We aim to unravel complex agent-environment interactions from trajectories, by explaining agent paths as combinations of predefined basic behaviors. We detect trajectory points signifying environment-driven behavior changes, ultimately disentangling interactions in space and time; our framework can be used for environment synthesis and authoring, shown by our case studies.