State Space Constrains/Bounds?

Unity Engine
,
1

Hi,

I’m developing an environment where the agent moves objects around. Is there a way to set constraints on the state space? Eg. set a minimum and maximum local position the agent can take? I’m asking because I don’t want the agent to just move the object to the left for infinity for example. So far I’ve placed walls to delimit the area and use a collider to reset the episode, but this seems a bit silly and is also affecting my camera sensors as the walls are in some of their field of view. I’ve scoured the documentation and forums but haven’t found anything of the sort but I’d be surprised if it hasn’t come up before?

Thanks in advance :slight_smile:

2

You could just add a negative reward if the agent moves too far away from it to prevent it going too much.
Invisible walls would solve at least the camera problem.
And as for the move infinite to the left moving, that is way usually each step should have a cost and a max step amount.