Move 2 object by mouse to same position

Im trying to make simple RPG where players controls 4 characters (party).
Now Im struggling with that problem:
Im using Raycast to point position where each character should go, but It generates problem. Characters trying to get there are stuck on trying to get to this tiny point (characters are rigidbody). The are just shaking forcing ther way to that point.
How can I change that?
here is my moving script

var ray = Camera.main.ScreenPointToRay (Input.mousePosition);
        // var hit : RaycastHit;     
         //sprawdzanei czy trafilo we wroga   
         // this code show nameobject with click
         var hit : RaycastHit;
		if (Input.GetMouseButtonDown(0))

var hitdist = 0.0;


                if (playerPlane.Raycast (ray, hitdist)) 
                    var targetPoint = ray.GetPoint(hitdist);
                    targetPosition = ray.GetPoint(hitdist);
                    var targetRotation = Quaternion.LookRotation(targetPoint - transform.position);
                    transform.rotation = targetRotation;    



			var dir:Vector3 = targetPosition - transform.position;
    		var dist:float = dir.magnitude;
   			var move:float = speed * Time.deltaTime;
		    if (transform.position.y<50) transform.position.y=50;
		    if(dist > move)
		   		 transform.position += dir.normalized * move;
		  	  transform.position = targetPosition;
            transform.position += (targetPosition - transform.position).normalized * speed * Time.deltaTime; 


You mean they kinda huddle over the destination point? I remember I had that issue, I just added another check to see if the’re within a certain range to the destination that left enough room for all of them. So instead of if(dist > move) I would try var minrange: int = 5; if(dist > minrange), and lose the else function, I guess if you’re teleporting all of the characters to the same spot their rigidbodies will start shoving each other.