Character input works but gets dragged back for no reason

Im making a 2D platformer but my character is getting dragged back to the starting position it can only move 0.2 away from its place.

My character has box collider and Rigidbody2D but it doesnt fall to the ground which has a box collider on it. I only have one piece of code which consists of this:

using System.Collections;
using System.Collections.Generic;
using UnityEngine;
public class PlayerMovement : MonoBehaviour
{
    public float moveSpeed = 5f;
    // Start is called before the first frame update
    void Start()
    {
        
    }

    // Update is called once per frame
    void Update()
    {
        Jump();
        Vector3 movement = new Vector3(Input.GetAxis("Horizontal"), 0f, 0f);
        transform.position = movement * Time.deltaTime * moveSpeed;
    }

    void Jump()
    {
        if(Input.GetButtonDown("Jump"))
        {
            gameObject.GetComponent<Rigidbody2D>().AddForce(new Vector2(0f, 5f), ForceMode2D.Impulse);
        }    

    }
}

@TheNyteEagle You need to do += instead of =

transform.position += movement * Time.deltaTime * moveSpeed;