I’m having trouble removing a shadow from a specific object, but I don’t want to remove the shadows completely.
You should find what you need in the mesh renderer settings. There are settings for both cast and receive shadows. It isn’t clear exactly if you are wanting to remove the shadows on the object, or if you are wanting to remove the shadows that the object casts, but both options should be available in the mesh renderer settings.
See this page in the documentation.