Light patches when baking lighting. (Only happens when 2 objects are close to each other)

I’ve been trying to bake the lights in my scene, and everything looks fine until I add an object too close to the wall, then these light patches happen.


I cannot seem to figure out what is causing them.
These are my light settings:

Also, it seems like I cannot change the indirect resolution

This is a bake without the object.

Issue was caused because my normals were facing inside out