CharacterController falling through walls and ceiling

Hi guys. I have a simple CharacterController using the Move method to move around. Walking across the floor and is just fine. But, for example, when I rotate the room (room = floor, walls and ceiling - all of them Cube objects) by 90 degrees forcing the character to land on the wall (as it is the new floor at the moment), or by 180 degrees forcing the character land on the ceiling (as it is the new floor at the moment) is with random success, ie. the character falls through either the wall or the ceiling. Sometines it falls through before the rotation finishes, at other times, it is possible to walk across the wall or the ceiling, but after some time it falls through as well. Can you give me a hint as to what goes wrong with the walls and the ceiling if everything is alright when walking across the floor (0-degree rotation)? All the room Cube objects have BoxCollider enabled and the isTrigger option is off and have their thickness set to 50. The thickness of box colliders is set to 50 as well.

Update 01:
Adding mesh colliders to all surfaces (floor, walls, ceiling) did not resolve the issue.

Using shapes from the ProBuilder (asset store) addon resolved the issue and the character no longer falls through.