Ignore Particular Collisions

Is there a way to ignore collisions between two particular colliders, but not other colliders?

I have a system of Game Objects that are connected by hinge and fixed joints and I want to change the scale of certain components, but when I do this, the components collide with eachother, which I want to avoid. I doubt it will be possible by strategically locating the joints.

Physics.IgnoreCollision

–Eric