Issue with two cameras and fog

So I’ve been trying to find a solution for a long time and still not sure how to fix this issue. I have two camera, one that has post processing and another to ignore post processing on certain objects that use the layer IgnorePostProcessing.

The problem is any object that is ignored by post processing camera is causing fog to not be applied to these objects.

Not sure if this is a unity bug or if I need to change something?

Camera settings: