Edit Collider button not working at times?! [2D]

Ok, I know how to edit my colliders, but at times the edit collider button does not work! I click on the edit button to enable it but when I attempt to click on the green outline it deselects my object!

Am I missing an important step to able to edit my colliders? Maybe there is another mode that I am in that disallows editing coliders? Im not sure I can’t find further details regarding this issue!!

Example of what I am trying to describe: Screen capture - 0c946a81218c9d95f18f816e5a198dfe - Gyazo

Same as mine, could anybody help there?

There is just a VERY SMALL dot that you must click. If you miss it yes it will deselect your object. I know it’s frustrating but just be a little more careful.