Well I found a way to deselect all elements without destroying and creating the gameobject to have it load -1 from the prefab.
I basically had to trick unity into thinking there was a third element to set the value to 3, otherwise it wouldn’t except any values that didn’t have items to them.