ATM this is down either manually storing the button state (or querying it directly like Mouse.current.leftButton.isPressed) or writing a custom composite.
ButtonWithOneModifier only works with buttons and not with Vector2 controls. The request for this kind of functionality has come up frequently. We’re planning to have a universal ControlWithOneModifier composite in 1.1.