I have arrows to control the player on the screen and the player has a collider. So if the player jumps it would hit the arrow buttons which would affect the gameplay. I have tried OnMouseDown/Up and Raycast2D but it all requires colliders. Is there anyway to detect touch without collider or make a layer with colliders?
You can use a layer mask parameter in your ray casting to ignore specific Physics layers. Also, you can configure Physics layers to ignore each other, as in the case of your Player and Arrow buttons in Edit > Project Settings > Physics2D
What about OnCollisonEnter?