Change Editor Cursor

Do we have access to changing the mouse cursor in an EditorWindow? If so, how is it possible?

Look into EditorGUIUtility.AddCursorRect for a selection of cursors. Or you can always hide the mouse and draw a texture at the mouse position.