Using Render Texture option does not work with graphic raycaster

I have a screen space UI canvas attached to a camera that renders to a render texture. The render texture is set as the base texture for a material that is on a plane viewed by another camera. The canvas shows perfectly, however the buttons and sliders are not interactable. When I set the camera to render to a display instead of a render texture the buttons and sliders work. How can I have this work while the camera renders to a render texture.