How Do I Animate a Sprite in 4.3?

I get how the demo does it, but what if I have a bunch of different sprites that make different animations? Do I have to code some type of sprite manager to animate them frame by frame?

No, you can use Animation, where you can animate sprites, not only curves.
(Menu: Create > Animation)

Animator Controller