Are only the assets that are used loaded?

I'm making an iPhone game. Is there a point to removing items in the assets folder I'm not using? Will it speed up my loading time? Or does the iPhone only load objects that are in that scene?

Thanks!

Unused asset are not loaded.