How do I specify a prefab in a json file?

Have you heard about ScriptableObjects? You can link anything in Unity using them.

And you can build up vast chains of interesting structures this way.

Using ScriptableObjects to configure game modes and play modes:

ScriptableObject usage in RPGs:

Usage as a shared common data container: