[VISION] Braindance like recording-tool for Gameplay Recording

Braindance like recording-tool for Gameplay Recording
Imagine you can do more than just record your normal View in a game. You can rewatch the whole game from everywhere in the scene and switch focusmodes like in Cyberpunks2077 brain dances or Matchrecording in some Ego-Shootergames.

Braindance:

Im building this tool just as a part of a bigger project, a research tool for my universtity, but I wanted to share some of my progress, thoughts and problems.

Right Now I stumbeld across 3 possible Ways to create this tool.

  • Find a Asset, which I havent found yet, to do the things I want.
    (would be okay for me and I can focus on other things)

  • Record the whole scene as a big animation and somehow replay it afterwards
    → Problem: I want to rewatch what happend without being in the Unity Editor

  • Get every transform value with timestamp in my scene, save it in a file.
    Reimport the file and build a interpreting unit for it, which recreates the whole scene while i am watching it.

I will to my best to build number 2 & 3. If someone allready knows how to do this easily or how big game-studios do this, tell me please.

If you thing my text is hard to understand or you find spelling mistake, well you have to live with i, Im not a english native speaker.

Update-Log:

  • 12.10.2022 - Trying out multiple things, asking for help, creating a thread

what kind of objects, animations, effects and things you have happening in the scenes?

for example if you want to record exact positions for (random) particle effects, wind, replaying physics, skinned mesh renderers, collisions or so, might get difficult…

does that braindance-thing record the scene as animated point cloud? can use interact with anything or just watch? (so no mouseovers from objects etc, which would require recording collider info…)

how long history it has, that you can “rewind” ?