Koreographer simplifies the process of synchronizing gameplay and animations to music and sound in your game or application. It’s simple editing interface allows you to map events in the game to rhythms, beats, notes, volume, and other dynamics of the music.
Enhance the cinematic quality of your game by tying visuals to your game’s music score
Create a rhythm game, enable lip syncing or add subtitles to audio with minimal effort
Precisely synchronize in-game events to different points in your game’s music
Rapidly create new music-based gameplay, animations, and effects
“I am very excited about what Koreographer means for game development… Koreographer really does represent a paradigm shift in how audio and visuals interact.”
Adam Creighton, Creative Director, Panic Button
“It’s so good… it gives me that ‘chills’ effect every time. Totally crazy.”
Erik Asmussen, 82 Apps, developer of Disco Dodgeball
Simplify the synchronization process
The visual authoring interface and in-game event system make it fast and easy to tie object and code parameters to audio and [Pro] MIDI events.
Enable new music and gameplay experiences
Explore game mechanics driven by music and make music a core part of your game. Or simply ratchet up that cinematic feel.
Enhance the music, don’t sacrifice game performance
Koreographer’s approach to music synchronization eliminates realtime music processing, leaving your game running at peak performance.
Keep synchronization on time, always
No more time spent debugging scripts and tweaking algorithms to resolve latency and other audio bugs across platforms.
Features
View the music in the Koreography timeline and precisely add game events and other outputs
[Pro] Import a MIDI file into Koreographer to quickly map notes or instrument data to game events
Gain live access to your music’s timeline from within your game: power animations with beats and musical events rather than built-in system timing
Tag and sync to any musical event, even those not picked up by automated music analysis algorithms. Tag tempo changes, notes, musical phrases, lyrics, percussion, crescendos, section changes, and more
Eliminates realtime music processing, leaving your game engine at peak performance
Drive animations, textures, particle effects, gameplay actions, and more with music
Perfectly execute subtitles, lyrics, and lip syncing - even includes a Karaoke demo! (demo requires Unity 5.0+)
Send customizable payloads to your game along with the music event, including curves, text, numbers, [Pro] Unity assets, [Pro] colors, and [Pro] frequency spectra
[Pro] Automatically generate events from the music using RMS and FFT analysis
Create Rhythm gameplay with ease - Koreographer even gets you started with a built-in Rhythm Game demo! (demo requires Unity 5.0+)
Compatibility
Supports Unity 4.5+.
[Pro] Integration with Audiokinetic’s Wwise 2017.1.0+ (new in 1.5.0!)†
[Pro] Integration with Firelight Technologies’ FMOD for Unity 2.0+ (new in 1.6.1)†
[Pro] Integration with Tazman Audio’s Fabric 2.2.2+ (new in 1.1.0!)
[Pro] Integration with Procedural Worlds’ SECTR COMPLETE (new in 1.3.0!)
[Backwards compatible with Make Code Now!'s SECTR Audio 1.2.1+]
[Pro] Integration with Dark Tonic’s Master Audio 4.2+ (new in 1.4.0!)
Integration with Hutong Games’ PlayMaker 1.7+ (new in 1.3.0!)
We don’t currently have plans to discount Koreographer or run a sale. That said, it is something we are considering for the future! Just nothing currently on the radar!
How well does this run on mobile?.. I am interested in specifically, Android. I have been toying around for a while with ideas related to a musical/tap game.
We haven’t run it on mobile ourselves, but some early beta users were very pleased! One of our beta users was even using the event system to control music transitions for a VR app on mobile (Samsung GearVR). It’s actually thanks to her that we have a configurable system for delaying event processing to maintain crisp synchronization (see the “Special Note About Event Delay” in the Koreographer User’s Guide).
The MIDI features are for reading MIDI files. Koreographer includes a MIDI Converter that takes a MIDI version of an AudioClip and allows you to convert MIDI information (like note value or velocity) into Koreography data.
We have used our MIDI library internally to receive MIDI data, but that required a separate, custom app or plugin that connected to the host OSes MIDI-framework (all OSes provide different interfaces for MIDI which complicates things).
Going to keep an eye out on this one. It is a little expensive for me right now, but I might take the plunge if I decide on doing a music based game. If any official tests are done via mobile platforms, I would love to hear about it.
Hey Everyone! We just released version 1.1.0 to the Unity Asset Store! Here’s a list of notable changes from version 1.0.1:
[NEW] Integration with Tazman Audio’s Fabric audio engine!
[NEW] HUGE fixes for runtime memory performance. We tracked down a slew of minor allocations in the API that could add up quickly over time. We think we got most of them but if you notice any allocations occurring, please let us know!
[NEW] AudioSourceVisor component. Enables simple Koreography Event triggering based on an associated AudioSource component (does not enable the Music Time API - use a Music Player if this is needed).
[NEW] Detect when Unity’s Audio System is disabled when using the Koreography Editor; offer to re-enable it.
[NEW] Core adjustments to make extending Koreographer easier by abstracting most of the “glue” visor code into the “VisorBase” class and removing AudioClip reference requirements on Koreography - matches now occur by name!
For the full list of release notes, click the version number on the asset store page.
Hey Folks! Version 1.2.0 just hit the Unity Asset Store! Here’s a handful of changes from version 1.1.0:
[NEW] Support for all Windows Phone 8 and Windows Store build targets! With these platforms joining the herd, Koreographer supports all platforms that Unity does (in Unity 4.5+)!
[NEW] Massive simplification and optimizations to the KoreographyTrack serialization system! Hurray performance!
[NEW] MIDI Converter can now Append/Replace Koreography Events to/in a Koreography Track!
The big news here, of course, is full support for the non-desktop Windows platforms. Those can be tricky due to C# API incompatibilities but we were able to wrangle things together to get a solid build moving!
For the full list of release notes, click the version number on the asset store page.
So many cool features to add, so little time! Back to it!
Koreographer does not do any runtime processing of audio data: the Koreography events are added in the Unity Editor either using the Koreography Editor or via the MIDI Converter. That said, Koreographer does support Unity’s Streaming AudioClip assets!
