SALSA LipSync Suite
Crazy Minnow Studio, LLC youtube | website | unity forum | documentation | email
The SALSA LipSync v2 suite has been completely re-written to provide more flexibility, a much higher degree of perceived accuracy, and more advanced animation technologies for your character models. Mix and match blendshapes, transforms, sprites, textures, Animator parameters, C# events, etc. to create unlimited viseme and emote expressions. Expression components can now be reused within and across modules without conflict. The Suite includes three product modules to simplify 2D/3D lipsync, eye/head movement, and emote expression projects:
SALSA LipSync
Simple Automated Lip Sync Approximation provides high quality, language-agnostic, lip sync approximation for your 2D and 3D characters. Audio dialog files are processed in real-time with our new look-ahead technology to reduce/eliminate timing lag. Audio processing works equally well with 2D or 3D audio configurations. You will get amazing results without labor intensive phoneme mapping or baking.
EmoteR
The emote randomization engine works alone or along-side SALSA and Eyes to drive random, emphasis-timed, repeating, or manual expression animations. Link with SALSA to add emphasis emotes with audio-based timing. Emotes are fired with priority over other expressions and seamlessly blend in and out using our new QueueProcessing technology to manage animation and overriding priority.
Eyes
This module focuses on eye, eyelid, and head animation (and tracking). Allow your character model to randomly look around or configure her to focus on a target object with advanced micro-movements to eliminate static, robot-stare. Take control over vertical and horizontal saccade movements for more realism. And, if your model supports it, enable the new eyelid tracking option for the ultimate animation nuance.
Custom component inspectors enable code-free configuration options, while our simple API provides behind-the-scenes accessibility from any Unity supported scripting language.
Check out the documentation for more detailed information.
Supports the latest OFFICIAL RELEASE versions of Unity (v2017.4+).
NOTE: Some add-ons/integrations may require newer Unity versions.
Tested on Windows, Mac, Linux, Android, iOS, and Universal Windows Platform. WebGL lipsync is only supported when combined with our Amplitude asset.
Works with:
•Autodesk (ACG) (OneClick setup available)
•DAZ3D (OneClick setup available)*
•Fuse Character Creator (OneClick setup available)
•Reallusion iClone/CC3 (OneClick setup available)
•UMA DCS (OneClick setup available)
•Create your own OneClicks
•Any model or modeling system with sufficient facial animation controls (see requirements)
•Adventure Creator
•Amplitude for WebGL
•Cinema Director
•Cinematic Sequencer - SLATE
•Dialogue System for Unity
•Dissonance Voice Chat (multiplayer lipsync)
•Master Audio Playlists/Groups
•MorphMixer (BlendShape mixing)
•NodeCanvas
•Photon Voice (multiplayer lipsync)
•Playmaker
•Real-time microphone lip-sync
•RT-Voice (runtime text-to-speech)
•TextSync (text-to-lipsync)
•Unity Timeline
*DAZ3D OneClick setup supports Genesis, Genesis 2, Genesis 3, Genesis 8, and Emotiguy models.
** The Suite core packages are compiled. Add-ons include source code unless otherwise noted.
The SALSA LipSync v2 suite has been completely re-written to provide more flexibility, a much higher degree of perceived accuracy, and more advanced animation technologies for your character models. Mix and match blendshapes, transforms, sprites, textures, Animator parameters, C# events, etc. to create unlimited viseme and emote expressions. Expression components can now be reused within and across modules without conflict. The Suite includes three product modules to simplify 2D/3D lipsync, eye/head movement, and emote expression projects:
SALSA LipSync
Simple Automated Lip Sync Approximation provides high quality, language-agnostic, lip sync approximation for your 2D and 3D characters. Audio dialog files are processed in real-time with our new look-ahead technology to reduce/eliminate timing lag. Audio processing works equally well with 2D or 3D audio configurations. You will get amazing results without labor intensive phoneme mapping or baking.
EmoteR
The emote randomization engine works alone or along-side SALSA and Eyes to drive random, emphasis-timed, repeating, or manual expression animations. Link with SALSA to add emphasis emotes with audio-based timing. Emotes are fired with priority over other expressions and seamlessly blend in and out using our new QueueProcessing technology to manage animation and overriding priority.
Eyes
This module focuses on eye, eyelid, and head animation (and tracking). Allow your character model to randomly look around or configure her to focus on a target object with advanced micro-movements to eliminate static, robot-stare. Take control over vertical and horizontal saccade movements for more realism. And, if your model supports it, enable the new eyelid tracking option for the ultimate animation nuance.
Custom component inspectors enable code-free configuration options, while our simple API provides behind-the-scenes accessibility from any Unity supported scripting language.
Check out the documentation for more detailed information.
Supports the latest OFFICIAL RELEASE versions of Unity (v2017.4+).
NOTE: Some add-ons/integrations may require newer Unity versions.
Tested on Windows, Mac, Linux, Android, iOS, and Universal Windows Platform. WebGL lipsync is only supported when combined with our Amplitude asset.
Works with:
•Autodesk (ACG) (OneClick setup available)
•DAZ3D (OneClick setup available)*
•Fuse Character Creator (OneClick setup available)
•Reallusion iClone/CC3 (OneClick setup available)
•UMA DCS (OneClick setup available)
•Create your own OneClicks
•Any model or modeling system with sufficient facial animation controls (see requirements)
•Adventure Creator
•Amplitude for WebGL
•Cinema Director
•Cinematic Sequencer - SLATE
•Dialogue System for Unity
•Dissonance Voice Chat (multiplayer lipsync)
•Master Audio Playlists/Groups
•MorphMixer (BlendShape mixing)
•NodeCanvas
•Photon Voice (multiplayer lipsync)
•Playmaker
•Real-time microphone lip-sync
•RT-Voice (runtime text-to-speech)
•TextSync (text-to-lipsync)
•Unity Timeline
*DAZ3D OneClick setup supports Genesis, Genesis 2, Genesis 3, Genesis 8, and Emotiguy models.
** The Suite core packages are compiled. Add-ons include source code unless otherwise noted.
