Panim LipSync V2

AI lip sync for Blender, from audio to animated mouth in minutes.

Runs locally No cloud service Blender 4.1-5.0 Shape Keys, Bones, ARKit Batch mode
20% OFF Limited launch offer VER02 Copied!

What's New in V2.0

The biggest update yet. Tap any tab to explore the new features.

Allosaurus Engine

Whisper and Allosaurus now side by side. Whisper estimates phonemes from speech-to-text. Allosaurus detects them directly from audio acoustics, more precise, and supports 2,000+ languages.

  • Whisper for clear speech in common languages
  • Allosaurus for direct acoustic detection
  • Install one or both, switch anytime
  • Works across all three animation modes

Binary Dominant Viseme

Only the dominant viseme gets set to 1. Everything else drops to 0. A hard switch between mouth shapes that gives a clean, snappy 2D-style animation feel, great for stylized or cartoon characters.

Available for Shape Keys and Bone modes. Can be toggled per-project in Processing Options.

Post Processing

A dedicated panel handles Butterworth filter smoothing for softer keyframe curves, and animation transfer (copy, paste) between compatible characters.

Zero extra setup needed. Apply smoothing and transfer directly after generating your animation.

Refinement Panel

After generating, navigate and inspect each phoneme keyframe individually. Replace, reassign, or remove specific mouth shapes without re-processing the full audio.

Available for Shape Keys mode only.

Works with your rig.

Shape keys, bone actions, or ARKit blendshapes, Panim adapts to whatever your character uses.

All modes include
Whisper + Allosaurus Batch processing Auto eye blink Local processing Post-processing smoothing

Shape Keys

  • Auto shape key mapping
  • Refinement Panel
  • Copy and Paste
  • Binary Viseme

Bone Actions

  • Action-based mapping
  • Visible bones only
  • Full action support
  • Binary Viseme

ARKit

  • Visual mapping
  • Multi-shape categories
  • Jaw intensity sliders
  • ARKit blendshape workflow

Built for character dialogue.

Panim is made for Blender artists who need fast lip sync without rebuilding their rig workflow.

Character animators

Generate mouth animation from audio for shape keys, bone actions, or ARKit rigs without changing how your character is built.

Dialogue scenes

Batch process multiple characters and audio clips with frame markers, built for scenes with more than one speaker.

Stylized rigs

Use smooth blending for natural motion or Binary Viseme mode for clean, readable cartoon-style mouth shapes.

Every detail covered.

From multilingual audio to production-ready bone rigs, Panim gives you the tools to do it right.

Multilingual Support

Allosaurus uses universal IPA phoneme recognition across 2,000+ languages, no language configuration needed. Whisper supports dozens of the most common languages with a configurable language setting.

Switch engines freely depending on the audio you're working with.

Flexible Mapping

Each phoneme group points to the specific blend shapes or bone actions in your rig. Set it up once and reuse on every audio file.

Supports Shape Key, Bone, and ARKit modes with auto-detection for standard naming or manual override for any custom rig.

Animate multiple characters at once

Add multiple characters, assign individual audio clips with frame markers, and process them all in a single click. Built for scenes with more than one speaking character.

Built for Blender character rigs: local AI phoneme detection, Shape Keys, Bones, ARKit, batch dialogue, and post-processing tools in one workflow.

Changelog for V2.0

01 — New

Allosaurus Engine

Direct acoustic phoneme detection from audio. Supports 2000+ languages out of the box.

02 — New

Binary Viseme

Hard switch between mouth shapes. Only the dominant viseme activates at full value.

03 — New

Post-Processing

Butterworth smoothing, animation transfer, and delete controls in one panel.

04 — New

Eye Blinks

Randomized blink generation with auto-detect across all animation modes.

05 — New

Refinement

Navigate and replace any phoneme keyframe after baking the animation.

06 — Improved

Bone Performance

Visible bones only by default. Much faster performance on complex rigs.

07 — Improved

UI Cleanup

Icon-only toolbar with dedicated panels for a cleaner workspace.

08 — Fixed

Windows Install

Dependencies survive Blender restart. scipy installs safely with --no-deps.

Three steps.

From raw audio to fully animated mouth, done in minutes, or even seconds.

Load Audio

Import MP3, WAV, OGG, FLAC, M4A, or AAC. Works in any language with no extra configuration.

Process

Panim detects phonemes locally using your chosen engine and maps them to your rig's visemes.

Animate

Shape keys or bone actions get keyframed automatically. Refine individual frames as needed.

What you need.

Panim runs entirely on your machine. No cloud service, no internet required after the initial model download.

System

  • Blender 4.1 to 5.0
  • RAM 8GB+ recommended (16GB+ for Whisper Large)
  • Storage ~5GB for models and dependencies
  • Windows VC++ 2015–2022 Redistributable x64
  • Mac Limited support, not actively tested

Engines

  • Whisper ~74MB–2.9GB depending on model size
  • Allosaurus ~100MB fixed model
  • Internet Only needed once to download the model
  • GPU CUDA and Metal accelerated automatically if available
  • Audio MP3, WAV, OGG, FLAC, M4A, AAC

Compatibility Notes

Mac support is limited and not actively tested. Windows is the primary supported platform.

Windows requires a one-time Blender restart after installing dependencies.

Internet is only required once per engine to download the AI model. After that, everything runs locally.

Refinement Panel is available for Shape Keys mode only, not for Bone Actions or ARKit.

Thanks To

"character_02" by BuuMya is licensed under Creative Commons Attribution (Sketchfab).

"2D mouth with shape keys phonemes" by myname, from BlendSwap.com (BlendSwap).

"Ellie - Character Rig" from Blender Studio (Character Link).

"Victoria - Character Rig" from Blender Studio (Character Link) (Temporarily displayed in the video).

Song: LAKEY INSPIRED - Going Up

To allow characters to be used for demonstration of the tool.

Important

The characters, music, and other files used in demonstrations and examples are not included with this addon. If you want to test with similar assets, you can download them from the sources listed in the "Thanks to" section above.

Thank you!