SmartVidFX Studio | AI Face Replacement, Mandarin Voice Cloning, Lip Sync

Live GPU preview
Split-screen illustration: a source portrait on the left and the same shot with a replaced face and tracking mesh on the right IDENTITY LOCK 98.7% SOURCE RESULT 4K · 25 fps · 18 ms/frame 普通话 · 声纹已匹配
00:14 / 00:38

What this plugin does

SmartVidFX Studio puts a complete AI performance toolkit inside the editor you already use. Drop the effect onto a clip, pick a target identity, and the plugin tracks, replaces and relights the face across the whole shot — no roto, no external app, no round-tripping through a render farm.

The second half of the toolkit is voice. Our speech models are trained on Mandarin first rather than bolted on afterwards, so tones land correctly, numbers and measure words are read the way people actually say them, and a cloned voice keeps its character across takes. Generate a narration track, match it to the new performance, and the lip-sync engine conforms the mouth shapes to the audio automatically.

Built for the way Chinese creators actually work

Short-form teams re-cut the same script for half a dozen platforms every week. Studios localise a finished ad for three regional markets on a two-day turnaround. Both need identity and voice changes that survive close-ups and compression — and both need them without a VFX department. That is the job this plugin was designed around.

  • Runs where you edit. A native plugin, not a web uploader — your footage never leaves the workstation unless you switch on cloud rendering.
  • Frame-accurate tracking. Handles profile turns, partial occlusion, glasses and motion blur without popping.
  • Consent-first identity library. Every stock identity ships with a signed release; your own uploads stay private to your seat.
  • Commercial use included. One licence covers client work, paid ads and platform monetisation for as long as the project lives.

Core modules

Three engines, one timeline

Everything below is included in the same plugin bundle. Enable a module per clip and stack them in any order.

AI face replacement

Swap a performer's identity across a full shot at up to 4K. Skin tone, grain and scene lighting are matched per frame so the result grades like original footage.

Mandarin voice generation

Text-to-speech trained on Chinese, with tone-accurate delivery, adjustable pace and emotion, plus voice cloning from roughly thirty seconds of clean reference audio.

Automatic lip sync

Conform mouth shapes to any generated or recorded track. Re-dub a finished edit into a new language without reshooting a single frame.

Local GPU rendering

Inference runs on your own card. Footage stays on the workstation, which keeps client NDAs simple and preview scrubbing responsive.

Batch & versioning

Queue a whole folder of clips against one identity and voice preset, then export platform-specific versions in a single pass.

Provenance & watermarking

Optional invisible watermarking and an exportable edit log, so you can show a client exactly which shots were synthetically modified.

Voice library preview

播音腔 · 男声Broadcast · Male 0:12
亲切口播 · 女声Conversational · Female 0:09
粤语 · 中性Cantonese · Neutral 0:15

Placeholder waveforms — wire these to real audio files before you show this to customers.


Workflow

From raw clip to delivered cut in three moves

No node graphs, no intermediate exports. If you can apply a transition, you can run this.

Drop it on the clip

Drag SmartVidFX from the effects panel onto any clip in the timeline. Tracking analyses the shot in the background while you keep cutting.

Pick an identity and a voice

Choose from the licensed library or upload your own reference. Adjust blend strength, age, and delivery style with a handful of sliders.

Render and ship

Export straight from your NLE. The licence travels with the project, so client deliveries and paid placements are already covered.

What's included

  • Face replacement engine with per-frame tracking
  • Mandarin & Cantonese TTS voice pack (24 voices)
  • Voice cloning from a 30-second sample
  • Automatic lip-sync conform
  • Licensed identity library (120 releases)
  • Batch queue and preset manager
  • Relight and skin-grain matching tools
  • Installer for macOS (Apple Silicon) and Windows
  • Bilingual documentation and sample project
  • 12 months of updates on every plan

Works with your editor

  • DR DaVinci Resolve 18 +
  • PR Adobe Premiere Pro
  • AE After Effects
  • FC Final Cut Pro
  • OF OpenFX host
  • CL CLI / watch folder

Names are listed for compatibility only. SmartVidFX Studio is not affiliated with, or endorsed by, any of these vendors.

Tags

More from SmartVidFX Labs

Ready to try it on a real timeline?

Pick a plan, install the plugin, and render your first swap in about ten minutes.