Overview

Transform and edit live video streams in realtime with AI. Our realtime models enable creative style transformations, precise video editing, lip synchronization, and lifelike avatar animation with minimal latency.

Choose between style transformation (Lucy Restyle Live) for artistic effects, video editing and character transformation (Lucy 2) for adding, changing, or removing elements and becoming any character, lip synchronization (LipSync Live) for matching a live video stream to audio, or avatar animation (Avatar Live) for bringing portrait images to life with audio.

Available Models

We offer specialized realtime models, each optimized for different use cases:

Model	Use Case	Example Prompts	Best For
Lucy Restyle Live	Style transformation	”Anime style”, “Cyberpunk city”, “Studio Ghibli animation”	Creative effects, artistic filters, visual themes
Lucy 2	Video editing + character reference	”Transform into this character”, “Add a dog”, “Change hair to blonde”	Character transformation, object manipulation, scene editing
LipSync Live	Realtime lip synchronization	Stream speech audio and sync lip movements to it	Live dubbing, voice agents, localized video experiences
Avatar Live	Avatar animation	”Smile warmly”, “Nod while speaking”, “Look enthusiastic”	Talking avatars, virtual presenters, interactive agents

Lucy Restyle Live - Video Restyling

Transform the overall visual style and aesthetic of your video stream. Perfect for creative applications, social media filters, and artistic effects.

Lucy 2 - Video Editing & Character Reference

Make specific edits to videos by adding, modifying, or removing objects and elements. Lucy 2 (lucy_2_rt) also supports character reference images — upload any face and see yourself transformed into that character in realtime.

LipSync Live - Realtime Lip Sync

Synchronize lip movements in a live video stream to incoming audio over WebSocket. Ideal for live dubbing, conversational agents, and voice-driven video experiences.

Avatar Live - Talking Avatars

Animate portrait images with audio input. Transform static images into lifelike talking avatars with synchronized lip movements and natural expressions. Perfect for virtual presenters, AI agents, and interactive experiences.

Quick Start

Installation

npm install @decartai/sdk

Basic Usage

Video Editing (Lucy 2)

import { createDecartClient, models } from "@decartai/sdk";

// Use Lucy 2 for video editing — supports text prompts and character reference
const model = models.realtime("lucy_2_rt");

const stream = await navigator.mediaDevices.getUserMedia({
  video: {
    frameRate: model.fps,
    width: model.width,
    height: model.height,
  }
});

const client = createDecartClient({
  apiKey: "your-api-key-here"
});

const realtimeClient = await client.realtime.connect(stream, {
  model,
  onRemoteStream: (editedStream) => {
    videoElement.srcObject = editedStream;
  },
});

// Text-only editing
await realtimeClient.set({ prompt: "Add a small dog in the background", enhance: true });

// Character transformation with a reference image
const characterPhoto = document.querySelector("input[type=file]").files[0];
await realtimeClient.set({
  prompt: "Transform into this character",
  image: characterPhoto,
  enhance: true,
});

Video Restyling (Lucy Restyle Live)

import { createDecartClient, models } from "@decartai/sdk";

// Use Lucy Restyle Live for style transformation
const model = models.realtime("mirage_v2");

const stream = await navigator.mediaDevices.getUserMedia({
  video: {
    frameRate: model.fps,
    width: model.width,
    height: model.height,
  }
});

const client = createDecartClient({
  apiKey: "your-api-key-here"
});

const realtimeClient = await client.realtime.connect(stream, {
  model,
  onRemoteStream: (transformedStream) => {
    videoElement.srcObject = transformedStream;
  },
  initialState: {
    prompt: { text: "Anime style", enhance: true }
  }
});

// Change styles dynamically
realtimeClient.setPrompt("Cyberpunk city");
realtimeClient.setPrompt("Studio Ghibli animation");

Avatar Live

import { createDecartClient, models } from "@decartai/sdk";

// Use Avatar Live for talking avatars
const model = models.realtime("live_avatar");

// Load avatar image
const avatarImage = await fetch("/portrait.jpg").then(r => r.blob());

const client = createDecartClient({
  apiKey: "your-api-key-here"
});

// Connect with avatar image (no camera needed)
const realtimeClient = await client.realtime.connect(null, {
  model,
  initialState: { image: avatarImage },
  onRemoteStream: (animatedStream) => {
    videoElement.srcObject = animatedStream;
  }
});

// Play audio to animate the avatar
const audioFile = document.querySelector("input[type=file]").files[0];
await realtimeClient.playAudio(audioFile);

// Set avatar behavior
await realtimeClient.setPrompt("Smile warmly and nod");

Use Cases & Examples

Video Restyling with Lucy Restyle Live

Perfect for creative applications and visual effects:

• Social Media Filters: “Anime style”, “Vintage film”, “Oil painting”
• Content Creation: “Studio Ghibli animation”, “Cyberpunk aesthetic”, “Watercolor art”
• Live Streaming: “Cartoon style”, “Neon synthwave”, “Impressionist painting”
• Virtual Events: “Fantasy world”, “Futuristic setting”, “Medieval theme”

Video Editing & Character Transform with Lucy 2

Ideal for content modification, character-driven experiences, and interactive apps:

• Character Transformation: Upload a reference image and become that character — your movements and expressions map onto the reference identity
• Object Addition: “Add a dog running around”, “Add birds flying overhead”, “Add flowers in the foreground”
• Appearance Changes: “Change hair to blonde”, “Add sunglasses”, “Change shirt color to red”
• Object Removal: “Remove the car from the scene”, “Remove the tree”, “Remove background objects”
• Scene Modifications: “Replace the background with a beach”, “Add snow falling”, “Change day to night”

Realtime Lip Sync with LipSync Live

Ideal for voice-driven video experiences:

• Live Dubbing: Replace or localize speech while keeping natural-looking mouth motion
• Voice Agents: Drive a prerecorded character or spokesperson video with live model-generated audio
• Interactive Characters: Pair TTS and dialogue systems with a consistent video identity
• Media Localization: Prototype translated or alternate-audio versions of portrait video quickly

Avatar Animation with Avatar Live

Perfect for virtual presenters and interactive agents:

• Virtual Presenters: Animate company spokespersons or brand mascots with pre-recorded audio
• AI Agents: Create lifelike conversational agents that speak with natural expressions
• Content Creation: Generate talking head videos from static portraits
• Interactive Experiences: Build real-time avatar interactions with live audio input

Getting Started

Choose your model based on your use case:

Video Restyling

Transform video styles with the Lucy Restyle Live model. Perfect for creative effects and artistic transformations.

Lucy 2

Character transformation and video editing with Lucy 2.

Video Editing (Legacy)

Edit video content with the original Lucy model.

LipSync Live

Synchronize lip movements in a live video stream to incoming audio.

Avatar Live

Animate portraits with audio using the Avatar Live model. Create lifelike talking avatars.