Lipsync Video: Emotion-Aware Face Reanimation from Audio on playground and API | RunComfy
Sync React-1 reanimates facial performance from audio or emotion prompts with identity-preserving lipsync video-to-video and audio-to-video edits up to 4K for filmmakers, localization, and post-production teams.
Table of contents
1. Get started
Use RunComfy's API to run sync/react-1. For accepted inputs and outputs, see the model's schema.
curl --request POST \
--url https://model-api.runcomfy.net/v1/models/sync/react-1 \
--header "Content-Type: application/json" \
--header "Authorization: Bearer <token>" \
--data '{
"video_url": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-1.mp4",
"audio_url": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-2.mp3"
}'2. Authentication
Set the YOUR_API_TOKEN environment variable with your API key (manage keys in your Profile) and include it on every request as a Bearer token via the Authorization header: Authorization: Bearer $YOUR_API_TOKEN.
3. API reference
Submit a request
Submit an asynchronous generation job and immediately receive a request_id plus URLs to check status, fetch results, and cancel.
curl --request POST \
--url https://model-api.runcomfy.net/v1/models/sync/react-1 \
--header "Content-Type: application/json" \
--header "Authorization: Bearer <token>" \
--data '{
"video_url": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-1.mp4",
"audio_url": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-2.mp3"
}'Monitor request status
Fetch the current state for a request_id ("in_queue", "in_progress", "completed", or "cancelled").
curl --request GET \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/status \
--header "Authorization: Bearer <token>"Retrieve request results
Retrieve the final outputs and metadata for the given request_id; if the job is not complete, the response returns the current state so you can continue polling.
curl --request GET \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/result \
--header "Authorization: Bearer <token>"Cancel a request
Cancel a queued job by request_id, in-progress jobs cannot be cancelled.
curl --request POST \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/cancel \
--header "Authorization: Bearer <token>"4. File inputs
Hosted file (URL)
Provide a publicly reachable HTTPS URL. Ensure the host allows server‑side fetches (no login/cookies required) and isn't rate‑limited or blocking bots. Recommended limits: images ≤ 50 MB (~4K), videos ≤ 100 MB (~2–5 min @ 720p). Prefer stable or pre‑signed URLs for private assets.
5. Schema
Input schema
{
"type": "object",
"title": "Input",
"required": [
"video_url",
"audio_url"
],
"properties": {
"video_url": {
"title": "Video URL",
"description": "URL to the input video. Must be 15 seconds or shorter.",
"type": "string",
"default": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-1.mp4"
},
"audio_url": {
"title": "Audio URL",
"description": "URL to the input audio. Must be 15 seconds or shorter.",
"type": "string",
"default": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-2.mp3"
},
"emotion": {
"title": "Emotion",
"description": "Emotion prompt for the generation. Currently supports single-word emotions only.",
"type": "string",
"enum": [
"happy",
"angry",
"sad",
"neutral",
"disgusted",
"surprised"
],
"default": "neutral"
},
"model_mode": {
"title": "Model Mode",
"description": "Controls the edit region and movement scope for the model.",
"type": "string",
"enum": [
"lips",
"face",
"head"
],
"default": "face"
},
"lipsync_mode": {
"title": "Lipsync Mode",
"description": "Lipsync mode when audio and video durations are out of sync.",
"type": "string",
"enum": [
"cut_off",
"loop",
"bounce",
"silence",
"remap"
],
"default": "bounce"
},
"temperature": {
"title": "Temperature",
"description": "Controls the expressiveness of the lipsync.",
"type": "float",
"default": 0.5,
"minimum": 0,
"maximum": 1
}
}
}Output schema
{
"output": {
"type": "object",
"properties": {
"image": {
"type": "string",
"format": "uri",
"description": "single image URL"
},
"video": {
"type": "string",
"format": "uri",
"description": "single video URL"
},
"images": {
"type": "array",
"description": "multiple image URLs",
"items": { "type": "string", "format": "uri" }
},
"videos": {
"type": "array",
"description": "multiple video URLs",
"items": { "type": "string", "format": "uri" }
}
}
}
}RunComfy is the premier ComfyUI platform, offering ComfyUI online environment and services, along with ComfyUI workflows featuring stunning visuals. RunComfy also provides AI Models, enabling artists to harness the latest AI tools to create incredible art.