shipped / October 16, 2026

Dub Anything: a coding agent directs a film dub line by line, in the actors' own voices, on your own PC

score language pairs: 7

swax wanted to watch shows that have no subtitles or dub in any language they speak. So they built Dub Anything, a repo you clone, open in Claude Code, Codex or Cursor, and ask to dub a video. The scripts split, separate, transcribe and clone the voices locally. The agent is the dubbing director, correcting the transcript, translating for the screen and timing every line to the actor's lips. It checks its own dub by running it back through Whisper and revising it; you only listen when tuning the system.

Built by swax with Claude Code and Codex.

pythonclaude codecodexcursorclaude opus 5.5agentsagents.mddubbingvoice cloningwhisperffmpeglocalvideosubtitlestool

What it is

Dub Anything is a repo you clone, open in Claude Code, Codex or Cursor, and ask: dub this file into English. Back comes the same video with a new default audio track in the original actors' voices, the original audio as a second track, subtitles in both languages, and the music and effects left alone. It runs on a Mac or a Windows PC with an NVIDIA card, and the README says the internet is used only to download the models. It dubs Japanese, Spanish, Korean and Chinese into English, and English into Japanese, Spanish and Cantonese. Ask for a pair that is not there yet and "your agent adds it as part of the job."

Eight steps: split the video into roughly three-minute parts at pauses in speech, separate voices from music, transcribe with Whisper large-v3 plus two second opinions, cast each line by matching voices across the whole show, direct, voice (OmniVoice clones the actor), fit and mix and check, then deliver with nothing re-encoded. Two YouTube demos show an anime and a live-action Japanese film, both dubbed into English.

How it was built

swax has been on Hacker News since 2008 and has a GitHub full of agent tooling, including NAISYS, a "command shell driver for LLMs." The post opens with the problem: shows with "neither subtitles or dubs in English (or any other language). Pretty much impossible to watch." The repo holds "all the scripts and guidance I've developed over the past few weeks." It went public on October 7, and more than half of the recent commits carry Claude Opus 5.5 as co-author.

The twist is step five. AGENTS.md puts it plainly: "The scripts are instruments. They produce evidence and do the heavy lifting, but they never decide." The agent is the dubbing director. It corrects the transcript from context, translates "for the screen, not the page," splits long lines at the actor's pauses so the English lands where the lips move, keeps running jokes consistent across a show, and leaves names and sung lines in the original audio. On a feature film it directs the first few parts itself, writes show notes, then farms the rest out to subagents. The guide budgets about seven hours of GPU time for a film.

The agent also checks its own work: it runs Whisper over the finished dub to hear what it made and revises lines automatically. swax clarified on X that active listening is only needed when tuning the system; normally you give it the video and the target language and it does the rest. The docs still leave you the final word on taste and on what may be cloned at all. The README is clear on rights: only dub media you have the rights to, and a dub of someone else's film or voice stays private. It is also "self improving": "each dub may modify the scripts for better fidelity," and swax asks you to push those changes back.

Why we picked it

Because the job title is dubbing director, and the director checks its own takes. It reads every transcript, times every lip, runs the finished dub back through Whisper and fixes what it hears, so a human only steps in to tune the system. Also because "Know when to stop, and say so" belongs in every AGENTS.md ever written.


Shipped is Accept All's daily pick of things people build with AI, written by MK, updated October 16, 2026. We are not affiliated with swax; the work and the credit are theirs, so go tell them it's good. Newer: Five Hundred Clocks: Opus 5.5 ran its own subagents for 18 hours and built 500 clocks into one HTML file. Older: Factory DS: a Factorio-like for the 2004 Nintendo DS, built with Claude Code and tested by agents that play badly.