Agent Upstart

Cool things people are building with agents — and practical help getting the most out of them.

Playbooks · Coding

MOSS-Live: full-duplex spoken AI

Written November 10, 2026

MOSS-Live is a spoken AI that listens and talks at the same time, so a conversation can be interrupted, corrected, and resumed without the turn-taking pause. It also keeps working on a task in the background while the conversation goes on.

The problem

Most voice agents take turns: you speak, they answer, and anything you say mid-answer waits or gets lost. A real conversation does not work that way. A short "mm-hmm" means keep going, a pause may mean someone is thinking, and a new question can interrupt an explanation. A spoken assistant that cannot tell those apart either talks over you or waits too long. MOSS-Live, from the OpenMOSS team, is built around that problem: full-duplex speech, live visual understanding, and background task execution in one continuous conversation.

What it does

The design splits the work in two: a foreground that runs on the timescale of the conversation, and a background that runs on the timescale of the task. A shared coordination layer connects them through memory, context, and task state.

What the authors measured

The post compares MOSS-Live with GPT Realtime 2.1, GPT-Live-1, Doubao SeedDuplex, and two Qwen Audio 3.0 models across six benchmarks and 36 metrics. The figures below are the authors', from that comparison:

Three worked examples in the post show the shape of it: joining a group meeting and summarising decisions, replanning a road trip while hotel and ferry questions come in, and guiding an English-speaking visitor around Shanghai through the live camera.

Trying it

MOSS-Live can be tried in the online playground linked from the post, or integrated through its realtime API guide. The post also links the code repository. Plan a trip, change your mind halfway through, or turn on the camera and talk about what you see — that is the authors' own suggestion for a first try.

Limits

Related playbooks

Sources

Back to: Coding playbooks hub · Also: SafetyPulse: catch safety drift in tuning · Project Eve: Claude plays MMORPGs