Voice Lab

Web experiment · 2026 · Live lab

A body for a voice agent. It listens, takes a breath while it thinks, then speaks.

Play with the lab ↗

Voice agents have no body language. Voice Lab gives one a body: an orb that reacts to both sides of the conversation, your voice and the agent's.

Every frame, it reads each voice separately: loudness, pitch, intonation, syllables and speaking rate. It tracks who's talking, when people overlap, and the pause while the agent thinks.

That becomes a set of states: rest, listen, think, speak, yield, settle.

It's a lab, so the orb comes in variants, like Charcoal and Graphite, with a live tuner and a simulated conversation for tuning without a mic.

Kind
Web experiment
Status
Live lab
Stack
TypeScript, Three.js, Web Audio, Gemini Live
Year
2026
Voice Lab

01 / Something to look at

In April I was building a voice app, and it needed something to look at while it talked: a sphere of a few thousand particles that gathered and moved with the sound.

Voice Lab is what came after: an orb that knows whose turn it is.

Voice Lab: Charcoal mid-conversation, with the lab's controls
Voice Lab: Charcoal mid-conversation, with the lab's controls

02 / Both sides of the call

October 4 it became its own lab. One audio setup hears your mic and the agent's voice separately, and measures the agent as you hear it, not when the audio arrives.

On top of that, a presence layer. At rest it breathes. When you talk it turns toward you and echoes your rhythm. While the agent thinks, it inhales. When it speaks, the syllables come out springy. Cut in and it yields.

A real agent to talk to, connected with a short-lived token so no key reaches the browser. And a pretend conversation, so I can tune it without talking for an hour.

Voice Lab: Charcoal, a rubbed charcoal orb mid-conversation
Voice Lab: Charcoal, a rubbed charcoal orb mid-conversation

03 / Many bodies

Every orb is one small file against the same contract, so a new idea is a copied file. There have been a ring, ripples, a marbled drop, a murmuration.

The two I keep coming back to are dust on paper. Graphite is an even sprayed disc. Charcoal is rubbed: dark where the hand pressed, lighter in the middle, a dusty edge. Both sit on a fixed paper grain, so thin pigment only catches the tops of it.

A tuner on the side has a slider for everything, and copies the settings out when one feels right.

Voice Lab: Graphite with the tuner open, a slider for everything
Voice Lab: Graphite with the tuner open, a slider for everything

04 / Cards and typing

Then the agent got hands. Ask what's on today and a calendar card unfolds out of the orb. Say you're done with it and it folds back in. A list, a timer, the same way. Drag a card out and it stays where you drop it. All sample data.

Typing became a voice too. Speed, pauses, deletes and where the caret is all feed the same presence, so the orb leans in and reads along the line as you write.

Voice Lab: voice cards, a to-do list and a calendar unfolded from the orb (sample data)
Voice Lab: voice cards, a to-do list and a calendar unfolded from the orb (sample data)

05 / Where it went

The lab is open to play with: pick an orb, start the pretend conversation, drag the sliders. Headphones help.

Its audio engine is what Vance listens with, the orb on the front of this site.

Voice Lab: typing, the orb leaning in to read along the line
Voice Lab: typing, the orb leaning in to read along the line
Voice Lab: Graphite, a sprayed grey orb
Voice Lab: Graphite, a sprayed grey orb