Voice Lab
A body for a voice agent. It listens, takes a breath while it thinks, then speaks.
Voice agents have no body language. Voice Lab gives one a body: an orb that reacts to both sides of the conversation, your voice and the agent's.
Every frame, it reads each voice separately: loudness, pitch, intonation, syllables and speaking rate. It tracks who's talking, when people overlap, and the pause while the agent thinks.
That becomes a set of states: rest, listen, think, speak, yield, settle.
It's a lab, so the orb comes in variants, like Charcoal and Graphite, with a live tuner and a simulated conversation for tuning without a mic.
- Kind
- Web experiment
- Status
- Live lab
- Stack
- TypeScript, Three.js, Web Audio, Gemini Live
- Year
- 2026

01 / Something to look at
In April I was building a voice app, and it needed something to look at while it talked: a sphere of a few thousand particles that gathered and moved with the sound.
Voice Lab is what came after: an orb that knows whose turn it is.

02 / Both sides of the call
October 4 it became its own lab. One audio setup hears your mic and the agent's voice separately, and measures the agent as you hear it, not when the audio arrives.
On top of that, a presence layer. At rest it breathes. When you talk it turns toward you and echoes your rhythm. While the agent thinks, it inhales. When it speaks, the syllables come out springy. Cut in and it yields.
A real agent to talk to, connected with a short-lived token so no key reaches the browser. And a pretend conversation, so I can tune it without talking for an hour.

03 / Many bodies
Every orb is one small file against the same contract, so a new idea is a copied file. There have been a ring, ripples, a marbled drop, a murmuration.
The two I keep coming back to are dust on paper. Graphite is an even sprayed disc. Charcoal is rubbed: dark where the hand pressed, lighter in the middle, a dusty edge. Both sit on a fixed paper grain, so thin pigment only catches the tops of it.
A tuner on the side has a slider for everything, and copies the settings out when one feels right.

04 / Cards and typing
Then the agent got hands. Ask what's on today and a calendar card unfolds out of the orb. Say you're done with it and it folds back in. A list, a timer, the same way. Drag a card out and it stays where you drop it. All sample data.
Typing became a voice too. Speed, pauses, deletes and where the caret is all feed the same presence, so the orb leans in and reads along the line as you write.

05 / Where it went
The lab is open to play with: pick an orb, start the pretend conversation, drag the sliders. Headphones help.
Its audio engine is what Vance listens with, the orb on the front of this site.

