VoiceFi Developer & CLI Hub
The canonical guide for installing, configuring, and operating VoiceFi on macOS, and connecting autonomous AI agent loops to the on-device voice & IPC bus.
1-Minute Quickstart
Install the vifi binary and launch the local hands-free voice server:
# 1. Install VoiceFi universal binary $ curl -fsSL https://vifi.sh | sh # 2. Auto-wire hooks into Antigravity & Cursor $ vifi setup # 3. Boot VoiceFi background server & status bar $ vifi start
Installation Methods
Instant installation into ~/.local/bin/vifi with automatic PATH detection.
Official Homebrew tap formula with automated updates and binary symlinks.
Install directly into your Python environment with Metal CoreML support.
Architecture & IPC Audio Bus
VoiceFi operates as an on-device ambient loopback server. It bridges physical CoreAudio microphones, Apple Silicon neural Whisper inference, and multi-provider text-to-speech pipelines directly to autonomous agent runtimes via high-speed Unix Domain Sockets and WebSockets at localhost:5141.
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ Autonomous Agent Runtime โ
โ (Google Antigravity ยท Claude Code ยท Cursor ยท VS Code) โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฌโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ (JSON-RPC 2.0 / WebSocket & IPC)
โผ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ VoiceFi Ambient Server (localhost:5141) โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฌโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
โ โก Turn-Completion Stop-Hooks โ ๐๏ธ Energy Voice Activity (VAD) โ
โ ๐ง Neural Faster-Whisper (Metal) โ ๐ Multi-Provider TTS (Edge/Say) โ
โ ๐ฅ๏ธ macOS Status Bar Tray & Hotkey โ ๐ Voice Memo Buffer Synthesizer โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Core CLI Commands
vifi start [OPTIONS]
Server Boot
Starts the background VoiceFi audio bus listener, WebSocket server on localhost:5141, and the native macOS Menu Bar tray controller.
5141)vifi setup [OPTIONS]
Agent Hook Integration
Discovers installed AI agent systems on your Mac and connects them to VoiceFi. Injects turn-completion stop-hooks into ~/.gemini/config/hooks.json (Antigravity) and ~/.claude/settings.json (Claude Code).
vifi pause / vifi resume
Kill SwitchInstantly pauses or resumes all VoiceFi agent speech hooks and microphone capture globally without editing configuration files.
vifi listen [OPTIONS]
One-Shot DictationTriggers instant high-speed Whisper dictation. Listens for speech, transcribes locally in 120ms, and types the result directly into the active frontmost macOS application.
vifi voice <SUBCOMMAND>
Persona ManagementManage acoustic personas, audition voices, configure speech rate, and map agent roles.
vifi voice list
Print all available neural voice models
vifi voice set <role> <persona>
Assign persona to role (e.g. planner Christopher)
vifi voice audition
Interactive terminal acoustic audition prompt
vifi memo <SUBCOMMAND>
Voice Memo BufferCapture 2โ5 minute pacing thoughts and synthesize them into structured implementation plans, Mermaid architecture diagrams, and PR verification checklists.
vifi memo record
Start capturing microphone audio buffer
vifi memo synth <file.wav>
Deconstruct voice memo into PR checklist artifact
vifi memo list
List captured memos in ~/.voicefi/memos/
vifi status & vifi tray
System Diagnostics & Status BarCheck daemon process health, active IPC sockets, latency diagnostics, and launch the native macOS Menu Bar tray companion.
vifi status
Display daemon uptime, audio device IDs, and active port
vifi tray
Launch lightweight macOS menu bar status indicator & quick-toggle
vifi info
Print detailed system audio hardware & ML model parameters
vifi config
Configuration Schema
Configuration is persisted in ~/.voicefi/config.yaml. Modify models, TTS providers, voice personas, and energy VAD thresholds:
version: 1 tts: provider: "edge_tts" # "edge_tts" | "mac_say" | "elevenlabs" voice: "en-US-ChristopherNeural" rate: 200 stt: provider: "whisper_local" # "whisper_local" | "groq" | "apple_speech" model_size: "base.en" # "tiny.en" | "base.en" | "small.en" vad: mode: "hybrid" # "hybrid" | "ptt" | "auto" silence_duration: 1.2 # Silence duration (seconds) to close mic energy_threshold: 0.003 # Mic sensitivity threshold
Agent & IDE Integration
Google Antigravity Hook Configuration
To trigger acoustic turn announcements automatically when Antigravity finishes a task, verify your ~/.gemini/config/hooks.json contains:
{
"post_turn_hooks": [
{
"name": "voicefi_ambient_notify",
"command": "vifi hook turn-completed --summary \"$TURN_SUMMARY\""
}
]
}
Claude Code Integration
VoiceFi connects natively to Claude Code via lifecycle Stop hooks in ~/.claude/settings.json. Claude Code speaks turn completions aloud using the Guy neural voice persona, and automatically captures your spoken reply:
# 1. Automatically configure Claude Code hook
vifi setup --claude
# 2. Registered hook in ~/.claude/settings.json:
{
"hooks": {
"Stop": [
{
"matcher": ".*",
"hooks": [
{
"type": "command",
"command": "voicefi hook --agent claude",
"timeout": 60
}
]
}
]
}
}
Cursor & VS Code Integration
VoiceFi operates globally across macOS. Press Control + T inside any Cursor or VS Code split-pane, terminal, or AI prompt bar to dictate immediately with 100% on-device Whisper neural accuracy.
Model Context Protocol (MCP) & WebMCP Layer W3C DRAFT + STDIO
VoiceFi provides native support for both Stdio JSON-RPC 2.0 MCP (for CLI agents like Antigravity, Claude Code, and Cursor) and WebMCP (navigator.modelContext) for in-browser AI assistants.
# Start the native stdio JSON-RPC MCP server vifi mcp # Exposed agent tools: โข voicefi_speak: Speak text aloud with live HUD animation โข voicefi_listen: Record user speech with VAD & return STT transcript โข voicefi_stop: Immediately halt active audio playback โข voicefi_status: Audio devices, active personas, & daemon state โข voicefi_set_voice: Configure voice persona for a specific subagent โข voicefi_ping_voice: Silent TTFB latency test โข voicefi_send: Inter-agent task dispatch envelope (Antigravity โ Claude) โข voicefi_sfx: Play comedic sound effects & punchlines
navigator.modelContext)
On voicefi.org, AI agents can discover and invoke tools directly in the browser tab via the W3C WebML standard or the /.well-known/webmcp.json manifest:
// Discover and invoke WebMCP tools in the page
const tools = navigator.modelContext.getTools();
// [
// { name: "voicefi_audition_voice", description: "Audition neural voice in 3D carousel" },
// { name: "voicefi_get_docs", description: "Query CLI reference and guides" },
// { name: "voicefi_generate_install_command", description: "Generate custom 1-line installer" },
// { name: "voicefi_ping_voice", description: "Measure TTFB latency for Edge TTS" },
// { name: "voicefi_stop_audio", description: "Halt audio playback" }
// ]
await navigator.modelContext.invokeTool("voicefi_audition_voice", {
voice: "viv",
sampleText: "Testing WebMCP in-tab execution!"
});