A Streaming Proxy for Real-Time ASR: Abstracting Speech Providers
Jul 9, 2025
How does Voice Writer turn speech into grammatically correct writing in real time? Most voice apps record everything first and only process it afterward. Voice Writer works differently: we use streaming ASR and LLMs to deliver sub-second latency as you speak. In this post, we’ll walk through the real-time architecture that enables low latency, high reliability, and the ability to seamlessly swap out speech providers as better models become available.
