Microsoft Build Keynote: Hybrid Loop with ONNX Runtime and OpenAI Whisper

Cassie BreviuCassie Breviu·
Cover Image for Microsoft Build Keynote: Hybrid Loop with ONNX Runtime and OpenAI Whisper

I presented a live demo during the Microsoft Build 2023 keynote, showcasing a hybrid loop using ONNX Runtime with OpenAI Whisper models. The demo demonstrated how to run Whisper inference both locally on-device and in the cloud, seamlessly switching between local and cloud execution to optimize for latency, cost, and availability.