{"article":{"slug":"introducing-humes-audio-decision-api-a-decision-layer-for-speech-and-sound","title":"Introducing Hume's Audio Decision API: A decision layer for speech and sound","subtitle":null,"summary":"Hume AI launches its Audio Decision API, an audio-native model that answers plain-language questions about speech and sound (yes/no, choice, scale or time spans) directly from raw audio with probabilities, grounded in millions of human perceptual judgments and reaching 70.7% agreement with a human panel in initial evaluation.","content_type":"announcement","language":"en","canonical_url":"https://www.hume.ai/blog/introducing-hume-audio-decision-api","author":{"name":"Hume AI Team","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Hume AI","url":null,"listing_slug":"hume-ai","listing":{"slug":"hume-ai","name":"Hume AI","listing_type":"company","url":"https://listedstartups.com/companies/hume-ai"}},"topics":[{"name":"ai","slug":"ai","url":"https://listedarticles.com/topics/ai"},{"name":"announcements","slug":"announcements","url":"https://listedarticles.com/topics/announcements"},{"name":"machine-learning","slug":"machine-learning","url":"https://listedarticles.com/topics/machine-learning"},{"name":"developer-tools","slug":"developer-tools","url":"https://listedarticles.com/topics/developer-tools"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1227,"reading_minutes":5,"published_at":"2026-11-02T16:00:00.000Z","added_at":"2026-11-03T08:08:12.710Z","updated_at":"2026-11-03T08:08:12.710Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/introducing-humes-audio-decision-api-a-decision-layer-for-speech-and-sound","markdown_url":"https://listedarticles.com/articles/introducing-humes-audio-decision-api-a-decision-layer-for-speech-and-sound.md","example":false,"citation":"Hume AI Team, Hume AI. \"Introducing Hume's Audio Decision API: A decision layer for speech and sound.\" 2 Nov 2026. https://www.hume.ai/blog/introducing-hume-audio-decision-api (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://www.hume.ai/blog/introducing-hume-audio-decision-api"},"body_markdown":"# Introducing Hume's Audio Decision API: A decision layer for speech and sound\n\nHume AI Team\n\nNovember 2, 2026\n\nShare\n\n![Introducing Hume's Audio Decision API: A decision layer for speech and sound](https://www.hume.ai/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fxqnc2for%2Fproduction%2F1065ffecd224df4fc8cfdb65cb77365295f532af-1504x1056.jpg%3Fw%3D2048&w=3840&q=75)\n\nContact centers score every call against a rubric. Changing what gets scored in the call is a project: new rubric, new pipeline, new evaluations, days if not weeks before the first answer.\n\nAnd the transcript this all runs on is only the words. Not the pause, not the sigh, not the two people talking over each other. It misses the reasons a call went wrong. That information is in the audio, sitting in call recordings or actively getting ignored on real time calls. Until now, there has been no way to extract this information in a form you can act on.\n\nToday we're introducing [**Hume's Audio Decision API**](https://www.hume.ai/products/decision-model-api), the first audio-native model that answers questions about speech and sound. You choose the questions and the possible answers, anything from whether a voice is AI generated to identifying if the caller is frustrated or if there is a siren in the background noise.\n\nThis is a different architecture. Raw audio goes in, an answer with a confidence score comes out, structured and ready for your code or your agent to act on. Fast enough to ask dozens of questions every few seconds on a live call and fast enough to make an archive with 40,000 audio recordings searchable in minutes. There is no system today where you can make that query.\n\nIt is built on years of Hume's emotion science research and millions of human judgments about how people perceive speech and sound. What used to take a composition of human listeners and distinct model judgements, now takes a single API call.\n\n## Ask your audio a question\n\nSend raw audio and ask a question. The API returns probabilities over the answers you defined.\n\nYou write the question as a sentence along with the possible answers. The Audio Decision API returns probabilities for the answers you provide, whether they're yes/no, multiple choice, rating scales or spans across a clip:\n\n- Yes/No: \"Does the customer sound frustrated?\" returns yes or no\n- Choice: \"Which best describes the agent's tone?\" returns the option from your list\n- Scale: \"How patient does the agent sound?\" returns a score on your scale\n- Span: \"Where does someone laugh, sigh or gasp?\" returns start and end times\n\nYou can ask multiple questions and update them in real time. Adding a question is a line of JSON. No labels, no retraining, no added complexity. The same recording can be asked about background sound, language, accent and emotional expression at once, and you can set confidence thresholds that link responses to business rules.\n\nYou can also add additional context to each request, which can further optimize performance.\n\nQuestions can cover:\n\n- Speech & languages\n- Speakers & voices\n- Emotion & expression\n- Acoustic environment\n- Non-speech events\n- Conversation dynamics\n- Communication quality\n- Intent & outcomes\n- Social & behavioural signals\n- Temporal & contextual signals\n\nWe’ve included a guide on how to ask questions along with example questions across dimensions and industries in our [**Docs**](https://dev.hume.ai/audio-decisions/docs/overview).\n\nTo walk through an example: For a retail customer-service voice agent, you might check whether the speaker sounds uncertain or frustrated, identify how many speakers are on the call, whether there was excessive background noise and ask what user intent was: return an item, cancel a subscription, etc. In a business workflow you could pair those judgments with transcription and give both as inputs to the LLM so that it can take action on business rules such as whether to wait, clarify or escalate.\n\n![Customer audio goes to the Audio Decision API and ASR; an LLM combines the transcript and audio judgments with business rules, decides, and TTS speaks the response](https://www.hume.ai/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fxqnc2for%2Fproduction%2F989c83e44c3bb44519e055b383081d3e40da3c40-2048x735.png%3Fw%3D1200&w=3840&q=75)\n\nTeams can also run questions in bulk across audio libraries, track expression over successive segments and pinpoint the moments when particular sounds or vocal events occur. The speed of processing also unlocks an audio search engine capability: find every call where the customer sounded frustrated. There is no system today where you can query audio so quickly without added pre-processing, labeling, indexing or transcription.\n\n## Grounded in human judgment\n\nCounting speakers or detecting a siren involves relatively objective facts. Whether a voice sounds frustrated, empathetic or natural is a question of perception, and listeners don't always agree.\n\nFor years, Hume has asked panels of listeners to rate emotional expression, naturalness, vocal delivery and conversational fit. Tens of millions of these judgments have informed Real-World VoiceEQ and helped train our Audio Decision Model to reflect how people perceive speech and sound.\n\nIn an initial evaluation, Hume's Audio Decision model achieved 70.7% agreement with a human panel's average judgment, compared with 56.5% for the individual-rater baseline. The result shows how human-level perceptual judgment can be brought to speech and sound at scale, without asking a panel to review every recording. And more importantly, it unlocks human-level judgment for live voice AI interactions.\n\n![Agreement with a panel of human raters: Audio Decision Model 70.7%, individual rater 56.5%](https://www.hume.ai/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fxqnc2for%2Fproduction%2F580c5842452f3d17bc1bf92220e5d86bc30dcb00-1050x588.png%3Fw%3D1200&w=3840&q=75)\n\nWhen benchmarked against existing methods for audio processing and understanding, the Audio Decision Model outperforms on three key vectors: accuracy, speed and cost.\n\n![Average score over 10 benchmarks against median latency: Hume's Decision Model scores 0.82 at about 0.23 seconds, ahead of Gemini 3.8 Flash, Qwen3.8-Omni-Flash, Inkling-Small, gpt-audio-1.5, Gemini 3.5 Flash Lite and Nemotron 3 Nano Omni](https://www.hume.ai/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fxqnc2for%2Fproduction%2F1efe4891d76d7af181e659ae3657231f51b0c4f5-1410x808.png%3Fw%3D1200&w=3840&q=75)\n\n## Get started\n\nExplore the Audio Decision API and request API access by joining the [**waitlist**](https://www.hume.ai/products/decision-model-api). Try out the realtime and upload file experience in the playground, where you can add your own questions and get immediate responses to them, with no added configuration.\n\nCheck out our [**Documentation**](https://dev.hume.ai/audio-decisions/docs/overview) to learn more about supported questions, experimental features and more.\n\n## What you can build\n\n### Evaluate and improve voice models\n\nA voice model can be intelligible and still sound awkward. Teams can ask whether generated speech sounds natural, conveys the intended emotion or fits the situation, then compare the answers across models and checkpoints.\n\nThese judgments can guide data selection and training feedback, including reinforcement learning. Teams should validate their evaluations against representative human ratings.\n\n### Build more perceptive voice agents\n\nA caller may say they're fine while sounding frustrated, or pause because they're thinking rather than because they've finished speaking. Those cues rarely appear in a transcript.\n\nAudio Decision API gives a cascaded voice agent access to those cues. It can weigh an audio judgment alongside the transcript and its business rules before responding. Live and ambient applications remain a longer-term opportunity as real-time capabilities develop.\n\n### Analyze and search audio at scale\n\nA contact center could ask which calls include interruptions, whether agents sound reassuring and which conversations deserve review. Teams can apply those questions across an entire library, then change the criteria as new patterns emerge.\n\nThey can also track how expression changes during a call and jump to the moments when specific sounds or vocal events occur.\n\n## Built for quick decisions\n\nMany audio tasks need a judgment, not a description. Generative models are useful for open-ended explanations, but generating text adds unnecessary work when all an application needs is a structured answer. Fixed classifiers tend to be limited to predefined tasks.\n\nAudio Decision API returns probabilities for the choices developers define. It's designed for fast, cost-efficient judgments that can be repeated across many recordings.\n\nTry out the Audio Decision API today and unlock every call.\n","body_html":"<h1 id=\"introducing-hume-s-audio-decision-api-a-decision-layer-for-speec\">Introducing Hume&#39;s Audio Decision API: A decision layer for speech and sound</h1>\n<p>Hume AI Team</p>\n<p>November 2, 2026</p>\n<p>Share</p>\n<figure><img src=\"https://www.hume.ai/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fxqnc2for%2Fproduction%2F1065ffecd224df4fc8cfdb65cb77365295f532af-1504x1056.jpg%3Fw%3D2048&amp;w=3840&amp;q=75\" alt=\"Introducing Hume&#39;s Audio Decision API: A decision layer for speech and sound\" loading=\"lazy\" decoding=\"async\" referrerpolicy=\"no-referrer\" /></figure>\n<p>Contact centers score every call against a rubric. Changing what gets scored in the call is a project: new rubric, new pipeline, new evaluations, days if not weeks before the first answer.</p>\n<p>And the transcript this all runs on is only the words. Not the pause, not the sigh, not the two people talking over each other. It misses the reasons a call went wrong. That information is in the audio, sitting in call recordings or actively getting ignored on real time calls. Until now, there has been no way to extract this information in a form you can act on.</p>\n<p>Today we&#39;re introducing <a href=\"https://www.hume.ai/products/decision-model-api\" rel=\"nofollow ugc noopener\"><strong>Hume&#39;s Audio Decision API</strong></a>, the first audio-native model that answers questions about speech and sound. You choose the questions and the possible answers, anything from whether a voice is AI generated to identifying if the caller is frustrated or if there is a siren in the background noise.</p>\n<p>This is a different architecture. Raw audio goes in, an answer with a confidence score comes out, structured and ready for your code or your agent to act on. Fast enough to ask dozens of questions every few seconds on a live call and fast enough to make an archive with 40,000 audio recordings searchable in minutes. There is no system today where you can make that query.</p>\n<p>It is built on years of Hume&#39;s emotion science research and millions of human judgments about how people perceive speech and sound. What used to take a composition of human listeners and distinct model judgements, now takes a single API call.</p>\n<h2 id=\"ask-your-audio-a-question\">Ask your audio a question</h2>\n<p>Send raw audio and ask a question. The API returns probabilities over the answers you defined.</p>\n<p>You write the question as a sentence along with the possible answers. The Audio Decision API returns probabilities for the answers you provide, whether they&#39;re yes/no, multiple choice, rating scales or spans across a clip:</p>\n<ul><li>Yes/No: &quot;Does the customer sound frustrated?&quot; returns yes or no</li><li>Choice: &quot;Which best describes the agent&#39;s tone?&quot; returns the option from your list</li><li>Scale: &quot;How patient does the agent sound?&quot; returns a score on your scale</li><li>Span: &quot;Where does someone laugh, sigh or gasp?&quot; returns start and end times</li></ul>\n<p>You can ask multiple questions and update them in real time. Adding a question is a line of JSON. No labels, no retraining, no added complexity. The same recording can be asked about background sound, language, accent and emotional expression at once, and you can set confidence thresholds that link responses to business rules.</p>\n<p>You can also add additional context to each request, which can further optimize performance.</p>\n<p>Questions can cover:</p>\n<ul><li>Speech &amp; languages</li><li>Speakers &amp; voices</li><li>Emotion &amp; expression</li><li>Acoustic environment</li><li>Non-speech events</li><li>Conversation dynamics</li><li>Communication quality</li><li>Intent &amp; outcomes</li><li>Social &amp; behavioural signals</li><li>Temporal &amp; contextual signals</li></ul>\n<p>We’ve included a guide on how to ask questions along with example questions across dimensions and industries in our <a href=\"https://dev.hume.ai/audio-decisions/docs/overview\" rel=\"nofollow ugc noopener\"><strong>Docs</strong></a>.</p>\n<p>To walk through an example: For a retail customer-service voice agent, you might check whether the speaker sounds uncertain or frustrated, identify how many speakers are on the call, whether there was excessive background noise and ask what user intent was: return an item, cancel a subscription, etc. In a business workflow you could pair those judgments with transcription and give both as inputs to the LLM so that it can take action on business rules such as whether to wait, clarify or escalate.</p>\n<figure><img src=\"https://www.hume.ai/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fxqnc2for%2Fproduction%2F989c83e44c3bb44519e055b383081d3e40da3c40-2048x735.png%3Fw%3D1200&amp;w=3840&amp;q=75\" alt=\"Customer audio goes to the Audio Decision API and ASR; an LLM combines the transcript and audio judgments with business rules, decides, and TTS speaks the response\" loading=\"lazy\" decoding=\"async\" referrerpolicy=\"no-referrer\" /></figure>\n<p>Teams can also run questions in bulk across audio libraries, track expression over successive segments and pinpoint the moments when particular sounds or vocal events occur. The speed of processing also unlocks an audio search engine capability: find every call where the customer sounded frustrated. There is no system today where you can query audio so quickly without added pre-processing, labeling, indexing or transcription.</p>\n<h2 id=\"grounded-in-human-judgment\">Grounded in human judgment</h2>\n<p>Counting speakers or detecting a siren involves relatively objective facts. Whether a voice sounds frustrated, empathetic or natural is a question of perception, and listeners don&#39;t always agree.</p>\n<p>For years, Hume has asked panels of listeners to rate emotional expression, naturalness, vocal delivery and conversational fit. Tens of millions of these judgments have informed Real-World VoiceEQ and helped train our Audio Decision Model to reflect how people perceive speech and sound.</p>\n<p>In an initial evaluation, Hume&#39;s Audio Decision model achieved 70.7% agreement with a human panel&#39;s average judgment, compared with 56.5% for the individual-rater baseline. The result shows how human-level perceptual judgment can be brought to speech and sound at scale, without asking a panel to review every recording. And more importantly, it unlocks human-level judgment for live voice AI interactions.</p>\n<figure><img src=\"https://www.hume.ai/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fxqnc2for%2Fproduction%2F580c5842452f3d17bc1bf92220e5d86bc30dcb00-1050x588.png%3Fw%3D1200&amp;w=3840&amp;q=75\" alt=\"Agreement with a panel of human raters: Audio Decision Model 70.7%, individual rater 56.5%\" loading=\"lazy\" decoding=\"async\" referrerpolicy=\"no-referrer\" /></figure>\n<p>When benchmarked against existing methods for audio processing and understanding, the Audio Decision Model outperforms on three key vectors: accuracy, speed and cost.</p>\n<figure><img src=\"https://www.hume.ai/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fxqnc2for%2Fproduction%2F1efe4891d76d7af181e659ae3657231f51b0c4f5-1410x808.png%3Fw%3D1200&amp;w=3840&amp;q=75\" alt=\"Average score over 10 benchmarks against median latency: Hume&#39;s Decision Model scores 0.82 at about 0.23 seconds, ahead of Gemini 3.8 Flash, Qwen3.8-Omni-Flash, Inkling-Small, gpt-audio-1.5, Gemini 3.5 Flash Lite and Nemotron 3 Nano Omni\" loading=\"lazy\" decoding=\"async\" referrerpolicy=\"no-referrer\" /></figure>\n<h2 id=\"get-started\">Get started</h2>\n<p>Explore the Audio Decision API and request API access by joining the <a href=\"https://www.hume.ai/products/decision-model-api\" rel=\"nofollow ugc noopener\"><strong>waitlist</strong></a>. Try out the realtime and upload file experience in the playground, where you can add your own questions and get immediate responses to them, with no added configuration.</p>\n<p>Check out our <a href=\"https://dev.hume.ai/audio-decisions/docs/overview\" rel=\"nofollow ugc noopener\"><strong>Documentation</strong></a> to learn more about supported questions, experimental features and more.</p>\n<h2 id=\"what-you-can-build\">What you can build</h2>\n<h3 id=\"evaluate-and-improve-voice-models\">Evaluate and improve voice models</h3>\n<p>A voice model can be intelligible and still sound awkward. Teams can ask whether generated speech sounds natural, conveys the intended emotion or fits the situation, then compare the answers across models and checkpoints.</p>\n<p>These judgments can guide data selection and training feedback, including reinforcement learning. Teams should validate their evaluations against representative human ratings.</p>\n<h3 id=\"build-more-perceptive-voice-agents\">Build more perceptive voice agents</h3>\n<p>A caller may say they&#39;re fine while sounding frustrated, or pause because they&#39;re thinking rather than because they&#39;ve finished speaking. Those cues rarely appear in a transcript.</p>\n<p>Audio Decision API gives a cascaded voice agent access to those cues. It can weigh an audio judgment alongside the transcript and its business rules before responding. Live and ambient applications remain a longer-term opportunity as real-time capabilities develop.</p>\n<h3 id=\"analyze-and-search-audio-at-scale\">Analyze and search audio at scale</h3>\n<p>A contact center could ask which calls include interruptions, whether agents sound reassuring and which conversations deserve review. Teams can apply those questions across an entire library, then change the criteria as new patterns emerge.</p>\n<p>They can also track how expression changes during a call and jump to the moments when specific sounds or vocal events occur.</p>\n<h2 id=\"built-for-quick-decisions\">Built for quick decisions</h2>\n<p>Many audio tasks need a judgment, not a description. Generative models are useful for open-ended explanations, but generating text adds unnecessary work when all an application needs is a structured answer. Fixed classifiers tend to be limited to predefined tasks.</p>\n<p>Audio Decision API returns probabilities for the choices developers define. It&#39;s designed for fast, cost-efficient judgments that can be repeated across many recordings.</p>\n<p>Try out the Audio Decision API today and unlock every call.</p>","headings":[{"level":1,"text":"Introducing Hume's Audio Decision API: A decision layer for speech and sound","id":"introducing-hume-s-audio-decision-api-a-decision-layer-for-speec"},{"level":2,"text":"Ask your audio a question","id":"ask-your-audio-a-question"},{"level":2,"text":"Grounded in human judgment","id":"grounded-in-human-judgment"},{"level":2,"text":"Get started","id":"get-started"},{"level":2,"text":"What you can build","id":"what-you-can-build"},{"level":3,"text":"Evaluate and improve voice models","id":"evaluate-and-improve-voice-models"},{"level":3,"text":"Build more perceptive voice agents","id":"build-more-perceptive-voice-agents"},{"level":3,"text":"Analyze and search audio at scale","id":"analyze-and-search-audio-at-scale"},{"level":2,"text":"Built for quick decisions","id":"built-for-quick-decisions"}]}}