How to Evaluate Voice Agents in 2025: Beyond Automatic Speech Recognition (ASR) and Word Error Rate (WER) to Task Success, Barge-In, and Hallucination-Under-Noise

How to Evaluate Voice Agents in 2025: Beyond Automatic Speech Recognition (ASR) and Word Error Rate (WER) to Task Success, Barge-In, and Hallucination-Under-Noise

Optimizing only for Automatic Speech Recognition (ASR) and Word Error Rate (WER) is insufficient for modern, interactive voice agents. Robust evaluation must measure end-to-end task success, barge-in behavior and latency, and hallucination-under-noise—alongside ASR, safety, and instruction following. VoiceBench offers a multi-facet speech-interaction benchmark across general knowledge, instruction following, safety, and robustness to speaker/environment/content variations, but…

Read More
Amid Intel’s deals, Intel Foundry Services remains notably absent — 18A and 14A are on the way, but success isn’t guaranteed

Amid Intel’s deals, Intel Foundry Services remains notably absent — 18A and 14A are on the way, but success isn’t guaranteed

It has been a busy few weeks for semiconductors. Apple debuted its next-generation silicon, Nvidia launched an unprecedented partnership, and TSMC denied rumors of a major tie-up with Intel. But across all these developments, one name has remained conspicuously absent: Intel Foundry Services. Take the biggest stories of the month. Apple’s new A19 and A19…

Read More
How military leadership prepares veterans for cybersecurity success – Help Net Security

How military leadership prepares veterans for cybersecurity success – Help Net Security

In this Help Net Security interview, Warren O’Driscoll, Head of Security Practice at NTT DATA UK and Ireland, discusses how military leadership training equips veterans with the mindset, resilience, and strategic thinking needed to excel in cybersecurity. Drawing on habits such as disciplined preparation, blunt honesty, and adaptive decision-making, veterans bring a blend of defensive…

Read More
An academic Great Gatsby Curve – How much academic success is inherited?

An academic Great Gatsby Curve – How much academic success is inherited?

To what extent does academic success follow success? Drawing on a dataset of mentor-mentee relations and their citations, Ye Sun, Fabio Caccioli, Xiancheng Li and Giacomo Livan suggest the dynamics of citation and wealth inequality are surprisingly similar. Rankings are ubiquitous: every week, lists of best-selling records, movies, and books are released, and in sports like…

Read More