Evaluating Audio Reasoning with Big Bench Audio
The emergence of native Speech to Speech models offers exciting opportunities to increase voice agent capabilities and simplify speech-enabled workflows. However, it’s crucial to evaluate whether this simplification comes at the cost of model performance or introduces