I spent $10,000 on tokens. It should’ve cost $100!!
Models that are great at coding aren’t necessarily great at voice. So which LLM should run on your transcripts? Voice Standard Bench scores 50+ LLMs on the jobs voice products actually run: summarization, information extraction, text correction and dictation cleanup. Every task is tested on real transcripts at four lengths, from a 30-second voicemail to an hour-long meeting, with quality, speed and cost side by side. In this video I walk through the results, compare two models in the LLM Gateway playground, and show how to test the picks on your own audio. The benchmark is open source: clone
Discussion
Rejoignez la communauté pour réagir et poser vos questions.
Aucun message pour l'instant. Lancez la discussion !