Vanta and LangSmith: Assessing Compliance Evidence Like an Auditor

"I can finally find the data that I want without having to fight my tooling." Zheng Tao, Senior AI Engineer at Vanta, is building a capability that helps assess compliance evidence the way an auditor would. With other vendors and Vanta's own in-house tooling, she would spend 10 minutes trying to find a trace and give up. She explains how LangSmith observability lets her look through traces with full text search and metadata fields, and why she's a big fan of LangSmith evaluations, especially the Align Evaluators feature, which forces you to have an opinion and label your ground truth as good