跳到正文
AI NEWS JOURNAL
AI NEWS / SEARCH

新闻与全站搜索

关联新闻、工具、模型、指南、专题、工作流与提示词。

新闻报道 67

“Transcript AI”

新闻报道

The Apple Watch’s Live Rewind Can Record and Rewind Spoken Conversations. It’s Pretty Awkward

Live Rewind and Siri Recap can transcribe missed moments and summarize your day—if you don’t mind a little social clumsiness.

Apple · Rewind · Recap查看新闻 ↗
新闻报道

Agents are users, so your software needs evals

Agents interact with software through a funnel similar to humans: Discovery, Selection, Access, and Success. To measure whether agents complete user tasks correctly, end-to-end (E2E) evaluations are essential. These tests run multiple trials, score outcomes, and help identify failures across steps like searching cafes, checking budgets, and placing orders. Using frameworks like Harbor, teams can define tasks with specific instructions, environments, verifiers, and known-good solutions. Metrics such as success rate, Pass@k, and Pass^k reveal how reliably agents perform, while trace analysis uncovers root causes of failure. The process includes setting a goal based on observability, customer feedback, or roadmap needs; defining measurable metrics; designing task sets covering common and edge cases; running evaluations at scale using tools like Vercel Sandbox and AI Gateway; and analyzing traces to iterate improvements. Automated trace analysis enables scaling, and repeated evaluation supports continuous improvement, regression detection, and product optimization.

Specific · Eval · Sequence查看新闻 ↗
新闻报道

CamSpokenNLI: A Pilot Resource for Cross-Variety Transfer Evaluation in Cameroon Pidgin English and Camfranglais

arXiv:2611.17573v1 Announce Type: new Abstract: Cameroon Pidgin English (a West African Pidgin English variety) and Camfranglais are widely used in Cameroon, yet to our knowledge, neither has a dedicated spoken Natural Language Inference (NLI) resource. We introduce CamSpokenNLI, a pilot dataset of 114 scenario-matched spoken NLI items in each variety (228 in total), recorded by one native speaker from Buea. Each item pairs premise audio and text with a hypothesis, an NLI label, and English glosses. The author assigned labels, so the dataset is an exploratory resource rather than a mature benchmark. The NLI experiments use the reference text; the audio is evaluated separately. XLM-RoBERTa baselines with five-fold item-level cross-validation reach 44.7% on Pidgin and 46.2% on Camfranglais (chance 33.3%). Still, neither is statistically distinguishable from hypothesis-only input, so hypothesis wording may account for much of the accuracy. Under disjoint-item cross-variety transfer, where a test item's counterpart is never seen in training, accuracy is 40.1% (Pidgin to Camfranglais) and 45.6% (Camfranglais to Pidgin). A counterpart-leak audit raises this to 60-64%, illustrating how counterpart leakage can overstate transfer. Zero-shot Whisper transcription of the recordings performs poorly: the best word error rates are 66.6% for Pidgin and 45.5% for Camfranglais, and with automatic language identification, Whisper Large-v3 labels 93 of 114 Pidgin recordings as Yoruba or Swahili. Together, the results suggest that such resources need disjoint-item evaluation and hypothesis-only controls, and that speech recognition must be adapted to these varieties before spoken NLI can be tested end to end.

Abstract · Scenario · Reach查看新闻 ↗
新闻报道

Making open models work for long-horizon agentic workloads

Prefix caching helps coding agents stay fast as conversations grow. Prompts, tool calls, and inference routing determine how much work the model can reuse.

Prompt · Sequence · Output查看新闻 ↗
新闻报道

Show HN: Redacted - Stop Handing Claude Your Secrets

Article URL: https://github.com/svn-arv/redacted/ Comments URL: https://news.ycombinator.com/item?id=50513298 Points: 1 # Comments: 0

Claude · Output · Reach查看新闻 ↗
新闻报道

Show HN: AI Time Estimator – how long Claude Code will take, from your own logs

Article URL: https://github.com/noambrand/ai-time-estimator Comments URL: https://news.ycombinator.com/item?id=50499487 Points: 2 # Comments: 0

Claude · Claude Code · Minutes查看新闻 ↗
新闻报道

Show HN: Linux CLI for Cricut StickerPix

Article URL: https://github.com/vavkamil/crycut Comments URL: https://news.ycombinator.com/item?id=50498398 Points: 1 # Comments: 0

Background · Preview · Output查看新闻 ↗
新闻报道

Cost-optimizing AssemblyAI speech-to-text inference on AWS with Amazon EC2 Spot

Learn how AssemblyAI runs cost-optimized speech-to-text inference at scale on AWS, using Amazon ECS, Amazon EC2 Spot GPU instances, and an Amazon SQS-based retry architecture to achieve 70% cost savings while maintaining SLA commitments across European Regions.

AssemblyAI · 英伟达 · Specific查看新闻 ↗
新闻报道

Route coding agent requests to the right model on Amazon Bedrock with NVIDIA NeMo Switchyard

Coding agents work in tasks, and the number that matters is cost per solved task, not price per token. In this post, you use the AWS CDK to deploy LiteLLM with the NVIDIA NeMo Switchyard routing plugin on Amazon Bedrock, then measure cost per solved task for a routed model group against single-model baselines.

英伟达 · Claude · Claude Code查看新闻 ↗
新闻报道Hacker News Show HN

Show HN:使用 WebGPU 在浏览器中进行音频转录

文章网址:https://whisper.tanpreet.xyz/demo/ 评论网址:https://news.ycombinator.com/item?id=50495635 积分:1 # 评论:0

查看新闻 ↗