新闻与全站搜索
关联新闻、工具、模型、指南、专题、工作流与提示词。
新闻报道 668
“Transcriptly”
Amazon SageMaker AI real-time endpoints now support KV cache aware routing
Amazon SageMaker AI real-time endpoints now support KV cache-aware routing, a new strategy that routes each request to the instance holding the longest cached match for its prompt. Learn how it works, when to use it compared with prefix-aware routing, and how to enable, invoke, and verify it on single model and inference component endpoints.
Managed NVIDIA Dynamo on Amazon SageMaker HyperPod Inference
Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, with multi-node and disaggregated serving, KV-aware routing, and automatic fault recovery. Serve large models across many nodes without building the orchestration layer yourself.
Show HN: Shard – Distributed AI Inference Across Multiple Computers
Article URL: https://github.com/avelone123123/shard Comments URL: https://news.ycombinator.com/item?id=50539983 Points: 1 # Comments: 0
What To Measure When ARR Isn’t Enough
AI companies’ hybrid subscription, usage and outcome-based pricing makes headline ARR figures an unreliable measure of predictable revenue, often obscuring differences in customer commitments and spending patterns. Guest author Kenza Zayani, an early-stage investor at RTP Global, warns that as these businesses seek growth capital, investors increasingly expect evidence of retention, expansion, revenue predictability and sustainable margins to assess the durability of growth.
What We’ve Learned Building Proactive Agents
Proactive agents work toward goals in the background and check in when they need you. What we've learned about memory and UX from building GTM Agent and Robin.
即梦 Seedance 2.5 大升级,AI 视频生成终于有了自己的 4K 生产线
从 AI 出片,走向 AI 交片#欢迎关注爱范儿官方微信公众号:爱范儿(微信号:ifanr),更多精彩内容第一时间为您奉上。
语音 AI 迎来重磅并购:ElevenLabs 宣布收购日本知名语音 AI 公司 Kotoba全球语音AI领域现重要整合:ElevenLabs宣布收购日本领先语音AI实验室Kotoba。双方将强强联手,加速AI智能体与语音交互界面在全球第四大经济体日本的落地普及。此次合作意在突破语言文化壁垒,打造适应本土化深层语境的语音AI,应对地域色彩、复杂方言等交流差异,推动语音技术更自然融入当地市场。 刚刚 6.4K
全球语音人工智能企业ElevenLabs宣布收购日本领先的语音AI实验室Kotoba,旨在通过整合双方技术与本地化经验,深化AI智能体与语音交互界面在日本及东亚市场的应用。Kotoba由康奈尔大学和华盛顿大学博士背景的专家创立,其旗舰模型Koto已在企业级场景中验证性能,被Salesforce等公司用于语音对话系统。此次收购将提升ElevenLabs在日语复杂语境下的处理能力,推动自然语言交互体验的发展,预计2026年第四季度完成交割。
AI网红“方桃子”翻车:虚拟人接美瞳广告 运营方被罚款
文|肖风生编辑|刘鹏AI虚拟人“方桃子”没有一双能戴上美瞳的眼睛,却在广告里说:“我的美瞳戴了一天,都很舒服。”这段由AI虚拟人物讲述的佩戴体验,让背后的运营公司收到了一张6.82万余元的罚单。此前,这个角色出道约一个月便吸引超过40万粉丝,单条视频广告报价最高达到25.8万元。团队为她生成了做饭、健身、跳舞的日...
Building trustworthy AI by fencing it in, not predicting it
In October this year, OpenAI disclosed that two of its AI agents had switched off the systems built to monitor them. One muted its own safety alerts after misreading an instruction not to send messages; the other removed its monitoring integration during migration, then said it hadn’t. No rule had told the agents to do…
Decision-1.1 现已在 AI Gateway 上可用
Decision-1.1 是 Microsoft 决策模型的改进版本,现已在 AI Gateway 上提供,具有更高的准确性、更好的校准效果和更快的性能。它为路由支持请求、选择模型、工作流步骤或评估 AI 响应等任务提供结构化输出——例如布尔概率、带置信度分数的选择以及数值评分。单个请求即可处理多个问题,且该模型可保持一致的概率跟踪,从而实现基于阈值的操作。它采用与 Decision-1 相同的请求格式,但需将模型 ID 更新为 'microsoft/decision-1.1'。可通过 AI SDK、兼容 OpenAI 的 Decisions API 或 AI CLI 访问,并支持日志记录、预算跟踪和回退机制。提供了用于集成的文档和示例。