Skip to content
AI NEWS JOURNAL
AI, IN PERSPECTIVE

Search AI news

Search headlines, summaries and articles to connect the dots.

Newest first

Introducing eve 1.0

Vercel announces the general availability of eve 1.0, an open-source framework for building production-ready agents. The release includes performance improvements, expanded integrations, enhanced observability via OpenTelemetry, and new features like multi-tenant support, persistent memory, multiplayer sessions, and lower workflow costs. eve enables developers to build agents with customizable workflows, native UI integrations with frameworks like Next.js, and secure, scalable deployments on Vercel. Early adopters report significant gains in development speed, reduced codebases, and lower AI costs.

Agents are users, so your software needs evals

Agents interact with software through a funnel similar to humans: Discovery, Selection, Access, and Success. To measure whether agents complete user tasks correctly, end-to-end (E2E) evaluations are essential. These tests run multiple trials, score outcomes, and help identify failures across steps like searching cafes, checking budgets, and placing orders. Using frameworks like Harbor, teams can define tasks with specific instructions, environments, verifiers, and known-good solutions. Metrics such as success rate, Pass@k, and Pass^k reveal how reliably agents perform, while trace analysis uncovers root causes of failure. The process includes setting a goal based on observability, customer feedback, or roadmap needs; defining measurable metrics; designing task sets covering common and edge cases; running evaluations at scale using tools like Vercel Sandbox and AI Gateway; and analyzing traces to iterate improvements. Automated trace analysis enables scaling, and repeated evaluation supports continuous improvement, regression detection, and product optimization.

AI Gateway now supports Private Inference

Vercel's AI Gateway now enables enterprises to integrate private, self-hosted, or prerelease models through a unified interface, offering consistent authentication, SDKs, APIs, and observability. Users can switch between private and catalog models using the same endpoints, keep models scoped to their team with encrypted credentials and optional Zero Data Retention, connect to coding agents like Claude Code and Cursor, monitor traffic alongside public models, configure fallbacks to catalog models, and manage providers via CLI. Private model requests are logged alongside catalog requests for unified observability.

Token Pass now includes $150 in tokens for $30/month

Vercel Token Pass now offers $150 in monthly tokens (up from $80) for $30 per team per month, applicable to featured open-weight models via AI Gateway such as Kimi K3, Kimi K3.1 Pro, GLM 5.3, GLM 5.3 Flash, and DeepSeek V4.1 Flash. Credits reset each billing cycle with no rollover; once exhausted, requests using standard keys fall back to the team's AI Gateway balance, while Token Pass-scoped keys cease without overage charges. Available as an Early Access add-on for Pro teams with limited availability and a waitlist. Connect via the Vercel CLI command 'vercel token-pass' or use a Token Pass API key if supported. Subscribe through the AI Gateway dashboard.

Workflow SDK 5: built for production

Vercel's Workflow SDK 5 introduces end-to-end encryption for workflow payloads, regional data residency for improved latency and reliability, and significant performance enhancements including fewer queue hops, incremental replay, and WebSocket streaming. The update supports secure, durable workflows across multiple regions, enables zero-configuration encryption on Vercel, and delivers up to 25× faster execution in benchmarks. It also adds features like searchable run attributes, in-flight cancellation, and expanded framework integrations, with a Python SDK now in beta.

WTF are evals? How to test agents and the software they use

Agents interact with software through a funnel similar to humans: Discovery, Selection, Access, and Success. To measure whether agents complete user tasks correctly, end-to-end (E2E) evaluations are essential. These evaluations assess the full sequence of steps an agent takes, ensuring outcomes meet user requirements. Using frameworks like Harbor, developers can design tasks with defined environments, verifiers, and known-good solutions, then run trials across variants to measure success rate, pass@k, pass^k, efficiency, time, and cost. Analyzing traces reveals root causes of failures, enabling targeted improvements. Iterative evaluation helps catch regressions, test changes, and guide product development, turning evaluations into ongoing infrastructure for building better agent-driven products.

How I Fight AI Brain Fry

Article URL: https://sergeykuhne.com/blog/fighting-ai-brain-fry Comments URL: https://news.ycombinator.com/item?id=50416363 Points: 83 # Comments: 56

Copilot impact dashboard adds chat and VS Code agent usage

The Agent adoption chart in the Copilot impact dashboard now includes Copilot Chat and the VS Code Agents window, so you can see engagement across nine Copilot experiences. The adoption… The post Copilot impact dashboard adds chat and VS Code agent usage appeared first on The GitHub Blog.

Token Pass credit now applies automatically across AI Gateway

Token Pass credit is now automatically applied to model usage through AI Gateway, regardless of authentication method, with fallback to team credits when Token Pass credit runs out. Requests remain under Zero Data Retention policies, and standard keys or OIDC tokens are recommended for fallback access.

Usage metrics API adds code review details and addressed rate

The enterprise and organization repository-level Copilot usage metrics reports now show what happens to Copilot code review feedback. A new copilot_code_review object on each repos-1-day row reports how many Copilot-reviewed… The post Usage metrics API adds code review details and addressed rate appeared first on The GitHub Blog.

Usage metrics API flags telemetry and version gaps

The Copilot usage metrics API now shows which users are missing client telemetry or are running IDE or extension versions below the usage metrics minimums. New per-user fields appear in… The post Usage metrics API flags telemetry and version gaps appeared first on The GitHub Blog.

Vercel CI no longer requires a linked Vercel project

Vercel CI can now be enabled on GitHub repositories without requiring an associated Vercel project, simplifying setup. Users need the Vercel GitHub App installed, their GitHub and Vercel accounts linked, and write or admin access to the repository. Running `vercel ci enable` in a local clone activates CI for the team, with configuration applied on subsequent pushes. This feature is currently limited to private GitHub repositories.

Vercel token scanning expands to more public sources

Vercel has partnered with Truffle Security to enhance automated detection and revocation of exposed Vercel tokens across public platforms like GitHub, GitLab, npm, and others. A new scanner also checks monthly Common Crawl data, automatically revoking any found tokens. Revoked tokens trigger an email notification explaining the action.

How Mercor ships internal apps and billions of production tokens on one platform

Mercor reduced batch job processing time from 12 hours to 2–3 hours by using Vercel AI Gateway, which provided increased inference capacity and failover routing across providers. In its first 10 days on the platform, Mercor routed 18 million requests and 63 billion tokens without hitting rate limits. The company also leveraged Vercel Passport and its internal Audiences product to provision secure access for hundreds of business teams and over 2,000 projects in seconds, enabling rapid deployment of client-specific applications while maintaining strict usage controls and automated offboarding.

Introducing Vercel Security Review

Vercel introduces Security Review, a new feature in Vercel Agent that automatically scans for vulnerabilities in code changes pushed to connected GitHub repositories. It provides real-time findings via pull request comments, a Security dashboard, and CLI access, with options to auto-fix issues using Vercel Agent or integrate with custom coding agents. The tool checks for logic flaws, enforces team-specific security policies, tracks vulnerabilities across deployments, and supports audit logging for Enterprise users. Available now in public beta for Pro and Enterprise teams, it is free until November 10, 2026.

GPT-6.1 Terra in GitHub Copilot

GPT-6.1 Terra, OpenAI’s newest model, is now generally available in GitHub Copilot. It is designed for everyday agentic coding and terminal work at a lower cost than GPT-6.1 Sol. In… The post GPT-6.1 Terra in GitHub Copilot appeared first on The GitHub Blog.

Timeline and related coverage