Search AI news

Search headlines, summaries and articles to connect the dots.

2026-11-12

Vercel13:00

WTF are evals? How to test agents and the software they use

Agents interact with software through a funnel similar to humans: Discovery, Selection, Access, and Success. To measure whether agents complete user tasks correctly, end-to-end (E2E) evaluations are essential. These evaluations assess the full sequence of steps an agent takes, ensuring outcomes meet user requirements. Using frameworks like Harbor, developers can design tasks with defined environments, verifiers, and known-good solutions, then run trials across variants to measure success rate, pass@k, pass^k, efficiency, time, and cost. Analyzing traces reveals root causes of failures, enabling targeted improvements. Iterative evaluation helps catch regressions, test changes, and guide product development, turning evaluations into ongoing infrastructure for building better agent-driven products.

2026-11-06

Vercel09:00

Token Pass credit now applies automatically across AI Gateway

Token Pass credit is now automatically applied to model usage through AI Gateway, regardless of authentication method, with fallback to team credits when Token Pass credit runs out. Requests remain under Zero Data Retention policies, and standard keys or OIDC tokens are recommended for fallback access.

2026-11-04

Vercel02:00

Vercel CI no longer requires a linked Vercel project

Vercel CI can now be enabled on GitHub repositories without requiring an associated Vercel project, simplifying setup. Users need the Vercel GitHub App installed, their GitHub and Vercel accounts linked, and write or admin access to the repository. Running `vercel ci enable` in a local clone activates CI for the team, with configuration applied on subsequent pushes. This feature is currently limited to private GitHub repositories.

Vercel21:00

Vercel token scanning expands to more public sources

Vercel has partnered with Truffle Security to enhance automated detection and revocation of exposed Vercel tokens across public platforms like GitHub, GitLab, npm, and others. A new scanner also checks monthly Common Crawl data, automatically revoking any found tokens. Revoked tokens trigger an email notification explaining the action.

2026-11-03

Vercel12:00

How Mercor ships internal apps and billions of production tokens on one platform

Mercor reduced batch job processing time from 12 hours to 2–3 hours by using Vercel AI Gateway, which provided increased inference capacity and failover routing across providers. In its first 10 days on the platform, Mercor routed 18 million requests and 63 billion tokens without hitting rate limits. The company also leveraged Vercel Passport and its internal Audiences product to provision secure access for hundreds of business teams and over 2,000 projects in seconds, enabling rapid deployment of client-specific applications while maintaining strict usage controls and automated offboarding.

2026-11-02

Vercel21:00

Introducing Vercel Security Review

Vercel introduces Security Review, a new feature in Vercel Agent that automatically scans for vulnerabilities in code changes pushed to connected GitHub repositories. It provides real-time findings via pull request comments, a Security dashboard, and CLI access, with options to auto-fix issues using Vercel Agent or integrate with custom coding agents. The tool checks for logic flaws, enforces team-specific security policies, tracks vulnerabilities across deployments, and supports audit logging for Enterprise users. Available now in public beta for Pro and Enterprise teams, it is free until November 10, 2026.