THE NEXT THING, IN PERSPECTIVEIndependent AI news

The latest AI news, in focus.

Official announcements and industry reporting. Follow the timeline of AI.

Today's news

News feed
AI NEWS × FOXAIFind your next step

From the latest news to tools that work for you.

Explore AI tools

Discover AI tools

Swipe to explore →
KiroCoding & development

Kiro is an AI engineering tool for developers that organizes requirements into specifications, architectures, and tasks, generates code via agents, and supports the entire workflow—from planning to code review—through property-based testing, execution memory, and integration with development tools.

AI programming tool分类推荐榜首Free entry availableView details
Open DesignDesign & 3D

OpenDesign is an open-source design workspace that can connect to local programming agents, use built-in model keys, or leverage cloud-based models, enabling the creation and editing of prototypes, web pages, presentations, and graphics within a design system; local software is free, while model services incur fees.

AI design tools分类推荐榜首Free entry availableView details
AI ShortWriting & content

AIS ALERT MANAGEMENT AND SHARED PLATFORM, QUICK COMMAND FOR MULTIPLE SCENARIOS

AI HINT COMMAND分类推荐榜首Pricing unverifiedView details
EvoMapAgents & automation

EvoMap is an infrastructure designed for the reuse of AI agent experiences. It organizes reusable strategies and repair assets with validation records via the GEP protocol, offering market- and quality-based ranking to help different agents discover, evaluate, and inherit existing capabilities.

分类推荐榜首Pricing unverifiedView details
JAXModels & infrastructure

JAX is a Python numerical computing library designed for accelerators, specifically tailored for high-performance array computations and large-scale machine learning. It efficiently executes the same code across multiple hardware backends, including CPUs, GPUs, and TPUs.

AI DEVELOPMENT PLATFORM分类推荐榜首Pricing unverifiedView details
MemoAIMusic & audio

MemoAI is an AI-powered audio-to-text tool that supports localized processing, eliminating the need to upload data and ensuring privacy and security. It can efficiently transcribe YouTube videos, podcasts, and local audio/video files (such as MP4, MP3, AAC, M4A, etc.) into text, while offering core features like multilingual translation, speaker diarization, real-time subtitles, and floating notes—making it ideal for meeting minutes, interview transcription, content learning, and more.

AI AUDIO TOOL分类推荐榜首Pricing unverifiedView details
My Glow Up AILife & personal

My Glow Up AI provides free analysis based on selfies, without requiring registration, and can generate hairstyle recommendations and beauty plans that suit you.

待评分 · 分类列表推荐Pricing unverifiedView details
闪剪Video & animation

FlashCut is an AI-powered creation platform for voice-over and short-video marketing. It can generate finished videos with voiceovers, subtitles, and visuals from text, offering digital human customization, photo-to-digital-human conversion, live-stream clipping, and intelligent editing. It also provides APIs and branded mini-program solutions for businesses.

待评分 · 分类列表推荐Pricing unverifiedView details
AssemblyAIMusic & audio

AssemblyAI is a speech AI platform for developers, offering pre-recorded, real-time, and short-form synchronous transcription APIs. It enables the building of voice-based applications by integrating capabilities such as speaker identification, emotion analysis, chapter and summary extraction, as well as speech agent functionality, dictation, and sensitive information processing.

AI AUDIO TOOL待评分 · 分类列表推荐Pricing unverifiedView details
Meta AI助手Assistants & search

Meta's free AI chat assistant

待评分 · 分类列表推荐Pricing unverifiedView details

AI, as it happens

2176 published stories
2026-11-03
Follow the timeline
16:09

llama.cpp · b12065

kv-cache : never return 0 kv_rows for sequences without cells (#31570) A cache that shares the cells of another one (f.ex. the gemma4 assistant) can build a graph before its sequences have any cells, f.ex. at the server warmup. get_n_kv_rows() then returned 0, which means that kv_rows are not used, so the graph fell back to the dense KQ mask and the scheduler re-planned for it. Later graphs with larger masks then aborted with GGML_SCHED_DEBUG_REALLOC=1. **Website:** - **Attestations:** - **macOS/iOS:** - [macOS Apple Silicon (arm64)](https://github.com/ggml-org/llama.cpp/releases/download/b12065/llama-b12065-bin-macos-arm64.tar.gz) - macOS Apple Silicon (arm64, KleidiAI enabled) [DISABLED](https://github.com/ggml-org/llama.cpp/pull/23780) - [macOS Intel (x64)](https://github.com/ggml-org/l

Inference systems & deploymentRead original
15:00

Cities Worldwide Build and Scale AI Services With NVIDIA Physical and Agentic AI

Cities generate enormous amounts of data from cameras, sensors and operational systems, but turning it into useful action — for planning, maintenance and public services — remains a challenge. Physical and agentic AI offer new ways to close that gap, from digital twins for infrastructure planning to vision and service agents, while keeping local governments […]

M&A & IPOs# OfficialRead original
13:32

I discovered a sound that leaks your exact location (and it's everywhere) - YouTube

I discovered a sound that leaks your exact location (and it's everywhere) - YouTube Genius piece of OSINT by Colsto, who demonstrates how you can take almost imperceptible background noise of planes from a video soundtrack, figure out their Doppler curves, then cross reference them against ADS-B data to find the exact location of the video based on their speed, distance, and gaps between different flights. Via Lobste.rs Tags: privacy, youtube

Copyright, privacy & ethics# IndividualRead original
13:00

Fairway: Load-Aware KV Cache Reuse for LLM Prefill Scheduling

arXiv:2611.02082v1 Announce Type: new Abstract: LLM-based applications often employ agentic workflows and retrieval-augmented generation (RAG), which build long prompts from shared context. When prefixes are shared across requests, serving engines reuse the key-value (KV) cache to skip parts of the prefill computation. Reuse is typically graded: the uncached work of requests in a queue can differ by up to 100x. In this setting, the order of scheduling determines the time-to-first-token (TTFT) for the queued requests. KV reuse-first scheduling, which prioritizes the requests with the longest KV cache hit, gives the lowest median TTFT but starves expensive requests under load spikes; first-come-first-served (FCFS) scheduling bounds the tail but raises the median TTFT. We present Fairway, a prefill scheduler built on adaptive reuse prioritization: it favors KV cache reuse while queues are short, and shifts toward fair allocation as requests wait longer relative to their own prefill time. Fairway employs a virtual dual lane model: a KV reuse-first Fast lane and a Fair lane atop the serving engine's waiting queue that enables speeding up of cheap reuse requests without starving expensive ones. This model automatically adapts to the workload without any per-workload tuning. Fairway lowers the tail TTFT at no cost to the median in transient overload. Across workloads and load levels, Fairway matches or beats the best baseline, with a p99 TTFT up to 8.6x lower than prior prefix-aware schedulers. During load spikes, it keeps the tail of FCFS at a 6x lower median TTFT.

Inference systems & deploymentRead original
13:00

From Single-Shot QA to Continuous Perception: Revisiting the Energy Composition and Optimization Boundary of Edge VLMs

arXiv:2611.00036v1 Announce Type: new Abstract: Visual-prefill energy conclusions for edge vision-language models (VLMs) are commonly drawn under single-shot workloads; we revisit them under continuous perception. Profiling nine VLMs across three architecture families on Jetson AGX Thor and Orin (4,508 records, calibrated with a pure-text task), we find two mutually independent energy laws: the per-output-token decode cost grows monotonically with model scale, whereas the visual-prefill (image-encoding) cost is dominated by visual-encoder architectural efficiency, not scale. Under continuous perception ($N{=}10$) with sparse output, visual-prefill energy reaches 92--97\% of total. We derive optimization strategies---visual frame reuse, adaptive output truncation, task-aware routing, and encoder throughput optimization---for edge VLM deployment.

Token pricing, cost & energyRead original
13:00

Rethinking Model Aggregation for Federated Learning with Domain Skew: A Knowledge-Preserving Perspective

arXiv:2611.01893v1 Announce Type: new Abstract: Domain skew challenges federated learning by requiring a shared model to accommodate distinct visual distributions. Domain-specific experts can capture these distributions separately, creating an opportunity to integrate their representations in a unified predictor. We propose Federated Knowledge-Preserving Learning (FKPL), a two-stage framework that combines domain-oriented expert training with prototype-based classifier calibration. First, a one-shot subspace-based clustering procedure groups clients for intra-cluster training. The resulting expert encoders are concatenated and frozen, preserving each learned feature mapping during global integration. Second, clients interpolate their concatenated features with class-matched domain prototypes and upload the resulting virtual features. The server trains a global linear classifier on these features, concentrating classifier optimization at the server after a single feature upload. FKPL achieves average accuracies of 73.01\%, 67.00\%, and 64.51\% on Office-Caltech-10, PACS, and a four-domain subset of DomainNet, respectively. On DomainNet, its cross-domain standard deviation is 7.50 percentage points, the lowest among the evaluated methods. With the same concatenated extractor, prototype-based calibration improves average accuracy over federated classifier training by 9.99 and 14.94 percentage points on Office-Caltech-10 and PACS. These results identify classifier calibration as an effective way to combine preserved domain representations into a global predictor.

Enterprise & work applicationsRead original
13:00

Token-as-a-Utility: A Model-Agnostic Architecture for Metering and Provisioning AI Inference Services

arXiv:2611.01371v1 Announce Type: new Abstract: Token-based subscriptions are emerging as a commercial model for large language model inference, but extending them into interoperable utility services requires comparable consumption accounting. Raw token counts do not consistently measure inference resource use because demand varies with model architecture, context length, tokenisation, and concurrent serving conditions. This paper presents Token-as-a-Utility, a model-agnostic architecture integrating inference metering, service-level-aware provisioning, and inter-operator settlement. We prove that, under batched serving, no per-request meter can be additive, independent of co-resident traffic, and exactly cost-reflective at once. This motivates separating provisioned capacity, metered consumption, and contracted quality into distinct service products. Consumption is expressed in Reference Inference Units (RIUs) derived from prefill and decode demand, while occupancy-indexed operator ratings recover shared serving costs without altering the common unit. Versioned inference records support auditing and re-rating across operators; software-enforced capacity leases and quality-constrained routing enable provisioning on shared accelerators. The resource model is measured on three NVIDIA RTX 5000 Ada GPUs, and multi-tenant behaviour is evaluated with a trace-driven model calibrated to them. For the reference model, occupancy-indexed rating limits statement energy error to 9% under measured traffic, compared with up to 70.5% under fixed-occupancy rating. In calibrated multi-tenant experiments, tenant mispricing decreases from 7.36 times under flat token counting to 2.39 times with RIUs and 1.06 times after occupancy-based reconciliation. These findings demonstrate how portable inference accounting can be combined with load-dependent cost recovery and contract-based provisioning to support heterogeneous inference services across operators.

Chips, GPUs & hardwareRead original
12:00

How Mercor ships internal apps and billions of production tokens on one platform

Mercor reduced batch job processing time from 12 hours to 2–3 hours by using Vercel AI Gateway, which provided increased inference capacity and failover routing across providers. In its first 10 days on the platform, Mercor routed 18 million requests and 63 billion tokens without hitting rate limits. The company also leveraged Vercel Passport and its internal Audiences product to provision secure access for hundreds of business teams and over 2,000 projects in seconds, enabling rapid deployment of client-specific applications while maintaining strict usage controls and automated offboarding.

AI software engineeringRead original
12:00

How Zapier turns ideas into working software in hours with Vercel

Zapier leverages Vercel to rapidly develop interactive partner demos in under two hours, build internal applications like Marketing Hive and Marketing OS in a day each, and securely share sensitive data through SSO-protected deployments. The platform enables non-developers to deploy applications, supports AI orchestration via AI Gateway, and facilitates scalable, secure code execution with 3.3 million sandboxes created monthly. Vercel's speed, security, and ease of use have become central to Zapier’s innovation across engineering, marketing, and sales teams.

AI software engineeringRead original
08:00

Diagnose Vercel CLI setup problems with vercel doctor

The Vercel CLI now includes the vercel doctor command, which diagnoses setup issues by checking CLI version and installation, login status, team affiliation, project linking, vercel.json configuration, and active incidents from the Vercel status page. It reports results as OK, Warning, Failed, or Skipped, and provides specific fix commands. The tool runs without requiring login or project linkage and supports JSON output via --json for integration with coding agents.

AI software engineeringRead original
08:00

How OpenEvidence scales medical search for 650K doctors

OpenEvidence, a platform helping physicians access peer-reviewed medical evidence at the point of care, leverages Vercel to deploy updates in minutes, handle traffic spikes without additional provisioning, and reduce serverless costs by 90% through Fluid compute. The platform supports over 20 million clinical consultations monthly and serves more than 100 million Americans annually, with its small engineering team managing independent deployments for doctor- and patient-facing applications using Next.js and Vercel's infrastructure.

AI software engineeringRead original
08:00

Tencent Hy4 now available on AI Gateway

Hy4, Tencent's latest AI model with vision capabilities, is now available on Vercel's AI Gateway at 50% off through December 31, 2026. It supports reasoning, tool calling, structured outputs, image input, and a 1M-token context window. Hy4 excels in detailed image analysis, complex chart reading, and computer use across command-line and graphical interfaces. It outperforms its preview version in instruction following, long-context handling, and deep research tasks. Users can access it via the model name 'tencent/hy4' in supported tools like Claude Code, Codex, and Cursor after setting up the Vercel CLI. AI Gateway offers unified API access, usage tracking, cost management, and performance optimizations with no markup or platform fees.

AI software engineeringRead original
04:09

Vercel MCP now supports Client ID Metadata Documents

Vercel MCP now allows any client to connect by publishing a Client ID Metadata Document (CIMD), eliminating the need for manual review. Clients use a JSON file's HTTPS URL as their OAuth client_id, with consent screens displaying the client's name, logo, and hostname for transparency. Verified badges are not granted to CIMD clients, so users must trust the hostname when approving access. Existing registered apps remain unaffected.

AI software engineeringRead original
01:05

Vercel MCP now renders deployments as an interactive card

Vercel MCP introduces an interactive card feature for ChatGPT and compatible chat clients, displaying live deployment status, build logs, source details, and a Visit button upon completion. Users can debug via logs shared in chat or view full logs in fullscreen mode. For repositories with multiple projects, a project selector is available. The feature leverages the MCP Apps extension, with fallback text-only display for unsupported clients. The open_deployments tool enables lookups by project, repository, or commit with environment filtering, accessible through ChatGPT's Connectors setup.

AI software engineeringRead original
00:58

Flags Explorer redesigned for easier override sharing

Vercel has redesigned the Flags Explorer in the Vercel Toolbar to improve visibility and sharing of feature flags, now co-locating overrides, branch recommendations, and related actions. When a branch has overrides, teammates viewing the deployment are prompted with a dialog recommending those settings. The tool is available on all plans, with documentation available for getting started.

AI software engineeringRead original
00:00

Evaluate Vercel Flags from another project without sharing SDK keys.

Project Connections allow applications to evaluate flags from another Vercel project within the same team without managing SDK keys, using deployment identity for authentication. Access is managed via the Connections page or CLI, grants read-only access across all environments, and can be revoked without redeployment. Requires @flags-sdk/vercel 1.6.0 or later, or @vercel/flags-core 1.11.0 or later, and Vercel CLI 63.0.0 or later for CLI management.

AI software engineeringRead original
2026-11-02
Follow the timeline
21:00

Introducing Vercel Security Review

Vercel introduces Security Review, a new feature in Vercel Agent that automatically scans for vulnerabilities in code changes pushed to connected GitHub repositories. It provides real-time findings via pull request comments, a Security dashboard, and CLI access, with options to auto-fix issues using Vercel Agent or integrate with custom coding agents. The tool checks for logic flaws, enforces team-specific security policies, tracks vulnerabilities across deployments, and supports audit logging for Enterprise users. Available now in public beta for Pro and Enterprise teams, it is free until November 10, 2026.

AI software engineeringRead original
08:00

Blocking malicious npm packages before and during installation

Vercel now proactively checks for and blocks malicious npm packages before and during dependency installation in builds using a dynamic blocklist, preventing harmful scripts from executing. The system scans supported lockfiles and public npm downloads, automatically failing deployments if a blocked package is detected, identifying the problematic package and version, and attempting to invalidate the build cache. Users must update to a safe dependency version and regenerate the lockfile before redeploying. These security measures apply automatically to all plans without requiring configuration.

AI software engineeringRead original
Every update links back to its source.
STAY CURIOUS. STAY INFORMED.

Stay informed about the changes that matter.

Give your curiosity direction. Make every day of reading count.

Subscribe via RSS