THE NEXT THING, IN PERSPECTIVEIndependent AI news

The latest AI news, in focus.

Official announcements and industry reporting. Follow the timeline of AI.

Today's news

News feed
AI NEWS × FOXAIFind your next step

From the latest news to tools that work for you.

Explore AI tools

Discover AI tools

Swipe to explore →
KiroCoding & development

Kiro is an AI engineering tool for developers that organizes requirements into specifications, architectures, and tasks, generates code via agents, and supports the entire workflow—from planning to code review—through property-based testing, execution memory, and integration with development tools.

AI programming tool分类推荐榜首Free entry availableView details
Open DesignDesign & 3D

OpenDesign is an open-source design workspace that can connect to local programming agents, use built-in model keys, or leverage cloud-based models, enabling the creation and editing of prototypes, web pages, presentations, and graphics within a design system; local software is free, while model services incur fees.

AI design tools分类推荐榜首Free entry availableView details
EvoMapAgents & automation

EvoMap is an infrastructure designed for the reuse of AI agent experiences. It organizes reusable strategies and repair assets with validation records via the GEP protocol, offering market- and quality-based ranking to help different agents discover, evaluate, and inherit existing capabilities.

分类推荐榜首Pricing unverifiedView details
MemoAIMusic & audio

MemoAI is an AI-powered audio-to-text tool that supports localized processing, eliminating the need to upload data and ensuring privacy and security. It can efficiently transcribe YouTube videos, podcasts, and local audio/video files (such as MP4, MP3, AAC, M4A, etc.) into text, while offering core features like multilingual translation, speaker diarization, real-time subtitles, and floating notes—making it ideal for meeting minutes, interview transcription, content learning, and more.

AI AUDIO TOOL分类推荐榜首Pricing unverifiedView details
AI ShortWriting & content

AIS ALERT MANAGEMENT AND SHARED PLATFORM, QUICK COMMAND FOR MULTIPLE SCENARIOS

AI HINT COMMAND分类推荐榜首Pricing unverifiedView details
JAXModels & infrastructure

JAX is a Python numerical computing library designed for accelerators, specifically tailored for high-performance array computations and large-scale machine learning. It efficiently executes the same code across multiple hardware backends, including CPUs, GPUs, and TPUs.

AI DEVELOPMENT PLATFORM分类推荐榜首Pricing unverifiedView details
Zoom WorkplaceOffice & productivity

Zoom Workplace is Zoom’s team collaboration platform, integrating video conferencing, chat, calendars, and documents, and leveraging built-in AI to organize discussions, draft messages, and track follow-up tasks.

AI meeting tool待评分 · 分类列表推荐Pricing unverifiedView details
RowsData & analytics

Rows is a spreadsheet tool that combines AI analytics, data integration, and interactive reporting, enabling you to organize documents and business data using natural language, merge datasets, generate reports, and build computational models. The official website currently indicates that it has been integrated with Superhuman and provides a corresponding link to continue using the service.

DATA PROCESSING FOR AI FORMS待评分 · 分类列表推荐Pricing unverifiedView details
IamIPIndustry applications

IamIP is a patent platform that provides AI-driven search, analysis, and monitoring tools to help users conduct patent research and management more efficiently.

待评分 · 分类列表推荐Pricing unverifiedView details
My Glow Up AILife & personal

My Glow Up AI provides free analysis based on selfies, without requiring registration, and can generate hairstyle recommendations and beauty plans that suit you.

待评分 · 分类列表推荐Pricing unverifiedView details

AI, as it happens

2154 published stories
Inference systems & deployment · 191 storiesClear filters ×
2026-11-18
Follow the timeline
03:11

b12480

The Llama UI design system, including tokens, surfaces, fonts, and base components, has been moved from a temporary repository to ui/lib/ui, where it is now published as @ggml-org/llama-ui. Llama Chat now imports all UI elements—including model components, constants, enums, and helpers—from this centralized library, eliminating duplicate code. The update includes updated branding with Llama Sans and Llama Mono fonts, improved submenu rendering, enhanced elevation for chat form elements, and integration with the llama-brand package for colors and logo. The UI is now consistently applied across the application, with builds and deployment configurations adjusted accordingly.

Inference systems & deploymentRead original
2026-11-17
Follow the timeline
21:43

b12475

The Llama Chat UI has been upgraded to SvelteKit 3, integrating its built-in service worker for improved update detection and offline functionality. The migration includes updates to Vite 8, TypeScript 6, Storybook 10, and ESLint 10, along with the replacement of deprecated packages and resolution of npm audit issues through dependency overrides, including pinning minimatch to version 11.0.5 to address a security vulnerability. Changes also align with current Svelte patterns, such as using $state instead of stores and adopting new syntax for actions and class bindings.

Inference systems & deploymentRead original
21:25

b12474

The llama.cpp release b12474 introduces the application of output projection weight scale and provides precompiled binaries for multiple platforms including macOS, Linux, Windows, Android, and openEuler, supporting various backends such as CUDA, Vulkan, ROCm, OpenVINO, and SYCL.

Inference systems & deploymentRead original
13:05

b12456

The update addresses three issues in the OpenCL implementation of the bin flash-attention prefill path: releasing a previously unreleased WMM flash-attention mask fallback image, excluding q8_0 K/V at head size 512 from the WMM kernel due to incorrect results, and preventing the use of the WMM path beyond device 3D image limits to avoid clCreateImage failures.

Inference systems & deploymentRead original
11:34

b12451

The web UI for Llama.cpp has been relocated from tools/ui to ui/apps/chat as part of a structural refactoring to separate the component library (ui/lib) from the applications built on it. The app is now officially named Llama Chat, with its package renamed to @ggml-org/llama-chat, while maintaining private status. Documentation, help text, comments, and other references have been updated to reflect the new name, though legacy identifiers remain unchanged for backward compatibility.

Inference systems & deploymentRead original
04:44

b12445

The update introduces support for split_k in conv3d operations using Vulkan, leveraging a 256x128 shape (coopmat2-only) when beneficial and reusing the mul_mat split_k reduce shader.

Inference systems & deploymentRead original
2026-11-16
Follow the timeline
20:49

b12438

The release includes support for json sort_keys=true in jinja, with various precompiled binaries available for macOS, Linux, Windows, Android, and other platforms, including CUDA, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon backend options.

Inference systems & deploymentRead original
19:16

b12433

A fix was implemented to prevent the MUL_MAT_ID operation from aborting on AMD devices when using F32, F16, or BF16 data types with an odd number of columns in src0, particularly affecting rank 1 LoRA on MoE expert weights. The issue arose because MMVF read src0 in pairs and required an even ne[0], so the fix restricts MMVF usage to cases with even ne[0], defaulting to fallback for other shapes. This resolves issue #30576.

Inference systems & deploymentRead original
17:20

b12431

The update addresses issues with reasoning effort levels by ensuring rejected levels are properly handled during parsing, preventing 500 errors on API endpoints. It maintains support for template-ignored levels and aliases while trimming the output_config.effort test to a single level.

Inference systems & deploymentRead original
13:00

Does the Ranking Hold? A Practitioner-Facing Audit of Hallucination Detectors on Small, Quantized, On-Device LLMs

arXiv:2611.17339v1 Announce Type: new Abstract: Hallucination detection for large language models is dominated by methods evaluated on 7B-70B research models with abundant sampling budgets and exact-match or ROUGE correctness labels. The small models practitioners actually ship on-device, Phi-3-mini, Llama-3.2-3B-Instruct, Qwen2.5-3B-Instruct, and Gemma-2-2B-Instruct, typically at 4-bit precision, sit outside this evidence base. We present a reproducible one-GPU audit of four detectors spanning three paradigms: length-normalized token-margin calibration, a lexical n-gram baseline, and two sampling-based consistency methods (semantic entropy and SelfCheckGPT-NLI) on two small open instruction-tuned models (Llama-3.2-3B-Instruct and Qwen2.5-3B-Instruct) loaded at 4-bit NF4 quantization on a single Colab T4 GPU, evaluated on closed-book TriviaQA. Cross-model ranking transfer is poor: Spearman rho is -0.80 and Kendall tau-b is -0.667, meaning the detector ranking actively inverts between the two models, and the cheap lexical baseline is statistically indistinguishable from the sampling-based consistency detectors on both models under bootstrap 95 percent confidence intervals. As a second, methodological contribution, we show that the standard token-overlap-to-multiple-choice correctness labeler for TruthfulQA-Generation produces near-chance AUROC (0.46-0.59) for all four detectors on both models, a labeler failure, not a detector failure, since the same detectors reach 0.69-0.89 AUROC on TriviaQA under the identical pipeline. We release the harness, prompts, and per-item scores and frame the detector choice explicitly as a fairness-of-error-rates allocation problem for practitioners deploying on resource-constrained, on-device hardware.

Inference systems & deploymentRead original
08:12

b12428

The update includes the addition of four missing features in jinja, along with applied suggestions and a fix for an error message. This release is part of the llama.cpp project, offering binaries for multiple platforms including macOS, Linux, Windows, Android, and openEuler, supporting various backends like CUDA, Vulkan, ROCm, OpenVINO, and SYCL.

Inference systems & deploymentRead original
02:14

b12421

The llama.cpp release b12421 includes updated binaries for multiple platforms including macOS, Linux, Windows, Android, and iOS, with support for various backends such as CUDA, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon. The documentation has been reorganized, moving per-model TTS content to /docs and linking it from other pages. Some builds, like macOS Apple Silicon with KleidiAI and openEuler variants, are currently disabled.

Inference systems & deploymentRead original
2026-11-15
Follow the timeline
19:13

b12410

The release includes a fix to clear the slot cache when the global LoRA configuration changes, ensuring consistency in model loading and inference. Prebuilt binaries are available for multiple platforms including macOS, Linux, Windows, Android, and iOS, supporting various backends like CUDA, Vulkan, ROCm, OpenVINO, and SYCL.

Inference systems & deploymentRead original
17:27

b12406

The latest release of llama.cpp introduces support for Inkling 2, including text and vision capabilities. This update includes text inference implementation, GGUF conversion for text models, vision multimodal projection support, still-image encoding, flash attention with folded bias and sinks, and improvements to tensor mapping and testing. The changes also address model conversion, checkpoint handling, and compatibility across multiple platforms, with support for CPU, GPU (CUDA, ROCm, Vulkan), and specialized hardware like Snapdragon and OpenVINO.

Inference systems & deploymentRead original
13:58

b12397

The update introduces a change to the template soft_max_f32_parallelize_cols_single_row to store column elements in registers when feasible, reducing global memory traffic from five passes to two, thereby improving performance on CUDA-enabled systems.

Inference systems & deploymentRead original
02:48

b12385

The qwen2vl model in llama.cpp was producing incorrect results due to NULL values being passed for FFN weight scales, preventing per-tensor NVFP4 scales from being applied. This issue has been resolved by correctly passing the scales to the build_ffn function, consistent with how qwen2 handles them.

Inference systems & deploymentRead original
Every update links back to its source.
STAY CURIOUS. STAY INFORMED.

Stay informed about the changes that matter.

Give your curiosity direction. Make every day of reading count.

Subscribe via RSS