THE NEXT THING, IN PERSPECTIVEIndependent AI news

The latest AI news, in focus.

Official announcements and industry reporting. Follow the timeline of AI.

Today's news

News feed
AI NEWS × FOXAIFind your next step

From the latest news to tools that work for you.

Explore AI tools

Discover AI tools

Swipe to explore →
JAXModels & infrastructure

JAX is a Python numerical computing library designed for accelerators, specifically tailored for high-performance array computations and large-scale machine learning. It efficiently executes the same code across multiple hardware backends, including CPUs, GPUs, and TPUs.

AI DEVELOPMENT PLATFORM分类推荐榜首Pricing unverifiedView details
Open DesignDesign & 3D

OpenDesign is an open-source design workspace that can connect to local programming agents, use built-in model keys, or leverage cloud-based models, enabling the creation and editing of prototypes, web pages, presentations, and graphics within a design system; local software is free, while model services incur fees.

AI design tools分类推荐榜首Free entry availableView details
AI ShortWriting & content

AIS ALERT MANAGEMENT AND SHARED PLATFORM, QUICK COMMAND FOR MULTIPLE SCENARIOS

AI HINT COMMAND分类推荐榜首Pricing unverifiedView details
MemoAIMusic & audio

MemoAI is an AI-powered audio-to-text tool that supports localized processing, eliminating the need to upload data and ensuring privacy and security. It can efficiently transcribe YouTube videos, podcasts, and local audio/video files (such as MP4, MP3, AAC, M4A, etc.) into text, while offering core features like multilingual translation, speaker diarization, real-time subtitles, and floating notes—making it ideal for meeting minutes, interview transcription, content learning, and more.

AI AUDIO TOOL分类推荐榜首Pricing unverifiedView details
EvoMapAgents & automation

EvoMap is an infrastructure designed for the reuse of AI agent experiences. It organizes reusable strategies and repair assets with validation records via the GEP protocol, offering market- and quality-based ranking to help different agents discover, evaluate, and inherit existing capabilities.

分类推荐榜首Pricing unverifiedView details
KiroCoding & development

Kiro is an AI engineering tool for developers that organizes requirements into specifications, architectures, and tasks, generates code via agents, and supports the entire workflow—from planning to code review—through property-based testing, execution memory, and integration with development tools.

AI programming tool分类推荐榜首Free entry availableView details
妙播Marketing & commerce

THE AI LIVE TELECOM SOLUTION FROM THE AD

待评分 · 分类列表推荐Pricing unverifiedView details
AssemblyAIMusic & audio

AssemblyAI is a speech AI platform for developers, offering pre-recorded, real-time, and short-form synchronous transcription APIs. It enables the building of voice-based applications by integrating capabilities such as speaker identification, emotion analysis, chapter and summary extraction, as well as speech agent functionality, dictation, and sensitive information processing.

AI AUDIO TOOL待评分 · 分类列表推荐Pricing unverifiedView details
Udacity AI学院Education & languages

Udacity AI Academy is the gateway to AI courses and learning paths, covering machine learning, deep learning, computer vision, natural language processing, and AI product management, with courses and project-based training available at both beginner and advanced levels.

AI learning website待评分 · 分类列表推荐Pricing unverifiedView details
IamIPIndustry applications

IamIP is a patent platform that provides AI-driven search, analysis, and monitoring tools to help users conduct patent research and management more efficiently.

待评分 · 分类列表推荐Pricing unverifiedView details

AI, as it happens

2434 published stories
Compute & infrastructure · 332 storiesClear filters ×
2026-11-21
Follow the timeline
03:27

AI deals shrink to as little as 30 days as the data layer sets the pace

Artificial intelligence has turned data infrastructure from a back-office purchase into the bottleneck that decides how fast GPUs pay off. As hyperscalers, neoclouds and enterprises race to expand their data layers, the way that infrastructure gets bought is changing just as fast. The storage industry’s longtime performance specialist sees that shift as its opening. DataDirect […] The post AI deals shrink to as little as 30 days as the data layer sets the pace appeared first on SiliconANGLE.

Chips, GPUs & hardwareRead original
03:02

b12590

The llama.cpp v1.2590 release introduces integration of the Drama3 voice cloning model with the Fish S2 codec encoder, enabling shared use of codec and audio encoder key-value pairs. The fish_s2_spkenc function now outputs clip codes and constructs Drama3 backbone rows, while the Drama3 pipeline uses reference frames through a backbone and tower with teacher forcing. Additional updates include correctness fixes, code cleanup, and removal of redundant code.

Inference systems & deploymentRead original
2026-11-20
Follow the timeline
21:49

b12569

A fix was implemented to ensure graph_max_nodes() accounts for the MoE cache's additional slot lookup and expert path, preventing overflow in models with limited tensor budgets when using quantized KV cache, particularly affecting cohere2moe with 49 layers and 443 tensors per layer.

Inference systems & deploymentRead original
19:35

b12563

The update addresses a precision issue in CUDA's per-expert fallback path where the MUL_MAT_ID operation was not properly preserving precision due to an unset operation type. The fix sets the operation to GGML_OP_MUL_MAT and reverts an earlier change that forced fp32 output, ensuring consistent precision handling across quantized matrix multiplication paths. This resolves issues with overflow to infinity in fp16 when results exceed 65504, particularly affecting models using IQ1_M weights with large batches.

Inference systems & deploymentRead original
18:46

b12561

The update introduces a chunked GATED_DELTA_NET implementation for Vulkan, including shader additions, optimizations for RDNA4 and Ampere architectures, fixes for shared memory bank conflicts and NVIDIA shader compiler issues, and support for various subgroup sizes and backend configurations. It also enables the feature by default and adds diagnostic markers for device information.

Inference systems & deploymentRead original
14:38

b12558

A fix has been implemented to disable subgroup arithmetic in the Vulkan driver for Qualcomm's Adreno GPUs, addressing an issue where subgroupAdd() after divergent code returns incorrect sums. This correction resolves problems with the decode-step norm, preventing models from generating stray tokens after long prompts. Testing on Adreno 850 and X2-90 showed improved results for ADD_RMS_NORM and RMS_NORM_MUL_ADD operations, while performance on llama 3B Q4_0 remained unchanged.

Inference systems & deploymentRead original
13:00

Berth: SLO-Preserving GPU Sharing Without New Preemption

arXiv:2611.25091v1 Announce Type: new Abstract: Inference services keep GPUs reserved for their worst-case load, and most of that capacity sits idle. Filling it with best-effort work such as training is the obvious remedy, and latency is why it rarely happens: on a shared GPU, a request that must finish within milliseconds finds the best-effort job's kernels running or queued ahead of it. Spatial sharing cannot evict them, temporal sharing gives the request only its turn, and hardware partitioning protects it by idling what it does not use. Systems that keep both the SLO and the utilization have reached inside the stack (rewriting kernels, patching the driver, instrumenting the framework), which the operator of a closed GPU stack cannot do. This paper argues that reaching inside is unnecessary. The time-slicer built into commodity GPUs already preempts a running kernel within a fraction of a millisecond and switches the moment a context runs out of work; what it lacks is priority, and priority can be created from outside by controlling what the best-effort context has to run. Berth is a user-space system built on this observation: a preloaded shim feeds the best-effort job to the GPU only when no request needs it (feed control), a declared deadline reference extends the rule to continuous-batching LLM engines, and a shortened best-effort time slice, set without privileges, bounds what a long kernel can cost. Berth changes no application, framework, kernel or driver. Across 31 scenario points with MLPerf SLOs and 13 baselines, Berth meets SLOs within a few percentage points of running alone, above every baseline, with 2.7-3.5x the best-effort throughput of the strongest ones; beside LLM serving, it meets per-token targets for nearly every request while training keeps running. Sharing a closed GPU under SLOs needs no new preemption mechanism, only control over what the existing one sees.

Chips, GPUs & hardwareRead original
07:12

b12556

A vulnerability in llama.cpp's HRM layer count validation allows integer overflow due to improper handling of uint32_t multiplication, leading to potential buffer overflows during tensor loading. The issue arises when the product of n_hrm_layers_per_stack, n_hrm_h_cycles, and (n_hrm_l_cycles + 1) is computed as a uint32_t and compared to block_count, enabling maliciously crafted inputs to pass validation despite exceeding the actual block count.

Inference systems & deploymentRead original
05:51

b12552

The update includes fixes for OpenVINO CI, optimizations for model recompiles in the prefill stage, improvements to output handling during model reuse, and support for f16 SCALE and f16/bf16 TRI operations. It also addresses issues with static-shape views in MoE layers, enhances SSM_SCAN build checks, and adds Falcon-H1 to the list of validated OpenVINO models with noted limitations.

Inference systems & deploymentRead original
05:07

Enterprise AI is pushing cloud infrastructure beyond the GPU

Enterprise adoption of artificial intelligence is creating new requirements for enterprise AI infrastructure. While much of the early AI investment centered on access to powerful GPUs, organizations moving AI applications and agents into production are discovering that accelerators are only one part of the equation. Agentic AI systems need environments where they can execute code, […] The post Enterprise AI is pushing cloud infrastructure beyond the GPU appeared first on SiliconANGLE.

Data centres & cloud computeRead original
04:00

NVIDIA and Microsoft Expand Accelerated Computing From Azure to Windows PCs

NVIDIA and Microsoft are extending their full-stack collaboration to help organizations build, customize and deploy intelligent applications — from next-generation infrastructure on Azure to industrial systems and Windows PCs. At Microsoft Ignite, the companies are expanding access to Azure virtual machines powered by NVIDIA Vera Rubin NVL72 systems, as well as adding customer availability to […]

Chips, GPUs & hardwareRead original
02:39

Hitachi Vantara bets smarter storage can close AI’s pilot-to-production gap

Enterprises pushing AI from pilot to production are learning that data, not GPUs, is the hardest part, and open table formats such as Apache Iceberg are part of the answer. Demand for AI infrastructure shows few signs of slowing, but much of the information companies need is still scattered, ungoverned and out of reach. That […] The post Hitachi Vantara bets smarter storage can close AI’s pilot-to-production gap appeared first on SiliconANGLE.

Chips, GPUs & hardwareRead original
01:46

b12549

The llama.cpp v1.25.49 release includes fixes for Inkling 2 attention mask handling, making the relative-position input a hybrid iswa input, enabling optional expert weight scale and final logit softcap, and improving KV rows mask generation for hybrid iswa memory. The update also standardizes code formatting in inkling2.cpp and ensures compatibility across multiple platforms including macOS, Linux, Windows, Android, and openEuler.

Inference systems & deploymentRead original
00:33

b12543

The update introduces a new tensor API conv_2d kernel for Metal, enabling split-K optimizations across all chips, including M5. It improves efficiency by utilizing tensor cores, reducing idle GPU time during long reductions. The kernel now splits reductions into partial sums stored in buffers, with a follow-up kernel summing them deterministically. Address math is optimized using 32-bit byte offsets, reducing computational overhead. A fallback to the generic kernel is implemented for images exceeding 4 GiB. Performance benchmarks show significant speed improvements on M5 Max devices, with reduced execution times across various convolution configurations.

Inference systems & deploymentRead original
2026-11-19
Follow the timeline
13:00

Accelerating Distributed Digital Ising Machines

arXiv:2611.23883v1 Announce Type: cross Abstract: Ising machines, dedicated accelerators built around the dynamics of Ising-like spin models, have emerged as a leading platform for combinatorial optimization and probabilistic sampling. The problems that motivate them require millions of spins, far beyond the on-chip capacity of any single device, so a practical Ising machine must distribute its computation across many devices. Prior work reports throughput at a single operating point, leaving the binding resource unidentified and platform crossovers measurable only by experiment; no calibrated cross-platform cost model of distributed Ising machines has been reported, nor have systematic techniques to accelerate their Markov chain Monte Carlo (MCMC) workloads. This work presents a calibrated cost model that decomposes digital Ising sweep time into compute, memory, synchronization, and inter-device communication terms, validated with 4.8% mean error across three GPU generations, FPGA and ASIC up to 1 million spins. Guided by the model, we address each term in turn and propose: (i) a data placement strategy, worth up to 4.2$\times$ speedup; (ii) multi-rate and bounded-staleness schedules that relax the barrier that Gibbs sampling imposes, cutting time-to-solution (TTS) by up to 3.16$\times$ on three benchmarks; and (iii) a phase-offset streaming dataflow that hides boundary exchange behind interior computation whenever a link satisfies a latency-transparency criterion, yielding up to 1.25$\times$/1.74$\times$/2.01$\times$ on an H200 pair, a ZCU106 pair, and a four-board XEM8320 $2{\times}2$ mesh. The streaming dataflow is also implemented on a fabricated four-chip 28 nm ASIC sustaining 28.1 Gflips/s at 4.81 pJ/flip.

Chips, GPUs & hardwareRead original
06:56

b12527

The update rejects malformed GGUF files that could cause out-of-bounds memory access by validating the mudd_tap_idx array bounds during hparams loading, preventing potential exploits from crafted models with excessive n_layer * n_mudd_taps values exceeding 512.

Inference systems & deploymentRead original
01:06

Agentic AI puts the CPU back at center stage as Dell and AMD chase every watt

Agentic AI is rewriting the business development playbook for chipmakers and server builders. Graphics processing units still grab the headlines, but as supercomputing and AI converge, the next wave of demand is landing on central processing units that must fit inside the power budgets data centers already have. The shift has been building for years. […] The post Agentic AI puts the CPU back at center stage as Dell and AMD chase every watt appeared first on SiliconANGLE.

Data centres & cloud computeRead original
Every update links back to its source.
STAY CURIOUS. STAY INFORMED.

Stay informed about the changes that matter.

Give your curiosity direction. Make every day of reading count.

Subscribe via RSS