03:09
Make a Robot Arm Feel Weightless with NVIDIA Holoscan 5
Picture guiding a robot arm by hand while its motors supply just enough torque to support its weight and keep the robot upright. This simple interaction, a...
Today's news
Safety & governance / 01Exploring the world's languages with Language ExplorerGoogle Research
01 / IN FOCUS
Exploring the world's languages with Language Explorer
Google ResearchProducts & applications / 02Cisco research: Trust, not technology, is now the speed limit on enterprise AISiliconANGLE AI
02 / IN FOCUS
Cisco research: Trust, not technology, is now the speed limit on enterprise AI
SiliconANGLE AICompute & infrastructure / 03b12229llama.cpp releases
03 / IN FOCUS
b12229
llama.cpp releasesAI NEWS × FOXAIFind your next step
Explore AI tools From the latest news to tools that work for you.
Discover AI tools
Swipe to explore →K
KiroCoding & development
AI ShortWriting & content
JAXModels & infrastructure
Open DesignDesign & 3D
MemoAIMusic & audio
EvoMapAgents & automation
闪剪Video & animation
Meta AI助手Assistants & search
Zoom WorkplaceOffice & productivity
妙播Marketing & commerce
KiroCoding & developmentKiro is an AI engineering tool for developers that organizes requirements into specifications, architectures, and tasks, generates code via agents, and supports the entire workflow—from planning to code review—through property-based testing, execution memory, and integration with development tools.
分类推荐榜首AAI ShortWriting & contentAIS ALERT MANAGEMENT AND SHARED PLATFORM, QUICK COMMAND FOR MULTIPLE SCENARIOS
分类推荐榜首JJAXModels & infrastructureJAX is a Python numerical computing library designed for accelerators, specifically tailored for high-performance array computations and large-scale machine learning. It efficiently executes the same code across multiple hardware backends, including CPUs, GPUs, and TPUs.
分类推荐榜首OOpen DesignDesign & 3DOpenDesign is an open-source design workspace that can connect to local programming agents, use built-in model keys, or leverage cloud-based models, enabling the creation and editing of prototypes, web pages, presentations, and graphics within a design system; local software is free, while model services incur fees.
分类推荐榜首MMemoAIMusic & audioMemoAI is an AI-powered audio-to-text tool that supports localized processing, eliminating the need to upload data and ensuring privacy and security. It can efficiently transcribe YouTube videos, podcasts, and local audio/video files (such as MP4, MP3, AAC, M4A, etc.) into text, while offering core features like multilingual translation, speaker diarization, real-time subtitles, and floating notes—making it ideal for meeting minutes, interview transcription, content learning, and more.
分类推荐榜首EEvoMapAgents & automationEvoMap is an infrastructure designed for the reuse of AI agent experiences. It organizes reusable strategies and repair assets with validation records via the GEP protocol, offering market- and quality-based ranking to help different agents discover, evaluate, and inherit existing capabilities.
分类推荐榜首闪FlashCut is an AI-powered creation platform for voice-over and short-video marketing. It can generate finished videos with voiceovers, subtitles, and visuals from text, offering digital human customization, photo-to-digital-human conversion, live-stream clipping, and intelligent editing. It also provides APIs and branded mini-program solutions for businesses.
待评分 · 分类列表推荐MMeta AI助手Assistants & searchMeta's free AI chat assistant
待评分 · 分类列表推荐ZZoom Workplace is Zoom’s team collaboration platform, integrating video conferencing, chat, calendars, and documents, and leveraging built-in AI to organize discussions, draft messages, and track follow-up tasks.
待评分 · 分类列表推荐妙妙播Marketing & commerceTHE AI LIVE TELECOM SOLUTION FROM THE AD
待评分 · 分类列表推荐AI, as it happens
1542 published storiesCompute & infrastructure · 228 storiesClear filters ×
2026-11-10
Follow the timeline00:41
b12229
A fix was implemented to ensure the OpenAI-compatible chat completions endpoint correctly processes JSON schema when provided at the top level in response_format.schema, rather than requiring it to be nested within response_format.json_schema.schema. The update also improves error messages, documents the correct usage in the README, and adds test cases to verify behavior, resolving issue #10732.
2026-11-09
Follow the timeline22:00
Practice Makes Precise: At CoRL, NVIDIA and Partners Reveal How Robots Rehearse Delicate Work in Simulation
Simulation, which has long been the proving ground for robots learning to walk, roll and hop, is now helping researchers teach robots tasks that require a finer touch: aligning gears, connecting cables and assembling small components. The shift from locomotion to manipulation is taking center stage at this week’s Conference on Robot Learning (CoRL) in […]
20:00
b12220
The Metal kernel for ggml_tri has been updated to use a select operation instead of scaling by comparison, aligning its behavior with the CPU kernel. This change ensures that values outside the triangle are set to zero rather than becoming NaN when encountering ±inf. A new test, test_tri_special, validates this fix across all four triangle types, confirming it passes with the update but failed previously.
16:00
NVIDIA Announces New Planned Investments in Korean Startups at the MSIT-NVIDIA AI Startup Partnership Forum
Korea’s Ministry of Science and ICT and NVIDIA hosted the MSIT-NVIDIA AI Startup Partnership Forum at COEX. Ryu Je-myung, vice minister of science and ICT, joined NVIDIA leaders to meet with over 20 Korean startups across foundation models, physical AI, AI infrastructure and AI semiconductors. NVIDIA also announced an investment in Korean startup Point2, with […]
13:00
Korea Advances Physical AI Across Industries With NVIDIA
Tapping into the country’s strengths in manufacturing and engineering, NVIDIA is helping advance Korea’s physical AI ecosystem. The country’s industry leaders are applying accelerated computing, AI and simulation to everything from semiconductor manufacturing to robotics and autonomous vehicles. These efforts are helping bring physical AI from development into real-world production. Samsung Advances Semiconductor Engineering With […]
13:00
Korea’s AI Ecosystem Advances and Secures Agentic AI With NVIDIA
As AI agents take on more work, they need capable open models and security that advances alongside them. Hyundai Motor Group is exploring NVIDIA NemoClaw blueprints and the NVIDIA OpenShell runtime, while AIM Intelligence is integrating its Starfort platform with NVIDIA OpenShell to support secure AI agents for employee productivity and enterprise workflows. A key […]
13:00
From Chips to Skills, NVIDIA and Korea Expand Sovereign AI Collaboration
NVIDIA and Korea’s Ministry of Science and ICT (MSIT) are expanding their collaboration across the country’s sovereign AI ecosystem, from AI semiconductors and data center infrastructure to talent, startups, models, agents and security. The collaboration lays the groundwork for Korean NPU and XPU companies to explore participation in the NVIDIA NVLink Fusion ecosystem, and includes […]
13:00
ReKV: Overlapping Quantized KV Transfer and Suffix Recomputation
arXiv:2611.08770v1 Announce Type: new Abstract: Prefill--decode disaggregation moves a prompt's key--value (KV) cache between workers before the first token can be generated. Reducing this handoff to either cache compression or recomputation misses a useful choice: which layers to transmit, at what precision, and which layers to execute again on the decode worker. ReKV transfers a quantized prefix KV cache and one BF16 boundary state, then reconstructs a contiguous suffix while the prefix is in flight. In a model-shaped synthetic benchmark on cross-node H100s, the Q8 configuration meeting separately evaluated quality criteria reduces 8K handoff latency by $2.36\times$, $2.84\times$, and $3.65\times$ over BF16 transfer for Qwen2.5-7B, Qwen2.5-3B, and Qwen3-8B. It is also faster than the best measured transfer-only or recompute-only action at those points. A separate real-weight BF16 recomputation experiment reduces prefill-to-token-return time by $1.16$--$1.63\times$. The preferred action changes with prompt length and link bandwidth.
2026-11-08
Follow the timeline14:58
b12201
The llama.cpp project has released version b12201, offering pre-compiled binaries for multiple platforms including macOS, Linux, Windows, Android, and iOS. The release includes support for various backends such as CUDA, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon hardware. Notably, the MoE cache feature is disabled for the draft model in this release. Additional resources include setup guides for Snapdragon devices and separate downloads for CUDA and OpenVINO libraries.
14:39
b12200
Enhancements to OpenCL support in llama.cpp include adding new kernel functions for quantized matrix operations, improving small-n MoE GEMV performance across multiple quantization types, optimizing Adreno GPU kernel floor settings, renaming functions for clarity, and disabling bin FA for small verification batches.
12:43
b12199
The release addresses the issue of invalid UTF-8 characters in arguments passed to PEG tool calls, improving input handling and robustness.
10:05
b12198
The llama.cpp release b12198 includes a change to downgrade per-request proxy logs to trace level, along with numerous precompiled binaries for macOS, Linux, Windows, Android, and other platforms, supporting various backends like CUDA, Vulkan, ROCm, OpenVINO, and SYCL. Some builds are disabled or experimental, including openEuler and KleidiAI-enabled macOS versions.
09:46
b12197
The update introduces support for automatic loading of libhtp without relying on legacy environment variables, enhances path handling for non-ASCII directories and long paths, adds platform-wide support for FASTRPC_MANAGE_DSP_LIBRARY_PATH and GGML_HEXAGON_LIBHTP_DIR, maintains forward slashes in absolute paths on Android and Linux, ensures absolute path precedence with fallback mechanisms, and includes CDSP1,2,3 in the fallback chain for IQ10 compatibility.
09:29
b12196
The release includes updates for SYCL backend with exact rounding support in CPY operations for Q4_1, Q5_1, and Q8_0 quantization formats.
09:11
b12195
The llama.cpp release b12195 introduces a change to refuse device buffers that would exceed VRAM, improving memory management. It includes precompiled binaries for multiple platforms including macOS, Linux, Windows, Android, and openEuler, with support for various backends such as CUDA, ROCm, Vulkan, OpenVINO, SYCL, and others. Some builds are marked as disabled or experimental.
07:45
b12193
The llama.cpp release b12193 includes a change to move log-mel computation to the cgraph, removes stray files, updates mtmd_audio_track to include source, and adds tests. It provides precompiled binaries for macOS, Linux, Windows, Android, and openEuler across various architectures and backends including CUDA, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon-specific platforms.
05:28
b12192
The latest release of llama.cpp adds support for the MageVL-Cowork model and adjusts how rope frequencies are handled, now stored at the model level within clip_model instead of being copied into each clip_layer. The loader verifies that rope_freqs is a 32-bit floating-point array with dimensions matching d_head, ensuring compatibility with expected 4:6:6 splits in the computational graph.
05:11
b12191
The latest update to llama.cpp introduces enhanced MoE (Mixture of Experts) cache functionality, enabling computation of cache misses on the CPU with a configurable CPU share. A new tuning script, moe-cache-tune.py, automatically determines optimal cache size and CPU share settings based on system performance. The update also improves scheduling efficiency, removes redundant sync operations, and refactors code for better maintainability, while maintaining compatibility across multiple platforms including macOS, Linux, Windows, and Android.
00:00
ASRock Rack DMRD16-2L+ Spotted with 16 DDR5 Slots for Diamond Rapids
We check out the ASRock Rack DMRD16-2L+ which is a 16-channel Intel Diamond Rapids Xeon motherboard with 128x PCIe Gen6 lanes over MCIO The post ASRock Rack DMRD16-2L+ Spotted with 16 DDR5 Slots for Diamond Rapids appeared first on ServeTheHome.
Every update links back to its source.