b12445
The update introduces support for split_k in conv3d operations using Vulkan, leveraging a 256x128 shape (coopmat2-only) when beneficial and reusing the mul_mat split_k reduce shader.
Official announcements and industry reporting. Follow the timeline of AI.
From the latest news to tools that work for you.
EvoMap is an infrastructure designed for the reuse of AI agent experiences. It organizes reusable strategies and repair assets with validation records via the GEP protocol, offering market- and quality-based ranking to help different agents discover, evaluate, and inherit existing capabilities.
分类推荐榜首KKiro is an AI engineering tool for developers that organizes requirements into specifications, architectures, and tasks, generates code via agents, and supports the entire workflow—from planning to code review—through property-based testing, execution memory, and integration with development tools.
分类推荐榜首A
AI ShortWriting & contentAIS ALERT MANAGEMENT AND SHARED PLATFORM, QUICK COMMAND FOR MULTIPLE SCENARIOS
分类推荐榜首OOpenDesign is an open-source design workspace that can connect to local programming agents, use built-in model keys, or leverage cloud-based models, enabling the creation and editing of prototypes, web pages, presentations, and graphics within a design system; local software is free, while model services incur fees.
分类推荐榜首M
MemoAIMusic & audioMemoAI is an AI-powered audio-to-text tool that supports localized processing, eliminating the need to upload data and ensuring privacy and security. It can efficiently transcribe YouTube videos, podcasts, and local audio/video files (such as MP4, MP3, AAC, M4A, etc.) into text, while offering core features like multilingual translation, speaker diarization, real-time subtitles, and floating notes—making it ideal for meeting minutes, interview transcription, content learning, and more.
分类推荐榜首JJAX is a Python numerical computing library designed for accelerators, specifically tailored for high-performance array computations and large-scale machine learning. It efficiently executes the same code across multiple hardware backends, including CPUs, GPUs, and TPUs.
分类推荐榜首MMy Glow Up AI provides free analysis based on selfies, without requiring registration, and can generate hairstyle recommendations and beauty plans that suit you.
待评分 · 分类列表推荐UUdacity AI Academy is the gateway to AI courses and learning paths, covering machine learning, deep learning, computer vision, natural language processing, and AI product management, with courses and project-based training available at both beginner and advanced levels.
待评分 · 分类列表推荐E
ElicitKnowledge & researchElicit provides semantic search, research report generation, literature screening, and data extraction for scientific research. It enables traceable answers within source materials and organizes evidence through a literature library, research agents, and ongoing tracking workflows, making it ideal for advancing from initial problem exploration to systematic reviews.
待评分 · 分类列表推荐CClipdrop is a suite of AI-powered image creation and editing tools, covering background removal, local cleanup, image enlargement, upscaling, relighting, text removal, and background replacement. It allows users to process images directly in the browser and also provides developers with an API for integrating these capabilities into their applications.
待评分 · 分类列表推荐The update introduces support for split_k in conv3d operations using Vulkan, leveraging a 256x128 shape (coopmat2-only) when beneficial and reusing the mul_mat split_k reduce shader.
The release includes support for json sort_keys=true in jinja, with various precompiled binaries available for macOS, Linux, Windows, Android, and other platforms, including CUDA, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon backend options.
A fix was implemented to prevent the MUL_MAT_ID operation from aborting on AMD devices when using F32, F16, or BF16 data types with an odd number of columns in src0, particularly affecting rank 1 LoRA on MoE expert weights. The issue arose because MMVF read src0 in pairs and required an even ne[0], so the fix restricts MMVF usage to cases with even ne[0], defaulting to fallback for other shapes. This resolves issue #30576.
A performance improvement in llama.cpp addresses the issue of an O(n_cells) scan during each sequence removal, optimizing efficiency by reducing computational overhead.
The update addresses issues with reasoning effort levels by ensuring rejected levels are properly handled during parsing, preventing 500 errors on API endpoints. It maintains support for template-ignored levels and aliases while trimming the output_config.effort test to a single level.
The update includes the addition of four missing features in jinja, along with applied suggestions and a fix for an error message. This release is part of the llama.cpp project, offering binaries for multiple platforms including macOS, Linux, Windows, Android, and openEuler, supporting various backends like CUDA, Vulkan, ROCm, OpenVINO, and SYCL.
The llama.cpp release b12421 includes updated binaries for multiple platforms including macOS, Linux, Windows, Android, and iOS, with support for various backends such as CUDA, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon. The documentation has been reorganized, moving per-model TTS content to /docs and linking it from other pages. Some builds, like macOS Apple Silicon with KleidiAI and openEuler variants, are currently disabled.
A fix has been implemented to correct the placement of begin/end of image tokens in the Inkling 2 model within the chat functionality, along with the addition of a test to ensure stability.
The release includes a fix to clear the slot cache when the global LoRA configuration changes, ensuring consistency in model loading and inference. Prebuilt binaries are available for multiple platforms including macOS, Linux, Windows, Android, and iOS, supporting various backends like CUDA, Vulkan, ROCm, OpenVINO, and SYCL.
The latest release of llama.cpp introduces support for Inkling 2, including text and vision capabilities. This update includes text inference implementation, GGUF conversion for text models, vision multimodal projection support, still-image encoding, flash attention with folded bias and sinks, and improvements to tensor mapping and testing. The changes also address model conversion, checkpoint handling, and compatibility across multiple platforms, with support for CPU, GPU (CUDA, ROCm, Vulkan), and specialized hardware like Snapdragon and OpenVINO.
The update introduces a change to the template soft_max_f32_parallelize_cols_single_row to store column elements in registers when feasible, reducing global memory traffic from five passes to two, thereby improving performance on CUDA-enabled systems.
The qwen2vl model in llama.cpp was producing incorrect results due to NULL values being passed for FFN weight scales, preventing per-tensor NVFP4 scales from being applied. This issue has been resolved by correctly passing the scales to the build_ffn function, consistent with how qwen2 handles them.
The update refactors DFlash-based speculative decoding methods in llama.cpp by restructuring code organization, sharing components across models, splitting decoder graphs per head, and introducing dedicated classes for DFlash2 and LiliCorr drafts. It also adds support for new draft types, improves documentation, and removes unused code.
A warning is now issued when the --spec-draft-p-min parameter is used with probabilistic draft sampling, as the draft's top probability does not reliably indicate how much of the draft the target model would accept under rejection sampling. The warning is skipped for drafters that do not use p_min, such as n-gram and DSpark.
The latest release of llama.cpp (b12362) includes optimizations for grammar matching through left factoring, improved handling of character class boundaries, prevention of infinite expansion, and enhanced code clarity with ASCII comments and deduplicated logic. It reverts prior changes related to AST refactoring and alternative limits, while introducing shared immutable rules and removing performance benchmarks. The release supports multiple platforms including macOS, Linux, Windows, Android, and iOS, with various backend options such as CUDA, Vulkan, ROCm, OpenVINO, and SYCL.
The llama.cpp project has released version 1.0.0, marking a significant milestone with numerous improvements across multiple platforms including CUDA, Vulkan, Metal, SYCL, OpenCL, and WebGPU. Key updates include enhanced support for quantized models (Q5_0, Q5_1, FP8), optimizations for flash attention and MoE caching, improved server security features like CORS protection and SSRF mitigation, UI enhancements such as sidebar reorganization and live-preview markdown editing, and better cross-platform compatibility. The release also includes bug fixes, CI/CD improvements, and updated dependencies.
The release includes support for Q5_0 and Q5_1 quantization levels on Hexagon NPUs, with dedicated kernels for Q5_0 in the hex-mm module.
A security update has been released to address Server-Side Request Forgery (SSRF) vulnerabilities related to CORS proxy and media URLs in the llama.cpp server component.
The update requires the position embedding tensor for HunyuanVL to be explicitly provided as F32 during model loading to prevent buffer overflow issues when using F64 tensors, ensuring compatibility and stability on first image requests.
MMVF is recommended for BF16 matrices with few rows and small batch sizes due to its superior performance when K is large, while MMF remains efficient for larger row counts. The decision depends on the condition rows × batch × 256 ≤ nsm × min(K, max_k) and K ≥ 1024, with GPU-specific limits on columns and max_k. Evaluation cases include 128×2560, 512×2560, and 320×10240 at batch sizes 2–8.
Give your curiosity direction. Make every day of reading count.