Ollama v0.32.4 Enhances Apple GPU AI; llama.cpp Adds Vision; YaneuraOu Boosts NPS

The v0.32.4 release significantly enhances Ollama's capabilities for local AI inference, particularly for users on Apple Silicon hardware. This update introduces support for the Laguna model family via Apple's MLX engine, leveraging the integrated GPUs for accelerated inference. This integration promises improved performance and efficiency for running large language models directly on Mac devices, making powerful AI more accessible for local development and experimentation. Further advancing local inference techniques, Ollama v0.32.4 refines speculative decoding by quantizing draft-model output heads to the requested type. This optimization helps maintain efficiency and accuracy when generating text using this acceleration method, which relies on a smaller, faster model to predict tokens for a larger, more accurate one. The release also addresses critical bug fixes, including rectifying Qwen3 MoE decoding issues that arose with differently-quantized experts, ensuring consistent performance across varied quantization schemes for this popular open-weight model.

The latest llama.cpp release, b10142, marks a significant expansion of its capabilities with the preliminary addition of vision support for the Minimax-M3 model. While currently a text-only port that re-uses existing components, this update lays the groundwork for multimodal AI inference directly on local hardware. The integration leverages Minimax-M2 style Grouped-Query Attention (GQA) with per-head QK-norm and partial rotary embeddings, along with DeepSeek-V3 style lead token processing. This development is crucial for advancing local AI, as it enables the foundational llama.cpp framework to begin processing and understanding visual information in addition to text. For developers and enthusiasts, this means the potential to run multimodal models on consumer-grade CPUs and GPUs, democratizing access to more sophisticated AI applications. The initial text-only port focuses on architectural compatibility, setting the stage for full visual processing in future iterations and opening new avenues for local multimodal AI exploration.

The release of ふかうら王 V9.40 marks a substantial advancement for the popular YaneuraOu Shogi engine, delivering a significant performance uplift of approximately 30% in Nodes Per Second (NPS) for smaller models. This enhancement in search speed directly contributes to stronger play and more efficient analysis, a critical factor for competitive Shogi AI. The V9.40 update also includes comprehensive runtime bundling, incorporating CUDA, TensorRT, and cuDNN, which simplifies setup and ensures optimized GPU inference for users with NVIDIA hardware. Beyond raw speed, ふかうら王 V9.40 introduces support for `入玉特徴量` (nyugyoku features), indicating potential refinements to its NNUE evaluation function, which is crucial for handling complex end-game scenarios where a king enters the opponent's camp. This technical improvement in evaluation, combined with the packaged runtimes, makes the engine more accessible and performant for a wider range of users. A Windows x64 CPU-only version is also provided, ensuring broad compatibility regardless of GPU availability, although stressing that the highest NPS gains are typically observed with GPU acceleration.