Inkling Model Debuts in Transformers & vLLM; Stockfish 18 & llama.cpp Multimodal Updates

Hugging Face Transformers v5.14.0 officially introduces the Inkling model family, a new general-purpose multimodal model from Thinking Machines. Weighing in at 975 billion total parameters with 41 billion active parameters, Inkling marks a significant new entry in the open-weight model landscape. Its inclusion in the Transformers library means developers can immediately access and experiment with this substantial model, leveraging the comprehensive toolset provided by Hugging Face for model loading, processing, and inference. This release positions Inkling for broad adoption and further development within the AI community, especially for those working with large-scale multimodal tasks. Complementing this, vLLM v0.26.0 has simultaneously rolled out full support for the new Inkling model family. This includes base modeling capabilities and, crucially, piecewise CUDA graph support. The integration of CUDA graphs is a key development for inference acceleration, enabling more efficient and lower-latency execution of large models like Inkling on NVIDIA GPUs. For practitioners focused on local inference, this means Inkling can be run with optimized performance, making it more practical for real-world applications on consumer-grade hardware. The rapid, dual-platform support from both Transformers and vLLM underscores Inkling's immediate readiness for deployment and research.

The latest `llama.cpp` release, b10155, significantly expands its capabilities by adding support for the MiMo-V2.5 audio input model. This update marks an important stride into multimodal AI for `llama.cpp`, moving beyond its traditional text-only focus to handle audio inputs directly. The ability to process audio with the MiMo-V2.5 model, which is described as an RVQ-based model, is particularly relevant for local inference. RVQ (Residual Vector Quantization) is a technique known for its efficiency in compressing models, making them more amenable to running on consumer-grade CPUs and GPUs with limited memory resources. This enhancement means developers can now leverage `llama.cpp` for a broader range of applications, such as local speech-to-text processing or AI agents that respond to spoken commands, all while benefiting from the project's optimization for efficient, local execution. The continuous integration of new, diverse models and efficient quantization methods like RVQ reinforces `llama.cpp`'s position as a vital tool for making advanced AI accessible on everyday hardware. This release ensures that multimodal AI research and deployment can increasingly occur without reliance on cloud-based services.

Stockfish 18, a new major release, cements its position as the world's strongest open-source chess engine. This update continues Stockfish's legacy of pushing the boundaries of competitive computer chess, offering significant improvements in its evaluation function and search algorithms. For the "Local AI & Open Models" category, Stockfish is a prime example of high-performance AI runnable on consumer hardware, particularly through its use of Neural Network Uci Engine (NNUE) evaluation functions. NNUE networks are compact neural networks specifically designed for efficient inference on CPUs and GPUs, allowing Stockfish to achieve incredible strength through a blend of deep search and accurate, learned positional evaluation. The release of Stockfish 18 is not merely an incremental update; it represents the culmination of countless self-play games and architectural refinements by its global community of developers. Its open-source nature means the underlying technology, including its sophisticated NNUE architecture and optimization techniques, is fully transparent and available for study. For developers and AI enthusiasts, Stockfish 18 serves as an excellent case study in optimizing neural network inference for real-time decision-making in complex environments, making it a first-class story in the realm of game AI and local, high-performance computing.