PyTorch Metal Codegen Adds Uint Support; NVIDIA Blackwell/Rubin AI Factory Launched; AMD ROCm LLM Guide

This official PyTorch trunk update addresses a critical bug in the MPSInductor Metal code generation, specifically adding support for unsigned integer types. Previously, operations like `torch.eye(256)` could produce `torch.uint16` index expressions in Inductor, leading to `KeyError` exceptions because `DTYPE_TO_METAL` did not include this dtype, and `MetalOverrides.to_dtype` failed. The update maps `torch.uint16` to `half` for Metal codegen, ensuring compatibility and preventing crashes. This fix is crucial for developers leveraging Apple's Metal Performance Shaders (MPS) backend within PyTorch, particularly when working with dynamic shapes or specific indexing operations that might implicitly generate unsigned integer tensors. By resolving this type mismatch, PyTorch's Inductor is now more robust for a wider range of graph compilations on MPS-enabled hardware, improving stability and performance for macOS users developing AI applications. This enhancement contributes to the overall reliability of PyTorch's native GPU acceleration on Apple Silicon.

NVIDIA announced that Firebird, an emerging AI cloud provider, has launched the CIS region's largest AI factory in Armenia, establishing a significant new AI computing hub. This facility is powered by NVIDIA acceleration, notably mentioning the use of current and future-generation NVIDIA platforms, including Blackwell and Rubin. The announcement highlights Firebird's commitment to scaling its infrastructure to meet the surging global demand for AI compute, with plans to expand its total compute capacity to 100 exaflops by the end of the decade. The deployment of such a massive AI factory, leveraging NVIDIA's cutting-edge Blackwell and future Rubin architectures (which are NVIDIA's next-gen GPU platforms beyond Hopper), signals critical advancements in global AI infrastructure. It underscores NVIDIA's strategy to democratize access to advanced AI computing capabilities worldwide and demonstrates the rapid global expansion of AI cloud services built on NVIDIA's GPU technology, crucial for training and deploying large-scale AI models.

The AMD ROCm Blog has published a deep dive into enabling language-specific reasoning in multilingual models using reinforcement learning, introducing the Poro 2 Long family of models. This follow-up to the Poro 2 family builds upon its strong performance in Finnish and English instruction-following and conversational tasks. The post outlines methodologies for enhancing multilingual capabilities, particularly for low-resource languages, through techniques like pretraining data augmentation and specific reinforcement learning from human feedback (RLHF) strategies. This article provides practical insights and a training playbook for researchers and developers utilizing ROCm-powered hardware for large language model (LLM) development. It demonstrates how to fine-tune models to exhibit robust performance across multiple languages, offering a valuable resource for optimizing LLMs on AMD Instinct GPUs. The focus on overcoming challenges in multilingual AI, especially for under-represented languages, directly supports the broader adoption and utility of ROCm for diverse AI workloads.