ROCm 6.3 adds several new features including a Fortran compiler, and SGLang

AMD Launches ROCm 6.3: Key Updates for AI and Fortran

AMD has launched ROCm version 6.3, introducing significant updates to its open-source driver stack. The new SGLang runtime improves latency and throughput for generative AI models on Instinct GPUs, achieving up to 6X performance boosts in large language model inferencing. Meanwhile, FlashAttention-2 improves upon its predecessor by reducing memory usage and offering up to 3x speedup for AI model training. Additionally, a new Fortran compiler all…

ROCm 6.3 adds several new features including a Fortran compiler, and SGLang

ROCm 6.3 adds several new features to the open source platform, helping accelerate various workloads on Instinct GPUs such as AI and HPC workloads.

AMD Releases ROCm Version 6.3

Nov. 26, 2024: AMD today announced the release of ROCm Version 6.3 open-source platform, introducing tools and optimizations for AI, ML and HPC workloads on AMD Instinct GPU accelerators. ROCm 6.3 is engineered for a range of organizations, from AI startups to HPC-driven industries, and is designed to enhance developer productivity Features of this release […] The post AMD Releases ROCm Version 6.3 appeared first on High-Performance Computing Ne…

AMD Releases ROCm 6.3 with SGLang, Fortran Compiler, Multi-Node FFT, Vision Libraries, and More

AMD has released the new ROCm 6.3 version which introduces several new features and optimizations, including SGLang integration for accelerated AI inferencing, a re-engineered FlashAttention-2 for optimized AI training and inference, the introduction of multi-node Fast Fourier Transform (FFT), new Fortran compiler, and enhanced computer vision libraries like rocDecode, rocJPEG, and rocAL. According to AMD, the SGLang, a runtime that is now sup…

AMD Talks Up Imminent ROCm 6.3 With Big Performance Gains, New Features

Either due to a mistimed blog post or other factors, a big feature article is out talking up the new ROCm 6.3 features... But the updated ROCm 6.3 open-source GPU compute software doesn't appear to actually be released yet at all their usual sources. In any event there are new features and big performance gains being talked up for ROCm 6.3...