Friday, September 13. 2024
10:20 – 11:10 a.m. (CST)
ETB 1020
Dr. Wen-mei W. Hwu
Senior Director of Research at NVIDIA
Professor Emeritus l Electrical & Computer Engineering
University of Illinois, Urbana-Champaign
Title: “BaM: System Architecture and Software Stack for Accelerating Compute-Directed Access to Massive Datasets”
Abstract
Compute Devices have traditionally relied on OS services to bring data into the memory in bulk before performing algorithmic computation on the individual data-structure elements. For example, Graphics Processing Units (GPUs) have relied on the host CPU services to bring chunks of storage data into its device memory for use by compute kernels. This approach is well-suited for GPU applications with known data access patterns that enable partitioning of their dataset to be processed in a pipelined fashion in the GPU. However, emerging applications such as graph and data analytics, recommender systems, and graph neural networks, require fine-grained, data-dependent and sparse access to vast feature vectors and embedding datasets. CPU services are unsuitable for these applications due to high CPU-GPU synchronization overheads, I/O traffic amplification, and low CPU software throughput. GPU-initiated access avoids these overheads by removing the CPU from the storage control path and, thus, can potentially support these applications at much higher speed. However, there is a lack of systems architecture and software stack that enable efficient GPU-initiated storage access for applications today. I will present a vision for enabling fast, compute-directed sparse access to massive datasets, the BaM system architecture to realize this vision, and the BaM software stack that efficiently supports emerging applications on existing and upcoming GPUs.
Biography
Wen-mei W. Hwu is a Senior Distinguished Research Scientist and Senior Director of Research at NVIDIA. He is also a Professor Emeritus and the Sanders-AMD Endowed Chair Emeritus of ECE at the University of Illinois at Urbana-Champaign. His research is in the architecture, algorithms, and infrastructure software for data intensive and computational intelligence applications. He served as the Illinois director of the IBM-Illinois Center for Cognitive Computing Systems Research Center (c3sr.com) from 2016 to 2020. He was a PI of the NSF Blue Waters supercomputer project. He received the ACM SigArch Eckert-Mauchly Award, ACM/IEEE Maurice Wilkes Award, the ACM Grace Murray Hopper Award, the IEEE Computer Society Charles Babbage Award, the ISCA Influential Paper Award, the MICRO Test-of-Time Award, the IEEE Computer Society B. R. Rau Award, the CGO Test-of-Time Award, numerous best paper awards, numerous teaching awards, and the Distinguished Alumni Award in CS of the University of California, Berkeley. He is a Fellow of IEEE and ACM.
To learn more about Dr. Hwu: https://research.nvidia.com/person/wen-mei-hwu
Please join us on Friday, 9/13/24 at 10:20 a.m. in ETB 1020.