Loading Events

« All Events

  • This event has passed.

ECEN Seminar – Dr. David Patterson of Google

April 23 @ 11:30 am - 12:30 pm

Zoom Meeting ID: 950 1123 2211

David Patterson
Distinguished Engineer, Google


ECEN Distinguished Speaker Seminar:
“Domain Specific Architectures for Deep Neural Networks: Three Generations of Tensor Processing Units (TPUS)”


Abstract: The recent success of deep neural networks (DNN) has inspired a resurgence in domain specific architectures (DSAs) to run them, partially as a result of the deceleration of microprocessor performance improvement due to the slowing of Moore’s Law. DNNs have two phases: training, which constructs accurate models, and inference, which serves those models. Google’s first generation Tensor Processing Unit (TPUv1) offered 50X improvement in performance per watt over conventional architectures for inference. We naturally asked whether a successor could do the same for training. This talk reviews TPUv1 and explores how Google built the first production DSA supercomputer for the much harder problem of training, which was deployed in 2017. Google’s TPUv2/TPUv3 supercomputers with up to 1024 chips train production DNNs at close to perfect linear speedup with 50X higher floating point operations per Watt than general-purpose supercomputers running the high-performance computing benchmark Linpack.


Biography: David Patterson is a UC Berkeley professor, Google distinguished engineer, RISC-V International Vice-Chair, and RISC-V International Open Source Laboratory Director. His best known projects are RISC and RAID. He co-authored seven books, including Computer Architecture: A Quantitative Approach, and shared the 2017 ACM A.M Turing Award shared with his co-author John Hennessy.


*ECEN Meeting Information Online @ https://calendar.tamu.edu/ece/view/event/event_id/238884 *

Zoom Meeting ID: 950 1123 2211


April 23
11:30 am - 12:30 pm