Eleuther AI - Paper Presentation on AMD Training By Zyphra Team
Date:
Here, I provide an overview showing the work our team (and I, making minor contributions) performed on training Zaya-1 purely on AMD software and hardware. We outline challenges, as well as demonstrate that AMD itself is a mature platform for high performance training.
Link to video recording of the talk: https://www.youtube.com/watch?v=pKH7POtQQKk Slides: https://docs.google.com/presentation/d/1mjFM7RPNuHMsKeDF4Arr-y2YhkMBJztqp1NzRfETP7U/edit?usp=sharing