Yang You | |
---|---|
![]() | |
Born | April 19, 1991 |
Known for | Colossal AI, Open Sora, LARS, LAMB |
Awards | IEEE-CS TCHPC Early Career Award |
Scientific career | |
Fields | Computer Scientist |
Thesis | Fast and Accurate Machine Learning on Distributed Systems and Supercomputers (2020) |
Yang You was born on April 19, 1991, and is a Presidential Young Professor at the National University of Singapore.[1]
Biography
editYang You earned his master's degree in Computer Science from Tsinghua University in 2015, and his Ph.D. from the University of California, Berkeley in 2020 under the guidance of James Demmel.[2] He joined the National University of Singapore as an Assistant Professor in Computer Science and founded a company called HPC-AI Tech,[3] which focuses on combining high-performance computing (HPC) technologies with artificial intelligence (AI) to enhance AI productivity.[4][5][6]
Academic works
editYang is recognized for his contributions in large scale optimization. During his doctoral period, he introduced the LARS algorithm in 2018,[7] which achieved a new world record for ImageNet training, reducing the training time for AlexNet on ImageNet to just 24 minutes.[8] The following year, he further improved the algorithm by introducing the LAMB algorithm to address its limitations on attention models such as BERT, significantly reducing the training time for BERT from 3 days to 76 minutes.[9][10]
After that, he and his research team focused on work in the area of machine learning, high performance computing, machine learning systems, parallel and distributed systems and AI applications. His work “CowClip: Reducing CTR Prediction Model Training Time from 12 hours to 10 minutes on 1 GPU”, focusing on exploring the use of large-batch training to accelerate the training process, won the distinguished paper award on the 37th Association for the Advancement of Artificial Intelligence Conference (AAAI-23).[11][12] Another work “CAME: Confidence-guided Adaptive Memory Efficient Optimization”, trying to increase the efficiency of the training process for large AI models like GPT, won the Outstanding Paper Award at the recent 61st Annual Meeting of the Association for Computational Linguistics (ACL).[13][14] Their unified deep learning system for large-scale parallel training, Colossal-AI, got 35,000 GitHub stars in 18 months. It has been used by 100+ big enterprises globally including IBM, Oracle, HPE, Walmart, etc.[15][16]
Honors and awards
editYang You is a Siebel Scholar and received the ACM/IEEE-CS George Michael Memorial HPC Fellowships in 2017.[17][18] He was awarded the Lotfi A. Zadeh Prize in 2020 for his notable contributions to soft computing and its applications.[19] He was recognized in Forbes' 30 under 30 Asia list in 2021[20] and received the IEEE-CS TCHPC Early Career Award.[21] He also received the “Singapore Maritime R&D Grant Award on Maritime AI” in 2022,[22] been recognized as “Top 100 Most Influential Chinese by Forbes China” in 2023,[23] and elected to the “Chinese Intelligent Computing Innovator in 2023” by MIT Technology Review.[24]
References
edit- ^ "NUS Department of Computer Science". Retrieved 2024-03-06.
- ^ "Fast and Accurate Machine Learning on Distributed Systems and Supercomputers" (PDF). EECS at Berkeley. Retrieved 2024-05-20.
- ^ "HPC-AI Tech". Retrieved 2024-05-20.
- ^ "Teaching a computer to think like a human". Retrieved 2024-03-05.
- ^ Mansfield, Kathy (2018-04-10). "Shaden Smith and Yang You Announced as Recipients of 2017 ACM/IEEE-CS George Michael Memorial HPC Fellowships". IEEE Computer Society. Retrieved 2024-03-05.
- ^ "ImageNet Training Record - 24 Minutes". Retrieved 2024-03-05.
- ^ "2017 ACM/IEEE-CS George Michael Memorial HPC Fellowships Recipients". ACM. Retrieved 2024-03-05.
- ^ "Yang You makes Forbes 30 Under 30 2021 Asia for Healthcare and Science". EECS at Berkeley. Retrieved 2024-03-05.
- ^ Jennings, Ralph. "Under 30 Asia Alum Launches AI Startup With Funding From Kai-Fu Lee's Sinovation Ventures And ZhenFund". Forbes. Retrieved 2024-03-05.
- ^ "Supercomputing speeds up deep learning training". ScienceDaily. Retrieved 2024-03-05.
- ^ "AAAI Conference Paper Awards and Recognition". AAAI.
- ^ "NUS Presidential Young Professor Yang You and PhD students win Distinguished Paper award at AAAI-23 Conference".
- ^ "ACL 2023 Best Papers".
- ^ "NUS Computing faculty and students excel at ACL 2023".
- ^ "Colossal-AI". Github.
- ^ Li, Shenggui; Liu, Hongxin; Bian, Zhengda; Fang, Jiarui; Huang, Haichen; Liu, Yuliang; Wang, Boxiang; You, Yang (2023). Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training. pp. 766–775. arXiv:2110.14883. doi:10.1145/3605573.3605613. ISBN 979-8-4007-0843-5.
{{cite book}}
:|website=
ignored (help) - ^ "Yang You wins ACM IEEE-CS George Michael Memorial Fellowship". EECS at Berkeley. Retrieved 2024-03-05.
- ^ Black, Doug (2017-08-29). "Researchers in Machine Learning Awarded George Michael Memorial HPC Fellowships". High-Performance Computing News Analysis | insideHPC. Retrieved 2024-03-05.
- ^ "Student Award: Lotfi A. Zadeh Prize | EECS at UC Berkeley". www2.eecs.berkeley.edu. Retrieved 2024-03-05.
- ^ "NUS Presidential Young Professor Yang You makes Forbes' '30 Under 30 Asia' list".
- ^ "Asst Prof Yang You wins IEEE TCHPC Early Career Researchers Award". Asst Prof Yang You wins IEEE TCHPC Early Career Researchers Award. Retrieved 2024-03-05.
- ^ "NUS receives close to S$13 million in research funding to develop smart capabilities for next-generation ports".
- ^ "2023 Forbes China 100 Most Influential Chinese Selection". FORBES CHINA.
- ^ "2023年中国智能计算创新人物" (in Chinese). Retrieved 2024-05-20.
External links
edit- Yang You publications indexed by Google Scholar
- Yang You at DBLP Bibliography Server