This portion is sponsored by Anyscale.
Website: www.anyscale.com/
Anyscale is a unified compute platform that makes it easy to develop, deploy, and manage scalable AI and Python applications using Ray.
//Abstract
While we've seen great progress on Open Source LLMs, we haven't seen the same level of progress on systems to serve those LLMs in production contexts. In this presentation, I work through some of the challenges of taking open source models and serving them in production.
//Bio
Dr. Waleed Kadous leads engineering at Anyscale, the company behind the popular open source project Ray. Prior to Anyscale, Waleed worked at Uber, where he led overall system architecture, evangelized machine learning, and led the Location and Maps teams. He previously worked at Google, where he founded the Android Location and Sensing team, responsible for the “blue dot” as well as ML algorithms underlying products like Google Fit. He also holds more than 40 patents.
Негізгі бет Ғылым және технология Scalable Evaluation and Serving of Open Source LLMs // Waleed Kadous // LLMs in Prod Conference
Пікірлер