Machine learning as a service (MLaS) is imperative to the success of many companies as many internal teams and organizations need to gain business intelligence from big data. Building a scalable MLaS in a very challenging problem. In this paper, we present the scalable MLaS we built for a company that operates globally. We focus on several scalability challenges and our technical solutions.
LI Erran Li received his Ph.D. in Computer Science from Cornell University in 2001. From 2001 to 2015, he worked as a researcher in Bell Labs, Alcatel-Lucent (acquired by Nokia). Since 2015, he started working as a senior software engineer at Uber Technologies. He is also an adjunct professor in the Computer Science Department of Columbia University. He is an IEEE Fellow and ACM Distinguished Scientist. His research interests are machine learning algorithms, systems, deep learning and AI.