Apache Kylin from eBay: Extreme OLAP engine for Hadoop Date: This event took place live on November 11 2015 Presented by: Yang Li Duration: Approximately 60 minutes. Cost: Free Questions? Please send email to Description:Apache Kylin is an open source distributed analytics engine contributed by eBay Inc. that provides SQL interface and multi-dimensional analysis (OLAP) on Hadoop, supporting extremely large datasets. Kylin's pre-built MOLAP cubes, distributed architecture, and high concurrency helps users analyze multidimensional queries using Kylin's SQL interface as well as via other BI tools like Tableau and MicroStrategy. Kylin is successfully deployed and used in eBay for a variety of production use cases, including web traffic analysis and geographical expansion analysis. It was open sourced on Oct 1, 2014 and has 320 stars and 125 forks. Kylin was accepted as an Apache Incubator Project on Nov 25, 2014. Background The challenge faced at eBay is that our data volume has become bigger while our user base has become more diverse. Our users—for example, in analytics and business units—consistently ask for minimal latency but want to continue using their favorite tools, such as Tableau and Excel. We worked closely with our internal analytics community and outlined requirements for a successful product at eBay:
Distributed and scale-out architecture for analysis in the TB to PB size range. We quickly realized nothing met our exact requirements externally—especially in the open-source Hadoop community. To meet our emergent business needs, we decided to build a platform from scratch. With an excellent team and several pilot customers, we have been able to bring the Kylin platform into production as well as open-source it. Feature highlights Kylin is a platform offering the following features for big data analytics:
In this webcast we will cover:
About Yang LiYang Li is the tech lead for Apache Kylin. He joined eBay-Shanghai in January 2014 as a member of the technical staff, and has been a key developer and architect of the Kylin OLAP engine. Yang also leads the Kylin team of engineers in Shanghai, where they develop the Kylin product and deploy it for eBay as an analytics platform. Prior to eBay, Yang spent eight years with IBM and two years with Morgan Stanley. At IBM, Yang was focused on the core Java library (Apache Harmony), J2EE, and big data engineering development. He was the technical lead at IBM User Technologies and won the Outstanding Technical Achievement Award in 2008. During his time with Morgan Stanley, Yang was the vice president of the Asia Markets team responsible for global regulatory reporting architecture, engine development, and end-to-end production support infrastructure. Twitter: @ApacheKylin You might also be interested in |
|
|