Loading…
Apache: Big Data 2016 has ended
Register Now or Visit the Website for more Information 
Back To Schedule
Monday, May 9 • 10:40am - 11:30am
Building Distributed Systems Using Apache Helix - Aditya Auradkar, LinkedIn

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Building distributed data systems is hard! Especially systems that store and process vast quantities of data and yet need to be operable. Problems like partition management, resource distribution, state management, leader elections are often solved in isolation by various big data systems. Wouldn’t it be nice if we had one mechanism with which to model these concepts across systems?

Apache Helix aims to do exactly that. It is a generic cluster management framework that can be used to manage resources spread across a pool of nodes. This talk will provide an overview of Apache Helix and how different data systems at LinkedIn leverage it to solve some of their hardest problems in a uniform manner.

Speakers
AA

Aditya Auradkar

Engineering Manager, Uber
Aditya manages the Streaming Data platform team at Uber. Powering pub-sub style event transport, streaming/batch analytics and ingestion are some examples of use-cases. Previously at LinkedIn, he managed the Apache Kafka engineering team and was one of the earliest members of the... Read More →



Monday May 9, 2016 10:40am - 11:30am PDT
Regency A