Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
Register Now or Visit the Website for more Information 
View analytic
Monday, May 9 • 10:40am - 11:30am
Building Distributed Systems Using Apache Helix - Aditya Auradkar, LinkedIn

Sign up or log in to save this to your schedule and see who's attending!

Building distributed data systems is hard! Especially systems that store and process vast quantities of data and yet need to be operable. Problems like partition management, resource distribution, state management, leader elections are often solved in isolation by various big data systems. Wouldn’t it be nice if we had one mechanism with which to model these concepts across systems?

Apache Helix aims to do exactly that. It is a generic cluster management framework that can be used to manage resources spread across a pool of nodes. This talk will provide an overview of Apache Helix and how different data systems at LinkedIn leverage it to solve some of their hardest problems in a uniform manner.

Speakers
AA

Aditya Auradkar

Engineering Manager, Uber
Aditya manages the Streaming Data platform team at Uber. Powering pub-sub style event transport, streaming/batch analytics and ingestion are some examples of use-cases. Previously at LinkedIn, he managed the Apache Kafka engineering team and was one of the earliest members of the Espresso team (distributed storage). | | | | Previously spoken at Apache: Big Data Vancouver.



Monday May 9, 2016 10:40am - 11:30am
Regency A