Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
Register Now or Visit the Website for more Information 
View analytic
Tuesday, May 10 • 2:00pm - 2:50pm
Building a Self-serve Kafka Ecosystem - Joel Koshy, LinkedIn

Sign up or log in to save this to your schedule and see who's attending!

Apache Kafka has enjoyed widespread adoption as a messaging backbone for data pipelines and stream processing platforms.

LinkedIn runs one of the largest known deployments of Kafka and serves hundreds of applications within the company. As new use-cases for Kafka emerge it is becoming increasingly critical to provide self-serve features for users without having to always engage Kafka specialists. Users need to create topics with non-default configurations and easily examine various topic metadata and schemas; topic owners may want to specify authorization rules and be able to encrypt their data. Furthermore, Kafka brokers need mechanisms in place to protect against rogue clients that impact the cluster and other clients.

In this talk we will describe how we are addressing these practical challenges in providing a truly multi-tenant messaging service.

Speakers
JK

Joel Koshy

Joel Koshy is a Staff Software Engineer in LinkedIn’s Data Infrastructure team. He is also a PMC member and committer on the Apache Kafka project. Joel has worked on distributed systems infrastructure and applications for the past eight years. Prior to LinkedIn, he was with the Yahoo! search team where he worked on web crawlers. Joel received his PhD in Computer Science from UC Davis and his bachelors in Computer Science from IIT Madras... Read More →


Tuesday May 10, 2016 2:00pm - 2:50pm
Regency A