Loading…
Apache: Big Data 2016 has ended
Register Now or Visit the Website for more Information 
Back To Schedule
Monday, May 9 • 5:10pm - 6:00pm
Next-Gen Decision Making in Under 2ms - Ilya Ganelin, Capital One Data Innovation Lab

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

What if we had reached that point where open source can handle massively difficult streaming problems with enterprise-grade durability?

Today, Ilya presents Capital One’s novel solution for real-time decisioning on Apache Apex. With an analysis of the dominant streaming frameworks, he’ll show how Apex provides unique capabilities ensuring less than 2ms latency in an enterprise-grade solution on Hadoop.

He’ll first take a detailed dive into the business requirements of a new real-time decisioning platform for model building, feature computation, and model scoring. Next, a survey of the leading open source technologies for stream processing and what tradeoffs we considered when selecting our technology stack. Lastly, how Apex provides un-paralleled performance and meets the stringent performance, scalability, and durability requirements necessary for enterprise-grade decisioning.

Speakers
avatar for Ilya Ganelin

Ilya Ganelin

Senior Data Engineer, Capital One Data Innovation Lab
Ilya is a roboticist turned data engineer. At the University of Michigan he built self-discovering robots and then worked on embedded DSP software with cell phone radios at Boeing. Today, he drives innovation at Capital One. Ilya is a contributor to the core components of Apache Spark... Read More →


Monday May 9, 2016 5:10pm - 6:00pm PDT
Plaza B