Apache: Big Data 2016

Data is the biggest asset in modern organizations to enable building value added products and services as well as optimizing operations. Real time analytic pipelines with a messaging system such as Apache Kafka to capture the data followed by a general purpose transformation layer such as Spark to process and analyze it have become the prominent infrastructure to deliver relevant and timely information to variety of users and applications. Given the extreme diversity of the data sources,an additional consideration for such pipelines is having agility in being able to adapt to changes to the underlying structure of data without incurring lot of development costs and missing SLAs. In this session, Neeraja will cover how Apache Drill’s ability to query complex and dynamically evolving datasets can compliment these solutions and new use cases enabled by using Drill, Spark and Kafka together.