On large-scale web sites, users leave thousands of traces every second. Businesses need to process and interpret these traces in real-time to be able to react on the behavior of their users. In this talk, Andreas will show a real world example of the power of a modern open-source stack. He will walk you through the design of a real-time clickstream analysis PAAS solution based on Apache Spark, Kafka, Parquet and HDFS, explain our decision making and present our lessons learned.
Andreas is Principal Software Architect at QAware, an independent cloud native software manufacturer that has been repeatedly awarded Best IT Workplace in Germany. His focus is cloud native computing in all its glory. He is responsible for the heavy lifting at a large-scale cloud... Read More →
Bill of materials (BOMs) are at the heart of every manufacturing process. Especially large BOMs can be found in the automotive industry, where a complex and highly variable product meets high production volumes. Drawing from the experiences made in an ongoing real world project for a major car manufacturer, Andreas will provide an in-depth view how Apache Solr and Apache Spark were used to power an innovative architecture that provides lightning-fast BOM explosions, demand forecasts and scenario-based planning on 20 billion records per scenario.
Andreas is Principal Software Architect at QAware, an independent cloud native software manufacturer that has been repeatedly awarded Best IT Workplace in Germany. His focus is cloud native computing in all its glory. He is responsible for the heavy lifting at a large-scale cloud... Read More →
The audience will participate in a live, interactive demo that generates personalized, real-time recommendations using the latest open source streaming and big data processing tools available. We’ll dive deep into not only the architecture and application code, but also the Spark, Cassandra, and ElasticSearch internal codebases that power this awesome combination of technologies. All code and demos are available on Github and DockerHub. Follow the links @ advancedspark.com.
