Loading…
Apache: Big Data 2016 has ended
Register Now or Visit the Website for more Information 
View analytic
Monday, May 9 • 11:40am - 12:30pm
Using the SDACK Architecture to Build a Big Data Product - Yu-Hsin Yeh, Trend Micro

Sign up or log in to save this to your schedule and see who's attending!

You definitely have heard about the SMACK architecture, which stands for Spark, Mesos, Akka, Cassandra, and Kafka. It’s especially suitable for building a lambda architecture system. But what is SDACK? Apparently it’s very much similar to SMACK except the “D" stands for Docker. While SMACK is an enterprise scale, multi-tanent supported solution, the SDACK architecture is particularly suitable for building a data product. In this talk, I’ll talk about the advantages of the SDACK architecture, and how TrendMicro uses the SDACK architecture to build an anomaly detection data product. The talk will cover:
1) The architecture we designed based on SDACK to support both batch and streaming workload.
2) The data pipeline built based on Akka Stream which is flexible, scalable, and able to do self-healing.
3) The Cassandra data model designed to support time series data writes and reads.

Speakers
avatar for Evans Ye

Evans Ye

Sr. Software Engineer, Yahoo!
Evans Ye is currently PMC chair of Apache Bigtop. He works at Yahoo Taiwan to develop E-Commerce data solutions. He loves to code, automate things, and develop big data applications. Aside engineering stuff, he is also an enthusiast in giving talks to share software innovations and... Read More →



Monday May 9, 2016 11:40am - 12:30pm
Plaza B