Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
Register Now or Visit the Website for more Information 
View analytic
Monday, May 9 • 11:40am - 12:30pm
Using the SDACK Architecture to Build a Big Data Product - Yu-Hsin Yeh, Trend Micro

Sign up or log in to save this to your schedule and see who's attending!

You definitely have heard about the SMACK architecture, which stands for Spark, Mesos, Akka, Cassandra, and Kafka. It’s especially suitable for building a lambda architecture system. But what is SDACK? Apparently it’s very much similar to SMACK except the “D" stands for Docker. While SMACK is an enterprise scale, multi-tanent supported solution, the SDACK architecture is particularly suitable for building a data product. In this talk, I’ll talk about the advantages of the SDACK architecture, and how TrendMicro uses the SDACK architecture to build an anomaly detection data product. The talk will cover:
1) The architecture we designed based on SDACK to support both batch and streaming workload.
2) The data pipeline built based on Akka Stream which is flexible, scalable, and able to do self-healing.
3) The Cassandra data model designed to support time series data writes and reads.

Speakers
avatar for Yu-Hsin Yeh

Yu-Hsin Yeh

Sr. Software Engineer, Trend Micro
Evans Ye(Yu-hsin Yeh) is currently a Committer and PMC member of Apache Bigtop. He works at Trend Micro developing big data infra and applications. He loves to code, automate things, and develop big data solutions. Aside engineering stuff, he is also an enthusiast in giving talks to share software innovations and cutting edge technologies. Evans had talked about Bigtop’s recent improvements by leveraging Docker in Apache: Big Data EU 2015. In... Read More →



Monday May 9, 2016 11:40am - 12:30pm
Plaza B