Apache: Big Data 2016

Apache Eagle is an Open Source Monitoring framework for Hadoop to instantly identify access to sensitive data, recognize attacks, malicious activities in Hadoop and take actions in real time. Eagle provides distributed, fault-tolerant policy engine and out of box machine learning models to create user profiles offline based on historic user behaviors and detects anomalies online.

Apache Eagle was initially created for filling some obvious gaps in Hadoop security landscape and soon expanded to Hadoop system monitoring including map/reduce job monitoring, data node anomaly detection, master node garbage collection activity monitoring etc.

Apache Eagle’s core is the fully distributed policy evaluation engine. It solved common yet hard problems for traditional monitoring, like horizontal scalability, data skew, policy fault-tolerance, fluent stream DSL etc.