Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
Register Now or Visit the Website for more Information 
View analytic
Monday, May 9 • 4:10pm - 5:00pm
YARN: A Resource Manager for Analytic Platform - Tsuyoshi Ozawa, NTT

Sign up or log in to save this to your schedule and see who's attending!

Hadoop Yet Another Resource Negotiator (YARN) is a resource manager for processing big data. YARN can run various major distributed processing frameworks including not only MapReduce, but also Spark, Tez, Flink and so on to support various workloads.
I will talk about the architecture of YARN, how YARN manages resources in a cluster and how YARN is integrated with these processing frameworks. In particular, I will introduce the best practice to maximize the throughput of the processing frameworks on YARN with the optimization techniques of Spark on YARN and Tez on YARN as examples. I will talk about the points where our YARN community needs more helps and feedback.

Speakers
avatar for Tsuyoshi Ozawa

Tsuyoshi Ozawa

NTT
I’m a Research Engineer on topics in distributed computing working at NTT(Nippon Telegraph and Telephone corporation), which is one of the largest carrier company in Japan. I’ve been a committer and PMC on Apache Hadoop project. Prior to working on Hadoop, I researched the time management on Virtual Machine Monitor with Linux KVM(kernel-based virtual machine).



Monday May 9, 2016 4:10pm - 5:00pm
Regency A

Attendees (30)