Apache: Big Data 2016 has ended
Register Now or Visit the Website for more Information 
Back To Schedule
Monday, May 9 • 4:10pm - 5:00pm
YARN: A Resource Manager for Analytic Platform - Tsuyoshi Ozawa, NTT

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Hadoop Yet Another Resource Negotiator (YARN) is a resource manager for processing big data. YARN can run various major distributed processing frameworks including not only MapReduce, but also Spark, Tez, Flink and so on to support various workloads.
I will talk about the architecture of YARN, how YARN manages resources in a cluster and how YARN is integrated with these processing frameworks. In particular, I will introduce the best practice to maximize the throughput of the processing frameworks on YARN with the optimization techniques of Spark on YARN and Tez on YARN as examples. I will talk about the points where our YARN community needs more helps and feedback.

avatar for Tsuyoshi Ozawa

Tsuyoshi Ozawa

I’m a Research Engineer on topics in distributed computing working at NTT(Nippon Telegraph and Telephone corporation), which is one of the largest carrier company in Japan. I’ve been a committer and PMC on Apache Hadoop project. Prior to working on Hadoop, I researched the time... Read More →

Monday May 9, 2016 4:10pm - 5:00pm PDT
Regency A