Apache: Big Data 2016 has ended
Register Now or Visit the Website for more Information 
Back To Schedule
Wednesday, May 11 • 10:50am - 11:40am
Using a Relative Index of Performance (RIP) to Determine Optimum Configuration Settings Compared to Random Forest Assessment Using Spark - Diane Feddema, Red Hat Inc, Canada

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Computer Systems can be set with a myriad of options, determining an optimal set-up for any particular application can be difficult. This pilot study demonstrates how numerous I/O performance tests with varied hardware and software configurations can be efficiently compared to determine an optimal set-up for an application. To simplify this process a statistic was developed to provide a quick relative performance comparison. This metric can be arithmetically manipulated to provide meaningful averaging of multiple performance tests into a single overall performance indicator. We will illustrate how RIP is used by comparing I/O performance test results on approximately 50-100 different hardware/software set-ups; RIP results will be compared to results from a random forest repeat sampling technique to determine the most influential performance factors.

avatar for Diane Feddema

Diane Feddema

Principal Software Engineer, Red Hat
Diane Feddema is a principal software engineer at Red Hat Inc Canada, in the AI Center of Excellence. Diane is currently focused on developing and applying machine learning techniques for performance analysis using hardware accelerators, automating these analyses and displaying data... Read More →

Wednesday May 11, 2016 10:50am - 11:40am PDT
Georgia B