Apache: Big Data 2016 has ended
Register Now or Visit the Website for more Information 

Sign up or log in to bookmark your favorites and sync them to your phone or calendar.

Monitoring-Benchmarking [clear filter]
Wednesday, May 11


Using a Relative Index of Performance (RIP) to Determine Optimum Configuration Settings Compared to Random Forest Assessment Using Spark - Diane Feddema, Red Hat Inc, Canada
Computer Systems can be set with a myriad of options, determining an optimal set-up for any particular application can be difficult. This pilot study demonstrates how numerous I/O performance tests with varied hardware and software configurations can be efficiently compared to determine an optimal set-up for an application. To simplify this process a statistic was developed to provide a quick relative performance comparison. This metric can be arithmetically manipulated to provide meaningful averaging of multiple performance tests into a single overall performance indicator. We will illustrate how RIP is used by comparing I/O performance test results on approximately 50-100 different hardware/software set-ups; RIP results will be compared to results from a random forest repeat sampling technique to determine the most influential performance factors.

avatar for Diane Feddema

Diane Feddema

Principal Software Engineer, Red Hat
Diane Feddema is a principal software engineer at Red Hat Inc Canada, Emerging Technologies Group. Diane is currently focused on developing and applying big data techniques for performance analysis, automating these analyses and displaying data in novel ways. Previously Diane was... Read More →

Wednesday May 11, 2016 10:50am - 11:40am
Georgia B