Apache: Big Data 2016 has ended
Register Now or Visit the Website for more Information 
Monday, May 9 • 3:00pm - 3:50pm
Happier Developers and Happier Software Through Distributed Testing - Andrew Wang, Cloudera

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

A thorough unit test suite is a positive indicator of software quality. However, as the size of a test suite grows, its runtime can span hours or even days, to the point that it is unwieldy to run the full suite. Also, test runs at this scale are unlikely to succeed due to intermittent test failures. Together, these issues make the test suite less accessible to developers, which lowers developer productivity and decreases software quality.

Distributed testing offers a solution to these issues. Using our open-source distributed test infrastructure, we are able to speed up Apache Hadoop’s test suite by approximately 100x. This same framework is also in use by Apache HBase and Apache Kudu (incubating), with further projects planned.

In this talk, I will describe our distributed testing framework, how we use it at Cloudera, and how you could use this same framework on for your project.

avatar for Andrew Wang

Andrew Wang

Software Engineer, Cloudera
Andrew Wang is a software engineer at Cloudera on the HDFS team, where he has worked on projects including in-memory caching, transparent encryption, and erasure coding. Previously, he was a PhD student in the AMP Lab at UC Berkeley, where he worked on problems related to distributed... Read More →

Monday May 9, 2016 3:00pm - 3:50pm PDT
Plaza C