Apache: Big Data 2016 has ended
Register Now or Visit the Website for more Information 
Back To Schedule
Tuesday, May 10 • 2:00pm - 2:50pm
SciSpark: MapReduce in Atmospheric Sciences - Kim Whitehall, NASA Jet Propulsion Laboratory

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

The atmospheric science (AS) community generates model and observational data to simulate and monitor the Earth system. Big data in the AS community has arrived: high volumes (petabytes), at increasing velocity (to AS groups worldwide) and variety (of data formats and resolutions), are need for the veracity of models and observation systems that add value to the policy-making process. As scientists require solutions that allow interaction with these big data, the community is interested in the Map Reduce paradigm and Apache Spark. This talk presents a specific NASA Advanced Information Systems Technology (AIST) project called “SciSpark” that marries Apache Spark with climate science. SciSpark is a scalable system for interactive AS analysis. We will demonstrate SciSpark’s scientific data ingestion, visual interaction and metrics generation using the Spark engine.


Kim Whitehall

NASA Jet Propulsion Laboratory
Kim is a scientific applications software engineer at NASA’s Jet Propulsion Laboratory.

Tuesday May 10, 2016 2:00pm - 2:50pm PDT
Plaza A