The course covers how to work with “big data” stored in a distributed file system, and execute Spark applications on a Hadoop cluster. After taking this course, participants will be prepared to face real-world challenges and build applications to execute faster decisions, better decisions, and interactive analysis, applied to a wide variety of use cases, architectures, and industries.

How the Apache Hadoop ecosystem fits in with the data processing lifecycle

How data is distributed, stored, and processed in a Hadoop cluster

How to write, configure, and deploy Apache Spark applications on a Hadoop cluster

How to use the Spark shell and Spark applications to explore, process, and analyze distributed data

How to query data using Spark SQL, DataFrames, and Datasets

How to use Spark Streaming to process a live data stream