-
Lesson 4: Build a Simple Apache Spark Application
-
Quiz 4
-
Lesson 5: Monitor Apache Spark Applications
-
Quiz 5
- Course Materials
-
Lab Guide
-
Lab Environment Setup Guide
-
Course Sandboxes
Build and Monitor Apache Spark Applications
Learn to build standalone Spark applications, components of Spark execution model, use the Spark Web UI
In this course you will learn about the full Spark program lifecycle and SparkSession, along with how to build and launch standalone Spark applications. Also described are the components of the Spark execution model using the Spark Web UI to monitor Spark applications.
This is the second course in the Apache Spark v2.1 Series.
What's Covered
| Course Lessons | Lab Activities |
|
4: Build a Simple Apache Spark Application Define the Spark Program LifecycleDefine SparkSession Describe Ways to Launch Spark Applications Launch a Spark Application |
Import and Configure Application Files Complete, Package, and Launch the Application |
|
5: Monitor Apache Spark Applications Describe Logical and Physical Plans of Spark ExecutionUse Spark Web UI to Monitor Spark Applications Debug and Tune Spark Applications |
Use the Spark UI Find Spark System Properties |
Prerequisites
- Completion of Introduction to Apache Spark
- Basic Hadoop knowledge and intermediate Linux knowledge
- Experience using a text editor such as vi
- Terminal program installed; familiarity with command-line options such as mv, cp, ssh, grep, cd, and useradd
- Knowledge of functional programming with Scala, and experience with SQL