AWS EMR and Spark 2 using Scala

Learn AWS EMR and Spark 2 using Scala as programming language

Spark is in memory distributed computing framework in Big Data eco system and Scala is programming language. It is one of the hottest technologies in Big Data as of today. 

Spark 2 have changed drastically from Spark 1. Spark SQL and DataFrames have become core module on which other modules like Structured Streaming and Machine Learning Pipe lines.

As part of this course, there will be lot of emphasis on lower level APIs called transformations and actions of Spark along with core module Spark SQL and DataFrames

EMR brings cloud capabilities to Big Data. EMR provides different options which include Spark 2 as well as one of the service on the cluster.

As part of this course, you will learn

• Basics of Amazon Web Services
• Security using IAM
• Setting up EMR clusters
• Basics of programming using Scala
• Spark 2 - Core Transformations and Actions
• Spark 2 - Spark SQL and Data Frames
• Spark 2 - Streaming and Structured Streaming
• Different File Formats and Compression algorithms
• Submitting Spark 2 jobs on EMR using step execution
• and many more

We will start with understanding basics of AWS, setting up EMR cluster with Spark and then jump into Spark 2 using Scala as programming language.