PYSPARK Developer Course (Spark with Python)

Published 4/2023
Created by Kedar Nanda
MP4 | Video: h264, 1280×720 | Audio: AAC, 44.1 KHz, 2 Ch
Genre: eLearning | Language: English | Duration: 33 Lectures ( 2h 40m ) | Size: 1 GB

Learn PySpark end to end features and functionalities. Course also includes a Python course and HDFS Commands Course.

What you’ll learn
Complete Development Functionalities and Features of PySpark
Spark Architecture
Python Course
HDFS Course

Requirements
Python Basics.
HDFS Commands.
The course covers above two topics.

Description
Introduction to Spark.HDFS CommandsPython Course.Why Spark was developed.What is Spark and its features.Spark Main Components.Introduction to Spark.HDFS CommandsIntroduction to SparkSessionRDD FundamentalsWhat is RDDRDD PropertiesWhen to use RDDRDD ProblemsCreate RDDDifferent Ways to Create RDDsRDD OperationsTransformations -  Low LevelTransformations – Join TypesActions -  Total AggregationsShuffle and CombinerTransformations -  Key AggregationsTransformations -  SortingTransformations -  RankingTransformations -  SetTransformations -  SamplingTransformations -  PartitionTransformations -  RepartitionTransformations -  Repartition and SortTransformations -  CoalesceTransformations -  Repartition Vs CoalesceExtractionSpark Cluster Execution Architecture_Full ArchitectureSpark Cluster Execution Architecture_YARN As Spark Cluster ManagerSpark Cluster Execution Architecture_JVMs across ClustersSpark Cluster Execution Architecture- Commonly Used Terms in Execution FrameworkSpark Cluster Execution Architecture – Narrow and Wide TransformationsSpark Cluster Execution Architecture – DAG SchedulerSpark Cluster Execution Architecture – Task SchedulerRDD PersistenceSpark Shared VariablesSparkSQL ArchitectureDetailed SparkSession FeaturesDataFrame FundamentalsDatatypesDataFrame RowsDataFrame ColumnsDataFrame ETLDataFrame ETL_Introduction to Transformations and ExtractionDataFrame ETL_DataFrame APIs Introduction ExtractionDataFrame ETL_DataFrame APIs SelectionDataFrame ETL_DataFrame APIs Filter or WhereDataFrame ETL_DataFrame APIs SortingDataFrame ETL_DataFrame APIs SetDataFrame ETL_DataFrame APIs JoinDataFrame ETL_DataFrame APIs AggregationsDataFrame ETL_DataFrame APIs GroupByDataFrame ETL_DataFrame APIs WindowsDataFrame ETL_DataFrame Built-in Functions IntroductionPerformance and Optimization

Who this course is for
Data Engineers
Data Scientists
Data Analysts
Database Developers