Course Content
1 big data intro prerequisite
2 big data end to end execution learning plan discussion
3 big data evolution deep cloud computer glimpse software overview
4 clustering deep hdfs architecture set up steps
5 hdfs metadata management hadoop 2.0
6 linux handson commands execution
7 hdfs commands handson
8 hadoop edge node data transfer sqoop intro cloud glimpse
9 sqoop sample imports where imports
10 sqoop query imports incremental data import
11 sqoop automation job password file automation cloud start
12 cloud intro vm creation aws gcp serialization intro
13 serialiazed deep dive file formats parquet orc
14 serialized avro file formats multi mappers hive intro
15 hive vs sql deep table database creation
16 hive table creations edge node loads types of table intro
17 hive types of tables partition intro static intro
18 hive types of tables deep partitions static load static insert
19 hive cloud analytics avro schema evolution project
20 hive performance tuning spark intro lazy evaluation
21 spark vs mr performance run spark deployment
22 spark types of processing pyspark files reads
23 pyspark handson list iterations rdd deep
24 pyspark list iterations string lambda flatmap
25 pyspark deep rdd handson file processing
26 pyspark rdd column processing schema rdd dataframe intro
27 pyspark dataframe reads semi structured processing dsl filters
28 pyspark dsl filter expressions
29 pyspark expression deep withcolumn
30 pyspark joins scenario question
31 pyspark joins aggregations scenario
32 pyspark windowing complex data intro
33 pyspark complex data processing revision
34 pyspark complex data processing deep dive type 2
35 pyspark complex data 3 rd api data read deep dive
36 aws deployment pyspark delta lake intro airflow
37 aws deep deployment pyspark delta lake deep airflow automation
38 aws intro cloud s3 handson
39 aws s3 deep handson ec2 intro
40 aws emr development deep dive
41 aws secrets manager password emr deployment deep airflow schedule
42 scala spark intro handson set up
43 spark scala intro execution
44 streaming intro nifi data flow
45 spark streaming workshop whatsapp streaming
46 kafka intro handson producer consumer
47 nifi kafka integration consumption model
48 pyspark kafka integration gcp intro
49 google cloud dataproc deployment aws kinesis
50 azure deployment spark hdinsight data factory
51 nosql db cassandra spark integration
About this course
Enroll for Free
This course includes:
- 51 modules
- Comprehensive reading materials
- Full lifetime access