Course Content
1 big data intro data evolution
2 big data handson cloud end to end execution learning plan
3 software overview big data cluster information hdfs intro
4 hdfs 1.0 cloud intro block splits set up details
5 hdfs metadata mangement 2.0 high availability
6 linux intro hdfs commands intro handson
7 hdfs commands sqoop intro
8 sqoop import architecture controlling import handson
9 sqoop incremental append job intro
10 sqoop automated job password file automation
11 sqoop last modified serialization file formats
12 sqoop aws s3 integration multi mappers
13 sqoop export performance hive intro
14 hive hql vs sql handson db table creation
15 hive hdfs load location types of table intro
16 hive types of table deep end to end script execution
17 hive static partitions load static inserts
18 hive dynamic partitions sub partitions bucketing intro
19 hive avro schema evolution aws hive
20 hive performance tuning spark intro lazy evolution
21 spark vs mr performance check jar deployment
22 spark ways of processing list iterations lambda
23 scala string iterations usecase spark intro rdd
24 spark rdd operations usdata.csv
25 spark schema rdd dataframe conversion sql
26 spark row rdd struct type dataframe reads
27 spark dataframe writes avro reads save modes
28 spark xml reads aws rds reads dsl intro
29 spark partition by dsl deep
30 spark dsl withcolumn aggregation
31 spark aggregations deep aws s3 integration revision
32 spark complex data processing intro struct multiline
33 spark complex data struct generation array processing
34 spark complex array processing generation
35 spark array complex generation handson spark hive integration
36 spark hive integration joins project
37 spark hive writes extra jar path
38 pyspark intro handson rdd handson
39 pyspark handson deep dive
40 spark real time issues and executions
41 aws intro s3 commands handson
42 aws ec2 emr development
43 spark emr aws deployment project
44 nifi intrio etl data flow aws s3 rdbms
45 spark streaming workshop
46 streaming intro kafka intro handson
47 spark kafka nifi streaming consumption models
48 aws athena glue spark kinesis streaming
49 hbase nosql hive hbase spark integratio
50 cassandra nosql spark cassandra integration
51 spark structured streaming git
52 usecase
About this course
Batch 31
Enroll for Free
This course includes:
- 52 modules
- Comprehensive reading materials
- Full lifetime access