Course Content
day 1 big data workshop
day 2 big data workshop
3 software overview big data basics evolution
4 hdfs 1.0 cluster administration block splits
5 hdfs metadata management high availability hadoop 2.0
6 linux commands and hdfs commands
7 hdfs commands remaining linux semi structured data read
8 unix parameterization sqoop intro import export
9 sqoop multi mappers sqoop architecture eval
10 sqoop controlling import mappers deep dive
11 sqoop incremental data job automation password file
12 sqoop last modified semi structured data serializatino
13 avro parquet orc sqoop export
14 hive intro thoery handson db table data loads
15 hive table loads edge hdfs location
16 hive types of table static partition loads
17 hive static insert dynamic insert
18 hive sub partitions bucketing script automation
19 hive avro schema evolution revision flow
20 hive revision 5 flows execution
21 aws cloud hive analytics
22 aws hive analytics 2
23 hive dml performance tuning project
24 spark intro project phase 2
25 spark theory jar deployment
26 spark list string iteration lambda
27 spark schema rdd column fiilter
28 spark row rdd dataframe creation sql
29 spark seamless semi structured reads avro processing
30 spark extra jar deployment parameterization
31 git hub spark partition by xml handling
31 spark dsl intro
33 spark dsl deep dive with column
34 spark revision dsl aggregation
35 spark dataframe join complex data processing nested
36 spark complex data array processing and generation
37 spark complex array generation hive integ git hub commit
38 spark hive integration
39 aws s3 spark integration cache persist spark project
40 hbase intro project tasks
41 hbase hive spark integraition phase 2 project
42 pyspark rdd dataframes deployment
43 pyspark hbase integration aws intro s3
44 aws s3 commands ec2 key pair
45 aws emr spark deployment project
46 aws hive glue metastore athena analytics project 4
47 aws rds caassandra spark integration
48 nifi intro data flow execute sql aws s3 writes
49 kafka intro handson nifi kafka integration
50 kafka spark integration integration
51 spark elastic search writes kafka consumption models
52 nifi incremental cassandra data processing
53 kafka isr spark aws kinesis streaming
54 spark structured streaming 1
55 spark structured streaming 2
About this course
Batch 28