Канал: Hadoop Mentor

04 sqoop incrememtal import

04 sqoop incrememtal import

03 sqoop import 2

03 sqoop import 2

scala setup 15 06 2020

scala setup 15 06 2020

scala basics anonymous recursion tailRec 24 06 2020

scala basics anonymous recursion tailRec 24 06 2020

scala basics array arrabuffer 06 07 2020

scala basics array arrabuffer 06 07 2020

scala basics object CLASS CONSTRUCTOR 09 07 2020

scala basics object CLASS CONSTRUCTOR 09 07 2020

scala CONSTRUCTOR inheritace 13 07 2020

scala CONSTRUCTOR inheritace 13 07 2020

scala abstraction 16 07 2020

scala abstraction 16 07 2020

scala abstraction trait 20 07 2020

scala abstraction trait 20 07 2020

scala encapsulation caseclass poly 21 07 2020

scala encapsulation caseclass poly 21 07 2020

scala cust exception companion 23 07 2020

scala cust exception companion 23 07 2020

scala collection list intro 27 07 2020

scala collection list intro 27 07 2020

scala collection heirarchy seq 28 07 2020

scala collection heirarchy seq 28 07 2020

scala collection list 31 07 2020

scala collection list 31 07 2020

scala list FUNCS 3 08 2020

scala list FUNCS 3 08 2020

scala set hashcode equals 04 08 2020

scala set hashcode equals 04 08 2020

scala exception hnadling 22 07 2020

scala exception hnadling 22 07 2020

scala basics datatype 16 06 2020

scala basics datatype 16 06 2020

scala basics for loop break 22 06 2020

scala basics for loop break 22 06 2020

scala basics functions 23 06 2020

scala basics functions 23 06 2020

scala basics higher order functions 26 06 2020

scala basics higher order functions 26 06 2020

scala basics pattern matching while 19 06 2020

scala basics pattern matching while 19 06 2020

scala basics strings 07 07 2020

scala basics strings 07 07 2020

scala basics stringsbuffer object intro 08 07 2020

scala basics stringsbuffer object intro 08 07 2020

scala basics typecast ifelse 17 06 2020

scala basics typecast ifelse 17 06 2020

HDFS QA part 1 20 05 2020

HDFS QA part 1 20 05 2020

scala collection heirarchy seq 28 07 2020

scala collection heirarchy seq 28 07 2020

scala collection list 31 07 2020

scala collection list 31 07 2020

scala collection list intro 27 07 2020

scala collection list intro 27 07 2020

scala cust exception companion 23 07 2020

scala cust exception companion 23 07 2020

scala encapsulation caseclass poly 21 07 2020

scala encapsulation caseclass poly 21 07 2020

scala exception handling 22 07 2020

scala exception handling 22 07 2020

KAFKA topic consumer demo 09 06 2020

KAFKA topic consumer demo 09 06 2020

KAFKA consumer api java app 15 06 2020

KAFKA consumer api java app 15 06 2020

KAFKA consumer commit sync async 16 06 2020

KAFKA consumer commit sync async 16 06 2020

KAFKA INTRO 01 06 2020

KAFKA INTRO 01 06 2020

KAFKA producer acks 04 06 2020

KAFKA producer acks 04 06 2020

KAFKA producer api java app 14 06 2020

KAFKA producer api java app 14 06 2020

KAFKA spark realtime 17 06 2020

KAFKA spark realtime 17 06 2020

KAFKA topic consumer group demo 12 06 2020

KAFKA topic consumer group demo 12 06 2020

KAFKA topic producer demo 05 06 2020

KAFKA topic producer demo 05 06 2020

KAFKA TOPICS SETUP DEMO 03 06 2020

KAFKA TOPICS SETUP DEMO 03 06 2020

spark executor memory 07 09 2020

spark executor memory 07 09 2020

spark sortby joins 27 08 2020

spark sortby joins 27 08 2020

spark sql create dataframe trans 17 09 2020

spark sql create dataframe trans 17 09 2020

spark sql intro create dataframe 16 09 2020

spark sql intro create dataframe 16 09 2020

spark accum 15 09 2020

spark accum 15 09 2020

spark broadcast 09 09 2020

spark broadcast 09 09 2020

spark resource allocation 08 09 2020

spark resource allocation 08 09 2020

spark submit 03 09 2020

spark submit 03 09 2020

checkpoint vs cache vs persist zip 02 09 2020

checkpoint vs cache vs persist zip 02 09 2020

spark cartrsian persist cache 01 09 2020

spark cartrsian persist cache 01 09 2020

spark partitions 17 08 2020

spark partitions 17 08 2020

spark broadcast part 2 14 09 2020

spark broadcast part 2 14 09 2020

spark project setup simple exmp 12 08 2020

spark project setup simple exmp 12 08 2020

spark partitioners custpartitioner 26 08 2020

spark partitioners custpartitioner 26 08 2020

spark repartition coalesce mappratiotionwithindex group todebugstring 24 08 2020

spark repartition coalesce mappratiotionwithindex group todebugstring 24 08 2020

SPARK FOREACHPARTITION MAPPARTITION 21 08 2020

SPARK FOREACHPARTITION MAPPARTITION 21 08 2020

spark fold min max sum id name 20 08 2020

spark fold min max sum id name 20 08 2020

spark map flatmap filter filterbyrange 19 08 2020

spark map flatmap filter filterbyrange 19 08 2020

spark mapreduce intro 06 08 2020

spark mapreduce intro 06 08 2020

spark rdd textfile wholetextfile map 18 08 2020

spark rdd textfile wholetextfile map 18 08 2020

spark RDD master partition conf 14 08 2020

spark RDD master partition conf 14 08 2020

spark archit workflow 13 08 2020

spark archit workflow 13 08 2020

SPARK SETUP WINDOWS 10 08 2020

SPARK SETUP WINDOWS 10 08 2020

spark flow intro 07 08 2020

spark flow intro 07 08 2020

spark flowe intro 07 08 2020

spark flowe intro 07 08 2020

spark mapreduce intro 05 08 2020

spark mapreduce intro 05 08 2020

SPARK PARTITION SPARK TRANSFORMATIONS ACTIONS

SPARK PARTITION SPARK TRANSFORMATIONS ACTIONS

what is spark what is RDD what is partitions

what is spark what is RDD what is partitions

SPARK PERSIST CHECKPOINT CACHE

SPARK PERSIST CHECKPOINT CACHE

END to END SPARK PROJECT ARCHITECTURE 2018 07 15

END to END SPARK PROJECT ARCHITECTURE 2018 07 15

HDFS: COMPLETE ARCHITECTURE AND HIGH AVAILABILITY 2018 07 07

HDFS: COMPLETE ARCHITECTURE AND HIGH AVAILABILITY 2018 07 07

INTELLI SETUP MAVEN SCALA PROJECT

INTELLI SETUP MAVEN SCALA PROJECT

HIVE Installation

HIVE Installation

mapreduce setup

mapreduce setup

sqoop and mysql installation

sqoop and mysql installation

2017 09 26 09 37 hadoopspark

2017 09 26 09 37 hadoopspark

hadoop Demo part-2 --03-09-2017

hadoop Demo part-2 --03-09-2017

End to End Big data Project-Explanation

End to End Big data Project-Explanation

hdfs INTERVIEW QNS

hdfs INTERVIEW QNS

WEEKEND-HDFS-2-17-09-2017-Session-2

WEEKEND-HDFS-2-17-09-2017-Session-2

HADOOP-WEEKEND BATCH 16-09-2017-session1

HADOOP-WEEKEND BATCH 16-09-2017-session1

hadoop-weekend-demo-part-1-02-09-2017

hadoop-weekend-demo-part-1-02-09-2017

HIVE INSTALLATION 2017 07 27

HIVE INSTALLATION 2017 07 27

HIVE-MANAGED-TABLES-EXTERNAL TABLES

HIVE-MANAGED-TABLES-EXTERNAL TABLES

WHY HADOOP WHAT IS HADOOP

WHY HADOOP WHAT IS HADOOP

11 SCALA ITERATION TAIL RECURSION 2017 07 07

11 SCALA ITERATION TAIL RECURSION 2017 07 07

05 SCALA TYPE CAST TUPLEs 2017 06 28

05 SCALA TYPE CAST TUPLEs 2017 06 28

03 SCALA VAR VAL TYPES OF VARIABES 2017 06 26

03 SCALA VAR VAL TYPES OF VARIABES 2017 06 26

SCALA ABSTRACT CLASS METHOD FIELDS 2017 07 19

SCALA ABSTRACT CLASS METHOD FIELDS 2017 07 19

09 SCALA Higher Order functions 1 2017 07 05

09 SCALA Higher Order functions 1 2017 07 05

02 SCALA SETUP FEATURES PROGRAM 2017 06 23

02 SCALA SETUP FEATURES PROGRAM 2017 06 23

10 SCALA HIGHER ORDER FUNC 2 2017 07 06

10 SCALA HIGHER ORDER FUNC 2 2017 07 06

12 SCALA CURRING STRING INTERPOLATION 2017 07 10

12 SCALA CURRING STRING INTERPOLATION 2017 07 10

06 SCALA CONTROL STATEMENTS 2017 06 29

06 SCALA CONTROL STATEMENTS 2017 06 29

04 SCALA DATATYPES 2017 06 27

04 SCALA DATATYPES 2017 06 27

SCALA PRIVATE CONSTRUCTOR SINGLETON ABSTARCTION 2017 07 18

SCALA PRIVATE CONSTRUCTOR SINGLETON ABSTARCTION 2017 07 18

04 HIVE MANGEDTABLE AND METASTORE

04 HIVE MANGEDTABLE AND METASTORE

Functions-Method-Scala

Functions-Method-Scala

SCALA-MATCH-CASE

SCALA-MATCH-CASE

How to control parallel process in sqoop..

How to control parallel process in sqoop..

02 sqoop import

02 sqoop import

CCA175 SQOOP IMPORT APPAND 2

CCA175 SQOOP IMPORT APPAND 2

06 SQOOP EXPORT

06 SQOOP EXPORT

07 SQOOP JOB

07 SQOOP JOB

04 sqoop incrememtal import

04 sqoop incrememtal import

03 sqoop import 2

03 sqoop import 2

05 SQOOP INCREMENTAL IMPORT Lastmodified

05 SQOOP INCREMENTAL IMPORT Lastmodified

06 BACKUPNODE HA FEDERATION

06 BACKUPNODE HA FEDERATION

03 HIVE PARTITIONS 2

03 HIVE PARTITIONS 2

02 HIVE EXTERNAL TABLE PARTITION

02 HIVE EXTERNAL TABLE PARTITION

01 HIVE INTRO MANAGED TEMP TABLE

01 HIVE INTRO MANAGED TEMP TABLE

01 CCA 175 SQOOP INTRO IMPORT

01 CCA 175 SQOOP INTRO IMPORT

CCA 175 SMALL FILE PROBLEM VIEW FSIMAGE 18

CCA 175 SMALL FILE PROBLEM VIEW FSIMAGE 18

02 HDFS class 2

02 HDFS class 2

05 SECONDARY NAMENODE CHECKPOINT NODE

05 SECONDARY NAMENODE CHECKPOINT NODE

01 hadoop what is hadoop class 1

01 hadoop what is hadoop class 1

mysql sqoop setup

mysql sqoop setup

01 hadoop demo 3

01 hadoop demo 3

15 MAPREDUCE PARTITION EXAMPLE 2

15 MAPREDUCE PARTITION EXAMPLE 2

hdfs write failure case

hdfs write failure case

17 MAPREDUCE COMBINEr 2

17 MAPREDUCE COMBINEr 2

CCA 175 HDFS ADMIN COMMANDS PART 3 17

CCA 175 HDFS ADMIN COMMANDS PART 3 17

01 hadoop Demo 1

01 hadoop Demo 1

16 MAPREDUCE COMBINER 1

16 MAPREDUCE COMBINER 1

01 hadoop Demo 2

01 hadoop Demo 2

hdfs write operation

hdfs write operation

Access oracle VM Ubuntu using Putty

Access oracle VM Ubuntu using Putty

01 flume setup example

01 flume setup example

02 flume load data to hdfs

02 flume load data to hdfs

13 MAPREDUCE INVERTED INDEX PARTITION

13 MAPREDUCE INVERTED INDEX PARTITION

CCA 175 HDFS ADMIN COMMANDS PART 2 16

CCA 175 HDFS ADMIN COMMANDS PART 2 16

14 MAPREDUCE PARTITION EXAMPLE

14 MAPREDUCE PARTITION EXAMPLE

CCA 175 HDFS ADMIN COMMANDS PART 1 15

CCA 175 HDFS ADMIN COMMANDS PART 1 15

12 MAPREDUCE CUSTOM DATATYPES

12 MAPREDUCE CUSTOM DATATYPES

CCA 175 HDFS COMMANDS PART 4 14

CCA 175 HDFS COMMANDS PART 4 14

11 MAPREDUCE WRITABLE COMPARABLE

11 MAPREDUCE WRITABLE COMPARABLE

10 MAPREDUCE PASS PARAMS TO DRIVER CLASS

10 MAPREDUCE PASS PARAMS TO DRIVER CLASS

05 PIG JOINS

05 PIG JOINS

CCA 175 HDFS COMMANDS PART 3 13

CCA 175 HDFS COMMANDS PART 3 13

04 PIG NESTED FOREACH UNION JOIN CO GROUP

04 PIG NESTED FOREACH UNION JOIN CO GROUP

09 MAPREDUCE GREP ZERO REDUCERS

09 MAPREDUCE GREP ZERO REDUCERS

08 MAPREDUCE INTERNALS

08 MAPREDUCE INTERNALS

03 PIG GROUP FILTER AVG STORE

03 PIG GROUP FILTER AVG STORE

01 PIG INTRO

01 PIG INTRO

CCA 175 HDFS COMMANDS PART 2 12

CCA 175 HDFS COMMANDS PART 2 12

02 PIG DATATYPES LOAD

02 PIG DATATYPES LOAD

06 MAPREDUCE END TO END EXPLANATION

06 MAPREDUCE END TO END EXPLANATION

06 MAPREDUCE IDENTITY MAPPER REDUCER

06 MAPREDUCE IDENTITY MAPPER REDUCER

05 MAPREDUCE WORDCOUNT EXAMPLE PART 3 EXECUTION

05 MAPREDUCE WORDCOUNT EXAMPLE PART 3 EXECUTION

CCA 175 HDFS COMMANDS 11

CCA 175 HDFS COMMANDS 11

04 MAPREDUCE WORDCOUNT EXAMPLE PART 2

04 MAPREDUCE WORDCOUNT EXAMPLE PART 2

03 MAPREDUCE WORDCOUNT EXAMPLE PART 1

03 MAPREDUCE WORDCOUNT EXAMPLE PART 1

CCA 175 HDFS CONFIGURATIONS 11

CCA 175 HDFS CONFIGURATIONS 11

10 KAFKA SETUP TEST

10 KAFKA SETUP TEST

CCA A75 HDFS SERVICES SH 10

CCA A75 HDFS SERVICES SH 10

HIVE COMPLEX DATATYPES 15

HIVE COMPLEX DATATYPES 15

02 MAPREDUCE MAP REDUCE DATATYPES

02 MAPREDUCE MAP REDUCE DATATYPES

01 MAPREDUCE INTRO

01 MAPREDUCE INTRO

HIVE COMPLEX DATATYPES 15

HIVE COMPLEX DATATYPES 15

09 zookeeper setup

09 zookeeper setup

08 spark setup in pseudo mode

08 spark setup in pseudo mode

07 scalainstallation method 2

07 scalainstallation method 2

06 scala installation using terminal method 1

06 scala installation using terminal method 1

05 hadoop installtion

05 hadoop installtion

HIVE UDF HIVERC 10

HIVE UDF HIVERC 10

CCA 175 HDFS RACKWARENESS 09

CCA 175 HDFS RACKWARENESS 09

04 JAVA SETUP in ubuntu

04 JAVA SETUP in ubuntu

JAVA MAP HASHMAP HASHTABLE TREEMAP 24

JAVA MAP HASHMAP HASHTABLE TREEMAP 24

HIVE INDEXING COMPACT BITMAP 13

HIVE INDEXING COMPACT BITMAP 13

CCA 175 HDFS FEDERATION 8

CCA 175 HDFS FEDERATION 8

WHAT IS DFS 2

WHAT IS DFS 2

WHAT IS FILESYSTEM 1

WHAT IS FILESYSTEM 1

CCA 175 HDFS Question and answers 5 1

CCA 175 HDFS Question and answers 5 1

CCA 175 HDFS NAMENODE SNN CHECKPOINT 6

CCA 175 HDFS NAMENODE SNN CHECKPOINT 6

CCA 175 HDFS BKP NODE HIGH AVAILABILITY 7

CCA 175 HDFS BKP NODE HIGH AVAILABILITY 7

JAVA HASHSET LINKEDHASHSET TREESET 23

JAVA HASHSET LINKEDHASHSET TREESET 23

JAVA ARRAYLIST VECTOR LINKEDLIST 22

JAVA ARRAYLIST VECTOR LINKEDLIST 22

HIVE TABLESAMPLE JOINs 12

HIVE TABLESAMPLE JOINs 12

UBUNTU Installation part 1

UBUNTU Installation part 1

UBUNTU Installation part 2

UBUNTU Installation part 2

JAVA COLLECTION ARRAYLIST INTRO 21

JAVA COLLECTION ARRAYLIST INTRO 21

HIVE BUCKETING 11

HIVE BUCKETING 11

MAPREDUCE PARTITION COMBINER -----15

MAPREDUCE PARTITION COMBINER -----15

MAPREDUCE DATATYPES ECLIPSE ---- 5

MAPREDUCE DATATYPES ECLIPSE ---- 5

MAPREDUCE CUSTOM INPUTFORMAT ----21

MAPREDUCE CUSTOM INPUTFORMAT ----21

MAPREDUCE COMBINER CIRCULAR BUFFER ----16

MAPREDUCE COMBINER CIRCULAR BUFFER ----16

MAOREDUCE INPUTSPLIT RECORDREADER CODE ----- 3

MAOREDUCE INPUTSPLIT RECORDREADER CODE ----- 3

MAPREDUCE-WRITABLE VS JAVA SERIALIZATION ------12

MAPREDUCE-WRITABLE VS JAVA SERIALIZATION ------12

MAPREDUCE COMPRESSION LAZYOUTPUT ----20

MAPREDUCE COMPRESSION LAZYOUTPUT ----20

MAPREDUCE PASS PARAM TO MAPPER PROGREAM ----11

MAPREDUCE PASS PARAM TO MAPPER PROGREAM ----11

MAPREDUCE MAXLENGTHWORD PROGRAM ----10

MAPREDUCE MAXLENGTHWORD PROGRAM ----10

MAPREDUCE PARTITION ----14

MAPREDUCE PARTITION ----14

MAPREDUCE WORDCOUNT PART-2 ----7

MAPREDUCE WORDCOUNT PART-2 ----7

MAPREDUCE WORDCOUNT DETAILS DEBUG------ 8

MAPREDUCE WORDCOUNT DETAILS DEBUG------ 8

MAPREDUCE GREP PROGRAM ---- 9

MAPREDUCE GREP PROGRAM ---- 9

MAPREDUCE WHOLEFILE MULTIINPUT MULTIOUTPUT------19

MAPREDUCE WHOLEFILE MULTIINPUT MULTIOUTPUT------19

MAPREDUCE SEQUENCE COMBINE NLINE -----18

MAPREDUCE SEQUENCE COMBINE NLINE -----18

MAPREDUCE MAPPER DETAILED EXPLAINS SATURDAY CLASS

MAPREDUCE MAPPER DETAILED EXPLAINS SATURDAY CLASS