Extensive Experience in designing, configuring, developing, monitoring, debugging and
performance tuning of Dataware housing and BigData applications using Hadoop technologies.
• Understanding requirement from Business AnalystOnsite Counterparts and requirement
specification documents.
• Designing data pipeline and decide technologies to be used to implement business
requirement.
• Distribute work among team member and mentoring team member.
• Have worked on different hadoop technologies like spark, pig, hive, MapReduce, sqoop etc.
and distinct hadoop distribution Cloudera and Hortonworks
• Strong working knowledge on spark streaming , spark sql and performance running
• Very good understanding of Partitioning, Bucketing concepts in Hive and designed both
Managed and External tables in Hive to optimize performance.
• Implement and enhance pig latin script.
• Export and import data in HDFS using sqoop.
• Automate data pipeline using shell script.