Experience

Bartronics India Ltd

• IT Services and IT Consulting
• 200 - 300 Employee

• Hadoop Developer

  • Jun 2012 - Present

  • Importing all the ANZ Customer specific personal data to Hadoop file system using SQOOP component of Hadoop. • Creating two different users (hduser for performing hdfs operations and mapred user for performing mapreduce operations only) • Writing Map Reduce code that will take input as customer related flat file and parse the same data to extract the meaning full (domain specific) information for further processing. • Practical work experience with Hadoop Ecosystem (i.e. Hadoop, Hive, Pig etc.) • Creating Hive External tables to store the processed data from Map Reduce. • End-to-end performance tuning of Hadoop clusters routines against very large data sets • Keeping track of opening & closing production trouble tickets by using Talend tool. • Coordinate Hadoop system implementation, system support and performance tuning • Conduct Hadoop cluster training for a team of 10 members. • Written the Apache PIG scripts to process the HDFS data. • Written the Map Reduce Code for filtering data. • Writing CLI commands using HDFS. • Ensured NFS is configured for Name Node. • Setup Hive with MySQL as a Remote Metastore. • Moved all log/text files generated by various products into HDFS location. Show less