Experience

MapR Technologies, acquired by Hewlett Packard Enterprise company in 2019

• United States
• Information Technology & Services
• 1 - 100 Employee

• Senior Distributed System Engineer at MapR Technologies

  • Aug 2015 - Present

  Setup of MapR Hadoop grids on a large scale level from scratch in multiple data centers devising strategic methods of automation and configuration deployment. * Draft conventions, procedures and develop automation tools for productive and simplified management of large scale deployments of MapR Hadoop & allied technologies. * Setup monitoring of MapR Hadoop hosts and services using Nagios as monitoring and alerting system * Plan, evaluate and deployment of MapR HBase and MapR Hadoop… Show more Setup of MapR Hadoop grids on a large scale level from scratch in multiple data centers devising strategic methods of automation and configuration deployment. * Draft conventions, procedures and develop automation tools for productive and simplified management of large scale deployments of MapR Hadoop & allied technologies. * Setup monitoring of MapR Hadoop hosts and services using Nagios as monitoring and alerting system * Plan, evaluate and deployment of MapR HBase and MapR Hadoop clusters as a low latency cache and large data fast lookup, for improving upon the data availability, resiliency of underlying serving systems and performance of complex data processing jobs. * Design and develop web based dashboard for presenting coordination metrics from Hadoop ecosystem, Zookeeper data navigation for enhancing operability and visibility of Zookeeper clusters. * Understand and review operability, configuration and monitoring metrics of various Hadoop clusters at regular intervals and gather required necessary changes for fine tuning of the scalability, stability and performance with respect to the available hardware capacity and workload driven parameters in a multi-tenant environment. * Perform root cause analysis, prepare post-mortem reports, debug and troubleshoot the failure situations for the Hadoop cluster * Participation in 24 x 7 on-call activities and operations. * Good working knowledge of Hive, Hbase , YARN, , MFS, Pig, Sqoop etc. Show less Setup of MapR Hadoop grids on a large scale level from scratch in multiple data centers devising strategic methods of automation and configuration deployment. * Draft conventions, procedures and develop automation tools for productive and simplified management of large scale deployments of MapR Hadoop & allied technologies. * Setup monitoring of MapR Hadoop hosts and services using Nagios as monitoring and alerting system * Plan, evaluate and deployment of MapR HBase and MapR Hadoop… Show more Setup of MapR Hadoop grids on a large scale level from scratch in multiple data centers devising strategic methods of automation and configuration deployment. * Draft conventions, procedures and develop automation tools for productive and simplified management of large scale deployments of MapR Hadoop & allied technologies. * Setup monitoring of MapR Hadoop hosts and services using Nagios as monitoring and alerting system * Plan, evaluate and deployment of MapR HBase and MapR Hadoop clusters as a low latency cache and large data fast lookup, for improving upon the data availability, resiliency of underlying serving systems and performance of complex data processing jobs. * Design and develop web based dashboard for presenting coordination metrics from Hadoop ecosystem, Zookeeper data navigation for enhancing operability and visibility of Zookeeper clusters. * Understand and review operability, configuration and monitoring metrics of various Hadoop clusters at regular intervals and gather required necessary changes for fine tuning of the scalability, stability and performance with respect to the available hardware capacity and workload driven parameters in a multi-tenant environment. * Perform root cause analysis, prepare post-mortem reports, debug and troubleshoot the failure situations for the Hadoop cluster * Participation in 24 x 7 on-call activities and operations. * Good working knowledge of Hive, Hbase , YARN, , MFS, Pig, Sqoop etc. Show less



Sears

• United States
• Retail
• 700 & Above Employee

• Hadoop Systems Administrator at Sears Holdings Corporation

  • Nov 2014 - Jul 2015

  Team member of the Hadoop Infrastructure Support team providing hardware and software support for Cloudera Apache Hadoop implementation for Sears and MetaScale (A division of Sears Holdings). Team member of the Hadoop Infrastructure Support team providing hardware and software support for Cloudera Apache Hadoop implementation for Sears and MetaScale (A division of Sears Holdings).



Ugam

• India
• IT Services and IT Consulting
• 700 & Above Employee

• Amazon Cloud ( AWS ) and Devops Engineer

  • Jun 2013 - Oct 2014

  Designing & implementing enterprise grade with customizable and cost-effective Solutions on AWS. Experience in AWS- EC2, S3, EMR ,Elastic Load Balancing, IAM, RDS, SES, SNS, Cloud Watch, Auto Scaling, and Cloud Front,Route53,etc .. Implementation of security with OS level & AWS Security Group for the EC2 & database server. Building Cloud infrastructure for Applications with Fail-over and High Availability Mode. Creation of AMI for the Production deployment with the required… Show more Designing & implementing enterprise grade with customizable and cost-effective Solutions on AWS. Experience in AWS- EC2, S3, EMR ,Elastic Load Balancing, IAM, RDS, SES, SNS, Cloud Watch, Auto Scaling, and Cloud Front,Route53,etc .. Implementation of security with OS level & AWS Security Group for the EC2 & database server. Building Cloud infrastructure for Applications with Fail-over and High Availability Mode. Creation of AMI for the Production deployment with the required software’s & Creation of Snapshot. Design & Implemented Backup Site in AWS. Experience in RDS & EC2 server for Mysql Database Servers. Implemented Bulk E-mail Sending System using SES. Deployed the monitoring with Nagios & cloud watch, Sitemon. Configuring & maintaining Apache server with High Availability with Amazon elastic load balancer (ELB) Show less Designing & implementing enterprise grade with customizable and cost-effective Solutions on AWS. Experience in AWS- EC2, S3, EMR ,Elastic Load Balancing, IAM, RDS, SES, SNS, Cloud Watch, Auto Scaling, and Cloud Front,Route53,etc .. Implementation of security with OS level & AWS Security Group for the EC2 & database server. Building Cloud infrastructure for Applications with Fail-over and High Availability Mode. Creation of AMI for the Production deployment with the required… Show more Designing & implementing enterprise grade with customizable and cost-effective Solutions on AWS. Experience in AWS- EC2, S3, EMR ,Elastic Load Balancing, IAM, RDS, SES, SNS, Cloud Watch, Auto Scaling, and Cloud Front,Route53,etc .. Implementation of security with OS level & AWS Security Group for the EC2 & database server. Building Cloud infrastructure for Applications with Fail-over and High Availability Mode. Creation of AMI for the Production deployment with the required software’s & Creation of Snapshot. Design & Implemented Backup Site in AWS. Experience in RDS & EC2 server for Mysql Database Servers. Implemented Bulk E-mail Sending System using SES. Deployed the monitoring with Nagios & cloud watch, Sitemon. Configuring & maintaining Apache server with High Availability with Amazon elastic load balancer (ELB) Show less



Wipro

• India
• IT Services and IT Consulting
• 700 & Above Employee

• Associate Engineer

  • Feb 2011 - Jun 2013

  Hadoop Cluster Maintenance which includes check for HDFS corruption, copying data between clusters, adding and removing cluster nodes, cluster rebalancing, NameNode metadata backup. Hadoop Cluster up-gradation using CDH. Hadoop Cluster monitoring and troubleshooting. General node monitoring using Nagios/grafana /graphite/Ganglia etc General troubleshooting in the cluster such as memory, replica errors etc Hadoop cluster log management. Basic idea on benchmarking a Hadoop… Show more Hadoop Cluster Maintenance which includes check for HDFS corruption, copying data between clusters, adding and removing cluster nodes, cluster rebalancing, NameNode metadata backup. Hadoop Cluster up-gradation using CDH. Hadoop Cluster monitoring and troubleshooting. General node monitoring using Nagios/grafana /graphite/Ganglia etc General troubleshooting in the cluster such as memory, replica errors etc Hadoop cluster log management. Basic idea on benchmarking a Hadoop cluster. Importing data using Apache Flume, Sqoop to HDFS. Working on developing a DNS Query log monitoring application to find the QPS, Cache Hit, Highest domain resolved etc using Apache Flume on Hadoop stack. Knowledge of Database Administration: Worked as a MySQL, and Postgres DBA consultant in various projects providing remote support and resolving the issues. Involved in capacity planning and designing of the database architectures. Automation of DBA tasks using BASH scripts. Experience in MySQL database tuning for better performance. Managing archival backups and other database objects and performing scheduled backups. Implementing and managing replication in various scenarios. Show less Hadoop Cluster Maintenance which includes check for HDFS corruption, copying data between clusters, adding and removing cluster nodes, cluster rebalancing, NameNode metadata backup. Hadoop Cluster up-gradation using CDH. Hadoop Cluster monitoring and troubleshooting. General node monitoring using Nagios/grafana /graphite/Ganglia etc General troubleshooting in the cluster such as memory, replica errors etc Hadoop cluster log management. Basic idea on benchmarking a Hadoop… Show more Hadoop Cluster Maintenance which includes check for HDFS corruption, copying data between clusters, adding and removing cluster nodes, cluster rebalancing, NameNode metadata backup. Hadoop Cluster up-gradation using CDH. Hadoop Cluster monitoring and troubleshooting. General node monitoring using Nagios/grafana /graphite/Ganglia etc General troubleshooting in the cluster such as memory, replica errors etc Hadoop cluster log management. Basic idea on benchmarking a Hadoop cluster. Importing data using Apache Flume, Sqoop to HDFS. Working on developing a DNS Query log monitoring application to find the QPS, Cache Hit, Highest domain resolved etc using Apache Flume on Hadoop stack. Knowledge of Database Administration: Worked as a MySQL, and Postgres DBA consultant in various projects providing remote support and resolving the issues. Involved in capacity planning and designing of the database architectures. Automation of DBA tasks using BASH scripts. Experience in MySQL database tuning for better performance. Managing archival backups and other database objects and performing scheduled backups. Implementing and managing replication in various scenarios. Show less