Experience

Rock Central

• United States
• Information Technology & Services
• 200 - 300 Employee

• Senior Big Data Engineer

  • Dec 2022 - Present

• Big Data Engineer

  • Mar 2021 - Dec 2022

  Detroit, Michigan, United States



Quicken Loans

• United States
• Financial Services
• 700 & Above Employee

• Software Engineer - Data

  • Sep 2019 - Mar 2021

  Greater Detroit Area



GalaxE.Solutions

• United States
• IT Services and IT Consulting
• 700 & Above Employee

• Data Engineer

  • Sep 2017 - Aug 2019

  Greater Detroit Area



Cisco

• United States
• Software Development
• 700 & Above Employee

• Big Data Engineer

  • 2016 - 2017

  Milpitas, CA Tuned the performance of the existing Hive queries and migrate existing data transformations and developed new transformations Using Apache Spark. Involved in building end-to-end data pipelines to analyze the data and to extract various behavioral patterns of the customers. •Implemented Spark using Scala and utilizing Data frames and Spark SQL API for faster processing of data. •Developed data pipeline using Spark, Hive and Sqoop, to ingest, transform and analyze operational… Show more Tuned the performance of the existing Hive queries and migrate existing data transformations and developed new transformations Using Apache Spark. Involved in building end-to-end data pipelines to analyze the data and to extract various behavioral patterns of the customers. •Implemented Spark using Scala and utilizing Data frames and Spark SQL API for faster processing of data. •Developed data pipeline using Spark, Hive and Sqoop, to ingest, transform and analyze operational data. •Developed Spark jobs and Hive Jobs to summarize and transform data. •Used Spark for interactive queries, processing of streaming data and integration with popular NoSQL database for huge volume of data. •Real time streaming the data using Spark with Kafka •Created applications using Kafka, which monitors consumer log within Apache Kafka clusters. •Developed Python scripts to copy data between the clusters. The Python script is developed in such a way to handle the copying of huge amount of data between intermediate clusters in multiple threads instead of a single threaded fashion. Very effective approach than "Distcp" command in Hadoop. •Ingested syslog messages, parses them and streams the data to Apache Kafka. •Handled importing data from different data sources into HDFS using Sqoop and performing transformations using Hive, Map Reduce and then loading data into HDFS. •Exported the analyzed data to the relational databases using Sqoop, to further visualize and generate reports for the BI team. •Analyzed the data by performing Hive queries (Hive QL) to study customer behavior. •Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting. Show less



Sipit Solutions

• Salesforce Developer Intern

  • Aug 2015 - Jan 2016

  Flint, Michigan The main aim of the company is to support local Non - Government Organizations (NGOs) in building customized Salesforce applications. •Followed Agile SDLC process for the project •Developed custom objects, fields, validations, workflows and process flows •Used Apex and Visualforce code to achieve custom functionality •Created Reports and Dashboards for respective… Show more The main aim of the company is to support local Non - Government Organizations (NGOs) in building customized Salesforce applications. •Followed Agile SDLC process for the project •Developed custom objects, fields, validations, workflows and process flows •Used Apex and Visualforce code to achieve custom functionality •Created Reports and Dashboards for respective projects. •Created user manual and technical manual for every project Show less