Experience

REPAY

• United States
• Financial Services
• 1 - 100 Employee

• Data Engineer

  • Nov 2022 - Present



ADP

• United States
• Human Resources Services
• 700 & Above Employee

• Senior Data Engineer

  • Aug 2020 - Oct 2022

  Responsible for estimating the cluster size, monitoring and troubleshooting of the Spark data bricks cluster. Developed spark streaming applications to consume the streaming json messages from Kafka topics. And Experience working with varied forms of data infrastructure inclusive of relational databases such as SQL, Hadoop, Spark, and column-oriented databases such as MySQL. Responsible for estimating the cluster size, monitoring and troubleshooting of the Spark data bricks cluster. Developed spark streaming applications to consume the streaming json messages from Kafka topics. And Experience working with varied forms of data infrastructure inclusive of relational databases such as SQL, Hadoop, Spark, and column-oriented databases such as MySQL.



Caterpillar

• 300 - 400 Employee

• Data Engineer

  • Jan 2019 - Aug 2020

  Involved in the development of real time streaming applications using PySpark, Apache Flink, Kafka, Hive on distributed Hadoop Cluster. Designed and developed Power BI graphical and visualization solutions with business requirement documents and plans for creating interactive dashboards. Created ADF pipelines to extract, transform and load data from different sources like SQL, Oracle, SharePoint to Azure data lake and Azure Synapse. Created and Developed Notebooks (using PySpark and Spark SQL) and published dashboards with desired charts and tables. Show less



Cambia Health Solutions

• United States
• Wellness and Fitness Services
• 700 & Above Employee

• Data Engineer

  • Mar 2016 - Dec 2018

  Responsible for design and development of Python programs/scripts to prepare, transform and harmonize data sets in preparation for modeling. Developed an automatic Jira ticket generator using React, Bootstrap, and Node.js for cloud NoSQL database users. Created data stream performed using Matillion jobs by ETL, ELT approach. Business intelligence solutions derived from visualization tools like Tableau, Looker. Worked on with Big data on AWS and AWS connect glue cloud services i.e., EC2, S3, EMR and DynamoDB. Show less



Publix

• Switzerland
• Advertising Services
• 1 - 100 Employee

• Software Developer

  • Sep 2014 - Mar 2016