Experience

Anthem

• United States
• Insurance
• 700 & Above Employee

• Data Engineer

  • Apr 2019 - Present

  • Worked on creating Enterprise Data Lake to resolve functional gaps in the traditional Data Warehouse architecture on-premises and defined new Cloud Architecture to meet emerging big data needs. • Analyzed and predicted product ratings with a semi-structured dataset using Spark and Python on AWS Glue. • Developed ETL Processes in AWS Glue using PySpark to migrate Health Care data from external sources like S3, HDFS into AWS Redshift.• Used Hive QL to analyze the partitioned and bucketed data, executed Hive queries on Parquet tables stored in Hive to perform data analysis to meet the business specification logic. • Created and managed AWS EMR clusters using AWS CloudFormation to run spark scripts using Jupyter Notebooks and monitored the EMR usage using CloudWatch.• Used AWS Redshift, S3, and Athena services to query large amount data stored on S3 to create a Data Lake without having to go through ETL process.



Frontier Communications

• Telecommunications
• 700 & Above Employee

• Data Engineer

  • Jan 2018 - Feb 2019

  • Gathered business scope and technical requirements from users and translated business logic into ETL Specifications.• Actively involved in interaction with Management to identify key Dimensions and Measures for business performance.• Achieved data mappings to extract data from different source databases, performed data analysis and transformed the data using ETL Informatica Transformations to load data to Oracle database.• Engineered on tuning the Informatica ETL mapping and improved the performance of the load process by 15%.• Programmed complex SQL Server queries and performance-tuned queries for efficient data retrieval.• Performed application server builds in AWS EC2 environment and monitoring them using cloud watch.• Creating Security groups for both individual instances and for group of instances under a network.• Created S3 buckets and managed policies and utilized S3 bucket and glacier for storage and backup on AWS.• Experience in migrating the data using Sqoop from HDFS to Relational Database System and vice-versa.• Created Hive schema using performance techniques like partitioning and bucketing.• Gained experience working in Agile Development Environment and Scrum Methodology.



Agaram Consulting Pvt Ltd.

• India
• Human Resources Services
• 1 - 100 Employee

• Software Developer

  • Jan 2016 - Nov 2017

  • Collaborated with users, Business Analysts to understand the overall system data flow, gathered and documented requirements and translated the Functional Specification to Technical Specification for Informatica mappings.• Coordinated with Data Analyst, Data Modeler and Data Warehouse team to analyze source data coming from various source systems like Oracle, DB2, Flat Files in designing logical and physical Dimensional Data Models and created Star Schema using Erwin Data Modeler 7.3.• Integrated new data management technologies and software engineering tools into existing structures. • Developed and Maintained model data from various sources, debugging and increasing solution feasibility.• Translated customer requirements into formal requirements and design documents.• Involved in creating the design and technical specifications for the ETL process based on Functional specifications.• Worked extensively with Extraction, Transformation and Loading of data from Multiple Sources (oracle, fixed width and delimited flat files) to ORACLE, SQL server databases using Informatica.• Worked on Scheduling workflows and sessions using Informatica scheduler and have implemented decision task and email task for tracking the successful completion• Handled the creation of tables, views, triggers, stored procedures, functions, sequences in the database using SQL and PL/SQL scripts.