Data Migration Developer | System Engineer

• Sep 2023 - Present

Data Engineer | Software Engineer

• May 2021 - Jun 2023

 Team lead for a module focusing on data segregation into core data, archived data, purge data  Designed and implemented ETL process to migrate Terraform raw data to SQL in Bigdata  Designed Data Architecture for Wells Fargo  Defined Data storage strategies and roadmaps  Developed spark function to transform old token based to role-based authentication  Designed and implemented dashboard showing quantitative analysis for business intelligence using spark, java and Tableau for data visualization• Wells FargoAs part of the Wells Fargo project, I designed and implemented an ETL process to migrate Terraform raw data to SQL in Bigdata. I also played a key role in designing the data architecture and defining data storage strategies and roadmaps. My contributions to the project's data management earned me recognition from the team and the client.• CISCOAs part of the CISCO project, I supervised a team of 4 people to create a data segregation module, which involved designing a process to segregate data into core, archived, and purge data. I also created Spark jobs as needed by business intelligence, enabling the team to perform data analysis quickly and efficiently. Furthermore, I designed and implemented a dashboard using Spark, Java, and Tableau for quantitative analysis of business intelligence. The dashboard helped stakeholders gain valuable insights into the project's progress and make informed decisions. Additionally, I developed a Spark function to transform the old token-based authentication to a more efficient role-based authentication. These contributions significantly improved data processing efficiency and security for the project. Show less

Software Engineer

• May 2021 - Jun 2023