Experience

IBM

• China
• Software Development
• 700 & Above Employee

• Senior Software Engineer

  • May 2021 - Present

  Datastage, Talend

• Senior Software Engineer

  • May 2021 - Present

  Datastage, Talend



Prolifics

• United States
• Information Technology & Services
• 700 & Above Employee

• Senior Software Engineer

  • Apr 2016 - Jul 2022

  Prolifics Is a Global Digital Technology Solutions Provider. Promoted to Software Engineer and later Senior Software Engineer after the Ispace was taken over by Profilics. Work on ETL and Hadoop projects as per client requirements. Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. • Build processes supporting data transformation, data structures, metadata, dependency and workload management. Manipulate, process and extract value from large disconnected datasets. Worked on POC's with technologies of Talend and Tableau. • Gained experience of message queuing, stream processing, and highly scalable ‘big data’ data stores. • Facilitate and support the Agile Scrum processes. Turn both end-users and stakeholder’s feedback into Requirements Documents (BRD, BDD, MRK, and PRD), Roadmaps and User Stories. • Develop Spark code and Spark-SQL for faster testing and processing of realtime data structured and unstructured data. Load the data into Spark RDD and performed in-memory data computation to generate the output response. • Regularly monitor Hadoop Cluster to ensure installed applications are free from errors and warnings. Show less