Data Engineer

• May 2023 - Present

Data Engineer

• Sep 2020 - May 2023

• Designed, built, and maintained scalable data analytics pipelines using Apache Airflow and Elasticsearch ingest pipelines. • Developed a configuration management system using YAML to dynamically create, modify, and configure DAGs in Apache Airflow. • Set up full CI/CD pipelines on GitLab to build and test the systems. • Utilized Elasticsearch Anomaly Detection API to identify and report anomalies in the timeline series data. • Designed, built, and maintained scalable data analytics pipelines using Apache Airflow and Elasticsearch ingest pipelines. • Developed a configuration management system using YAML to dynamically create, modify, and configure DAGs in Apache Airflow. • Set up full CI/CD pipelines on GitLab to build and test the systems. • Utilized Elasticsearch Anomaly Detection API to identify and report anomalies in the timeline series data.

Research & Teaching Assistant

• Sep 2012 - Sep 2020

• Demonstrated the practical use cases of the courses by illustrating them on real-life problems for the courses Data Structures & Algorithms, Software Engineering, and Data Mining. • Solved challenging problems to prepare students for the tough analytical questions they might face in job interviews at high-tech companies. • Conducted research on Software Testing and published several papers in well-known journals and conferences. • Demonstrated the practical use cases of the courses by illustrating them on real-life problems for the courses Data Structures & Algorithms, Software Engineering, and Data Mining. • Solved challenging problems to prepare students for the tough analytical questions they might face in job interviews at high-tech companies. • Conducted research on Software Testing and published several papers in well-known journals and conferences.