Experience

BestDoctor

• Wellness and Fitness Services
• 1 - 100 Employee

• Data Engineer

  • Jul 2022 - Present

  Migration of data lake update pipeline from Spark/Zeppelin, creation, maintenance and optimization of raw layer loading process from sources to Greenplum-based data lake using Airflow and external PXF tables, automatic daily monitoring of raw layer freshness, Greenplum cluster monitoring. Assistance to analysts and data scientists in query optimization, data mart changes, access control for different user groups. Tech stack: SQL, Python, Gitlab, Apache Zeppelin, BI Metabase. Migration of data lake update pipeline from Spark/Zeppelin, creation, maintenance and optimization of raw layer loading process from sources to Greenplum-based data lake using Airflow and external PXF tables, automatic daily monitoring of raw layer freshness, Greenplum cluster monitoring. Assistance to analysts and data scientists in query optimization, data mart changes, access control for different user groups. Tech stack: SQL, Python, Gitlab, Apache Zeppelin, BI Metabase.



Skyeng

• Cyprus
• Professional Training and Coaching
• 700 & Above Employee

• Data Engineer

  • Sep 2019 - Jul 2022

  Assisted analysts with technical issues, optimized complex SQL queries, administered AWS Redshift cluster, monitored Redshift metrics, partially administered and monitored Tableau Server. Identified and resolved performance bottlenecks in Redshift and Apache Airflow, which was used as an ETL tool. Contributed to the development of a new data warehouse as part of a team of engineers: wrote DAGs, participated in organizing Greenplum cluster with Pivotal licenses on AWS, open-source version on rented servers, administered data clusters. Tech stack includes SQL, Python, AWS S3, AWS Redshift, AWS Cloudwatch, Greenplum, Github, Apache Airflow, Matillion ETL, Stitch, BI tools (Tableau, Redash, Metabase). Show less