Senior Data Engineer

• Jul 2023 - Present

Data Engineer

• Oct 2021 - Jul 2023

• Attending meetings with potential customers and creating appropriate tech designs for problems. • Implementing ETLs with ScalaSpark. • Implementing real-time streaming services with Apache Flink. • Designed and implemented a ClickHouse database solution on AWS, including provisioning EC2 instances and configuring the infrastructure from scratch. • Designed and deployed an Apache Superset BI solution on AWS, leveraging open-source technology to provide data insights and visualizations. • Using various AWS services such as GLUE, Athena, Kinesis, S3, DynamoDB, RDS, SNS, ECS, Fargate and Lambda. • Using Terraform for infrastructure as a code. • Optimizing AWS costs. Show less

Machine Learning Engineer

• Jun 2020 - Oct 2021

- Worked on Insider's Smart Recommender and On-Site Search products. - API development with Scala/Akka - Implemented ETL jobs with Scala/Spark and orchestrated them with Airflow. - Used various AWS services such as Lambda(with Node.js), EMR, Athena, Kinesis, and S3. - Experienced in Elasticsearch, Redis and MySQL. - Specialized in NLP and did research and development for the Tubitak project, which is Text Generation with Generative Adversarial Networks. - Experienced in text classification tasks using FastText with Python. - Experienced in text generation tasks using seq2seq models. Show less

Data Science Intern

• Jun 2019 - Jun 2020

- Worked as a part of the Data Science team that is responsible for applying machine learning and statistical methods to build innovative global credit scoring engine fed from various data sources - Implemented a novel model for predicting big five personality traits based on Twitter features - Researched and implemented change detection algorithms for fraudulent analysis - Implemented unit tests for Python-Flask application - AWS / Git - Python development - Worked as a part of the Data Science team that is responsible for applying machine learning and statistical methods to build innovative global credit scoring engine fed from various data sources - Implemented a novel model for predicting big five personality traits based on Twitter features - Researched and implemented change detection algorithms for fraudulent analysis - Implemented unit tests for Python-Flask application - AWS / Git - Python development