Dmitriy Gorbenko

Lead Software Developer at IT_One
  • Claim this Profile
Contact Information
us****@****om
(386) 825-5501
Location
Russia, RU
Skills

Topline Score

Topline score feature will be out soon.

Bio

Generated by
Topline AI

You need to have a working account to view this content.
Join now
You need to have a working account to view this content.
Join now

Credentials

  • DevOps on AWS Specialization
    Coursera
    Apr, 2023
    - Oct, 2024
  • Architecting Solutions on AWS
    Coursera
    Mar, 2023
    - Oct, 2024
  • Introduction to Designing Data Lakes on AWS
    Coursera
    Mar, 2023
    - Oct, 2024

Experience

  • IT_One
    • Russian Federation
    • Information Technology & Services
    • 300 - 400 Employee
    • Lead Software Developer
      • Nov 2020 - Present

      2016 - now (this project started in Luxoft) A project for a very large logistics company. Data Lake based on Big Data technologies: Hadoop, Hive, Spark, Vertica, Clickhouse, Ambari, Hue, Oozie. My activities: - development of data layers (Hive SQL), creation of Hive UDF (Java), Scala unit tests for SQL scripts (using hiverunner) - Scala sql script generators (ODS/DDS), Scala DSL to describe ODS/DDS meta-data - performance optimization of individual jobs, Hive SQL performance tuning - jobs orchestration (Oozie), development of custom oozie actions (Java) - troubleshooting, incident resolution - deployment, release activities (last 3 years) - development of tools for collecting statistics on the operation of services and jobs, visualization of the work of jobs and utilization of cluster resources (Grafana) - optimization of cluster resource utilization for groups of jobs (hundreds of jobs per day) - creation of non-standard ETL streams, RDBMS -> kafka -> hadoop - meta-data (control flow, data flow), DSL to describe meta-data - unix/bash scripting Show less

  • Luxoft
    • Switzerland
    • IT Services and IT Consulting
    • 700 & Above Employee
    • Senior Software Developer
      • Oct 2013 - Nov 2020

      2016 - now (this project continues in IT One) A project for a very large logistics company. Data Lake based on Big Data technologies: Hadoop, Hive, Spark, Vertica, Clickhouse, Ambari, Hue, Oozie. My activities: - development of data layers (Hive SQL), creation of Hive UDF (Java), Scala unit tests for SQL scripts (using hiverunner) - Scala sql script generators (ODS/DDS), Scala DSL to describe ODS/DDS meta-data - performance optimization of individual jobs, Hive SQL performance tuning - jobs orchestration (Oozie), development of custom oozie actions (Java) - troubleshooting, incident resolution - deployment, release activities (last 3 years) - development of tools for collecting statistics on the operation of services and jobs, visualization of the work of jobs and utilization of cluster resources (Grafana) - optimization of cluster resource utilization for groups of jobs (hundreds of jobs per day) - creation of non-standard ETL streams, RDBMS -> kafka -> hadoop - meta-data (control flow, data flow), DSL to describe meta-data - unix/bash scripting 2015 - 2016 Finance project (taxation): Hadoop, Spark(Java), HBase. 2013 - 2015 Several software development projects (Java). Show less

  • Optima Soft
    • Moscow, Russia
    • Senior Software Developer
      • Jan 2007 - Sep 2013

      Integration projects. Telecom. OracleDB. BI. System/data integration, software development(Java), reports(Oracle Data Warehouse). Integration projects. Telecom. OracleDB. BI. System/data integration, software development(Java), reports(Oracle Data Warehouse).

Education

  • Krasnoyarsk State University

Community

You need to have a working account to view this content. Click here to join now