Dinesh Sandaruwan

Data Engineer II at Circles.Life
  • Claim this Profile
Contact Information
us****@****om
(386) 825-5501
Location
Hambantota District, Southern Province, Sri Lanka, LK

Topline Score

Topline score feature will be out soon.

Bio

Generated by
Topline AI

You need to have a working account to view this content.
Join now
You need to have a working account to view this content.
Join now

Credentials

  • Scala & Functional Programming for Beginners | Rock the JVM
    Udemy
    Apr, 2020
    - Nov, 2024
  • Certified OKR Professional
    Profit.co

Experience

  • Circles
    • Software Development
    • 400 - 500 Employee
    • Data Engineer II
      • May 2022 - Present

      ❖ Developed an infrastructure automation product that is highly configurable and supports deployment on GCP, AWS, and on-premises environments. The product was developed using Python and leverages the Pulumi framework to provide a flexible and powerful platform for infrastructure management. ❖ Implemented a Client-Side Encryption (CSE) mechanism to encrypt the data before loading it into Snowflake, one of our cloud-based data warehousing solution. ❖ Designed and implemented ELT pipelines for various business use cases. ❖ Actively participated in on-call support, demonstrating my commitment to resolving issues and ensuring the stability and reliability of our systems. I have been proactive in troubleshooting and resolving incidents promptly, minimizing downtime and ensuring business continuity. ❖ Provisioned our own MinIo setup on Kubernetes (instead of relying on a third-party cloud solution), which offers a more reliable storage infrastructure. This provisioning has not only increased our control and autonomy over our data but also improved the reliability and availability of our storage resources. ❖ Involved in implementing an on-premises data warehouse on Kubernetes using Trino, MinIO, and Hive Metastore service. ❖ Involved in enabling data masking and access control features for an on-premises data warehouse solution using Apache Ranger ❖ Supported the team in migrating BigQuery and Apache spark pipelines to run on the Trino query engine. ❖ Implemented a microservice template using the Play Framework. This template serves as a standardized starting point for developing microservices, incorporating best practices and essential functionalities. ❖ Built a CI/CD pipeline to facilitate the building of custom Docker images required for our service deployments on Kubernetes. It enabled the team to create and push custom images quickly and reliably into Docker registry Show less

  • PickMe
    • Sri Lanka
    • Information Technology & Services
    • 300 - 400 Employee
    • Associate Tech lead | Data Team
      • Dec 2021 - May 2022

      ❖ As the technical owner for the Data team, I provided technical leadership and guidance to a team of data engineers, enabling them to successfully deliver data-driven solutions that aligned with key business objectives❖ Followed the agile practices, including daily standups, sprint planning, and sprint retrospectives.

    • Senior Software Engineer | Data Team
      • Jul 2021 - Dec 2021

      ❖ Big Data and Data Science Stack migration from Azure HDInsight to GCP Dataproc

    • Software Engineer | Data Team
      • Aug 2019 - Jul 2021

      ❖ Big Data and Data Science Stack migration to Azure HDInsight ✓ Understanding of Hadoop and Spark Architecture ✓ Experience in exporting data from MySQL to HDFS using Sqoop ✓ Experience in designing and developing Hive database structures ✓ Experience in writing spark application using Scala and python ✓ Experience in building real-time data pipeline using spark streaming ✓ Experience in writing shell scripts ✓ Experience in installing and configuring Azkaban workflow manager ✓ Experience in developing Azkaban workflows using LinkedIn’s Gradle DSL for Hadoop❖ Recommended location API implementation ✓ Experience in designing tables in HBase ✓ Experience in developing micro services using Play Framework❖ Delivery Time Prediction model deployment ✓ Developed API using Java and which communicate with the python model wrapper (Inter process communication)❖ Geo Address Search Engine Implementation ✓ Implemented a method to give an address for each geo regions using historical geo data Show less

    • Associate Software Engineer | Data Team
      • Feb 2019 - Jul 2019

      ❖ Travel Time Prediction model implementation and deployment ✓ Experience in data preprocessing, analyzing, cleaning, visualizing and model building using python ✓ Experience in deploying ML models with Flask (POC) ✓ Experience in profiling of python programs using cProfile ✓ Experience in monitoring services using Prometheus and Grafana

  • V S Information Systems (Pvt) Ltd
    • Sri Lanka
    • IT Services and IT Consulting
    • 100 - 200 Employee
    • Network System Engineer
      • Jun 2017 - Dec 2017

      ❖ Firewall Migration Project at Dialog Data center ✓ Hands-on experience working with Cisco ASA 5525 & ASA 5508 Firewall and Cisco 2960 -X switch. ❖ Network Management Software Installation Project (Internal Project) ✓ Experience in installing Network monitoring system (PRTG NMS) ❖ ELV Project at Farmchemi (Pvt) Ltd (Homagama, Sri Lanka) ✓ Experience in designing a network and configuring of UNV IP cameras, Cisco 1800 series access points and Cisco 2960 & 3850 switches Show less

Education

  • University of Moratuwa
    MSc in Computer Science Specializing in Data Science Engineering and Analytics
    2020 - 2022
  • University of Moratuwa
    Bachelor of Science (B.Sc.) (Hons), Electronic and Telecommunication Engineering
    2014 - 2018
  • Walasmulla National School
    G.C.E A/L(Maths Stream)-3A, D.R- 2, I.R-61 ; G.C.E O/L-7A
    2004 - 2012

Community

You need to have a working account to view this content. Click here to join now