Niroshan Wickramasinghe, PhD

Senior Data Engineer at NCS Group Australia
  • Claim this Profile
Online Presence
Contact Information
Location
Greater Melbourne Area, AU

Topline Score

Bio

Generated by
Topline AI

5.0

/5.0
/ Based on 1 ratings
  • (1)
  • (0)
  • (0)
  • (0)
  • (0)

Filter reviews by:

You need to have a working account to view this content. Click here to join now
Lucio Cunha Tinoco

Bhagya entered our team with the very challenging task of supporting a legacy C++ codebase used by a lot of challenging customers with very high support expectations. Simply said, Bhagya´s tenacity and drive exceeded everyone´s expectations. After a few weeks on the job, everyone on the team felt reassured and confident, which was a primary factor to making the whole project a big success.

0

/5.0
/ Based on 0 ratings
  • (0)
  • (0)
  • (0)
  • (0)
  • (0)

Filter reviews by:

No reviews to display There are currently no reviews available.
You need to have a working account to view this content. Click here to join now

Credentials

  • Data Science: Machine Learning
    HarvardX - An Online Learning Initiative by Harvard University through edX
    Mar, 2020
    - Sep, 2024

Experience

    • Australia
    • IT Services and IT Consulting
    • 100 - 200 Employee
    • Senior Data Engineer
      • Mar 2022 - Present

      The Salvation Army AUGUST 2022 – CURRENT Designed and mentored developing a reusable metadata driven ETL Framework that ingested data from source systems to landing, staging, data vault and data mart layers using Azure Synapse Pipeline/ADF. This was a greenfield project. • Lead the development of the ETL Framework and its orchestration with Synapse Pipelines • Ingestion layer supports REST API, SFTP and ADLS storages with the ability to extend to other methods. • Developed staging pattern, automated data validation and issue reporting mechanisms that were used across the project. • Developed data vault hub, link and satellite loading patterns. • Developed fact tables loading pattern in the data mart layer for “as was” presentation of the data. • Advocated and established Git and CICD processes within the project. • Mentored junior data engineers to establish engineering practices like naming conventions to deliver project objectives. • Managed stakeholder expectations to achieve project objectives. • Tech stack includes Azure Synapse pipelines, SQL, Azure DevOps, GIT and Python Department of Environment, Land, Water and Planning MARCH – AUGUST 2022 Worked with DELWP to migrate the on prem ETL system on to Azure cloud. On prem system used SSIS packages and they were migrated on to ADF and SQL Managed Instances. • Developed ADF data pipelines to execute SSIS packages • The sensitive information and the variables that change across different environments (dev, UAT and prod) were stored in Azure Key Vault. • Developed a notification framework using Azure Event Grid, which enabled triggering additional ADF pipelines upon successful completion of a given pipeline. Show less

    • Australia
    • IT Services and IT Consulting
    • 300 - 400 Employee
    • Senior Data Engineer
      • Nov 2020 - Mar 2022

      Developing COVID-19 reporting platform for the Victorian Centre for Data Insights, the data analytics arm of the Department of Premier and Cabinet, Victoria Developing COVID-19 reporting platform for the Victorian Centre for Data Insights, the data analytics arm of the Department of Premier and Cabinet, Victoria

    • Australia
    • Mental Health Care
    • Co-Founder
      • May 2020 - Jan 2021

      Using smart home technology to assist mental health patients Using smart home technology to assist mental health patients

    • Australia
    • Higher Education
    • 700 & Above Employee
    • PHD Candidate
      • Feb 2014 - Feb 2020

      Research topic: Merging data from different sources to generate synthetic agent populations.The research explores novel methods to construct synthetic human populations by fusing marginal data distributions from different sources, like census data. The work:• Reconstructs the information lost during the data collection process. For example, family andhousehold structures in census data.• Merges existing populations that contain partial information to construct new populations with complete information.• Proposes suitable statistical tests for comparing very large categorical distributions consistingcategories of varying sizes, by doing a detailed analysis of test behaviours under different conditions.• Algorithm development included efficient memory usage, dynamic programming, Monte-Carlo simulation and optimisation techniques to deal with exponentially growing solution space.• The word advances agent based modelling and simulation technology by providing reliable methods to generate highly detailed agent populations. Show less

    • Research Assistant (Software Engineer)
      • Feb 2018 - Jun 2018

      Generating a synthetic population for Melbourne using Australian census data for urban planning applications.• Productionalized a population generation algorithm developed as a part of my PhD research with Java, Maven and Travis CI• Pre-processing data and statistical validations with R• The algorithm generates arguably the most detailed synthetic population available for Australia• The work is available at github.com/agentsoz/synthetic-population.

    • Australia
    • Government Administration
    • 500 - 600 Employee
    • Data Engineer
      • Jul 2018 - Jan 2019

      Provided consultancy services to research and develop an interactive data visualisation tool for water-quality-data published on Victorian Government's Yarra&Bay website. • Investigating effective visualisations to accurately communicate scientific information to the general public • Investigating suitable technologies to implement the identified visualisations • Developing a program to collect and processes data from different sources using Python and JSON • Developing interactive web visualisations with Python and GIS libraries • Providing technical thought leadership to the team on future scientific information communications Show less

    • Australia
    • Real Estate
    • 1 - 100 Employee
    • Machine Learning Engineer
      • Oct 2017 - Jan 2018

      Developed an NLP system for a chatbot of an automated strata management system. Responsibilities included: • Implementing text input processing understand the requirement and generating responses with Python and NLTK • Developing mobile interface of the chatbot • Developing webservices with Django, RESTful web services and system database with SQL Server Developed an NLP system for a chatbot of an automated strata management system. Responsibilities included: • Implementing text input processing understand the requirement and generating responses with Python and NLTK • Developing mobile interface of the chatbot • Developing webservices with Django, RESTful web services and system database with SQL Server

    • United States
    • Mental Health Care
    • Data Engineer
      • Apr 2017 - Aug 2017

      The company provides intelligent marketing data analytics to small business owners via a Slack Bot. My responsibilities included: • Extracting client web traffic information using GoogleAnalytics API and storing them using MongoDB • Extracting insights from the data • Identifying suitable visualisations to communicate the identified insights • Developing a web portal and backend services for user sign-up with HTML, CSS, JQuery, Python Flask and AWS EC2 • Communicating insights via Slack API Show less

    • United Kingdom
    • Software Development
    • 700 & Above Employee
    • Software Engineer
      • Jun 2013 - Dec 2013

      Worked as a Java developer on Codegen's flagship product, Travelbox. My responsibilities included: • Developed and maintained TravelBox Java Web Services and Hibernate • Used Oracle 11g RDBMS for managing data • Developed and maintained desktop user interfaces using HTML, CSS and JavaScript • Used Agile development practices and GIT • Liaised with customers to provide new features and resolve software issues. Worked as a Java developer on Codegen's flagship product, Travelbox. My responsibilities included: • Developed and maintained TravelBox Java Web Services and Hibernate • Used Oracle 11g RDBMS for managing data • Developed and maintained desktop user interfaces using HTML, CSS and JavaScript • Used Agile development practices and GIT • Liaised with customers to provide new features and resolve software issues.

    • Software Engineer (SDE I)
      • Sep 2011 - Jun 2013

      Worked with Microsoft SharePoint Search Foundation’s Document Parsing team as a C++ engineer. I was responsible for: • Developed Office Filter Pack 2.0/3.0 (Ifilters) component • Developed and maintained parsers for XML based document formats (docx, xlsx and pptx) in Microsoft SharePoint Search Foundation • Maintained the filter for HTML documents • Proposed a new architecture to double the performance of Office Open Xml Format based parsers. The new design allows for implementing new parsers quickly and easily. Show less

    • Research Assistant (Internship)
      • Apr 2010 - Sep 2010

      I worked on a Mobile Facial Recognition System that could be deployed in handheld mobile phones • Designed and proposed a refinement algorithm to improve the accuracy of matched feature points • My responsibilities included; - Developing feature extraction algorithm (C++) - Developing facial recognition algorithm (C++) - Implementing server side processes (PHP) I worked on a Mobile Facial Recognition System that could be deployed in handheld mobile phones • Designed and proposed a refinement algorithm to improve the accuracy of matched feature points • My responsibilities included; - Developing feature extraction algorithm (C++) - Developing facial recognition algorithm (C++) - Implementing server side processes (PHP)

Education

  • RMIT University
    Doctor of Philosophy - PhD, Computer Science
    2014 - 2019
  • University of Colombo
    Bachelor of Science (B.Sc.), Computer Science
    2007 - 2011
  • Ananda College, Sri Lanka
    Mathematics
    1997 - 2006

Community

You need to have a working account to view this content. Click here to join now