Senior Data Engineer

• Apr 2021 - Present

Technology Lead - Data Engineer

• Oct 2020 - Aug 2021

• Extract Transform and Load data from Source Systems to Azure Data Storage services using a combination of Azure Data Factory, Hive DB, SQL and Azure Data Lake Analytics, and processing the data in Azure Databricks. • Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform and load data to different containers like Azure SQL, Blob storage, Azure Hive DB. • Responsible for high level deliverables which include development of a project from scratch and touch base on all Microsoft services such as SSIS, SSRS, SQL Server, SSAS and Power BI • Involved heavily in designing Data warehouse to fit in the ongoing requirements. • Created Azure Analysis Services Models with designing and creating various calculated measures using DAX. • Created interactive dashboards using Power BI which included various sources such as SQL, SSAS Tabular Models, Azure Analysis Services and Excel. • Working on Azure Synapse to work with all kinds of data like files, tables, database etc. • Working in an Agile environment with deliverables in every sprint using TFS for source control mechanism.

Software Specialist

• Apr 2017 - Mar 2020

• Extract Transform and Load data from Source Systems to Azure Data Storage services using a combination of Azure Data Factory, SQL, Azure Data Lake Analytics and Cosmos DB and processing the data in Azure Databricks. • Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse and Cosmos DB. • Responsible for high level deliverables which include development of a project from scratch and touch base on all Microsoft services such as SSIS, SSRS, SQL Server, SSAS and Power BI • Involved heavily in designing Data warehouse to fit in the ongoing requirements. • Responsible for creating SSIS models to pull data from various sources such as Cognos, APIs, Flat files, Excels, Other Datawarehouse. • Created SSAS Tabular Models with designing and creating various calculated measures using DAX. • Created interactive dashboards using Power BI which included various sources such as SQL, SSAS Tabular Model, and Excel. • Working in an Agile environment with deliverables in every sprint using TFS for source control mechanism.

Software Engineer

• Feb 2015 - Mar 2017

• Design and develop SSIS packages, store procedures and tables and implement best practices to maintain optimal performance • Created the dataflow using transformations like Derived Column, Union All, Conditional Split, Multicast, and Lookup • Used Control Flow Tasks like Execute SQL, File System, send mail, Dataflow Task, Execute Process Task and Execute package Task • Involved in unit testing • Performed performance tuning in code by implementing a number of methods. • Design and develop SSIS packages, store procedures and tables and implement best practices to maintain optimal performance • Created the dataflow using transformations like Derived Column, Union All, Conditional Split, Multicast, and Lookup • Used Control Flow Tasks like Execute SQL, File System, send mail, Dataflow Task, Execute Process Task and Execute package Task • Involved in unit testing • Performed performance tuning in code by implementing a number of methods.

Software Engineer

• Oct 2012 - Jan 2015

• Design and develop SSIS packages, store procedures and tables, views, and implement best practices to maintain optimal performance • Created the dataflow using transformations like Derived Column, Union All, Conditional Split, Multicast, Script Component and Lookup • Used Control Flow Tasks like Execute SQL, File System, send mail, Dataflow Task, Execute Process Task and Execute package Task • Developed reports as per the business requirements using SSRS and languages such as SQL and MDX. • Involved in unit testing • Performed performance tuning in code by implementing a number of methods • Created Tabular, Cross tab, chart, Matrix reports using SSRS • Performed impact analysis for various enhancement requests to find out the programs that could be potentially affected by proposed change(s)