Experience

Methods

• United Kingdom
• Information Technology & Services
• 300 - 400 Employee

• Senior Consultant

  • Oct 2022 - Present

  Leeds, England, United Kingdom Working for Department of Work & Pension Client. Migrating on-premises Oracle data warehousing solution to AWS. Design and build data pipeline using AWS EMR. IAC using terraform , cloud formation.



DWP Digital

• United Kingdom
• Government Administration
• 700 & Above Employee

• Site Reliability Engineer

  • May 2022 - Oct 2022

  Leeds, England, United Kingdom Review architecture, code & align PDUs against SRE principles. Onboarding PDUs and helping them to build CI/CD pipelines



Reach plc

• United Kingdom
• Technology, Information and Media
• 700 & Above Employee

• Senior Data Engineer

  • Feb 2022 - May 2022

  Leeds, England, United Kingdom Design & Develop Enterprise Data warehouse on AWS Cloud using Redshift. Build IAC using cloud formation



DWP Digital

• United Kingdom
• Government Administration
• 700 & Above Employee

• Senior Data Engineer | Devops

  • Jul 2019 - Feb 2022

  Leeds, West Yorkshire, United Kingdom − Working for DWP(Department of Work and Pension) - Design and develop big data solutions on on-premise Hortonworks/Couldera platform using Hive, PySpark, Python. − Orchestration of Hadoop jobs using Azkaban, working on complex data structures. − Migrating on-premise big data solutions into Cloud AWS using various AWS services like EMR, RDS, DynamoDB, Lambda, QuickSight, SQS, SNS, ECS , Glue, CloudWatch, etc. − Design & Implement new data pipelines in AWS… Show more − Working for DWP(Department of Work and Pension) - Design and develop big data solutions on on-premise Hortonworks/Couldera platform using Hive, PySpark, Python. − Orchestration of Hadoop jobs using Azkaban, working on complex data structures. − Migrating on-premise big data solutions into Cloud AWS using various AWS services like EMR, RDS, DynamoDB, Lambda, QuickSight, SQS, SNS, ECS , Glue, CloudWatch, etc. − Design & Implement new data pipelines in AWS environment. − Ingestion of Kafka message into AWS platform − Document the design and best practices. − Building the EMR cluster and orchestration of various other services using Terraform , Concourse and Python APIs − Building data pipelines using CI/CD/CT tools such as Concourse and Circle CI. − Developing Infrastructure as code using Terraform. − Build Unit testing, E2E test pipelines using behave framework. − Creating epics and breaking up into simple tickets based on Requirements & design. − Performance tune the data solutions to meet agreed SLAs. − Presenting the new solutions and POC results to the wider team resulting in agreeable design. − Organise and present the knowledge transfer sessions to the team members − Actively participate in the Data & Analytics Monthly meet-ups and present new ideas and POCs. Technologies: Pyspark, Python, Kafka, Terraform, Concourse, Circle CI, various AWS services, HDFS, Hadoop, Hive, Hbase, Azkaban , GIT, Apache NiFi Platform : AWS, Hortonworks/Couldera Show less



Computershare UK

• United Kingdom
• Financial Services
• 700 & Above Employee

• MI/BI Consultant

  • Sep 2018 - Jun 2019

  Crossflats Design & Develop solutions on Microsoft Platform using SSRS and SQL servers. Unit testing the code developed and supporting the path to Live Requirement Gathering from various stakeholders and document the design



Yorkshire Building Society

• United Kingdom
• Financial Services
• 700 & Above Employee

• ETL Consultant

  • Oct 2015 - Aug 2018

  Leeds, United Kingdom − Development of ETLs, Data Marts, Extracts, Reports of Data-warehouse. Analysed & processed complex data sets. − Define Best practices and coding standards document. − Provide high-level feedback and feasibility effort required to technically achieve a business objective, and work with the Programme Manager and Practice Lead. − Identify and manage technical risk, and lead any activities mitigating those risks. − Performing a lead technical role with internal and external delivery… Show more − Development of ETLs, Data Marts, Extracts, Reports of Data-warehouse. Analysed & processed complex data sets. − Define Best practices and coding standards document. − Provide high-level feedback and feasibility effort required to technically achieve a business objective, and work with the Programme Manager and Practice Lead. − Identify and manage technical risk, and lead any activities mitigating those risks. − Performing a lead technical role with internal and external delivery teams to ensure timely delivery of coherent solutions. − Provide input to the test planning process and ensure that solutions are both functionally and non-functionally testable. − Work with 3rd parties to understand their capabilities and limitations and to design robust functional integrations that meet the business and technical requirements − Understand the development, testing and production environments and the processes that support these. − Understand, refine and agree the non-functional requirements needed for solutions, and ensure that we are able to test those requirements have been met as part of the delivery. − Provide advice, guidance and arbitrate between internal and external delivery teams to ensure that solutions comply with the high level design. − Govern delivery by acting as the design authority during design/build/release, making sure that all areas have been considered (e.g., functional, non-functional, security/compliance, etc.) and design documentation exists and is accurate. Show less



Virgin Money

• United Kingdom
• Financial Services
• 700 & Above Employee

• Oracle ETL / DWH Consultant

  • Aug 2015 - Oct 2015

  Newcastle upon Tyne, United Kingdom Develop complex PLSQL, OWB Mappings, process flows, OMB+ scripting to deploy OWB mappings and process flows, Unix Shell scripting. Provide Impact analysis, estimation. Requirement gathering, Impact analysis, Data Modelling and ETL design for the new requirements. Data Profiling, dimensional Modelling (SCD Type 1, SCD Type 2, SCD Type 3 and Hybrid dimensions, Facts).



NHS Digital

• United Kingdom
• Hospitals and Health Care
• 700 & Above Employee

• Mastek - Data Warehouse/ETL/BI Software Specalist

  • May 2014 - Aug 2015

  Leeds, United Kingdom



Morrisons

• United Kingdom
• Retail
• 700 & Above Employee

• Mastek - Data Warehouse / ETL Designer

  • Mar 2013 - May 2014

  Bradford, United Kingdom Develop PLSQL packages, procedures, functions, loading of XML files and Unix Shell scripting Working on OBIEE repository (Business Model, mapping Layer) development. Building the reports, dashboards in OBIEE 11g. Migration of the data from SQL server/Oracle legacy system to new data warehouse by creation procedure, packages. Providing the Impact analysis and estimation for new requirements and change controls within the project. Performance tuning of the code. Requirements… Show more Develop PLSQL packages, procedures, functions, loading of XML files and Unix Shell scripting Working on OBIEE repository (Business Model, mapping Layer) development. Building the reports, dashboards in OBIEE 11g. Migration of the data from SQL server/Oracle legacy system to new data warehouse by creation procedure, packages. Providing the Impact analysis and estimation for new requirements and change controls within the project. Performance tuning of the code. Requirements gathering, ETL design and development using ODI (Oracle data integrator) tool, Oracle 11g to provide extracts for RPAS tool using SFTS mechanism from Data warehouse. Preparation of Design and other release documents. Show less



BT Group

• United Kingdom
• Telecommunications
• 700 & Above Employee

• Mastek - Datawarehouse Sr Software Engg

  • Feb 2010 - Mar 2013

  Leeds, United Kingdom − Development, Requirements gathering, Low level design, dimensional modelling, POCs, Performance tuning, Data migration, automated deployment. − Involved in Data Profiling, Define the granularity, dimensional Modelling (SCD Type 1, SCD Type 2, SCD Type 3 and Hybrid dimensions, Facts). − Design Star & Snow Flake schema. Building Data Marts, materialized Views. − Universe design and development of reports in Business Objects XIR2 and crystal reports. − Preparation of design and… Show more − Development, Requirements gathering, Low level design, dimensional modelling, POCs, Performance tuning, Data migration, automated deployment. − Involved in Data Profiling, Define the granularity, dimensional Modelling (SCD Type 1, SCD Type 2, SCD Type 3 and Hybrid dimensions, Facts). − Design Star & Snow Flake schema. Building Data Marts, materialized Views. − Universe design and development of reports in Business Objects XIR2 and crystal reports. − Preparation of design and release documents. Providing the Impact analysis and estimation for new requirements and change controls within the project. − Knowledge sharing to stake holders by presenting POCs appropriately. − Conducting the induction program to new joinees to provide project details. − Review the developed code, UTP and Component Deployment Guide document. − Offshore coordinator as being a module owner. − Support for Integration testing, Non-functional testing and production support. − Communicating the requirements and agreed design to the offshore team − Performance tuning, usage of Hints, TKPROF, AWR reports. − Prepare the Component Design Specification Document that includes sequence diagram, class diagram and flow of the use case and other release documents. − Involved in development of prototypes and POCs for different functionalities for different modules. Ensuring that all requests for support are dealt with according to set standards and procedures. Show less



Mastek

• United Kingdom
• IT Services and IT Consulting
• 700 & Above Employee

• Developer

  • Aug 2007 - Jan 2010

  Mumbai Area, India