Experience

O2F INFO SOLUTIONS PRIVATE LIMITED

• India
• IT Services and IT Consulting
• 200 - 300 Employee

• Azure Data Engineer

  • Sep 2022 - Present

  Project Title: Data platform Migration to Azure Environment: Azure Data Bricks, PySpark, AzureDatafactory, Python, Azure DevOps Client: UNITED OF AUTOMOBILE ASSOSIATION. Description: This project focuses on migrating the on-premises Enterprise Data Warehouse to Cloud using Microsoft Azure technologies. It will include rewriting the whole solution using Azure technol-ogies, migrating all the data from various disparate legacy source systems, interacting with Business getting and finalizing business requirements and finally integrating and testing the whole solution.  Strong development skills on Azure Data Lake, Azure Data Factory, Azure Data-bricks.  Experience managing Big Data platform deployed in Azure Cloud.  Having knowledge on OLTP and OLAP using Azure Data factory and Databricks to Data Lake.  Experience in Managing and storing confidential credential in Azure Key vault.  Good experience in Python code for data loads, extracts, in Azure Databricks.  Implemented multiple activities and custom Pipelines in Azure Data Factory for On- cloud ETL processing.  Experience in integrating Hive queries into Spark environment using Spark SQL.  Hands-on experience in using Transformation ETL techniques to extract the data from external repositories and Internal sources.  Profound Knowledge on cloud Confidential like Azure Services  Capable of working in new technologies with a minimum learning curve.  Hands-on experience in python programming and Spark components like Spark- core and Spark-SQL  Worked on creating the RDDs, Data Frames for the required input data and per-formed the data transformations using Spark-core.  Having good analytical, problem solving and communication skills. Show less



InfoCepts

• United States
• Business Consulting and Services
• 700 & Above Employee

• Senior Data Analyst

  • Sep 2021 - Aug 2022

  Project Title: Data platform Migration to Azure Client: Lutron Electricals Description: Lutron was also the first to successfully mass-market the dimmer, the first to successfully mar-ket systems of linked dimmers, and is still the only company to create systems of dimmers and motorized window shades that control both electric light and daylight. In almost 50 years of innovation, Lutron has invented hundreds of lighting control devices and systems, and expanded their product offering from 2 products to 15,000. The company has ad-vanced the technology of lighting control while maintaining top market position by focusing on exceptional quality and design. Lutron continues to lead the market in high-quality lighting controls for fluorescent, halogen incandescent, magnetic low-voltage, electronic low-voltage and LED light sources. RESPONSIBILITIES:  Map source system data elements to target system and develop, test, and support extrac-tion, transformation, and load processes.  Handling the data ingestion from the different source systems like blob, Adls, Rest-Api, SQL Server.  Worked on using spark Data Frame API to complete Data manipulation within spark ses-sion.  Creating Data frames and summarize the data into partitions.  Inside the notebooks we can write transformation logic by using PySpark and schedule that notebooks for execution.  Developed the spark code to process the parquet files and dumped delta table to delta lake.  Created Azure Databricks Notebooks to process data from ADLS and to apply various data transformations.  Resolving defects/bugs, environmental issues during QA testing, pre-production, and pro-duction.  Hands on experience on developing Spark- SQL queries in creating temporary tables.  Scheduling by using workflows in data bricks  Processing the data as per the business logic using PySpark in Databricks Environments. Show less



Vodafone Idea Limited

• India
• Telecommunications
• 700 & Above Employee

• SOFTWERE ENGINEER

  • Feb 2019 - Aug 2021

   Design and Implemented DataStage jobs to transfer the data from source to staging area and then to Data warehouse.  Used DataStage Designer & DataStage Director for creating and implementing jobs.  Used Import and Export in Designer Client for importing the source and target database schemas, importing, and exporting jobs/projects.  Extracted data from various sources, transformed according to the requirement and loaded into data warehouse schema using various stages like sequential file, Aggregator, Transformer stage  Participated in all phases including Requirement Analysis, Design, Coding, Testing, Support and Documentation  Creating various jobs using stages like Joiner, Transformer, filter, Lookup, Change Capture, Funnel, Copy and Aggregator etc.  Created Unit Test cases and integration test cases and captured the results for the same.  Actively participated in the team meetings in day today calls, meeting reviews, status calls, design reviews, etc.,  Developed Jobs in IBM Web sphere DataStage and Quality Stage for loading data from source to target. Show less



RBC Royal Bank Of Canada

• Software Engineer

  • Dec 2017 - Jan 2019

  • Developing and Maintaining ETL jobs. • Monitoring the control-m Jobs and changes from DataStage jobs as per client requirement modified the UAT and OAT Production issues fix. • Daily Basis we must check UAT, and OAT Production files Received as certain Timestamp in Putty. • Modified the DataStage Jobs Scheduling timings and raise to change order permission from Production Team As per client requirement. • Once we made changes in control-m jobs then review by Technical Lead after take backup push into the quality gate for deployment. • Extensively involving in daily scrum meetings with client, Business team and analysts. Show less


Khotot Altawen For Contracting & Trading Est
• Khotot Altawen For Contracting & Trading Est

  • Oct 2015 - Feb 2017

sri chennakesava constructions
• sri chennakesava constructions

  • Feb 2012 - Jul 2015


Teamlease Services Limited

• India
• Staffing and Recruiting
• 700 & Above Employee

• Sds technical supporter

  • Feb 2011 - Dec 2011

   Configuration of SQL Server 2005 and 2008 completely installation.  Configure of Dot net frame work 2.0 completely installation.  Create SQL Server 2005,2008 user name and password.  Configuration of upload new DB and Data base backup, Restore.  Ability to configure and troubleshooting SQL Server.  Configuration of SDS Nestle software, troubleshooting completely installation.  Configuration of Nesvision software and completely installation.  Configure mobile android Nesvision application, and link to the sds mobile end user billing process.  Primarily Responsible for client tickets understanding the issues, providing right information and resolution.  End user issues resolve to be used Team viewer and log me in online.  Work on the tickets and resolve them with the right technical resources  Update IT Access and Help Desk immediately after every call. Show less