Experience

Payments Canada

• Banking
• 200 - 300 Employee

• Senior Data Engineer

  • Nov 2019 - Present

  Ottawa, Canada



Deloitte

• Business Consulting and Services
• 700 & Above Employee

• Lead Software Developer

  • Nov 2017 - Mar 2019

  Lake Mary, Florida Created Data Lake by extracting data from real-time customer actions into HDFS. Implement data ETL with Map-Reduce in Spark SQL. Build Data pipeline upon AWS EC2 with S3 and Redshift. Ingestion multiple data source and loading data into the S3 bucket. Install, deploy, update and maintenance Big Data ecosystem in EC2 instance and designed Redshift database for data science. Worked on Python and AWS S3, Redshift and used them in the project for more effective data mining and data… Show more Created Data Lake by extracting data from real-time customer actions into HDFS. Implement data ETL with Map-Reduce in Spark SQL. Build Data pipeline upon AWS EC2 with S3 and Redshift. Ingestion multiple data source and loading data into the S3 bucket. Install, deploy, update and maintenance Big Data ecosystem in EC2 instance and designed Redshift database for data science. Worked on Python and AWS S3, Redshift and used them in the project for more effective data mining and data discovery. Analyzing various dependencies, storage levels, resource tuning and memory management. Converted large sets of Informatica mappings to facilitate Informatica retirement. Show less



Tata Consultancy Services

• India
• IT Services and IT Consulting
• 700 & Above Employee

• Software Developer

  • Jan 2008 - Oct 2017

  Charlotte, North Carolina Collaborated with Business Users and Business Owners to understand their Business requirements and written technical specification and design documents. Provided technical solutions, resolved issues with deliverables, performed technical reviews and guided the team. Worked on Designing and Coding of Batch processes which load the huge data from various sources. Involved in the all the activities like testing, certifying and implementation of the data models in production. Analyze… Show more Collaborated with Business Users and Business Owners to understand their Business requirements and written technical specification and design documents. Provided technical solutions, resolved issues with deliverables, performed technical reviews and guided the team. Worked on Designing and Coding of Batch processes which load the huge data from various sources. Involved in the all the activities like testing, certifying and implementation of the data models in production. Analyze and convert existing mainframe batch processes to DataStage Coordinating with Release Management, Data Management and Configuration Management. Use of appropriate technology for the given requirement (DataStage/Teradata SQL scripting/Shell Scripting) Conducted Technical and Architectural design review of the application during development Phase. Designed and developed scalable ETL jobs as per business rules using ETL design document Designed and developed ETL processes using DataStage designer to load data from Oracle, MS SQL, Flat Files (Fixed Width) and XML files to staging database and from staging to the target Data Warehouse database. Design and implementation of Job flows using Autosys for the functionalities supported. Single point of contact for offshore to resolve internal issues. Show less