Experience

bigspark

• United Kingdom
• Software Development
• 1 - 100 Employee

• Technical Architect - Data Engineer

  • Jul 2022 - Present

  Working on re-architecting and providing solutions to critical data engineering problem. Working on re-architecting and providing solutions to critical data engineering problem.



Maveric Systems Limited

• India
• Information Technology & Services
• 700 & Above Employee

• Data Solutions Architect - Bigdata

  • Aug 2020 - Jun 2022

  Re-architected and designed complex data engineering problems related to orchestration, robust data pipeline involving large data volumes, data observability and quality. Re-architected and designed complex data engineering problems related to orchestration, robust data pipeline involving large data volumes, data observability and quality.



JPMorgan Chase & Co.

• United States
• Financial Services
• 700 & Above Employee

• Big Data Architect / Big Data Engineer

  • Aug 2015 - Aug 2020

  • Reduced time taken for impact analysis by 90% by creating an automated tool using Python, Pyspark and Hive. This tool generates data lineage between all datasets in the data lake, identifies missing job dependencies, and automatically generates information of all objects in the data lake and the association between them. • Creating underlying data for efficient Dashboarding, ETL, Data warehousing using Big Data technologies Pyspark, hive, Sqoop and Python and automation using Control-M. • Handled end to end migration from Hortonworks to Cloudera • Responsible for optimizing scripts to meet quality standards and performance. • Proven track record for providing strategic solutions and setting best practices to create and maintain Data lakes and ETL jobs in the Hadoop platform. • Closely work with Quantitative research / predictive modelling teams in an event driven setup for data needs using Pyspark, Python, Impala and tableau. • Designed and created tools for robust data quality checks in warehouse. Show less



BNP Paribas

• Investment Banking
• 1 - 100 Employee

• Sr. Developer

  • Aug 2011 - Mar 2015

  • Order management system on Sybase ASE, PowerBuilder, Shell scripting, WTX • Data Warehouse on Sybase IQ and Informatica. • DBA activities including data modelling, lower environments upgrade and performance tuning. • The System that receives a SWIFT message, processes the orders and responds with a SWIFT message for acknowledgement. • Order management system on Sybase ASE, PowerBuilder, Shell scripting, WTX • Data Warehouse on Sybase IQ and Informatica. • DBA activities including data modelling, lower environments upgrade and performance tuning. • The System that receives a SWIFT message, processes the orders and responds with a SWIFT message for acknowledgement.



Syntel

• Netherlands
• Financial Services
• 100 - 200 Employee

• Software Engineer

  • Mar 2007 - Aug 2011

  Consulted at Moody's Investor Services as a Project lead • Received accolades by senior management for being a key contributor to the success of the project. • Lead a Team of 10 • Order management on Sybase ASE and VC++ Consulted at Moody's Investor Services as a Project lead • Received accolades by senior management for being a key contributor to the success of the project. • Lead a Team of 10 • Order management on Sybase ASE and VC++