Experience

Guardant Health

• United States
• Biotechnology Research
• 700 & Above Employee

• Solution Architect - Platform Engineering (Data)

  • May 2021 - Present

  Toronto, Ontario, Canada Accomplishments ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ✔ Built the Data Platform connecting 25 Data sources and more than 50 derived data sets which is used in 300+ reports and dashboards driving critical business decisions. ✔ Drive the architecture vision for the Data Platform. Architected customized Data Mesh solution for the organization. ✔ Built a 7-member team of Data Engineers, ML Engineers, and DevOps for the Platform Engineering squad ✔ Build reusable components of infra and code… Show more Accomplishments ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ✔ Built the Data Platform connecting 25 Data sources and more than 50 derived data sets which is used in 300+ reports and dashboards driving critical business decisions. ✔ Drive the architecture vision for the Data Platform. Architected customized Data Mesh solution for the organization. ✔ Built a 7-member team of Data Engineers, ML Engineers, and DevOps for the Platform Engineering squad ✔ Build reusable components of infra and code, enabling Data-centric teams to focus more on data and less on infra & code. ✔ Work closely with the security team to ensure all the compliance and security issues are resolved. ✔ Work with multiple technology partners – AWS, Tableau, Okta, and Jira to align our roadmaps with theirs. ✔ Evaluate different products available in the market and drive build vs buy decisions. ✔ Implemented a fully automated release process with automated release documentation. ✔ Drive team towards craftsmanship practices with CI/CD, GitOps, IaC, and no-touch deployments. ✔ Standardized project intake process, incident management, change management and release management using JIRA. Show less



Neurabytes

• India
• Information Technology & Services

• Data Engineer - Consultant

  • Jan 2021 - Present

  Patiala, Punjab, India I work as a technical advisor and content writer for Neurabytes. My role includes volunteer work in the domain of ✔ Data Engineering ✔ Cloud Engineering ✔ MLOps ✔ ModelOps ✔ AWS Technology Stack ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ● Scala, Python ● Apache Spark, Apache Flink, Apache Kafka ● PowerShell ● Terraform, Dockers, Jenkins ● Amazon S3, Lambda, Glue, MSK ● Hadoop, Yarn



Prudential Financial

• United States
• Financial Services
• 700 & Above Employee

• Big Data & ML Solution Engineer - Sr. Specialist

  • Jul 2019 - Apr 2021

  Letterkenny, County Donegal, Ireland I worked as technical lead for Automated Underwriting Engine based on ensembled machine learning models. It is Prudential's first ML solution on AWS Cloud. My biggest contribution was to transition a POC gone production system to a stable, operationalized production system. Accomplishments ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ✔ Have managed a 6-member team from 4 different cities (New York, Chennai, Letterkenny, California) ✔ Refactored the legacy codebase and achieved a 95% reduction in… Show more I worked as technical lead for Automated Underwriting Engine based on ensembled machine learning models. It is Prudential's first ML solution on AWS Cloud. My biggest contribution was to transition a POC gone production system to a stable, operationalized production system. Accomplishments ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ✔ Have managed a 6-member team from 4 different cities (New York, Chennai, Letterkenny, California) ✔ Refactored the legacy codebase and achieved a 95% reduction in production outages. ✔ Operationalized and maintained ML Models for Predictive system handling transactions worth millions. ✔ Implemented best architectural practices, deployment automation - CI/CD pipelines, unit test cases, automated functional testing using in-house data creation framework resulting in more than 100 bug fixes ✔ Architected Click Stream Data Ingestion using AWS Kinesis to queue and AWS Firehose to dump the data in S3. ✔ Drove initiative to standardized Jira boards and agile practices resulting in an increase of adoption rate by 3 times. Technology Stack ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ● Scala, Python ● Apache Kafka, Apache Spark ● Amazon S3, Amazon EMR ● Hadoop, Yarn Projects Details ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ➢ Refactored one of the largest codebases with more than 200 rules and 5 ML models. ➢ Reduced the processing time from 15 minutes to 1 second by utilizing Apache Spark Structured Streaming. ➢ Maintained the on-prem Hadoop infrastructure based Spark App and migrated it to AWS EMR

• Big Data Solution Engineer - Specialist

  • Jan 2018 - Jun 2019

  Letterkenny, County Donegal, Ireland Technology Stack ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ● Scala, Python ● Apache Kafka, Apache Spark ● Amazon S3, Amazon EMR ● Hadoop, Yarn



Times Internet

• India
• Technology, Information and Internet
• 700 & Above Employee

• Senior Data & ML Engineer

  • Dec 2016 - Dec 2017

  Noida, Uttar Pradesh, India Accomplishments ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ✔ Increased the bookings by 2% by developing Recommendation Engine using Spark, Kafka, EMR, Glue, Athena ✔ Increased Session duration by 7% by implementing widgets like “You Make Also Like”, “Similar Restaurants”, “Weekly Top 5 Bars/Clubs”, “Trending Restaurants Now”, “Real-time display of the number of Views in last n Minutes” ✔ Introduced Data Engineering practices using AWS EMR, AWS Kinesis, and Scala-based Spark Jobs resulting in better… Show more Accomplishments ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ✔ Increased the bookings by 2% by developing Recommendation Engine using Spark, Kafka, EMR, Glue, Athena ✔ Increased Session duration by 7% by implementing widgets like “You Make Also Like”, “Similar Restaurants”, “Weekly Top 5 Bars/Clubs”, “Trending Restaurants Now”, “Real-time display of the number of Views in last n Minutes” ✔ Introduced Data Engineering practices using AWS EMR, AWS Kinesis, and Scala-based Spark Jobs resulting in better Click Stream Data Ingestion, Change Data Capture, Data Analytics Dashboard using Zeppelin & QuickSight ✔ Owned the Search & ELK Stack – Including Auto-Suggestion widget, Search Result Page, real-time logging system. Technology Stack ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ● Java, Scala ● Redis, Hadoop, Yarn ● Apache Spark, Apache Kafka, Apache Solr ● Amazon S3, QuickSight, Athena ● Elasticsearch, Logstash, Kibana DATA INGESTER ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ➢ Developed SDK with collaborating with Android and IOS team, to push the events to our system. ➢ Architect a High availability Click Event Processing System for handling 1000 click events per Second and save them in S3. ➢ Configured and maintained AWS EMR for Spark running jobs. DATA PROCESSOR JOBS ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ➢ Developed ‘Weekly Top Restaurants Aggregation Job’ to create most views restaurant Spring REST API. ➢ Developed ‘Recommendation API’ using Spark and Solr based on Spring REST API. ➢ Developed REST API for ‘Number of views in last 15 mins’, ‘Number of searches in last 15 mins’ aggregations' jobs using spark and Redis as Storage with Java API for the front end. ➢ Developed Suggested Searches API from Using Spark and Apache Solr. ➢ Integrated ELK stack with Streaming Job to see real-time aggregations of the data which can be viewed on Kibana Dashboard. ➢ Configured Zeppelin to create Notebooks for Analytics.

• Data Engineer in Search

  • Oct 2015 - Dec 2016

  Noida Area, India RECOMMENDATION AS SERVICE ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ Generation of personalized recommendations based on collaborative filtering & item-item similarity using implicit behavior of diner captured in the form of restaurant views and booking history on Dineout - an online table reservation platform. ➢ Spark Job for retrieving restaurant features for restaurant similarity ➢ Youmaylike API to retrieve recommended restaurants based on the diner's booking history. ➢ Similar API for… Show more RECOMMENDATION AS SERVICE ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ Generation of personalized recommendations based on collaborative filtering & item-item similarity using implicit behavior of diner captured in the form of restaurant views and booking history on Dineout - an online table reservation platform. ➢ Spark Job for retrieving restaurant features for restaurant similarity ➢ Youmaylike API to retrieve recommended restaurants based on the diner's booking history. ➢ Similar API for recommending restaurants on the basis of diner's last booking based on restaurant features obtained from the item-item similarity and Euclidean distance. SOLR SERVICE ¯¯¯¯¯¯¯¯¯¯¯¯¯¯ Key Focus area: ➢ Requirement Gathering/Analysis/Design ➢ Ownership - Search Stack & REST API ➢ Auto-suggestions & SRP ➢ Search Relevancy ELK SETUP ¯¯¯¯¯¯¯¯¯¯¯ ➢ Setup of real-time centralized Logging system to explore & visualize user search behavior through dashboards. ➢ It also helps in driving key business decisions, identifying real-time trends, and optimizing products on the whole. Technology Stack ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ● Apache Spark - MLlib ● Spring MVC, Tomcat ● Apache Solr, MySQL ● Git, Maven



PocketLawyer.com

• India
• Legal Services

• Principal Technical Consultant

  • Jun 2016 - Nov 2017

  Noida Area, India Started working as the technical advisor and slowly moved to the role of Principal Solutions Architect. As this was an early startup my responsibilities including various items from architecting to development and maintenance. ✔ Architecting and designing the backend services ✔ Development of backend APIs. ✔ Designing the frontend system ✔ Co-ordinating various changes done in frontend and backend. ✔ Code Review and deployments ✔ Automation of repetitive… Show more Started working as the technical advisor and slowly moved to the role of Principal Solutions Architect. As this was an early startup my responsibilities including various items from architecting to development and maintenance. ✔ Architecting and designing the backend services ✔ Development of backend APIs. ✔ Designing the frontend system ✔ Co-ordinating various changes done in frontend and backend. ✔ Code Review and deployments ✔ Automation of repetitive jobs Technology Stack ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ● Spring MVC, Tomcat ● Apache Solr, MySQL ● Git, Maven, Jenkins ● AWS ECS, AWS EC2 ● NodeJS, ReactJS Show less



e-bee Global Solution Pvt. Ltd.

• India
• IT Services and IT Consulting
• 1 - 100 Employee

• Data Engineer in Search

  • Dec 2014 - Sep 2015

  Gurgaon, India Worked on Solr for different clients to increase their Search relevancy coded different APIs. Developed ways to scale the Solr as Service. Stack Ownership of the same. MAJOR WORK (DETAILS IN PROJECTS) ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ➢ Stack ownership of Solr Service. ➢ Solr Cloud. ➢ Spell-check component and Autocomplete ➢ Relevancy

• Full Stack Software Developer

  • Jan 2014 - Dec 2014

  Gurgaon, Haryana, India While working in E-Bee, I got to experience various technologies from UI to Java to Automation to Memcache to Maven to AWS. Was one of the Core team members to work on the complete Omni-Commerce Platform. Working here I got experience of building a whole product from scratch to top. Worked on different Projects which included (DETAILS IN INDIVIDUAL PROJECTS) ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ➢ Spring-based Java back-end ➢… Show more While working in E-Bee, I got to experience various technologies from UI to Java to Automation to Memcache to Maven to AWS. Was one of the Core team members to work on the complete Omni-Commerce Platform. Working here I got experience of building a whole product from scratch to top. Worked on different Projects which included (DETAILS IN INDIVIDUAL PROJECTS) ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ ➢ Spring-based Java back-end ➢ AWS ➢ JavaScript-based front-end ➢ Memcache Service ➢ IPad app

• Software Engineer Intern

  • Jan 2014 - Jul 2014

  Gurugram, Haryana, India