Software Engineer (Data Engineering)

• Nov 2021 - Present

Highlights: --> Created Delta Live Tables (DLT) for Incremental Load with Databricks autoloader. --> Worked on Migration of Zeppelin Notebooks from Qubole to Databricks. --> Involved in Designing end-to-end Delta lake solutions based on open source. --> Created a Python Library that recommends and builds appropriate Databricks clusters based on the requirements (for both Azure and AWS Databricks). --> Created scripts for databricks workspace… Show more Highlights: --> Created Delta Live Tables (DLT) for Incremental Load with Databricks autoloader. --> Worked on Migration of Zeppelin Notebooks from Qubole to Databricks. --> Involved in Designing end-to-end Delta lake solutions based on open source. --> Created a Python Library that recommends and builds appropriate Databricks clusters based on the requirements (for both Azure and AWS Databricks). --> Created scripts for databricks workspace migration. Tools and Technologies used: Pyspark, AWS, Airflow, Apache superset, NLP, AI/ML, Power BI. Show less Highlights: --> Created Delta Live Tables (DLT) for Incremental Load with Databricks autoloader. --> Worked on Migration of Zeppelin Notebooks from Qubole to Databricks. --> Involved in Designing end-to-end Delta lake solutions based on open source. --> Created a Python Library that recommends and builds appropriate Databricks clusters based on the requirements (for both Azure and AWS Databricks). --> Created scripts for databricks workspace… Show more Highlights: --> Created Delta Live Tables (DLT) for Incremental Load with Databricks autoloader. --> Worked on Migration of Zeppelin Notebooks from Qubole to Databricks. --> Involved in Designing end-to-end Delta lake solutions based on open source. --> Created a Python Library that recommends and builds appropriate Databricks clusters based on the requirements (for both Azure and AWS Databricks). --> Created scripts for databricks workspace migration. Tools and Technologies used: Pyspark, AWS, Airflow, Apache superset, NLP, AI/ML, Power BI. Show less

Software Development Engineer – AI/ML

• Mar 2021 - Oct 2021

Highlights: -> Created data pipelines using Technologies like Apache Spark, Kafka, MSK, Glue, Pyspark, Airflow, and many more. -> Woked on resume Parser and text processing using core NLP.

Data Science Intern/Trainee at Diatoz

• Jan 2021 - Feb 2021

Machine Learning and Deep Learning intern

• Jan 2020 - Apr 2020

Highlights: -> Worked as a Computer vision intern. used deep learning and image processing techniques to solve Computer vision problems. -> Created GUI(graphical user interface) to show model output using PYQT library. Highlights: -> Worked as a Computer vision intern. used deep learning and image processing techniques to solve Computer vision problems. -> Created GUI(graphical user interface) to show model output using PYQT library.

Data Science Research Intern

• Jul 2019 - Sep 2019

Highlights: -> Worked on creating machine learning algorithms without using built-in libraries. -> worked on the model creation of the Spiking neural network(paper name: SAFRON). Highlights: -> Worked on creating machine learning algorithms without using built-in libraries. -> worked on the model creation of the Spiking neural network(paper name: SAFRON).

Frontend Web Developer intern

• Feb 2018 - Apr 2018