Dhvanil Prajapati
Big Data Engineer at ITLux Tech- Claim this Profile
Click to upgrade to our gold package
for the full feature experience.
Topline Score
Bio
Experience
-
ITLux Tech
-
United States
-
IT Services and IT Consulting
-
1 - 100 Employee
-
Big Data Engineer
-
Sep 2022 - Present
Ontario, Canada Piloted comprehensive Azure solutions for data engineering and analytics in water and health & safety sectors, bolstering system reliability by 35% and enhancing performance by 25%. Fine-tuned data pipeline operations using Databricks and Azure Data Factory, contributing to a 20% boost in workflow efficiency and cutting down configuration time by 15%. Constructed a unified Python library, ETL pipelines, and a PySpark-based repository, boosting deployment effectiveness by 25%… Show more Piloted comprehensive Azure solutions for data engineering and analytics in water and health & safety sectors, bolstering system reliability by 35% and enhancing performance by 25%. Fine-tuned data pipeline operations using Databricks and Azure Data Factory, contributing to a 20% boost in workflow efficiency and cutting down configuration time by 15%. Constructed a unified Python library, ETL pipelines, and a PySpark-based repository, boosting deployment effectiveness by 25%, curtailing data processing time by 15%, and lifting code reusability by 35%. Utilized advanced SQL queries, KQL, and bespoke Python and Spark functions for data loading, transformation, and refined backend queries, enhancing query performance by 20% and diminishing query processing time by 15%. Adopted data design patterns and refined ETL pipelines, achieving a 50% deduction in cloud storage usage, a 20% reallocation of resources for improved results, and decreasing pipeline construction time by 20%. Devised data migration, warehousing, and backup strategies, boosting data precision by 15%, data availability by 100%, and bettering data handling efficiency by up to 30% while reducing data ingestion time by 15%. Accomplished seamless data migration from GCP to Azure cloud platform, ensuring uninterrupted data transfer with zero data loss and curtailing data transfer time by 20%. Initiated and carried out a proof of concept for integrating data science teams' work within ETL pipelines, hastening project completion by 15% and increasing team collaboration efficiency by 20%. Show less
-
-
-
Vertex Ladders
-
Canada
-
IT Services and IT Consulting
-
1 - 100 Employee
-
Data Architect
-
Mar 2021 - Aug 2022
Ontario, Canada Conceived and executed data architecture for various domains, boosting system efficiency by 30% and refining data flow by 20%. Formulated and preserved conceptual, logical, and physical data models, diminishing model development time by 15% and heightening data precision by 20%. Spearheaded data migration initiatives from antiquated systems to modern platforms, culminating in 100% successful data transfer with no loss and a 30% decrease in data retrieval time. Worked in conjunction… Show more Conceived and executed data architecture for various domains, boosting system efficiency by 30% and refining data flow by 20%. Formulated and preserved conceptual, logical, and physical data models, diminishing model development time by 15% and heightening data precision by 20%. Spearheaded data migration initiatives from antiquated systems to modern platforms, culminating in 100% successful data transfer with no loss and a 30% decrease in data retrieval time. Worked in conjunction with Data Engineers and Business Analysts to translate business prerequisites into database solutions, enhancing the pertinence of the output by 25%. Shaped strategies for data acquisitions, archive recovery, and successful database implementation, resulting in a 20% elevation in data reliability. Executed security measures and data privacy standards in sync with GDPR and other regulations, ensuring 100% adherence and averting potential legal implications Show less
-
-
-
-
Data Science Engineer
-
Mar 2018 - Aug 2019
India Supervised and governed data science teams, enhancing overall project completion rates by 15% and improving team productivity by 20%. Formulated, developed, and launched machine learning algorithms and advanced analytics to address complex business problems, heightening decision-making efficiency by 30%. Nurtured cross-functional collaboration between data science, engineering, and business teams, enhancing project effectiveness and communication by 25%. Conveyed complex data… Show more Supervised and governed data science teams, enhancing overall project completion rates by 15% and improving team productivity by 20%. Formulated, developed, and launched machine learning algorithms and advanced analytics to address complex business problems, heightening decision-making efficiency by 30%. Nurtured cross-functional collaboration between data science, engineering, and business teams, enhancing project effectiveness and communication by 25%. Conveyed complex data insights in an intelligible manner to non-technical stakeholders, ensuring 100% comprehension and improving decision-making based on data insights. Maintained data quality and dependability in data science projects, augmenting the accuracy of predictions and decision-making effectiveness by 20%. Coached and fostered talent in the data science team, leading to a 30% boost in team skill levels and a 15% reduction in employee turnover rates. Show less
-
-
Education
-
L.D. College of Engineering
Bachelors in Mechanical Engineering -
University of Ottawa
Masters in Mechanical Engineering