Rajat Ghoshal
Data Scientist at HiLabs Inc.- Claim this Profile
Click to upgrade to our gold package
for the full feature experience.
Topline Score
Bio
Credentials
-
Neural Networks and Deep Learning
CourseraAug, 2020- Nov, 2024
Experience
-
HiLabs
-
United States
-
Software Development
-
100 - 200 Employee
-
Data Scientist
-
Jun 2021 - Present
Non Hadoop Migration Stage1• Migrated stage 1 from Hadoop to Java-Scala based framework by creating abatch-wise process and writing a status driven automated pipeline• Reduced run time by 96% by migrating the SQL checks to Python based functionsEnd to End Volumetrics Screen• Developed an efficient pipeline processing 200M data received weekly into200k different time series and finding anomalous data points• Identified key statistics and charts along with Business team to display on UI• Approximately, 30k high-priority anomalies are generated and reported to the clientEnhancements to Existing load running process• Reduced manual effort of 2 hrs by developing a script automating QC on each load• Improved performance and reliability on scripts by adding critical break points• Prepared detailed documentation for each step involved in load runningHEDIS Use Case• Developed a pipeline for finding anomalous patients related to a HEDIS measure• Optimized association mining models by introducing a correlation measurebetween categorical variables to reduce unnecessary variables
-
-
Intern
-
Feb 2021 - May 2021
Pipeline for stage 3,4• Developed a pipeline for ingesting clinical data from HIVE for running DQ Checks• Developed SQL queries for the custom checks and configured them on base models
-
-
-
YoloBus, an EaseMyTrip.com Company
-
India
-
Leisure, Travel & Tourism
-
1 - 100 Employee
-
Software Development Intern
-
Apr 2020 - Jun 2020
Project : ETAs from GPS data & Web Pages for freight part • Estimated Time of Arrivals between the various cities was calculated from mining 3 million GPS data points using SQL and Geopandas library. • Cleaned the raw GPS data and uploaded it on postgres database. Geofences around the source & destination cities were used from OSM as GeoJSONs. • Results were accurate up to 30 mins as per the feedback from Operations team. • Created web pages related to freight partner, supplier and vehicles form. – Tech. Skills - Python, Geopandas, SQL | PHP, HTML, CSS & Javascript
-
-
-
-
President's Nominee
-
Apr 2019 - Apr 2020
OBJECTIVES • Managing logistics of the cell to provide an inclusive environment for all. • Coordinating with other departments to act as a single platform for DAP. • Organizing various sessions to sensitize the campus community. KEY INITIATIVES • Affiliated with 1980 batch & ALIMCO in conducting a medical camp to provide free assistive devices to the campus community. • Collaborated with the Programming Club to train the students on the softwares specially designed for visually challenged people. • Collaborated with the Dramatics Club to spread awareness in campus.
-
-
-
Counselling Service, IIT Kanpur
-
India
-
Non-profit Organizations
-
100 - 200 Employee
-
Student Guide
-
Jul 2018 - Apr 2019
– Guided and mentored 6 freshmen students in acclimatizing to the environment of the Institute. – Helped them with their academics by arranging meetings with their mentors and maintain a good rapport with them. – Coordinated with the Counselling Service and helped in the organization of Orientation Program 2018. – Guided and mentored 6 freshmen students in acclimatizing to the environment of the Institute. – Helped them with their academics by arranging meetings with their mentors and maintain a good rapport with them. – Coordinated with the Counselling Service and helped in the organization of Orientation Program 2018.
-
-
-
Antaragni, IIT Kanpur
-
India
-
Entertainment Providers
-
100 - 200 Employee
-
Senior Secretary, Ritambhara
-
Aug 2018 - Oct 2018
-
-
Education
-
Indian Institute of Technology, Kanpur
Bachelor of Technology -
Sharda Vidya Mandir
High School