Experience

InvestingChannel

• United States
• Online Audio and Video Media
• 1 - 100 Employee

• Data Engineer

  • Jun 2023 - Present



Indiana University Bloomington

• United States
• Higher Education
• 700 & Above Employee

• Research Assistant

  • Dec 2022 - Jun 2023

  • Research involves exploring time series databases for IOT sensors that support both real time analytics and fast batch reads. • Compared architectural differences of BTrDB(Berkley Database) and InfluxDB which are specially designed for timeseries data. • Research involves exploring time series databases for IOT sensors that support both real time analytics and fast batch reads. • Compared architectural differences of BTrDB(Berkley Database) and InfluxDB which are specially designed for timeseries data.



Amazon

• United States
• Software Development
• 700 & Above Employee

• Data Engineer

  • May 2022 - Aug 2022

  • Part of consumer organization with Catalog Discovery Trust team which protects brands from infringement. • Building CICD solutions to provide integration tests, and unit tests on SQL scripts available on multiple platforms. • Understanding and optimizing complex data pipelines thus reducing refresh interval of the core process to hourly refresh instead of every three hours. • Part of consumer organization with Catalog Discovery Trust team which protects brands from infringement. • Building CICD solutions to provide integration tests, and unit tests on SQL scripts available on multiple platforms. • Understanding and optimizing complex data pipelines thus reducing refresh interval of the core process to hourly refresh instead of every three hours.



Media.net

• United Arab Emirates
• Technology, Information and Internet
• 700 & Above Employee

• Data Analyst

  • Jul 2019 - Aug 2021

  • Involved in design, architecture, and planning of scalable ETL pipelines with data rates in order of million messages per minute. • Developed and owned a Flask server for automating column addition process reducing task time by 50%. • Streamlined data pipelines and reduced data hops which helped the company save 300-500 TB storage per process. • Reduced error percentage by 10% in revenue prediction model for multiple ad-providers. • Developed automated alert system for auditing process using Python (Druid-API, Slack/Flock-API and MySQL). • Developed generic python scripts to automate daily tasks like reporting and monitoring. Show less