Sr. Data Engineer

• Jan 2020 - Present

Data Engineer

• Jan 2019 - Jan 2020

Data Science Intern

• Jun 2018 - Jan 2019

Technical Skills: AWS S3, EC2, AWS IoT, AWS Deep Lens, Sage Maker, Green Grass, DynamoDB, React, Flask-RestfulDeveloped object-detection model using Tensorflow-hub and OpenCV. The application takes the feed from DeepLens and then uses the Model to analyze the frame for lights detection. AWS IoT is used to see the MTTQ by subscribing to the inference function. Lambda function hears to the MTTQ and puts the details of the proceeded frame into DynamoDB. The processed frame is put in the S3 for future reference. An API gateway is configured to get the details of the frame from DynamoDB. Web interface helps the user to see the output and learn how many lights are turned on at a point of time. Show less

Big data Intern, Research and Development

• May 2017 - Dec 2017

Technical Skills: Hive, Pig, Spark, Hortonworks framework, HBase, Sqoop, Azure IoT, Hadoop Ecosystem, Kafka, SparkML and Azure SQL Management worked on technical design, development and implementation of analytics on very large datasets worked on Big Data concepts, Data Lake development, Business Intelligence and data warehousing development processes and techniques Ported machine learning algorithms developed originally in MATLAB to Spark using Pyspark Developed algorithms for fault detection using SparkML with data scientists, business analysts for insights transformed and loaded data in various shapes/forms for algorithmic development of the advanced technology team implemented Machine learning algorithms on retail data and built dashboards based on the results which were used for ad-hoc reporting and data analysis Developed Stream Analytics jobs for extracting data from Event Hubs and push it into Azure Blob Storage Created real-time dashboards on Azure Event Hubs for Support Team to provide on-call assistance to customers Show less

Software Engineer

• Jul 2014 - Jul 2016

Technical Skills: SQL, Toad, Unix Shell Scripting, C++, SSIS, Autosys, Oracle Financial Markets and Data Warehouse in CommonWealth Bank of Australia • Integral part of Oracle Data Warehouse application team which transforms and loads millions of records daily via SQL loader, C program, Unix scripts and Autosys scheduler • Designed and implemented automation scripts in Unix using Oracle data pump to perform backup and restore of Production schemas into Prod Copy environment which saved three hours of manual effort daily • Hands on in Oracle SQL tuning using Implicit Cursors, Bulk Collect, ForALL, Adding Hints to improve the efficiency of queries and expertise in ETL batch processing using Unix shell scripts and Oracle SQL Loader • Putting In right practices for SDLC including code reviews, pair programming etc. • Implementing best practices/standards for development and production releases • Working closely with plan teams and business aligned technology teams. Show less