Experience

Acubed

• United States
• Aviation & Aerospace
• 1 - 100 Employee

• Senior Data Engineer

  • Aug 2022 - Present



2K

• Computer Games
• 700 & Above Employee

• • Jun 2020 - Aug 2022

• • Aug 2017 - May 2020



Insight Data Science

• United States
• Higher Education
• 1 - 100 Employee

• Data Engineering Fellow

  • Jan 2017 - May 2017

  ● Built platform to aggregate item sale information in the game Path of Exile and allow users to subscribe and receive alerts on sales of items of interest ● Platform made using open source distributed computing technologies ● Platform built on Amazon Web Service EC2 cluster of nine machines, 4 for stream processing using Flink, 4 for running RethinkDB database and handling Kafka message queue and 1 for hosting webapp ● Built a program to continuously call Path of Exile market API (one call per second) with Java and wrote results to Kafka topic as JSON, consumed 150GB data per day ● Built a stream processing pipeline using Java and Apache Flink to read item data from Kafka message queue and compute mean and standard deviation of item prices in real time and write item data into NoSQL document store database RethinkDB ● Applied stateful streaming to compute mean and standard deviation of prices by using six hour sliding time windows to ensure computed price metrics adjust to price fluctuations and one hour sliding time window to filter out previously listed items and to control memory consumption of Flink ● Built webapp using Python based webserver Tornado that displayed output of processing pipeline ● Webapp used websocket to display in real-time all new items that appeared in the Path of Exile marketplace that were at least one standard deviation below the average price of the most recent six hour window Show less



UC San Diego

• United States
• Higher Education
• 700 & Above Employee

• Staff Research Associate

  • Jul 2015 - Dec 2016

  ● Investigated the correlation of electrical brain activity (EEG) with learning and uncertainty in adults and children ● Built data processing pipeline in MATLAB and EEGLAB to process raw EEG data and perform data cleaning, filtering, Independent Component Analysis, and segmentation to prepare data for analysis ● Preserved each stage of data processing to allow modifications to be made to later stages of processed data, total data volume approximately 100GB ● Analyzed EEG data in time domain and frequency domain using R with general linear models and prepared conference presentations and reports for funding agencies ● Data processing pipeline continues to be used by other researchers in the lab ● Provided technical support to aid other researchers in modifying pipeline for their specific use cases Show less