Data Engineer

• Apr 2023 - Present

Senior Data Engineer

• Jun 2019 - Sep 2022

Led development of Airflow application, fully integrated to multiple AWS services and external databases, and deployable to multiple environments via Azure DevOps CI/CD. Enabled new cross-sector analytical services building ingestion and models for previously siloed data stores. The newly integrated data allowed analysts to improve data accuracy and deliver finer dashboards. Designed and led pipeline refactoring process to pivot from an ETL-based data lake pattern in S3 to an ELT-based based on DBT models and a Snowflake data warehouse. Improved sports concessions sector pipelines by refactoring ingestion Lambdas to be more accurate and migrating business logic transformation from complex single-script Glue jobs to clearer DBT models. Led and delivered multiple data quality improvement programs, including data freshness dashboards, a Glue-error reporting CLI, and Snowflake workbook-based acceptance testing. Scaled pub-sub ingestion for variably large payloads using Airflow and AWS SNS/SQS Led code, project, & data model reviews with junior engineers & analysts. Led data operations infrastructure planning and development. Built end-to-end Airflow and AWS-backed ETL pipelines and data models from multiple enterprise data sources to feed reporting and dashboard suites for employee dining programs at Amazon and Netflix. Managed small interdisciplinary team for migration of business-critical database and ETL pipeline into EC2, leading to faster issue recovery and significant compute cost savings. Delivered React-based frontend for event management platform, designed in collaboration with backend engineering lead and internal user base. Owned front and backend codebases after deployment. Led collaborative Agile-based code reviews, planning, and business requirement gathering with junior engineers and analysts. Show less

Data Engineer

• Aug 2021 - Feb 2022

Development and deployment of PostgreSQL data warehouse for the department of education in a large Western state. Reduced data ingestion task run time by refactoring custom Airflow operators. Created complex data normalization pipelines and validation for distinct but related sources using DBT. Simplified data accession patterns for engineering partners by implementing NoSQL-based modeling for a backend data warehouse. Development and deployment of PostgreSQL data warehouse for the department of education in a large Western state. Reduced data ingestion task run time by refactoring custom Airflow operators. Created complex data normalization pipelines and validation for distinct but related sources using DBT. Simplified data accession patterns for engineering partners by implementing NoSQL-based modeling for a backend data warehouse.

Product Manager, Onsite Search + AB Testing

• Aug 2015 - Oct 2018

Delivered new customer-facing onsite search experience, driving ~40% improvement in mobile conversion. Directed data collection architecture to enrich search analytics data points and analysis. Designed and launched solution for iteratively testing T-Mobile's first data-driven search ranking algorithm. Stood up Agile A/B testing and optimization programs for several internal product teams. Deployed location-targeting solutions for personalization merchandising program. Developed data pipeline using Python and AWS solutions for data science team's executive dashboards. Created utility scripts in Python, R, and JavaScript to optimize reporting and debugging workflows. Show less

Search and Taxonomy Analyst

• Jul 2013 - Aug 2015

Launched search algorithm testing program with testing and optimization team. Wrote search ranking algorithms, driving variably higher lift in conversion and engagement metrics for desktop and mobile marketing campaigns. Created new reporting scripts and capabilities in SQL, providing more granular insight into brand affinity and location-based search behavior. Developed productivity tools in JavaScript that reduced data migration project by 30% of time estimated to complete. Collaborated with developers on new search engine functionality. Show less

Graduate Research Assistant

• Aug 2011 - Jun 2013

Ran comparative analysis on rare holdings against collections of similar academic media libraries. Researched new media content delivery to better meet teaching staff's digital media needs for budget/funding requests. Designed new media request tracking process, folding follow-up emails and receipts into request processing workflow. Ran comparative analysis on rare holdings against collections of similar academic media libraries. Researched new media content delivery to better meet teaching staff's digital media needs for budget/funding requests. Designed new media request tracking process, folding follow-up emails and receipts into request processing workflow.

Web Content Editor

• Apr 2012 - Oct 2012

Scoured the web for commercial and public developer APIs. Cataloged APIs' technical and functional metadata in searchable directory. Wrote technical documentation and how-tos on API research, tracking, and cataloging. Scoured the web for commercial and public developer APIs. Cataloged APIs' technical and functional metadata in searchable directory. Wrote technical documentation and how-tos on API research, tracking, and cataloging.

Floor Staff

• Jan 2005 - May 2012