Senior Site Reliability Engineer

• May 2022 - Present

Lead Data Engineer

• Aug 2021 - Feb 2022

Troubleshoot and maintain legacy Data Engineering infra built on mesos, chronos and hive in Google Cloud. Lead project to migrate to a new stack built on airflow and snowflake. Contributor to the planning and design process for future projects. Troubleshoot and maintain legacy Data Engineering infra built on mesos, chronos and hive in Google Cloud. Lead project to migrate to a new stack built on airflow and snowflake. Contributor to the planning and design process for future projects.

Lead Data Engineer

• Feb 2019 - Aug 2021

As the initial member of the data engineering team I was responsible for bootstrapping the team at JumpCloud. This included laying down the foundational tech vision, as well as interviewing and hiring engineers for the team. I also set up scrum processes such as standup, planning retro etc.Spearheaded multiple projects around CI/CD to improve engineer productivity and velocity. As well as assisting with migrating legacy apps running on EC2 to containers running on a Hashicorp Nomad cluster. Designed, planned and implemented pipelines and an Elasticsearch Cluster to support a customer facing solution for delivering event data with search and aggregation functionality to thousands of customers over an API in near real time. These pipelines handle roughly 25 Billion events/month. Heavily involved in the design, planning and implementation of other game changing features for customers such as AWS SAM Lambda Apps that calculate risk scores on user behavior and event driven pipelines for sending notifications and alerts that are configurable by customers. Worked as an individual contributor to deploy pipelines utilizing AWS Kinesis/Kinesis Firehose, AWS SQS and AWS Lambda that feed data into a Snowflake Data Warehouse for BI.

DevOps Engineer

• Oct 2016 - Feb 2019

As the first ever DevOps Engineer at JumpCloud I’m responsible for maintaining and scaling a 300+ server environment in AWS and GCE for a company that has experienced 3x customer growth each of the last two years. I’ve led an initiative to get 100% of our servers using configuration management with SaltStack. As well as addressed 21 single points of failure in the infrastructure I inherited. I am also solely responsible for monitoring, troubleshooting and scaling MongoDB, MySQL and Postgres database deployments.I’ve also been heavily involved in the last two SOC2 audits at JumpCloud as the main point of contact and contributor to the audit for all infrastructure related items. I was also a part of growing the DevOps team from just myself to 12 in the span of a year. This included developing and managing the on-call and post mortem process.

Hadoop Engineer

• Oct 2015 - Oct 2016

Help manage a 40 Node Hadoop cluster with Cloudera Manager. Configure and maintain various Hadoop services such as Hive, Impala, YARN, and HDFS. Advise and work with the Spotx systems team to help architect Hadoop solutions. Create and support Docker images for ETL and Application development. Develop and maintain ETL and Hadoop applications mainly in Python. Help manage a 40 Node Hadoop cluster with Cloudera Manager. Configure and maintain various Hadoop services such as Hive, Impala, YARN, and HDFS. Advise and work with the Spotx systems team to help architect Hadoop solutions. Create and support Docker images for ETL and Application development. Develop and maintain ETL and Hadoop applications mainly in Python.

Data Engineer

• Apr 2014 - Oct 2015

Build, configure and manage over 150 ElasticSearch nodes. Manage server configuration and accomplish remote parallel command execution with SaltStack. Experience with Elasticsearch clusters for Operations Analytics, Site Search and as a Document Store for billions of images meta data. Manage a 25 node Hadoop cluster and pull business analytics using Hive. Write ETL and reporting processes in Python. Maintain a Flume data pipeline for web server logging data. Build new data pipelines using Python, Flume and RabbitMQ. Some experience with Java while maintaining legacy ETL and Mapreduce programs.

IT Specialist

• Apr 2011 - Apr 2014

I wore many hats at photobucket, but I was originally hired as an IT intern and was eventually brought on full time. On the IT side of things my responsibilities included: - Tracking and managing 60+ work stations- Managing 5 windows servers (DC, AV and finance systems)- User account management- Maintain a pair Juniper VPN controllers- Manage google appsMy responsibilities expanded to include helping out the customer support team with back end issues requiring technical knowledge. I mainly helped with file system and database troubleshooting, scripting and bug reporting. I used a combination of BASH and Python for this area.Probably half my work time was devoted to learning about data analytics and database administration. I interacted with a hadoop cluster and mysql every day to provide data and information to photobucket's marketing team. I primarily used SQL/HiveQL for data extraction and excel for reporting.

Lifeguard/Instructor II

• May 2008 - Sep 2012