Zachary Lawson
Engineering Manager, Platform Engineering at SpotHero- Claim this Profile
Click to upgrade to our gold package
for the full feature experience.
Topline Score
Bio
Jim Werwath
I have had the pleasure of working with Zachary at two different companies. In both cases, Zachary was an early adopter of tooling that my team developed. His collaboration and experience benefited both teams immensely.
Jim Werwath
I have had the pleasure of working with Zachary at two different companies. In both cases, Zachary was an early adopter of tooling that my team developed. His collaboration and experience benefited both teams immensely.
Jim Werwath
I have had the pleasure of working with Zachary at two different companies. In both cases, Zachary was an early adopter of tooling that my team developed. His collaboration and experience benefited both teams immensely.
Jim Werwath
I have had the pleasure of working with Zachary at two different companies. In both cases, Zachary was an early adopter of tooling that my team developed. His collaboration and experience benefited both teams immensely.
Experience
-
SpotHero
-
United States
-
Software Development
-
200 - 300 Employee
-
Engineering Manager, Platform Engineering
-
Jan 2023 - Present
-
-
Data Engineering Squad Lead
-
Jan 2022 - Jan 2023
-
-
Senior Data Engineer II
-
Mar 2021 - Jan 2022
-
-
-
Zeitworks
-
United States
-
Software Development
-
1 - 100 Employee
-
Senior Data Engineer
-
Jul 2020 - Mar 2021
- Designed, built, and managed multiple Kubernetes Clusters on AWS EKS to serve both internal data processing needs and external application needs - Developed Terrafrom w/ Terragrunt System as an Infrastructure as Code Solution for managing Snowflake and AWS infrastructure - Developed multiple CI/CD Pipelines leveraging GitHub Actions leveraging containerized execution of testing, linting, and deployment - Established AWS ECR for container storage - Established Helm Charts for all… Show more - Designed, built, and managed multiple Kubernetes Clusters on AWS EKS to serve both internal data processing needs and external application needs - Developed Terrafrom w/ Terragrunt System as an Infrastructure as Code Solution for managing Snowflake and AWS infrastructure - Developed multiple CI/CD Pipelines leveraging GitHub Actions leveraging containerized execution of testing, linting, and deployment - Established AWS ECR for container storage - Established Helm Charts for all internal and external applications - Designed and Built an Airflow System on Kubernetes for batch processing - Built Kubernetes processing jobs for ingesting sensor data from S3 into Snowflake - Designed and built a data warehouse with Snowflake - Developed canonical and analytical data models for use in Machine Learning pipelines - Analyzed sensor data and built robust reporting pipelines to synthesize raw sensor data into tangible business insights around process discovery and execution. - Built and maintained AWS Networking Infrastructure for internal and externally facing network segregation - Established AWS Route53 for DNS resolution in conjunction with AWS ELB and AWS Certificate Manager to enable properly SSL termination and support. Show less - Designed, built, and managed multiple Kubernetes Clusters on AWS EKS to serve both internal data processing needs and external application needs - Developed Terrafrom w/ Terragrunt System as an Infrastructure as Code Solution for managing Snowflake and AWS infrastructure - Developed multiple CI/CD Pipelines leveraging GitHub Actions leveraging containerized execution of testing, linting, and deployment - Established AWS ECR for container storage - Established Helm Charts for all… Show more - Designed, built, and managed multiple Kubernetes Clusters on AWS EKS to serve both internal data processing needs and external application needs - Developed Terrafrom w/ Terragrunt System as an Infrastructure as Code Solution for managing Snowflake and AWS infrastructure - Developed multiple CI/CD Pipelines leveraging GitHub Actions leveraging containerized execution of testing, linting, and deployment - Established AWS ECR for container storage - Established Helm Charts for all internal and external applications - Designed and Built an Airflow System on Kubernetes for batch processing - Built Kubernetes processing jobs for ingesting sensor data from S3 into Snowflake - Designed and built a data warehouse with Snowflake - Developed canonical and analytical data models for use in Machine Learning pipelines - Analyzed sensor data and built robust reporting pipelines to synthesize raw sensor data into tangible business insights around process discovery and execution. - Built and maintained AWS Networking Infrastructure for internal and externally facing network segregation - Established AWS Route53 for DNS resolution in conjunction with AWS ELB and AWS Certificate Manager to enable properly SSL termination and support. Show less
-
-
-
SpotHero
-
United States
-
Software Development
-
200 - 300 Employee
-
Senior Data Engineer II
-
Sep 2019 - Jun 2020
- Researched and developed a SQL Materialization platform for rapid data transformation across Presto and Redshift with low touch configuration and no interruption to end users’ queries. - Created a RESTful entrypoint to capture direct parking garage occupancy information and process that data into a standard format leveraging the Kafka Streams Framework. - Spearheaded the creation of several Concourse CI/CD pipelines for deployment of applications to Kubernetes and Terraform… Show more - Researched and developed a SQL Materialization platform for rapid data transformation across Presto and Redshift with low touch configuration and no interruption to end users’ queries. - Created a RESTful entrypoint to capture direct parking garage occupancy information and process that data into a standard format leveraging the Kafka Streams Framework. - Spearheaded the creation of several Concourse CI/CD pipelines for deployment of applications to Kubernetes and Terraform Infrastructure to AWS Infrastructure. - Managed key data platform components for processing and storing data including Airflow, Presto, 3 Kafka Connect Clusters, and Redshift. - Audited the Data Infrastructure and reduced costs for the company by ~$3,500 a month through rescaling infrastructure. Show less - Researched and developed a SQL Materialization platform for rapid data transformation across Presto and Redshift with low touch configuration and no interruption to end users’ queries. - Created a RESTful entrypoint to capture direct parking garage occupancy information and process that data into a standard format leveraging the Kafka Streams Framework. - Spearheaded the creation of several Concourse CI/CD pipelines for deployment of applications to Kubernetes and Terraform… Show more - Researched and developed a SQL Materialization platform for rapid data transformation across Presto and Redshift with low touch configuration and no interruption to end users’ queries. - Created a RESTful entrypoint to capture direct parking garage occupancy information and process that data into a standard format leveraging the Kafka Streams Framework. - Spearheaded the creation of several Concourse CI/CD pipelines for deployment of applications to Kubernetes and Terraform Infrastructure to AWS Infrastructure. - Managed key data platform components for processing and storing data including Airflow, Presto, 3 Kafka Connect Clusters, and Redshift. - Audited the Data Infrastructure and reduced costs for the company by ~$3,500 a month through rescaling infrastructure. Show less
-
-
-
Uptake
-
United States
-
Software Development
-
100 - 200 Employee
-
Staff Data Engineer
-
Mar 2019 - Sep 2019
- Led a team of 3 engineers and 18 contractors in development of 3 applications for high profile industrial energy client within 3 months. - Provided mentorship & recruiting outreach at STRATA Conference and Open Source Hack Nights.
-
-
Senior Data Engineer
-
Nov 2017 - Mar 2019
- Led technical & architectural design for the Data Engineering Team. Managed & led 7 team members’ development via Agile Sprint Planning. - Developed a Scalatra/Scala based RESTful API for production data science reporting using Docker in Kubernetes. - Designed & developed a Scala Spark application for creation of production statistical performance metrics for data science models. - Created Kafka consumers and producers in Scala and Python for streaming data ingestion of analytical… Show more - Led technical & architectural design for the Data Engineering Team. Managed & led 7 team members’ development via Agile Sprint Planning. - Developed a Scalatra/Scala based RESTful API for production data science reporting using Docker in Kubernetes. - Designed & developed a Scala Spark application for creation of production statistical performance metrics for data science models. - Created Kafka consumers and producers in Scala and Python for streaming data ingestion of analytical data. - Created interview procedures and led hiring for the Data Engineering Team resulting in the hiring of 4 quality candidates.
-
-
Data Engineer
-
Nov 2016 - Oct 2017
- Developed & managed Postgres server leveraging Alembic for storage of data science training labels, reporting data, and general data warehousing. - Designed & implemented Airflow ETL orchestration for the entire Data Science Department (60+ employees). - Developed internal Flask RESTfulplus API and Vue.js internal reporting application in DC/OS. - Developed Python ETL CLI package for idempotent interactions with Postgres.
-
-
-
Point Inside
-
United States
-
Software Development
-
1 - 100 Employee
-
Business Data Analyst
-
Oct 2012 - Oct 2016
Dynamic and adaptive analysis on internal and partner data. General data architecture and process design. New product development including requirements generation, project management, and technical design. Dynamic and adaptive analysis on internal and partner data. General data architecture and process design. New product development including requirements generation, project management, and technical design.
-
-
Education
-
Lewis and Clark College
BA, Economics, Psychology