Alexander Gilfillan
Software Engineer: Data at Cars.com- Claim this Profile
Click to upgrade to our gold package
for the full feature experience.
Topline Score
Bio
Experience
-
Cars.com
-
United States
-
Internet Publishing
-
700 & Above Employee
-
Software Engineer: Data
-
Apr 2021 - Present
• Developed and deployed a software process to automate the collection of Dataset/Job lineage, Schema, and other metadata. Migrated 300+ Jobs at initial deployment and covers over 500+ Jobs running in production today. • Developed software that automatically updates documentation containing job, dataset, repository, and dag level information. Provides document coverage for over 500+ Jobs/Datasets and 30+ Repositories/DAGS. • Established team-wide standards for code review, code style, common ETL task structure, and AWS infrastructure patterns. • Led the coordination and delivery of multiple end-to-end projects to ingest, transform and serve data to various destinations for business stakeholders. • Developed and maintained projects involving Hashicorp Packer/Terraform to help automate and modularize data infrastructure involving AWS EC2, S3, and Glue. • Developed PySpark performance improvements to reduce job runtime by over 50% and reduce required compute by upwards of 30%. • Led design efforts to generalize common ETL tasks into modularized code to increase developer velocity and reduce development time. Reduced lines of code by over 60%. • Debugged various PySpark issues (some affecting all jobs in production) and led communication with the team and others in the data organization about solutions to address the issues. • Developed over two dozen reports for external third parties, including collecting requirements and revisions for the data as needed. • Led and contributed to various improvements to common shared code libraries resulting in reduced boilerplate, new/enhanced functionality, and stability. • Presented to the broader data organization various topics/POCS covering new data tools, data organizational trends, and general software engineering practices. • Engineered improvements to Airflow that reduced operational overhead for managing and re-running pipelines impacting several dozen DAGS.
-
-
-
Dealer Inspire
-
United States
-
IT Services and IT Consulting
-
500 - 600 Employee
-
Software Engineer: Data
-
Mar 2020 - Mar 2021
-
-
Data Science Intern
-
Jun 2019 - Mar 2020
-
-
-
Argonne National Laboratory
-
United States
-
Research Services
-
700 & Above Employee
-
Engineering Coop: Cryogenics
-
Jan 2016 - Aug 2016
-
-
Education
-
North Central College
Bachelor's degree, Computer Science -
Naperville North HighSchool