Andy Redeker
Principal Data Engineer at Continuus Technologies- Claim this Profile
Click to upgrade to our gold package
for the full feature experience.
Topline Score
Bio
Experience
-
Continuus Technologies
-
United States
-
IT Services and IT Consulting
-
1 - 100 Employee
-
Principal Data Engineer
-
Apr 2021 - Present
Principal Data Engineer on consulting engagements at financial service clients:• Worked with Snowflake Solution Architects to design and build processes that move data from external AWS Data Lake into Snowflake. Completely automated the data movement utilizing native AWS and Snowflake components. Built CI/CD processes to automate the deployment of all AWS and Snowflake resource.• Led the architecture, design and implementation of AWS workflows that moved data across the various data lake zones. Transformed data from both on-prem and cloud locations. Built MWAA (Airflow) DAGs that lev-eraged Glue, Lambda and Athena components to transform the data to the desired state. • Led the POC and implementation of dbt as the primary tool for transforming data with Snowflake. Built CI/CD processes to completely automate the deployment of dbt components.Specific Technologies Utilized: Snowflake, dbt, Airflow, AWS (Glue, Athena, Lambda, S3, MWAA), Terraform, GitLab, Flyway, MarkitEDM, Matillion Show less
-
-
Lead Data Engineer
-
Sep 2020 - Apr 2021
Lead Data Engineer on consulting engagements at financial service clients:• Implemented clients first cloud-based data warehouse utilizing Snowflake and MatillionSpecific Technologies Utilized: Snowflake, Matillion, Azure
-
-
-
Northwestern Mutual
-
United States
-
Financial Services
-
700 & Above Employee
-
Lead Engineer
-
Mar 2019 - Aug 2020
Lead engineer on a DevOps enablement team whose main responsibility was to onboard on-premise applications into an AWS Cloud environment. Key accomplishments include:• Led architecture, design and implementation of a data lake and data warehouse utilizing AWS Redshift, Glue and S3. This data was instrumental in guiding partner teams on-premise to cloud migration ensuring secure and well architected application designs.• Led AWS service introduction process partnering with cloud platform team and enterprise security teams. This process ensured AWS services used by application teams were secured and utilized best practices. • Partnered with application teams migrating from on-premise to cloud. Guided teams on architecture and best practices.Specific Technologies Utilized: AWS Redshift, AWS S3, AWS Glue, GitLab, Splunk, Terraform Show less
-
-
Technical Lead / Senior Data Engineer
-
Aug 2017 - Mar 2019
Senior engineer and technical lead for the company’s next generation enterprise data and analytics platform. Contributed as architect, engineer, and developer in bringing enterprise data sources to a common platform. Key accomplishments include:• As a technical lead, team member and individual, worked with business areas to bring data into an enterprise data warehouse. Leveraged the Data Vault 2.0 data modeling methodology.• Led the design and development of the team’s CI/CD processes leveraging GitLab, Docker and FlywayDB.• Responsible for the ongoing strategic roadmap and buildout of CI/CD and DevOps processes.• AWS Developer Certification• Data Vault 2.0 Certification• Technical lead responsibility for a team of 8 employees.Specific Technologies Utilized: SnapLogic, PostgreSQL, GitLab, Docker, FlywayDB, AWS, Python, Java, Linux, Splunk, Terraform Show less
-
-
Lead Software System Engineer
-
Jun 2015 - Aug 2017
Lead engineer on an enterprise master data management initiative. Led a team of engineers responsible for the long-term viability of the company’s first master data management effort. Key accomplishments include:• Led the creation and execution of a team responsible for the architecture, engineering, design, and development of Markit EDM processes and solutions.• Led a team of developers responsible for implementing a CI/CD pipeline with the goal of automating the Markit EDM build, deployment and testing processes.• Led the strategic historical performance attribution data storage and analytics platform direction resulting in the selection of Hadoop as the strategic direction.• Markit Intro, UI, and Advanced Certifications• People management responsibility for a team of 5 employees.Specific Technologies Utilized: Markit EDM, SQL, Delphix, RedGate, Hadoop, Team City, PowerShell, tSQLt Show less
-
-
Information Architect
-
Jan 2010 - Jun 2015
Led the development and implementation of the company’s first enterprise strategies around Big Data and Hadoop. Partnered with business area across the enterprise to promote consistent and reusable software solutions in the data integration and service-oriented architecture domains. Key accomplishments include:• Led the business case, solution definition and solution execution of the deployment of IBM Big Insights for Hadoop technology.• Participated in the definition, design, development and implementation of the first analytical database implementation on the Netezza database platform.• Partnered with application teams to create and maintain architecture patterns in the SOA and data integration spaces.Specific Technologies Utilized: IBM BigInsights for Hadoop, Netezza, Informatica, Java, SQL, SAS Show less
-
-
Application Engineer
-
Jan 2005 - Jan 2010
Performed roles including application analyst, technical engineer, team lead and developer on a number of en-terprise scale projects. Key accomplishments include:• Led design, development and implementation of an enterprise document retrieval application that is 100% configurable and reusable across the enterprise. The application allows for document management services leveraging IBM Content Manager. • Led team in the design, development and implementation of web application that targeted news articles to users based on their credentials.• Led team in the design, development and implementation of web application that manages URL’s for vendor hosted financial representative web sites.• Facilitated the deployment of a large 3rd Party application into existing company environments. This involved retrofitting the application into the exiting security constraints (Prepared WebSphere and MQ Series infrastructures). Specific Technologies Utilized: Java, WebSphere MQ, XML, HTTP, AJAX, HTML, Web Services, UDB, IBM Content Manager, Struts, Spring, iBatis, Input Accel Show less
-
-
Integration Engineer
-
Sep 2002 - Mar 2005
Partnered with enterprise teams to establish integration best practices and patterns for current and future enterprise usage. Successfully implemented a large-scale integration project, the first of its kind for the company. Partnered with Business Domain Architect to proof of concept new technologies. Key accomplishments include:• Led team in the design, development and implementation of middleware that integrated enterprise CRM (Siebel) and financial planning applications with company’s existing SOA. This project was the first large-scale development effort using IBM’s Message Broker. Project utilized web services, XML, MQ Series and HTTP.• Worked closely with external vendors to define and document custom interfaces to meet integration requirements. • Mentored junior team members and support area in usage of new technologies.• Partnered with enterprise teams to design and develop re-usable enterprise integration frameworks.• Performed a number of web service proof of concepts that involved moving data back and forth from the enterprise CRM to a mobile device. Specific Technologies Utilized: Message Broker 5.0, WebSphere MQ, MQ Workflow, Java, C#, XML, HTTP, Web Services, UDB Show less
-
-
-
Stratagem, Inc
-
United States
-
IT Services and IT Consulting
-
1 - 100 Employee
-
Consultant
-
Aug 1997 - Sep 2002
Performed various roles including team lead, developer and mentor on a wide variety of projects, technologies and applications. Key accomplishments include: • Designed, coded and implemented a number of user-interface and business object enhancements for existing insurance illustration and business case management systems. • Performed various roles directed towards implementing and maintaining a Sybase database. Developed stored procedures, triggers, and SQL scripts to perform various functions including enforcing referential integrity and creating a regression testing process. • Lead developer responsible for completing major enhancements to an Executive Benefits re-illustration system. • Independently designed and developed applications consisting of Visual Basic interfaces that made calls to host databases. Specific Technologies Utilized: Java, JSP, Visual C++ 6.0, Visual Basic 5.0, SQL, Sybase Adaptive Server Show less
-
-
Education
-
University of Wisconsin-Whitewater
Bachelor of Business Administration (BBA), Management Information Systems, General