Adrián Lucas

Senior Data Engineer at Coreso SA
  • Claim this Profile
Contact Information
us****@****om
(386) 825-5501
Location
Brussels, Brussels Region, Belgium, BE

Topline Score

Topline score feature will be out soon.

Bio

Generated by
Topline AI

You need to have a working account to view this content.
Join now
You need to have a working account to view this content.
Join now

Credentials

  • Big Data Analytics Program
    QUT (Queensland University of Technology)
    Jan, 2018
    - Nov, 2024

Experience

  • Coreso SA
    • Belgium
    • Utilities
    • 1 - 100 Employee
    • Senior Data Engineer
      • Feb 2023 - Present

      We are improving the efficiency of the European electrical grid, impacting 300M of citizens, and making the grid systems more reliable and safe. - DWH modeling. - Improving data governance and quality. - Data migrations. - Architecting complex pipelines based on best practices in the market. - DevOps. Some of the technologies in our stack: Airflow, dbt, Python, SQL, PostgreSQL, Pandas, Kubernetes, Docker, Gitlab, etc We are improving the efficiency of the European electrical grid, impacting 300M of citizens, and making the grid systems more reliable and safe. - DWH modeling. - Improving data governance and quality. - Data migrations. - Architecting complex pipelines based on best practices in the market. - DevOps. Some of the technologies in our stack: Airflow, dbt, Python, SQL, PostgreSQL, Pandas, Kubernetes, Docker, Gitlab, etc

  • European Commission
    • Belgium
    • Government Administration
    • 700 & Above Employee
    • Senior Data Engineer / Cloud Architect
      • Apr 2021 - Jan 2023

      Working on exciting data analytic projects with high impact in the wellness of the european citizens (Eurobarometer, eSurveillance product safety, Better Regulation Portal analytics platform, Arachne, etc).◦ Architecture of high performant big data pipelines on AWS.◦ Machine Learning proof of concepts: fraud detection, NLP classification, record linkage, etc.◦ Data modeling (SQL and non-SQL) for transactional and analytical databases.◦ Data migrations and integrations between on-premise and cloud environments.◦ Dashboard generation.◦ Colaboration with DevSecOps team (IaC, CI/CD best practices, documentation, CRISP-DM, etc). Show less

    • Application Architect
      • Mar 2020 - Apr 2021

      Working on Transparency Register, one of the key projects in the transparency strategy for the European Union and one of most visited Europa.eu pages.◦ Migration from a legacy monolithic application to microservices, creating CI/CD pipelines and refactoring the codebase following DIGIT best practices.◦ Oracle database migration to the lastest version, PL/SQL refactoring, improving Full text search capabilities on top of Oracle FTS support.◦ Improving data quality, fixing issues in the persistency layer.◦ Improving the integration between TR and other EC/EP systems.◦ Reverse engineering, moving from zero documentation to good practices. Show less

  • Teralco
    • Spain
    • IT Services and IT Consulting
    • 1 - 100 Employee
    • Technical Data Lead
      • Apr 2019 - Mar 2020

      ◦ Technical leadership, E2E, on big data projects for some of the top companies in Spain; working with cutting-edge technologies (Spark, Snowflake, Kafka, etc). ◦ Cloud back-end architecture design and IaC automation in AWS (API Gateway, Lambda, Kinesis, EMR, CloudFormation, etc). ◦ Machine Learning proof of concepts (Markov attribution models, OCR, Template matching, etc). ◦ Front-end customization for advanced analytics dashboards (Tibco Spotfire, Tableau, D3.js, etc). ◦ PM for the implementation of the ISO-27001 standard within the organization (> 100 employees). Show less

  • Solvencia y Marketing, SL
    • Alicante, Comunidad Valenciana / Comunitat Valenciana, España
    • Technical Data Lead
      • May 2005 - Apr 2019

      ◦ Architecture and development of highly complex Big data projects for credit scoring, fraud detection and recoveries (Spark, Airflow, Nifi, Hive, Impala, Sqoop, etc). Application of Machine Learning and NLP techniques with Java and Python. ◦ ETL and Data Quality Processes. Integration of Opendata (Cadastre, Census, BORME, TEU, etc) and statistical microdata. ◦ Database modeling (OLTP and OLAP). ◦ Development of scrapers to obtain data (Scrapy and Puppeteer / XPath). ◦ Dashboards and visual analytics with Talend and Knime. ERP integrations. ◦ Design and architecture of back-end microservices (Java and Python) using Google Cloud (AppEngine, Dataprep, BigQuery, etc) and Spring Framework. ◦ Technical coordination of different data providers of Banco Popular / Wizink group after the successive acquisitions of the bank. Risk analysis and adaptation of treatments to RGPD and ISO-27001. ◦ Managing people, budgets and recruitment in my field of expertise. Show less

  • Infeur
    • Java Back-end Architect
      • Jun 2004 - May 2005

      ◦ Database model architecture and management.◦ Design of REST and SOAP (J2EE) webservices for access to information.◦ Front-end for visual analytics with HTML, CSS and jQuery.

    • J2EE y DBA Oracle Developer
      • Jan 2002 - Jun 2004

      ◦ Back-end development with J2EE and JSP technologies.◦ Oracle Database Administration and Development of PL/SQL code.

Education

  • Universitat Oberta de Catalunya
    Máster universitario de Ciencia de Datos, Matemáticas e informática
    2021 -

Community

You need to have a working account to view this content. Click here to join now