Fidel P.
Senior Data Engineer at PayFit España- Claim this Profile
Click to upgrade to our gold package
for the full feature experience.
Topline Score
Bio
Experience
-
PayFit España
-
Spain
-
Information Technology & Services
-
100 - 200 Employee
-
Senior Data Engineer
-
Nov 2022 - Present
-
-
-
zooplus
-
Germany
-
Retail
-
700 & Above Employee
-
Big Data Engineer
-
Jun 2019 - Present
Creation from scratch of a company-wide big data infrastructure. Technologies: Scala, AWS, Docker, Flux, Kubernettes, Vue+Javascript, Argo, and many more. Creation from scratch of a company-wide big data infrastructure. Technologies: Scala, AWS, Docker, Flux, Kubernettes, Vue+Javascript, Argo, and many more.
-
-
-
Atos
-
France
-
IT Services and IT Consulting
-
700 & Above Employee
-
Big Data Engineer
-
Aug 2018 - Jun 2019
Worked in several projects: * Spark, Scala and Kafka based project for AllFundsBank. * ParaPanamerican games website: Analysis and design of the infrastructure used to create the site. * Ferrovial: Performance tests of a mongoDB to replace their current solution. Worked in several projects: * Spark, Scala and Kafka based project for AllFundsBank. * ParaPanamerican games website: Analysis and design of the infrastructure used to create the site. * Ferrovial: Performance tests of a mongoDB to replace their current solution.
-
-
-
HI Iberia Ingeniería y Proyectos
-
Spain
-
IT Services and IT Consulting
-
1 - 100 Employee
-
Big Data Engineer
-
Sep 2017 - Aug 2018
Client: Telefonica Design, development and migration from the existing streaming solution to a Flink / Kafka / Kubernettes based platform. * Design and development of the end to end solution. * Scala and Python development for the ingestion, pre-processing and cleaning of the data * Prediction and anomaly detection algorithm development * Technologies: Flink, Kafka, OpenShift, Logstash, ElasticSearch y Kibana. Client: Telefonica Design, development and migration from the existing streaming solution to a Flink / Kafka / Kubernettes based platform. * Design and development of the end to end solution. * Scala and Python development for the ingestion, pre-processing and cleaning of the data * Prediction and anomaly detection algorithm development * Technologies: Flink, Kafka, OpenShift, Logstash, ElasticSearch y Kibana.
-
-
-
Scalian Spain
-
Spain
-
IT Services and IT Consulting
-
200 - 300 Employee
-
Big Data Engineer
-
Dec 2016 - Aug 2017
Client: Isban Development, bugfixing and provide client support for SUPRA software, developed in Java and Scala, running on top of a Cloudera infrastructure. * Development & manteinience of the code written in Java and Scala * End to end testing using a Docker infrastructure Client: Isban Development, bugfixing and provide client support for SUPRA software, developed in Java and Scala, running on top of a Cloudera infrastructure. * Development & manteinience of the code written in Java and Scala * End to end testing using a Docker infrastructure
-
-
-
Mnemo
-
IT Services and IT Consulting
-
300 - 400 Employee
-
Python developer
-
Mar 2016 - Dec 2016
Client: BBVA Several tasks involving data management for the Cloudera infrastructure. * Develpment and manteinience of the codebase written in Scala and Python for the data ingestion of the system * Early detection of vulnerabilities using ML techniques * Manteiniance of a MongoDB infrastructure keeping all the data * Web scrappers / api requests development to extract vulnerability information from our data providers. * Python code development to clean and process the extracted data Show less
-
-
-
Accelya Group
-
United Kingdom
-
IT Services and IT Consulting
-
700 & Above Employee
-
Technical support
-
Jun 2015 - Apr 2016
Project manager technical support for infrastructure migration * Development of scripts written in SQL, Bash and Python * Information extraction from a SQL database to support the migration process. * Graph and reports creation with key information to support the decisions for the migration project. * Automatic documentation creation (PDF) using python to support the migration process. Project manager technical support for infrastructure migration * Development of scripts written in SQL, Bash and Python * Information extraction from a SQL database to support the migration process. * Graph and reports creation with key information to support the decisions for the migration project. * Automatic documentation creation (PDF) using python to support the migration process.
-
-
Education
-
Universidad Politécnica de Madrid
Ingeniería, Ingeniería de Caminos, Canales y Puertos