Carlos
A passionate Data Engineer
I use modern technologies to design, implement, test, deploy, monitor and maintain data driven apps. I am specialized in streaming processing and Cloud computing.
Hi, my name is
About Me
I am a Software Engineer with a strong passion for data and analytics, and the Cloud computing ecosystem. I have a solid background in data streaming processing, particularly with Apache Flink, in the AWS cloud. I am a strong advocate of the DevOps culture and its benefits, and I cannot imagine a project without CI/CD, automation or monitoring. I also have a keen interest in the IoT world and its applications across various fields.
I have +6 years of experience in the data ecosystem, and I am currently working as a Data Engineer at Openbank in Spain. I also have some experience in leading development teams and teaching online classes.
I was honored with the Final Degree Award for the best academic record in the Bachelor’s Degree in Software Engineering.
I’m a very curious person, always eager to learn new things and improve myself every day. I am very disciplined with my habits, and I always try to do my best to achieve my goals.
As for my hobbies, I really enjoy staying active and practicing sports, especially going to the gym, but I am always open to exploring new sports whenever I can. I like spending time with my friends and my girlfriend, watching football, listening to music and podcasts, playing video games, and collecting vinyl records and anime statues. I am also an avid reader, particularly of personal development books, manga, and video game magazines. I love traveling, experiencing diverse cultures and meeting new people.
These are my essential skills and the technologies in which I have the most expertise:- Spanish (native)
- English (C1)
- Java
- Python
- Flink
- Kafka
- Iceberg
- Redis
- Docker
- Kubernetes
- Ansible
- Vagrant
- Grafana
- Kibana
- Spring
- AWS
Experience
Openbank
UAX
Accenture
UniOvi
- Was a member of the platform team, a data engineering group responsible for managing the data lake and developing and maintaining various data tools to support and enhance the data infrastructure, as well as other data teams.
- Improved and optimized a Flink job responsible for generating real-time alerts based on core banking data.
- Implemented a Flink job responsible for making core banking data and other systems’ information available in the Data Lake in near real-time, using Iceberg tables. Implemented and orchestrated the execution of various table maintenance operations.
- Improved the internal flow orchestrator (Spring Boot + Angular) and helped make it cloud provider agnostic.
- Technologies: Java, Scala, Flink, Iceberg, Avro, Schema Registry, Spring, AWS (Kinesis, Glue, Lambda, CloudWatch, CloudFormation).
- Professor of Python in the subject Programming Languages (SM142050) of the Master’s Degree in Artificial Intelligence.
- Professor and coordinator of the subject Cloud Software Development and DevOps (C0342506) of the Bachelor’s Degree in Data Science and Artificial Intelligence.
- Defined cost and security controls for the Big Data Cloud platform (AWS) of a banking project valued at €10M, using AWS services such as Lambda, CloudWatch, SNS, IAM, and CloudFormation.
- Trained 50 people in Python and streaming (Kafka + Flink) in 2 editions of an internal Accenture bootcamp.
- Led the training in Python, PySpark, and AWS for a group of 13 people (junior and senior profiles). Ensured that all obtained the AWS Certified Cloud Practitioner certification. Integrated them into the project and facilitated their collaboration and growth.
- Acted as a mentor for 3 people, internship supervisor for 3 students, and thesis advisor for one Bachelor’s thesis.
- Developed and end-to-end solution for monitoring Flink and EMR; which includes the collection, processing and loading of Flink/EMR metrics and logs; and the creation of dashboards in Grafana and Kibana for their visualization and analysis.
- Automated the configuration of the EMR clusters through Ansible, following a GitOps philosophy.
- Implemented a Continuous Delivery process for deploying Flink jobs on EMR, based on the declarative paradigm.
- Developed a proof of concept of the new Flink SQL version, to homologate it and promote its usage within the project.
- Improved and evolved our Java framework based on Flink with abstractions over Flink SQL, which simplified the development of streaming applications focused on joining event streams.
- Reduced AWS infrastructure costs by 60% by optimizing EMR and ElastiCache instances.
- Maintained close communication with the client’s development teams, focusing on decision-making and continuous improvement.
- Took part in on-call duty, handling maintenance of production applications and resolving numerous incidents.
- Conducted technical interviews with 3 candidates to select a new member for our project’s development team.
- Led a team of 3 developers to implement and deploy numerous streaming projects with Flink.
- Helped win an RFP (Request For Proposals) from one of the largest insurance companies in the market, where I designed a serverless architecture based on microservices on AWS.
- It was a resounding success, as the project was awarded to Accenture and we received personal recognition from the CDO (Chief Data Officer) of the insurance company.
- Was selected by Accenture to participate in the exclusive TechStar program, where I had the opportunity to further develop my technical, interpersonal, and management skills.
- Less than 1% of the analysts and consultants of Accenture Technology can participate in this program.
- Designed and implemented a Java framework based on Flink that facilitated the development of streaming applications
- This framework abstracts several common components, including: security configurations, read/write events from/to Kafka, N-N joins between events, generation of custom metrics, and timestamps management.
- Implemented and deployed numerous streaming applications on AWS using the previous framework, services such as EMR, S3, ElastiCache, EC2, and Certificate Manager, and technologies such as Flink, Kafka, Redis, CouchBase, and Hadoop YARN.
- Automated numerous internal processes using Python and Bash scripts.
- Contributed to the adoption of a testing culture focused on specification-based techniques (Equivalent Class Partitioning) and structure-based techniques (MCDC - Modified condition/decision coverage).
- Developed a Python library for topic identification in a collection of documents, the classification of documents into those topics, and the generation of extractive text summaries, using NLP (Natural Language Processing) techniques.
- Developed a REST API in Flask and a frontend in Angular, which eased the interaction with a collection of documents.
- Installed several software packages and repaired multiple hardware devices.
- Managed the inventory.
- Resolved a wide range of issues for both students and teachers, with a particular focus on problems related to Active Directory.
Education
2015–2019
Bachelor's Degree in Software Engineering
Universidad de Oviedo
GPA:
9.312 out of 10 · 3.66 out of 4
- Awarded 28 honors
- Final Degree Award for best academic record
- Grace Hopper Award for academic excellence
- Final Degree Project: Web application for the classification of text documents and the generation of extractive summaries
Achievements
Get in Touch
My inbox is always open. Whether you have a question or just want to say hi, I’ll try my best to get back to you!