Empresa:

Closer Consulting

Descrição da Função

Mutual Respect, Empathy, Innovation, and Professional Pride. Do you see yourself within these values?

Founded in 2006 with the mission "To Challenge Complexity", Closer Consulting is a Data Science company specializing in Business Intelligence, Advanced Analytics, and Artificial Intelligence. Developing projects in the most diverse industries - Banking, Telecommunications, Healthcare, Retail, Energy, Insurance, and Aviation, among others -, we have created an environment where the brightest enquiring minds feel at home, providing our people with the means, opportunities and support they need to thrive and innovate.

We are looking for a Data Engineer (3-4 years of experience ) with the skills to take on new challenges in Lisbon (2 days at the office).

Location: Lisbon

About the Role:

We're seeking a skilled Data Engineer to design, build, and maintain robust data infrastructure that powers our organization's data-driven decisions. You'll own end-to-end data pipelines (using Airflow), optimize data workflows, and collaborate with analysts to deliver reliable, accessible data. If you thrive in distributed environments (Hadoop/Spark) and love solving complex data challenges, this role is for you.

Key Responsibilities:

Data Infrastructure & Pipelines

• Design, develop, and maintain Airflow DAGs for ETL/ELT processes.
• Optimize and monitor data pipelines for performance/stability.
• Manage data lakes (S3 preferred) and warehouses, ensuring efficient storage (Parquet/Avro).

DevOps & Deployment

• Deploy Airflow pipelines in production using Jenkins/Ansible.
• Containerize applications with Docker/Kubernetes.
• Automate infrastructure provisioning and scaling.

Collaboration & Innovation

• Partner with analysts to deliver user-friendly data access.
• Improve data architecture and DevOps processes.
• Document workflows, conduct code reviews, and optimize queries (SQL/PySpark).

Technical Requirements:

Mandatory Skills

• Python: Advanced (APIs with Flask, testing, documentation).
• Big Data: Hadoop (HDFS/Yarn), Spark, PySpark.
• Databases: Oracle (SQL Server/PostgreSQL a plus).
• Data Formats: Parquet (Avro a plus).
• Tools: Airflow, Kafka, Docker, Kubernetes, Jenkins.
• Methodologies: Agile/Scrum.

Nice-to-Have

• Ansible, Avro, SQL Server/PostgreSQL.

Soft Skills:

• Strong communication (fluent English).
• Analytical mindset (balance big-picture vs. detail-oriented).
• Team player with client-focused adaptability.

Oh and by the way, we also have:

• Several challenging complex projects.
• Stimulating teams and leaders.
• World-class Clients and Partners.

If you believe in this match as much as we do, send us your CV to and reach the closer side of life.

Closer is a company that values diversity and inclusion. We are committed to fostering an environment where everyone is treated with dignity and respect, regardless of race, gender, beliefs, sexual orientation, physical or mental disability, or other personal characteristics.

At Closer, we embrace the unique perspectives and experiences that everyone brings, and we believe that it is a fundamental driver for the success we've achieved.

Observações

Lisboa (Portugal)