Our client, Euronext, is recruiting a Senior Data Engineer to join an international team.

Description

• Data Modeling: Designing efficient data models for optimal query performance.
• SQL Proficiency: Writing and optimizing SQL queries.
• Performance Tuning: Identifying and optimizing performance bottlenecks.
• ETL and Data Integration: Extracting, transforming, and loading data into Redshift, mysql, Postgresql.
• Cluster Management: Provisioning, scaling, and monitoring Redshift clusters.
• Security and Compliance: Implementing security measures and ensuring compliance.
• AWS Integration: Integrating Redshift with other AWS services.
• Monitoring and Troubleshooting: Monitoring cluster performance and resolving issues.
• Documentation and Training: Creating documentation and providing training to team members.
• Logging and Tracing: Proficiency in setting up and managing logging and tracing mechanisms in AWS, including leveraging services like AWS CloudTrail for auditing API calls and AWS X-Ray for distributed tracing and performance analysis. Understanding of best practices for logging configuration, log aggregation, and analysis to ensure visibility into system activity and troubleshooting capabilities.

Profile

• Expertise in AWS: Extensive experience with AWS services, particularly Lambda, Glue, StepFunctions, CloudFormation, CloudWatch, and others.
• Strong Solution Architecture Knowledge: Ability to design scalable and efficient data solutions onAWS, considering best practices for cloud architecture and infrastructure.
• Proficiency in Python and Databases: Strong programming skills in Python and experience with relational databases (MySQL, PostgreSQL, RedShift) and NoSQL databases.
• Orchestration and Workflow Management: Experience with orchestration tools such as Apache Airflow and AWS Step Functions for automating and managing data workflows.
• ETL Tools and Big Data Experience: Knowledge of ETL tools and experience working with large volumes of data, with a preference for Kafka experience.
• Experience with Iceberg Tables: Familiarity with Iceberg tables for managing large datasets efficiently, ensuring data consistency, and supporting ACID transactions.
• Production Awareness and Troubleshooting: Proactive approach to production monitoring and troubleshooting, with the ability to anticipate and mitigate potential issues.
• Technical Leadership and Communication: Capable of evolving into a technical lead role, with excellent communication and teamwork skills to collaborate effectively with cross-functional teams.
• Strong Analytical and Problem-Solving Skills: Ability to analyze requirements, define technical approaches, and propose innovative solutions to complex problems.
• Documentation and Requirements Analysis: Experience in writing solution documents, technical documentation, and the ability to challenge and refine business requirements.

Job Offer

A good opportunity to ramp up a global project