Anterior     |     Seguinte  

Senior Data Engineer @ Man Digital Hub - Lisbon (M/F)

Kelly Services

22.06.2020 | Lisboa | Referência: 2007717


  PARTILHAR







  
 
Kelly Services
 
 
Kelly IT Resources is recruiting a Senior Data Engineer to be a part of our client, Volkswagen Digital Solutions, from the Volkswagen Group.

The Volkswagen Group is forging ahead with digital transformation and Volkswagen Digital Solutions is part of this represented for its 3 tech units: AMS, MAN Digital Hub and SDC:LX.


Technology-driven trends such as diverse mobility, autonomous driving, electrification and connectivity will revolutionize the automotive industry in the next decade. Volkswagen Group, as world leader in the automotive industry, is setting the pace for this revolution. Volkswagen Digital Solutions was created in Lisbon following the overall group strategy to be part of this challenge.


MAN Digital Hub | Lisbon


The MAN Digital Hub in Lisbon is part of Volkswagen Digital Solutions and, together with MAN Truck & Bus SE, develops and shapes the future of commercial vehicles by driving digitalization in this market.


We are looking for passionate IT experts like you to join us in working in our new project, Data Connectivity.


What you will do...
 
  • Create and maintain data pipeline architecture.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
  • Create data tools for analytics and data scientists that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.
  • Actively contribute to tech and architecture decisions.
  • Write clean code following the TDD/BDD approach.
  • Implementation and maintenance of CI/CD pipelines.
  • Understand and implement principles around security, logging and monitoring running products.
  • Use build-measure-learn feedback loops to constantly improve all aspects of our work.
  • Experience in Operational Readiness (Functionality, Reliability, Usability, Efficiency, Changeability, Transferability)
You have the following qualifications...
 
  • Bachelor's degree in IT and/or comparable job expertise (min. 3 years)
  • Programming with functional programing and object-oriented script languages: Scala, Python, Java
  • Tooling Experience:
    • Experience with big data tools and distributed clusters: Hadoop, Spark, Kafka, Kinesis, etc.
    • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
    • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, Glue Workflow etc.
    • Experience with AWS cloud services: Athena, EC2, Elastic, Elasticache (Redis), EMR, Glue, RDS, Redshift
    • Experience with stream-processing systems: Flink, Storm, Spark-Streaming etc.
  • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
What's in it for you...
 
  • Be part of our amazing startup atmosphere and help of our local company culture, with the support of a solid international group;
  • An Agile environment where your ideas are welcome;
  • A very talented international team just as passionate and goal-oriented as you;
  • Flexible working hours and the possibility to work from home if needed;
  • The opportunity to evolve with continuous training and constant feedback;
  • Access to Udemy;
  • Health insurance for you and your family;
  • Smartphone with voice/data plan;
  • Fresh fruit, coffee and tea every day so you can be healthy and stay fueled for the day;
  • Hakuna Matata Sessions aka our weekly knowledge sharing session with snacks and beer to kick-off the weekend.
 
Caso considere que corresponde ao perfil pretendido envie-nos a sua candidatura actualizada através deste link.
 
Kelly Services
 






EMPREGOS SEMELHANTES





ÚLTIMOS EMPREGOS