Senior Data Engineer - Munich, Deutschland - emagine Consulting

    emagine Consulting
    Default job background
    Beschreibung

    For our client, an internationally active company in the logistic sector, we are looking for a Senior Data Engineer (m / f / d) on a contract basis as soon as possible. The work can be % remote (no on-site work) and the duration of the project is min. 6 months with an option to extend.

    Tasks:

  • Design and implement data pipelines for effective data integration from various sources into cloud platforms, focusing on automation of data movements and transformations.
  • Deploy new developments on cloud platforms like Azure (using big data or cloud-integration technologies)
  • Implement business processes and logic in Databricks using Python / SQL / PySpark
  • Construct and test data warehouses, including staging and business layers (focus on Microsoft Azure)
  • Support the analysis of data integration projects
    (technical conception, design, solution selection, implementation, and quality assurance)
  • Design and implement a robust, scalable data management platform
  • Requirements:

  • Databricks
  • Microsoft Azure
  • Proficient in Python, SQL, Spark, etc.
  • Experience with object-oriented Python for scalable big-data pipelines, ETL processes, web APIs, and microservices.
  • Expertise in relational and NoSQL databases, star schemas, data lakes, blob/file storage, and data warehouses
  • Knowledge of technical implementation of regulatory requirements including access control, historization, versioning, and data lineage in data solutions
  • Experience working in agile environments (Scrum, Kanban)
  • Languages:

  • English (C1) / German (Nice to have - not important)
  • Does the position sound exciting to you and does your profile match the requirements?

    Then we look forward to receiving your application

    Contact person at emagine: Mr. Aman Karvandian-Esfahani

    Mail:

    Phone:

    Your emagine - Team