Informacje podstawowe

Opis zadania i wymagań

Data Platform Engineer - 12 months - Remote

* Location: #Remote (based in Europe)
* Availability: Full-time
* Contract Duration: 12 months
* Start Date: January 2025

Our client is seeking an experienced Data Platform Engineer to join their team on a Freelance basis.

Key Responsibilities:

* Airflow Infrastructure Management: Optimize and maintain workflows on Kubernetes-based platforms, ensuring scalability and reliability.
* Data Migration Efforts: Plan and execute migrations to new orchestration platforms (e.g., Astronomer, AWS).
* Data Catalogue Enhancement: Manage LinkedIn DataHub to ensure accurate metadata integration and governance.
* Databricks Configuration: Set up and optimize Databricks infrastructure, leveraging tools like Spark and Delta Lake.
* Monitoring and Reporting: Track infrastructure health, resolve issues, and provide actionable insights.
* Optional On-Call Support: Address critical incidents to minimize downtime.

Desired Skills and Experience:

* Expertise in Airflow, Kubernetes, and data orchestration tools (e.g., Astronomer, MWAA).
* Strong background with big data tools (e.g., Spark, DBT) and cloud platforms (AWS).
* Proficiency in Databricks infrastructure and advanced features like Delta Lake.
* Experience in data migrations and managing metadata systems (e.g., LinkedIn DataHub).
* Strong problem-solving skills and adherence to software development best practices (CI/CD, version control).

Interested?
If this role is of interest, please send an up-to-date CV via E-mail.

We do not ask for a placement fee from Candidates/Employees.

If you wish to contact a specialist regarding this role, or your job search in general, please contact us.

Kategoria