iO Associates has partnered with a FinTech start-up based in the Frankfurt am Main region. They are pioneering both B2C and B2B finance management, leveraging the latest AI tech and modernised data platforms.

In this role, you will act as an external SME consultant in Databricks (Spark) and lead the development and enrichment of the existing data lakehouse, helping to further modernise their foundational data platforms and architecture.

You will need:

Demonstrable experience in Databricks Data Engineering roles, ideally in a freelance/project setting. Databricks Certifications are highly desirable.
Unity Catalog and Delta Lake experience.
Hands on Spark streaming experience - PySpark is acceptable if your experience in Spark is not at expert level.
To be an expert in handling, processing, and governing large datasets.
Experience in developing ETL/ELT pipelines, and ownership of CI/CD pipelines.
Extensive cloud tech experience (AWS is preferable).

Bonus if you have experience in:

Terraform
Kunbernetes
Infrastructure-as-code
Medallion Architecture

Important information:

Proposed start date: immediate
Rate: €80-€100 per hour depending on experience
Contract length: 6 months
Remote set up: 1-2 days per month in Frankfurt
You must be a resident in Germany (or the EU) and hold the right to work in the EU with no dependency
You must be immediately (max. 2 weeks' notice) available for this role

Apply now to find out more!