Data Architect

Description

Data Architect (Databricks)

Location: Remote (UK)

Rate: £700 per day Inside IR35

Duration: 12 months

Overview

We're looking for a hands-on Data Architect to design a scalable, secure data architecture on AWS, with Databricks as the central engine for all processing and transformation. Data models and tooling are already set, so this role is all about getting the most out of Databricks. You'll shape the technical design, set governance standards and mentor a team of experienced ETL engineers who are new to Databricks.

Key Responsibilities

Translate project requirements into technical designs that deliver high-performance, cost-effective pipelines

Bring together source data from files and databases into a single AWS and Databricks platform

Ensure data is delivered in line with predefined silver and gold models in a Medallion architecture

Make the right Databricks choices, including storage modes and compute cluster configuration

Define governance standards, including roles and responsibilities across Databricks and downstream data users

Work with other architects on best practice for data quality and observability

Mentor data engineers new to Databricks through hands-on guidance, training and reusable patterns

Key Requirements

Strong AWS experience

Deep hands-on Databricks experience, including xjnqpsq performance and cost optimisation

Proven experience delivering Medallion architecture

Strong ETL background

Experience setting data governance standards

Confident mentoring and upskilling engineering teams

Desirable

Unity Catalog

PySpark and Spark performance tuning

Delta Lake

Data quality and observability tooling

Experience leading a team's move onto Databricks

Apply now or email for more information

Ad ID: 5419349663