Contact JAM Recruitment Ltd
JAM Recruitment Ltd
Data Engineer
North London, London
- Hours
- Full Time
- Posted
- 11 hours ago
- Salary
- £650 - 745 - Day
- Recruiter
- JAM Recruitment Ltd
- Closes
- 13 Oct 2025
- Course
- No
- Recruiter Type
- Direct Employer
Description
eSC Cleared Data Engineer
Bristol or London (Mostly working from home)
Up to £745 per day (Umbrella, Inside IR35)
Must hold live and transferrable Enhanced SC Security Clearance
About the Role
We're seeking an experienced Data Engineer to join a high-profile programme, working with cutting-edge cloud and data technologies. You'll be instrumental in building, optimising, and maintaining scalable data pipelines and platforms that underpin mission-critical systems.
If you thrive on solving complex data challenges, working with modern orchestration tools, and applying best practices in security and compliance, this role offers both technical depth and impact.
Key Responsibilities
Design & Optimise Pipelines - Build and refine ETL/ELT workflows using Apache Airflow for orchestration.
Data Ingestion - Create reliable ingestion processes from APIs and internal systems, leveraging tools such as Kafka, Spark, or AWS-native services.
Cloud Data Platforms - Develop and maintain data lakes and warehouses (e.g., AWS S3, Redshift).
Data Quality & Governance - Implement automated validation, testing, and monitoring for data integrity.
Performance & Troubleshooting - Monitor workflows, enhance logging/alerting, and fine-tune performance.
Data Modelling - Handle schema evolution, partitioning strategies, and efficient data structures.
CI/CD for Data - Work with DevOps teams to integrate pipelines into robust CI/CD processes, managing version control for DAGs and configurations.
Security & Compliance - Apply encryption, access control (IAM), and GDPR-aligned data practices.
Technical Skills & Experience
Proficient in Python and SQL for data processing.
Solid experience with Apache Airflow - writing and configuring DAGs.
Strong AWS skills (S3, Redshift, etc.).
Big data experience with Apache Spark.
Knowledge of data modelling, schema design, and partitioning.
Understanding of batch and streaming data architectures (e.g., Kafka).
Experience with Docker and/or Kubernetes.
Familiarity with Microsoft SQL Server Stack (SQL Server, SSIS, C#, T-SQL), Elastic/OpenSearch.
Interested?
If you're ready to bring your data engineering expertise to a technically challenging and rewarding programme, apply now with your CV
Ad ID: 5416941856
Stay Safe
"Be wary of buyers asking to use 'Gumtree delivery' or 'Payments on Gumtree' because Gumtree doesn't offer these services currently. Requests from Whatsapp or SMS could be scams"
"Only access Gumtree from gumtree.com and do not follow links sent by other users"
"Share photos and ask lots of questions about the items you are buying and selling"
"If an ad or reply sounds too good to be true, it probably is"
"Use the 'Reply to ad' button for your safety and privacy"
"Don't reply to email addresses hidden in text and pictures"
"Trade in person, use PayPal 'paying for an item or service' to transfer money"
"Beware of fake Gumtree, eBay or escrow sites and invoices"
1 of 8