Contact Experis
Experis
Hadoop Engineer – ODP Platform
United Kingdom
- Hours
- Full Time
- Posted
- 18 hours ago
- Salary
- Competitive
- Recruiter
- Experis
- Closes
- 08 Sep 2025
- Course
- No
- Contract Type
- Contract
- Recruiter Type
- Direct Employer
Description
Role Title: Hadoop Engineer / ODP Platform
Location: Birmingham / Sheffield – Hybrid working with 3 days onsite per week
End Date: 28/11/2025
Role Overview:
We are seeking a highly skilled Hadoop Engineer to support and enhance our Operational Data Platform (ODP) deployed in an on–premises environment.
The ideal candidate will have extensive experience in the Hadoop ecosystem, strong programming skills, and a solid understanding of infrastructure–level data analytics. This role focuses on building and maintaining scalable, secure, and high–performance data pipelines within enterprise–grade on–prem systems.
Key Responsibilities:
Design, develop, and maintain data pipelines using Hadoop technologies in an on–premises infrastructure.Build and optimise workflows using Apache Airflow and Spark Streaming for real–time data processing.Develop robust data engineering solutions using Python for automation and transformation.Collaborate with infrastructure and analytics teams to support operational data use cases.Monitor and troubleshoot data jobs, ensuring reliability and performance across the platform.Ensure compliance with enterprise security and data governance standards.
Required Skills & Experience:
Minimum 5 years of experience in Hadoop and data engineering.Strong hands–on experience with Python, Apache Airflow, and Spark Streaming.Deep understanding of Hadoop components (HDFS, Hive, HBase, YARN) in on–prem environments.Exposure to data analytics, preferably involving infrastructure or operational data.Experience working with Linux systems, shell scripting, and enterprise–grade deployment tools.Familiarity with monitoring and logging tools relevant to on–prem setups.
Preferred Qualifications:
Experience with enterprise ODP platforms or similar large–scale data systems.Knowledge of configuration management tools (e.g., Ansible, Puppet) and CI/CD in on–prem environments.Understanding of network and storage architecture in data centers.Familiarity with data security, compliance, and audit requirements in regulated industries.
Ad ID: 5416925806
Stay Safe
"Be wary of buyers asking to use 'Gumtree delivery' or 'Payments on Gumtree' because Gumtree doesn't offer these services currently. Requests from Whatsapp or SMS could be scams"
"Only access Gumtree from gumtree.com and do not follow links sent by other users"
"Share photos and ask lots of questions about the items you are buying and selling"
"If an ad or reply sounds too good to be true, it probably is"
"Use the 'Reply to ad' button for your safety and privacy"
"Don't reply to email addresses hidden in text and pictures"
"Trade in person, use PayPal 'paying for an item or service' to transfer money"
"Beware of fake Gumtree, eBay or escrow sites and invoices"
1 of 8
