AWS Integration Engineer

Description

Role Title: AWS Integration Engineer

Duration: contract to run until 20/12/2025 with high likelihood dof extension

Location: Knutsford. Hybrid, 2/3 day onsite (Some onsite work will be required -London and Glasgow may also be options).

Rate: up to £414 p/d Umbrella inside IR35

Key Skills/ requirements

Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments.

Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services.

Establish best practices for cloud security, scalability, and performance.

Manage and configure vendor product deployments, ensuring the setup and maintenance of environments.

Ensure high availability, scalability, and fault tolerance of Airflow clusters.

Implement monitoring, alerting, and logging for Airflow and related components.

Perform upgrades and patches for platform-related components.

Oversee capacity planning, resource allocation, and optimization of Airflow workers.

Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control.

Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements.

Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.

Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies.

Work with stakeholders, including design, product, and executive teams, to address platform-related technical issues.

Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.?

All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply

Ad ID: 5416918722