Lead Data Engineer (Cloud)
Job Title: Lead Data Engineer (Cloud) Location: Preston, Yeovil, Portsmouth, Glasgow or Frimley - We offer a range of hybrid and flexible working arrangements - please speak to your recruiter about the options for this particular role Salary: £55,000 depending on skills and experience What you''ll be doing: Building and operating ingestion pipelines into the lakehouse Developing Spark transformation jobs and reusable pipeline patterns Orchestrating workflows in Airflow (raw > bronze > silver > gold) Implementing manifest-driven transformation using JSON configuration stored in MongoDB or CosmosDB Maintaining Delta Lake tables and trouble shoot pipeline reliability/performance Your skills and experiences: Deep understanding of modern data engineering principles , data lifecycle, and enterprise-scale architecture. Strong knowledge of data governance, metadata management , and quality frameworks, with ability to enforce standards. Extensive experience managing and scaling data across hybrid environments (on-prem and cloud), particularly Azure and Databricks. Benefits: As well as a competitive pension scheme, BAE Systems also offers employee share plans, an extensive range of flexible discounted health, wellbeing and lifestyle benefits, including a green car scheme, private health plans and shopping discounts - you may also be eligible for an annual incentive. The Data team: This is an opportunity to join a new part of the business, undertaking a new piece of work, ..... full job details .....
Other jobs of interest...
Perform a fresh search...
-
Create your ideal job search criteria by
completing our quick and simple form and
receive daily job alerts tailored to you!