Senior Databricks Architect/Databricks Engineer- Contract- Remote Rate- £700/day Outside IR35 Work from Home Duration- 12 months minimum (with possible extensions) This is a Senior Databricks hands-on Architect who is a Databricks engineer by trade. This is a long-term contract engagementto provide dedicated data engineering depth within the Databricks and Shared IEP Services data layer, owning delivery across these workstreams and ensuring the resulting pipelines and schemas are production-grade, governed, and maintainable by the permanent team. The contractor will operate primarily within the Databricks and Shared IEP Services data layer, owning data engineering delivery across three areas: 1) Product data ingestion - Building and maintaining daily pipelines from content and assessment products into the shared Back Office data layer. 2) AI feature enablement - Designing and maintaining the schemas and data pipelines that power LLM-based features (GenAI Goals, Bulk Upload, Evaluation Document processing), including handling of parsed, normalized, and PII-sensitive document data. 3) IEP andamp; Medicaid integration - Building and maintaining pipelines for IEP, Medicaid, and related service data into Databricks and other IEP systems. Essential Criteria 1. Medallion architecture depth - designing and maintaining Bronze, Silver, and Gold schemas and pipelines using Databricks Delta Lake, including schema evolution and enforcement. 2. Production pipeline engineering - ..... full job details .....