Lead Data Engineer - Pyspark / AWS / Python / SAS - Financial SectorAs a Lead PySpark Engineer, you will design, develop, and fix complex data processing solutions using PySpark on AWS. You will work hands-on with code, modernising legacy data workflows and supporting large-scale SAS-to-PySpark migrations. The role requires strong engineering discipline, deep data understanding, and the ability to deliver production-ready data pipelines in a financial services environment.Essential SkillsPySpark and Data EngineeringMinimum 5+ years of hands-on PySpark experience.SAS to Pyspark migration experienceProven ability to write production-ready PySpark code.Strong understanding of data and data warehousing concepts, including: ETL/ELT, Data models, Dimensions and facts, Data marts, SCDsSpark Performance and OptimisationStrong knowledge of Spark execution concepts, including partitioning, optimisation, and performance tuning.Experience troubleshooting and improving distributed data processing pipelines.Python and Engineering QualityStrong Python coding skills with the ability to refactor, optimise, and stabilise existing codebases.Experience implementing parameterisation, configuration, logging, exception handling, and modular design.SAS and Legacy AnalyticsStrong foundation in SAS (Base SAS, SAS Macros, SAS DI Studio).Experience understanding, debugging, and modernising legacy SAS code.Data Engineering and TestingAbility to understand end-to-end data flows, integrations, ..... full job details .....