Data Engineer- Databricks: SQL/Python/PySpark
Data Engineer- Databricks/SQL/Python/PySpark Location: London (Hybrid: 3 days travel to the office in Central London per week + 2 days'' work from Home) Salary- up to £56K base + pension + healthcare. Data Engineer required for one of our global clients in the UK for their BI andamp; Analytics Team. You will be working with the leading tools and platforms such as Power Platform, Databricks, ADF. Duties andamp; Responsibilities Data Pipeline development/orchestration/maintenance Creating robust, fit-for-purpose data modelling solutions to address multiple business cases Root cause analysis and pro-active investigation to identify potential issues and optimize ETL pipelines, notify end-users and propose adequate solutions Prepare documentation for further reference Software Knowledge Demonstratable delivery experience using Azure Databricks Solid delivery experience using ADF, ADLS Gen2, and the Azure Cloud Ecosystem Solid SQL skills - Querying syntax, DDL, and DML statements Solid Python skills - able to use the Python programming concepts in Databricks Notebooks for data loading, transformation, and exploration, including familiarity with Pandas Strong understanding of core Databricks and Spark concepts such as Delta Live Tables, Delta Sharing, Medallion Architecture, Dataframes, Workflows, Unity Catalogue, Delta Live Tables, and UDF''s Understands the key principles of Data Warehouse design, including Star Schema, Fandamp;D design, Dimension and Fact loading patterns, ..... full job details .....
Other jobs of interest...
Perform a fresh search...
-
Create your ideal job search criteria by
completing our quick and simple form and
receive daily job alerts tailored to you!