Azure Data Engineer - Remote (Permanent)

This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client service, intelligent risk taking and superior risk adjusted returns for our shareholders. We also proudly maintain an entrepreneurial, disciplined and ethical corporate culture. All qualified applicants will receive consideration for employment without regard to race, color, religion or creed, sex, pregnancy, sexual orientation, gender identity or expression, national origin or ancestry, citizenship, physical or mental disability, age, marital status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process.The Data and Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our data architecture, ensuring efficient data integration, and enabling advanced analytics to support critical business decisions. This role will enhance the department''s ability to deliver high-quality analytics and maintain robust data infrastructure.As a Senior Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data storage and processing solutions on the Azure platform. You will work with modern data warehouse (MDW) technologies, big data, and Lakehouse architectures to ensure our data solutions are secure, efficient, and optimized.Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage.Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. - Develop, test and build CI/CD pipelines using Azure DevOps to automate deployment and monitoring of data solutions to all environments. Provide knowledge sharing to data operations teams on release management and maintenance.
Manage platform administration, ensuring optimal performance, availability, and scalability of Azure data services.Implement end-to-end data pipelines, ensuring data quality, data integrity and data security.Troubleshoot and resolve data pipeline issues while ensuring data integrity and quality.Implement and enforce data security best practices, including role-based access control (RBAC), encryption, and compliance with industry standards.Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.Monitor and optimize Databricks performance, including cost management guidance and cluster tuning.Assist data analysts with technical input.We encourage you to bring your own experience and expertise to the table, so while there are some qualifications and experiences, we need you to have, we are open to discussing how your individual knowledge might lend itself to fulfilling this role and help us achieve our goals.5 plus years Azure and Data Engineering Expertise:- Proven experience in designing and managing large-scale data solutions on Microsoft Azure.- In-depth knowledge of setting up, configuring, and utilizing Unity Catalog for robust data governance, access control, and metadata management in a Databricks environment.- Demonstrated ability to optimize and tune Databricks notebooks and workflows to maximize performance and efficiency. Experience with performance troubleshooting and best practices for scalable data processing is essential.- Strong problem-solving skills, ability to work in agile environments, and effective collaboration with cross-functional teams.- Experience with implementing a Data Lakehouse solution with Azure Databricks, data modeling, warehousing, and real-time streaming.- Strong experience with Azure Data Factory (ADF) for data integration and orchestration.- Hands-on experience with Azure DevOps, including pipelines, repos, and infrastructure as code (IaC).- Solid understanding of platform administration, including monitoring, logging, and cost management.- Knowledge of data security, compliance, and governance in Azure, including Azure Active Directory (AAD), RBAC, and encryption.- Experience working with big data technologies (Spark, Python, Scala, SQL).- Excellent communication skills with the ability to collaborate with cross-functional teams to understand requirements, data solutions, data models and mapping documents.
Azure Data Engineer Associate, Azure Solutions Architect).Experience integrating Azure Data Services with Power BI and AI/ML workflows.The position is full-time with remote work options, requiring in-office presence three days per weekYou will be eligible for a comprehensive and competitive benefits package which includes medical plans for you and your family, health and wellness programs, retirement plans, tuition reimbursement, paid annual leave, and much more.
Other jobs of interest...
Perform a fresh search...
-
Create your ideal job search criteria by
completing our quick and simple form and
receive daily job alerts tailored to you!