Senior Data Engineer

Greater London, South East, England

Apply by 2 Dec 2026

£95000 - £110000 per annum

Job Ref.: BH-58449

Job Description

Senior Data Engineer

Location: London
Type: Permanent

Required Background

  • 10+ years' experience in Data Engineering, ideally within the insurance sector
  • Proven experience delivering enterprise data platforms and business-facing data products
  • Strong stakeholder management skills with the ability to work across business and technology teams
  • Experience working with underwriters, actuaries, or other business stakeholders
  • Strong understanding of data modelling, data governance, and Agile delivery methodologies
  • Excellent communication skills with the ability to explain technical concepts to non-technical audiences
  • Bachelor's degree in a technical, scientific, mathematical, or business-related discipline (or equivalent experience)

Technical Skills

  • Advanced SQL and PySpark
  • Azure Databricks and Delta Lake
  • Data lakehouse architectures and Medallion Architecture (Silver & Gold layers)
  • Data modelling and transformation design
  • Power BI reporting and dashboard development
  • Databricks Dashboards
  • Data quality management and troubleshooting
  • Semantic layer and consumption layer development
  • Azure data platform technologies
  • Agile/Scrum delivery practices
  • Version control and modern development workflows
  • Strong understanding of data governance principles

Nice to Have

  • Insurance industry experience, particularly specialty insurance, delegated authority, or large-risk environments
  • Databricks Unity Catalog
  • Experience with AI, LLMs, and Retrieval-Augmented Generation (RAG)
  • Databricks Genie experience
  • Dimensional modelling, including Star Schemas and Slowly Changing Dimensions (SCDs)
  • Databricks Certified Data Engineer certification
  • Microsoft Azure Data Engineer Associate certification

Key Responsibilities

  • Design, develop, and maintain data products within an Azure Databricks lakehouse environment
  • Build and optimise Silver and Gold layer transformations using Medallion Architecture principles
  • Contribute to data modelling and architecture discussions
  • Investigate and resolve data quality and platform issues
  • Develop reporting and analytics solutions using Power BI and Databricks
  • Partner with business and technical stakeholders to deliver high-quality data products
  • Support code reviews, modelling reviews, and engineering best practices
  • Ensure solutions are scalable, reusable, and aligned with governance standards
  • Communicate technical solutions, trade-offs, and recommendations to stakeholders

By applying for this role, you consent to SGI contacting you by telephone regarding recruitment services, market updates, and relevant business opportunities

We believe in equal opportunity for all and actively encourage applications from diverse backgrounds, experiences, and perspectives.

Source Group International Ltd is acting as an Employment Business in relation to this vacancy

APPLY NOW

Similar Jobs.

QA / Test Lead – CTRM Transformation
Geneva, Switzerland

For our customer within Capital Markets we are seeking a Murex CTRM QA Test Lead Role Overview Lead end-to-end test management for a Murex CTRM SaaS transformation covering physical and financial trad

Market Data Team Lead
London, Greater London, South East, England

Market Data Team Lead Initial 6 Month Contract with Extentions Hybrid Working Model, with 2 days in office a Week in Central London Rate - DOE (Umbrella) About the Opportunity A Tier 1 Investment Ban

Elastic/ Observability Engineer
Egg b. Zürich, Switzerland

Freelance Elastic / Observability Engineer |/ Zurich or Remote if Travel can be arranged Seeking an experienced engineer to design and improve enterprise-scale observability and monitoring solutions.