Lead Data Engineer
Location: Flexible / Hybrid
Type: Permanent
Required Background
- 12+ years' experience delivering enterprise data and analytics solutions
- Proven track record owning end-to-end data architecture and complex technical initiatives
- Experience designing and delivering production-grade data platforms and shared data products
- Strong background translating complex business requirements into scalable data solutions
- Experience establishing engineering standards, best practices, and architectural governance
- Ability to work across multiple business domains and stakeholder groups
- Strong ownership mindset with experience leading technical design through to production delivery
Technical Skills
- Expert SQL
- Databricks Lakehouse architecture
- dbt
- PySpark
- Data architecture and solution design
- Data modelling and transformation frameworks
- Semantic layer design and implementation
- Data pipeline development and optimisation
- Unity Catalog
- Data governance and access controls
- Column-level security and PII management
- Data lineage and metadata management
- DataHub
- CI/CD and deployment practices
- Data observability and monitoring
- Testing frameworks and data quality controls
Nice to Have
- Experience supporting AI, machine learning, or conversational analytics workloads
- Experience designing reusable enterprise data products
- Knowledge of modern data governance frameworks
- Experience implementing data discovery and self-service analytics capabilities
- Exposure to large-scale cloud data platforms
- Experience building enterprise-wide reporting and analytics foundations
- Strong understanding of platform engineering and data product operating models
Key Responsibilities
- Architect and deliver enterprise data products end-to-end
- Design scalable data pipelines, models, and transformation frameworks
- Build and evolve semantic layers supporting reporting, analytics, and AI use cases
- Define and implement data governance, security, lineage, and ownership standards
- Establish engineering standards for quality, testing, documentation, and maintainability
- Drive platform observability, CI/CD, and data quality best practices
- Model complex business domains and create reusable data assets
- Own technical delivery from design through deployment and continuous improvement
Ideal Candidate
- Senior technical leader with deep data engineering and architecture expertise
- Strong hands-on capability across modern cloud data platforms
- Comfortable operating in complex enterprise environments
- Excellent problem-solving and stakeholder management skills
- Passionate about building scalable, governed, and reusable data products
- Able to balance strategic architecture with hands-on technical delivery