Senior Data Engineer

Senior Data Engineer 

Not for profit organisation 

Up to £70k per annum / Private Medical / 10% Bonus 

2 days per week in Central London office 

 
The role:

• Reporting into the Head of Data & Analytics, you will be responsible for the engineering of my clients data platform, essential to the running and evolution of their event portfolio
• This involves working with databases, integrating data from API’s and building automated ingest curation data pipelines
• Azure cloud services to hydrate our core data system and downstream systems used for key business functions and analytics
• You will have extensive support to build and deliver a reliable and robust data platform
• Their core data is brought into Azure, where they leverage services like Data Lake Storage, SQL Managed Instances, DataFactory, LogicApps, FunctionApps, and code in SQL and Python
• They are also keen to introduce Snowflake as a technology to broaden our analytics capabilities and you would be involved in the buildout of this extension to their platform

 
 Key areas of responsibility:

• Collaborate with their Product, IT and Analytics teams to create a best-in-class data platform providing low-cost, actionable insights and to drive data-driven improvements across the organisation
• Architect, maintain and optimise key datasets 
• Design, build, test and deploy data solutions within an agile software development life-cycle
• Production of high quality, well tested code that can be deployed using CI/CD tooling
• Contribute to the data architecture strategy and associated roadmaps 
• Monitoring of pipelines, system resource utilisation, availability and correspond with end users to resolve queries
• Enhance the Enterprise data model (including data dictionary etc) and manage the data that is being created and updated in the system
• Understand the concepts and principles of data modelling and produce relevant data models across multiple subject areas
• Run data quality searches and resolve data issues, as well as performing daily, weekly and monthly housekeeping tasks
• Monitor data in accordance with the standards and policies outlined in the firm’s data governance framework (incl. GDPR compliance) 
• Handle production data releases

 
 Skills and experience required:

• Azure Cloud stack – Azure Data Lake, Azure Data Factory and Azure SQL
• Managed Instance or Microsoft SQL Server knowledge 
• Excellent knowledge of T-SQL (DQL and DDL – incl sequences, stored procedures, functions, views) 
• 5 or more years software development experience in a commercial data centric setting, using Python or .NET
• Good understanding of database architectures, data modelling (conceptual, logical and physical), Master Data Management principles, including data quality, lineage and taxonomies
• Experience working in an agile environment
• Strong communication skills
• Snowflake, Dynamics 365 or Power BI experience would be beneficial but not essential 

 
Required Education and Qualifications:

• 5+ years of experience in data engineering or data architecture
• Relevant Microsoft cloud qualifications a plus
  
  Other benefits:
• 25 days holiday and a ten-day Christmas shutdown
• Wellbeing allowance
• Personal Health insurance
• Excellent employer contributions into our pension scheme