Senior Data Engineer

London, Greater London, South East, England

Posted:17 days ago
Sector:Data & Analytics
Location:London, Greater London, South East, England
Job Ref:BH-37781
Job Type:Permanent
Salary:£70000 per annum
Expiry date:6/5/2023
Contact:Louis Pakarian
Senior Data Engineer 

Not for profit organisation 

Up to £70k per annum / Private Medical / 10% Bonus 

2 days per week in Central London office 

The role:
  • Reporting into the Head of Data & Analytics, you will be responsible for the engineering of my clients data platform, essential to the running and evolution of their event portfolio
  • This involves working with databases, integrating data from API’s and building automated ingest curation data pipelines
  • Azure cloud services to hydrate our core data system and downstream systems used for key business functions and analytics
  • You will have extensive support to build and deliver a reliable and robust data platform
  • Their core data is brought into Azure, where they leverage services like Data Lake Storage, SQL Managed Instances, DataFactory, LogicApps, FunctionApps, and code in SQL and Python
  • They are also keen to introduce Snowflake as a technology to broaden our analytics capabilities and you would be involved in the buildout of this extension to their platform
 Key areas of responsibility:

  • Collaborate with their Product, IT and Analytics teams to create a best-in-class data platform providing low-cost, actionable insights and to drive data-driven improvements across the organisation
  • Architect, maintain and optimise key datasets 
  • Design, build, test and deploy data solutions within an agile software development life-cycle
  • Production of high quality, well tested code that can be deployed using CI/CD tooling
  • Contribute to the data architecture strategy and associated roadmaps 
  • Monitoring of pipelines, system resource utilisation, availability and correspond with end users to resolve queries
  • Enhance the Enterprise data model (including data dictionary etc) and manage the data that is being created and updated in the system
  • Understand the concepts and principles of data modelling and produce relevant data models across multiple subject areas
  • Run data quality searches and resolve data issues, as well as performing daily, weekly and monthly housekeeping tasks
  • Monitor data in accordance with the standards and policies outlined in the firm’s data governance framework (incl. GDPR compliance) 
  • Handle production data releases
 Skills and experience required:

  • Azure Cloud stack – Azure Data Lake, Azure Data Factory and Azure SQL
  • Managed Instance or Microsoft SQL Server knowledge 
  • Excellent knowledge of T-SQL (DQL and DDL – incl sequences, stored procedures, functions, views) 
  • 5 or more years software development experience in a commercial data centric setting, using Python or .NET
  • Good understanding of database architectures, data modelling (conceptual, logical and physical), Master Data Management principles, including data quality, lineage and taxonomies
  • Experience working in an agile environment
  • Strong communication skills
  • Snowflake, Dynamics 365 or Power BI experience would be beneficial but not essential 
Required Education and Qualifications:
  • 5+ years of experience in data engineering or data architecture
  • Relevant Microsoft cloud qualifications a plus

    Other benefits:
  • 25 days holiday and a ten-day Christmas shutdown
  • Wellbeing allowance
  • Personal Health insurance
  • Excellent employer contributions into our pension scheme

Apply now