Data Engineer

Data Engineer - Energy Industry

Industry: Oil & energy
Location: London, United Kingdom (Hybrid: 3 days on-site, 2 days work from home)
Rate: £550 per day, DOE
Contract length: 6 months initially

Job Overview: We are seeking a Data Engineer to join our exciting energy trading client in working across their cloud-based big data platform. You will be joining this ambitious project from Stage One, using your knowledge of data pipelines, management, and analysis to automate and optimise business and data science projects across the company.

Primary Responsibilities

• Construct, test, and maintain optimal data pipelines.
• Solve challenging integration problems, using optimal ETL and ELT patterns and techniques, sourced both from structured and unstructured data sources.
• Extracting, cleansing, and transferring data for prescriptive and predictive modelling.
• Optimise pipelines, dashboards, and systems to facilitate development and analytical utilisation.
• Develop data visualisation dashboards & work with data scientists to build out scalable AI and ML models.

Qualifications

• Degree in Computer Science, Data Science, or related field.
• 2+ years' experience with data services on the cloud (Azure, AWS, GCP).
• Hands-on experience with Python and Python-related data tools, such as Pandas; strong experience with PySpark.
• Experience writing data pipelines (ETL and ELT).
• Experience with SQL (TSQL, ANSI SQL, Spark SQL, etc.).
• Background in Investment Banking, Oil & Gas, or Commodity trade.

How to Apply: If you are right for this role and it's of interest, we would love to hear from you! Please apply with an up-to-date CV or get in touch with Damian Marlow @ Source Technology.