Come and join one of the UK’s largest providers in complex care. We proudly employ over 4000+ people - no matter what your experience, we have jobs for everyone.
We are looking for a Data Engineer to join our small development team and take ownership of the data pipelines and integrations that underpin reporting and operations across the business. You will work closely with the Head of Software Engineering, building and maintaining the systems that move data from a wide range of source platforms into our Snowflake data warehouse, and supporting the applications that depend on it.
This is a hands-on role with significant autonomy. As the dedicated data engineer in the team, you will own work end to end: from investigating a new source system and designing the integration, through to building, testing, scheduling and supporting it in production. The estate is broad and the work is varied, so we are looking for someone who is confident working independently and getting to the bottom of things.
Where you'll be working:
This role is full time, 37.5 hours per week. The role is remote with occasional travel to London.
What you'll be doing:
- Build, maintain and monitor data pipelines that ingest data from a wide range of source systems into the Snowflake data warehouse, using both scheduled batch and API-based methods.
- Design and deliver new integrations end to end, including source investigation, data modelling, development, testing and production scheduling.
- Investigate and resolve pipeline failures and data quality issues, identifying root cause from logs and evidence.
- Maintain and improve existing ETL jobs, including load strategy, scheduling, performance and warehouse cost management.
- Work independently and with BI developers to develop and support the data models that feed reporting and internal applications, ensuring accuracy and reliability.
- Contribute to wider engineering and infrastructure activity, including cloud-hosted services and data security and compliance work.
- Document pipelines and integrations to support maintainability and handover within the team.
What you'll have:
- Demonstrable commercial experience designing and maintaining production data pipelines, ideally against a cloud data warehouse such as Snowflake, BigQuery or Redshift.
- Strong SQL, including the ability to reason about load strategy and query performance.
- Proficiency in Python for data engineering, including API integration, scripting and orchestration.
- Experience integrating data from a variety of sources, including relational databases, REST APIs and file-based feeds (CSV, SFTP).
- Strong problem solving and diagnostic skills, with the ability to investigate issues and propose clear solutions.
- The ability to work independently and own deliverables in a small team.
- Excellent written and verbal communication.
Desirable skills and experience
- Experience with Talend or a comparable ETL tool such as Matillion.
- Experience with Talend Management Cloud or similar orchestration frameworks.
- Experience with Microsoft Azure, especially Logic Apps.
- Experience with the Microsoft Graph API, SharePoint or Power Automate.
- Awareness of data security and compliance frameworks.
- Experience working in a regulated sector such as healthcare, social care or finance.
