Please note, this vacancy closes at 12pm, midday, on Monday 7th September.
We reserve the right to close this vacancy early if we receive a high volume of suitable applications.
Interviews will take place as and when suitable candidates are identified.
Purpose of Role
The Data Engineer will play a key role in developing, maintaining and continually improving United Welsh's modern data platform. Working as part of the Data & Insights team, the role will help build reliable, scalable and secure data solutions that support reporting, analytics, operational decision-making and future innovation.
As United Welsh modernises its data estate and explores the future direction of its data platform, the Data Engineer will support the evaluation, testing and implementation of modern data technologies, including Microsoft Fabric and other cloud-based solutions where appropriate.
A key part of this role will be involvement in proof-of-concept and pilot activity for Microsoft Fabric. The role will help assess whether Fabric is the right long-term platform for United Welsh by testing functionality, performance, scalability, governance, security and business value before wider decisions are made.
The role will work closely with BI Partners, the Data Governance Analyst, business stakeholders and third-party suppliers to ensure quality data is available when and where it is needed. This is an opportunity to contribute to a growing data capability and help improve outcomes for colleagues and customers across South Wales.
Key Responsibilities
Data Platform Development:
-
Design, build and maintain data solutions using Microsoft Fabric, Azure Data Lakeand related Microsoft technologies where appropriate.
-
Develop and support data pipelines that ingest, transform and curate data from a range of internal and external systems.
-
Support the ongoing development of a modern Lakehouse-style architecture, including Bronze, Silver and Golddata layers.
-
Maintain and enhance trusted, reusable datasets that support reporting,analytics and operational insight.
-
Monitor and optimise platform performance, reliability, efficiency and cost awareness.
Microsoft Fabric Proof of Concept / Pilot Activity:
-
Support the design, delivery and evaluation of Microsoft Fabric proof-of-concept and pilot activity.
-
Test Fabric capabilities including Data Factory, Lakehouse, Dataflows, pipelines, semantic models and integration with Power BI.
-
Assess if the platform meets criteria such as functionality, scalability, security, governance, performance and business value.
-
Record technical findings, risks, dependencies and lessons learned to inform future platform decisions.
-
Work with the Data and Insights Manager and wider team to provide clear recommendations based on pilot outcomes.
Data Transformation & Modelling:
-
Develop transformation logic that cleanses,validates and enriches data for operational and analytical use.
-
Create and maintain reusable data sets and semantic models that support reporting and insight requirements.
-
Apply good-practice data modelling techniques, including dimensional modelling and star schema design where appropriate.
-
Work with business users to understand data requirements and translate them into scalable technical solutions.
Data Migration & System Implementation:
-
Support system implementation and data migration projects through data mapping, transformation,validation and reconciliation activity.
-
Work with business stakeholders and third-party suppliers to understand source and target system requirements.
-
Identify and help resolve data quality issues that may impact migration activity or reporting outcomes.
-
Help with repeatable migration processes, templates and validation approaches for future implementation activity.
-
Support and maintain existing migration solutions developed usingSQLServer Integration Services(SSIS), and be comfortable with working with and enhancing established migration processes where appropriate
-
Assist in the transition of migration processes from legacy approaches to modern cloud-based data engineering solutions where appropriate.
Data Quality, Governance & Documentation:
-
Maintain high standards of data quality, accuracy, completeness and consistency.
-
Build quality checks and validation processes into engineering solutions wherever possible.
-
Work closely with the Data Governance Analyst to support data standards, classifications ,lineage and quality monitoring.
-
Create and maintaint echnical documentation, including data dictionaries, schemas, process flows and solution designs.
-
Ensure data engineering activity supports organisational policies, compliance requirements and good governance practice.
Security & Compliance:
-
Implement and maintain appropriate security controls within data solutions.
-
Support role-based access controls and secure handling of sensitive information.
-
Contribute to the development of secure and well-governed data products.
-
Ensure data engineering activity aligns with GDPR and organisational data protection requirements.
DevOps & Continuous Improvement:
-
Use Git-based source control to manage code, configurations and reusable components.
-
Contribute to CI/CD processes using Azure DevOps and other platform tooling.
-
Follow agreed development standards, testing processes and change control procedures.
-
Identify opportunities to automate manual processes and improve platform efficiency.
-
Support adoption of emerging technologies, including AI-assisted development tools where appropriate.
Collaboration & Ways of Working:
-
Work collaboratively with BI Partners, the Data Governance Analyst, the Data & Insights Managerand business stakeholders.
-
Participate in Agile delivery activity, including sprint planning, reviews and retrospectives.
-
Support testing,validation and continuous improvement of data products and solutions.
-
Communicate effectively with both technical and non-technical audiences.
-
Take ownership of workload, priorities and delivery commitments.
Person Specification
Essential:
-
Experience in data engineering, ETL/ELTdevelopment and data integration.
-
Experience working with Microsoft Azure data technologies and/or equivalent modern cloud data platforms.
-
Experience with Microsoft Fabric, including Data Factory, Lakehouse,Dataflows and Semantic Models.
-
Strong knowledge of SQL and data transformation techniques.
-
Experience supporting data migration or system implementation projects.
-
Experience working with SQL Server Integration Services (SSIS) and maintaining or developing ETL solutions.
-
Experience working with cloud-based data platforms and modern data architectures.
-
Understanding of data modelling principles and analytics-ready data design.
-
Knowledge of data governance, security and data quality principles.
-
Experience using source control tools such as Git.
-
Exposure to CI/CD processes and Azure DevOps or similar tools.
-
Experience evaluating, testing or implementing new technologies, platforms or tools within a business environment.
-
Ability to work independently and manage competing priorities.
-
Strong communication and stakeholder engagement skills.
-
Ability to translate business requirements into technical solutions.
-
A proactive and continuous improvement mindset.
Desirable:
-
Experience with Microsoft Dataverse and integration of Dataverse data into reporting and analytics platforms
-
Experience participating in proof-of-concept projects, pilots or technology evaluations.
-
Experience supporting data migration or business system implementation projects.
-
Knowledge of Python, Spark or PySpark.
-
Experience developing automated data quality checks and monitoring.
-
Experience working with large operational systems and datasets.
-
Understanding of housing sector data and business processes.
-
Experience using AI-assisted engineering or automation tools.
-
Experience working in Agile delivery environments.
-
Welsh language skills
Why Join United Welsh?
You will be joining a growing Data & Insights team at an exciting stage of its data journey. United Welsh is modernising how data is collected, managed and used across the organisation, and this role will help build the trusted foundations needed for better reporting, insight and decision-making.
This role offers the chance to work across data engineering, migration, governance, automation, analytics and platform evaluation. It is particularly suited to someone who wants to broaden their experience, contribute to meaningful work and help shape how data supports services for customers and communities across Wales.
Requirements within the essential criteria of the Personal Requirements will be used for shortlisting purposes. However, all of the criteria will be considered in the process of making an appointment.
