Data Engineer – Microsoft Fabric & Analytics Platform, based in our Cardiff office.
About the Role
We are seeking a Data Engineer to join our Business Intelligence team and help shape the next generation of our enterprise analytics platform.
Our team is responsible for designing, developing, and maintaining the organisation's data platform, transforming data from multiple business systems into trusted, accessible, and actionable information. We work closely with stakeholders across the business to deliver scalable data solutions and intuitive Power BI reporting that support data-driven decision making.
We are currently evolving our architecture towards a modern Microsoft Fabric-based platform, leveraging Lakehouse and Delta Lake technologies to create a high-performance, scalable analytics environment capable of processing large volumes of data efficiently. This platform will form the foundation of future reporting, analytics, and data products across the organisation.
This role will play a key part in designing and building data ingestion pipelines, transforming and modelling data, and establishing best practices for our growing data platform.
Key Responsibilities
- Design, develop, and maintain data pipelines using Microsoft Fabric and Azure technologies.
- Build and optimise Delta Lake and Lakehouse solutions for large-scale analytical workloads.
- Integrate data from multiple source systems, including Dynamics 365 CE, Dynamics 365 Finance & Operations, and other enterprise applications.
- Design and implement scalable data models to support reporting and analytics requirements.
- Develop robust data transformation, validation, and quality assurance processes.
- Work closely with business stakeholders, analysts, and report developers to understand data requirements and deliver effective solutions.
- Support the creation of high-quality, user-friendly Power BI datasets and reporting solutions.
- Maintain documentation covering data lineage, architecture, transformations, and business rules.
- Contribute to data governance, security, and platform best practices.
- Identify opportunities to improve platform performance, scalability, and maintainability.
Essential Skills & Experience
Data Engineering
- Experience designing and developing data pipelines and ETL/ELT processes.
- Strong SQL skills with experience working on large datasets.
- Experience working with structured and semi-structured data sources such as SQL databases, JSON, CSV, XML, and APIs.
- Understanding of data modelling principles and analytical data structures.
- Experience troubleshooting data quality and performance issues.
Microsoft Data Platform
- Experience with Microsoft Fabric, Azure Synapse, Azure Data Factory, Databricks, or similar modern data platforms.
- Experience working with Lakehouse architectures and Delta Lake technologies.
- Understanding of cloud-based data storage and processing concepts.
- Experience implementing Medallion architecture in a Lakehouse.
- Experience with Python, Spark, or PySpark.
Reporting & Analytics
- Understanding of how data structures support Power BI and analytical reporting.
- Experience preparing data for consumption by reporting and analytics teams.
Soft Skills
- Strong problem-solving and analytical skills.
- Excellent communication and stakeholder engagement abilities.
- Ability to work independently while collaborating effectively within a team.
- Desire to learn and adapt to evolving technologies and business requirements.
Desirable Skills & Experience
- Experience with Dynamics 365 Customer Engagement (CE).
- Experience with Dynamics 365 Finance & Operations (F&O).
- Knowledge of Kimball methodology, dimensional modelling, fact tables, and dimension tables.
- Experience with Power BI semantic models and performance optimisation.
- Experience with source control and DevOps practices.
What We're Looking For
We're looking for someone who enjoys solving data problems, building scalable solutions, and working with modern cloud-based analytics technologies. The ideal candidate will be passionate about creating a robust data platform that enables the business to make better decisions through trusted, accessible data.
