Please note that this is a contract role providing services to Microsoft through external staffing partners of Allegis Global Solutions (AGS). If you are selected for this role, you will be employed by AGS and will not be an employee of Microsoft.
Role Summary
This role is for a hands-on Data Engineer who will take full ownership of building and stabilising large-scale data pipelines using Microsoft Fabric and OneLake. The focus is on transforming fragmented, high-volume data (billions of records) into clean, reliable, and analytics-ready datasets using medallion architecture. The ideal candidate is proactive, solves data issues at the source, and ensures strong data quality, governance, and access control. They will work closely with multiple teams, design resilient pipelines, handle frequent upstream changes, and enable trusted, self-service data for business users.
Key Responsibilities
Build and maintain data pipelines using Microsoft Fabric + OneLake
Implement medallion architecture (Bronze Silver Gold)
Develop transformations using:
SQL / T-SQL
Power Query / M Query
Notebooks (Python)
Handle very large data volumes (billions of rows) efficiently
Identify and fix data issues at the source
Set up:
Data quality checks
Monitoring & alerting
Logging frameworks
Build semantic models (Power BI / Fabric) for analytics
Implement data governance + access controls (RLS, object-level, etc.)
Collaborate with:
Upstream system owners
Business/data analysts
Continuously improve pipeline reliability and scalability
Must-Have Skills
4+ years in Data Engineering
Hands-on experience with:
Strong experience in:
Experience handling large-scale datasets (billions of rows)
Strong in data transformation frameworks:
Proven ability to:
Experience with:
Hands-on with:
Self-starter mindset (can work independently without direction)
Nice-to-Have Skills
Microsoft Fabric certification
Experience with:
Exposure to enterprise data governance frameworks
Experience collaborating across multiple teams / systems
Experience Level Guidance
Additional Details:
As a workplace, Allegis Global Solutions focuses on relationships – with each other, our clients and our candidates. In fact, serving others is one of our core values. We support open communication and recognize that giving constructive criticism can be even harder than receiving it. We appreciate the fearless and the passionate, who force us to be better. Everything we do sits on a pillar of diversity, equity and inclusion - diverse perspectives, backgrounds and ideas achieve innovation and make us successful.
Please note that we may use artificial intelligence (AI) tools to screen, assess, or select applicants for this position. These tools may analyse application materials and assist our team in identifying candidates whose qualifications best match the requirements of the role. If you have questions about our use of AI in the hiring process, or would like more information, please contact us.
Pay Rate Range
303 - 341 GBP daily
