Role description
Lead Data Engineer (Retail)
Location: London / Nottingham (Hybrid)
Type: Contract (Inside IR35) / Fixed-Term
We’re looking for a Lead Data Engineer to deliver scalable, cloud-based data platforms within a retail environment, driving real-time insights across customer, product, and supply chain data.
Key Responsibilities:
- Lead design and delivery of enterprise data pipelines on Azure & Databricks
- Build batch and real-time data processing solutions using PySpark, Spark SQL, Python, and Kafka
- Develop and optimise ETL/ELT pipelines, data ingestion frameworks, and Lakehouse architectures (Delta Lake)
- Leverage Azure services (ADF, ADLS, Synapse, Functions, Event Hub)
- Ensure data quality, governance, and performance optimisation
- Collaborate with cross-functional teams to deliver scalable retail data solutions
- Lead technical teams, code reviews, and engineering best practices
Skills & Experience:
- Strong hands-on experience in Azure, Databricks, and modern data engineering
- Expertise in Spark (PySpark), Python, Kafka, and distributed data processing
- Experience delivering large-scale data platforms in retail domain
- Deep understanding of data warehousing, Lakehouse/Delta architecture, and data modelling
- Exposure to CI/CD, DevOps, IaC (Azure DevOps, Git, Terraform)
- Proven ability to lead delivery of cloud data modernisation programmes
What you will bring:
- Extensive IT experience with significant hands-on experience in data engineering and cloud platforms
- Strong stakeholder management and leadership capability
Hurry & apply!
#UST
Skills
data engineering,microsoft azure services,data processing,azure data lake store,
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.
