Lead Data Engineer

Planning Inspectorate -
Bristol

Apply Now

Job details

Permanent | Full-time
£59,644 a year
5 days ago

Benefits

Annual leave
Company pension
Flexible schedule

Qualifications

Azure
DevOps
Encryption
Git
SQL
Presentation skills
Scalability
Leadership
Data warehouse
Python

Full job description

Details

Reference number

463860

Salary

£59,644

These roles attract a DDaT allowance, for details please see the section marked Salary.

A Civil Service Pension with an employer contribution of 28.97%

GBP

Job grade

Grade 7

Contract type

Permanent

Business area

PINS - Corporate Services - Digital and Data

Type of role

Architecture and Data
Digital
Engineering

Working pattern

Full-time

Number of jobs available

Location
About the job
Benefits
Things you need to know
Apply and further information

Location

Bristol

About the job

Job summary

Youll join the Planning Inspectorates Data Service as a Lead Data Engineer, working within a co-leadership model alongside the Service Manager and another Lead Data Engineer.

The Data Service underpins how data is shared, trusted and used across the organisation. In this role, youll lead the design and delivery of high quality data engineering solutions, including building and maintaining data pipelines and platforms that support analytics, decision making and operational insight. Youll also contribute to the development of a strong, sustainable data engineering capability across the organisation.

Youll play a hands-on technical leadership role - working with others to shape solutions, guide delivery, and provide technical oversight, while also supporting and developing data engineers through coaching and day-to-day collaboration. Working closely with your peers, youll help ensure the service operates effectively, manages technical risk, and continues to improve.

Job description

Were looking for a Lead Data Engineer who brings technical experience and enjoys supporting delivery through collaboration. Youll bring solid technical experience, sound engineering judgement, and the ability to support and develop others.

You should be comfortable contributing to complex data engineering work, working collaboratively within a shared leadership structure, and contributing to technical decision-making as part of a shared leadership model.

Youll take a constructive, coaching-oriented approach to leadership, be confident working with a range of stakeholders, and be motivated by building reliable, well governed data solutions in a public sector context.

Youll lead and support the design and delivery of data engineering solutions, working with the Data Service team to build, operate and improve enterprise scale data pipelines and platforms.

A significant part of your role will be supporting and developing other data engineers through technical leadership, code and design assurance, coaching and day‑to‑day guidance. Youll contribute to setting and maintaining engineering standards and contribute to continuous improvement of ways of working.

Youll work closely with the Service Manager and the other Lead Data Engineer to plan and prioritise work, manage technical risks, and engage with stakeholders to ensure solutions meet user needs and align with the wider Data Service roadmap.

Salary

New entrants to the Civil Service are expected to start on the minimum of the pay band. Internal rules apply to existing Civil Servants, i.e. level transfers move on current salary or the pay range minimum, transfers on promotion move to new pay range minimum or receive 10% increase. Either case is determined by whichever is the highest.

DDAT allowance of up to £20,756 based on Capability and base salary

Working hours:

Standard working week is 37 hours, flexible working hours policy available

Part time at 35 hours or above, flexible working hours policy available

The Planning Inspectorate has a long and proud history in ensuring a fair planning system for England. The work we do has a significant impact on peoples lives, the communities where they live and the economy.

We want our colleagues to be able to work more flexibly and more collaboratively, exploring new and innovative ways to improve the way we provide services.

For further information on the Planning Inspectorate, please visit our careers page at Civil Service Careers

Office Attendance

This role is contractually based in Bristol, 10 minute walk from Temple Meads train station. We recognise and value the mutual benefits of hybrid working and have a flexible approach to in person attendance, which can vary dependent on the requirements of individual business units - the details of which can be discussed with candidates if invited to attend an interview.

Person specification

Essential Criteria

Experience working with various Azure services and technologies relevant to data engineering, such as: Python, PySpark, Data Factory, Databricks, Synapse Analytics, SQL Database and Data Lake Storage. Understanding of how to leverage these services to build scalable and robust data solutions.
Knowledge of data warehousing principles and experience in designing and implementing data warehouse solutions using technologies like Azure Synapse Analytics (formerly Azure SQL Data Warehouse).
Proficiency in Python and SQL. Ability to write efficient and maintainable code for data ingestion, transformation, and manipulation.
Understanding of data governance principles, data security, and privacy requirements. Knowledge of Azure security features, data encryption, access controls, and compliance standards like GDPR (General Data Protection Regulation) and Data Protection Act.
Experience with DevOps practices, including continuous integration and continuous deployment (CI/CD), version control systems (e.g., Git), and infrastructure-as-code concepts. Knowledge of Azure DevOps or similar tools for managing and automating data engineering pipelines.
Experience identifying and resolving data engineering issues, optimize data pipelines, and ensure high performance and scalability of data solutions. Familiarity with monitoring tools and techniques to identify and address bottlenecks or inefficiencies.

Behaviours

We'll assess you against these behaviours during the selection process:

Leadership
Making Effective Decisions
Working Together

Technical skills

We'll assess you against these technical skills during the selection process:

Data engineering solution

Benefits

Alongside your salary of £59,644, Planning Inspectorate contributes £17,278 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

Flexible working options, including flexi-time, part-time, compressed hours and home working if suitable for the role.
A working culture which encourages inclusion and diversity.
25 days annual leave increasing by 1 day per year up to 30 days after 5 years, plus 1 privilege day to mark the Kings birthday. In addition to the normal bank holidays.
Generous family friendly policies.
Fast and modern IT kit which utilises Windows 11 and Microsoft 365, enabling seamless working from home and collaboration across teams.

Things you need to know

Artificial intelligence

Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles , and will assess your Behaviours, Experience and Technical skills.

For guidance on how to structure your application please see About the application process , Civil Service Careers

Complete the online application form on Civil Service Jobs which requires the following information:

A CV: The CV section lets you share your job history. List your jobs, how long you worked at each, and briefly describe your roles and duties. Make sure to show how your experience matches the essential criteria of the job you're applying for. Type or paste this information into the 'Employment History' box in the online application. You can't attach your CV.
Technical Example: Provide an example of a data engineering solution you have designed, built, or significantly contributed to using Python and PySpark. We are interested in how you approach data engineering in practice, including design decisions, use of tooling, and how you ensure quality and reliability. There is a 250 word limit.

All shortlisted candidates will be advised of the outcome shortly afterwards.

Interview

If you are shortlisted, you will:

Be asked to attend an interview to have a more in-depth discussion about your experience and suitability for the role
Interviews will be a blend of behaviour, experience and technical questions

Candidates who pass the shortlist stage will receive full assessment details with their interview invitations.

Other Information

Shortlist Date: w/c 22 June 2026

Interview Date: 09 July 12 July 2026

Interviews will be held at The Planning Inspectorate, Bristol, further details will be sent with the invite to interview.

The Planning Inspectorate does not fund travel and subsistence for candidates to attend interviews

Reserve list

A reserve list may be held for a period of 12 months from which further appointments can be made.

Future Matches

Candidates who demonstrate strong potential and future readiness but score just below the required level at interview may be considered for alternative positions. These roles may be at a lower grade but align with their skills and offer opportunities for growth.

We encourage all candidates to make themselves familiar with the role and what we will be assessing you against which is detailed in the Person Specification.

ID and Documents

If the job needs specific qualifications or memberships and you get the job, you'll need to send scanned or photographed images of them before you start.

We must check that any successful candidates are allowed to work for the Civil Service before we employ them. If successful, you will be asked to do a right to work check using identity document validation technology (IDVT) through the services of an Identity Service Provider (IDSP), Civil Service Jobs. If we are unable to confirm your right to work and through the IDVT we will need to do a manual right to work check using original documents with you in person.

Visa Sponsorship

The Planning Inspectorate cannot offer Visa sponsorship to candidates, we do not hold a Visa sponsorship licence.

Disability Confident Interview scheme/Reasonable Adjustments

The Civil Service values diversity and offers equal opportunities. We have a Disability Confident Interview scheme for candidates with disabilities who meet the job's minimum criteria. We will also provide reasonable adjustments to all where possible. For more information please see Reasonable Adjustments , Civil Service Careers.

Security Check

In addition to the BPSS, the level of security clearance required for this role is Security Check (SC) and the process can take a number of weeks to complete. For more details of vetting levels and requirements please refer to the Cabinet Office HMG Personnel Security Controls.

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a criminal record check.

People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

UK nationals
nationals of the Republic of Ireland
nationals of Commonwealth countries who have the right to work in the UK
nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS)
nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements

Working for the Civil Service

The Civil Service Code sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles .

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan and the Civil Service Diversity and Inclusion Strategy .

Apply and further information

This vacancy is part of the Great Place to Work for Veterans initiative.

The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment (opens in new window).

Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job contact :

Name : Aaron Beck
Email : [email protected]

Recruitment team

Email : [email protected]

Further information

If you feel your application has not been treated in accordance with the Principles and you wish to make a complaint, you should contact in the first instance: The Vacancy Manager via the Recruitment Team ([email protected]).
If you are not satisfied with the response, you receive you should then contact, Chief People Officer, via the Recruitment Team ([email protected]).
If you are still not satisfied with the response you receive from the Planning Inspectorate, you can contact the Office of the Civil Service Commission. https://civilservicecommission.independent.gov.uk/recruitment/recruitment-complaints/

Apply Now

Details

Reference number

Salary

Job grade

Contract type

Business area

Type of role

Working pattern

Number of jobs available

Contents

Location

About the job

Job summary

Job description

Person specification

Behaviours

Technical skills

Benefits

Things you need to know

Artificial intelligence

Selection process details

Security

Nationality requirements

Working for the Civil Service

Diversity and Inclusion

Apply and further information

Contact point for applicants

Job contact :

Recruitment team

Further information

Jobseeker tools

Employer Tools

Browse

Stay Connected