Python Work, Jobs in Esh, Dur (with Salaries)

Data Engineer (SC Cleared)
Scrumconnect Consulting —Newcastle upon Tyne
- £400 - £450 a week
- Hybrid work
- Data analysis skills
- SQL
- AWS
Automation QA Engineer
Causeway Technologies —Middlesbrough
- Hybrid work
- Azure
- Management
- Data analysis skills
- Annual leave
- Employee assistance programme
Quick apply
13d
DevOps Engineer
Everflow —Peterlee
- £39,400 - £63,000 a year
- Full-time
- Azure
- Scripting
- Linux
Postdoctoral Research Associate
Durham University —Durham
- £38,784 - £41,064 a year
- Full-time
- Doctoral degree
- Engineering
- University
- Annual leave
- Employee assistance programme
4d
AI Engineer
Version 1 —Newcastle upon Tyne
- Full-time
- Hybrid work
- Azure
- DevOps
- Master's degree
- Employee assistance programme
- Employee discount
Quick apply
20h
Applications Engineer
iamproperty & iamsold —Newcastle upon Tyne
- Full-time
- Salesforce
- Analysis skills
- Continuous improvement
- Annual leave
Quick apply
Test Automation Engineer
Version 1 —Newcastle upon Tyne
- Full-time
- Java
- AWS
- JavaScript
- Employee assistance programme
- Employee discount
Quick apply
Technical Artist d3t - 12 Month Contract
Keywords Studios —Gateshead
- Hybrid work
- C++
- Scripting
- APIs
- Free parking
- Flexible schedule
Quick apply
Automation Test Engineer
Version 1 —Newcastle upon Tyne
- Full-time
- Hybrid work
- Java
- AWS
- APIs
- Employee assistance programme
- Employee discount
Quick apply
Senior Software Engineer - FTC
Public Library of Science —Newcastle upon Tyne
- £65,000 - £142,000 a year
- Remote
- Computer Science
- Bachelor's degree
- Machine learning
- Annual leave
Oliver Wyman - Data & Analytics Research Fellowship - Newcastle upon Tyne
Oliver Wyman —Newcastle upon Tyne
- Full-time
- Doctoral degree
- English
- Machine learning
Embedded Design Engineer - FPGA Academy
Leonardo UK Ltd —Newcastle upon Tyne
- £37,400 - £71,400 a year
- Full-time
- Hybrid work
- Doctoral degree
- Engineering
- Master's degree
- Flexible schedule
- Referral programme
Cloud Platform Engineer
NECSWS —Hartlepool
- Full-time
- Hybrid work
- Azure
- DevOps
- AWS
- Annual leave
Quick apply
Research Assistant / Associate in immunology
Newcastle University —Newcastle upon Tyne
- £33,951 - £46,049 a year
- Full-time
- Doctoral degree
- Master's degree
- University
4d
Commercial Insights Analyst
Sunderland Association Football Club —Sunderland
- Full-time
- SQL
- AWS
- In-person
Quick apply
7d
Commercial Energy Consultant
Business Bots UK LTD —Newcastle upon Tyne
- £28,811 - £47,022 a year
- Full-time
- Data analysis skills
- Presentation skills
- Organisational skills
- Free parking
Quick apply
Senior Technical Artist d3t - 12 Month Contract
Keywords Studios —Gateshead
- Hybrid work
- C++
- Scripting
- APIs
- Free parking
- Flexible schedule
Quick apply
Lead Full Stack Engineer (AI/Agentic)
hedgehog lab —Newcastle upon Tyne
- Hybrid work
- Master's degree
- AWS
- APIs
- Annual leave
Quick apply
3d
Test Engineer (SC Cleared)
Scrumconnect Consulting —Newcastle upon Tyne
- £50,000 - £55,000 a year
- Java
- SQL
- AWS
Senior Full Stack Engineer (AI/Agentic)
hedgehog lab —Newcastle upon Tyne
- Hybrid work
- AWS
- APIs
- Python
- Annual leave
Quick apply
3d

I want to receive the latest job alerts for python in esh, dur

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

python jobs near esh, dur

Data Engineer (SC Cleared)

Scrumconnect Consulting
Newcastle upon Tyne

Apply Now

Job details

£400 - £450 a week

Qualifications

Data modelling
Cloud infrastructure
Data structures
Spark
Encryption
Data analysis skills
SQL
AWS
Analysis skills
Docker
Terraform
Natural language processing
S3
Apache
Root cause analysis
AI
GitLab
Python

Full job description

Job Information

Date Opened

14/05/2026

Job Type

Contract

Industry

Government & Public Sector

Work Experience

5+ years

Salary

400-450 Inside IR35

City

Newcastle upon Tyne

Province

Tyne and Wear

Country

United Kingdom

Postal Code

NE1

Job Description

Apache Spark · Python · AWS · Cloud Data Pipelines

A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets in a modern, cloud-native environment.

About Scrumconnect

Scrumconnect is a leading UK technology consultancy delivering digital transformation across public and private sectors, contributing to over 20% of the UK’s major citizen-facing public services. We specialise in cloud engineering, data platforms, and agile delivery, helping clients build scalable, secure, and user-centred digital solutions that create real impact.

Active SC clearance is a mandatory, non-negotiable requirement. Candidates must hold current, in-date Security Check (SC) clearance at the time of application. Sponsorship is not available. Applications without active SC clearance will not be considered.

Working arrangement:
This role is hybrid. Candidates must be willing and able to travel to the London office three days per week. Remaining days may be worked remotely from anywhere in the UK.

About the role

You will work as a Data Engineer on a complex, cloud-based data programme — designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics, you will help deliver reliable, well-governed data assets to downstream users.

You will apply strong data analysis skills to identify root causes of data issues, work with dimensional data models and slowly changing dimensions, and implement infrastructure as code using Terraform. Familiarity with DWP engineering best practices and the ability to translate customer expectations into applied technical functionality are key to success in this role.

Key responsibilities

Data pipeline development

Build and maintain scalable data pipelines using Apache Spark and PySpark, processing and transforming large datasets across distributed cloud infrastructure.

Workflow orchestration

Configure and manage Apache Airflow DAGs for task orchestration, ensuring reliable scheduling, monitoring, and execution of data processing workflows.

Root cause analysis

Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues — including reviewing EMR output logs and CloudWatch metrics.

Data modelling

Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured, analytically trusted data assets.

Infrastructure as code

Provision and manage cloud infrastructure using Terraform. Containerise solutions using Docker and manage deployments through GitLab CI/CD pipelines and release tagging.

Security & encryption

Apply understanding of both server-side and client-side encryption patterns within AWS. Work within IAM policies and data governance standards appropriate to a regulated government environment.

Technical skills required

Languages & analytics

Python — primary language for pipeline development and data processing
SQL — used for querying, transformation, and validation across data stores
PySpark — for distributed data processing using Apache Spark on AWS EMR
Familiarity with basic data structures for constructing robust, scalable solutions

Data processing & orchestration

Apache Spark — understanding of distributed data processing architecture and execution
Apache Airflow — configuring DAGs and managing task orchestration at scale
Jupyter Notebooks — for exploratory data analysis and pipeline prototyping
Understanding of dimensional data models and slowly changing dimensions (SCD Types 1, 2, 3)
Data analysis skills to identify root cause of issues within pipelines and data assets

AWS services

Amazon EMR — running Spark workloads and reviewing output logs
Amazon Athena — ad hoc querying of data in S3
Amazon Textract and Comprehend — familiarity with AI/ML document extraction and NLP services
AWS S3, IAM, CloudWatch, EC2, ECR — core platform services used day-to-day
AWS console proficiency — navigating, configuring, and monitoring services
Understanding of server-side and client-side encryption within AWS

Infrastructure, DevOps & delivery

Terraform — Infrastructure as Code for provisioning and managing AWS environments
Docker — containerisation of data engineering solutions
GitLab — source code management, CI/CD pipeline configuration, release tagging, and component versioning
Familiarity with DWP engineering best practices
Ability to translate customer expectations into applied, functional technical solutions

Technology stack at a glance

PythonPySparkSQLApache SparkApache AirflowJupyter NotebooksDimensional modelling / SCDAWS EMRAmazon AthenaAWS S3AWS IAMAWS CloudWatchAWS EC2 / ECRAmazon TextractAmazon ComprehendTerraformDockerGitLab CI/CDGitLab Tags

Apply Now

Refine Your Search

python jobs in esh, dur

Data Engineer (SC Cleared)

Automation QA Engineer

DevOps Engineer

Postdoctoral Research Associate

AI Engineer

Applications Engineer

Test Automation Engineer

Technical Artist d3t - 12 Month Contract

Automation Test Engineer

Senior Software Engineer - FTC

Oliver Wyman - Data & Analytics Research Fellowship - Newcastle upon Tyne

Embedded Design Engineer - FPGA Academy

Cloud Platform Engineer

Research Assistant / Associate in immunology

Commercial Insights Analyst

Commercial Energy Consultant

Senior Technical Artist d3t - 12 Month Contract

Lead Full Stack Engineer (AI/Agentic)

Test Engineer (SC Cleared)

Senior Full Stack Engineer (AI/Agentic)

I want to receive the latest job alerts for python in esh, dur

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected