Big data lead Work, Jobs in London, Eng (with Salaries)

Big Data Lead
FalconSmartIT —Wimbledon
- DevOps
- SQL
- AWS
Quick apply
Lead Data Analyst
HelloFresh —London
- Hybrid work
- Microsoft Excel
- SQL
- Analysis skills
- Work from home
- Employee assistance programme
Quick apply
13d
Lead Data Consultant
Atos —Balham
- Call to connect
- AI
- Annual leave
Data Solution Architect
Redhorse International —London
- £51,355.35 - £106,846.96 a year
- Full-time
- In-person
- Leadership
- Store discount
- Flexitime
Quick apply
Senior Data and Insights Analyst
Financial Ombudsman Service —London
- £54,500 - £60,000 a year
- Full-time
- Hybrid work
- SQL
- Analysis skills
- In-person
- Flexible schedule
9d
Sr. Manager, Finance Transformation
PlayStation Global —London
- Management
- PMP
- Master's degree
13d
Strategic AI transformation lead (UK)
WRITER —London
- Full-time
- Hybrid work
- Communication skills
- Annual leave
Data Science Lead - AML Risk
Wise Australia Investments —London
- £96,000 - £127,000 a year
- Machine learning
- Communication skills
- Python
Intelligence Origination – Lead Editor
Gain —London
- Full-time
- Hybrid work
- Bachelor's degree
- Team management
- Mentoring
14h
Digital Technology & Data Lead
Jensten Group —Sutton
- Hybrid work
- Annual leave
- Employee discount
Quick apply
Lead Data Scientist (Non-Lending)
Lendable —London
- Full-time
- Hybrid work
- Management
- SQL
- Machine learning
- Referral programme
Data Analyst
Smart Pension —London
- Hybrid work
- Data analysis skills
- SQL
- Financial services
- Employee assistance programme
- Employee discount
Consulting Analyst - London
Photon —London
- Microsoft Powerpoint
- Analysis skills
- AI
1d
Senior Data Scientist
Deliveroo —London
- Full-time
- SQL
- AI
- Communication skills
Big Data Architect
DataSpartan Consulting —London
- Azure
- AWS
- IT
Senior Data Analyst
CDP Global —London
- £39,525 - £49,407 a year
- Hybrid work
- CRM software
- Azure
- DevOps
- Employee assistance programme
Lead Data Engineer
UNiDAYS —London
- Hybrid work
- Management
- Computer Science
- SQL
- Employee assistance programme
Data Analyst III
Apex Group —London
- Full-time
- Azure
- SQL
- AWS
Agency Partner
GIG Retail —London
- Full-time
- Employee discount
Management Consultant - Manager - Digital & Data - Financial Services
Moorhouse Consulting —London
- £82,005 - £110,000 a year
- Sales
- Business development
- APIs
- Annual leave
- Employee discount

I want to receive the latest job alerts for big data lead in london, eng

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Big Data Lead

FalconSmartIT
Wimbledon

Quick apply

Job details

Qualifications

DataStage
DB2
Big data
DevOps
Spark
Test automation
SQL
AWS
Terraform
Data pipeline
S3
Data warehouse
Python
Hadoop

Full job description

Job TItle: Big Data Lead

Job Type: Contract

Job Location: Wimbledon , UK

Job Description:

For this role, senior experience of Data Engineering and building automated data pipelines on IBM Datastage & DB2, AWS and Databricks from source to operational databases through to curation layer is expected using the latest cloud modern technologies where experience of delivering complex pipelines will be significantly valuable to how D&G maintain and deliver world class data pipelines.

Knowledge in the following areas essential:

Data Engineering Experience:

Databricks: Expertise in managing and scaling Databricks environments for ETL, data science, and analytics use cases.
AWS Cloud: Extensive experience with AWS services such as S3, Glue, Lambda, RDS, and IAM.
IBM Skills: DB2, Datastage, Tivoli Workload Scheduler, Urban Code
Programming Languages: Proficiency in Python, SQL.
Data Warehousing & ETL: Experience with modern ETL frameworks and data warehousing techniques.
DevOps & CI/CD: Familiarity with DevOps practices for data engineering, including infrastructure-as-code (e.g., Terraform, CloudFormation), CI/CD pipelines, and monitoring (e.g., CloudWatch, Datadog).
Familiarity with big data technologies like Apache Spark, Hadoop, or similar.
Test automation skills
ETL/ELT tools and creating common data sets across on-prem (IBMDatastage ETL) and cloud data stores
Leadership & Strategy: Lead Data Engineering team(s) in designing, developing, and maintaining highly scalable and performant data infrastructures.
Customer Data Platform Development: Architect and manage our data platforms using IBM (legacy platform) & Databricks on AWS technologies (e.g., S3, Lambda, Glacier, Glue, EventBridge, RDS) to support real-time and batch data processing needs.
Data Governance & Best Practices: Implement best practices for data governance, security, and data quality across our data platform. Ensure data is well-documented, accessible, and meets compliance standards.
Pipeline Automation & Optimisation: Drive the automation of data pipelines and workflows to improve efficiency and reliability.
Team Management: Mentor and grow a team of data engineers, ensuring alignment with business goals, delivery timelines, and technical standards.
Cross Company Collaboration: Work closely with all levels of business stakeholder including data scientists, finance analysts, MI and cross-functional teams to ensure seamless data access and integration with various tools and systems.
Cloud Management: Lead efforts to integrate and scale cloud data services on AWS, optimising costs and ensuring the resilience of the platform.
Performance Monitoring: Establish monitoring and alerting solutions to ensure the high performance and availability of data pipelines and systems to ensure no impact to downstream consumers.

Quick apply

Refine Your Search

big data lead jobs in london, eng

Big Data Lead

Lead Data Analyst

Lead Data Consultant

Data Solution Architect

Senior Data and Insights Analyst

Sr. Manager, Finance Transformation

Strategic AI transformation lead (UK)

Data Science Lead - AML Risk

Intelligence Origination – Lead Editor

Digital Technology & Data Lead

Lead Data Scientist (Non-Lending)

Data Analyst

Consulting Analyst - London

Senior Data Scientist

Big Data Architect

Senior Data Analyst

Lead Data Engineer

Data Analyst III

Agency Partner

Management Consultant - Manager - Digital & Data - Financial Services

I want to receive the latest job alerts for big data lead in london, eng

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected