Adur District, England
Job Summary
We’re seeking an experienced Lead Data Engineer who can bring both strong leadership skills and hands-on data experience to mentor, lead, and grow teams while building data products using modern technologies.
Data is one of our key assets. In a world driven by data, Data Engineers play a vital role in enabling secure, timely, scalable, and regulated access to it at an enterprise level.
In your role you'll be leading the teams producing / curating (crafting, developing, moving, redefining, testing, and maintaining) Data Products. This enables consumers to ingest, transform, store, and analyse our data to gain insight and drive value for our customers, regulators, shareholders and colleagues.
A strong background in Data as well as Technology is a consistent characteristic of great practitioners in this role.
Day to day, you'll:
Provide management, guidance and mentorship to your engineering teams
Design, develop, and maintain complex Data Products
Lead implementation reviews and all aspects of data product delivery
Evaluate and recommend tools, technologies, and processes
Identify and implement standard methodologies for data engineering
Have a strong understanding of data security principles and secure architectural practices
Provide knowledge of DevOps practices and CI/CD pipelines
Ensure timely delivery by leading tasks and priorities effectively
Communicate effectively with team and stakeholders
Accountable for custodianship governance activities on data assets
What you’ll need
Leadership: Validated experience leading and mentoring data engineering teams
Data Engineering: Developing data validation methodology and data hub process models
Data Literacy: Communicating with data confidently and effectively
Data Modelling and Design: Practice of visually representing the design of information systems
In addition, any experience of these would be useful:
Experience with cloud platforms such as Google Cloud, Azure or AWS, and their underlying data engineering services
Experience with SQL and data warehouse technology such as BigQuery
Coding experience in any language
Experience of line management & coaching junior engineers
Familiarity with DevOps practices and tools, including CI/CD pipelines and containerisation (Docker, Kubernetes)
Familiarity with data visualisation tools such as Tableau, Power BI, or Looker
Relevant certifications in data engineering, cloud platforms, or related areas.
.
Key Responsibilities
1. Develop and maintain complex data models using ca erwin data modeler to support business requirements.
2. Utilize google bigquery for data storage, querying, and analysis to ensure data accuracy and efficiency.
3. Implement data pipelines using google dataflow to streamline data processing and transformation tasks.
4. Write and optimize sql queries to extract and manipulate data for analysis purposes.
5. Develop and deploy python scripts for automating data related processes and tasks.
6. Collaborate with cross functional teams to ensure data quality, consistency, and integrity throughout the data lifecycle.
Skill Requirements
1. Proficiency in google bigquery for data storage, querying, and analysis.
2. Strong sql skills for data manipulation and querying.
3. Experience with python for data processing, automation, and script development.
4. Knowledge of google dataflow for building and managing data pipelines.
5. Familiarity with ca erwin data modeler for designing and maintaining data models.
6. Strong analytical and problem-solving abilities.
7. Excellent communication and collaboration skills to work effectively with diverse teams.
8. Ability to prioritize tasks and work efficiently in a fast paced environment.
Other Requirements
1.Relevant certifications in Google BigQuery, SQL, Python, or CA Erwin Data Modeler are a plus.
#body.unify div.unify-button-container .unify-apply-now: focus, #body.unify div.unify-button-container .unify-apply-#body.unify div.unify-button-container .unify-apply-now: focus, #body.unify div.unify-button-container .unify-apply-