Job Description
We are seeking a skilled and detail-oriented Data Engineer with approximately 3 years of experience to join our dynamic team. The ideal candidate will have a strong understanding of data engineering principles, data architecture, ETL processes, and cloud-based data platforms. You will play a key role in designing, developing, and maintaining scalable data pipelines and ensuring the availability, reliability, and integrity of data to support business intelligence, analytics, and operational needs.
Key Responsibilities
- Design, develop, and maintain scalable and efficient ETL/ELT data pipelines for ingesting, transforming, and loading data from multiple sources.
- Build and optimize data architectures, databases, and data warehouses to support reporting, analytics, and business intelligence initiatives.
- Develop and maintain data integration solutions using SQL, Python, and other relevant programming languages.
- Collaborate with business stakeholders, data analysts, data scientists, and software development teams to understand data requirements and deliver appropriate solutions.
- Monitor, troubleshoot, and optimize data pipelines to ensure high performance, reliability, and data quality.
- Implement data validation, cleansing, and governance processes to ensure data accuracy, consistency, and compliance.
- Develop and maintain data models, metadata, and documentation for data assets and workflows.
- Support the implementation of cloud-based data platforms and modern data engineering technologies.
- Ensure compliance with data security, privacy, and regulatory requirements.
- Participate in code reviews, testing, deployment, and continuous improvement of data engineering processes.
- Monitor system performance and resolve data-related issues in a timely manner.
- Stay up to date with emerging technologies and industry best practices in data engineering and recommend improvements where appropriate.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, Data Science, Engineering, or a related field.
- Approximately 3 years of experience as a Data Engineer or in a similar data-focused technical role.
- Strong proficiency in SQL and experience with relational and NoSQL databases.
- Experience developing ETL/ELT pipelines using industry-standard tools and frameworks.
- Proficiency in Python, Scala, Java, or another programming language used for data engineering.
- Experience working with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
- Familiarity with data warehousing concepts and modern data architectures.
- Experience with version control systems such as Git.
- Knowledge of Agile/Scrum software development methodologies.
- Strong analytical, problem-solving, and communication skills.
- Ability to manage multiple priorities in a fast-paced environment.
Preferred Skills (Optional)
- Experience with Apache Spark, Hadoop, Kafka, Airflow, Databricks, Snowflake, or similar big data technologies.
- Experience with cloud data services such as AWS Redshift, Azure Synapse Analytics, Azure Data Factory, Google BigQuery, or Amazon S3.
- Familiarity with containerization technologies such as Docker and Kubernetes.
- Knowledge of CI/CD pipelines and DevOps practices.
- Experience with data governance, data quality, and master data management.
- Relevant certifications such as AWS Certified Data Engineer, Microsoft Azure Data Engineer Associate, Google Professional Data Engineer, or Databricks Certified Data Engineer.
Job Type: Full-time
Pay: £27,181.94-£69,444.82 per year
Work Location: In person
