Job Overview
We are seeking a motivated and detail-oriented Junior Data Engineer to join our dynamic data team. In this role, you will play a crucial part in designing, developing, and maintaining scalable data pipelines and data warehouses that support business analytics and decision-making processes. You will work closely with data analysts, data scientists, and other stakeholders to ensure the integrity, availability, and security of our data assets. This position offers an exciting opportunity to grow your technical skills in a fast-paced environment while contributing to innovative data solutions that drive strategic insights.
Responsibilities
- Assist in designing and implementing robust data pipelines using tools such as Apache Spark, Hadoop, and Informatica to process large volumes of Big Data efficiently.
- Develop and maintain data warehouses utilizing SQL-based technologies like Oracle, Microsoft SQL Server, and Apache Hive to support reporting and analysis needs.
- Collaborate with cross-functional teams to gather requirements and translate them into scalable database designs and ETL (Extract, Transform, Load) processes.
- Write optimized SQL queries for data extraction, transformation, and analysis to support business intelligence activities.
- Support the deployment of cloud-based solutions on AWS for scalable storage and computing resources.
- Automate routine tasks using Bash shell scripting, VBA macros, or Python scripts to improve workflow efficiency.
- Conduct analysis of data flows and troubleshoot issues related to database performance or pipeline failures.
- Document technical specifications, workflows, and best practices for ongoing maintenance and knowledge sharing.
Experience
- Proven experience working with relational databases such as Oracle or Microsoft SQL Server.
- Familiarity with Big Data technologies including Hadoop ecosystem components like HDFS, Hive, Spark, and related tools such as Apache Hive or Informatica.
- Hands-on experience with cloud platforms like AWS is highly desirable.
- Strong programming skills in Java or Python for data processing tasks.
- Knowledge of database design principles including normalization, indexing, and schema development.
- Experience with Shell scripting (Bash) or VBA for automation purposes is a plus.
- Understanding of Data Warehouse concepts and architecture to support large-scale analytics projects.
- Excellent analysis skills with the ability to interpret complex datasets accurately and efficiently.
Join us as a Junior Data Engineer if you’re eager to develop your expertise in cutting-edge data technologies while contributing to impactful projects! We value energetic problem-solvers who thrive on learning new skills and making a difference through innovative data solutions.
Pay: £14.00-£55.07 per hour
Work Location: Hybrid remote in Sevenoaks TN15
