AI Engineering Architect (Agentic AI & Data Platforms)
We are seeking a highly skilled AI Engineering Architect to lead the design and development of next-generation Agentic AI solutions powering large-scale data transformations.
Location: London / Nottingham
Employment Type: Full-time
Company: UST
About the Role
This role acts as the “brain” of a transformation accelerator, driving intelligent automation across complex data pipelines using advanced LLM frameworks and AI-driven engineering practices
Key Responsibilities
- Architect and implement Agentic AI workflows to automate:
- Legacy pipeline parsing
- PySpark code generation
- DAG (workflow) generation
- Design and standardize:
- Prompt engineering frameworks
- Context management strategies for LLMs
- Build and enhance:
- AI validation pipelines (including hallucination detection and control)
- Static analysis mechanisms for generated code
- Enable enterprise-scale AI adoption by:
- Driving AI-generated documentation and metadata
- Scaling intelligent automation across thousands of pipelines
Required Skills & Experience
- Strong expertise in:
- Agentic AI / LLM architectures / prompt engineering
- Python development
- Data engineering concepts (for validation and automation workflows)
- Proven experience designing AI-driven automation solutions
- Ability to develop scalable frameworks for AI code generation and validation
Nice to Have
- Experience with orchestration frameworks (e.g., Airflow or similar)
- Exposure to data processing frameworks such as PySpark
What We Offer
- Opportunity to work on cutting-edge Agentic AI transformation programs
- High-impact role shaping enterprise-scale AI adoption
- Collaborative and innovation-focused environment
- Career progression within a global technology organisation
How to Apply
If you’re passionate about building intelligent systems that transform how data platforms are designed and delivered, we’d love to hear from you.
pyspark,agentic ai,python,data engineering,