Description
Norstella is a premier and critical global life sciences data and AI solutions provider dedicated to improving patient access to life-saving therapies. Norstella supports pharmaceutical and biotech companies across the full drug development lifecycle — from pipeline to patient. Our mission is simple: to help our clients bring therapies to market faster and more efficiently, ultimately impacting patient lives.
Norstella unites market-leading brands - Citeline, Evaluate, MMIT, Panalgo, Skipta and The Dedham Group and delivers must-have answers and insights, leveraging AI, for critical strategic, clinical, and commercial decision-making. We help our clients:
-
Accelerate the drug development cycle
-
Assess competition and bring the right drugs to market
-
Make data driven commercial and financial decisions
-
Match and recruit patients for clinical trials
-
Identify and address barriers to therapies
Norstella serves most pharmaceutical and biotech companies around the world, along with regulators like the FDA, and payers. By providing critical proprietary data supporting AI-driven workflows, Norstella helps clients make decisions faster and with greater confidence. Norstella’s investments in AI are transforming how data is consumed and decisions are made, disrupting inefficient legacy workflows and helping the industry become more efficient, innovative, and responsive to patient needs.
-
As a Senior Life Sciences Analyst for Model Training at Norstella, you will sit at the intersection of deep clinical and scientific domain expertise and applied AI development.
-
This role will be embedded within a group of life science thought leaders, but will interface across cross-functional teams of data scientists, machine learning engineers and data engineers.
-
Your work centers on the preference and judgment layer of model development — through scoring and ranking outputs, you will calibrate models on dimensions of quality, accuracy and clinical reasoning such that they are able to handshake with persona use cases.
-
Your judgment becomes the signal that bridges a capable model and a genuinely useful one, and will play a critical role in our efforts to deliver predictive analytics and insights across clients.
-
Travel: None required
-
Evaluate model outputs across clinical, regulatory, and life sciences tasks by rating individual responses, ranking pairs and lists, and rewriting outputs to demonstrate the preferred response.
-
Define and maintain evaluation rubrics, preference dimensions, and quality criteria (factual accuracy, clinical reasoning quality, etc) that govern model outputs and preference alignment.
-
Act as an expert-in-the-loop for how life science models are commercialized with clients, including ongoing support for implementation.
-
Advise and assist with interpretation of model behavior, bridging the desired behavior back to the dataflow inflection point, working with the relevant teams to adjust as needed.
-
Partner with data scientists and MLEs to walk feedback into data collection pipelines.
-
Conduct red-team and adversarial evaluation of models, surfacing subtle failure modes — hallucinations, citation errors, unsupported clinical claims, regulatory missteps — that automated metrics cannot reliably catch.
-
Analyze preference data and model behavior to identify systematic gaps, then partner with the fine-tuning SMEs and the data science team to decide how each gap is addressed through preference data.
-
Conduct new proofs of concept for novel domain capabilities.
-
Contribute to Norstella’s knowledge graph and taxonomy work and help design new agentic workflows based on domain-grounded language models.
-
Graduate degree in life sciences, medical sciences, computer science or equivalent professional experience.
-
At least 3 years of professional experience in production-grade life science datasets, including with AI-enabled applications.
-
Experience working with structured publishing platforms and data tools; comfort with automation concepts
-
Experience working with and statistically analysing large and complex data sets, including data cleaning and preprocessing.
-
Excellent problem-solving skills and the ability to work independently.
-
Excellent communication skills, especially between technical and non-technical teams.
-
Experience working with Generative AI, especially LLMs, including agents, throughout the entire software development lifecycle (SDLC).
-
Experience creating MCPs and consuming them into Agentic workflows.
-
Experience in fast-paced, novel product development.
-
Bold, Passionate, Mission-First
-
Integrity, Truth, Reality
-
Kindness, Empathy, Grace
-
Resilience, Mettle, Perseverance
-
Humility, Gratitude, Learning
-
25 days annual leave, 4 days for volunteering and a personal day
-
5% pension match
-
Group Life Assurance (100% employer funded)
-
Group Income Protection (100% employer funded)
-
Other voluntary benefits such as: Dental, Cash Plan, PMI Excess Cover, Health Screening & Critical Illness
Please Note - All candidates must be authorized to work in the UK. We do not provide visa sponsorship or transfers.
Norstella is an equal opportunities employer and does not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, color, nationality, ethnic or national origin, religion or belief, disability or age. Our ethos is to respect and value people’s differences, to help everyone achieve more at work as well as in their personal lives so that they feel proud of the part they play in our success. We believe that all decisions about people at work should be based on the individual’s abilities, skills, performance and behavior and our business requirements. Norstella operates a zero tolerance policy to any form of discrimination, abuse or harassment.
Sometimes the best opportunities are hidden by self-doubt. We disqualify ourselves before we have the opportunity to be considered. Regardless of where you came from, how you identify, or the path that led you here- you are welcome. If you read this job description and feel passion and excitement, we’re just as excited about you.
All legitimate roles with Norstella will be posted on Norstella’s job board which is located at norstella.com/careers. If a role is not posted on this job board, a candidate should assume the role is not a legitimate role with Norstella. Norstella is not responsible for an application that may be submitted by or through a third-party and candidates should proceed with extreme caution if a third-party approaches them about an open role with Norstella. Norstella will never ask for anything of value or any type of payment during or as part of any recruitment, interview, or pre-hire onboarding process. If you are aware of or have reason to believe a job posting purportedly for a role with Norstella is fraudulent or otherwise not authorized by Norstella, please contact the Company using the following email address: [email protected].