Consultancy for the Independent Evaluation of the FarajaMH Generative AI Screening Model Before and After Fine-Tuning
Members only
Nairobi, Kenya
KES 150,000 – 300,000/moMarket estimate
On-siteContractSeniorPosted yesterday
What you bring
The consultancy is open to an individual or a small team. The lead consultant should have:
A PhD, or a master's degree with substantial equivalent experience, in machine learning, computer science, biostatistics, health data science or a closely related field.
At least five years' experience in machine learning, with a demonstrated record of evaluating large language or speech models (for example with lm-evaluation-harness, vLLM or Hugging Face tooling).
Experience evaluating AI for health, preferably mental health screening or clinical decision support, including safety and red-teaming.
Strong statistical skills: AUROC and calibration, bootstrap confidence intervals, inter-rater agreement and subgroup fairness analysis.
Experience deploying containerized GPU workloads on on-premises or institutional servers, with no reliance on cloud services.
Experience designing human evaluation with clinicians and community members, ideally including people with lived experience.
Knowledge of data protection law and research ethics in Kenya or Tanzania.
Working knowledge of Swahili; experience with speech or audio model evaluation; experience with federated learning; and peer-reviewed publications in AI evaluation are an added advantage.
Application deadline10 Dec 2026
GK
This is a preview of the role
Sign in to your GoKazini account to see the company name, full job details, salary information, and how to apply.