Benchmarking LLMs on African Livestock Knowledge — Baseline Results and Draft by fatika

·Nuno Sempere··

I’m a vet­eri­nary stu­dent and ML re­searcher based in Nige­ria. Over the past months I’ve been build­ing what I be­lieve is the first AI safety eval­u­a­tion bench­mark tar­get­ing Nige­rian in­dige­nous live­stock sys­tems.This post shares the baseline re­sults, method­ol­ogy, and open ques­tions. I’m post­ing here partly to share the work and partly be­cause I’m look­ing for feed­back from peo­ple work­ing on evals, AI de­ploy­ment in low-re­source con­texts, and Afri­can AI safety.Why this ...

Read full article →

Related Articles

Accelerating Gemma 4: faster inference with multi-token prediction drafters
amrrs · Hacker News · 3d ago
ProgramBench: Can language models rebuild programs from scratch?
jonbaer · Hacker News · 1d ago
ZAYA1-8B matches DeepSeek-R1 on math with less than 1B active parameters
steveharing1 · Hacker News · 1d ago
OpenAI’s o1 correctly diagnosed 67% of ER patients vs. 50-55% by triage doctors
donsupreme · Hacker News · 6d ago
A couple million lines of Haskell: Production engineering at Mercury
unignorant · Hacker News · 6d ago