AI ENGINEER · LLM APPS, RETRIEVAL & EVALUATION · NAIROBI · OPEN TO RELOCATION

Sharleen Busienei
I build AI systems that work in production.

AI engineer at Microsoft with three years of experience in search and recommendation for Microsoft 365 Copilot (2M+ monthly enterprise users). I build LLM applications, hybrid retrieval and agents, and the evaluation, experimentation and telemetry that show whether they work. BSc Computer Science, First Class Honours.

Abstract network of connected search results
4 yrsbuilding software & AI
30+A/B evaluations
~120Mtelemetry events / day
First ClassBSc Computer Science

About

I'm an AI engineer. My foundation in search, ranking and evaluation at Microsoft taught me that the hard part is rarely the model. It's knowing whether a change actually helped.

I graduated top of my class in Computer Science at the University of Nairobi, and was a 2023 Deep Learning Indaba scholar in Accra.

Failures usually live upstream of the ranker: in how documents were modelled, what was indexed, and whether the query was ever a search query.

I speak English and Swahili fluently, and some French. Now I build LLM apps, retrieval and agents end to end.

Experience

MicrosoftSoftware Engineer, Search & Recommendation (Microsoft 365 Copilot)

Microsoft · Aug 2023 – Dec 2026 · promoted twice, L59 → L61 (Software Engineer II)
  • Worked on evaluating embedding models and ranking against offline relevance judgments and online behavioural signals.
  • Contributed to 30+ controlled A/B evaluations that informed launch and rollback decisions.
  • Worked on telemetry pipelines processing roughly 120M events a day.
  • Partnered with product, engineering and design on search quality.

MicrosoftSoftware Engineering Intern, Africa Development Centre

Microsoft · Jul – Sep 2022
  • Built the Teams search bar app-results experience (a federated search candidate source).
  • Built an offline precision/recall evaluation tool for query-to-plugin matching.

Projects

Hybrid search pipeline diagram

Hybrid Search & Retrieval Evaluation

Hybrid BM25 + ANN + transformer reranking over 8,807 Netflix records behind a cached FastAPI service, with latency benchmarks and a tool-calling agent with grounding checks.

Shows: retrieval, serving, evaluation, tests, CI and Docker.

PythonFastAPIBM25Docker
Photo triage flow

Sloth Archivist

An offline CLI that triages photo folders with rules first, a local vision model second, and logs every decision. Nothing is deleted.

Shows: pipeline design, safe automation, schema-validated model output.

PythonOllamaGemmapytest
Illustrative bar chart

Hotel cancellation risk

SQL-first analysis and chronologically validated models, explicit about prediction versus intervention.

Shows: SQL, data quality, leakage control, calibration.

PostgreSQLscikit-learnpandas

Community & Mentorship

Global Mentorship Initiative logo
GLOBAL MENTORSHIP INITIATIVE · 2026

Second-time career mentor

Completed a 12-session mentorship supporting a university student with résumé development, networking, career planning and professional skills.

Read the reflection →
Rewriting the Code Kenya logo
REWRITING THE CODE KENYA · 2026

Community speaker

Shared lessons from working in technology with students and early-career professionals at a community event for future engineers and product leaders.

See the event post →
Women Techmakers logo
WOMEN TECHMAKERS · JUL 2023 – PRESENT

Ambassador

Part of a global community of leaders supporting women in technology through visibility, connection and community participation.

Technovation logo
TECHNOVATION · JUN – AUG 2021

Head Judge

Assessed and scored technology projects submitted by Technovation teams from around the world.

Skills

Tools

PythonFastAPIDockerGitGitHub Actions

AI & retrieval

LLM applicationsAgentsBM25Semantic retrievalEmbeddingsRankingRecommendation

Evaluation & data

Offline & online evaluationA/B experimentationTelemetry at scaleSQLC#KQL / Azure Data Explorer

Languages

English (fluent)Swahili (native)French (basic)

Learning now

RAGLLM evalsMCPDeploymentObservability

Writing

Articles on what I'm building and learning in AI engineering.

More weekly writing on reliable AI applications, retrieval and evaluation is coming.

All Medium articles All DEV articles

Let's talk

Open to roles anywhere, remote or relocation. Based in Nairobi, Kenya.