LLM Benchmarking for Academic Research

Placeholder image
Placeholder image
Placeholder cover for LLM Benchmarking for Academic Research (replace with screenshot)
Placeholder cover for LLM Benchmarking for Academic Research (replace with screenshot)
Placeholder image
Placeholder image

Category:

AI Research · Open-source & quantized LLMs

Client:

Hochschule Schmalkalden, Germany

Duration:

2026

A benchmark of open-source language models for a real educational use case.

What I did

I set up repeatable tests for quantized and full-size open-source models inside a RAG pipeline and measured answer quality, latency and resource use.

Why it matters

The same method now helps me pick the right model for client chatbots and knowledge assistants instead of defaulting to the most expensive one.