Ask My Docs
Twelve public-domain food-safety sheets, searched sixteen ways. The table is the saved evaluation. The winner is LLM chunks reranked by Groq. These are US rules.
Ask on this computer
This page shows the saved evaluation. A new question loads a local embedding model and keeps the API key on the server, so the ask box is not published here.
uv run python app.py
Then open http://127.0.0.1:8765/projects/ask-my-docs/
Retrieval comparison
Cited answers kept 7 of 16 in-scope replies. Refusals held on 10 of 10.
| Chunks | Search | Hits | MRR |
|---|---|---|---|
| character-500 | BM25 | 11/16 | 0.590 |
| character-500 | Vector | 14/16 | 0.724 |
| character-500 | Hybrid | 15/16 | 0.724 |
| character-500 | Cross-encoder | 15/16 | 0.807 |
| character-1000 | BM25 | 10/16 | 0.575 |
| character-1000 | Vector | 15/16 | 0.744 |
| character-1000 | Hybrid | 15/16 | 0.704 |
| character-1000 | Cross-encoder | 15/16 | 0.859 |
| section | BM25 | 12/16 | 0.604 |
| section | Vector | 14/16 | 0.792 |
| section | Hybrid | 15/16 | 0.728 |
| section | Cross-encoder | 15/16 | 0.854 |
| llm-chunks | BM25 | 15/16 | 0.792 |
| llm-chunks | Vector | 16/16 | 0.886 |
| llm-chunks | Hybrid | 16/16 | 0.881 |
| llm-chunks | Groq rerankWinner | 16/16 | 0.964 |