imxinchengyou/CacheVerifier

Code and experimental artifacts for "Synchronous Online Verification Gating in Semantic Caches" — an empirical study of real-time verifier gating for semantic cache hits, evaluated against static/adaptive-threshold baselines on ~210k real requests across three datasets.

51 commits

updated Sep 27, 2026

www.cacheverifier.com

See the code

See what people are saying

Newest first

Most points

Source	Message	Score	Date
	CacheVerifier: we finally audited the semantic caching benchmark we'd been tuning on, 23% of the "wrong" cache hits were literally the same prompt (r/LLMDevs) so for CacheVerifier we've been testing if a small verifier actually beats a plain similarity threshold for semantic caching. all our scoring comes from the public SemCacheLMArena and SemCacheSearchQueries benchmarks, and honestly we never really looked at the labels until last week. on LmArena,…	5	Oct 2, 2026

cache

cacheverifier

cross-encoder

gptcache

llm

llm-caching

machine-learning

reproducible-research

reranker

semantic-caching

threshold-calibration

vcache