domains / families / devops / cache-policy-comparison

cache-policy-comparison

separate

Compare and implement eviction policies (LRU, LFU, FIFO, S3FIFO, ARC) for bounded-capacity caches. Use when choosing or implementing an eviction policy for a buffer pool, page cache, CDN edge, or LLM KV cache, or when writing a replay simulator that supports multiple policies. Clarifies recency vs frequency semantics, queue topology, saturating counters, ghost buffers, and the second-chance rule that distinguishes modern FIFO-family policies from classic LRU.

When to use

• choosing an eviction policy
• implementing an eviction policy
• buffer pool eviction
• page cache eviction
• CDN edge eviction
• LLM KV cache eviction
• writing a replay simulator
• comparing hit rates on a trace

When not to use

• tasks not involving bounded-capacity caches
• tasks not involving eviction policy selection or implementation

Skill page

Source