Lower Bounds for ($h, k$)-Caching with Delayed Hits