[FEATURE] Some sort of notification and/or noise when cache rate drops below a user-defined threshold

[nickchomey]

🎯 The problem

Sometimes the agent's cache stops working and suddenly the cache rate goes from 99% to 20%, and you end up paying vastly more. I often don't notice this until I've used a day's worth of credits in a few minutes.

💡 Proposed solution

Add some sort of notification and/or noise that alerts you when the cache rate falls below a level that we can set in the settings. Perhaps even also be able to select from different sounds.

[nickchomey]

It might even be better if we could set it such that the request would stop entirely when it detects that cache hit rate has fallen below the threshold, so that it doesnt keep working on the current task with low/no cache. You can then address it accordingly (usually /compact works, or fork to a new chat session). This problem really does account for the majority of my token/credit usage, given how much cheaper cache hits are.

[nickchomey]

I just found this setting. github.copilot.chat.summarizeAgentConversationHistoryThreshold I set it to 0.55, as i tend to notice that the cache explodes sometime around there. Hopefully it'll autocompact going forward and save me from unknowingly paying 50x

But what I've proposed here - stop/auto compact based on the actual cache hit rate - would be far better