[FEATURE] Tokens per second metrics

[nickchomey]

I dont know if this could be implemented in any practical/useful way, but it would be neat to have some sort of tokens per second metric tracked/shown somewhere, so we can get some idea of how quickly different models are working.