This mostly happens with "radio" bots that constantly broadcast music for hours on end.

To reproduce:

* Join a voice channel where at least one user is broadcasting audio without any gaps or silence

* The audio timing will get worse and worse as the connection of either yourself or the constantly-broadcasting user deteriorates.

This can result in absurdly long audio clock drift times (up to 1 minute).