Speed issue in results.

#3
by Hanswalter - opened

Thanks a lot for releasing this, I was waiting for a new VOX for quite some time.
There is an issue however, I give it around 20-30 secs of reference audio with full transcription (ultimate mode) and no matter what I generate, speed is always 2 or 3 times faster than it should be with incredibly good quality. Is this is known issue? Kind regards.

I don't think anyone else has reported a similar problem before, because ultimate mode cloning usually maintains the same speed as the reference audio. Could it be due to the sampling rate of the saved audio?

Thanks a lot for releasing this, I was waiting for a new VOX for quite some time.
There is an issue however, I give it around 20-30 secs of reference audio with full transcription (ultimate mode) and no matter what I generate, speed is always 2 or 3 times faster than it should be with incredibly good quality. Is this is known issue? Kind regards.

Faced the same issue on a run. Changing the seed (to 0 in that case) helped with the pacing.

Faced the same issue on a run.

Worth splitting the diagnosis with one check: does the pitch shift along with the speed?

If the voice also sounds higher, it is a sample rate mismatch between what the model writes and what the player assumes, and 24k played back as 48k gives exactly a 2x. If the pitch is unchanged and only the pacing is wrong, the sample rate is fine and the duration conditioning on the reference is the place to look, which would also fit drakexp finding that a different seed changes it.

Sign up or log in to comment