File size: 4,264 Bytes
2dc30bc dafd79d 2dc30bc 20ff734 2dc30bc 22434d6 2dc30bc ab96199 2dc30bc fe0eca7 2dc30bc 3839702 d98ab00 3839702 2dc30bc 3839702 d98ab00 3839702 d98ab00 3839702 653bfbb ab96199 2dc30bc 4878400 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 | ---
base_model:
- aoi-ot/VibeVoice-Large
tags:
- text-to-speech
- tts
- lora
- sft
- full-finetune
- vibevoice
language:
- hu
---
# VibeVoice_7B_Hun_v2
This is my newest finetuned VibeVoice 7B (Large) model tailored to Hungarian language.
I trained LoRA for the LLM module, performed a full-finetune on the Diffusion head modules, and merged each of them into the base model.
To finetune the model I used the [following code](https://github.com/voicepowered-ai/VibeVoice-finetuning).
Thank you for [JPGallegoar](https://github.com/jpgallegoar-vpai) for that amazing VibeVoice trainer!
## Training
This model was trained on [RunPod cloud GPUs](https://runpod.io?ref=vpp0cion).
## Inference
For inference, you can use
- [this Comfyui node](https://github.com/Enemyx-net/VibeVoice-ComfyUI)
- Demo codes on [VibeVoice Community's repository](https://github.com/vibevoice-community/VibeVoice)
## Examples
These examples were made with 4bit inference. One can get even better results without quantization.
#### Sample 1
```
"Az utcák lassan megteltek emberekkel, ahogy a város ébredezett.
A kávézók teraszain gőzölgő csészék mellett beszélgettek az emberek, miközben a villamos csilingelve gördült el a sarkon.
A levegőben friss péksütemény illata keveredett a tavaszi széllel.
Minden arra utalt, hogy egy nyugodt, szép nap veszi kezdetét."
```
<div style="display: flex; gap: 20px; align-items: center;">
<div style="flex: 1;">
<strong>Fine-tuned Model</strong>
<audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_withmodel_1.flac" style="width: 100%;"></audio>
</div>
<div style="flex: 1;">
<strong>Base Model</strong>
<audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_no_model_1.flac" style="width: 100%;"></audio>
</div>
</div>
---
#### Sample 2
```
"Őrült űző üldöző őz őrjöngő őrült őrzőjével ügető ürge üvöltözött.
Örvénylő örömök örökös özönével ölelő ösvényeken ődöngő űrlények ütköztek össze önérzetesen."
```
<div style="display: flex; gap: 20px; align-items: center;">
<div style="flex: 1;">
<strong>Fine-tuned Model</strong>
<audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_withmodel_2.flac" style="width: 100%;"></audio>
</div>
<div style="flex: 1;">
<strong>Base Model</strong>
<audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_no_model_2.flac" style="width: 100%;"></audio>
</div>
</div>
---
#### Sample 3
```
"Csapzott cserecsapat cserebogár csapongott cserepes cseresznyecsokrok csücskében,
s közben csipcsup csipogással csipkedte csípős csipkebokor csúcsát."
```
<div style="display: flex; gap: 20px; align-items: center;">
<div style="flex: 1;">
<strong>Fine-tuned Model</strong>
<audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_withmodel_3.flac" style="width: 100%;"></audio>
</div>
<div style="flex: 1;">
<strong>Base Model</strong>
<audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_no_model_3.flac" style="width: 100%;"></audio>
</div>
</div>
**Important Notes:** This model is created as part of a fan project for research purposes only and is not intended for commercial use.
The dataset I used might contain material, which are protected by copyright. Users utilize the model at their own risk.
Users are obligated to comply with copyright laws and applicable regulations.
The model has been developed for research purposes, and it is not my intention to infringe on any copyright.
## Support
Producing and sharing this kind of open-source work requires renting cloud GPUs, which gets expensive quickly. If you find it useful and would like me to keep contributing, your support is very much appreciated:
[](https://ko-fi.com/chetyart) [](https://liberapay.com/chetyart/donate)
|