LLM Lora
Collection
16 items • Updated • 3
How to use bunnycore/Qwen-2.5-7b-Cool-lora with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("bunnycore/Qwen-2.5-7b-Cool-lora", device_map="auto")I haven't tested this model much, but I expect it to make the model uncensored and little bit more capable of roleplaying.
This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.