Instructions to use jbochi/candle-coedit-quantized with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jbochi/candle-coedit-quantized with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("jbochi/candle-coedit-quantized") model = AutoModelForSeq2SeqLM.from_pretrained("jbochi/candle-coedit-quantized", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload model-xxl.gguf with huggingface_hub
Browse files- model-xxl.gguf +3 -0
model-xxl.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:877b79b8cb073ca4bec25b0e8e1e233dcec49bc0d9b7aaf6214b09becaff5ea8
|
| 3 |
+
size 9135913536
|