Instructions to use Anjaan-Khadka/Nepali-Summarization with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Anjaan-Khadka/Nepali-Summarization with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "summarization" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("summarization", model="Anjaan-Khadka/Nepali-Summarization")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("Anjaan-Khadka/Nepali-Summarization") model = AutoModelForSeq2SeqLM.from_pretrained("Anjaan-Khadka/Nepali-Summarization", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from Anjaan-Khadka/Nepali-Summarization: direct link, hf CLI and curl.
- Browser
- Download file 2.9 kB
-
https://huggingface.co/Anjaan-Khadka/Nepali-Summarization/resolve/main/README.md
- Command line
-
hf download hf://Anjaan-Khadka/Nepali-Summarization/README.md
-
curl -L -o README.md https://huggingface.co/Anjaan-Khadka/Nepali-Summarization/resolve/main/README.md
2.9 kB
metadata
tags:
- summarization
- mT5
datasets:
- csebuetnlp/xlsum
language:
- ne
widget:
- text: >-
तीन नगरपालिकालाई समेटेर भेरी किनारमा बन्न थालेको आधुनिक नमुना सहरको काम
तीव्र गतिमा अघि बढेको छ । भेरीगंगा, गुर्भाकोट र लेकबेंसी नगरपालिकामा बन्न
थालेको भेरीगंगा उपत्यका नमुना आधुनिक सहर निर्माण हुन लागेको हो । यसले नदी
वारि र पारिको ४ सय ६० वर्ग किलोमिटर क्षेत्रलाई समेट्नेछ ।
model-index:
- name: Anjaan-Khadka/summarization_nepali
results:
- task:
type: summarization
name: Summarization
dataset:
name: xsum
type: xsum
config: default
split: test
metrics:
- name: ROUGE-1
type: rouge
value: 36.5002
verified: false
adaptation of mT5-multilingual-XLSum for Nepali Lnaguage
This repository contains adapted version of mT5-multilinguag-XLSum for Single Language (Nepali). View original mT5-multilinguag-XLSum model
Using this model in transformers (tested on 4.11.0.dev0)
import re
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
article_text = " तीन नगरपालिकालाई समेटेर भेरी किनारमा बन्न थालेको आधुनिक नमुना सहरको काम तीव्र गतिमा अघि बढेको छ । भेरीगंगा, गुर्भाकोट र लेकबेंसी नगरपालिकामा बन्न थालेको भेरीगंगा उपत्यका नमुना आधुनिक सहर निर्माण हुन लागेको हो । यसले नदी वारि र पारिको ४ सय ६० वर्ग किलोमिटर क्षेत्रलाई समेट्नेछ ।"
model_name = "Anjaan-Khadka/summarization_nepali"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForSeq2SeqLM.from_pretrained(model_name)
input_ids = tokenizer(
(article_text),
return_tensors="pt",
padding="max_length",
truncation=True,
max_length=512
)["input_ids"]
output_ids = model.generate(
input_ids=input_ids,
max_length=84,
no_repeat_ngram_size=2,
num_beams=4
)[0]
summary = tokenizer.decode(
output_ids,
skip_special_tokens=True,
clean_up_tokenization_spaces=False
)
print(summary)