Add rope_theta to rope_scaling for transformers 5.4+ compatibility

#14

by oliverholworthy - opened Apr 10

base: refs/heads/main

←

from: refs/pr/14

Discussion Files changed

-1

oliverholworthy

NVIDIA org Apr 10

•

edited Apr 10

transformers==5.4.0 validates that rope_theta is present inside rope_scaling before the migration from the top-level field runs, causing a KeyError when loading the config without trust_remote_code=True. Adds rope_theta inside rope_scaling while keeping the top-level value for backwards compatibility with transformers v4.

fix: add rope_theta to rope_scaling for transformers v5.4+ compat6a2a6e3b

oliverholworthy changed pull request title from dd rope_theta to rope_scaling for transformers 5.4+ compatibility to Add rope_theta to rope_scaling for transformers 5.4+ compatibility Apr 10

oliverholworthy changed pull request status to open Apr 10

oliverholworthy changed pull request status to merged Apr 10

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment