anicka commited on
Commit
40efacc
·
verified ·
1 Parent(s): b0cbdf1

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +25 -0
README.md ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen2.5-7B-Instruct
4
+ tags: [interpretability, jacobian-lens, logit-lens]
5
+ ---
6
+
7
+ # Jacobian lens for Qwen 2.5 7B Instruct
8
+
9
+ Fitted with Anthropic's reference implementation
10
+ ([jacobian-lens](https://github.com/anthropics/jacobian-lens), Apache-2.0)
11
+ for the paper *Verbalizable Representations Form a Global Workspace in
12
+ Language Models* (2026). Averaged input-output Jacobians per layer over
13
+ wikitext-103 prompts (fit_qwen25_7b.py from that repo).
14
+
15
+ Usage:
16
+ ```python
17
+ import jlens
18
+ lens = jlens.JacobianLens.from_pretrained(
19
+ "anicka/jlens-qwen2.5-7b-instruct",
20
+ filename="qwen2.5-7b-instruct_jlens.pt")
21
+ ```
22
+
23
+ Companion notebook (three lenses on one activation — logit lens vs
24
+ Jacobian lens vs NLA):
25
+ https://github.com/anicka-net/nla-at-home/blob/main/notebooks/05_three_lenses.ipynb