di-zhang-fdu commited on
Commit
697c5c1
·
verified ·
1 Parent(s): 41ac67d

Remove FIM limitation note

Browse files
Files changed (1) hide show
  1. README.md +0 -4
README.md CHANGED
@@ -101,10 +101,6 @@ next_logits = fim_forward(model, before_ids, after_ids, lang_id=LANG_ID)
101
  print(tok.decode([next_logits.argmax().item()]))
102
  ```
103
 
104
- > **Note**: These models were trained primarily for prefix completion. The `wne` embedding
105
- > (norm ~11 vs `wpe` ~110) is small, suggesting limited FIM training. Suffix-first FIM
106
- > (Method 1) leverages causal attention to incorporate suffix context without special tokens.
107
-
108
  ## Configuration
109
 
110
  | Field | Value |
 
101
  print(tok.decode([next_logits.argmax().item()]))
102
  ```
103
 
 
 
 
 
104
  ## Configuration
105
 
106
  | Field | Value |