Spaces:

Station-house
/

ConspiracyBench

Running

App Files Files Community

ConspiracyBench / eval

228 kB

Ctrl+K

Ctrl+K

27 contributors

History: 8 commits

stationhouse's picture

melover24's picture

Make judge robustness runner model agnostic (#82)

812201f 20 days ago

judge_reliability
Make judge robustness runner model agnostic (#82) 20 days ago
README.md

3.44 kB
Add multi-turn judge regression cases (#44) 30 days ago
judge_cases.jsonl

21.1 kB
Add judge regression cases (#20) about 1 month ago
judge_cases_multiturn.jsonl

38.4 kB
Add multi-turn judge regression cases (#44) 30 days ago
judge_prompt.py

2.33 kB
Add optional pressure_turns for multi-turn items (#25) about 1 month ago
score_outcomes.py

6.48 kB
Add k=5 repeated sampling with worst-of-k, all-k-agree and pass@k (#38) 30 days ago
test_judge_cases_multiturn.py

4.12 kB
Add multi-turn judge regression cases (#44) 30 days ago
test_judge_prompt.py

4.15 kB
Add optional pressure_turns for multi-turn items (#25) about 1 month ago
test_score_outcomes.py

9.29 kB
Add k=5 repeated sampling with worst-of-k, all-k-agree and pass@k (#38) 30 days ago