Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
ce06ab0
Updated calculate peer scores function and fixed fstrings
CodexVeritas May 2, 2025
fb786fc
reorganized data files into subdirectories
CodexVeritas May 2, 2025
492be08
Added pseudocode that for a refactor, and data models that can be use…
CodexVeritas May 2, 2025
f4a9e4e
Converted baseline scoring function to be independent of dataframes
CodexVeritas May 2, 2025
3ed53c9
Added baseline scoring tests
CodexVeritas May 2, 2025
7a3c6a0
Added peer scoring tests
CodexVeritas May 2, 2025
44ccf43
Minor updates
CodexVeritas May 2, 2025
c0f76b6
Added some comments
CodexVeritas May 3, 2025
a374c2d
Added peer score function from previous versions
CodexVeritas May 3, 2025
881193b
Refactored spot peer scoring functions
CodexVeritas May 3, 2025
7a65265
Got all binary scoring tests passing
CodexVeritas May 3, 2025
596ece8
Got MC scoring tests passing
CodexVeritas May 3, 2025
dbcc56d
Got all scoring tests passing except numeric baseline max/min
CodexVeritas May 6, 2025
ea46599
Fixed some dataframe row to scoring parameter conversion
CodexVeritas May 7, 2025
526e14e
Got calculate_all_peer_scores working
CodexVeritas May 7, 2025
095c7de
unified peer and head to head functions
CodexVeritas May 7, 2025
80ff198
Small touchups
CodexVeritas May 7, 2025
984b81d
Small touchup
CodexVeritas May 7, 2025
ac44cfe
Updated resolution types for numeric tests
CodexVeritas May 7, 2025
b96d183
Fixed option parsing problem, and provided median MC question better
CodexVeritas May 21, 2025
819c3a7
Moved community prediction comparison files to archived
CodexVeritas May 21, 2025
0f53d31
Moved another cp comparison csv
CodexVeritas May 21, 2025
d2fb58d
Moved discrimination chart above failing cell
CodexVeritas May 21, 2025
64f2657
Debugging calibration curve
CodexVeritas May 22, 2025
a98b04c
Fixed second calibration graph
CodexVeritas May 22, 2025
938f4a3
calibration bug fix :bug:
May 22, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
.venv/
.env
__pycache__
.personal/
9,244 changes: 5,671 additions & 3,573 deletions AI_BENCHMARKING_ANALYSIS.ipynb

Large diffs are not rendered by default.

47 changes: 0 additions & 47 deletions bootstrapped_h2h_bot_vs_pros.csv

This file was deleted.

44 changes: 0 additions & 44 deletions df_top_bot_pro_cp_forecasts.csv

This file was deleted.

Loading