| when | challenger | verdict | mu_hat | reason |
|---|
| 08-14 15:21 | ▸ newbie000/teutonic-5hpuhcq | king | -0.00273 | lost duel (weaker than king) |
newbie000/teutonic-5hpuhcqcrn-7ba5aa76 · lcb -0.003285 · 2016 seqs · 760.8s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| dendrite-synth-run | 0.210363 | 0.207624 | +0.002739 | 25 | | cosmopedia-wikihow-stories | 1.098689 | 1.096211 | +0.002478 | 126 | | ultradata-math-l3 | 0.269723 | 0.270297 | -0.000574 | 159 | | nemotron-cc-math-v1-4plus-mind | 0.524377 | 0.52526 | -0.000883 | 79 | | openmathreasoning | 0.481688 | 0.482644 | -0.000957 | 206 | | nemotron-specialized-v1.2 | 0.705546 | 0.706616 | -0.00107 | 66 | | openthoughts3-1.2m | 0.802794 | 0.804532 | -0.001738 | 169 | | automathtext-v2 | 1.963445 | 1.965205 | -0.001759 | 385 | | finewebedu | 1.929005 | 1.931022 | -0.002017 | 505 | | pes2o-v3 | 1.750841 | 1.754636 | -0.003796 | 110 | | dolma3_longmino_pool_8k | 1.688902 | 1.70529 | -0.016388 | 186 |
|
| 08-14 15:06 | ▸ silvanus0930/5Ev4MF794L-te | king | -0.005098 | lost duel (weaker than king) |
silvanus0930/5Ev4MF794L-teutonic-sn3-418-hk2 · lcb -0.005525 · 2016 seqs · 795.5s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| cosmopedia-wikihow-stories | 1.035519 | 1.036611 | -0.001092 | 118 | | nemotron-specialized-v1.2 | 0.796628 | 0.798782 | -0.002154 | 62 | | nemotron-cc-math-v1-4plus-mind | 0.525323 | 0.528152 | -0.002829 | 70 | | ultradata-math-l3 | 0.243051 | 0.246372 | -0.00332 | 181 | | finewebedu | 1.98763 | 1.991219 | -0.003589 | 517 | | openmathreasoning | 0.330295 | 0.334437 | -0.004142 | 183 | | openthoughts3-1.2m | 0.787059 | 0.791258 | -0.004199 | 149 | | automathtext-v2 | 2.0577 | 2.061917 | -0.004216 | 387 | | pes2o-v3 | 1.951209 | 1.957103 | -0.005895 | 114 | | dolma3_longmino_pool_8k | 1.639048 | 1.653768 | -0.01472 | 217 | | dendrite-synth-run | 0.266249 | 0.292911 | -0.026662 | 18 |
|
| 08-14 14:42 | silvanus0930/5Ev4MF794L-te | error | 0 | model not fetchable |
| 08-14 12:01 | devlegend/teutonic-5gnhvcr | error | 0 | copy-gate: too similar (family full) |
| 08-14 11:55 | dendrite-sn3-mining/teuton | error | 0 | copy-gate: too similar (family full) |
| 08-14 10:18 | touristAI/5fvvmpfo8w-10000 | error | 0 | digest already evaluated |
| 08-14 10:18 | touristAI/5fvvmpfo8w-10000 | error | 0 | copy-gate: too similar (family full) |
| 08-14 09:30 | greenpeace/teutonic-5dztcy | error | 0 | copy-gate: too similar (family full) |
| 08-14 09:24 | greenpeace/teutonic-5dztcy | error | 0 | copy-gate: too similar (family full) |
| 08-14 09:18 | greenpeace/teutonic-5dztcy | error | 0 | copy-gate: too similar (family full) |
| 08-14 09:11 | greenpeace/teutonic-5dztcy | error | 0 | copy-gate: too similar (family full) |
| 08-14 09:04 | ▸ dives000/teutonic-5ddcouho | king | -0.001163 | lost duel (weaker than king) |
dives000/teutonic-5ddcouhoh2-1786693399 · lcb -0.001241 · 2016 seqs · 754.7s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| openmathreasoning | 0.401136 | 0.401384 | -0.000248 | 185 | | dendrite-synth-run | 0.229898 | 0.230184 | -0.000286 | 15 | | ultradata-math-l3 | 0.478397 | 0.478724 | -0.000327 | 170 | | nemotron-cc-math-v1-4plus-mind | 0.529152 | 0.52953 | -0.000377 | 74 | | openthoughts3-1.2m | 0.803197 | 0.803746 | -0.000549 | 169 | | nemotron-specialized-v1.2 | 0.650622 | 0.651402 | -0.00078 | 65 | | cosmopedia-wikihow-stories | 1.088692 | 1.089777 | -0.001086 | 108 | | dolma3_longmino_pool_8k | 1.519278 | 1.520565 | -0.001288 | 199 | | pes2o-v3 | 1.694663 | 1.696019 | -0.001356 | 119 | | automathtext-v2 | 2.024063 | 2.02569 | -0.001627 | 404 | | finewebedu | 1.963468 | 1.965192 | -0.001723 | 508 |
|
| 08-14 08:51 | cryptoscammer/5hmimayppe-3 | error | 0 | identical copy of king |
| 08-14 08:50 | cuddle-ord/teutonic-5f6jmx | error | 0 | copy-gate: too similar (family full) |
| 08-14 08:45 | cryptoscammer/5hmimayppe-4 | error | 0 | identical copy of king |
| 08-14 08:44 | ▸ devlegend/teutonic-5gnhvcr | king | -2e-06 | lost duel (weaker than king) |
devlegend/teutonic-5gnhvcrzwz-dev26081407261714 · lcb -4.5e-05 · 2016 seqs · 743.4s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| openthoughts3-1.2m | 0.929647 | 0.929501 | +0.000145 | 131 | | nemotron-cc-math-v1-4plus-mind | 0.524595 | 0.524527 | +6.8e-05 | 78 | | nemotron-specialized-v1.2 | 0.762758 | 0.762691 | +6.7e-05 | 62 | | dendrite-synth-run | 0.177847 | 0.177811 | +3.6e-05 | 16 | | pes2o-v3 | 1.819271 | 1.81924 | +3.1e-05 | 121 | | ultradata-math-l3 | 0.237366 | 0.237358 | +8e-06 | 171 | | openmathreasoning | 0.433314 | 0.433314 | +0.0 | 210 | | finewebedu | 1.910805 | 1.910811 | -6e-06 | 471 | | dolma3_longmino_pool_8k | 1.7203 | 1.720335 | -3.5e-05 | 214 | | automathtext-v2 | 1.996637 | 1.996685 | -4.8e-05 | 418 | | cosmopedia-wikihow-stories | 1.092966 | 1.093032 | -6.6e-05 | 124 |
|
| 08-14 08:30 | ▸ cuddle-ord/teutonic-5f6jmx | king | 5e-06 | lost duel (weaker than king) |
cuddle-ord/teutonic-5f6jmxnsuy-beat26081407281142 · lcb -3.6e-05 · 2016 seqs · 995.6s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| dendrite-synth-run | 0.162942 | 0.162837 | +0.000106 | 21 | | automathtext-v2 | 1.452495 | 1.452433 | +6.2e-05 | 389 | | cosmopedia-wikihow-stories | 1.104096 | 1.104054 | +4.2e-05 | 112 | | ultradata-math-l3 | 0.239074 | 0.239051 | +2.3e-05 | 154 | | nemotron-specialized-v1.2 | 0.669227 | 0.669222 | +5e-06 | 51 | | pes2o-v3 | 1.772233 | 1.772229 | +4e-06 | 123 | | finewebedu | 1.779276 | 1.779275 | +1e-06 | 497 | | openmathreasoning | 0.40127 | 0.401292 | -2.2e-05 | 210 | | openthoughts3-1.2m | 1.288963 | 1.288998 | -3.5e-05 | 169 | | dolma3_longmino_pool_8k | 1.600446 | 1.600488 | -4.2e-05 | 202 | | nemotron-cc-math-v1-4plus-mind | 0.528825 | 0.528895 | -7e-05 | 88 |
|
| 08-14 08:10 | ▸ cryptoscammer/5hmimayppe-2 | challenger | 0.002102 | 👑 dethroned king |
cryptoscammer/5hmimayppe-2e25b54b · lcb 0.001905 · ? seqs · 1872.4s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| dolma3_longmino_pool_8k | 2.002877 | 1.989639 | +0.013238 | 1000 | | pes2o-v3 | 1.763785 | 1.760238 | +0.003547 | 600 | | openmathreasoning | 0.415123 | 0.413781 | +0.001342 | 1000 | | finewebedu | 1.987098 | 1.985988 | +0.00111 | 2500 | | openthoughts3-1.2m | 0.902419 | 0.901323 | +0.001096 | 800 | | automathtext-v2 | 2.201442 | 2.200456 | +0.000986 | 1900 | | nemotron-specialized-v1.2 | 0.65478 | 0.65418 | +0.000599 | 300 | | nemotron-cc-math-v1-4plus-mind | 0.518065 | 0.517705 | +0.00036 | 400 | | ultradata-math-l3 | 0.202102 | 0.201925 | +0.000177 | 800 | | dendrite-synth-run | 0.280036 | 0.281936 | -0.001901 | 100 | | cosmopedia-wikihow-stories | 1.096333 | 1.09881 | -0.002478 | 600 |
|
| 08-14 07:37 | ▸ happyteutonic/teutonic-5f6 | king | -0.069421 | lost duel (weaker than king) |
happyteutonic/teutonic-5f6jmxnsuy-top26081407095744 · lcb -0.07985 · 2016 seqs · 750.3s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| nemotron-cc-math-v1-4plus-mind | 0.52882 | 0.530905 | -0.002084 | 95 | | ultradata-math-l3 | 0.262029 | 0.265775 | -0.003746 | 156 | | automathtext-v2 | 2.248033 | 2.255235 | -0.007202 | 375 | | nemotron-specialized-v1.2 | 0.318949 | 0.332671 | -0.013722 | 58 | | pes2o-v3 | 1.983395 | 2.003833 | -0.020438 | 132 | | finewebedu | 1.992234 | 2.014073 | -0.021839 | 512 | | openthoughts3-1.2m | 1.158669 | 1.19522 | -0.036551 | 150 | | dolma3_longmino_pool_8k | 1.524389 | 1.607545 | -0.083157 | 187 | | openmathreasoning | 0.408597 | 0.502514 | -0.093918 | 215 | | dendrite-synth-run | 0.25983 | 0.592708 | -0.332878 | 17 | | cosmopedia-wikihow-stories | 1.093659 | 1.723159 | -0.6295 | 119 |
|
| 08-14 07:23 | ▸ happyteutonic/teutonic-5f6 | king | -0.068486 | lost duel (weaker than king) |
happyteutonic/teutonic-5f6jmxnsuy-top26081407070462 · lcb -0.079375 · 2016 seqs · 767.1s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| nemotron-cc-math-v1-4plus-mind | 0.529433 | 0.531612 | -0.002179 | 91 | | ultradata-math-l3 | 0.241544 | 0.246895 | -0.005351 | 177 | | automathtext-v2 | 1.779765 | 1.786943 | -0.007178 | 389 | | nemotron-specialized-v1.2 | 0.619694 | 0.630806 | -0.011112 | 61 | | finewebedu | 1.937043 | 1.960392 | -0.023349 | 500 | | openthoughts3-1.2m | 1.17539 | 1.206482 | -0.031093 | 158 | | pes2o-v3 | 1.73277 | 1.78246 | -0.04969 | 108 | | openmathreasoning | 0.436371 | 0.505038 | -0.068667 | 199 | | dolma3_longmino_pool_8k | 1.919907 | 2.014451 | -0.094544 | 198 | | dendrite-synth-run | 0.279374 | 0.657828 | -0.378454 | 22 | | cosmopedia-wikihow-stories | 1.100898 | 1.727341 | -0.626443 | 113 |
|
| 08-14 07:09 | ▸ happyteutonic/teutonic-5f6 | king | nan | lost duel (weaker than king) |
happyteutonic/teutonic-5f6jmxnsuy-top26081406370918 · lcb nan · ? seqs · 1855.5s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| automathtext-v2 | 1.957493 | nan | +nan | 1900 | | cosmopedia-wikihow-stories | 1.094594 | nan | +nan | 600 | | dendrite-synth-run | 0.162473 | nan | +nan | 100 | | dolma3_longmino_pool_8k | 1.755948 | nan | +nan | 1000 | | finewebedu | 2.014715 | nan | +nan | 2500 | | nemotron-cc-math-v1-4plus-mind | 0.527278 | nan | +nan | 400 | | nemotron-specialized-v1.2 | 0.480283 | nan | +nan | 300 | | openmathreasoning | 0.462204 | nan | +nan | 1000 | | openthoughts3-1.2m | 1.146651 | nan | +nan | 800 | | pes2o-v3 | 1.757798 | nan | +nan | 600 | | ultradata-math-l3 | 0.415633 | nan | +nan | 800 |
|
| 08-14 06:35 | cuddle-ord/teutonic-5f6jmx | error | 0 | model not fetchable |
| 08-14 06:27 | ▸ kaelund/teutonic-5dlurnuxg | king | nan | lost duel (weaker than king) |
kaelund/teutonic-5dlurnuxgz-tm14-1 · lcb nan · ? seqs · 1833.7s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| automathtext-v2 | 1.872122 | nan | +nan | 1900 | | cosmopedia-wikihow-stories | 1.098936 | nan | +nan | 600 | | dendrite-synth-run | 0.168211 | nan | +nan | 100 | | dolma3_longmino_pool_8k | 1.608195 | nan | +nan | 1000 | | finewebedu | 1.861543 | nan | +nan | 2500 | | nemotron-cc-math-v1-4plus-mind | 0.535576 | nan | +nan | 400 | | nemotron-specialized-v1.2 | 0.638438 | nan | +nan | 300 | | openmathreasoning | 0.325723 | nan | +nan | 1000 | | openthoughts3-1.2m | 1.149735 | nan | +nan | 800 | | pes2o-v3 | 1.759782 | nan | +nan | 600 | | ultradata-math-l3 | 0.40153 | nan | +nan | 800 |
|
| 08-14 04:59 | ▸ dives000/teutonic-5ddcouho | king | -0.000711 | lost duel (weaker than king) |
dives000/teutonic-5ddcouhoh2-1786682610 · lcb -0.000848 · 2016 seqs · 841.4s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| dolma3_longmino_pool_8k | 1.633241 | 1.631148 | +0.002093 | 222 | | dendrite-synth-run | 0.298274 | 0.298038 | +0.000236 | 19 | | openmathreasoning | 0.430703 | 0.430553 | +0.000151 | 197 | | nemotron-specialized-v1.2 | 0.625651 | 0.625687 | -3.5e-05 | 51 | | ultradata-math-l3 | 0.462767 | 0.462989 | -0.000222 | 154 | | openthoughts3-1.2m | 0.782203 | 0.782509 | -0.000306 | 148 | | nemotron-cc-math-v1-4plus-mind | 0.504456 | 0.504766 | -0.000309 | 88 | | cosmopedia-wikihow-stories | 1.090389 | 1.091177 | -0.000788 | 116 | | pes2o-v3 | 1.819468 | 1.820497 | -0.001029 | 117 | | finewebedu | 1.94325 | 1.944944 | -0.001694 | 537 | | automathtext-v2 | 2.184624 | 2.186536 | -0.001912 | 367 |
|
| 08-14 02:37 | silvanus0930/teutonic-5Ev4 | error | 0 | copy-gate: too similar (family full) |
| 08-14 02:30 | newbie000/teutonic-5hpuhcq | error | 0 | copy-gate: too similar (family full) |
| 08-14 02:17 | newbie000/teutonic-5hpuhcq | error | 0 | digest already evaluated |
| 08-14 02:08 | newbie000/teutonic-ef66d47 | error | 0 | repo missing coldkey token |
| 08-14 01:23 | touristAI/5fvvmpfo8w-600-c | error | 0 | copy-gate: too similar (family full) |
| 08-14 00:48 | touristAI/5fvvmpfo8w-600 | error | 0 | copy-gate: too similar (family full) |
| 08-14 00:07 | cryptoscammer/5hmimayppe-3 | error | 0 | copy-gate: too similar (family full) |
| 08-14 00:01 | cryptoscammer/5hmimayppe-7 | error | 0 | copy-gate: too similar (family full) |
| 08-13 23:54 | ▸ cryptoscammer/5hmimayppe-f | king | 0.000693 | lost duel (weaker than king) |
cryptoscammer/5hmimayppe-fc44637d · lcb 0.000545 · 6848 seqs · 1555.2s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| dolma3_longmino_pool_8k | 1.582068 | 1.578456 | +0.003612 | 656 | | dendrite-synth-run | 0.163839 | 0.162223 | +0.001616 | 76 | | pes2o-v3 | 1.75923 | 1.758204 | +0.001026 | 439 | | automathtext-v2 | 1.082612 | 1.082099 | +0.000513 | 1324 | | finewebedu | 1.889189 | 1.888817 | +0.000372 | 1707 | | openmathreasoning | 0.429743 | 0.429375 | +0.000369 | 691 | | nemotron-specialized-v1.2 | 0.673359 | 0.672997 | +0.000363 | 208 | | openthoughts3-1.2m | 1.261696 | 1.261529 | +0.000167 | 544 | | ultradata-math-l3 | 0.412545 | 0.412385 | +0.00016 | 531 | | nemotron-cc-math-v1-4plus-mind | 0.533637 | 0.533498 | +0.00014 | 276 | | cosmopedia-wikihow-stories | 1.094185 | 1.094327 | -0.000143 | 396 |
|
| 08-13 23:01 | devlegend/teutonic-5gnhvcr | error | 0 | copy-gate: too similar (family full) |
| 08-13 22:55 | ringtone-ro/teutonic-5ddco | error | 0 | copy-gate: too similar (family full) |
| 08-13 22:49 | dendrite-sn3-mining/teuton | error | 0 | copy-gate: too similar (family full) |
| 08-13 22:43 | ▸ huxdendrite/teutonic-5ev3r | king | -0.001209 | lost duel (weaker than king) |
huxdendrite/teutonic-5ev3rrdend-cl009 · lcb -0.001521 · 3456 seqs · 996.3s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| finewebedu | 1.868804 | 1.867854 | +0.00095 | 892 | | automathtext-v2 | 2.259637 | 2.258836 | +0.000801 | 677 | | nemotron-specialized-v1.2 | 0.75408 | 0.75348 | +0.0006 | 102 | | nemotron-cc-math-v1-4plus-mind | 0.545847 | 0.54529 | +0.000557 | 136 | | ultradata-math-l3 | 0.48401 | 0.483622 | +0.000388 | 290 | | openthoughts3-1.2m | 1.165205 | 1.164822 | +0.000383 | 264 | | dendrite-synth-run | 0.275376 | 0.275408 | -3.3e-05 | 43 | | pes2o-v3 | 1.831359 | 1.831722 | -0.000363 | 195 | | openmathreasoning | 0.326705 | 0.327116 | -0.000411 | 344 | | cosmopedia-wikihow-stories | 1.032422 | 1.036836 | -0.004414 | 208 | | dolma3_longmino_pool_8k | 1.465304 | 1.481003 | -0.015699 | 305 |
|
| 08-13 22:26 | cryptoscammer/5hmimayppe-b | error | 0 | identical copy of king |
| 08-13 22:25 | kaelund/teutonic-5dlurnuxg | error | 0 | config/code mismatch |
| 08-13 22:25 | cryptoscammer/5hmimayppe-2 | error | 0 | identical copy of king |
| 08-13 22:24 | ▸ bluecolor/teutonic-q3-5ek5 | king | -0.003145 | lost duel (weaker than king) |
bluecolor/teutonic-q3-5ek5kr57gg-817157171-rn-cp0 · lcb -0.00496 · 3904 seqs · 980.8s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| finewebedu | 1.981418 | 1.978893 | +0.002525 | 993 | | nemotron-specialized-v1.2 | 0.640673 | 0.638783 | +0.00189 | 122 | | automathtext-v2 | 0.994558 | 0.992846 | +0.001711 | 736 | | nemotron-cc-math-v1-4plus-mind | 0.539133 | 0.538178 | +0.000955 | 147 | | openthoughts3-1.2m | 0.802857 | 0.802339 | +0.000517 | 307 | | pes2o-v3 | 1.645493 | 1.645216 | +0.000277 | 234 | | ultradata-math-l3 | 0.204421 | 0.204165 | +0.000256 | 309 | | openmathreasoning | 0.441999 | 0.442395 | -0.000396 | 397 | | dendrite-synth-run | 0.254759 | 0.2663 | -0.011542 | 32 | | cosmopedia-wikihow-stories | 1.08967 | 1.110428 | -0.020758 | 242 | | dolma3_longmino_pool_8k | 1.673941 | 1.702951 | -0.02901 | 385 |
|
| 08-13 22:06 | ▸ bluecolor/teutonic-q3-5ek5 | king | -0.00457 | lost duel (weaker than king) |
bluecolor/teutonic-q3-5ek5kr57gg-817157171-rn-cp2 · lcb -0.007166 · 3488 seqs · 947.7s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| dendrite-synth-run | 0.152877 | 0.13532 | +0.017557 | 17 | | openthoughts3-1.2m | 1.081877 | 1.077804 | +0.004073 | 293 | | nemotron-specialized-v1.2 | 0.69333 | 0.690523 | +0.002807 | 109 | | finewebedu | 1.879447 | 1.877436 | +0.002011 | 864 | | automathtext-v2 | 1.601387 | 1.599563 | +0.001825 | 650 | | nemotron-cc-math-v1-4plus-mind | 0.540655 | 0.539772 | +0.000883 | 141 | | ultradata-math-l3 | 0.199699 | 0.199296 | +0.000403 | 274 | | pes2o-v3 | 1.761665 | 1.761542 | +0.000122 | 198 | | openmathreasoning | 0.334791 | 0.335661 | -0.00087 | 350 | | cosmopedia-wikihow-stories | 1.097686 | 1.119226 | -0.02154 | 226 | | dolma3_longmino_pool_8k | 1.627077 | 1.670105 | -0.043028 | 366 |
|
| 08-13 21:49 | ▸ bluecolor/teutonic-q3-5ek5 | king | -0.001035 | lost duel (weaker than king) |
bluecolor/teutonic-q3-5ek5kr57gg-817157171-rn-cp1 · lcb -0.00136 · 5952 seqs · 1359.2s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| dendrite-synth-run | 0.154574 | 0.142771 | +0.011803 | 62 | | finewebedu | 1.998334 | 1.996182 | +0.002152 | 1472 | | nemotron-specialized-v1.2 | 0.741169 | 0.739099 | +0.00207 | 189 | | automathtext-v2 | 2.015383 | 2.013435 | +0.001948 | 1128 | | openthoughts3-1.2m | 1.146314 | 1.144769 | +0.001545 | 488 | | pes2o-v3 | 1.794469 | 1.793282 | +0.001187 | 357 | | nemotron-cc-math-v1-4plus-mind | 0.530202 | 0.529479 | +0.000723 | 225 | | ultradata-math-l3 | 0.201195 | 0.200862 | +0.000333 | 467 | | openmathreasoning | 0.325932 | 0.326189 | -0.000256 | 594 | | dolma3_longmino_pool_8k | 1.48994 | 1.500323 | -0.010383 | 608 | | cosmopedia-wikihow-stories | 1.0955 | 1.116704 | -0.021204 | 362 |
|
| 08-13 21:25 | ▸ cuddle-ord/teutonic-5f6jmx | king | -4e-06 | lost duel (weaker than king) |
cuddle-ord/teutonic-5f6jmxnsuy-top26081320351039 · lcb -4.6e-05 · 2016 seqs · 1017.5s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| dendrite-synth-run | 0.160363 | 0.160244 | +0.000119 | 20 | | nemotron-cc-math-v1-4plus-mind | 0.528945 | 0.5289 | +4.5e-05 | 80 | | nemotron-specialized-v1.2 | 0.61231 | 0.612268 | +4.2e-05 | 70 | | openthoughts3-1.2m | 0.794909 | 0.794881 | +2.7e-05 | 154 | | finewebedu | 1.824471 | 1.824453 | +1.8e-05 | 478 | | cosmopedia-wikihow-stories | 1.093534 | 1.093519 | +1.5e-05 | 141 | | openmathreasoning | 0.46878 | 0.468765 | +1.5e-05 | 201 | | ultradata-math-l3 | 0.331778 | 0.331774 | +4e-06 | 173 | | automathtext-v2 | 1.768741 | 1.768775 | -3.4e-05 | 363 | | pes2o-v3 | 1.715644 | 1.715691 | -4.7e-05 | 139 | | dolma3_longmino_pool_8k | 2.225043 | 2.225124 | -8.2e-05 | 197 |
|
| 08-13 21:06 | ▸ cryptoscammer/5hmimayppe-0 | challenger | 0.020373 | 👑 dethroned king |
cryptoscammer/5hmimayppe-0fc9907c · lcb 0.0196 · ? seqs · 1936.3s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| dolma3_longmino_pool_8k | 1.833907 | 1.758442 | +0.075465 | 1000 | | dendrite-synth-run | 0.31126 | 0.262136 | +0.049123 | 100 | | pes2o-v3 | 1.816137 | 1.770932 | +0.045204 | 600 | | openthoughts3-1.2m | 0.837793 | 0.805891 | +0.031901 | 800 | | openmathreasoning | 0.436113 | 0.408851 | +0.027261 | 1000 | | cosmopedia-wikihow-stories | 1.116946 | 1.092912 | +0.024033 | 600 | | nemotron-specialized-v1.2 | 0.576764 | 0.567019 | +0.009744 | 300 | | automathtext-v2 | 1.982605 | 1.976292 | +0.006313 | 1900 | | finewebedu | 1.94884 | 1.943664 | +0.005176 | 2500 | | ultradata-math-l3 | 0.290137 | 0.288507 | +0.001631 | 800 | | nemotron-cc-math-v1-4plus-mind | 0.529728 | 0.530062 | -0.000335 | 400 |
|
| 08-13 20:19 | gyandrew/teutonic-5hmqfusr | error | 0 | copy-gate: too similar (family full) |
| 08-13 20:12 | ▸ gyandrew/teutonic-5hmqfusr | king | -0.000508 | lost duel (weaker than king) |
gyandrew/teutonic-5hmqfusr1k-cp21-400 · lcb -0.000701 · 8064 seqs · 1596.6s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| cosmopedia-wikihow-stories | 1.122173 | 1.109026 | +0.013147 | 479 | | dolma3_longmino_pool_8k | 1.758333 | 1.752047 | +0.006286 | 808 | | ultradata-math-l3 | 0.239206 | 0.239689 | -0.000483 | 638 | | nemotron-cc-math-v1-4plus-mind | 0.516168 | 0.516923 | -0.000755 | 316 | | openthoughts3-1.2m | 0.825813 | 0.827086 | -0.001273 | 649 | | openmathreasoning | 0.477653 | 0.479205 | -0.001551 | 822 | | pes2o-v3 | 1.78906 | 1.791427 | -0.002367 | 483 | | nemotron-specialized-v1.2 | 0.771509 | 0.774038 | -0.002528 | 250 | | finewebedu | 1.897293 | 1.900111 | -0.002819 | 2030 | | automathtext-v2 | 1.910051 | 1.912909 | -0.002858 | 1513 | | dendrite-synth-run | 0.209446 | 0.222666 | -0.01322 | 76 |
|
| 08-13 19:44 | gyandrew/teutonic-5hmqfusr | error | 0 | model not fetchable |
| 08-13 19:44 | gyandrew/teutonic-5hmqfusr | error | 0 | model not fetchable |
| 08-13 19:42 | ▸ gyandrew/teutonic-5hmqfusr | king | -0.002074 | lost duel (weaker than king) |
gyandrew/teutonic-5hmqfusr1k-cp24-1000 · lcb -0.002332 · 7392 seqs · 1759.9s | dataset | king loss | chall loss | Δ (mu_hat) | N |
|---|
| cosmopedia-wikihow-stories | 0.903061 | 0.892244 | +0.010816 | 446 | | dolma3_longmino_pool_8k | 1.649012 | 1.63919 | +0.009823 | 732 | | openmathreasoning | 0.31337 | 0.312543 | +0.000828 | 739 | | ultradata-math-l3 | 0.423241 | 0.42452 | -0.001279 | 592 | | nemotron-cc-math-v1-4plus-mind | 0.527409 | 0.528692 | -0.001283 | 296 | | nemotron-specialized-v1.2 | 0.355019 | 0.359658 | -0.004638 | 223 | | finewebedu | 1.849528 | 1.854664 | -0.005135 | 1850 | | automathtext-v2 | 2.505368 | 2.511515 | -0.006147 | 1411 | | openthoughts3-1.2m | 1.320241 | 1.326877 | -0.006636 | 597 | | pes2o-v3 | 1.831964 | 1.838612 | -0.006648 | 432 | | dendrite-synth-run | 0.312514 | 0.323053 | -0.010539 | 74 |
|
| 08-13 19:11 | gyandrew/teutonic-5hmqfusr | error | 0 | model not fetchable |
| 08-13 19:10 | gyandrew/teutonic-5hmqfusr | error | 0 | model not fetchable |
| 08-13 19:10 | gyandrew/teutonic-5hmqfusr | error | 0 | model not fetchable |
| 08-13 19:10 | gyandrew/teutonic-5hmqfusr | error | 0 | model not fetchable |
| 08-13 19:09 | gyandrew/teutonic-5hmqfusr | error | 0 | model not fetchable |
| 08-13 19:08 | knsimon/teutonic-5g6x3hn8b | error | 0 | model not fetchable |
| 08-13 19:07 | knsimon/teutonic-5g6x3hn8b | error | 0 | model not fetchable |
| 08-13 19:07 | knsimon/teutonic-5g6x3hn8b | error | 0 | model not fetchable |
| 08-13 19:06 | knsimon/teutonic-5g6x3hn8b | error | 0 | model not fetchable |
| 08-13 19:06 | knsimon/teutonic-5g6x3hn8b | error | 0 | model not fetchable |