docs(process): three sets through one rule bot, three rounds through one agent
The rule-bot table carries the third set now, which is the point of having a rule bot at all: a full 50-level acceptance pass takes one second, so every selection change can be checked against the previous one before any agent time is spent. Blind rotations 0.24 → 0.12 → 0.14, worst streak 4 → 1 → 1, dead taps zero throughout. The band table shows all three rounds side by side, each against the levels it actually played. Round 3 is reported as what it is: an unconfirmed hypothesis. It raised contrast and held rotation depth, and the back band's rating did not follow. On a rating that retests at 0.55 that settles nothing either way, so the page says the two are indistinguishable and names the design reasons the third set is the one being handed over — rather than quoting whichever number makes the last change look good. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
@@ -72,17 +72,15 @@ a{color:var(--rail)}
|
||||
<h2>两轮之间改了什么,效果如何</h2>
|
||||
<p>第一轮唯一可用的读数是「整批偏易」,加上抱怨里反复出现的「转了没反应」。据此只改了两件事:给<b>连续空转</b>设闸门(最多一次转动没反应,此前有 11 关能连着两次),以及把难度曲线<b>写成旋转深度的配额</b>而不是指望它从排序里自己长出来。第三轮又只改了一件:桶内改按<b>反差</b>取。每轮一个变量,才看得出是哪个变量起的作用。</p>
|
||||
<table>
|
||||
<thead><tr><th>同一个规则机器人,两套关卡集</th><th class="n">第一版</th><th class="n">第二版</th></tr></thead>
|
||||
<thead><tr><th>同一个规则机器人,三套关卡集</th><th class="n">第一版</th><th class="n">第二版</th><th class="n">第三版</th></tr></thead>
|
||||
<tbody>
|
||||
|
||||
<tr><td>盲转 / 关</td><td class="n">0.24</td><td class="n yes">0.12</td></tr>
|
||||
<tr><td>最长连续盲转</td><td class="n">4</td><td class="n yes">1</td></tr>
|
||||
<tr><td>空点 / 关</td><td class="n">0.00</td><td class="n">0.00</td></tr>
|
||||
<tr><td>决策 / 关(要做的事)</td><td class="n">10.3</td><td class="n">10.3</td></tr>
|
||||
|
||||
<tr><td>盲转 / 关</td><td class="n ">0.24</td><td class="n yes">0.12</td><td class="n yes">0.14</td></tr>
|
||||
<tr><td>最长连续盲转</td><td class="n ">4</td><td class="n yes">1</td><td class="n yes">1</td></tr>
|
||||
<tr><td>空点 / 关</td><td class="n ">0.00</td><td class="n ">0.00</td><td class="n ">0.00</td></tr>
|
||||
<tr><td>决策 / 关(要做的事)</td><td class="n ">10.3</td><td class="n ">10.3</td><td class="n ">9.8</td></tr>
|
||||
</tbody>
|
||||
</table>
|
||||
<p>要做的事一样多,浪费掉的动作少了一半。这是同一个玩家的对照,所以变的是关卡不是模型的心情。</p>
|
||||
<p>要做的事一样多,浪费掉的动作少了一半,而且第三版保住了这个成绩。这是同一个玩家的对照,所以变的是关卡不是模型的心情——一次 50 关的全量验收 1 秒跑完,这也是为什么全量验收该交给它而不是 agent。</p>
|
||||
<table>
|
||||
<thead><tr><th>grok 实测,按档(每关计一次,与它自己玩的那一版对齐)</th><th class="n" colspan="2">R1</th><th class="n" colspan="2">R2</th><th class="n" colspan="2">R3</th></tr>
|
||||
<tr><th></th><th class="n">难度</th><th class="n">无解感</th><th class="n">难度</th><th class="n">无解感</th><th class="n">难度</th><th class="n">无解感</th></tr></thead>
|
||||
|
||||
Reference in New Issue
Block a user