中国Floatboat团队在基准测试中击败Claude Opus 4.8,所有五项指标领先,且运行成本为市场最低
· pandaily.com
AOE Tech Labs的Floatboat团队于8月7日进行了一项单变量Harness基准测试实验。以DeepSeek-V4-Flash为模型基础,仅更换执行Harness,同一款价格为0.14美元的模型从在DeepSeek自有Harness上五项指标全部输给Opus 4.8,变为在Floatboat的Harness上五项全部获胜,成本降低57.1倍。
AOE Tech Labs' Floatboat team ran a single-variable Harness benchmark experiment on August 7. With DeepSeek-V4-Flash as the model base and only the execution Harness swapped, the same 0.14-dollar model went from losing all five benchmarks against Opus 4.8 on DeepSeek's own Harness to winning all five on Floatboat's Harness, at 57.1 times lower cost.