E1-045 平台推理非量化 Tools 分布报告

按 session、turn、tool call 和 A 类意图四个层次整理。统计对象为 assistant 消息中的 tool_calls[],并和 role=tool 返回数做一致性校验。

生成时间:2026-05-13 15:16:57
A 类:/Users/dujia/Desktop/Data/高考/0512_infer/batch_A类测试_20260513T034539.jsonl
BC 类:/Users/dujia/Desktop/Data/高考/0512_infer/batch_BC类测试_20260513T035445.jsonl

摘要

A sessions
32
133 turns
A tool calls
238
132 tool turns
A calls / turn
1.79
7.44 / session
BC sessions
31
115 turns
BC tool calls
228
115 tool turns
BC calls / turn
1.98
7.35 / session

结论:A 类包含志愿方案链路,gaokao_volunteer_form 占 28.2%;BC 类几乎稳定为 gaokao_sc_tool_batch -> gaokao_search_tool 双调用模式,未调用志愿表工具。

总体分布

tool turn 表示该 turn 至少触发一次 tool call;参数解析失败为 0 表示所有 function.arguments 都能正常 JSON 解析。

类别sessionsturnstool turnstool callstool responsescalls/sessioncalls/turn参数解析失败
A32133
132 (99.2%)
2382387.441.790
BC31115
115 (100.0%)
2282287.351.980

不同 Tool 分布

类别toolcallsturns with toolsessions with tool参数 query itemssearch query groups
Agaokao_sc_tool_batch
94 (39.5%)
87 (65.4%)
31 (96.9%)
2860
Agaokao_search_tool
77 (32.4%)
75 (56.4%)
30 (93.8%)
707196
Agaokao_volunteer_form
67 (28.2%)
66 (49.6%)
30 (93.8%)
670
BCgaokao_sc_tool_batch
113 (49.6%)
113 (98.3%)
31 (100.0%)
3590
BCgaokao_search_tool
115 (50.4%)
115 (100.0%)
31 (100.0%)
620135
BCgaokao_volunteer_form
0 (0.0%)
0 (0.0%)
0 (0.0%)
00

Turn 粒度

每轮 Tool Call 数

类别calls/turnturn 数
A0
1 (0.8%)
A1
44 (33.1%)
A2
74 (55.6%)
A3
11 (8.3%)
A4
2 (1.5%)
A5
1 (0.8%)
BC1
2 (1.7%)
BC2
113 (98.3%)

Top Tool 序列

类别tool sequenceturn 数
Agaokao_sc_tool_batch -> gaokao_search_tool
31 (23.3%)
Agaokao_volunteer_form -> gaokao_sc_tool_batch
23 (17.3%)
Agaokao_search_tool
17 (12.8%)
Agaokao_volunteer_form
15 (11.3%)
Agaokao_volunteer_form -> gaokao_search_tool
13 (9.8%)
Agaokao_sc_tool_batch
12 (9.0%)
Agaokao_volunteer_form -> gaokao_sc_tool_batch -> gaokao_search_tool
5 (3.8%)
Agaokao_search_tool -> gaokao_sc_tool_batch
3 (2.3%)
Agaokao_sc_tool_batch -> gaokao_volunteer_form
3 (2.3%)
Agaokao_sc_tool_batch -> gaokao_search_tool -> gaokao_sc_tool_batch -> gaokao_volunteer_form
1 (0.8%)
BCgaokao_sc_tool_batch -> gaokao_search_tool
113 (98.3%)
BCgaokao_search_tool
2 (1.7%)

Session 粒度

Tool Call 离散度

类别均值中位数P90最大值
A7.447.010.014
BC7.356.010.014

Top sessions by tool calls

类别sessionturnstool callssc_batchsearchvolunteer
AA_30614752
AA_10813742
AA_1511551
AA_11710523
AA_16510433
AA_4510523
AA_559243
AA_759513
AA_959342
AA_258431
BCBC_27714770
BCBC_19510550
BCBC_25510550
BCBC_30510550
BCBC_5510550
BCBC_359450
BCBC_148440
BCBC_1348440
BCBC_1448440
BCBC_1548440

A 类不同意图下 Tools 分布

gaokao_sc_tool_batchgaokao_search_toolgaokao_volunteer_form

A 类意图从 reasoning_content 中按 A-数字 抽取;多标签 turn 会同时计入多个意图桶,未出现显式标签的 turn 保留为“未标注”。

意图turnssessionstool callstool mixquery items
A-155
7 (1.40/turn)
SC 4 / Search 3 / Volunteer 0
65
A-211
1 (1.00/turn)
SC 0 / Search 0 / Volunteer 1
1
A-46329
118 (1.87/turn)
SC 38 / Search 24 / Volunteer 56
355
A-522
4 (2.00/turn)
SC 1 / Search 1 / Volunteer 2
13
A-696
16 (1.78/turn)
SC 4 / Search 2 / Volunteer 10
36
A-81110
21 (1.91/turn)
SC 8 / Search 2 / Volunteer 11
35
A-92619
46 (1.77/turn)
SC 23 / Search 19 / Volunteer 4
257
A-1011
4 (4.00/turn)
SC 2 / Search 1 / Volunteer 1
8
未标注4123
66 (1.61/turn)
SC 30 / Search 32 / Volunteer 4
419

意图组合分布

意图组合turn 数
未标注
41
A-4
39
A-9
19
A-4 + A-6
9
A-4 + A-8
8
A-4 + A-9
5
A-8
3
A-1
3
A-1 + A-9
2
A-10
1
A-2 + A-4
1
A-4 + A-5
1
A-5
1

关联产物