摘要
A sessions
32
133 turns
A tool calls
238
132 tool turns
A calls / turn
1.79
7.44 / session
BC sessions
31
115 turns
BC tool calls
228
115 tool turns
BC calls / turn
1.98
7.35 / session
结论:A 类包含志愿方案链路,gaokao_volunteer_form 占 28.2%;BC 类几乎稳定为 gaokao_sc_tool_batch -> gaokao_search_tool 双调用模式,未调用志愿表工具。
总体分布
tool turn 表示该 turn 至少触发一次 tool call;参数解析失败为 0 表示所有 function.arguments 都能正常 JSON 解析。
| 类别 | sessions | turns | tool turns | tool calls | tool responses | calls/session | calls/turn | 参数解析失败 |
|---|---|---|---|---|---|---|---|---|
| A | 32 | 133 | 238 | 238 | 7.44 | 1.79 | 0 | |
| BC | 31 | 115 | 228 | 228 | 7.35 | 1.98 | 0 |
不同 Tool 分布
| 类别 | tool | calls | turns with tool | sessions with tool | 参数 query items | search query groups |
|---|---|---|---|---|---|---|
| A | gaokao_sc_tool_batch | 286 | 0 | |||
| A | gaokao_search_tool | 707 | 196 | |||
| A | gaokao_volunteer_form | 67 | 0 | |||
| BC | gaokao_sc_tool_batch | 359 | 0 | |||
| BC | gaokao_search_tool | 620 | 135 | |||
| BC | gaokao_volunteer_form | 0 | 0 |
Turn 粒度
每轮 Tool Call 数
| 类别 | calls/turn | turn 数 |
|---|---|---|
| A | 0 | |
| A | 1 | |
| A | 2 | |
| A | 3 | |
| A | 4 | |
| A | 5 | |
| BC | 1 | |
| BC | 2 |
Top Tool 序列
| 类别 | tool sequence | turn 数 |
|---|---|---|
| A | gaokao_sc_tool_batch -> gaokao_search_tool | |
| A | gaokao_volunteer_form -> gaokao_sc_tool_batch | |
| A | gaokao_search_tool | |
| A | gaokao_volunteer_form | |
| A | gaokao_volunteer_form -> gaokao_search_tool | |
| A | gaokao_sc_tool_batch | |
| A | gaokao_volunteer_form -> gaokao_sc_tool_batch -> gaokao_search_tool | |
| A | gaokao_search_tool -> gaokao_sc_tool_batch | |
| A | gaokao_sc_tool_batch -> gaokao_volunteer_form | |
| A | gaokao_sc_tool_batch -> gaokao_search_tool -> gaokao_sc_tool_batch -> gaokao_volunteer_form | |
| BC | gaokao_sc_tool_batch -> gaokao_search_tool | |
| BC | gaokao_search_tool |
Session 粒度
Tool Call 离散度
| 类别 | 均值 | 中位数 | P90 | 最大值 |
|---|---|---|---|---|
| A | 7.44 | 7.0 | 10.0 | 14 |
| BC | 7.35 | 6.0 | 10.0 | 14 |
Top sessions by tool calls
| 类别 | session | turns | tool calls | sc_batch | search | volunteer |
|---|---|---|---|---|---|---|
| A | A_30 | 6 | 14 | 7 | 5 | 2 |
| A | A_10 | 8 | 13 | 7 | 4 | 2 |
| A | A_1 | 5 | 11 | 5 | 5 | 1 |
| A | A_11 | 7 | 10 | 5 | 2 | 3 |
| A | A_16 | 5 | 10 | 4 | 3 | 3 |
| A | A_4 | 5 | 10 | 5 | 2 | 3 |
| A | A_5 | 5 | 9 | 2 | 4 | 3 |
| A | A_7 | 5 | 9 | 5 | 1 | 3 |
| A | A_9 | 5 | 9 | 3 | 4 | 2 |
| A | A_2 | 5 | 8 | 4 | 3 | 1 |
| BC | BC_27 | 7 | 14 | 7 | 7 | 0 |
| BC | BC_19 | 5 | 10 | 5 | 5 | 0 |
| BC | BC_25 | 5 | 10 | 5 | 5 | 0 |
| BC | BC_30 | 5 | 10 | 5 | 5 | 0 |
| BC | BC_5 | 5 | 10 | 5 | 5 | 0 |
| BC | BC_3 | 5 | 9 | 4 | 5 | 0 |
| BC | BC_1 | 4 | 8 | 4 | 4 | 0 |
| BC | BC_13 | 4 | 8 | 4 | 4 | 0 |
| BC | BC_14 | 4 | 8 | 4 | 4 | 0 |
| BC | BC_15 | 4 | 8 | 4 | 4 | 0 |
A 类不同意图下 Tools 分布
gaokao_sc_tool_batchgaokao_search_toolgaokao_volunteer_form
A 类意图从 reasoning_content 中按 A-数字 抽取;多标签 turn 会同时计入多个意图桶,未出现显式标签的 turn 保留为“未标注”。
| 意图 | turns | sessions | tool calls | tool mix | query items |
|---|---|---|---|---|---|
A-1 | 5 | 5 | SC 4 / Search 3 / Volunteer 0 | 65 | |
A-2 | 1 | 1 | SC 0 / Search 0 / Volunteer 1 | 1 | |
A-4 | 63 | 29 | SC 38 / Search 24 / Volunteer 56 | 355 | |
A-5 | 2 | 2 | SC 1 / Search 1 / Volunteer 2 | 13 | |
A-6 | 9 | 6 | SC 4 / Search 2 / Volunteer 10 | 36 | |
A-8 | 11 | 10 | SC 8 / Search 2 / Volunteer 11 | 35 | |
A-9 | 26 | 19 | SC 23 / Search 19 / Volunteer 4 | 257 | |
A-10 | 1 | 1 | SC 2 / Search 1 / Volunteer 1 | 8 | |
未标注 | 41 | 23 | SC 30 / Search 32 / Volunteer 4 | 419 |
意图组合分布
| 意图组合 | turn 数 |
|---|---|
未标注 | |
A-4 | |
A-9 | |
A-4 + A-6 | |
A-4 + A-8 | |
A-4 + A-9 | |
A-8 | |
A-1 | |
A-1 + A-9 | |
A-10 | |
A-2 + A-4 | |
A-4 + A-5 | |
A-5 |
关联产物
| 产物 | 链接 |
|---|---|
| 全量 case 采样报告 | e1_045_platform_nonquant_all_cases_sample_report.html |
| Markdown 分析报告 | e1_045_tools_distribution_analysis.md |
| 机器可读统计 JSON | e1_045_tools_distribution_stats.json |
| Session 明细 CSV | e1_045_session_tool_stats.csv |
| Turn 明细 CSV | e1_045_turn_tool_stats.csv |
| Tool call 长表 CSV | e1_045_tool_calls_long.csv |
| A 类意图统计 CSV | e1_045_a_intent_tool_stats.csv |