muse-agent-example/tests/skills/plan-story/test_select_patterns_offline.py
zizi c9f69d9d6d 治理: Skill 测试治理第一阶段——harness 控制平面 + 实现测试迁出运行时目录
范围(不含 design-story-foundation、docs/、humanization/README.md 等进行中改动):

1. 新增 harness/ 控制平面
   - skill_harness.py 静态审计:32 个运行时 Skill 的 frontmatter/manifest/文档污染,当前 0 问题
   - run_selected.py 选择性执行器:manifest 与磁盘一一对账、依赖阻断、
     空跑与 skip-only 失败关闭、AST 测试形状门
   - manifests/skills.json:32 个 Skill 的合同责任方与协作领域登记
   - manifests/test-inventory.json:81 个测试资产登记
   - specs/skill-testing.md 与 README.md:测试分层、证据边界与 harness 职责

2. 实现测试从 .claude/skills/*/scripts/ 迁至 tests/skills/<skill>/
   - 71 个测试文件迁移并修复项目根与临时目录运行导入
   - 数据库触发器测试宽泛异常收窄为 psycopg.errors.RaiseException
   - 抽取离线大测试拆出真实 PG smoke(默认阻断,不计入离线通过)
   - 抽取 presence 去重边界拆出独立测试:493 + 78 = 571 项检查不变

3. 运行时文档清理
   - 13 个 SKILL.md 移除自测/离线验证段落、测试命令与测试文件事实源表述,
     只保留运行时合同;业务运行合同、额度、授权与离线模式均保留

4. SoT 同步
   - AGENTS.md:新增 Skill 领域索引(7 个合同责任方分组,覆盖 32 个运行时 Skill)
   - 领域 07:测试入口改由 harness/manifests/ 登记,SKILL.md 不承载测试命令
   - humanization 覆盖矩阵:活动测试路径同步迁移

验证证据: harness 自测 15 项 + runner 自测 13 项通过;静态审计 32 Skill / 0 问题;
73 个非数据库测试通过;8 个集成条目中 6 个 PostgreSQL 项被依赖门明确阻断;
py_compile 与 git diff --check 通过。未连接 PostgreSQL、网络、真实模型或额度。

已知边界: 真正 skill_behavior_eval 仍为 0,尚未验证任何 Skill 自然语言行为;
evaluate-frozen-replay 的 raw 存储边界冲突留待单独治理。
2026-08-19 01:50:20 +08:00

47 lines
2.1 KiB
Python

#!/usr/bin/env python3
"""范式选择投影的离线测试,不调用向量服务。"""
import pathlib
import sys
import unittest
from unittest.mock import patch
PROJECT_ROOT = pathlib.Path(__file__).resolve().parents[3]
SCRIPT_DIR = PROJECT_ROOT / ".claude" / "skills" / "plan-story" / "scripts"
sys.path.insert(0, str(SCRIPT_DIR))
import select_patterns as selector # noqa: E402
class SelectPatternsContractTest(unittest.TestCase):
def test检索结果投影成严格范式来源指针(self):
cards = [{
"sourceId": "draft:677", "sourceVersion": "draft-revision:1",
"name": "借尸试人", "summary": "借外在突袭验证立场",
"visibleFields": {"写法": "先试探后收手"},
}]
with patch.object(selector, "search_cards", return_value=cards), \
patch.object(selector, "write_section", return_value={"id": 9, "status": "written"}) as write, \
patch.object(selector, "record_section", return_value={"status": "recorded"}):
result = selector.select_patterns(12, "深空机甲微恐战斗", top=5)
ref = result["section"]
self.assertEqual(result["selected"], 1)
self.assertEqual(ref["id"], 9)
write.assert_called_once()
payload = write.call_args.kwargs["payload"]
self.assertEqual(payload["patternReferences"][0]["sourceId"], "draft:677")
self.assertEqual(payload["patternReferences"][0]["sourceType"], "public_pattern")
def test无命中记录明确原因(self):
with patch.object(selector, "search_cards", return_value=[]), \
patch.object(selector, "write_section", return_value={"id": 10, "status": "written"}) as write, \
patch.object(selector, "record_section", return_value={"status": "recorded"}):
selector.select_patterns(12, "无命中意图")
payload = write.call_args.kwargs["payload"]
self.assertEqual(payload["patternSelection"]["emptyReason"], "公共范式检索没有命中可授权卡")
if __name__ == "__main__":
unittest.main()