68e7922469
fix(eval): handle file-target grep and refresh real e2e scripts
2026-04-05 12:58:51 +00:00
49dfaeacd7
refactor(swarm): extract mailbox lock layer
...
Also align real eval scripts with the product default max_turns instead of hardcoded small limits.
2026-04-05 09:32:40 +00:00
8abe47603e
fix(ci): update tests for new system prompt, agent definitions, and CI compatibility
...
- Update prompt assertions to match new OpenHarness system prompt
- Update agent definition tests (verification not verifier, tools=['*'])
- Add pytest.mark.skipif for tests needing real API or AutoAgent workspace
- Fix agent tool test for InProcessBackend same-name spawn conflict
- Fix flaky worktree test for CI environments
2026-04-04 10:14:22 +00:00
8474379b10
fix(ci): resolve ruff lint errors in test files
...
Fix unused imports, single-line multi-statements (E701/E702),
ambiguous variable names (E741), and unused assignments (F841)
across test_untested_features.py, test_real_large_tasks.py, and
test_hooks_skills_plugins_real.py.
2026-04-04 10:06:20 +00:00
82b6a703d1
test: real large multi-feature tasks on unfamiliar AutoAgent codebase
...
6 end-to-end tasks combining 3+ features each, all using real Kimi K2.5 API
on the AutoAgent project (an unfamiliar 17K LOC Python codebase):
1. Security audit: hooks (35 logged entries) + grep + web_fetch + permissions
- 34 tool calls, found real eval/exec/shell injection issues (204s)
2. Coordinator code review: swarm (2 concurrent workers) + team + mailbox
+ agent definitions (verification agent) + task notifications (51s)
3. Migration plan: skills + memory (add/list) + session save/export
+ Plan agent prompt + 3-turn analysis (295s, 176KB markdown export)
4. Bug fix in worktree: git worktree create + file edit + bash test
- Fix verified, original untouched, worktree cleaned up (17s)
5. Full pipeline: coordinator + 2 research workers + permission sync
(request→resolve) + team lifecycle (27s)
6. Refactoring with session: 3-turn edit + session save/load + cost tracking
- Helper function extracted, valid Python, 18 messages saved (46s)
2026-04-04 09:42:19 +00:00
tjb-tech