Skip to content

feat(cu/ch): 集成 Windows 原生 History 与跨平台任务录制 - #690

Open
Jovianix wants to merge 36 commits into
MemTensor:v1.2.7from
Jovianix:feature/windows-history-native-core
Open

Jovianix wants to merge 36 commits into
MemTensor:v1.2.7from
Jovianix:feature/windows-history-native-core

Conversation

@Jovianix

@Jovianix Jovianix commented Oct 21, 2026 •

Copy link
Copy Markdown

改动内容

将 Windows 原生 Computer History 与跨平台任务录制独立集成到 v1.2.7。包含 Windows UIA 采集、共享 History 摘要、任务录制暂停/恢复、视频回放、事件时间线与 OpenAdapt Flow 离线导出。

本次同步(2026-10-30)

  • PR 来源:Jovianix:feature/windows-history-native-core,当前提交 921020fb182c9a667dfe12e665ebfb033b66e772。
  • 已合入上游 v1.2.7@38bbafab71116a7c743bb4fe963db7cb04b40957(包含团队合入的 v1.2.6);解决冲突后正常快进推送,未强推。
  • 保留原生 History 与任务录制行为,并整合上游共享 History 诊断、任务 digest、thinking/interrupt 字段、SSE 和退出收尾逻辑。
  • 录制助手退出时核对 socket 类型,避免把替换成普通文件的路径误判为成功关闭。

本轮验证

  • npm run lint、npm run typecheck、Agent typecheck 和 Agent build 通过。
  • 前端完整测试:3358 通过、3 跳过;Agent 目标回归:1372 通过、23 跳过。
  • 打包守卫:132 通过、2 跳过;后端关闭与 SSE 生命周期:8 通过;桌面退出相关用例:107 通过。
  • Memory 调度、扫描和压力用例隔离复测:96 通过。原完整回归在并发负载下出现超时,隔离复测均通过。

历史验收与限制

  • 合并前提交 047b3fe5 的 macOS/Windows 原生 History CI、OpenAdapt 兼容性及实机打包验收见本 PR 历史记录;它们不能替代本轮提交的 CI。
  • 当前 Linux checkout 缺少 Office E2E 的生成版 release 描述文件,完整后端套件因此有 2 项失败;Electron 离屏 webview 测试亦受当前图形环境影响。
  • OpenAdapt 集成为离线导出;桌面端自动回放或技能生成不在本 PR 范围。GitHub CI 与代码审查需在本轮提交上重新完成。

Jovianix and others added 30 commits October 2, 2026 17:59
Add the C++20 collector, isolated UIA worker, explicit policies, native protocol, input metadata, controlled fixtures and reproducible MSVC build entry. Release and Debug builds pass unit, Win32 boundary and CLI contract checks; foreground acceptance and package delivery remain separate.
…eline

Connect explicit application consent and the native adapter to the shared recording, summary and retrieval service and Windows UI. Preserve Mac import paths and recording formats, fix platform-aware summary metadata and model-sync coverage, and add a reproducible validation entry with a Mac handoff. Validation: 508 tests passed with 8 explicit skips; types, scoped lint, Agent compile and frontend build passed. Mac desktop regression remains required.
Close active SSE responses before Fastify waits for connections and reject event streams whose authentication finishes during shutdown.

Add real HTTP shutdown regression tests and document macOS automated, native, packaged, and installed-App validation results and remaining acceptance cases.
Integrate MemTensor v1.2.3 at dce29c5, including main at f6694d9,
with the Windows History and task-recording work at 92816b3.

Port upstream History summaries, recorder health, Memory synchronization,
source settings and WeChat support into the shared core. Retain the Windows
native driver, Word/VS Code evidence provenance and task recording/export.
Apply shared application exclusions and WeChat consent to native Windows
records, and preserve document context qualifiers through raw retention.

Use upstream Computer Use and permission restart behavior while retaining
recording cleanup, quit ownership and both Windows native validation jobs.

Validation: workspace and standalone agent builds; agent, frontend and
shell typechecks; version consistency; 2712 related regression tests passed
and 201 platform-dependent tests skipped. Windows/macOS native capture and
signed installer acceptance still require the respective operating systems.
Read foreground content by provider capabilities with bounded Raw View and
MSAA fallbacks, and enrich Chrome and Edge records with verified page URLs.

Unify Windows observation settings and management tools, preserve explicit
legacy scopes and sensitive-input filtering, and report content provenance
and capture quality through the shared recording and summary pipeline.
Separate Windows MJS packaging from TypeScript contract tests, validate
feature branch pushes, and pass absolute report paths in the macOS job.

Repair stale defaults and native report fixtures, isolate synthetic Mac
file metadata from the Windows host, and use Git Bash, PowerShell and
junction fixtures appropriate to the host. Preserve explicit skips when
file-symlink permissions or native platform support are unavailable.

Use POSIX Mac interpreter paths and emit BOM-free native report JSON.
Record the fixed integration baseline, the Windows capture and validation
results, remaining Electron limitations, and the move to the personal
feature branch without updating the shared integration branch.
Carry v1.2.3 fixes into the shared History core while retaining platform
adapters, task recording, quit cleanup, and Windows packaging checks.
Preserve both browser capture and path-based Windows exclusion rules.

Validation on macOS: Agent/frontend types and builds, History 885 passed
with 5 platform skips, CU/Agent 882 passed, frontend 159 passed, desktop
lifecycle/package 194 passed, and contract/package checks 46 passed with
5 platform skips. Both summary CLI paths and version checks passed.

The macOS native recording media self-test still reports
part_finalize_failed; reproduced from unchanged pre-merge 646d7b4 source.
Windows native/installed-app acceptance remains separate.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants