LiveLingo 2.0: composer rewrite, voice dictation, model warm-up and auto-update

.cursor/rules/architecture.mdc

@@ -1,37 +1,42 @@
 ---
-description: LiveLingo architecture boundaries — ViewModel / UI / Platform separation
+description: LiveLingo architecture boundaries — state in C#, the page only draws, platform code behind interfaces
 alwaysApply: true
 ---
 
 # Architecture Boundaries
 
 ## Core Principle
 
-UI 不测试逻辑，逻辑不依赖 UI。
+UI 不测试逻辑，逻辑不依赖 UI。一个功能只由一个服务或组件实现；不为兼容旧行为堆叠分支。
 
-## ViewModel Layer
+## State and logic (C#)
 
-- ViewModel **禁止** 引用 `Avalonia.*` 命名空间
-- ViewModel **禁止** 使用 `Dispatcher`、`Dispatcher.UIThread` 或任何线程调度 API
-- ViewModel 只依赖接口 (`ISettingsService`, `ITranslationPipeline`, `ITextInjector`, `IModelManager` 等)
-- ViewModel 使用 `CommunityToolkit.Mvvm` (`ObservableObject`, `RelayCommand`)
-- 需要通知 UI 的行为通过事件 (`event Action? RequestClose`) 或属性变更实现
+- `ComposerViewModel`、`SettingsViewModel` 和 Core 持有全部状态与逻辑
+- ViewModel **禁止** 引用 `Avalonia.*`，禁止使用 `Dispatcher` 或任何线程调度 API
+- ViewModel 只依赖接口（`ISettingsService`、`IModelManager`、`IVoiceInput`、`ITextInjector` 等）
+- ViewModel 使用 `CommunityToolkit.Mvvm`；需要通知界面时用事件或属性变更
 
-## View Layer (Avalonia)
+## The page (Web UI)
 
-- View 只负责绑定和布局
-- View 中 `code-behind` 仅处理 Avalonia 特有交互 (窗口定位、焦点、动画)
-- Dispatcher 调用只允许出现在 View 或 `App.axaml.cs` 中
+- 窗口是包着 WebView 的薄壳；页面（`Web/Assets`，Preact + htm，无 Node 构建）只绘制整份快照，只发送封闭集合的意图
+- 页面**不持有逻辑**：是否可用、校验、同意、记忆都在 C# 决定
+- 窗口代码只处理 Avalonia 特有的事：定位、焦点、停放；`Dispatcher` 只出现在窗口或 `App.axaml.cs`
 
-## Platform Layer
+## Platform layer
 
-- 平台差异通过接口抽象 (`IPlatformServices`, `IClipboardService`, `ITextInjector`)
-- 具体实现放在 `Platform/Windows/` 或 `Platform/macOS/`
-- 禁止在 ViewModel 中直接使用 P/Invoke 或平台 API
+- 平台差异通过接口抽象（`IPlatformServices`、`IClipboardService`、`ITextInjector`、`IWindowTracker`）
+- 实现放在 `Platform/Windows/` 或 `Platform/macOS/`
+- 禁止在 ViewModel 中使用 P/Invoke 或平台 API
+- 产品只支持 Windows x64 与 macOS arm64（llama.cpp 运行时的固定版本）
+
+## Privacy
+
+- 默认语音和文本不离开本机；云端调用必须由用户按功能显式开启，且只发文本
+- 凭据只进系统密钥存储，不写入代码、日志或设置文件
 
 ## Testing
 
-- ViewModel 测试使用 NSubstitute mock 所有依赖
-- Stryker 变异测试 **不测试** Avalonia UI 项目（源生成器不兼容）
-- Stryker 只测试 `LiveLingo.Core` 项目
-- 代码覆盖率通过 `test.runsettings` 排除平台实现和 View 层
+- ViewModel 测试使用 NSubstitute 替换全部依赖；测试不碰真实磁盘、网络或界面框架
+- 页面由 `LiveLingo.Web.Tests`（Playwright，WebKit + Chromium）用黄金快照测试；夹具由 `Desktop.Tests` 用 `UPDATE_FIXTURES=1` 生成，且必须与时区、操作系统无关
+- Stryker 只测试 `LiveLingo.Core` 的纯逻辑模块（见 `tests/LiveLingo.Core.Tests/stryker-config.json`）
+- 代码覆盖率通过 `test.runsettings` 排除平台实现和窗口壳层

.github/workflows/ci.yml

@@ -10,8 +10,9 @@ permissions:
   contents: read
 
 jobs:
+  # The product ships for Windows x64 and macOS arm64 (the only pinned llama.cpp runtimes), so its tests run on one of them.
   test:
-    runs-on: ubuntu-latest
+    runs-on: macos-latest
 
     steps:
       - uses: actions/checkout@v4
@@ -29,7 +30,19 @@ jobs:
       - name: Restore tools
         run: dotnet tool restore
 
-      - name: Test + Coverage + Mutation
+      - name: Build
         run: |
           chmod +x build.sh
-          ./build.sh Test
+          ./build.sh Build
+
+      # The web tests drive WebKit and Chromium.
+      - uses: actions/cache@v4
+        with:
+          path: ~/Library/Caches/ms-playwright
+          key: ${{ runner.os }}-playwright-${{ hashFiles('tests/LiveLingo.Web.Tests/*.csproj') }}
+
+      - name: Install browsers for the web tests
+        run: pwsh tests/LiveLingo.Web.Tests/bin/Release/net10.0/playwright.ps1 install webkit chromium
+
+      - name: Test + Coverage + Mutation
+        run: ./build.sh Test

.github/workflows/release.yml

@@ -52,10 +52,10 @@ jobs:
       - name: Compile
         run: dotnet build LiveLingo.slnx -c Release --nologo
 
-  # Stage 2: Run tests
+  # Stage 2: Run tests (on macOS: the product ships for Windows x64 and macOS arm64, the pinned llama.cpp runtimes)
   test:
     needs: compile
-    runs-on: ubuntu-latest
+    runs-on: macos-latest
 
     steps:
       - uses: actions/checkout@v4
@@ -75,10 +75,22 @@ jobs:
       - name: Restore tools
         run: dotnet tool restore
 
-      - name: Test
+      - name: Build
         run: |
           chmod +x build.sh
-          ./build.sh Test
+          ./build.sh Build
+
+      # The web tests drive WebKit and Chromium.
+      - uses: actions/cache@v4
+        with:
+          path: ~/Library/Caches/ms-playwright
+          key: ${{ runner.os }}-playwright-${{ hashFiles('tests/LiveLingo.Web.Tests/*.csproj') }}
+
+      - name: Install browsers for the web tests
+        run: pwsh tests/LiveLingo.Web.Tests/bin/Release/net10.0/playwright.ps1 install webkit chromium
+
+      - name: Test
+        run: ./build.sh Test
 
   # Stage 3: Build platform-specific installers
   pack:
@@ -123,25 +135,29 @@ jobs:
         shell: bash
         run: |
           chmod +x build.sh
-          ./build.sh PackMac --skip Test --Runtime ${{ matrix.runtime }} --Version ${{ needs.compile.outputs.version }}
+          ./build.sh Pack --skip Test --Runtime ${{ matrix.runtime }} --Version ${{ needs.compile.outputs.version }}
 
-      - name: Upload installers
+      # The installers and what installed applications update from: the full package and its feed (releases.<channel>.json).
+      - name: Upload release files
         uses: actions/upload-artifact@v4
         with:
           name: installers-${{ matrix.runtime }}
           path: |
             releases/*.exe
             releases/*.msi
             releases/*.pkg
+            releases/*.nupkg
+            releases/releases.*.json
+            releases/RELEASES*
           if-no-files-found: error
 
-  # Stage 4: Create GitHub Release with only installer files
+  # Stage 4: Create the GitHub Release with the installers and the update feeds
   release:
     needs: [compile, pack]
     runs-on: ubuntu-latest
 
     steps:
-      - name: Download all installer artifacts
+      - name: Download all release files
         uses: actions/download-artifact@v4
         with:
           path: installers
@@ -151,13 +167,31 @@ jobs:
       - name: List release files
         run: ls -la installers/
 
+      # An application only updates from a release whose feed names a package that is in it, so a release without one is not published.
+      - name: Check the update feeds
+        run: |
+          for channel in win osx; do
+            feed="installers/releases.${channel}.json"
+            test -f "$feed" || { echo "Missing $feed"; exit 1; }
+            jq -e --arg v "${{ needs.compile.outputs.version }}" \
+              '[.Assets[] | select(.Version == $v and .Type == "Full")] | length == 1' "$feed" > /dev/null \
+              || { echo "$feed has no full package for ${{ needs.compile.outputs.version }}"; exit 1; }
+            for file in $(jq -r '.Assets[].FileName' "$feed"); do
+              test -f "installers/$file" || { echo "$feed names $file, which was not built"; exit 1; }
+            done
+          done
+
       - name: Create GitHub Release
         uses: softprops/action-gh-release@v2
         with:
           tag_name: ${{ needs.compile.outputs.tag }}
           name: LiveLingo ${{ needs.compile.outputs.tag }}
+          prerelease: ${{ contains(needs.compile.outputs.version, '-') }}
           files: |
             installers/*.exe
             installers/*.msi
             installers/*.pkg
+            installers/*.nupkg
+            installers/releases.*.json
+            installers/RELEASES*
           generate_release_notes: true

.gitignore

@@ -428,3 +428,13 @@ stryker-run.log
 # Nuke temp
 .nuke/temp/
 .DS_Store
+
+# Local agent scratch space
+.superpowers/
+
+# POC data (audio corpora, results, models are not committed)
+poc/**/corpus*/
+poc/**/results/
+poc/**/models/
+*.wav
+*.gguf

.nuke/build.schema.json

@@ -28,11 +28,9 @@
         "Clean",
         "Mutate",
         "Pack",
-        "PackMac",
         "PackMsi",
-        "ProbeStt",
         "ProbeTranslation",
-        "ProbeTranslationAll",
+        "ProbeVoice",
         "Publish",
         "Restore",
         "Run",
@@ -128,46 +126,18 @@
           "description": "Minimum line coverage percentage",
           "format": "int32"
         },
-        "EnableSttProbe": {
-          "type": "boolean",
-          "description": "Enable sherpa-onnx STT regression probe target"
-        },
-        "EnableTranslationProbe": {
-          "type": "boolean",
-          "description": "Enable translation regression probe target"
-        },
         "MutationThreshold": {
           "type": "integer",
           "description": "Minimum mutation score percentage",
           "format": "int32"
         },
-        "ProbeCases": {
+        "ProbeCorpus": {
           "type": "string",
-          "description": "Batch probe cases: source=>expected;source=>expected"
-        },
-        "ProbeExpectedContains": {
-          "type": "string",
-          "description": "Expected substring in translation result"
+          "description": "Directory with scenarios.json and audio/<id>.wav used by ProbeVoice (see poc/voice-dictation/corpus)"
         },
         "ProbeModelPath": {
           "type": "string",
-          "description": "Model path used by translation probe"
-        },
-        "ProbeSourceText": {
-          "type": "string",
-          "description": "Source text used by translation probe"
-        },
-        "ProbeSttExpected": {
-          "type": "string",
-          "description": "Expected substring in the STT probe transcription result"
-        },
-        "ProbeSttLang": {
-          "type": "string",
-          "description": "Optional language hint (ISO-639-1) for the STT probe, e.g. en / zh / ja"
-        },
-        "ProbeWavPath": {
-          "type": "string",
-          "description": "Path to a 16 kHz mono wav file used by the STT probe"
+          "description": "Model storage directory used by end-to-end probes (defaults to the app's model directory)"
         },
         "Runtime": {
           "type": "string",