Skip to content

fix: reset file transfer stats on network interruption - #837

Draft
pppanghu77 wants to merge 37 commits into
linuxdeepin:masterfrom
pppanghu77:agent/agent/c02b87ef481d
Draft

pppanghu77 wants to merge 37 commits into
linuxdeepin:masterfrom
pppanghu77:agent/agent/c02b87ef481d

Conversation

@pppanghu77

Copy link
Copy Markdown
Contributor

Root Cause Analysis

After network interruption and recovery, re-sending files causes progress to stick at 1%. The root cause is _file_stats not being reset: initOnlineState() (transferhepler.cpp:65-66) only emits interruption() on network change without canceling in-flight jobs or resetting _file_stats. In handleFileTransStatus() (transferworker.cpp:262-327), all_current_size retains stale values from the interrupted transfer, causing progress = stale_value / new_total × 100 ≈ 1%. Neither sendFiles() nor Retransfer() resets _file_stats at entry.

Fix

Two complementary layers: (1) Root cause layer — in initOnlineState(), call cancelTransferJob() and resetFileStats() before Q_EMIT interruption() to cancel in-flight jobs and clear stale stats on network interruption. (2) Symptom layer — call resetFileStats() at sendFiles() entry as a defensive guard covering all call paths including Retransfer().

Change Safety Assessment

Code Safety

  • Risk Level: Low
  • Target behavior (Q_EMIT interruption() in initOnlineState()) was introduced by PMS 246087 (8ea4fec0); this change does not revert that fix — the interruption signal still fires, and the unfinished-file recording lambda remains connected
  • New resetFileStats() is a simple zeroing of three fields; cancelTransferJob() is an existing method reused in a new call site; no function signatures changed, no public members modified

Business Impact Scope

  • File Transfer module: progress calculation after network interruption recovery
  • User scenario: progress bar no longer sticks at 1% after network recovery; starts from 0% and advances normally
  • Retransfer path: retransferring unfinished files also shows correct progress
  • Normal network file transfer flow has no behavior change

Verification Suggestion

  1. Test file transfer progress advances 0% → 100% under normal network conditions
  2. Test re-sending files after network interruption/recovery — progress should start from 0%
  3. Test Retransfer of unfinished files — progress should advance correctly

根因分析

网络中断恢复后重新投送文件,进度卡在 1%。根因是 _file_stats 未重置:initOnlineState()(transferhepler.cpp:65-66)检测到网络变化时仅发出 interruption() 信号,不取消在途任务也不重置 _file_stats。handleFileTransStatus()(transferworker.cpp:262-327)中 all_current_size 保留中断传输的残留值,导致进度 = 残留值 / 新总量 × 100 ≈ 1%。sendFiles() 和 Retransfer() 入口均不重置 _file_stats。

修复方案

两层互补修复:(1) 根因层 — initOnlineState() 中在 Q_EMIT interruption() 前调用 cancelTransferJob() 取消在途任务并调用 resetFileStats() 重置统计。(2) 症状层 — sendFiles() 入口处防御性调用 resetFileStats(),覆盖含 Retransfer() 在内的所有调用路径。

改动安全评估

代码安全评估

  • 风险等级: 低风险
  • 目标行为(initOnlineState() 中的 Q_EMIT interruption())由 PMS 246087(8ea4fec0)引入;本次改动不撤销该修复——中断信号仍正常发出,未完成文件记录 lambda 仍保持连接
  • 新增 resetFileStats() 仅置零三个字段;cancelTransferJob() 为已有方法在新调用点复用;未修改函数签名,未修改公开成员变量

业务影响范围

  • 文件传输模块:网络中断恢复后重新投送文件的进度计算
  • 用户场景:进度条不再卡在 1%,从 0% 正常推进
  • Retransfer 路径:重传未完成文件时进度同样正常推进
  • 正常网络条件下文件传输流程无行为变化

验证建议

  1. 测试正常网络条件下文件传输进度从 0% 推进到 100%
  2. 测试网络中断恢复后重新投送文件,进度从 0% 正常推进
  3. 测试 Retransfer 路径重传未完成文件,进度正常推进

PMS: BUG-244361

pppanghu77 and others added 30 commits June 25, 2024 14:03
 [build] fix build

Log: [build] fix build
Task: https://pms.uniontech.com/task-view-354339.html
new tag v0.8.5, fix frontend launch issue for win.

Log: v0.8.5 override other incompatible version.
fix Multi user startup test

Log: fix Multi user startup test
Bug: https://pms.uniontech.com/bug-view-256723.html
[start] Change the startup sequence of the front-end and back-end

Log: [start] Change the startup sequence of the front-end and back-end
Bug: https://pms.uniontech.com/bug-view-261983.html
new tag v0.8.6

Log: new tag v0.8.6
[translation] add bo ug translation

Log: [translation] add bo ug translation
Fix title icon issue which caused by DTK updated.

Log: Fix title icon issue.
Bug: https://pms.uniontech.com/bug-view-264627.html
v0.8.7 release.

Log: v0.8.7 release.
…offline

Avoiding the impact of network fluctuations

Log: Added the option to manually disconnect the other party offline
Task: https://pms.uniontech.com/task-view-357177.html
Fix List Status and move the log location to/etc

Log: Fix List Status and move the log location to/et
Task: https://pms.uniontech.com/task-view-357177.html
v0.8.8 release.

Log: v0.8.8 release.
Modify the storage location of log level files

Log: Modify the storage location of log level files
Task: https://pms.uniontech.com/story-view-36529.html
Fix translation and UI issues

Log: Fix translation and UI issues
Bug: https://pms.uniontech.com/bug-view-250549.html
libcoost creates persistent static resources for each thread, which can cause memory leaks when threads are frequently created and released
using a thread pool to avoid frequent creation and destruction of threads
Log: Fix memory leaks
Bug: https://pms.uniontech.com/bug-view-266935.html
The daemon is renamed dde operation daemon

Log: The daemon is renamed dde operation daemon
Bug: https://pms.uniontech.com/bug-view-266935.html
v0.8.9 release.

Log: v0.8.9 release.
The default number of thread pools is too low, resulting in communication failure

Log: [thread] Increase the initial number of threads in threadpool
Bug: https://pms.uniontech.com/bug-view-273695.html
…nnection

Fix the issue of disconnection after network disconnection

Log: Fix the issue of disconnection after network disconnection
Bug: https://pms.uniontech.com/bug-view-273833.html
Record the searched devices and provide the option to minimize pallets

Log: [optimization] Optimize user experience
Bug: https://pms.uniontech.com/bug-view-250143.html
fix the password for the connection page is not complete in tibetan

Log: fix the password display is incomplete
Bug: https://pms.uniontech.com/bug-view-250623.html
Probability crash upon awakening

Log: Probability crash upon awakening
Bug: no
Unable to open from launcher after closing

Log: fix some ui bug
Bug: https://pms.uniontech.com/bug-view-282501.html
Implement a check in the setFile function to ensure that file paths do not exceed two directory levels. This change modifies the filename to retain only the last two directories and the file name itself, enhancing path management.

Log: Filter file paths to limit depth to two directories.
…P retrieval

Replace direct usage of QNetworkInterface::allAddresses() with
deepin_cross::CommonUitls::getFirstIp() to get the first available IP
address.
Log: fix: (data-transfer) replace QNetworkInterface with CommonUtils for IP retrieval
Bug: https://pms.uniontech.com/bug-view-341249.html
…rm transfer mechanism

- Add security checks in `getSaveFullpath` to prevent path traversal attacks by validating
  filenames and ensuring they are within allowed directories using realpath resolution.
- Introduce transfer confirmation mechanism in `JobManager` to require user approval before
  accepting incoming file transfers.
- Add methods to confirm, remove, and check transfer confirmation status for apps.
- Update `SendRpcService` to handle transfer confirmation and refusal messages.
- Include cleanup of confirmation status when jobs finish, cancel, or fail.

Log: fix(security): add path traversal protection in TransferJob and confirm transfer mechanism
Bug: https://pms.uniontech.com/bug-view-343709.html
Replace the library's dependencies with a method that displays the calling dynamic library.

Log: Remove displayjack kvm depend.
- Add file transfer confirmation status when password authentication succeeds
- Allow subsequent file transfers by calling JobManager::confirmTransfer
- This enables file operations after remote login is authenticated

Log: fix(rpc): add file transfer confirmation after successful authentication
Bug: https://pms.uniontech.com/bug-view-354299.html
pppanghu77 and others added 7 commits April 7, 2026 12:38
- Remove the transfer confirmation cleanup on job finished/canceled/failed
- Keep the confirmation state alive for the entire session to allow
  subsequent transfers without re-authentication
- This fixes the network error when transferring files again after
  returning from a completed transfer

Log: fix(transfer): 传输完成后点击返回再次传输提示网络错误
Bug: https://pms.uniontech.com/bug-view-355819.html
…emove transfer.json

- Fix storage directory for data-transfer: place target subdirectory under ~/Downloads
  instead of directly under home directory
- Change cleanup behavior to only remove transfer.json instead of the entire directory

Log: fix(data-transfer): save files to ~/Downloads subdirectory and only remove transfer.json
Bug: https://pms.uniontech.com/bug-view-356089.html
sync by github workflow

Log: none
Influence: none
… prompt on app installation

- Add initSecurityLoaderReport() in main.cpp: when started by deepin-security-loader (--fd1/--fd2 passed), report the system bus unique name and the com.deepin.lastore service list to the loader in JSON so it registers the lastore allow-caller whitelist on our behalf, making InstallPackage free of polkit authentication
- Call the report before any early-exit branch (including single-instance failure), otherwise the loader times out and kills the process, which shows up as a crash on startup
- Add launcher script /usr/bin/deepin-data-transfer: start the real binary /usr/libexec/deepin/deepin-data-transfer through deepin-security-loader with the deepin-daemon group when available (dbus >= 1.12.20.17-deepin1), otherwise fall back to direct launch with the historical polkit behavior
- Enable Qt DBus component/linking and install the real binary to libexec/deepin with the launcher taking over /usr/bin
- Update debian packaging: install the libexec binary and add Recommends: deepin-security-loader

修复(data-transfer): 经 deepin-security-loader 启动以避免安装应用时弹出 polkit 鉴权框

- main.cpp 新增 initSecurityLoaderReport():经 deepin-security-loader 启动(带 --fd1/--fd2 参数)时,将 system bus 唯一连接名和 com.deepin.lastore 服务列表以 JSON 回报给 loader,由其代为注册 lastore 的 allow-caller 白名单,使 InstallPackage 等接口免 polkit 鉴权
- 回报调用置于任何提前退出分支(含单例失败)之前,否则 loader 会超时结束子进程,表现为启动闪退
- 新增启动脚本 /usr/bin/deepin-data-transfer:环境满足(dbus >= 1.12.20.17-deepin1)时经 deepin-security-loader 附加 deepin-daemon 组启动真实二进制 /usr/libexec/deepin/deepin-data-transfer,否则回退直接启动,鉴权行为与历史一致
- 启用 Qt DBus 组件与链接,真实二进制安装至 libexec/deepin,/usr/bin 由启动脚本接管
- 更新 debian 打包:安装 libexec 二进制并增加 Recommends: deepin-security-loader

Log: 数据迁移工具经 deepin-security-loader 附加 deepin-daemon 组启动并回报 bus 连接名,实现 lastore 安装接口免鉴权,修复迁移三方应用时弹出密码认证框的问题
Bug: https://pms.uniontech.com/bug-view-375325.html
…n different filesystems

- Move directories with QDir::rename instead of QFile::rename, which fails with EISDIR on directories
- Fall back to recursive copy plus source removal when rename fails with EXDEV across filesystems: copyDirectory() for directories and QFile::copy for single files
- Fix rename-collision handling: dst.remove(fileName) deleted every occurrence of the name and corrupted paths with repeated segments; only the trailing segment is cut now
- Ensure the destination parent directory exists before moving, for targets such as ~/D:/ derived from Windows drive letters

修复(数据迁移): 修复源和目标位于不同文件系统时 moveFile 搬运失败的问题

- 目录改用 QDir::rename 移动,避免 QFile::rename 移动目录时报 EISDIR 错误
- rename 跨文件系统失败(EXDEV)时退化为复制后删除源:目录走 copyDirectory() 递归复制,单文件走 QFile::copy
- 修复重名避让逻辑: dst.remove(fileName) 会误删路径中所有同名段导致路径破坏,改为只截取结尾段
- 移动前确保目标父目录存在,兼容 ~/D:/ 这类源自 Windows 盘符的目标路径

Log: 修复数据迁移搬运阶段接收目录与主目录不在同一文件系统时 rename 跨设备失败(EXDEV)导致搬运失败的问题
Bug: https://pms.uniontech.com/bug-view-375881.html
- In domain-account environments the loginctl session username may differ
  from the home directory name (e.g. "@xxx"), and the name comparison
  failed, making the daemon exit right after startup (inactive desktop session)
- isActiveUser() now compares the active desktop session UID against getuid(),
  decoupled from the user naming scheme; when multiple desktop sessions are
  active, only the one belonging to the current user is taken as the active session
- KEY_CURRENT_ACTIVE_USER now stores the active session UID and the
  ServiceManager runtime check compares UIDs accordingly
- Guard the loginctl/getuid() based session check with _WIN32 so the daemon
  still compiles on Windows, where the check is not applicable
- Update SPDX copyright year to 2023-2026 for the modified files

修复(daemon): 改用 UID 而非用户名判定活动桌面会话

- 域账号场景下 loginctl 会话用户名与家目录名可能不一致(如 "@xxx"),
  名字比对失败导致 daemon 启动即退出(exit, inactive desktop session)
- isActiveUser 改为比对活动桌面会话 UID 与 getuid(), 与命名体系解耦;
  存在多个活跃桌面会话时, 以属于当前用户的会话为准
- KEY_CURRENT_ACTIVE_USER 改存活动会话 UID, ServiceManager 运行时检查同步按 UID 判定
- 活动会话检查增加 _WIN32 平台守卫, 修复 Windows 构建下 getuid() 编译失败的问题
- 更新所改文件的 SPDX 版权年份为 2023-2026

Log: 修复域账号环境下跨端协同 daemon 无法启动的问题
1. Root cause: initOnlineState() only emits interruption() on network
   change without canceling in-flight jobs or resetting _file_stats,
   leaving stale progress data that causes progress to stick at 1%
2. Fix: call cancelTransferJob() and resetFileStats() before emitting
   interruption() to cancel pending jobs; reset _file_stats at
   sendFiles() entry as defensive guard covering all call paths
3. Impact: network interruption recovery now starts fresh transfer;
   no behavior change for normal transfer flow

Log: fix file transfer progress stuck at 1% after network recovery

Influence:
1. Test file transfer with normal network conditions
2. Test file transfer after network interruption and recovery
3. Verify retransfer of unfinished files works correctly

fix: 网络中断后重置文件传输统计状态

1. 根因:initOnlineState() 检测到网络变化时仅发出 interruption 信号,
   未取消在途任务也未重置 _file_stats,残留进度数据导致进度卡在 1%
2. 方案:中断时先调用 cancelTransferJob() 取消在途任务并重置状态;
   在 sendFiles() 入口处防御性重置 _file_stats,覆盖所有调用路径
3. 影响:网络中断恢复后重新投送文件时进度正常推进;正常传输流程无变化

Log: 修复网络中断恢复后重新投送文件进度卡在 1% 的问题

Influence:
1. 测试正常网络条件下的文件传输
2. 测试网络中断恢复后重新投送文件
3. 验证未完成文件的重传功能正常

PMS: BUG-244361

@sourcery-ai sourcery-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, we are unable to review this pull request

The GitHub API does not allow us to fetch diffs exceeding 20000 lines

@deepin-ci-robot

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: pppanghu77

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@pppanghu77
pppanghu77 marked this pull request as draft October 29, 2026 19:14
@github-actions

Copy link
Copy Markdown

TAG Bot

TAG: 0.8.9
EXISTED: no
DISTRIBUTION: unstable

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants