feat(webcam): add AI background cutout, blur, and custom wallpapers (#291) - #493

Merged

EtienneLescot merged 29 commits into

mainfrom

feat/webcam-effects

Aug 30, 2026

Commits on Aug 30, 2026

feat(webcam): add AI background cutout, blur, and custom wallpapers (#291)
EtienneLescot
committed
cfad0cf
fix(ci): update npmDepsHash in nix package and fix TypeScript types in ExportDialog and webcamSegmentation
EtienneLescot
committed
0f486ed
fix(nix): update npmDepsHash to match package-lock.json
EtienneLescot
committed
533e71b
fix(webcam): address the review findings on the AI background PR
EtienneLescot
committed
05061cf
docs(webcam): record where segmentation stands and what has to be measured
EtienneLescot
committed
889a511
docs(webcam): the workload is overhead-bound, so quantisation is the wrong lever
EtienneLescot
committed
f3f1310
docs(webcam): E0 falsifies the overhead-bound reading — it is bandwidth-bound
EtienneLescot
committed
da282a0
docs(webcam): round 3 brief — settle the execution provider
EtienneLescot
committed
97980c9
docs(webcam): settle on the CPU execution provider
EtienneLescot
committed
9952f0e
feat(webcam): composite the segmentation mask in the shader
EtienneLescot
committed
eda73e1
feat(webcam): vendor the ONNX segmentation model and its conversion script
EtienneLescot
committed
28dfa52
feat(webcam): load the segmentation model and produce the mask
EtienneLescot
committed
77421a7
feat(webcam): extract the webcam frame and drive inference at 30 Hz
EtienneLescot
committed
818a6d8
feat(webcam): drive segmentation from compose_frame
EtienneLescot
committed
60b996c
feat(webcam): start segmentation from the scene, and prove it on the bench
EtienneLescot
committed
dd2f4ff
feat(webcam): port the mask composite to Metal and WGSL
EtienneLescot
committed
11e135e
feat(webcam): move segmentation into the compositor and delete the renderer path
EtienneLescot
committed
52d6098
fix(webcam): hide the background control where it cannot work
EtienneLescot
committed
50aabfc
fix(webcam): a missing ONNX Runtime must not take the render thread down
EtienneLescot
committed
568761a
docs(webcam): brief for porting segmentation to a compositor back-end
EtienneLescot
committed
ca5097a
docs(webcam): add the per-back-end specifics to the port brief
EtienneLescot
committed
a90d7f7
feat(webcam): port segmentation to the Metal back-end

sepion02
authored and
EtienneLescot
committed
11dc265
test(webcam): a visual harness for the mask, and what it cost to run

sepion02
authored and
EtienneLescot
committed
42ae637
build(webcam): stage ONNX Runtime, so the segmentation effect can actually run

sepion02
authored and
EtienneLescot
committed
92063f0
feat(webcam): port segmentation to the Linux compositor back-end
EtienneLescot
committed
5f1d7af
build(webcam): ship ONNX Runtime on Linux, now that its back-end can use it
EtienneLescot
committed
8c7a05e
fix(webcam): the three blockers that left the camera background non-functional
EtienneLescot
committed
54a416a
fix(webcam): make the exported mask reproducible
EtienneLescot
committed
3cdbd44
docs(webcam): close out the review threads on the measurement record
EtienneLescot
committed
eec9afb