Repository navigation
Add on-device AI video enhancement with Play Services Media Effect Enhancement - #195
Merged
Merged
Conversation
MayuriKhinvasara
commented
Sep 23, 2026
MayuriKhinvasara
commented
Contributor
- Integrate Play Services Media Effect Enhancement SDK (16.0.0-beta08) in EnhancementMode.SURFACE for on-device AI video enhancement (Tonemap, Deblur & Denoise, and 2x RAISR Upscale).
- Implement zero-copy GPU surface transcode pipeline (MediaExtractor -> hardware MediaCodec decoder -> session.inputSurface -> EnhancementSession -> hardware MediaCodec encoder -> MediaMuxer).
- Enforce suspension-safe 1-to-1 frame lockstep backpressure via Channel.CONFLATED and onSurfaceProcessed callback.
- Preserve BT.709 SDR color metadata, apply decode-order PTS queue remapping, copy audio track losslessly, and cap output resolution at 2560x1440 (2K).
- Add background session pre-warming at app startup and post-run re-warm for 0 ms perceived session initialization latency.
…ect Enhancement - Integrate Play Services Media Effect Enhancement SDK (16.0.0-beta08) in EnhancementMode.SURFACE for on-device AI video enhancement (Tonemap, Deblur & Denoise, and 2x RAISR Upscale). - Implement zero-copy GPU surface transcode pipeline (MediaExtractor -> hardware MediaCodec decoder -> session.inputSurface -> EnhancementSession -> hardware MediaCodec encoder -> MediaMuxer). - Enforce suspension-safe 1-to-1 frame lockstep backpressure via Channel.CONFLATED and onSurfaceProcessed callback. - Preserve BT.709 SDR color metadata, apply decode-order PTS queue remapping, copy audio track losslessly, and cap output resolution at 2560x1440 (2K). - Add background session pre-warming at app startup and post-run re-warm for 0 ms perceived session initialization latency.
MayuriKhinvasara
requested review from
SigmanZero,
donovanfm and
madebymozart
as code owners
September 23, 2026 17:22
kailianc
approved these changes
Sep 23, 2026
ashnohe
approved these changes
Oct 7, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.