Skip to content

Can't use side inputs with Combine.PerKeyWithHotKeyFanout #20637

Open

Description

@damccorm

PerKeyWithHotKeyFanout doesn't allow a user to specify a side input and access it in the CombineFn. When the function withHotKeyFanout is called, any sideinputs stored in the Combine.PerKey are dropped. (https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Combine.java#L1571): 


    public PerKeyWithHotKeyFanout<K, InputT, OutputT> withHotKeyFanout(
        SerializableFunction<?
super K, Integer> hotKeyFanout) {
      return new PerKeyWithHotKeyFanout<>(fn, fnDisplayData, hotKeyFanout);

   }

We would like to be able to use side inputs and hot key fanout.

Imported from Jira BEAM-11005. Original Jira may contain additional context.
Reported by: miagilepner.

Activity

  1. blazingbhavneek commented on May 12, 2023

    @blazingbhavneek

    Hey there! 👋 I'm new to this repository and eager to contribute! 🌟 Could you kindly suggest some entry point or files to look into?

  2. damccorm commented on May 15, 2023

    @damccorm
    ContributorAuthor

    Hey, saw you added this comment several places. I'd recommend focusing on a single issue at first (I answered the underlying question here - #20298 (comment))

  3. marc7806 commented on Oct 6, 2023

    @marc7806
    Contributor

    .take-issue

  4. singhmrinal02 commented on Sep 16, 2026

    @singhmrinal02
    Contributor

    Hi, I'd like to work on this issue as a first contribution to Apache . Could you please assign it to me?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions