Skip to content

[NFC] clarify the choices in blackbox_optimizers - #575

Open
mtrofin wants to merge 5 commits into
mainfrom
mtrofin/typing
Open

[NFC] clarify the choices in blackbox_optimizers#575
mtrofin wants to merge 5 commits into
mainfrom
mtrofin/typing

Conversation

@mtrofin

@mtrofin mtrofin commented Aug 17, 2026

Copy link
Copy Markdown
Collaborator

Mainly for type checkers or linters - they may believe (incorrectly) that top_index may be uninitialized.

@mtrofin
mtrofin marked this pull request as ready for review August 17, 2026 19:49
@mtrofin
mtrofin requested a review from boomanaiden154 August 17, 2026 19:52
boomanaiden154
boomanaiden154 previously approved these changes Aug 17, 2026
Comment thread compiler_opt/es/blackbox_optimizers.py Outdated

@boomanaiden154 boomanaiden154 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Base automatically changed from mtrofin/fix-antithetic-top-directions to main August 17, 2026 22:07
Mainly for type checkers or linters - they may believe (incorrectly) that `top_index` may be uninitialized.
Update filter_top_directions to rank antithetic pairs by max(R+, R-)
instead of symmetric absolute difference |R+ - R-|, following the
Augmented Random Search (ARS) standard (Mania et al., 2018).

In non-smooth or bounded environments, large negative penalties (cliffs)
produce massive absolute differences that dominate Top-K direction
selection and displace directions that discover higher-reward peaks.
Sorting by maximum reward focuses the update on the top-performing
perturbations.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants