microsoft mup · Discussions · GitHub

This repository was archived by the owner on Sep 21, 2026. It is now read-only.

Repository navigation

What's an example where two different tensors would have different values of width_mult?
Q&A Davis Yoshida (davisyoshida)

Discussions

You must be logged in to vote

SGD LR for hidden weights

Allan Zhou (AllanYangZhou) started Jun 3, 2023 in General

0
You must be logged in to vote

muP over depth

AlaaKhaddaj asked Jun 2, 2023 in Q&A · Unanswered

0
You must be logged in to vote

muP and Deep Double Descent

mathbloodprince (mathbloodprince) started Apr 26, 2023 in General

1
You must be logged in to vote

Question about the abc parametrization across the two papers

thomasdulacatos started Jan 10, 2023 in General

1
You must be logged in to vote

What's an example where two different tensors would have different values of width_mult?

Davis Yoshida (davisyoshida) asked Mar 20, 2022 in Q&A · Answered

2