Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions lrax/common/activations.py
Original file line number Diff line number Diff line change
Expand Up @@ -25,11 +25,12 @@
def lipswish(x: Array) -> Array:
"""LipSwish activation function.

LipSwish has been shown to perform well when applied to neural SDEs. Refer to the
following papers for additional information:
LipSwish has been shown to perform well when applied to neural SDEs. See:

- "Residual Flows for Invertible Generative Modeling" (https://arxiv.org/abs/1906.02735)
- "Efficient and Accurate Gradients for Neural SDEs" (https://arxiv.org/pdf/2105.13493)
- "Residual Flows for Invertible Generative Modeling", Ricky T. Q. Chen, Jens
Behrmann, David Duvenaud, and Jörn-Henrik Jacobsen.
- "Efficient and Accurate Gradients for Neural SDEs", Patrick Kidger, James Foster,
Xuechen Li, and Terry Lyons.

Parameters
----------
Expand Down
7 changes: 2 additions & 5 deletions lrax/common/networks.py
Original file line number Diff line number Diff line change
Expand Up @@ -116,10 +116,7 @@ def __call__(self, x: Array) -> Array:
class TamedMLP(eqx.Module):
"""Implements a tamed MLP, which helps prevent model blow-up during training.

For additional information, see,

"On neural differential equations"
(https://ora.ox.ac.uk/objects/uuid:af32d844-df84-4fdc-824d-44bebc3d7aa9)
"On Neural Differential Equations", Patrick Kidger.
"""

mlp: eqx.nn.MLP
Expand All @@ -136,7 +133,7 @@ def __init__(
*,
key: PRNGKeyArray,
):
"""Initialize an SPD network.
"""Initialize a tamed MLP.

Parameters
----------
Expand Down
4 changes: 2 additions & 2 deletions lrax/ppo/ppo.py
Original file line number Diff line number Diff line change
Expand Up @@ -70,7 +70,7 @@ def _compute_gae(
"""Calculate the advantages and returns using generalized advantage estimation.

"High-Dimensional Continuous Control Using Generalized Advantage Estimation",
John Schulman, Philipp Moritz, Sergey Levine, Michael I. Jordan and Pieter Abbeel
John Schulman, Philipp Moritz, Sergey Levine, Michael I. Jordan, and Pieter Abbeel.

Parameters
----------
Expand Down Expand Up @@ -140,7 +140,7 @@ class PPO(AbstractAlgorithm):
"""Proximal Policy Optimization.

"Proximal Policy Optimization Algorithms", John Schulman, Filip Wolski, Prafulla
Dhariwal, Alec Radford, Oleg Klimov.
Dhariwal, Alec Radford, and Oleg Klimov.

Notes
-----
Expand Down
2 changes: 1 addition & 1 deletion lrax/sac/sac.py
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ class SAC(AbstractAlgorithm):
"""Soft Actor-Critic.

"Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a
Stochastic Actor", Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, Sergey Levine.
Stochastic Actor", Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine.
"""

buffer_size: int = 1_000_000
Expand Down
2 changes: 1 addition & 1 deletion lrax/shac/shac.py
Original file line number Diff line number Diff line change
Expand Up @@ -141,7 +141,7 @@ class SHAC(AbstractAlgorithm):

"Accelerated Policy Learning with Parallel Differentiable Simulation", Jie Xu,
Viktor Makoviychuk, Yashraj Narang, Fabio Ramos, Wojciech Matusik, Animesh Garg,
Miles Macklin.
and Miles Macklin.
"""

num_steps: int = 32
Expand Down
Loading