Skip to content
This repository was archived by the owner on Nov 17, 2023. It is now read-only.

Commit f0c0a97

Browse files
eric-haibin-linszha
authored andcommitted
Further improve 1.3 NEWS.md (#12368)
* Update NEWS.md * Update NEWS.md
1 parent 679ec51 commit f0c0a97

1 file changed

Lines changed: 3 additions & 2 deletions

File tree

NEWS.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,8 +27,8 @@ MXNet Change Log
2727
- This enables stable training on large-scale networks with high memory consumption such as FCN for image segmentation.
2828

2929
### New Features - Sparse Tensor Support for Gluon (experimental)
30-
- Sparse gradient support is added to nn.Embedding. ([#10924](https://github.com/apache/incubator-mxnet/pull/10924))
31-
- Gluon Parameter now supports "row_sparse" stype, which speeds up multi-GPU training ([#11001](https://github.com/apache/incubator-mxnet/pull/11001), [#11429](https://github.com/apache/incubator-mxnet/pull/11429))
30+
- Sparse gradient support is added to `gluon.nn.Embedding`. Set `sparse_grad=True` to enable when constructing the Embedding block. ([#10924](https://github.com/apache/incubator-mxnet/pull/10924))
31+
- Gluon Parameter now supports "row_sparse" storage type, which reduces communication cost and memory consumption for multi-GPU training for large models. `gluon.contrib.nn.SparseEmbedding` is an example empowered by this. ([#11001](https://github.com/apache/incubator-mxnet/pull/11001), [#11429](https://github.com/apache/incubator-mxnet/pull/11429))
3232
- Gluon HybridBlock now supports hybridization with sparse operators ([#11306](https://github.com/apache/incubator-mxnet/pull/11306)).
3333

3434
### New Features - Control flow operators (experimental)
@@ -47,6 +47,7 @@ MXNet Change Log
4747
### New Features - Topology-aware AllReduce (experimental)
4848
- This features uses trees to perform the Reduce and Broadcast. It uses the idea of minimum spanning trees to do a binary tree Reduce communication pattern to improve it. This topology aware approach reduces the existing limitations for single machine communication shown by mehods like parameter server and NCCL ring reduction. It is an experimental feature ([#11591](https://github.com/apache/incubator-mxnet/pull/11591)).
4949
- Paper followed for implementation: [Optimal message scheduling for aggregation](https://www.sysml.cc/doc/178.pdf).
50+
- Set environment variable `MXNET_KVSTORE_USETREE=1` to enable.
5051

5152
### New Features - Export MXNet models to ONNX format (experimental)
5253
- With this feature, now MXNet models can be exported to ONNX format([#11213](https://github.com/apache/incubator-mxnet/pull/11213)). Currently, MXNet supports ONNX v1.2.1. [API documentation](http://mxnet.incubator.apache.org/api/python/contrib/onnx.html).

0 commit comments

Comments
 (0)