Skip to content

Commit 3fd5162

Browse files
jaiveersinghNVjaiveersinghNV
authored
Merge pull request #10 from NVIDIA-ISAAC-ROS/hotfix-release-2.1-f6a51266
Add troubleshooting for Tensor Stream Creation Failed error
2 parents 6471aff + 97a4dae commit 3fd5162

204 files changed

Lines changed: 2255 additions & 1210 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎public/.doctrees/environment.pickle‎

221 Bytes
Binary file not shown.

‎public/.doctrees/troubleshooting/dev_env.doctree‎

5.42 KB
Binary file not shown.

‎public/_sources/troubleshooting/dev_env.rst.txt‎

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,34 @@
22
Developer Environment
33
=====================
44

5+
GXF Failure due to Tensor Stream Creation Failed
6+
------------------------------------------------
7+
8+
When launching an Isaac ROS node on a Jetson accessed remotely with X11 forwarding,
9+
X events emitted by CUDA for initializing a tensor stream are captured by the remote
10+
monitoring machine instead of the local Jetson.
11+
12+
Symptom
13+
~~~~~~~
14+
15+
.. code:: bash
16+
17+
[component_container_mt-2] 2023-09-15 14:33:11.362 ERROR /workspaces/isaac_ros-dev/src/isaac_ros_image_pipeline/isaac_ros_image_proc/gxf/tensorops/extensions/tensorops/components/TensorStream.cpp@104: tensor stream creation failed.
18+
[component_container_mt-2] 2023-09-15 14:33:11.363 ERROR gxf/std/entity_warden.cpp@380: Failed to initialize component 00292 (stream)
19+
[component_container_mt-2] 2023-09-15 14:33:11.363 ERROR gxf/core/runtime.cpp@616: Could not initialize entity 'IPOQAFVQYV_global' (E290): GXF_FAILURE
20+
[component_container_mt-2] 2023-09-15 14:33:11.363 ERROR gxf/std/program.cpp@205: Failed to activate entity 00290 named IPOQAFVQYV_global: GXF_FAILURE
21+
[component_container_mt-2] 2023-09-15 14:33:11.363 ERROR gxf/std/program.cpp@207: Deactivating...
22+
[component_container_mt-2] 2023-09-15 14:33:11.396 ERROR gxf/core/runtime.cpp@1227: Graph activation failed with error: GXF_FAILURE
23+
[component_container_mt-2] [ERROR] [1694759591.396604150] [left_decoder_node]: [NitrosContext] GxfGraphActivate Error: GXF_FAILURE
24+
[component_container_mt-2] [INFO] [1694759591.396906843] [right_decoder_node]: [NitrosContext] Loading application: '/workspaces/isaac_ros-dev/install/isaac_ros_h264_decoder/share/isaac_ros_h264_decoder/EZXPATGEMM.yaml'
25+
[component_container_mt-2] [ERROR] [1694759591.396922620] [left_decoder_node]: [NitrosNode] runGraphAsync Error: GXF_FAILURE
26+
[component_container_mt-2] terminate called after throwing an instance of 'std::runtime_error'
27+
[component_container_mt-2] what(): [NitrosNode] runGraphAsync Error: GXF_FAILURE
28+
29+
Solution
30+
~~~~~~~~
31+
32+
Disabling X11 forwarding will prevent X events from being intercepted by the remote machine, resolving the error.
533

634
Docker ``buildx`` plugin not installed
735
--------------------------------------

‎public/about/contact.html‎

Lines changed: 11 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1458,31 +1458,36 @@
14581458
</li>
14591459
<li class="toctree-l1"><a class="reference internal" href="../troubleshooting/index.html">Troubleshooting</a><ul>
14601460
<li class="toctree-l2"><a class="reference internal" href="../troubleshooting/dev_env.html">Developer Environment</a><ul>
1461-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#docker-buildx-plugin-not-installed">Docker <code class="docutils literal notranslate"><span class="pre">buildx</span></code> plugin not installed</a><ul>
1461+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#gxf-failure-due-to-tensor-stream-creation-failed">GXF Failure due to Tensor Stream Creation Failed</a><ul>
14621462
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#symptom">Symptom</a></li>
14631463
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#solution">Solution</a></li>
14641464
</ul>
14651465
</li>
1466-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#repository-cloned-without-pulling-git-lfs-files">Repository cloned without pulling <code class="docutils literal notranslate"><span class="pre">git-lfs</span></code> files</a><ul>
1466+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#docker-buildx-plugin-not-installed">Docker <code class="docutils literal notranslate"><span class="pre">buildx</span></code> plugin not installed</a><ul>
14671467
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id1">Symptom</a></li>
14681468
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id2">Solution</a></li>
14691469
</ul>
14701470
</li>
1471-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#x11-forward-issue">X11-forward issue</a><ul>
1471+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#repository-cloned-without-pulling-git-lfs-files">Repository cloned without pulling <code class="docutils literal notranslate"><span class="pre">git-lfs</span></code> files</a><ul>
14721472
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id3">Symptom</a></li>
14731473
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id4">Solution</a></li>
14741474
</ul>
14751475
</li>
1476-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#ros-2-domain-id-collision">ROS 2 Domain ID Collision</a><ul>
1476+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#x11-forward-issue">X11-forward issue</a><ul>
14771477
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id5">Symptom</a></li>
14781478
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id6">Solution</a></li>
14791479
</ul>
14801480
</li>
1481-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#no-opt-ros-humble-install-directory-in-docker-container">No <code class="docutils literal notranslate"><span class="pre">/opt/ros/humble/install</span></code> directory in Docker container</a><ul>
1481+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#ros-2-domain-id-collision">ROS 2 Domain ID Collision</a><ul>
14821482
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id7">Symptom</a></li>
14831483
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id8">Solution</a></li>
14841484
</ul>
14851485
</li>
1486+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#no-opt-ros-humble-install-directory-in-docker-container">No <code class="docutils literal notranslate"><span class="pre">/opt/ros/humble/install</span></code> directory in Docker container</a><ul>
1487+
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id9">Symptom</a></li>
1488+
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id10">Solution</a></li>
1489+
</ul>
1490+
</li>
14861491
</ul>
14871492
</li>
14881493
<li class="toctree-l2"><a class="reference internal" href="../troubleshooting/hardware_setup.html">Hardware Setup</a><ul>
@@ -1680,7 +1685,7 @@ <h1>Contact<a class="headerlink" href="#contact" title="Link to this heading">
16801685

16811686
<div role="contentinfo">
16821687
<p>&#169; Copyright 2023, NVIDIA.
1683-
<span class="lastupdated">Last updated on Dec 09, 2023.
1688+
<span class="lastupdated">Last updated on Jan 22, 2024.
16841689
</span></p>
16851690
</div>
16861691

‎public/about/index.html‎

Lines changed: 11 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1458,31 +1458,36 @@
14581458
</li>
14591459
<li class="toctree-l1"><a class="reference internal" href="../troubleshooting/index.html">Troubleshooting</a><ul>
14601460
<li class="toctree-l2"><a class="reference internal" href="../troubleshooting/dev_env.html">Developer Environment</a><ul>
1461-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#docker-buildx-plugin-not-installed">Docker <code class="docutils literal notranslate"><span class="pre">buildx</span></code> plugin not installed</a><ul>
1461+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#gxf-failure-due-to-tensor-stream-creation-failed">GXF Failure due to Tensor Stream Creation Failed</a><ul>
14621462
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#symptom">Symptom</a></li>
14631463
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#solution">Solution</a></li>
14641464
</ul>
14651465
</li>
1466-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#repository-cloned-without-pulling-git-lfs-files">Repository cloned without pulling <code class="docutils literal notranslate"><span class="pre">git-lfs</span></code> files</a><ul>
1466+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#docker-buildx-plugin-not-installed">Docker <code class="docutils literal notranslate"><span class="pre">buildx</span></code> plugin not installed</a><ul>
14671467
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id1">Symptom</a></li>
14681468
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id2">Solution</a></li>
14691469
</ul>
14701470
</li>
1471-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#x11-forward-issue">X11-forward issue</a><ul>
1471+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#repository-cloned-without-pulling-git-lfs-files">Repository cloned without pulling <code class="docutils literal notranslate"><span class="pre">git-lfs</span></code> files</a><ul>
14721472
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id3">Symptom</a></li>
14731473
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id4">Solution</a></li>
14741474
</ul>
14751475
</li>
1476-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#ros-2-domain-id-collision">ROS 2 Domain ID Collision</a><ul>
1476+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#x11-forward-issue">X11-forward issue</a><ul>
14771477
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id5">Symptom</a></li>
14781478
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id6">Solution</a></li>
14791479
</ul>
14801480
</li>
1481-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#no-opt-ros-humble-install-directory-in-docker-container">No <code class="docutils literal notranslate"><span class="pre">/opt/ros/humble/install</span></code> directory in Docker container</a><ul>
1481+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#ros-2-domain-id-collision">ROS 2 Domain ID Collision</a><ul>
14821482
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id7">Symptom</a></li>
14831483
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id8">Solution</a></li>
14841484
</ul>
14851485
</li>
1486+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#no-opt-ros-humble-install-directory-in-docker-container">No <code class="docutils literal notranslate"><span class="pre">/opt/ros/humble/install</span></code> directory in Docker container</a><ul>
1487+
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id9">Symptom</a></li>
1488+
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id10">Solution</a></li>
1489+
</ul>
1490+
</li>
14861491
</ul>
14871492
</li>
14881493
<li class="toctree-l2"><a class="reference internal" href="../troubleshooting/hardware_setup.html">Hardware Setup</a><ul>
@@ -1685,7 +1690,7 @@ <h1>About<a class="headerlink" href="#about" title="Link to this heading"></a
16851690

16861691
<div role="contentinfo">
16871692
<p>&#169; Copyright 2023, NVIDIA.
1688-
<span class="lastupdated">Last updated on Dec 09, 2023.
1693+
<span class="lastupdated">Last updated on Jan 22, 2024.
16891694
</span></p>
16901695
</div>
16911696

‎public/about/license.html‎

Lines changed: 11 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1458,31 +1458,36 @@
14581458
</li>
14591459
<li class="toctree-l1"><a class="reference internal" href="../troubleshooting/index.html">Troubleshooting</a><ul>
14601460
<li class="toctree-l2"><a class="reference internal" href="../troubleshooting/dev_env.html">Developer Environment</a><ul>
1461-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#docker-buildx-plugin-not-installed">Docker <code class="docutils literal notranslate"><span class="pre">buildx</span></code> plugin not installed</a><ul>
1461+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#gxf-failure-due-to-tensor-stream-creation-failed">GXF Failure due to Tensor Stream Creation Failed</a><ul>
14621462
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#symptom">Symptom</a></li>
14631463
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#solution">Solution</a></li>
14641464
</ul>
14651465
</li>
1466-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#repository-cloned-without-pulling-git-lfs-files">Repository cloned without pulling <code class="docutils literal notranslate"><span class="pre">git-lfs</span></code> files</a><ul>
1466+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#docker-buildx-plugin-not-installed">Docker <code class="docutils literal notranslate"><span class="pre">buildx</span></code> plugin not installed</a><ul>
14671467
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id1">Symptom</a></li>
14681468
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id2">Solution</a></li>
14691469
</ul>
14701470
</li>
1471-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#x11-forward-issue">X11-forward issue</a><ul>
1471+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#repository-cloned-without-pulling-git-lfs-files">Repository cloned without pulling <code class="docutils literal notranslate"><span class="pre">git-lfs</span></code> files</a><ul>
14721472
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id3">Symptom</a></li>
14731473
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id4">Solution</a></li>
14741474
</ul>
14751475
</li>
1476-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#ros-2-domain-id-collision">ROS 2 Domain ID Collision</a><ul>
1476+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#x11-forward-issue">X11-forward issue</a><ul>
14771477
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id5">Symptom</a></li>
14781478
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id6">Solution</a></li>
14791479
</ul>
14801480
</li>
1481-
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#no-opt-ros-humble-install-directory-in-docker-container">No <code class="docutils literal notranslate"><span class="pre">/opt/ros/humble/install</span></code> directory in Docker container</a><ul>
1481+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#ros-2-domain-id-collision">ROS 2 Domain ID Collision</a><ul>
14821482
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id7">Symptom</a></li>
14831483
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id8">Solution</a></li>
14841484
</ul>
14851485
</li>
1486+
<li class="toctree-l3"><a class="reference internal" href="../troubleshooting/dev_env.html#no-opt-ros-humble-install-directory-in-docker-container">No <code class="docutils literal notranslate"><span class="pre">/opt/ros/humble/install</span></code> directory in Docker container</a><ul>
1487+
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id9">Symptom</a></li>
1488+
<li class="toctree-l4"><a class="reference internal" href="../troubleshooting/dev_env.html#id10">Solution</a></li>
1489+
</ul>
1490+
</li>
14861491
</ul>
14871492
</li>
14881493
<li class="toctree-l2"><a class="reference internal" href="../troubleshooting/hardware_setup.html">Hardware Setup</a><ul>
@@ -1680,7 +1685,7 @@ <h1>License<a class="headerlink" href="#license" title="Link to this heading">
16801685

16811686
<div role="contentinfo">
16821687
<p>&#169; Copyright 2023, NVIDIA.
1683-
<span class="lastupdated">Last updated on Dec 09, 2023.
1688+
<span class="lastupdated">Last updated on Jan 22, 2024.
16841689
</span></p>
16851690
</div>
16861691

0 commit comments

Comments
 (0)