Skip to content

Commit 4af572a

Browse files
authored
Add a Pixie Plugin section to the Troubleshooting guide. (#182)
* Add a Pixie Plugin section to the Troubleshooting guide. Signed-off-by: Hannah Troisi <htroisi@pixielabs.ai> * tweak Signed-off-by: Hannah Troisi <htroisi@pixielabs.ai> * Address philkuz's comments Signed-off-by: Hannah Troisi <htroisi@pixielabs.ai> * address philkuz's comment Signed-off-by: Hannah Troisi <htroisi@pixielabs.ai>
1 parent b0fca7c commit 4af572a

3 files changed

Lines changed: 64 additions & 0 deletions

File tree

content/en/01-about-pixie/06-troubleshooting.md

Lines changed: 56 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,12 @@ This page describes how to troubleshoot Pixie. We frequently answer questions on
2525
- [Why is Pixie being OOMKilled?](#troubleshooting-operation-why-is-pixie-being-oomkilled)
2626
- [Troubleshooting tracepoint scripts.](#troubleshooting-operation-troubleshooting-pixie-tracepoint-scripts)
2727

28+
#### Troubleshooting a Pixie Plugin
29+
30+
- [Why isn't my data exporting?](#troubleshooting-a-pixie-plugin-why-isn't-my-data-exporting-when-i-run-an-opentelemetry-export-script-in-the-live-ui)
31+
- [How do I check the Pixie logs for plugin errors?](#troubleshooting-a-pixie-plugin-how-do-i-check-the-pixie-logs-for-plugin-errors)
32+
- [Why isn't my data exporting when I run an OpenTelemetry export script in the Live UI?](#troubleshooting-a-pixie-plugin-why-isn't-my-data-exporting-when-i-run-an-opentelemetry-export-script-in-the-live-ui)
33+
2834
## Troubleshooting Deployment
2935

3036
### How do I check the status of Pixie's components?
@@ -135,3 +141,53 @@ Run the `px/tracepoint_status` script. It should show a longer error message in
135141
*How do I remove a tracepoint table?*
136142

137143
It is not currently possible to remove a table. Instead, we recommend renaming the table name (e.g. table_name_0) while debugging the script.
144+
145+
## Troubleshooting a Pixie Plugin
146+
147+
### Why isn't my data exporting when using the Pixie Plugin?
148+
149+
Here are some things to check if you are not seeing exported data when using the Pixie Plugin:
150+
151+
- Is Pixie working properly? If you just installed Pixie, [did it finish deploying](#troubleshooting-deployment-how-do-i-check-the-status-of-pixie's-components)? Are you able to see data in the [Live UI](/using-pixie/using-live-ui/)?
152+
153+
- Did you [enable the plugin](/reference/plugins/plugin-system/#enabling-a-plugin) from within the Live UI Admin page?
154+
155+
- When you enabled the plugin, did you use the correct endpoint? [Check the logs](#troubleshooting-a-pixie-plugin-how-do-i-check-the-pixie-logs-for-plugin-errors).
156+
157+
- When you enabled a third party Pixie Plugin, did you use the correct type of API key? [Check the logs](#troubleshooting-a-pixie-plugin-how-do-i-check-the-pixie-logs-for-plugin-errors).
158+
159+
- Did you [configure the data retention scripts](/reference/plugins/plugin-system/#long-term-data-retention)? You will need to enable one or more preset scripts and/or custom export scripts.
160+
161+
- If you [added a custom export script](/reference/plugins/plugin-system/#long-term-data-retention-creating-custom-export-scripts), did you first test the script in the Live UI's scratch pad? See the [Export OpenTelemetry Data](/tutorials/integrations/otel/) tutorial for directions.
162+
163+
- Do you see errors in the `kelvin-*` pod logs?
164+
165+
- Do you see errors in the `vizier-query-broker-*` pod logs?
166+
167+
### How do I check the Pixie logs for plugin errors?
168+
169+
1. To debug Pixie Plugin issues, first check for errors in the `kelvin-*` pod logs.
170+
171+
> If you provided an incorrect `custom export URL` (when [enabling the plugin](/reference/plugins/plugin-system/#enabling-a-plugin)), you may see an error like one of the following:
172+
173+
```bash
174+
Query c6139bff-880d-473a-98aa-2a6ca9543dd3 failed, reason: Internal : OTel export (carnot node_id=157) failed with error 'UNAVAILABLE'. Details: failed to connect to all addresses
175+
176+
# or
177+
178+
Query c6139bff-880d-473a-98aa-2a6ca9543dd3 failed, reason: Internal: OTel export (carnot node_id=55) failed with error 'UNAVAILABLE'. Details: DNS resolution failed for service: otel-collector.default.svc.cluster.local:4317
179+
```
180+
181+
> If you provided an API key of an incorrect type (when enabling a third party Pixie Plugin), you may see an error like the following:
182+
183+
```bash
184+
Query fbf952e9-7718-4890-a7d9-7986e18effcf failed, reason: Internal : OTel export (carnot node_id=111) failed with error 'PERMISSION_DENIED'.
185+
```
186+
187+
2. Next, check for errors in the `vizier-query-broker-*` pod logs.
188+
189+
### Why isn't my data exporting when I run an OpenTelemetry export script in the Live UI?
190+
191+
The Live UI's [`Scratch Pad`](/using-pixie/using-live-ui/#write-your-own-pxl-scripts-use-the-scratch-pad) is great tool for quickly developing PxL scripts to export Pixie data in the OpenTelemetry format.
192+
193+
When developing OpenTelemetry export scripts in the Live UI, make sure that your PxL script calls [`px.display()`](/reference/pxl/operators/px.display). The Live UI requires scripts to call this function in order to execute a query. Note that the PxL scripts used by Pixie Plugins do not have the `px.display()` requirement. For more information, see the [Export OpenTelemetry Data](/tutorials/integrations/otel/) tutorial.

content/en/04-tutorials/03-integrations/03-otel.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -273,3 +273,7 @@ px.export(df, px.otel.Data(
273273
```
274274

275275
Congrats! You're now exporting Pixie data to an OTel collector.
276+
277+
## Troubleshooting
278+
279+
Having problems? Check out the [Pixie Plugin Troubleshooting](/about-pixie/troubleshooting/#troubleshooting-troubleshooting-a-pixie-plugin) guide.

content/en/05-reference/04-plugins/01-plugin-system.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -63,3 +63,7 @@ Coming soon!
6363
Interested in contributing a Pixie plugin?
6464

6565
Check out our [Plugin Repository](https://github.com/pixie-io/pixie-plugin) for more details.
66+
67+
## Troubleshooting
68+
69+
Having problems? Check out the [Pixie Plugin Troubleshooting](/about-pixie/troubleshooting/#troubleshooting-troubleshooting-a-pixie-plugin) guide.

0 commit comments

Comments
 (0)