Associate Software Quality Engineer at Red Hat · Bangalore, India
I build the quality layer for Red Hat Developer Hub: Backstage plugin coverage, Playwright end-to-end suites, GitOps CI, and evaluation of LLM-backed features.
Quality engineering for an internal developer portal built on Backstage. Coverage runs from plugin unit and integration tests through product end-to-end flows and the CI that executes them on Kubernetes.
| Area | What I cover |
|---|---|
| Intelligent Assistant and Lightspeed | Notebooks, saved prompts, screen context, RBAC, bring-your-own-key RAG |
| Model Context Protocol | Kubernetes actions, orchestrator, scorecard tools, dynamic client registration |
| Catalog and platform plugins | Boost, OGX entity provider, KServe / Kubeflow connector, scorecard, homepage |
| Delivery | GitHub Actions, Kind, GitOps for the AI rolling demo, flake reduction |
| LLM evaluation | RAG relevancy, faithfulness, bias, and hallucination with DeepEval |
111 merged pull requests. 68 of those landed in redhat-developer, with more merged in Backstage community plugins, the RHDH AI rolling demo, and the automation-coverage MCP.
| Project | Merged | Focus |
|---|---|---|
| redhat-developer/rhdh-plugins | 46 | Playwright, integration, and permission coverage for Developer Hub plugins |
| redhat-developer/rhdh | 14 | Showcase end-to-end tests for scorecard, catalog, and adoption insights |
| redhat-developer/rhdh-plugin-export-overlays | 8 | Lightspeed, Intelligent Assistant, scorecard, and homepage e2e |
| redhat-ai-dev/ai-rolling-demo-gitops | 5 | GitOps CI, KServe connector coverage, Playwright TypeScript migration |
| backstage/community-plugins | 3 | Topology and ACR end-to-end tests, including i18n |
| rhdh-pai-qe/automation-coverage-mcp | 2 | Jira-driven automation planning and Feature-to-QE ticket breakdown |
Further merged pull requests sit on collaborator forks of these same repositories, usually while a change is in review.
- Topology e2e tests and ACR e2e tests with i18n in Backstage community plugins
- Notebook Release 2.1 e2e coverage and RBAC permission integration tests for Intelligent Assistant
- Kubernetes MCP actions coverage and Boost catalog coverage
- Lightspeed e2e workspace and notebook e2e coverage
- Playwright TypeScript migration and KServe / Kubeflow connector e2e
- Jira MCP integration and the Feature-to-QE ticket planner
Playwright in TypeScript and Python · React Testing Library · Backstage startTestBackend · DeepEval · Model Context Protocol · OpenShift · GitOps
rhdh-Lightspeed-Evaluation Automated evaluation of RAG answers from Developer Hub Lightspeed. Checks relevancy, faithfulness, bias, and hallucination, with a local Ollama model as the judge.
DeepEval learnings Notes and experiments on testing LLM applications with DeepEval.
automation-coverage-mcp Coverage-driven test planning for RHDH plugin forests, including a Jira integration that turns a Feature into the cheapest useful test layer.
