Repository navigation

feat(comprehension): ingestion-time LLM digests so ask/chat answer structure + combination questions - #1158

Merged

northdpole merged 243 commits into

stagingfrom

feat/ingest-comprehension

Nov 1, 2026

Merged

feat(comprehension): ingestion-time LLM digests so ask/chat answer structure + combination questions#1158
northdpole merged 243 commits into
stagingfrom
feat/ingest-comprehension

Commits on Oct 14, 2026
- feat(librarian): Module C retrieval upgrades (stack base for #1088)
  northdpole
  committed
  f4c314d
- Address review feedback on OIE librarian base.
  northdpole
  committed
  8368601
- feat(harvester): requirement extract and GitHub URL ingest
  northdpole
  committed
  70af687
- feat(oie): B2 eval harness and CRE neighborhood scorer
  northdpole
  committed
  583e987
- feat(librarian): LLM SafetyGuard for C.4 adversarial / update flags
  northdpole
  committed
  7fe303e
- Address review feedback on harvester and GitHub URL ingest.
  northdpole
  committed
  62d0c4b
- Address review feedback on B2 harness scripts.
  northdpole
  committed
  25f07e1
- chore(oie): ASVS 5.0 provisional B2 sources and gold
  northdpole
  committed
  955528d
- chore(oie): NIST 800-53 and remaining B2 sources/gold
  northdpole
  committed
  86d320a
- feat(mappings): promote Related-orphan remaps into canonical fixtures
  northdpole
  committed
  62cedd4
- Address review feedback on full-pipeline runner.
  northdpole
  committed
  81faa70
- feat(librarian): batch Module C query embeddings
  northdpole
  committed
  53562bf
- fix(librarian): keep LLM SafetyGuard when restacking leaf-drilldown
  northdpole
  committed
  657284b
- fix(librarian): finish SafetyGuard + leaf-drilldown restack merge
  northdpole
  committed
  ec9accd
- feat(oie): full-pipeline runner, docs, and experimental-flag notes
  northdpole
  committed
  e83b169
- Add experimental OIE OWASP metadata agent for chat
  
  cursoragent
  and
  northdpole
  committed
  f180d0d
- feat(librarian): promote d1-winner combo defaults (judge+cap8+top_k=3)
  northdpole
  committed
  0b797a5
- Isolate OWASP meta concepts to chat and MCP only
  
  cursoragent
  and
  northdpole
  committed
  dfec9a8
- Add idempotent Alembic migration for OWASP agent meta tables.
  northdpole
  committed
  b3fce72
- Fix OWASP agent probe gaps for chapters, people, membership, and CRE facts.
  northdpole
  committed
  a91d6e1
- Add synth v2 probe suite and raise agent routing pass rate.
  northdpole
  committed
  6953269
- Format owasp_agent modules with black for CI lint.
  northdpole
  committed
  3c6bcff
- Document OWASP agent setup, OIE relationship, and synth eval.
  northdpole
  committed
  6da242e
- Black-format remaining owasp_agent modules for CI.
  northdpole
  committed
  6d9eb6b
- Answer OWASP entity chat probes from agent metadata.
  northdpole
  committed
  060e651
- Add multi-turn chat memory with New chat.
  northdpole
  committed
  8ce9b6c
- Harden OWASP agent routing for board, geo, CRE, and PG index.
  northdpole
  committed
  32aefc1
- Route OWASP chat via multi-lane embedding similarity.
  northdpole
  committed
  e75479a
- Make OWASP agent meta embedding work on low-memory staging.
  northdpole
  committed
  a69c0d3
- Add adversarial completion asker and align embed model ids.
  northdpole
  committed
  aeb2ebf
- Fix OWASP agent routing for chapter-in-city and project leaders.
  northdpole
  committed
  033597b
- Treat named-chapter meetup asks as chapter lookup.
  northdpole
  committed
  34907f9
- Reuse one Flask app in the adversarial completion asker.
  northdpole
  committed
  7a1cf7d
Commits on Oct 15, 2026
- feat(owasp-agent): sim-first retrieve with normalize, chapters, board ontology
  northdpole
  committed
  3772492
- fix(owasp-agent): stop substring event/chapter traps and city hardcodes
  northdpole
  committed
  1202fa4
- fix(owasp-agent): drop meta/normative keyword dump gates
  
  northdpole
  and
  cursoragent
  committed
  5369337
- fix(owasp-agent): drop keyword dumps; derive project aliases on ingest
  northdpole
  committed
  b32ebbf
- Fix first-run harvest: list tracked files, order-safe chunk joins, checkpoint after write
  northdpole
  committed
  6a5867e
- Add scheduled OIE runs: OWASP (10 min) and CRE expansion (daily)
  northdpole
  committed
  4d375d5
- Report the agent index target in scheduled agent_sync
  northdpole
  committed
  643e6e1
- Chain oie_run Alembic revision after source_channel.
  northdpole
  committed
  eb95ff1
- Add signed-in admin showcase and Brevity bot skill.
  
  northdpole
  and
  cursoragent
  committed
  0994bed
- Complete remaining admin showcase plan items.
  
  northdpole
  and
  cursoragent
  committed
  080ffa8
- Guard admin fetches on unmount and type the config catalog.
  
  northdpole
  and
  cursoragent
  committed
  c9f19de
- Fix mapping edit fields and lock HTTP OIE to dry-run.
  
  northdpole
  and
  cursoragent
  committed
  c102785
- Drop unused ingest kwargs after HTTP OIE lock.
  
  northdpole
  and
  cursoragent
  committed
  dc8cb26
- Run HTTP OIE start in a dry-run child process.
  
  northdpole
  and
  cursoragent
  committed
  e2815e9
- Add plan-required admin tests for disabled agent, pipeline errors, and discard.
  
  northdpole
  and
  cursoragent
  committed
  db09073
- Isolate HTTP OIE on sqlite and surface failed starts.
  
  northdpole
  and
  cursoragent
  committed
  a56f660
- Gate /admin on capabilities.admin and surface delete errors.
  
  northdpole
  and
  cursoragent
  committed
  1a6488a
- Treat failed changeset fetches as errors in admin review.
  
  northdpole
  and
  cursoragent
  committed
  0690ed6
- Drop restated admin-panel comments after Brevity review.
  
  northdpole
  and
  cursoragent
  committed
  e8d7675
- Shorten admin login copy and drop restated MyOpenCRE blurb.
  
  northdpole
  and
  cursoragent
  committed
  20f5733
- Handle empty Impact keys with logs and JSON errors.
  
  northdpole
  and
  cursoragent
  committed
  6859e05
- Show impact warnings in Admin and format helpers.
  
  northdpole
  and
  cursoragent
  committed
  03612c2
- Keep stacked Nest agent env; agent DB is Postgres.
  
  northdpole
  and
  cursoragent
  committed
  5d77d3f
- Treat OWASP_AGENT_DB as Postgres only.
  
  northdpole
  and
  cursoragent
  committed
  51c243c
- Redact passwords in OWASP_AGENT_DB admin display.
  
  northdpole
  and
  cursoragent
  committed
  5a05310
- Harden admin targets, ingest, and mapping errors.
  
  northdpole
  and
  cursoragent
  committed
  5f3a6f3
- Add admin repos.yaml editor, org expand, and one-off ingest.
  
  northdpole
  and
  cursoragent
  committed
  40e16f5
- Harden repos.yaml org expand and yaml size limits.
  
  northdpole
  and
  cursoragent
  committed
  84e9839
- Rebuild frontend bundle for repos.yaml admin editor.
  
  northdpole
  and
  cursoragent
  committed
  3b58d49
- Raise repos.yaml admin cap to 4MiB for org expands.
  
  northdpole
  and
  cursoragent
  committed
  c1bf1b5
- Decouple repos.yaml config from GitHub org expansion.
  
  northdpole
  and
  cursoragent
  committed
  dce904e
- Treat the OWASP agent as a built-in ingest resource.
  
  northdpole
  and
  cursoragent
  committed
  c8f3298
- Reject inaccessible GitHub sources at config time.
  
  northdpole
  and
  cursoragent
  committed
  2a4015d
- Redesign admin IA: dashboard, config, pipeline, graph.
  
  northdpole
  and
  cursoragent
  committed
  a477189
- Rebuild frontend bundle for the admin IA redesign.
  
  northdpole
  and
  cursoragent
  committed
  bccae60
- Persist Add org on save and mark apply_failed on the strip.
  
  northdpole
  and
  cursoragent
  committed
  87824bc
- Drop OWASP_AGENT_DB; agent uses the main app Postgres.
  
  northdpole
  and
  cursoragent
  committed
  2f0da3f
- Fix OIE child import path; agent index uses the main DB.
  
  northdpole
  and
  cursoragent
  committed
  9ab2499
- Run admin OIE on Docker Postgres; drop sqlite:// child cache.
  
  northdpole
  and
  cursoragent
  committed
  555c4e7
- Align Flask/agent DB env order; always pin psycopg2 dialect.
  
  northdpole
  and
  cursoragent
  committed
  61bfcf9
- Make admin ingest run OIE end-to-end without false Module A errors.
  
  northdpole
  and
  cursoragent
  committed
  1422dee
- Skip invalid harvest docs; surface agent last_sync from meta_entity.
  
  northdpole
  and
  cursoragent
  committed
  0d372bc
- Restore degraded stop contract; tighten admin ingest defaults.
  
  northdpole
  and
  cursoragent
  committed
  3322ed0
- Fix Graph management Accept/errors for empty OIE import runs.
  
  northdpole
  and
  cursoragent
  committed
  1e5b4e5
- Surface OIE skip reasons, flags, and graph path in pipeline logs.
  
  northdpole
  and
  cursoragent
  committed
  f3ec363
- Auto-pull CRE graph in admin-local when Postgres is empty.
  northdpole
  committed
  3d820cb
- Wire Postgres admin bootstrap into make install and make dev.
  northdpole
  committed
  15a4fa1
- Wire golden-set harvest and OWASP agent sync into Admin Config.
  northdpole
  committed
  f814150
- Add Mac handover for admin/OIE/agent E2E validation.
  northdpole
  committed
  45eb358
- Chain admin panel tables migration after oie_run
  northdpole
  committed
  afb0948
- Black-format admin_imports_api_test for CI
  northdpole
  committed
  aabb90b
- Run admin OIE ingest through Modules B and C by default.
  northdpole
  committed
  7871306
- Paint Module C auto-filed graph edges and nodes in the explorer.
  northdpole
  committed
  bfcb1e4
- Add Module C.1 graph filing to the OIE A→B→C pipeline.
  northdpole
  committed
  0f22476
- Default Module C.1 auto-filing off behind an admin Config toggle.
  northdpole
  committed
  7b9b007
- Restore clarify followup test dropped in admin rebase.
  northdpole
  committed
  18ed280
- Parse OWASP event pages and harvest event repos
  northdpole
  committed
  5657668
- Embed auto-filed graph nodes in the CRE expansion job
  northdpole
  committed
  1ebd0f8
- Make event page parsing linear-time and clean Playwright fallback text
  northdpole
  committed
  1210ac2
- Make event-repo harvesting opt-in (OIE_HARVEST_EVENTS)
  northdpole
  committed
  bc13dc6
Commits on Oct 22, 2026
- style: format files flagged by CI (black, prettier)
  
  northdpole
  and
  claude
  committed
  5308183
- style: format files flagged by CI (black, prettier)
  
  northdpole
  and
  claude
  committed
  fcefa22
- test: fix stale admin config assertion, env leaks between tests, and the sync isolation guardrail
  
  northdpole
  and
  claude
  committed
  9262fde
- test: embedding-failure scheduler test needs graph filing enabled now that it defaults off
  
  northdpole
  and
  claude
  committed
  3351aeb
- Merge admin-panel-showcase into oie-event-pages-embeddings (picks up the test fixes)
  northdpole
  committed
  934f01c
Commits on Oct 25, 2026
Commits on Nov 1, 2026

Commits

Commits on Oct 14, 2026

Commits on Oct 15, 2026

Commits on Oct 22, 2026

Commits on Oct 25, 2026