Repository navigation

GSoC Module_A-week7: deduplication and metrics (stacked on top of #1029) - #1038

Closed

ParthAggarwal16 wants to merge 16 commits into

ParthAggarwal16:week_7-deduplication

Closed

GSoC Module_A-week7: deduplication and metrics (stacked on top of #1029)#1038
ParthAggarwal16 wants to merge 16 commits into
OWASP:mainfrom
ParthAggarwal16:week_7-deduplication

Commits on Aug 22, 2026
- feat(harvester): add git diff retrieval pipeline
  ParthAggarwal16
  committed
  aa79243
- feat(harvester): parse unified git diffs
  ParthAggarwal16
  committed
  15a0ba3
- feat(harvester): normalize extracted diff content
  ParthAggarwal16
  committed
  20f0515
- Enhance diff pipeline with metadata and normalization
  ParthAggarwal16
  committed
  f3bcb06
- feat(harvester): add RFC document data models and artifact.py
  ParthAggarwal16
  committed
  a6299e2
- feat(harvester): read files from repository commits
  ParthAggarwal16
  committed
  6986ec1
- feat(harvester): extract markdown heading hierarchy
  ParthAggarwal16
  committed
  0f24d71
- feat(harvester): build structured document objects
  ParthAggarwal16
  committed
  291d2d4
- feat(harvester): validate structured documents
  ParthAggarwal16
  committed
  ea7189f
- feat(harvester): add content hashing for deduplication
  ParthAggarwal16
  committed
  aa3f436
- feat(harvester): add artifact registry
  ParthAggarwal16
  committed
  6abf604
- feat(harvester): implement document deduplication
  ParthAggarwal16
  committed
  5ae56e0
- feat(harvester): add checkpoint management
  ParthAggarwal16
  committed
  57b34d7
- feat(harvester): orchestrate incremental document processing
  ParthAggarwal16
  committed
  f0f9368
- feat(harvester): track deduplication metrics
  ParthAggarwal16
  committed
  c46a848
Commits on Aug 24, 2026
- resolve the textacy stuff
  ParthAggarwal16
  committed
  5750abc