Complete ad network directory, data reports, and refresh workflows

[RaviTejaKNTS]

The ad-network directory now covers 44 active networks with rebuilt network, niche, stats, and checker views. Reviewed SQLite records populate development with 106,441 confirmed sites. Luna validated all 72 niche batches; 85,810 sites have accepted labels, while low-confidence suggestions and missing facts stay unknown.

The change adds resumable data gathering, reviewed niche import, protected network verification, identity/catalog guards, and prepared recurring refresh jobs. Compact report projections and bounded query concurrency keep large reports and sparse searches within the database timeout. Snigel is merged into Publisher Collective; its unpublished route returns 404.

Validation:

• npm run quality passed.
• Final independent Sol review: no blocking findings; 246 tests passed and one optional live-database fixture skipped.
• Real development database checks covered report projection parity and confirmed-departure recovery.
• Desktop/mobile checks covered directory, network, stats, checker, pagination, search, empty results, and invalid-input recovery.
• Transaction recovery: all seven focused niche-sync tests pass, including transient and persistent deadlocks, serialization failures, and immediate rejection of unrelated database errors. The readiness query passed 11 independent semantic fixtures.
• Development contains all reviewed niche labels and the published niche index plus 20 child pages. All children exceed 500 listed sites; accepted labels cover 80.5% of all listed sites.
• Six page types passed at 1440px and 390px with no page overflow or JavaScript errors. Mobile niche network filtering and oldest-domain sorting passed, along with checker recovery, pagination, search, empty results, and reset.
• The niche matrix now uses one grouped query instead of 20 scans. Nine focused report tests and 150 independent SQL parity comparisons passed. The final mobile joining-rule layout was visually checked and independently reviewed.
• All 21 niche routes passed the publisher’s public checks for responses, titles, descriptions, canonical URLs, revisions, robots, smoke text, and sitemap membership.
• Current ad-network suite: 126 passed, one optional live-database fixture skipped. Fresh release manifests preserve reviewed development data and keep Snigel retired; directory (68 entries) and checker previews both report no changes. Network readiness permits researched pages with zero confirmed sites while retaining identity and cohort gates.
• GitHub CI passed on head 5c6cbcbc: core, ad-network, and publication/recovery tests; backend build with strict static checks; static frontend export; and isolated Cloudflare preview verification. Sync unit tests use isolated temporary configuration and mocked database connections. Production publication jobs were skipped as expected before release.

Production activation remains a release step: merge and deploy the reviewed code, apply migrations, sync a fresh reviewed SQLite snapshot, publish selected pages, update the homelab checkout, and enable reviewed jobs. The obsolete discovery timer and verification service are paused with owner approval. Existing RDAP gathering and backups continue. This PR does not activate production data or schedules.