SiteForge: Turning Websites Into Local Knowledge Packs

SiteForge is part of the Knott Dynamics public software line. SiteForge archives websites into local AI-readable packs with snapshots, readable text, chunks, metadata, exports, and diagnostics.

What It Does

SiteForge captures websites into local archive packs containing raw snapshots, readable Markdown, JSON, text output, semantic chunks, SQLite metadata, exports, resume state, diagnostics, and a Scrin/Aisling terminal interface.

Why It Matters

A website archive should be useful after the crawl ends. SiteForge turns pages into durable local material that can be searched, chunked, exported, and inspected without relying on the original site staying unchanged.

Connected Surfaces

• Catalog
• Release page
• Docs page
• Tutorial page
• Package page
• API docs
• Source archive

Operator Notes

• Use resume and diagnostics when archiving larger sites or brittle page trees.
• Keep raw snapshots and readable outputs together so later processing can be audited.
• Use exports when moving archive packs into research, documentation, or local AI workflows.

Release Shape

The current public build tracks SiteForge v0.1.19, 317 package downloads, and 20 published versions.