Acquire
Normalize data
RSS, HTML, and API payloads become one item model.
Sources do not share a format. RSS, HTML list pages, and news APIs all become the same item fields so search, alerts, and workflows do not care which connector produced a row.
Why it matters
RSS ───────┐
HTML list ─┤
News API ──┘
↓
Normalized item
↓
Search · Feeds · Alerts · WorkflowsWhat downstream uses
- Full-text search over title, summary, and body
- Category streams on Feeds and the Feed API
- Alert match on keyword or category
- Workflow conditions on category, title, summary, URL, source_id
Normalization is the foundation of the rest of the platform. Intelligence products (PolyIntel, PolyRAG) will sit on the same items when they ship.
32 articles on this site. Engineering notes on GitHub.
