Acquire
Acquire
Connect sources and turn source content into structured items.
The acquisition layer connects a workspace to external sources and turns source content into structured items that search, monitoring, the Feed API, and automations can reuse.
Pipeline
Discover / fetch ↓ Extract ↓ Normalize ↓ Deduplicate ↓ Index and deliver
Not every source uses every stage. RSS is a feed URL. HTML list starts from a listing page. API sources call a news provider with a stored credential.
Source types today
- RSS or Atom feeds
- HTML listing pages (article links, optional URL filters)
- News-provider HTTP APIs (GNews, NewsData, and similar)
Documents, media files, and generic enterprise connectors are not live source types. Use RSS, HTML list, or a supported news API.
Acquire once, reuse everywhere
The same ingested items support search, watches, alerts, the Feed API, and workflows. You do not reconnect the original publisher for each output.
- SourcesShared fields and types.
- Connect a sourceAdd RSS, HTML list, or API.
- Configure ingestionFetch, extract, deliver.
- Normalize dataOne item model.
- FeedsCategory streams.
32 articles on this site. Engineering notes on GitHub.
