What it covers
- Workspaces — the container for ingested data, members, and downstream work.
- Ingestion — a managed job that runs convert, split, shape, and extract, then loads the result into a workspace.
- Queries — natural-language questions over already ingested workspace data.
- Sources — inspection of ingested documents and derived structure.
The pipeline
Ingestion is four steps from source to structured records.1
Convert
Normalize diverse sources into clean, machine-readable text. The formats convert accepts are listed below.
2
Split
Break that text into pieces that preserve document structure — sections and headings — so later steps see coherent units rather than arbitrary cuts.
3
Shape
Discover the schema of the content: classes, properties, and relationships. A customer can also supply a schema and skip discovery.
4
Extract
Pull matching facts and links as structured records. The output is entities and relationships shaped by that schema, not a bag of retrieved passages.
Source formats
Convert accepts the formats below. AZIP archive of supported files is unpacked; each file inside is ingested as its own source. Web pages can be passed as URLs.
Documents
PDF, Word (docx), PowerPoint (ppt, pptx), Markdown (md), and plain text (txt).Scans and images
JPEG, PNG, TIFF, WebP, GIF, and BMP.Spreadsheets
Excel (
xls, xlsx) and CSV.Structured data
JSON, JSON Lines (jsonl, ndjson), HTML, and XML.Mail and transcripts
Email (
eml) and captions (vtt).Engineering models
IFC building models and BCF issue packages (bcf, bcfzip).Audio and video
Audio (
mp3, wav, m4a) and video (mp4, mov).