Skip to content

Sync docs for schema and metadata fields#2435

Open
natoverse wants to merge 9 commits into
mainfrom
docs/schema-metadata-sync
Open

Sync docs for schema and metadata fields#2435
natoverse wants to merge 9 commits into
mainfrom
docs/schema-metadata-sync

Conversation

@natoverse

Copy link
Copy Markdown
Collaborator

Summary

  • Align input docs with current supported formats (JSONL, Parquet, MarkItDown)
  • Update schema documentation for documents and text_units fields
  • Clarify chunking field prepending behavior via raw_data
  • Fix stale architecture/dataflow references to current data model paths
  • Correct output storage field descriptions in config docs

Validation

  • uv run mkdocs build -q

@natoverse natoverse requested a review from a team as a code owner July 10, 2026 22:59
@natoverse

Copy link
Copy Markdown
Collaborator Author

Resolves #2416 and #2301

"outputs": [
{
"name": "stderr",
"output_type": "stream",

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is it ok to have output in these notebooks?

"execution_count": 3,
"metadata": {},
"outputs": [],
"outputs": [

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same as above

"execution_count": 4,
"metadata": {},
"outputs": [],
"outputs": [

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same as above

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants