Skip to content

docs_gen: write the release's connector data into the docs asset - #4947

Open
JakeSCahill wants to merge 1 commit into
mainfrom
docs/attach-connect-json
Open

JakeSCahill wants to merge 1 commit into
mainfrom
docs/attach-connect-json

Conversation

@JakeSCahill

Copy link
Copy Markdown
Contributor

The docs site's connect-<version>.json (read by the Bloblang playground and other site tools) is still built outside this repo: rp-connect-docs' auto-docs job runs rpk connect list --format json-full on the release binaries, adds Cloud and cgo flags by comparing binaries, and commits the file. It's a second source of truth for the same data, and it lags each release until that job runs.

With -version, docs_gen now writes attachments/connect-<version>.json into the docs asset:

  • The same schema list --format json-full prints, with the version and date.
  • cloudSupported and requiresCgo on every component and config object, from the same platform data as catalog.json.
  • cloudOnly on components only Redpanda Cloud runs. They're found the way cgo-only components are: components that a standard build of allcomponents registers and the redpanda-connect binary doesn't (a2a_message today).

The release job passes the tag's version and its commit date, and the layout check requires the file. A docs_tag rerun of a tag whose docs_gen predates the flag gets the partials only.

Compared with the committed 4.112.0 file, every cloudSupported, requiresCgo, and cloudOnly flag matches for all shared components. The differences: sap_hana and timeplus are new in 4.113.0, rate limits gain their description, and a2a_message loses an unused reason field.

PR CI doesn't pass -version, so PRs are unchanged. This conflicts with the release.yml split in #4938; whichever merges second is rebased.

With -version, docs_gen also writes attachments/connect-<version>.json:
the json-full schema with cloudSupported and requiresCgo on every
component and config object, and cloudOnly on components only Redpanda
Cloud runs. The release job passes the tag's version and date, so the
Bloblang playground and other site tools get the data with the release
instead of from a separate regeneration in rp-connect-docs.
JakeSCahill added a commit to redpanda-data/docs-extensions-and-macros that referenced this pull request Oct 14, 2026
…371)

redpanda-data/connect#4947 adds
`modules/components/attachments/connect-<version>.json` to the Connect
docs asset. The extension now adds files under `attachments/` as
attachments of the `connect` component's `components` module, so the
site serves `/connect/components/_attachments/connect-<version>.json`
from the release itself.

A file that rp-connect-docs already commits wins, as for partials. Its
committed file has the previous version's name, though, so both are
added, and `set-available-attachment-versions` points the Bloblang
playground at the newest. A test covers that path end to end.

Assets without the file (v4.113.0 and older) behave as before.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant