Skip to content

add Kubernetes AI Conformance working group #8515

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

fedebongio
Copy link
Contributor

Which issue(s) this PR fixes:

This PR is a follow up on the email sent 2 weeks ago on WG creation, see https://groups.google.com/a/kubernetes.io/g/dev/c/u6I_mCRC4lE

cc @janetkuo

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. committee/steering Denotes an issue or PR intended to be handled by the steering committee. sig/architecture Categorizes an issue or PR as relevant to SIG Architecture. labels Jul 9, 2025
@k8s-ci-robot k8s-ci-robot added the size/L Denotes a PR that changes 100-499 lines, ignoring generated files. label Jul 9, 2025
@k8s-ci-robot k8s-ci-robot requested a review from dims July 9, 2025 17:53
@cblecker
Copy link
Member

cblecker commented Jul 9, 2025

/hold
for review

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jul 9, 2025
@fedebongio
Copy link
Contributor Author

cc @mfahlandt

efficiently run AI/ML workloads. \n"
charter_link: charter.md
stakeholder_sigs:
- Architecture
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe this should list the same SIGs that are listed as stakeholders in your charter.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

Copy link
Member

@BenTheElder BenTheElder Jul 10, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMHO this should also have SIG testing given that a suite of tests is in scope.

cc @aojea @pohly

As a TL I am +1 to sponsor the WG.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay, so does everybody agree to list only: SIG Architecture and SIG Testing for now? Please let me know so I can make the change and get this merged asap to start meeting

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 as SIG Testing TL.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 as SIG Arch Chair

@janetkuo
Copy link
Member

janetkuo commented Jul 9, 2025

cc SIG Arch chairs @derekwaynecarr @dims @johnbelamaric for approval

@dims
Copy link
Member

dims commented Jul 9, 2025

@janetkuo let me paste @derekwaynecarr 's question from doc here

Derek Carr
Derek Carr
5:25 PM Jul 7
I apologize for being out of office during the meeting, but it looks like this proposal has evolved from an earlier form I had seen for networking conformance/benchmarking.

I want to understand more, but my general concern is that the document linked is larger in scope and its not clear how a single vendor may or may not be able to assert conformance depending on what it prereqs in its current form (particularly if it requires multiple vendors to reach a solution).  For example, the availability of a production DRA driver does not exist at this time from any GPU vendor (let alone a Kubernetes distribution).

Isn't this inverting the process?  Should a WG be formed to explore what should or should not be done (including if conformance is needed) and then allow vendors (hardware and software) to participate to appropriately determine if the requirements as written could be fulfilled?

Copy link

@franciscojavierarceo franciscojavierarceo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd like to advocate for an explicit nomination process for the leads of AI Conformance.


#### Code, Binaries and Services

- The primary artifact will be the Kubernetes AI Conformance specification and a suite of tests to demonstrate conformance.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In which repository will this be maintained? Who will be the maintainers of the conformance specification?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is an open question from the SIG arch meeting.

IIRC there was loose agreement to follow up in the WG to discuss options for how best to implement and host this and present them to the relevant groups (SIG Arch, SIG Testing, CNCF, ....).

In think this should be clarified, it is undetermined if there will be binary artifacts in the kubernetes organization. They may be in the CNCF, or the workgroup might determine that there's an alternate approach.

Copy link
Member

@andreyvelich andreyvelich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for this @fedebongio!

fedebongio and others added 3 commits July 10, 2025 16:55
Co-authored-by: Janet Kuo <[email protected]>
Co-authored-by: Janet Kuo <[email protected]>
Fixing 80 char line correctly
@fedebongio
Copy link
Contributor Author

/retest

Copy link
Contributor

@soltysh soltysh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

With all the bits in this
/lgtm (from steering)

/label tide/merge-method-squash

@k8s-ci-robot k8s-ci-robot added the tide/merge-method-squash Denotes a PR that should be squashed by tide when it merges. label Jul 29, 2025
@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 29, 2025
@soltysh
Copy link
Contributor

soltysh commented Jul 29, 2025

Looks like one more verify failure 😉

@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 29, 2025
@pohly
Copy link
Contributor

pohly commented Jul 29, 2025

👍 (steering and future liaison)

This file will be auto generated
@mfahlandt
Copy link
Member

@fedebongio can you rerun the generator, i can't pr into your branch GitHub does not find it ^^

@derekwaynecarr
Copy link
Member

Apologies for delay, I have been traveling.

/lgtm

+1 SIG Arch Chair

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 29, 2025
@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 29, 2025
@BenTheElder
Copy link
Member

+1 (steering)
/lgtm
/approve

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 29, 2025
Copy link
Member

@justaugustus justaugustus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 (Steering)
/lgtm
/approve

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: BenTheElder, fedebongio, franciscojavierarceo, janetkuo, justaugustus, mfahlandt, saschagrunert, soltysh

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • OWNERS [BenTheElder,justaugustus,mfahlandt,saschagrunert,soltysh]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@soltysh
Copy link
Contributor

soltysh commented Jul 29, 2025

we have sufficient steering 👍 -ing
/hold cancel

@k8s-ci-robot k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jul 29, 2025
@k8s-ci-robot k8s-ci-robot merged commit abc3687 into kubernetes:master Jul 29, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. committee/steering Denotes an issue or PR intended to be handled by the steering committee. lgtm "Looks good to me", indicates that a PR is ready to be merged. sig/architecture Categorizes an issue or PR as relevant to SIG Architecture. sig/testing Categorizes an issue or PR as relevant to SIG Testing. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. tide/merge-method-squash Denotes a PR that should be squashed by tide when it merges.
Projects
None yet
Development

Successfully merging this pull request may close these issues.