Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a test e2e plan #39

Closed
7 tasks
alexsnaps opened this issue Sep 7, 2022 · 1 comment
Closed
7 tasks

Create a test e2e plan #39

alexsnaps opened this issue Sep 7, 2022 · 1 comment
Labels
kind/epic Master issue tracking broken down work size/medium

Comments

@alexsnaps
Copy link
Member

alexsnaps commented Sep 7, 2022

Test scenarii

  • Installation itself
  • RLP happy path (add, mod, delete CRs)
  • AP happy path (add, mod, delete CRs)
  • "invalid" services (e.g. no Istio)
  • invalid CRs (test status)
  • Transient failures?
  • Uninstall

Implementation considerations

  • Test should "only" use public APIs (i.e. CRs) and test for expected outcome, e.g. the service is rate limited.
  • It's fine to have transient failures because of out-of-sync dependencies. Let's see how much we get, why we get them and re-assess if these become "too many".
  • Defer to kcp to actual testing implementation (for future safe testing, when integrating with them)
@alexsnaps alexsnaps added the kind/epic Master issue tracking broken down work label Sep 7, 2022
@alexsnaps alexsnaps added this to the v0.1.0 milestone Sep 7, 2022
@eguzki
Copy link
Contributor

eguzki commented Aug 29, 2023

What about testing the user guides? That is, implement the user guides workflow adding assertions to make sure the state is what is should be at any intermediate step.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/epic Master issue tracking broken down work size/medium
Projects
No open projects
Status: To test
Development

No branches or pull requests

2 participants