test: add E2E autotest plans and GitHub Action workflow#1605
Merged
wenytang-ms merged 3 commits intomainfrom Apr 14, 2026
Merged
test: add E2E autotest plans and GitHub Action workflow#1605wenytang-ms merged 3 commits intomainfrom
wenytang-ms merged 3 commits intomainfrom
Conversation
Add 16 YAML test plans covering all wiki Test-Plan.md scenarios: - Basic editing (#1-9): snippets, code actions, imports, rename, new file - Maven / Maven Multimodule / Gradle projects - JDK 25 compatibility (Maven + Gradle) - Single file / Single file without workspace - Debugger, Test Runner, Dependency Viewer - Maven for Java (Resolve Unknown Type) - Java Extension Pack (Configure Classpath) - Fresh Import (Spring Petclinic, auto-clone) GitHub Action (manual trigger): - Runs all test plans on windows-latest - Uploads test-results/ (screenshots + JSON) as artifact - Supports running a single plan via workflow_dispatch input Uses @vscjava/vscode-autotest CLI for execution. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
wenytang-ms
requested review from
chagong,
jdneo and
testforstephen
as code owners
- Checkout all repos into GITHUB_WORKSPACE (no ../ paths) - Set working-directory to vscode-java-pack for autotest - Upload results from vscode-java-pack/test-results/ Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
chagong
approved these changes
Apr 14, 2026
wenytang-ms
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add 16 YAML E2E test plans covering all scenarios from the wiki Test-Plan.md, plus a GitHub Actions workflow for manual execution.
Test Plans (16 files, 93 steps)
GitHub Action
How to use
\\�ash
Install the CLI
npm install -g @vscjava/vscode-autotest
Run a single plan
autotest run test-plans/java-maven.yaml
Run all plans
autotest run test-plans/java-maven.yaml # repeat for each
\\
Or trigger the E2E AutoTest workflow from the Actions tab.