Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[LiveLogger] Define long-term test plan #8724

Closed
ladipro opened this issue May 2, 2023 · 1 comment
Closed

[LiveLogger] Define long-term test plan #8724

ladipro opened this issue May 2, 2023 · 1 comment
Assignees
Labels
Area: Terminal Logger Problems with the livelogger/fancylogger/terminallogger -tl functionality. triaged
Milestone

Comments

@ladipro
Copy link
Member

ladipro commented May 2, 2023

Per @rokonec's work in #8418, the test cases below are designed to give us good enough coverage. Given that this is inherently manual testing, we should figure out who executes them and when/how often.

Test Case Single Console Multi project with tests Orchard non SDK .NET non SDK C++
rebuild /m:1 ✔️ ✔️ ✔️ ✔️ ✔️
rebuild /m ✔️ ✔️ ✔️ ✔️ ✔️
rebuild w/ cancel ✔️ ✔️
restore ✔️ ✔️ ✔️
interactive restore ✔️ ✔️ ✔️
rebuild w/ errors ✔️ ✔️ ✔️ ✔️ ✔️
rebuild w/ lots of errors ✔️ ✔️
restore w/ errors ✔️
dotnet test ✔️ ✔️
test w/ MSBuild server opt in ✔️

I have added dotnet test intuitively, as I know it uses Console colors and Console.Write for test progress reporting.

As for "Multi project with tests" I would recommend sln with one console, three class libraries projects and one test xunit project.

By interactive restore I mean a restore which DeviceFlow prompt:
image

Here are some simple steps how to prepare simple console app:

  • Running installcredprovider per these instructions
  • If it was already installed we might need to delete cached credentials from: $env:UserProfile\AppData\Local\MicrosoftCredentialProvider
  • If it was built before delete .\bin and .\obj folder
> dotnet new nugetconfig
> dotnet nuget add source https://pkgs.dev.azure.com/dnceng/internal/_packaging/7.0.100-rc.1.22429.3-shipping/nuget/v3/index.json
> dotnet new console
> dotnet build -r win-x64 --interactive --restore

Originally posted by @rokonec in #8418 (comment)

@ladipro ladipro added the Area: Terminal Logger Problems with the livelogger/fancylogger/terminallogger -tl functionality. label May 2, 2023
@AR-May AR-May added the triaged label Feb 21, 2024
@JanKrivanek JanKrivanek added this to the .NET 9.0 milestone Jun 19, 2024
@rainersigwald
Copy link
Member

I don't think we're going to do more than the existing acceptance-type tests + automation where we can.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: Terminal Logger Problems with the livelogger/fancylogger/terminallogger -tl functionality. triaged
Projects
None yet
Development

No branches or pull requests

4 participants