Skip to content

Conversation

@jiajia123-wind
Copy link

Update ICU ptest output so that each test prints in the Automake "simple test" format required by Yocto[1]:

result: testname

Where result is one of PASS, FAIL, or SKIP.

[1] https://wiki.yoctoproject.org/wiki/Ptest

Note: I do not currently have permissions to create an ICU Jira issue. I am submitting this patch to discuss the change and its approach with the ICU team. Once the PR is reviewed, a Jira issue can be created and associated if required.

@markusicu
Copy link
Member

We don't want to unconditionally change the test suite output after 25+ years.
A different format under a command line flag might be ok.
We would also want a reference to the output format spec or what tool expects that.

What is "ptest"?

I do not currently have permissions to create an ICU Jira issue.

Please follow the instructions from https://icu.unicode.org/bugs

@jira-pull-request-webhook
Copy link

Notice: the branch changed across the force-push!

  • icu4c/source/configure.ac is now changed in the branch
  • icu4c/source/icudefs.mk.in is now changed in the branch
  • icu4c/source/test/intltest/intltest.cpp is different
  • icu4c/source/tools/ctestfw/ctest.c is different

View Diff Across Force-Push

~ Your Friendly Jira-GitHub PR Checker Bot

@jiajia123-wind
Copy link
Author

jiajia123-wind commented Nov 12, 2025

@markusicu
Thank you for the feedback!

You're right — changing the default test output would not be ideal after so many years.
I’ve updated this patch to make the Automake-style output optional, controlled by the --enable-ptest-automake-format configure flag, instead of changing the default behavior.

Regarding your question:

  • ptest is the Yocto Project’s package testing framework.
    It expects each test case to print results in the Automake "simple test" format (PASS: testname, FAIL: testname, or SKIP: testname).
    Reference: https://wiki.yoctoproject.org/wiki/Ptest

Thanks for the clarification and the link!

I’ve followed the instructions on https://icu.unicode.org/bugs and successfully logged into the ICU JIRA site.
However, it seems my account ([email protected]) currently does not have permission to create new issues — the “Create” button is disabled for me.

Thanks again for the helpful comments!

Update ICU ptest output so that each test prints in the Automake "simple
test" format required by Yocto[1]:

  result: testname

Where `result` is one of PASS, FAIL, or SKIP.

[1] https://wiki.yoctoproject.org/wiki/Ptest

Signed-off-by: Jiaying Song <[email protected]>
@jira-pull-request-webhook
Copy link

Notice: the branch changed across the force-push!

  • icu4c/source/configure.ac is different
  • icu4c/source/icudefs.mk.in is no longer changed in the branch

View Diff Across Force-Push

~ Your Friendly Jira-GitHub PR Checker Bot


# Enable Automake-compatible ptest output format (for Yocto/OpenEmbedded)
AC_ARG_ENABLE([ptest-automake-format],
AS_HELP_STRING([--enable-ptest-automake-format],

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not just say 'test'? ptest is a yocto thing, it doesn't mean anything to others. But I'd be interested in possibly using this in Gentoo. It's really just that the testsuite format will be automake format (TAP) now.

The rationale is that it's for Yocto, but that's more for the commit message, not the option name or help description IMO.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants