Request for clarification on gcc test results deviations

Harish Sadineni via Gcc-help <gcc-help@xxxxxxxxxxx> · Thu, 6 Jun 2024 10:11:39 +0530

Hi all,

I'am using gcc-13.2.0, i have given two consective builds with make
check-gcc compared test results, i have observed below deviations by using
vimdiff tool:

 WARNING: program timed out | PASS: gcc.target/i386/avx512bw-pr94509-2.c
(test for excess errors)
 FAIL: gcc.target/i386/avx512bw-pr94509-2.c (test for excess errors) |
PASS: gcc.target/i386/avx512bw-pr94509-2.c execution test
 UNRESOLVED: gcc.target/i386/avx512bw-pr94509-2.c compilation failed to |

and in yocto we are using gcc-13.2.0 and after running gcc oe-selftest we
are comparing results but we have observed a lot of test result deviations :
for example, test passed in one time is moving to unresolved at other time.
 ptestresult.gcc.gcc.dg/20061026.c (test for excess errors): PASS ->
UNRESOLVED
        ptestresult.gcc.gcc.dg/20081223-1.c (test for errors, line 5): PASS
-> UNRESOLVED
        ptestresult.gcc.gcc.dg/Warray-bounds-6.c (test for excess errors):
PASS -> UNRESOLVED
        ptestresult.gcc.gcc.dg/asm-4.c (test for excess errors): PASS ->
UNRESOLVED
        ptestresult.gcc.gcc.dg/attr-access-read-write-2.c (test for
warnings, line 18): PASS -> UNRESOLVED
        ptestresult.gcc.gcc.dg/bitfld-10.c (test for errors, line 8): PASS
-> UNRESOLVED
        ptestresult.gcc.gcc.dg/c2x-complit-4.c: UNRESOLVED -> UNSUPPORTED
        ptestresult.gcc.gcc.dg/c2x-float-5.c: UNRESOLVED -> UNSUPPORTED
        ptestresult.gcc.gcc.dg/c2x-stdarg-5.c (test for excess errors):
PASS -> UNRESOLVED
        ptestresult.gcc.gcc.dg/c99-condexpr-1.c (test for excess errors):
PASS -> UNRESOLVED
        ptestresult.gcc.gcc.dg/const-float80-ped.c (test for warnings, line
5): PASS -> UNRESOLVED

 1)what can be the reason for this?
 2)how to resolve this kind of issues?

 thanks,
 Harish sadineni