Issues with test framework against OpenSSL 3.2

David Anes <david.anes@xxxxxxxxxxxxxxxxxxxx> · Thu, 25 Jan 2024 13:54:25 +0100

Hello all,

I've successfully compiled apache 2.4.58 against OpenSSL 3.2, but I see 

lot's of issues when running the test suite.

My first guess are the changes in 3.2 regarding the way certificates are 

generated (from the changelog at 

https://github.com/openssl/openssl/blob/openssl-3.2.0/NEWS.md):

  * The x509, ca, and req apps now always produce X.509v3 certificates.

Also, other potential incompatible issues metioned there are:

  * The default SSL/TLS security level has been changed from 1 to 2.

  * Subject or issuer names in X.509 objects are now displayed as UTF-8 

strings by default.

I've tried compiling normally, as prefork and event but all of them fail 

the same way:

    Test Summary Report
    -------------------

    t/protocol/echo.t                 (Wstat: 65280 (exited 255) Tests: 

1 Failed: 1)

      Failed test:  1
      Non-zero exit status: 255
      Parse errors: Bad plan.  You planned 8 tests but ran 1.
    t/security/CVE-2005-2700.t        (Wstat: 0 Tests: 2 Failed: 1)
      Failed test:  1

    t/security/CVE-2009-3555.t        (Wstat: 65280 (exited 255) Tests: 

1 Failed: 1)

      Failed test:  1
      Non-zero exit status: 255
      Parse errors: Bad plan.  You planned 4 tests but ran 1.
    t/ssl/basicauth.t                 (Wstat: 0 Tests: 4 Failed: 2)
      Failed tests:  2-3
    t/ssl/env.t                       (Wstat: 0 Tests: 30 Failed: 23)
      Failed tests:  1-8, 16-30
    t/ssl/extlookup.t                 (Wstat: 0 Tests: 4 Failed: 4)
      Failed tests:  1-4
    t/ssl/fakeauth.t                  (Wstat: 0 Tests: 3 Failed: 2)
      Failed tests:  2-3
    t/ssl/headers.t                   (Wstat: 0 Tests: 3 Failed: 3)
      Failed tests:  1-3
    t/ssl/ocsp.t                      (Wstat: 0 Tests: 3 Failed: 3)
      Failed tests:  1-3
    t/ssl/pr12355.t                   (Wstat: 0 Tests: 10 Failed: 10)
      Failed tests:  1-10
    t/ssl/pr43738.t                   (Wstat: 0 Tests: 4 Failed: 4)
      Failed tests:  1-4
    t/ssl/proxy.t                     (Wstat: 0 Tests: 290 Failed: 290)
      Failed tests:  1-290
    t/ssl/require.t                   (Wstat: 0 Tests: 10 Failed: 5)
      Failed tests:  2, 5-7, 9
    t/ssl/varlookup.t                 (Wstat: 0 Tests: 81 Failed: 81)
      Failed tests:  1-81
    t/ssl/verify.t                    (Wstat: 0 Tests: 3 Failed: 1)
      Failed test:  2

    Files=142, Tests=7248, 132 wallclock secs ( 3.04 usr  0.50 sys + 

50.18 cusr 28.03 csys = 81.75 CPU)

    Result: FAIL
    Failed 15/142 test programs. 431/7248 subtests failed.

Any clue? Does anyone had success running the tests against OpenSSL 3.2?

Thanks,
David.

--
David Anes <david.anes@xxxxxxxx>

OpenPGP_signature.asc