summaryrefslogtreecommitdiff
path: root/test/utils
AgeCommit message (Collapse)Author
2025-03-19Disable 055-enum-performance on tradefed Mythri Alle
055-enum-performance is disabled when run via testrunner from a long time. This test is timing sensitive and might fail on heavily loaded or slow systems. So disable this in tradefed runs as well. Bug:394148480 Change-Id: I30d552c020445aa283ead9b4537cc51b002f8d12
2024-11-28Promote two ART run-tests to presubmits (2024-11-15). Roland Levillain
Promote the following post-submit tests to pre-submit test groups in ART's Test Mapping file: * `art-run-test-2282-checker-always-throws-try-catch` * `art-run-test-2283-checker-remove-null-check` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 750 ART run-tests out of 1065 (70%). Generated TEST_MAPPING entries for 467 ART run-tests out of 1065 (43%): 467 ART run-tests (100%) in `art-mainline-presubmit` test group. 467 ART run-tests (100%) in `mainline-presubmit` test group. 467 ART run-tests (100%) in `presubmit` test group. 0 ART run-tests (0%) in `postsubmit` test group. 26 ART gtests (100%) in `mainline-presubmit` test group. 26 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `postsubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: Id117278ac514e0d72eab4194b53bf4f0ca5459bb
2024-11-01Promote `libnativebridge-lazy-tests` to presubmits. Roland Levillain
Promote the following post-submit test to pre-submit test groups in ART's Test Mapping file: * `libnativebridge-lazy-tests` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 749 ART run-tests out of 1064 (70%). Generated TEST_MAPPING entries for 467 ART run-tests out of 1064 (43%): 465 ART run-tests (99%) in `art-mainline-presubmit` test group. 465 ART run-tests (99%) in `mainline-presubmit` test group. 465 ART run-tests (99%) in `presubmit` test group. 2 ART run-tests (0%) in `postsubmit` test group. 26 ART gtests (100%) in `mainline-presubmit` test group. 26 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `postsubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: Ifd4c4cef227947ffe99ad647950f0a189169047f
2024-11-01Promote two ART run-tests to presubmits (2024-11-01). Roland Levillain
Promote the following post-submit tests to pre-submit test groups in ART's Test Mapping file: * `art-run-test-858-checker-unsafe` * `art-run-test-859-checker-var-handles-intrinsics` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 749 ART run-tests out of 1064 (70%). Generated TEST_MAPPING entries for 467 ART run-tests out of 1064 (43%): 465 ART run-tests (99%) in `art-mainline-presubmit` test group. 465 ART run-tests (99%) in `mainline-presubmit` test group. 465 ART run-tests (99%) in `presubmit` test group. 2 ART run-tests (0%) in `postsubmit` test group. 25 ART gtests (96%) in `mainline-presubmit` test group. 25 ART gtests (96%) in `presubmit` test group. 1 ART gtests (3%) in `postsubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: I5426b41f3772e619597c8f50641cff987079e31d
2024-11-01Regenerate ART test files (2024-11-01). Roland Levillain
This change enables build- and run-time support in automated executions for the following tests in post-submit runs: * `art-run-test-2282-checker-always-throws-try-catch` * `art-run-test-2283-checker-remove-null-check` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 749 ART run-tests out of 1064 (70%). Generated TEST_MAPPING entries for 467 ART run-tests out of 1064 (43%): 463 ART run-tests (99%) in `art-mainline-presubmit` test group. 463 ART run-tests (99%) in `mainline-presubmit` test group. 463 ART run-tests (99%) in `presubmit` test group. 4 ART run-tests (0%) in `postsubmit` test group. 25 ART gtests (96%) in `mainline-presubmit` test group. 25 ART gtests (96%) in `presubmit` test group. 1 ART gtests (3%) in `postsubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest -a art-run-test-2282-checker-always-throws-try-catch Test: atest -a art-run-test-2283-checker-remove-null-check Test: atest --test-mapping art:postsubmit Bug: 147812905 Bug: 152374989 Change-Id: I288d1f6df06ca713916552fa0fd6a90a3c265320
2024-10-24Add `libnativebridge-lazy-tests` to ART Test Mapping and ART MTS. Roland Levillain
* In ART Test Mapping, enable this test module in post-submit runs. * In ART MTS, add this test module to shard 03 (along with other ART gtests). Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 747 ART run-tests out of 1062 (70%). Generated TEST_MAPPING entries for 465 ART run-tests out of 1062 (43%): 463 ART run-tests (99%) in `art-mainline-presubmit` test group. 463 ART run-tests (99%) in `mainline-presubmit` test group. 463 ART run-tests (99%) in `presubmit` test group. 2 ART run-tests (0%) in `postsubmit` test group. 25 ART gtests (96%) in `mainline-presubmit` test group. 25 ART gtests (96%) in `presubmit` test group. 1 ART gtests (3%) in `postsubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest --test-mapping art:postsubmit Test: m mts && mts-tradefed run commandAndExit mts-art Test: m mts && mts-tradefed run commandAndExit mts-art-shard-03 Test: m mts \ && mts-tradefed run commandAndExit mts-art \ --module libnativebridge-lazy-tests Bug: 363075236 Bug: 167385698 Change-Id: I84ae685043a776b59b3bdc8ddf87c5f62a48d1cd
2024-10-24Promote `art_standalone_dex2oat_cts_tests` to presubmits. Roland Levillain
Promote the following post-submit test to pre-submit test groups in ART's Test Mapping file: * `art_standalone_dex2oat_cts_tests` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 747 ART run-tests out of 1062 (70%). Generated TEST_MAPPING entries for 465 ART run-tests out of 1062 (43%): 463 ART run-tests (99%) in `art-mainline-presubmit` test group. 463 ART run-tests (99%) in `mainline-presubmit` test group. 463 ART run-tests (99%) in `presubmit` test group. 2 ART run-tests (0%) in `postsubmit` test group. 25 ART gtests (100%) in `mainline-presubmit` test group. 25 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `postsubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: Id447fb44b964213e6f7c5902ce471303ec09a593
2024-10-17Use better names for some predicates in `regen-test-files`. Roland Levillain
Use more explicit names in the `regen-test-files` script for predicates about whether a test can be built (with Soong) and executed successfully (with TradeFed). Test: Run `test/utils/regen-test-files -m` and verify it is a no-op Bug: 147818031 Change-Id: Iafd5c7812e5d8a6ce9558af8f5438d9d2a4a5044
2024-10-17Do not package non-runnable ART run-tests in ART MTS. Roland Levillain
ART MTS package size comparison before and after this change: * on Arm64: ``` build/soong/soong_ui.bash --make-mode dist TARGET_PRODUCT=aosp_arm64 \ TARGET_RELEASE=mainline WITH_DEXPREOPT=false mts-art \ && stat -c %s out/host/linux-x86/mts-art/android-mts-art.zip ``` Before: 1465306040 bytes (~1397 MiB) After: 1463062851 bytes (~1395 MiB) Variation: -2243189 bytes (~2 MiB) (-0.15%) * on x86-64: ``` build/soong/soong_ui.bash --make-mode dist TARGET_PRODUCT=aosp_x86_64 \ TARGET_RELEASE=mainline WITH_DEXPREOPT=false mts-art \ && stat -c %s out/host/linux-x86/mts-art/android-mts-art.zip ``` Before: 1483408375 bytes (~1415 MiB) After: 1481164834 bytes (~1413 MiB) Variation: −2243541 bytes (~2 MiB) (-0.15%) Test: Run the following command and verify that its output contains none of the ART run-test modules mentioned in b/363075236#comment1: m mts-art && \ unzip -l \ $ANDROID_SOONG_HOST_OUT/mts-art/android-mts-art-tests_list.zip Bug: 363075236 Bug: 167385698 Change-Id: I5d0aaa042df47a1f8073bc522db7348ebc75c959
2024-10-17Fix typo in regen-test-files's post-execution statistics. Roland Levillain
Test: Run `art/test/utils/regen-test-files`, check its standard output Bug: 147818031 Change-Id: Ic169c2dec07e99d699fdc5a89ba070953d0ce311
2024-10-17Promote one ART run-test to presubmits (2024-10-15). Roland Levillain
Promote the following post-submit test to pre-submit test groups in ART's Test Mapping file: * `art-run-test-057-math-intrinsics` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 747 ART run-tests out of 1062 (70%). Generated TEST_MAPPING entries for 465 ART run-tests out of 1062 (43%): 463 ART run-tests (99%) in `art-mainline-presubmit` test group. 463 ART run-tests (99%) in `mainline-presubmit` test group. 463 ART run-tests (99%) in `presubmit` test group. 2 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (96%) in `mainline-presubmit` test group. 24 ART gtests (96%) in `presubmit` test group. 1 ART gtests (4%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: I6880f7d2dabdff241470ef9cda84738a992e6a65
2024-10-17Regenerate ART test files (2024-10-15). Roland Levillain
This change enables build- and run-time support in automated executions for the following tests in post-submit runs: * `art-run-test-858-checker-unsafe` * `art-run-test-859-checker-var-handles-intrinsics` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 747 ART run-tests out of 1062 (70%). Generated TEST_MAPPING entries for 465 ART run-tests out of 1062 (43%): 462 ART run-tests (99%) in `art-mainline-presubmit` test group. 462 ART run-tests (99%) in `mainline-presubmit` test group. 462 ART run-tests (99%) in `presubmit` test group. 3 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (96%) in `mainline-presubmit` test group. 24 ART gtests (96%) in `presubmit` test group. 1 ART gtests (4%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest -a art-run-test-858-checker-unsafe Test: atest -a art-run-test-859-checker-var-handles-intrinsics Test: atest --test-mapping art:postsubmit Bug: 147812905 Bug: 152374989 Change-Id: I40a7cd5765d9a3598098f32feaf49adfe5d08d11
2024-08-30Add ART JVM TI CTS tests to the ART MTS definition. Roland Levillain
Add these test modules to ART MTS shard 02. Test: m mts && mts-tradefed run commandAndExit mts-art Test: m mts && mts-tradefed run commandAndExit mts-art-shard-02 Bug: 361292790 Change-Id: If2c159dca6d8716935fb7222fbb0d50d68620aed
2024-08-26Add `CtsJvmtiRunTest988HostTestCases` to the ART MTS definition. Roland Levillain
Add this test module to ART MTS shard 02. Flag: TEST_ONLY Test: m mts && mts-tradefed run commandAndExit mts-art Test: m mts && mts-tradefed run commandAndExit mts-art-shard-02 Bug: 361292790 Bug: 357156783 Bug: 359777052 Change-Id: I67c59a37f8c1a1dc88ca0753f51d846aac1b5a98
2024-08-22Regenerate ART test files (2024-08-21). Roland Levillain
This change enables build- and run-time support in automated executions for the following test in post-submit runs: * `art-run-test-057-math-intrinsics` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 745 ART run-tests out of 1057 (70%). Generated TEST_MAPPING entries for 463 ART run-tests out of 1057 (43%): 462 ART run-tests (99%) in `art-mainline-presubmit` test group. 462 ART run-tests (99%) in `mainline-presubmit` test group. 462 ART run-tests (99%) in `presubmit` test group. 1 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (96%) in `mainline-presubmit` test group. 24 ART gtests (96%) in `presubmit` test group. 1 ART gtests (4%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: atest -a art-run-test-057-math-intrinsics Test: atest --test-mapping art:postsubmit Bug: 147812905 Bug: 152374989 Change-Id: Ic6a4dab7727c6996888a9726e6f914f65809f80f
2024-08-16Separate the varhandle-perf tests Santiago Aboy Solanes
This was the most time consuming test by far. Locally with 72 threads: * The 2239- tests take 24s instead of 2m40s. * Running the whole test suite now takes 1m30 instead of 3m. The test generation can be moved to utils since it can be reused between tests. Test: Build the tests and then run time art/test/testrunner/testrunner.py --host --64 \ --optimizing -t 2239- Test: Same but without -t 2239- Change-Id: Ibc2c230d8afd617ee674429fe8e42543ddb140a1
2024-08-12Promote two ART run-tests to presubmits (2024-08-09). Roland Levillain
Promote the following post-submit tests to pre-submit test groups in ART's Test Mapping file: * `art-run-test-2279-aconfig-flags` * `art-run-test-2279-second-inner-loop-references-first` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 744 ART run-tests out of 1040 (71%). Generated TEST_MAPPING entries for 462 ART run-tests out of 1040 (44%): 462 ART run-tests (100%) in `art-mainline-presubmit` test group. 462 ART run-tests (100%) in `mainline-presubmit` test group. 462 ART run-tests (100%) in `presubmit` test group. 0 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (96%) in `mainline-presubmit` test group. 24 ART gtests (96%) in `presubmit` test group. 1 ART gtests (4%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: I20574d9774cab87cf4861295ed67016479c9e834
2024-08-12Add `art_standalone_dex2oat_cts_tests` to ART Test Mapping and ART MTS. Roland Levillain
* In ART Test Mapping, enable this test module in post-submit runs. * In ART MTS, add this test module to shard 00 (along with other ART * gtests). Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 744 ART run-tests out of 1040 (71%). Generated TEST_MAPPING entries for 462 ART run-tests out of 1040 (44%): 460 ART run-tests (99%) in `art-mainline-presubmit` test group. 460 ART run-tests (99%) in `mainline-presubmit` test group. 460 ART run-tests (99%) in `presubmit` test group. 2 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (96%) in `mainline-presubmit` test group. 24 ART gtests (96%) in `presubmit` test group. 1 ART gtests (4%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest --test-mapping art:postsubmit Test: m mts && mts-tradefed run commandAndExit mts-art Test: m mts && mts-tradefed run commandAndExit mts-art-shard-03 Test: m mts \ && mts-tradefed run commandAndExit mts-art \ --module art_standalone_dex2oat_cts_tests Bug: 167385698 Change-Id: I96029369a1383dec2f98412abae630b94f1edcb8
2024-07-30Promote one more ART run-test to presubmits (2024-07-27). Roland Levillain
Promote the following post-submit test to pre-submit test groups in ART's Test Mapping file: * `art-run-test-2278-nested-loops` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 744 ART run-tests out of 1040 (71%). Generated TEST_MAPPING entries for 462 ART run-tests out of 1040 (44%): 460 ART run-tests (99%) in `art-mainline-presubmit` test group. 460 ART run-tests (99%) in `mainline-presubmit` test group. 460 ART run-tests (99%) in `presubmit` test group. 2 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (100%) in `mainline-presubmit` test group. 24 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: I59c05ae8fba7235b1a7b9f8f1d15589edd29c2ce
2024-07-30Tag more ART run-tests as slow tests. Roland Levillain
Add the following tests to the list of slow ART run-tests, for which the timeout value is raised: * `art-run-test-080-oom-throw` * `art-run-test-099-vmdebug` * `art-run-test-109-suspend-check` Flag: TEST_ONLY Test: atest -a art-run-test-080-oom-throw Test: atest -a art-run-test-099-vmdebug Test: atest -a art-run-test-109-suspend-check Bug: 355900769 Bug: 352860634 Bug: 353583195 Change-Id: I747922b9c83e12d7092ffb35acd1f9dba423acff
2024-07-30Regenerate ART test files (2024-07-29). Roland Levillain
This change enables build- and run-time support in automated executions for the following tests in post-submit runs: * `art-run-test-2279-aconfig-flags` * `art-run-test-2279-second-inner-loop-references-first` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 744 ART run-tests out of 1040 (71%). Generated TEST_MAPPING entries for 462 ART run-tests out of 1040 (44%): 459 ART run-tests (99%) in `art-mainline-presubmit` test group. 459 ART run-tests (99%) in `mainline-presubmit` test group. 459 ART run-tests (99%) in `presubmit` test group. 3 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (100%) in `mainline-presubmit` test group. 24 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: atest -a art-run-test-2279-aconfig-flags Test: atest -a art-run-test-2279-second-inner-loop-references-first Test: atest --test-mapping art:postsubmit Bug: 147812905 Bug: 152374989 Change-Id: I1be36eab60fd6967f100f17bfb7901d981830cff
2024-07-15Promote more ART run-tests to presubmits (2024-07-12). Roland Levillain
Promote the following post-submit tests to pre-submit test groups in ART's Test Mapping file: * `art-run-test-011-array-copy2` * `art-run-test-857-default-access` * `art-run-test-2275-checker-empty-loops` * `art-run-test-2275-integral-unsigned-arithmetic` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 742 ART run-tests out of 1038 (71%). Generated TEST_MAPPING entries for 460 ART run-tests out of 1038 (44%): 459 ART run-tests (99%) in `art-mainline-presubmit` test group. 459 ART run-tests (99%) in `mainline-presubmit` test group. 459 ART run-tests (99%) in `presubmit` test group. 1 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (100%) in `mainline-presubmit` test group. 24 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: I894d8f9180d917e1c3e76d59c85ac14b07e34a3a
2024-07-15Regenerate ART test files (2024-07-12). Roland Levillain
This change enables build- and run-time support in automated executions for the following test in post-submit runs: * `art-run-test-2278-nested-loops` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 742 ART run-tests out of 1038 (71%). Generated TEST_MAPPING entries for 460 ART run-tests out of 1038 (44%): 455 ART run-tests (98%) in `art-mainline-presubmit` test group. 455 ART run-tests (98%) in `mainline-presubmit` test group. 455 ART run-tests (98%) in `presubmit` test group. 5 ART run-tests (1%) in `postsubmit` test group. 24 ART gtests (100%) in `mainline-presubmit` test group. 24 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: atest -a art-run-test-2278-nested-loops Test: atest --test-mapping art:postsubmit Bug: 147812905 Bug: 152374989 Change-Id: Iccb05a1cfff74a30dce77fa87995f19c0812f52f
2024-07-09Keep lists of ART run-tests ordered numerically in `regen-test-files`. Roland Levillain
Flag: EXEMPT refactor Test: Run `test/utils/regen-test-files` and verify it is a no-op Bug: 147818031 Change-Id: I56f3b8872b30fe07d210519c530a94b05391751d
2024-07-09Regenerate ART test files (2024-07-09). Roland Levillain
This change enables build-time support for the following test: * `art-run-test-2275-pthread-name` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 741 ART run-tests out of 1037 (71%). Generated TEST_MAPPING entries for 459 ART run-tests out of 1037 (44%): 455 ART run-tests (99%) in `art-mainline-presubmit` test group. 455 ART run-tests (99%) in `mainline-presubmit` test group. 455 ART run-tests (99%) in `presubmit` test group. 4 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (100%) in `mainline-presubmit` test group. 24 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: m art-run-test-2275-pthread-name Bug: 147814778 Change-Id: I6f7bdffff1a43e109782b352d569583b36bf1459
2024-07-09Refactor MTS test list file generation a bit in `regen-test-files`. Roland Levillain
Flag: EXEMPT refactor Test: Run `test/utils/regen-test-files -m` and verify it is a no-op Bug: 167385698 Change-Id: I92478d67e0a4c4da45337baccb2725e912f2d2dd
2024-07-09Add two more tests to the ART MTS test list file of "eng-only" tests. Roland Levillain
This change adds the following tests (already part of ART's Test Mapping file) to the ART MTS "eng-only" test list: * `art_standalone_dexoptanalyzer_tests` * `art_standalone_profman_tests` Flag: TEST_ONLY Test: m mts && mts-tradefed run commandAndExit mts-art Test: m mts && mts-tradefed run commandAndExit mts-art-shard-03 Bug: 268491069 Bug: 167385698 Change-Id: I079a9bf48cc63a8ad12184716d97dd133e585add
2024-07-09Generate the ART MTS test list file of "eng-only" tests. Roland Levillain
Have `regen-test-files` also generate file `tools/mts-tradefed/res/config/mts-art-tests-list-eng-only.xml`, which contains the list of tests that need root access to the device-under-test and are not part of "user" test plans. Flag: TEST_ONLY Test: Run `test/utils/regen-test-files -m` and verify it is "almost" a no-op Bug: 268491069 Bug: 167385698 Change-Id: I68945b458c6a7a29ab5f0ea87cc554b895f062cc
2024-06-28Promote more ART run-tests to presubmits (2024-06-24). Roland Levillain
Promote the following post-submit tests to pre-submit test groups in ART's Test Mapping file: * `art-run-test-458-checker-riscv64-shift-add` * `art-run-test-856-clone` * `art-run-test-2274-checker-bitwise-gvn` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 740 ART run-tests out of 1035 (71%). Generated TEST_MAPPING entries for 459 ART run-tests out of 1035 (44%): 455 ART run-tests (99%) in `art-mainline-presubmit` test group. 455 ART run-tests (99%) in `mainline-presubmit` test group. 455 ART run-tests (99%) in `presubmit` test group. 4 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (100%) in `mainline-presubmit` test group. 24 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: Ifb77742f10ba9e3b85bf7dfbefa495cf5324fbed
2024-06-28Regenerate ART test files (2024-06-24). Roland Levillain
This change enables build- and run-time support in automated executions for the following tests in post-submit runs: * `art-run-test-011-array-copy2` * `art-run-test-2275-checker-empty-loops` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 740 ART run-tests out of 1035 (71%). Generated TEST_MAPPING entries for 459 ART run-tests out of 1035 (44%): 452 ART run-tests (98%) in `art-mainline-presubmit` test group. 452 ART run-tests (98%) in `mainline-presubmit` test group. 452 ART run-tests (98%) in `presubmit` test group. 7 ART run-tests (1%) in `postsubmit` test group. 24 ART gtests (100%) in `mainline-presubmit` test group. 24 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: atest -a art-run-test-011-array-copy2 Test: atest -a art-run-test-2275-checker-empty-loops Test: atest --test-mapping art:postsubmit Bug: 147812905 Bug: 152374989 Change-Id: I54829072f00ed9d59d028881eceb6a0af01b9a99
2024-06-23Ensure tests are both or neither in CTS and MCTS in `regen-test-files`. Roland Levillain
For now, there is no good reason to have ART run-tests have a different test suite membership w.r.t. CTS and MCTS. Flag: TEST_ONLY Test: Run `test/utils/regen-test-files` and verify it is a no-op Bug: 147814778 Change-Id: Ic26ca9997013f8a77b4d863e053eb01059c5dc22
2024-06-23Regenerate ART test files (2024-06-20). Roland Levillain
This change enables build- and run-time support in automated executions for the following tests in post-submit runs: * `art-run-test-857-default-access` * `art-run-test-2275-integral-unsigned-arithmetic` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 738 ART run-tests out of 1033 (71%). Generated TEST_MAPPING entries for 457 ART run-tests out of 1033 (44%): 452 ART run-tests (98%) in `art-mainline-presubmit` test group. 452 ART run-tests (98%) in `mainline-presubmit` test group. 452 ART run-tests (98%) in `presubmit` test group. 5 ART run-tests (1%) in `postsubmit` test group. 24 ART gtests (100%) in `mainline-presubmit` test group. 24 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: atest -a art-run-test-857-default-access Test: atest -a art-run-test-2275-integral-unsigned-arithmetic Test: atest --test-mapping art:postsubmit Bug: 147812905 Bug: 152374989 Change-Id: Id8121ca329e28aa52d5e0f77be43e463cc66c886
2024-06-23Honor the Lint baseline file in `regen-test-files`, if present. Roland Levillain
This change amends the `regen-test-files` generator to add an explicit `lint` property to the build recipe of the following test: * `art-run-test-845-data-image` The corresponding changes in the generated test file were added previously (manually) in https://googleplex-android-review.git.corp.google.com/c/platform/art/+/25855393 (commit 5efc53426feb10ea132faad5030f7e38c03499a0). Flag: TEST_ONLY Test: Run `test/utils/regen-test-files` and verify it is a no-op Bug: 147814778 Change-Id: I21ac231e4571d84b6ff550efbaaa5f49e17cb922
2024-06-18Add ART MTS eng-only tests to the test plan of ART MTS shard 03. Roland Levillain
This is a quick and easy way to run ART MTS eng-only tests as part of ART test code coverage configurations (so that they can contribute to the line coverage of the tested code), without requiring the creation of a new ATP test shard. Restructuring the MTS generation logic to make it cleaner is planned as a follow-up. Flag: TEST_ONLY Test: m mts && mts-tradefed run commandAndExit mts-art Test: m mts && mts-tradefed run commandAndExit mts-art-shard-03 Bug: 268491069 Bug: 167385698 Change-Id: I7249b8e3ffe1be411ba08c2e74218a050d570ff8
2024-06-18Promote more ART run-tests to presubmits (2024-06-07). Roland Levillain
Promote the following post-submit tests to pre-submit test groups in ART's Test Mapping file: * `art-run-test-2247-checker-write-barrier-elimination` * `art-run-test-2273-checker-unreachable-intrinsics` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 736 ART run-tests out of 1031 (71%). Generated TEST_MAPPING entries for 455 ART run-tests out of 1031 (44%): 452 ART run-tests (99%) in `art-mainline-presubmit` test group. 452 ART run-tests (99%) in `mainline-presubmit` test group. 452 ART run-tests (99%) in `presubmit` test group. 3 ART run-tests (0%) in `postsubmit` test group. 24 ART gtests (100%) in `mainline-presubmit` test group. 24 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: I4e7454f2f23fe72a054b603d71bccf2148f69f26
2024-06-18Regenerate ART test files (2024-06-07). Roland Levillain
This change: * enables build-time support for the following test: * `art-run-test-855-native` * enables build- and run-time support in automated executions for the following tests in post-submit runs: * `art-run-test-458-checker-riscv64-shift-add` * `art-run-test-856-clone` * `art-run-test-2274-checker-bitwise-gvn` * adds missing entries in some Test Mapping test groups for the following tests: * `art_standalone_dexopt_chroot_setup_test` * `libnativebridge-tests` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 736 ART run-tests out of 1031 (71%). Generated TEST_MAPPING entries for 455 ART run-tests out of 1031 (44%): 450 ART run-tests (98%) in `art-mainline-presubmit` test group. 450 ART run-tests (98%) in `mainline-presubmit` test group. 450 ART run-tests (98%) in `presubmit` test group. 5 ART run-tests (1%) in `postsubmit` test group. 24 ART gtests (100%) in `mainline-presubmit` test group. 24 ART gtests (100%) in `presubmit` test group. 0 ART gtests (0%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Flag: TEST_ONLY Test: m art-run-test-855-native Test: atest -a art-run-test-458-checker-riscv64-shift-add Test: atest -a art-run-test-856-clone Test: atest -a art-run-test-2274-checker-bitwise-gvn Test: atest -a art_standalone_dexopt_chroot_setup_test Test: atest -a libnativebridge-tests Test: atest --test-mapping art:presubmit Test: atest --test-mapping art:postsubmit Bug: 147812905 Bug: 152374989 Bug: 347717488 Change-Id: Idc0608e4cea878fb0c41be605799ab5453579fa1
2024-06-15Have ART run-tests part of CTS (and MCTS) compile against the test API. Roland Levillain
This change amends the `regen-test-files` generator to add an explicit `sdk_version` property to the build recipe of the following tests: * `art-run-test-018-stack-overflow` * `art-run-test-048-reflect-v8` The corresponding changes in the generated test files were added previously (manually) in https://android-review.git.corp.google.com/c/platform/art/+/3119091. Flag: TEST_ONLY Test: Run `test/utils/regen-test-files` and verify it is a no-op Bug: 345499522 Bug: 147812905 Change-Id: Ia0f8e169e9e92c3bbc209e3c4fc98a2234a9c4a1
2024-05-30Add a dedicated Mainline Test Mapping group for ART Diwas Sharma
Test of *all* Mainline modules are currently configured in a single `mainline-presubmit` Test Mapping group. This requires that users indicate the module to install in every entry and is quite tedious. The above approach also adds overhead due to installing, checking for, and uninstalling Mainline modules between test module executions. This eats up precious presubmit time and gets runtimes close to violating the SLO. This change moves all ART Mainline module tests into a dedicated Test Mapping group that installs the Mainline module once before executing all test modules. This also simplifies the configuration syntax by no longer requiring brackets that indicate the, now implicit, Mainline module. Bug: 328102821 Test: ABTD test runs (cherry picked from https://googleplex-android-review.googlesource.com/q/commit:79bf2c5a876f5e1448c95971ba5fdfed5af5f5fc) Merged-In: Icd03a12d7a096bc16ad5fb16eaec4bf65380f6f2 Change-Id: Icd03a12d7a096bc16ad5fb16eaec4bf65380f6f2
2024-05-24Promote libnativebridge-tests to presubmit Colin Cross
Bug: 189484095 Test: presubmit Flag: TEST_ONLY Change-Id: If678e9427280a3f64eb5137729e78d4e576206ac
2024-05-15Use isolated: true instead of test_per_src: true in libnativebridge_tests Colin Cross
libnativebridge_tests uses test_per_src: true to avoid running multiple tests in the same process. gtest_isolated uses separate processes for each test, but without the various incompatibilities caused by test_per_src. Switch to isolated: true instead. Create a temporary directory in the constructor of the shared NativeBridgeTest base class instead and put the code_cache directory inside it to keep the tests from trying to modify the current directory. Also add the tests to TEST_MAPPING and remove the preupload check. Bug: 189484095 Test: atest --host libnativebridge_tests Test: atest libnativebridge_tests Flag: TEST_ONLY Change-Id: Iea522c1895f1f5996b10e545c44d6b00bda1ee3d
2024-04-11Implement dexopt_chroot_setup. Jiakai Zhang
BYPASS_INCLUSIVE_LANGUAGE_REASON=preexisting terminology Bug: 311377497 Test: atest art_standalone_dexopt_chroot_setup_tests Change-Id: I2cbbd8c605d45b5451460306fc2291340668863b
2024-04-04Move art_standalone_dexopt_chroot_setup_tests to eng only. Jiakai Zhang
This test will require root access. Bug: 311377497 Test: N/A Change-Id: If34bf2572990e3d4efb4d87de400888ea844b691
2024-04-04Promote art_standalone_dexopt_chroot_setup_tests to Presubmit. Jiakai Zhang
Bug: 311377497 Test: N/A Change-Id: I29b1b329393b83b0ec71f9155f893405beb45a9c
2024-02-15Refactor the Test Mapping exclusion logic in `regen-test-files`. Roland Levillain
Test: Run `test/utils/regen-test-files` and verify it is a no-op Bug: 152374989 Change-Id: I57491b3a84d2c2b06777a2f3af024c3bfdecda77
2024-02-15Promote more ART run-tests to presubmits (2024-02-13). Roland Levillain
Promote the following post-submit tests to pre-submit test groups in ART's Test Mapping file: * `art-run-test-851-null-instanceof` * `art-run-test-853-checker-inlining` * `art-run-test-2266-checker-remove-empty-ifs` * `art-run-test-2268-checker-remove-dead-phis` * `art-run-test-2269-checker-constant-folding-instrinsics` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 731 ART run-tests out of 1024 (71%). Generated TEST_MAPPING entries for 452 ART run-tests out of 1024 (44%): 450 ART run-tests (99%) in `mainline-presubmit` test group. 450 ART run-tests (99%) in `presubmit` test group. 2 ART run-tests (0%) in `postsubmit` test group. 22 ART gtests (95%) in `mainline-presubmit` test group. 22 ART gtests (95%) in `presubmit` test group. 1 ART gtests (4%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest --test-mapping art:presubmit Bug: 152374989 Change-Id: I8dfc196570630f74f0607435d5c00972da8bf2e6
2024-02-15Regenerate ART test files (2024-02-13). Roland Levillain
This change: * enables build-time support for the following test: * `art-run-test-2272-checker-codegen-honor-write-barrier-kind` * enables build- and run-time support in automated executions for the following tests in post-submit runs only: * `art-run-test-2273-checker-unreachable-intrinsics` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 731 ART run-tests out of 1024 (71%). Generated TEST_MAPPING entries for 452 ART run-tests out of 1024 (44%): 445 ART run-tests (98%) in `mainline-presubmit` test group. 445 ART run-tests (98%) in `presubmit` test group. 7 ART run-tests (1%) in `postsubmit` test group. 22 ART gtests (95%) in `mainline-presubmit` test group. 22 ART gtests (95%) in `presubmit` test group. 1 ART gtests (4%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: m art-run-test-2272-checker-codegen-honor-write-barrier-kind Test: atest -a art-run-test-2273-checker-unreachable-intrinsics Test: atest --test-mapping art:postsubmit Bug: 147812905 Bug: 152374989 Change-Id: I61be071a786948072751dc1bb004073a79d0a6fa
2024-02-15Add support for post-submit-only ART gtests to `regen-test-files`. Roland Levillain
New Android tests participating in Test Mapping need to have enough successful post-submit runs before they are allowed to run in pre-submit runs. Introduce a new category of "post-submit-only" ART gtests to on-board new ART gtests in post-submit runs, before they can be promoted to presubmits. Add recent test `art_standalone_dexopt_chroot_setup_tests` to this set of post-submit-only ART gtests. Test: Run `test/utils/regen-test-files` and check its outputs Test: atest art_standalone_dexopt_chroot_setup_tests Test: atest --test-mapping art:postsubmit Bug: 152379281 Change-Id: Iaba5ead4500d7de67a52808e38315ee3a019282f
2024-02-13Re enable test 2247- on MTS for postsubmit Santiago Aboy Solanes
Bug: 311607333 Test: Presubmit Change-Id: Ia16c3f506e6ee3e88e1c7b816e040618aa781f41
2024-02-06Add service dexopt_chroot_setup and artd_pre_reboot. Jiakai Zhang
Boilerplate changes. Bug: 311377497 Test: manual - Call getDexoptChrootSetupServiceRegisterer().waitForService() Test: manual - Set up a chroot environment and call getArtdPreRebootServiceRegisterer().waitForService() Test: manual - Test the fuzzers on host and on device following the instructions at https://source.android.com/docs/security/test/libfuzzer. Change-Id: Ic576d741ae0fe058833d3bbad6ebb5188ccf200a
2024-01-10Regenerate ART test files (2024-01-09). Roland Levillain
This change enables build- and run-time support in automated executions for the following test in post-submit runs: * `art-run-test-853-checker-inlining` Output of `art/test/utils/regen-test-files`: $ art/test/utils/regen-test-files Generated Blueprint files for 729 ART run-tests out of 1022 (71%). Generated TEST_MAPPING entries for 450 ART run-tests out of 1022 (44%): 445 ART run-tests (98%) in `mainline-presubmit` test group. 22 ART gtests (100%) in `mainline-presubmit` test group. 445 ART run-tests (98%) in `presubmit` test group. 5 ART run-tests (1%) in `postsubmit` test group. 22 ART gtests (100%) in `presubmit` test group. Note: Tests in `*presubmit` test groups are executed in pre- and post-submit test runs. Tests in the `postsubmit` test group are only executed in post-submit test runs. Test: atest -a art-run-test-853-checker-inlining Test: atest --test-mapping art:postsubmit Bug: 147812905 Bug: 152374989 Change-Id: I7184fe73ae460576bde2d2f0d76e64d59a75fd70
generated by cgit v1.2.3-59-g8ed1b (git 2.39.0) at 2026-01-21 01:26:37 +0000