Split rv32i_m/F/fnmadd_b15.S, fnmsub_b15.S, fmadd_b15.S, fmsub_b15.S into multiple smaller tests

[UmerShahidengr]

Description

I have split rv32i_m/F/fnmadd_b15.S, fnmsub_b15.S, fmadd_b15.S, fmsub_b15.S into multiple smaller tests. Each of these test files originally contained over 35,000 tests, resulting in Sail logs exceeding 1GB and large signature files. I have written the following python script to split these tests into smaller segments while maintaining full coverage. This approach will reduce the size of Sail logs to less than 8KB and signature files to 1KB each, simplifying the debugging process. Also I have updated the ISA strings which will allow these tests to run on rv32e as well.

List Extensions

RV32IF,RV32IFD,RV32EF,RV32EFD

Reference Model Used

• SAIL
• Spike
• Other - < SPECIFY HERE >

Mandatory Checklist:

• All tests are compliant with the test-format spec present in this repo ?
• Ran the new tests on RISCOF with SAIL/Spike as reference model successfully ?
• Ran the new tests on RISCOF in coverage mode
• Link to Google-Drive folder containing the new coverage reports (See this for more info): < SPECIFY HERE >
• Link to PR in RISCV-ISAC from which the reports were generated : < SPECIFY HERE >
• Changelog entry created with a minor patch

Optional Checklist:

• RISCV-V CTG PR link if tests were generated using it : < SPECIFY HERE >
• Were the tests hand-written/modified ?
• Have you run these on any hard DUT model ? Please specify name and provide link if possible in the description
• If you have modified arch_test.h Please provide a detailed description of the changes in the Description section above.

[allenjbaum]

Hm, I don't think we should be lumping the FMA splitting into the same PR as PMP tests; unless there's a really good reason, those should be a different PR.

…

On Fri, Apr 26, 2024 at 5:35 AM Umer Shahid ***@***.***> wrote: Description I have split rv32i_m/F/fnmadd_b15.S, fnmsub_b15.S, fmadd_b15.S, fmsub_b15.S into multiple smaller tests. Each of these test files originally contained over 35,000 tests, resulting in Sail logs exceeding 1GB and large signature files. I have written the following python script <https://github.com/UmerShahidengr/riscv-arch-test/blob/misc/doc/arch_tests_converter.py> to split these tests into smaller segments while maintaining full coverage. This approach will reduce the size of Sail logs to less than 8KB and signature files to 1KB each, simplifying the debugging process. Also I have updated the ISA strings which will allow these tests to run on rv32e as well. List Extensions RV32IF,RV32IFD,RV32EF,RV32EFD Reference Model Used - SAIL - Spike - Other - < SPECIFY HERE > Mandatory Checklist: - All tests are compliant with the test-format spec present in this repo ? - Ran the new tests on RISCOF with SAIL/Spike as reference model successfully ? - Ran the new tests on RISCOF in coverage mode <https://riscof.readthedocs.io/en/stable/commands.html#coverage> - Link to Google-Drive folder containing the new coverage reports (See this <https://github.com/riscv-non-isa/riscv-arch-test/blob/main/CONTRIBUTION.md#uploading-test-stats> for more info): < SPECIFY HERE > - Link to PR in RISCV-ISAC from which the reports were generated : < SPECIFY HERE > - Changelog entry created with a minor patch Optional Checklist: - RISCV-V CTG PR link if tests were generated using it : < SPECIFY HERE > - Were the tests hand-written/modified ? - Have you run these on any hard DUT model ? Please specify name and provide link if possible in the description - If you have modified arch_test.h Please provide a detailed description of the changes in the Description section above. ------------------------------ You can view, comment on, or merge this pull request online at: #461 Commit Summary - 8ac1a16 <8ac1a16> Added PMP32 & PMP64 ACTs - 25b9bff <25b9bff> replaced lw/sw with ld/sd for pmp64 tests - c61488a <c61488a> Added nop after every ld - 83bf447 <83bf447> Added nop after every lw - dd87110 <dd87110> Split fnmsub_b15 test - f3d87a6 <f3d87a6> Split fnmadd_b15 test in RV32 - 84ee78f <84ee78f> Split fmadd_b15 test in RV32 - 72464c7 <72464c7> Clean Up - 472b1da <472b1da> Merge branch 'riscv-non-isa:main' into FD_tests - 99ca97a <99ca97a> Added ChangeLog entry File Changes (300 files <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files>) - *M* CHANGELOG.md <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-06572a96a58dc510037d5efa622f9bec8519bc1beab13c9f251e97e657a9d4ed> (3) - *A* coverage/pmp32_coverpoint_def_format.cgf <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f761b14c4e78da679c94240d222c64913347fb226e5008f59bef6ec2d9cd6d25> (702) - *A* coverage/pmp32_translated_coverpoints.cgf <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-c30c751120fec0e2a3180522e80adbfc7747d6221e6c4f235401a961d203a910> (1423) - *A* coverage/pmp64_coverpoint_def_format.cgf <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-17d732e36e4d04e89fcc7d4b0da3781b8b5922e94c7ef289740977f2fcb901db> (702) - *A* coverage/pmp64_translated_coverpoints.cgf <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-2f423f1282ed8ad58281e83c8667fe7ef7ed5034ebea2363285d3bd9a347c9ce> (1423) - *M* riscv-test-suite/rv32i_m/F/src/fmadd_b15-01.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9cd2fb83873ca867b4032b858cf79465abeed0dae51774177e26fbcf94f7af11> (382816) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-02.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d99e5757d79bf1ab85ebbca26b9462b4938b2fce76942c1a66013b95544802c8> (1372) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-03.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-88e7e7e189bc94bd90463ffdc088101a4130988d58a5736e9074571be6828aad> (1372) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-04.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-074d7af037842a159e6e62f4490a7a4497532c937b6ee76abf60ee4222cba8f4> (1372) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-05.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3fdba4c151bbf258c9f2822c74e658ddd3da09308f8939c3271982eb4c74cb4b> (1372) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-06.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-2f1d63e4aa7354955af14725c1477d8765fdd38040045965f621f8b4321921af> (1372) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-07.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f02cf2a47d81b2905e4a5239acbd7a5e1675ce018e9fade912241626127f56f9> (1372) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-08.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-acfe86f4ad1110897ed5002709661af84b0306513457936df7268ddd22ef686f> (1372) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-09.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e6cb6f2de26e95644d475ecba92ce4626b331a2c191971bc6a2f36268f7322d6> (1372) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-10.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6e53bb75f8c22157c20989380bc16fc5711da12d63c80944f77076f46da6e45b> (1372) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-100.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e48ef8735009511620accc1ea8114317ece04201398c8267e4e5de7eaf4f169f> (1372) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-101.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d1dc84412fb43044c9154ae73ead2ddd17f10fe853c7e97db2ceafcee3a47840> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-102.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f85921a9925478b453be844a266e33488c4780ec063deac14a13b80128766a25> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-103.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-bbe93b7e7315a2db85c6739dac5f1915863471916ea548929e00791abb4dd28f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-104.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e32bc1e758303bcb0da724dc9736f1d6dcb9da2c501cb081a596572b1ce6ad24> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-105.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-31d639681c8d9f86c29db17b7e8ecac6a3bb975da490d9d052aadb40970cfd9c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-106.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8706b836d401dd97a113fe0f3209d31ee22c5cb55d077c22b68dc4b89d502b21> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-107.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-498470d7f6d73528f881c2d08b2b191e46a5f64095c12acced43355835b86250> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-108.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-c5a78d4acbe4e5db0c610b7e76d49fd6a998a5244083420b470c908340d5bc32> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-109.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-2a45bcd8cb8580e229fd1b0be34a8b778a1f6cf4079182ef34deed013ef1ec44> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-11.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b442a4b2d6aa895536106fe3855b9a0104df871110ceff4ff764d49f8a6deda9> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-110.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-434a4186d8ef1eb7148b7c22022423b41d6199286b8b472e08ce6a30ef7ba9d9> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-111.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-ce3677e8b6c6670d42bbcbbbe014064cdbfe572cfbb3fd33e6069386c391d70c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-112.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e302df65aeb42d53337288716ab20f279efbd2ac1827c59a58f972bd03ae57d0> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-113.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-28fefbf9efeda37c986e7e931cffa8b54eed1ef001b2da26f8bcf1907cc9c3e1> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-114.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-43e51cfc1d812f43ab40c7d4c576606940729f7cca644434b6dbbfa8f3c6cde1> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-115.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a5c18dcc6a40fff8e3648ef058e880a7fed4c6064d022dd947d7874e61bb0f73> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-116.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9b347f533092778d5a7cae135fa7fe45de1d431001aa59e41677615489dff158> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-117.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-c1176f47c001b5b5000a4281a0e5096d477fb65d2470245364b9cd690c2b03e7> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-118.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a49a1409b9ec1d2d3ec451f2567c1aa113374d4a630617a1781cb639d946c022> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-119.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-09287a02b29b7a80109b94bf0b7c9754d49608fe79156b1a683c2896cbeb88a3> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-12.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-1c191119f3cf9761d1ad2a1911a27a58dfec5e6b667fd1a596ac88e572170d54> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-120.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8eab6f87fcc2f99434b6024e9c217f78fc07fdd688482b809c5680866d03a223> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-121.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-fe434d92efa505cc7c6d8d12b9960804694530289b2ee95f6cbcdf135569da44> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-122.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-0248d3b132f77a70a948510a4fb815a8f151c76c7925568b6da25e0e911edbbf> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-123.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d1a89aa9ac13b1bd68e0ed6b0f9c61c05a4e37a50f8045d725d68f52a7b565c5> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-124.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-0e2af706934fa89cc3da16e0b7ba27faf7b0ba22609d24267ec2d78d51ebb019> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-125.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-24975787980e338beb0a33d8b2ff81e0e13c251f2aedbff103ec028af78a356e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-126.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-53fd8642151b4cf62ce5a5670ee2913a823f293a497d58abe1b84f23f5a39800> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-127.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-25799e84904e0e0e03ab725ce0bdd4cf214752f33107029c58be3bd6cc80eeeb> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-128.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7bfc5a9c9bdba37a6b2cc0c4b55428c12808b748a8c9cbc8dbe2122fa26c4d3f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-129.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4cd1f3e728c257cdcc68abf1b5272da9de0c50d48c857eef90bc1fca7981a10d> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-13.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-32420f5b1cb9709489a6d3f79a515eaad2d587db70c4f980a6f4a0565fa30285> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-130.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7fb46fd179cd86cda80b408ef0911d734ed95a333f079342d0e8703ad7cad462> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-131.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d5a42e568e93cba9555440a35ae27cbae5dfddec05d0608a6bb1fc683fe330e4> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-132.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-bc4f0bc8045eeb4b3dad72f6e8c13f5ac4c3bf9db1a5ca12ba633ea280029e22> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-133.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-71df16061d48c54c7b45915c7e030cfc87cc81940cb1aadbad54afc50fff278c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-134.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8762490347ed6a7a68500799b54943814fc87dc8862574bdb024364aa8aaa9d2> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-135.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b62233a8886695e619ee42fe6523d1b90b2e67454920367450c16f8a4765884f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-136.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-08d8cb5a3ef38008d98f5cdaed044b4a31b8c1337ac5afbdf842140fb10a2698> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-137.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-523cf56865bfbc235631696527b1befd1434a5573dea043163e5db032eea3866> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-138.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4f2609b59e91d149ba8b889e98c55cc7d00f135090917d61dd6081662511439b> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-139.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-40945d2dac911a9375e60085cda79cf532b06084228c256d641661d417207e1b> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-14.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e4f68625efcd81127548d2182c8339d8e2f3fcb9f16a1f8e8dd393ffefddada1> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-140.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-70befdec6661608f68b45eb9bd333ae7f8d7781cff9d336a3a5a56ddc903ae44> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-141.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a0ea9423bd36804f9a1e95fdf260f4853f4cb5b219e4f00c09bcc4c4711403e4> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-142.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-0f96f7a1ea0d68eed3357d3ed6a8d3f358f1c810a53c1a64b7156d664548ca2c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-143.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6815ed5174d620e740cc8fdc42a2b7a0f78869cc2f9ff17bdd407ab21dbb4e48> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-144.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-ff55e2a1b9e46ab8ebfb7d6b44dce0606903add7e31710f40816094420eb3b70> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-145.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-94875b57eafe771070973e811093ddd387a065d9838d56b1d6b59cdcf39de89f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-146.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d9ba681114f01d7fd54f2d682e2b3a189cf7a0be5d698a81b2694a7db2ef5a47> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-147.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a790a82d2da483a9c17a0df5084681afedaaa3d280de186b916808c2572b4793> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-148.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-2dd14dd686c46d097823bd1ad35179ba5f561477edad21faa06af329b00732cc> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-149.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-020ea42c5a5858b058125dfea553303bb43fd0765dcc7e365d769481981899df> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-15.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-55195367a04c1e1f75ddbb72b598028fbaadf410952775bc2d0195268a0377a8> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-150.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-54a7fddfe0859dd051f3cc103798b403078e024bd0ba8e2f42099d2a736b8dcd> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-151.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e0f9eb51144a35a174e8dc838082998c951b1809cad806e74777fa72ed5caf1e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-152.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8bd138df4dabb75166f519a0067f305ec29f1dac0b3eebe1de30e014fb6b062a> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-153.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-631485e548f74e1434ced07430034d48d156bc3552181299ca1e9dc2e33024eb> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-154.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-00b20c5e8c226759cd26f5bdebe4e209d73de6f07ab3cd273cc30d9db78b58d5> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-155.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b397e0413a50fb9153cf1698cb5148b64a5027c5b8c34929378d718580564f3c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-156.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8c5b9b000818648b46eb2b6525df96e2f614301a20b173fa246ac42f417f5e22> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-157.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6cc134ca9841fdf3c7cc861ce9b2c6a2c392d3f8880e2b344dcb79e6f4db2bc8> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-158.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d3f2662f69973d0113954426fe49ef8e51d75de75f0efc5647d03c3e369f4ab8> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-159.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-704f56395e866a64d388c18caa295caecd7b2d6275bb381062dca8046a869782> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-16.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7b003cfd78ec224c24d1f26ca45473a31d80bce992644018a0014c0e79a41e4c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-160.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a9529a67037f85eb175194dfcb669eb3cf1db3a33671af621b3c92888c8577f9> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-161.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7b73bc71ffb9d840452d5a6d28b0353650c157a0dc1751bd4988da0f8f376251> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-162.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-87b06bade78495eca0fde03753c44fc873fb7bcb49abca3763cfa70c9fc01107> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-163.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-0658ff9d24738fadc19d1543ac5284cc2860b47756adecf34295a662df47638d> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-164.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f02280c2f9b134ad4b85d77c48cad2b6f7e7b28f133152c5d242382dde3f7023> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-165.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f36dcdffc43e09a0cbad4c01465b62e98d4861738a1a9d8e74e00db2bb81f140> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-166.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-175581ca961cc20ec49af7b605d532ebaf5c8a06459dc0d5fcb14b9bb26313ff> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-167.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-2f1a65e07a17c6d2c8e8e0e24fa221c554b0a4605609473af486481275d60a12> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-168.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-2848d5bbb9712483c93f7dde83a79e2d666b2b9b092abbb91a66852cc401c3fd> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-169.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e07194219f516977b0a6a9bc8e3d80b7621a15a526ae053b334a79c98f72e75b> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-17.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4d554bedc308bb95b4f855b1bb967645a05092aacc47bf3d48d0fe890448daa8> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-170.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-64c48a1784aae68a13c1bc920b6caa1b221f356cafc604c40dea26e8d8259077> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-171.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b895adddf979b4e5754e521403521c373729481c07f8d88d9f97fb191577efca> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-172.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4cc5cfb804e50d803ad5b65b2c7ca28aa91bc83c961f3a7aafc411b9cd4e3e7e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-173.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4adfb25347175f4d4af8fd96840145d13788e68211e51d29ac8a4ce4a65d22ca> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-174.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-761c433810afa38d0c2bb862420ce8f71fc9e556ed68b6497e74a6ea4b68114e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-175.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b02832b6a52e06c33f80f9bbd11c17c0e7f146e125864e07cefa0b7b0d00aef0> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-176.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6743bc50eead5095737496f87fbabaefec31b52729788a03fcbc012426336a12> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-177.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d1a3eb8938e19661a23ca41b1ae37395d18415b33b385a67d51de4f118bbf8ad> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-178.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3dc7ee11fe50ff1ff6966ba046ce1c10ec58d36ee691e2eddb78f788ec9e8250> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-179.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-318b197d910a1485ffc514dc0c9414e4440f5816c8f7d60cb4f2b2e25fea1838> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-18.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-88056cbdf71d5c98ad1c6397d5ac36957ff4f525112b42cd4c3c63a8a4bcf414> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-180.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e1315afbc534b1770d9de7c331e30c6e7d46fa665a804592b1c09cbe5cd061db> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-181.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-dae749c69f0f8a7711e156dc4c30082cb793d609f90409ee2dc6f46201ab7b55> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-182.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b400e94b357ee8181ce2e69566455aeebb02bc2d661d021050207ed518da3472> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-183.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-daa1fc91d1fd2271db914f207cd347ad3c2a5cc7b4f1ea3e3c9b1fb640c307ab> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-184.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6ea7c333012d555f6116a94f861877155fe0998f9dde99b7599fe8917b1d3015> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-185.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-515355e16243636188c0fc6a9e4d17f5dea7742aa77bf065e9b20014519f21b5> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-186.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f1bd8768dae2289c4e8526960909f8c9a83aea28fea00963c051d06bbad5187c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-187.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3665e4289e6e201752a7720018e443ed1fd058eee13c37d7b7f1bdba98fadc88> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-188.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7cab9ce09018808563fb8a723855265b12d0947928a1d0f3399718fa78d337d4> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-189.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e48e2f10b89c35ac25cc6d5bb2e2b485583d72a43129b8440bef00228d1c1629> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-19.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-80609e486b3cee494e93ae25b8c524bd374605a7b339626f96723e7f42abf862> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-190.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-942ecf8dc9fee7494e1d82b117bcf6b9ca0c792a116e9e4b3ff42f8f7eaec1e8> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-191.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-70165df2b9e0e68941ce972bdb1a44bab4b434494b63cc673a7e04d359ad48e3> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-192.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-ecfb5ad70bab96f529517451615ed6e22f36c84704b32fed7fdd7a012d51c782> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-193.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-5b68ffd931aa7f6dcd25abb3026fa0ae5cf03915c9598ae57c270caeb94bd622> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-194.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-1a1281c4561c8e0ee0472f25b50081d6f15ec322f90e6778b3049b81fb6c75e1> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-195.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3ff02912fcae181c83a21ee42bcb9e60935f967a1c3c9a8e249b9878247eb2fb> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-196.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-af8950107c8c8a6faed610c67d2c1f8dc64aabf51c61d198a99829bd01772e56> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-197.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-eeb0474630dd16bb9f4a8ff0719b13f77e2f69e549b15ef529089833bfc2040d> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-198.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d101243feecbd8281ce2cbf8206afbe18f6a7afbdc01a7422db074e94390440d> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-199.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7b853998f291c4693893a607332a3ec5b2490a46e1334443658523a388311d55> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-20.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-22555eae0781955a2449479f50bda6a99ec32ee466a9bf013912e4bbdf16f3ce> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-200.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6cbe674105f50d5ce990ff703b053ca6a01936e9ee5b53d230e715a8502c0692> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-201.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b5a8649a96070a50cb1e1eea0c68e2df9caf856854416333fadaf1467520242f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-202.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-5da018fbd52981990cbd574574328440b7d0a47af12b3effe515734f4ee6d08e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-203.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f40b83735321261e8c0a5381f782e6a21f8c078c2f3e9a8d44a0af33e2d8c5f7> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-204.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-79c47e797849aa9787f5d9f07cab289e49005211abec7a8fd7f3121cdee6b7bf> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-205.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-89b126a9ff0d3118aa012aae0d31d13670f9544407816590202d3d804e010cfe> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-206.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-c4328429658e8ccc971747e62598ee5b4f9c299ef7d81f43c3d3f042cd89de27> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-207.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-ab8e49bcf0b880f77a3e8c6beb508ae9aee87e3d9ee9c91e287a66c0ffef7fa6> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-208.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-63ea6677389ee648c0ca311b3c3bc1bef107f00f54b39b8613ba0eca1a8854af> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-209.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a3baf2d6bbbeb665e705377de23e263581232905bdf846e27eff3944d961e42b> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-21.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-5782b92f2495bd10a1e22eed63161c885644eb6051f838a7810163460465aa1f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-210.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b8c85e2b4782eddd40b1f1ce287319b84f18515b7bf4c66923a166eeaf081db3> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-211.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b374cba80d0658d19447d54702783f363296cf7eac9c44c0371c178ca5c3488c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-212.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e3a60aeb9415337ca69d53f70fc9e9ec47beb577791e226e3b012e78411d7f00> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-213.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3351dfa8471c7e68f2e231a5eb23aac812f63c32b78c9d44db96c05851996248> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-214.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-5a34b9a6b5ec52994797bece8692fd98eae5fd118cd8b2e46950b3e16f874741> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-215.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4874074afa997f02a4b155eaf0275e4723c28c64fe7a42143b740e53bbf52cc6> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-216.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7621c399d7c1efef8968d33c19d1881021d5e91a1448aa8d07167a34c769c388> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-217.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-49b712346af3b5e50927352cab9dfc5fe91aaf52a20e52b75c91f64b9e4107d2> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-218.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e3f5e2b5b8b90998e8daff3393f0c94ffcf07dcebc544ea0c180e53f948aadce> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-219.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-caeaaa327b8e149417f682a16518c55439cdf9f76a7fb87ecc5a27738e28a729> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-22.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f6dea7a844922a8cf86438231bdf87b982f6552bc6947f0666599fd808233828> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-220.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8638b908618d1fc36e609cea62335ecfc1dbbe7337d7fefdd31700a90e838c20> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-221.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f058717c894d9f02838c0d77b7ab795d98ff5f2474878c64892869a209e1ac43> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-222.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f9b0d26e117725d521677c74bd118fc5e99ca14bc191dd35ec708b2bceb93692> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-223.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3226f3ec5c2fd07b77da84c8330f89a8a81fec0695580f112f9872a38326f360> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-224.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-573cc3b75015d2ced74e8fd998813ccd1a5979f7ba43a662b3d3eca1376f003c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-225.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9b37a9af1b885ba3310636c1458298652cf22b2c89cab2d3dd1c03215ab03c23> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-226.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e2f1203a5a52552aca88bdd63e0f5f937da727effdced7886d1737218a20fd1f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-227.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4626f02b6fad64105b667c6fea71d88ab5db159ad618b9b97e4dd2957da83249> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-228.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e27b2bcd34b0023d82ba301a971e26c4174b3d1da10cfc0c16f162dcfa77d7d5> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-229.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-dcdf8863c01f55244bc5fa07feef6f5537ac377f78124bc3ee73e23f889fccfe> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-23.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-bf8365d589c9c9bc02f30c63787c76b5dc7811f5fa061d7c4bdf170fa7b82e76> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-230.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8e7a63bafc73270a5ca983a757635b5d63ccd78c4bbcf4b9fd3daa2f345046cc> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-231.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b6a8570f89da7f0051ac41eada65fd137c12609219a838347ce8434094c23f8b> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-232.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9203981750efe95b6360aad78bdb9d1c7aa6a5d363571619bcaabb4e1c29b974> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-233.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d9a2cac69d50cd30ab2a0a0a40279e563f0dc3ba930ec39acd17fac50dda1945> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-234.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4ee6a20bbe40d5accf95bba452097f14baf53ce0fbc6ff1c774f944e04723a08> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-235.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-12eb32a9a271bedc446a6bf37de135e242210619736ebbe009cb0d45d8d7f558> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-236.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d750799eca2c716d25a9ac9cf4b158b9adc7fda602a05921dd71e35e35924f52> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-237.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-53a19b8e556a7e5018742d6d55485b690e7006169d2bd40ebfb7882870d7080d> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-238.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f247641b51cfeda03a0d7716d4ef04bfeedbc3042316922be8edc434aa8ff7da> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-239.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-1051c3ba757818389b1bb85145d0734bfc5f72a60edaa33756b89e76e3950945> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-24.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7d87123753ed29fe9e120fba9fb9788d553bb527c2ef10833a3dedf948e60d5f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-240.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f7faf20c390265d653e8e01d5c8cca8af6bcf507b5b31a5068df773dbc2fd4ef> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-241.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-dc52efc3a86986c1fb625bca85f32825786aa8a951362167f01359909a2a0c2b> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-242.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-07647a7b599e6345b49b6c4259c28372cc5996b3f06e02c242dcdc66140c7fdb> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-243.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-35e758dfcb7f993e5fcf1961d95c40d27ee813a8db3e6e57f375d0584dfb6c1b> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-244.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-1f02e309fa78b2bc327725dc00d248b9b67dbac5c53f2fc070a5699881c26941> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-245.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4a4047a7df348e77090c26cc5ca44754adfd3d8a34491edab2617e6dfdbd5ade> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-246.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-73d76fb90101796d3f0b391d0940fc12b399e3941aa478a3aa0090579ea30472> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-247.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e88fa8c77f0efe07a560aa127425fc215228728f2ed910f47c0f622c958b5776> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-248.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-36acbe8466a20b1bc5bc578acacc005daa1fa79f40a35ad1977ceb53c15aa72e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-249.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9bf186840fe1735ce8de30f4b6e44e409b185eafffdb753542c2c69b1b0a7eba> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-25.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7c5f186e922c9732266cbd1bb8ea4831dee32dce3a24908706f2f7e1d78b7140> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-250.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-c8f8785283349b0cd0a59ea59194753a7dca4464e7b1569b77a16aa9aa2bd37d> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-251.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-eeebfbd254c1dd70f98388567569c581bcaffc04fcd90de99521b1f41c75ea72> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-252.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-c120b128cb2b7dccc6a7b1d0e477354a473d3baadc14402cac3c03c6e75961f8> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-253.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4c0ea16d0b7fd1d91030ff858951190b64ab145c8a0e73f1cb4c2f42a9e0f08f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-254.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-c33757723d179b22a93be4bce5c45fd66d3a9672fe8c07ab2965eb05cba57cc6> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-255.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e3b28cce0f6994193ce9c3a6df52133a0b089367a6f5ba05f4906a63884ce0dc> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-256.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d69c601656385df368c4ed728a43dcf3fd486f7cff4d54521d73ca1c2c3a62c5> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-257.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-65c7503030dbd8992ed87d43ca23b0967e38e5cd4432d8d2ac5a276803d5a854> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-258.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-65697e1486aa7b927df63d8fea1c22069ba0b62f96e9950b9c89227b6e6baff8> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-259.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6dde2f7176f5468dc59c580993938ecc52e836685afa81317db741d8478853bb> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-26.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6aa00cf249a1e6f66d8499d09d4e6a2a73b495a9b60176ce0429e41a9c41f6e5> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-260.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6ec0614832c5df27f63aabcbf73c7181c5155f29293e8711b8d4bea58042e8c8> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-261.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d58044c8435b16bd663c298b232a0ecd226fc705d532ed1db9d6ab7fad67d2e7> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-262.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-726b4b5d517b755fae6ba92840dd3c908f8d6d0d238cf64b99cd63bcfdebd62d> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-263.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-52313b29650be3129ca2fc664d8ff21a8de303f32d8c6592391afa18531c296d> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-264.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-1602cedcc543abb169884d769d4d9c65b39eb578ec26b1b9596d7da2dde64342> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-265.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a394dc46e2c3dad74cb716f9e679d29fa5282cf5d0ed3680b33b5e1f0014de56> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-266.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4723f5a101c9856174e960ff1a602054ea11f57f0f3dfedba6aee3c47fc93860> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-267.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-75bf9ab2b611d83da8b5ac658b6a88b39feef529622a1c6db2f5146f109b50fe> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-268.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-48f7945206d9e48c34b963f997c974c51178587c1c281ce7508ce8e707850efb> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-269.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e5143a1241be212944198ffcd8a71b69d8cfb4b85d60458b59c1faebbb7b0355> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-27.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-0bf58a51356596dc0f2ffffb4af1c404ea1821dc5e6e811d844af30a3941d376> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-270.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7faff55f7cc73e58cdbde5c4b5d2c112195e67e476b8dc96fb46c16cdd92c546> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-271.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d6469b8168121eefc3bf09bf411aa6335767879ffb630d696cb19291e66a6006> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-272.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7eee3fb7aebbee8179263246e2ef651b45dfcfa72ffe68be6f09ca85fb0208c8> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-273.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-eaa9706022958478a35c260f45e51479d12bd10bf2d36390b229ddfdd203e0bf> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-274.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-26fc695072c8bbb240e36e6f32d40d84ae6e1ac284ee4741b03ddc0b99519b0f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-275.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4afbc06c051eb716f8ce2affbecf1bfe681078322e3ec84f6b9ecbfd5a9efd25> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-276.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8d5a6d9a273979ee90aeba098cf0842c41c0f458540d85dc267513517a33264c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-277.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8539c9445d987082f6bff725896ce2d0e2e3f9511cabdde735a47391c79eecbe> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-278.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-ba9eaeac07cb8e2bf3d6313a25e268e95451fbc0b9d2d78c86a6e56d3924eb0d> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-279.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8ff4513c69e7764f518d73e62b493ca48805ae22992f468638cbe03ebbffdf36> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-28.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-902a40d1081e1c14e8312f34a38c49b8a9e0bb416cbdd97b9d61106dd5752087> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-280.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-5aa7020c5aa217114e827b39595975eb989cc904cd28183b47c6550c5bdbaab4> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-281.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7bc9c043fffc79a1ab78c3d74c601500a4aeee9fb950d86a376355b885dd40b0> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-282.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-beb3579c9dfed6e05d679f715404c6d8d66149e772189a53418f2e0fe1af4759> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-283.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7335a37ea52c41ed7b6efccadb54c29361f1ebc4011f8a8549f829245c486e95> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-284.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-cc2266a01138e20de3a707861f8df460dec24aa137ddfd7086c76c9011a2b268> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-285.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3e25e900e5f7af07b1d86fdecd60bad38135eddada4499e4dc36bc8b31f5edf9> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-286.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-e2c8873bd6a15216a9b44153e4712a1492e1b031c97a1ff587c2a2638ea604bb> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-287.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-bbbd3c90df73efb17be1de91879eacaa8afa8e9f37f9813065f21d159c76406b> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-288.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7a3a98fce295cce62cc526f541997ff4fb280b88fbeadd5a935711a6b2ca48bd> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-289.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-1c9fabd0eaed5e191f2d7f3f5e07751c45b4d2a0935ce891595a984a6c98bf31> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-29.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-77f634c0bda9d91c524fc86cb24bf860f436ff89d7e05ae8241c65c4c5f11bd5> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-290.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-2cbbd8c1959a54a4ef79e789ca0dc8f883cf5ec294a33005cebeca49c6dc9271> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-291.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-2e9456402e0d2e303b75df47bf50c923a7fddbd794236e7958fd02e5b56485e9> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-292.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-383861855c8b1ef84bbac56f49c7ec4feb05d6fca2721e4a351a385a4d2b1948> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-293.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-fe5d3f5c737af299c7ce8929c29bb4ed1c5804980c1c40f0c1cde092230fd79b> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-294.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-2e469768fd13a3bcd7ce36373640cd6a4dd0fe84bc6c07fc38d7c6fce31ef23e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-295.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-273901c56818129953e097a77644ff86eed68851befe2e5def1b7fe910efc9a3> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-296.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a7b2f8cd1124bc8b71121f99207c616601bb35e070159ae2cf25189fc0f5cf3e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-297.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6d0a5e967641ca249b1caa0b5ee2748bad5347ff1112081654f2bb84b1e84caa> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-298.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4bd1e9dbf25aab861fdcf1d111fb009a910a5b7e47da0557b7e32690ee691b2a> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-30.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-5a3ca1b2b9b96654b5c4c7c212e7c9ffe13fe1468a168eee600dd401424de76c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-31.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4e350d3afe21f6188d4493545dbe66dd9bedbf571b232c6130fbd5f2f46033b3> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-32.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-bc306cba4459994cf62aa86321252f10bc55379ccb51b742e031a79987d6f54c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-33.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-4a121a8d5ffa38651ca0a073bc6f578bd5c08992acffa4c75d09ef3bbf4af6ff> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-34.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9dde1f6021de848b70d8dfe1aa48ab48f60fccdae14b902865e3abea6559a675> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-35.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3d89d6c39b246789e6b6fe39654e3da0f52b03e837a61eef3ea837c043c63373> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-36.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-79e88607edf9fc31b702afcc5d35929a08fd5d0e26c982e9a9a0b992c068a308> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-37.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a617a7a87bc9bf8c7339e370ff78393a2ba05be94ab5ef8c738465ecc0b0d29e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-38.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-5e985e12b2760cc7bbabc966d557aeb09d0acb75ca285c1c678adff1b09b9e81> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-39.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-bba2f641494f767bb3e13b78d7d3a78f938e014193fe2de67e11c19260bc9230> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-40.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-0ea37df7d3d7b263d33903d86771d01ca60e53eaa2fd6fccb4478107d5b46e55> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-41.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-771f80fe9ce4cc7f0bb9709fcb537b8bd14ec9de42eee258c2069d1c7954b3cc> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-42.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-bba328692deb7603f736e2764a4501a90f390120a59affe0923621d295aa8018> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-43.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-da834a6430100397bdd9ff43bb2779fba96c0ea30eca64ac46753e86b6b61abd> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-44.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-49563822df178e75e18a5153d4feffe516b32776dacc0b14d8ba8e681c02461e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-45.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f2ba0e90b207105335cc8a5cac7fbb95e5d07930321f102c440825d2b5e110d7> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-46.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-35a65ef65c302f1a8afb37de3ea56059358ec067d848b4d8d19d54b91106538a> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-47.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-56b357389dce935de63069a0b1416bc0f2be745ce074360926f200dd329f7e52> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-48.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-97bfb443c923c64bfa2399ef92d8c340d1362afcbdf78d1ed4e09a113e2884fe> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-49.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-b062883462b9e5f20eab7850b30c420a29ca761af121e91b11fec4254b1f27c1> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-50.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-02507ec9d21b69a6a1e9db6b0d6598c76eac2ae3af516f9370fd4c08f1308d31> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-51.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-1ed2245d5c501a9bf1b4ac8ee1d5faf57903414866f6c83b650de8b73dc67b30> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-52.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a5e804f6359934dc9aa95900f1547d08bfb9d1dc54ef1229901ec1570c25741e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-53.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-277cc47a948c26bc130e660010c2b168f9bbd4bdb389ddabe2e027624c85f4a9> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-54.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-59b4405ac3e15f394cf09c1caf14d754b46e4865b66939eca4363221eff4709f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-55.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a3754881ee53aa7f18963bfcbfd864c6a64a106788f86f7734cf9233845c6cd7> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-56.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-82994d9fec0e7edfa28be546d6be945c7c7c3845c5a2974a16464a0efcbff984> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-57.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-8f7dd7126dbac553bcbf20a7b1e954fea4a4afbed9ce0abbb4be6f04d1a2538c> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-58.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a82e83d20b1a8667807470f184063f7e8c839e618f60be658272bbec1aa898fe> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-59.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-5b05d868473f02220beca04458da56f2a1f485faf6e7f5692634c6277785aab2> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-60.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-79954e1e11abb77d65d45097120523201d58dce2baf92eb1a491d6ad35fbba39> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-61.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-be235ba1f081d9c81354d9a369061840137c689e530226fb425d8f646f00c46b> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-62.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-64d59926815daa3a87291b7d19b20e527cb808379a56fa62608d3c839e8ef4a7> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-63.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-735e6934093d70b36bff88cf073f6f9285021967adc10210f5938be440dfb58e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-64.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3101821d6edc9186feec6c43d33c747452dc675514edcf1f3e1878448fa274ca> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-65.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-d6ccd96336fa1a3e049750692be30fa8c78d51a8bcb5fcbc96ebd0d097cfce93> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-66.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3ec5bc2a7d73e4762cf9d7197b87b61a5112f6dd8e7ef7ea98e7d48f45b4711e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-67.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9cd75fec30b207975b5c1c3b827e625fad3e67cc6ac603185113dbe5b1cf3d2e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-68.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-635754f1e16a62a189f55b79417fca8f3e231c9d87c9affbdfeaa9ad77d70a40> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-69.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9c0eb6fc9f07fba7fb6185d41aec6e3703d2686a129e128f917525938f229834> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-70.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-a58c6f24b714fb5cacb8b2af6f3c258200516b6afc1945301df160a137ef3fe4> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-71.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9496eb0f22083b980eb39885433ada10a4d35d34dfc9f0e9ec062a4b8831c091> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-72.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-1c09d0ea31a919ff77110ac80baccd3c2d7240e5c43d6e859eeeb96f75536b75> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-73.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-69d76a9c9fbe83bc9cb78e826369cfbde5296e0aba81e8d555d3cd2168db3187> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-74.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7a6f413de3f9f19e1ffee3c186b75439193d42298b88c01aea074bf17bf753ad> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-75.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-fdffb3c335f5f03c5c585e9a38db9d152e7505c4a69a2ca0642dffb6d009d2c4> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-76.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-19a3fe9d3d1b23354b260cedd4037275119e79d4f6c552f995a6ff73be185547> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-77.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f22f6f31d3a1ca00a7d8e9ab4308a4f284acc537e719e9e552eb71b75b3c681f> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-78.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-f1106fbaca216225943651bf84fd6f5de411134b04fd2669eddef49d0bb11abc> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-79.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-7f2abc794fc5bd91046007fb18770eeb1a1ddec327b5dfb16120d99b6c7d08d3> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-80.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-67c2ad20cf31d3792304d7dea9e8eeb1e3486e66e03a1635cfcd8744c11aafe6> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-81.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9a5370005c84aff6b800c35bdc65b60e5fd2ac074e5f86edd6a33cd332045f7e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-82.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-65e72de05502ce5e19700aaca5d9a4290852f4da3e3e655971d35e09a0f4bc60> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-83.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-92d8a07d467389a4e14c80ac5d9eb0c04fddd20676aedd38ff0996110fa89ed8> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-84.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-6235e41a6cf1a2513b1a545b172dbde2cafb0052a77a752bdfc325d2dde97c10> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-85.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-fd85ff75cecbbebc2778969f5bcee0bcbe87723faeb33edbb74fdb4b5fbbdb8a> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-86.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-3968c60f69c612e34d5b173055d46c0b360f4adbe198629652945fea04db49bd> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-87.S <https://github.com/riscv-non-isa/riscv-arch-test/pull/461/files#diff-9f29b85b5f3061bf34a7695187b47e8916ff569db3d445fbf23ea3e13a84bf2e> (0) - *A* riscv-test-suite/rv32i_m/F/src/fmadd_b15-88.S

[UmerShahidengr]

Hm, I don't think we should be lumping the FMA splitting into the same PR as PMP tests; unless there's a really good reason, those should be a different PR.

Sorry, PMP tests were in a different branch, it got synced while cleaning up my branches. I have removed all pmp related stuff from this PR.

[allenjbaum]

This reduces the size of fm[n][add/sub] tests by splitting them into individual test cases (using a custom python tool) each of which contain 256 tests (roughly 12KB instructions and 6.4KB data) and updating them to work with RV32E/RV64E architectures. No tests were changed, so the exact same test cases are still present, with the same coveragem but now in nearly 300 different test files instead of 4 monolithic test files

[allenjbaum]

now merged!

…

On Fri, Apr 26, 2024 at 12:10 PM Umer Shahid ***@***.***> wrote: Hm, I don't think we should be lumping the FMA splitting into the same PR as PMP tests; unless there's a really good reason, those should be a different PR. Sorry, PMP tests were in a different branch, it got synced while cleaning up my branches. I have removed all pmp related stuff from this PR. — Reply to this email directly, view it on GitHub <#461 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AHPXVJTIFKAHMFFW7L5Y6KLY7KRA7AVCNFSM6AAAAABG2WO6MSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANZZHE3TONRUGM> . You are receiving this because you commented.Message ID: ***@***.***>

[Timmmm]

Thanks for doing this! Unfortunately it looks like there are still some really big tests that have been missed:

• riscv-test-suite/rv64i_m/Zfinx/src/f[n]m(add|sub)_b15-01.S (24 MB each)
• riscv-test-suite/rv32i_m/D/src/f[n]m(add|sub).d_b15-01.S (60 MB each)
• All of the b1 tests. They're not 60 MB, but they're still around 8 MB which is very large.

Also I am not sure a Python script to split up the tests like this is a good long term solution. As soon as someone tries to regenerate them they will have this problem again and your script is unlikely to work at that point. I may still try my approach which is to post-process the normalised cgf YAML file just before generation. Let me know if you are going to fix the above issues though - if so I probably wont bother!

Finally, I highly recommend you use git rebase -i next time to remove unrelated commits next time! (Or squash when merging this.)

[davidharrishmc]

Separately, I had suggested splitting into 10 files, not 300. We just added thousands of tests to riscv-arch-test. There are so many that github won't show the full directory. In some methodologies such as ImperasDV, the simulator has to launch separately on each file, creating an enormous overhead to start up thousands of times.

[Timmmm]

I think 10 files would still be too big. Based on the file sizes 50 would bring them in line with the other files.

[allenjbaum]

The script could probably be adapted without too much trouble to any size we wanted. Splitting each into 128 test cases turned about to be easy, as would any multiple of that. I suspect we could pretty much use the same script for the missing tests. *Discussion topic for the next meeting:* Talk about that what size code or data region should we choose as a test limit (e.g.a range from X to 2X bytes for code/data/sum of code+data) (and I think that should be the measure, and not the number of files) (I would like the files be named with constant sized , so they are listed in numerical order instead of alphabetical order though) Long term, you are correct that it isn't an ideal solution, but I suspect it will work for quite a while until we have resource to do it correctly. This effort took a only matter of hours (the structure of the tests made that possible, as well as a talented programmer). I don't know of any other tests that wouldn't have similar structures, so a python script might be the easiest solution for some time to come. It won't work for more unstructured tests, but I don't know of or contemplate any large ones.

…

On Wed, May 1, 2024 at 9:31 AM Tim Hutt ***@***.***> wrote: I think 10 files would still be too big. Based on the file sizes 50 would bring them in line with the other files. — Reply to this email directly, view it on GitHub <#461 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AHPXVJQK3CG3T262XBRQ23DZAEKF7AVCNFSM6AAAAABG2WO6MSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBYG4ZTANZRGI> . You are receiving this because you modified the open/close state.Message ID: ***@***.***>

[UmerShahidengr]

@Timmmm other tests can also be split into multiple files but first we need to discuss what should be the optimal file size vs number of files. It is a good thing that Allen has added this point as the agenda item for next week's meeting, we will update the script and will split the test files after converging to a conclusion in the next meeting

[Timmmm]

Sounds good. Which meeting is it?

[davidharrishmc]

I agree that the size of the b_15 files before the split was the bottleneck on running regressions.

However, even a 3-way split would be enough in my context to break the bottleneck. There's overhead launching each simulation job that has to balance against the parallelism of the jobs. A 10ish way split would be a reasonable sweet spot so that the simulations run fast without greatly increasing the total number of simulations required to regress the riscv-arch-tests.

Moreover, there are 4 fma-type instructions in each of f, d, and Zfh, so the number of files is 12x the number of splits.

A large number of splits also leads to a huge number of files in the riscv-arch-test repository and in the regression logs. That can make directories cumbersome and can lead to real problems getting hidden in a sea of reports.

For example, for fma-type instructions, I counted 102005 cases in _b15 tests. I count 13,835 for _b1, 1684 for b8, 280 for _b5, and so forth. Integer tests have 1-819 cases each. I can see a benefit getting down to below _b1. Unless we also split _b1, why go much lower? And what metric are we optimizing to choose the number of splits?

@Timmmm, what is driving the desire to make the _b15 splits in line with the other test cases? Please help me understand why that is beneficial rather than overkill?

[allenjbaum]

We discussed how to write a simply python tool that will split a test up into multiple tests, based on parameters passed to it.
It has some assumptions about the structure of a test (which matches what CTG generates: the line numbers of the actual tests, the line numbers of the data area, the number of data items used in each tests case, the number of instructions generated by each test case, and the maximum size you'd want a test to be. The test will be broken up at next SIGBASE macro that follows that maximum size. So, the question remains: what is a reasonable size of a test, or a reasonable number of tests (which can be in a subdirectory, if that helps) - but you don't get to decide both....

[Timmmm]

There's overhead launching each simulation job that has to balance against the parallelism of the jobs.

I definitely agree! Our overhead for each job is only 15 seconds though (see below), which is very small compared to the actual runtime of the tests in our case. I haven't used ImperasDV but I have briefly used their reference model and we use it in a similar way to this diagram but with a custom trace system. I don't remember it having a long startup time - just the normal time of running the RTL simulator which is pretty fast.

A large number of splits also leads to a huge number of files in the riscv-arch-test repository and in the regression logs. That can make directories cumbersome and can lead to real problems getting hidden in a sea of reports.

I don't really understand how this can be a real problem to be honest. Anyone properly verifying a chip will be running tens of thousands of tests. No testing system I've ever used has required you to manually look through a list of pass/fails to find the failures. Maybe I'm misunderstanding you here though?

what is driving the desire to make the _b15 splits in line with the other test cases? Please help me understand why that is beneficial rather than overkill?

There are two reasons:

1. Total runtime. It's preferable to keep the total runtime of the tests under 10-20 minutes so we can run them in CI. We use test ranking to decide which tests to run in CI but if they take longer than this then they aren't eligible at all. We do have tests that run longer but given 15 second overhead it's nice if they are around ~10 minutes.
2. Memory use. Since we run thousands of jobs on a shared compute cluster, we reserve each job some memory. Currently 2 GB, but these jobs go over that limit during compilation (although only very slightly for the b01 tests).

I did some measurements and actually the b1 tests are only slightly over that 2GB limit so maybe it's not worth splitting those and we'll just increase our limit slightly. But I definitely wouldn't want anything bigger than that.

Here's some examples:

• Hello world: 1k instructions, 15s, max RSS 200 MB
• rv32i_m/D/fmul.d_b9-1 (the largest of the non-problematic tests): 38k instructions, 2m40s, max RSS 230 MB
• rv32i_m/D/fnmadd.d_b1-01: 253k instructions, 44m20s, max RSS 2.1 GB

[allenjbaum]

I'm missing something here. How is the test size being calculated? For fmul.d, 38k ops is ~5.5K tests, each test case is 8B/op * 7ops * ~5.5k tests = ~308KB (each tests is CSRW Fcsr, Flw Src1, Flw Src2, Mul, Fsw rd, CSRr Fcsr, stw Fcsr) 8B/op * 2Src * ~5.5k tests = ~88KB 8B/dst * 2dst * ~5.5 tests = ~88KB 18B /sig * 2sig * ~5.5 signature entries = ~198KB Total is 682KB How did that become 2GB, >150x larger?

…

On Tue, May 7, 2024 at 2:16 AM Tim Hutt ***@***.***> wrote: There's overhead launching each simulation job that has to balance against the parallelism of the jobs. I definitely agree! Our overhead for each job is only 15 seconds though (see below), which is very small compared to the actual runtime of the tests in our case. I haven't used ImperasDV but I have briefly used their reference model and we use it in a similar way to this diagram <https://www.imperas.com/sites/default/files/inline-images/ImperasDV_diagram_May_2023.jpg> but with a custom trace system. I don't remember it having a long startup time - just the normal time of running the RTL simulator which is pretty fast. A large number of splits also leads to a huge number of files in the riscv-arch-test repository and in the regression logs. That can make directories cumbersome and can lead to real problems getting hidden in a sea of reports. I don't really understand how this can be a real problem to be honest. Anyone properly verifying a chip will be running tens of thousands of tests. No testing system I've ever used has required you to manually look through a list of pass/fails to find the failures. Maybe I'm misunderstanding you here though? what is driving the desire to make the _b15 splits in line with the other test cases? Please help me understand why that is beneficial rather than overkill? There are two reasons: 1. Total runtime. It's preferable to keep the total runtime of the tests under 10-20 minutes so we can run them in CI. We use test ranking to decide which tests to run in CI but if they take longer than this then they aren't eligible at all. We do have tests that run longer but given 15 second overhead it's nice if they are around ~10 minutes. 2. Memory use. Since we run thousands of jobs on a shared compute cluster, we reserve each job some memory. Currently 2 GB, but these jobs go over that limit during compilation (although only very slightly for the b01 tests). I did some measurements and actually the b1 tests are only *slightly* over that 2GB limit so maybe it's not worth splitting those and we'll just increase our limit slightly. But I definitely wouldn't want anything bigger than that. Here's some examples: - Hello world: 1k instructions, 15s, max RSS 200 MB - rv32i_m/D/fmul.d_b9-1 (the largest of the non-problematic tests): 38k instructions, 2m40s, max RSS 230 MB - rv32i_m/D/fnmadd.d_b1-01: 253k instructions, 44m20s, max RSS 2.1 GB — Reply to this email directly, view it on GitHub <#461 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AHPXVJXR434QZKICHEXOAVLZBCLX3AVCNFSM6AAAAABG2WO6MSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOJXHAZTCMJYG4> . You are receiving this because you modified the open/close state.Message ID: ***@***.***>

[Timmmm]

2.1GB is the maximum memory usage when compiling, not the size of the test.

[allenjbaum]

Ok, thanks for the clarification - I thought that might be the case. For splitting up tests, though, we can't use RSS as a metric for splitting up tests; We can only use (#tests*test_size ) + (#data loads/tests) + (#signature stores/test) to estimate the amount of memory that will be used to run the test, and the amount of disk space of the stored signature.

…

On Wed, May 8, 2024 at 1:07 AM Tim Hutt ***@***.***> wrote: 2.1GB is the maximum memory usage when compiling, not the size of the test. — Reply to this email directly, view it on GitHub <#461 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AHPXVJULANJWX7POY7LA5L3ZBHML3AVCNFSM6AAAAABG2WO6MSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOJZHE4TGNRQGM> . You are receiving this because you modified the open/close state.Message ID: ***@***.***>

[Timmmm]

I think that's fine. I would expect that that is probably a pretty good proxy for memory use during compilation.

[davidharrishmc]

@Timmmm there is something funny going on for your memory requirements to scale with the length of the test. Is it possible that the testbench is logging too much history of state in RAM? I agree with Allen that even the biggest tests should add less than 1 MB of memory to model.

I accept your argument that full verification of a large system involves a large number of test files. However, splitting up riscv-arch-test in this way exploded the number of tests in this suite. I may be biased focusing on just riscv-arch-test, but I feel it's gotten out of hand. For example, when I go to

https://github.com/riscv-non-isa/riscv-arch-test/tree/main/riscv-test-suite/rv32i_m/F/src

I get a message

Sorry, we had to truncate this directory to 1,000 files. 334 entries were omitted from the list. Latest commit info may be omitted.

There's also some baggage related to the CORE-V Wally flow. Presently, we list each test set individually in a file, so this involves adding thousand of lines to the file. We print each set when it runs successfully, which had been dozens and becomes thousands in the logs. Debug occasionally involves scanning the logs, and this is more cumbersome when they explode in size. None of this is showstoppers, but it affects our viewpoint.

As a simple heuristic, how about splitting the _b15 tests into 10 files instead of 300, to get their runtime below _b1?

[allenjbaum]

So, we can have tests that are too big, or directories that are too big. One "simple" fix is probably to put each test that is broken up this way into its own subdirectory (and while we're at it, make the numbering be 3 digits with leading zeroes so it sorts correctly) I don't think there is any particular limit on directory levels in Riscof

…

On Thu, May 9, 2024 at 6:54 AM David Harris ***@***.***> wrote: @Timmmm <https://github.com/Timmmm> there is something funny going on for your memory requirements to scale with the length of the test. Is it possible that the testbench is logging too much history of state in RAM? I agree with Allen that even the biggest tests should add less than 1 MB of memory to model. I accept your argument that full verification of a large system involves a large number of test files. However, splitting up riscv-arch-test in this way exploded the number of tests in this suite. I may be biased focusing on just riscv-arch-test, but I feel it's gotten out of hand. For example, when I go to https://github.com/riscv-non-isa/riscv-arch-test/tree/main/riscv-test-suite/rv32i_m/F/src I get a message Sorry, we had to truncate this directory to 1,000 files. 334 entries were omitted from the list. Latest commit info may be omitted. There's also some baggage related to the CORE-V Wally flow. Presently, we list each test set individually in a file, so this involves adding thousand of lines to the file. We print each set when it runs successfully, which had been dozens and becomes thousands in the logs. Debug occasionally involves scanning the logs, and this is more cumbersome when they explode in size. None of this is showstoppers, but it affects our viewpoint. As a simple heuristic, how about splitting the _b15 tests into 10 files instead of 300, to get their runtime below _b1? — Reply to this email directly, view it on GitHub <#461 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AHPXVJUA6TGKTJDAZU3XJ3DZBN5ZXAVCNFSM6AAAAABG2WO6MSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBSG4YDSOBQGE> . You are receiving this because you modified the open/close state.Message ID: ***@***.***>

[Timmmm]

Is it possible that the testbench is logging too much history of state in RAM?

The 2.1 GB memory is when compiling the test. I.e. when running GCC to turn the assembly into an ELF file. Seems reasonable that that would scale with the size of the test.

Sorry, we had to truncate this directory

Yeah that is annoying to be fair.

[davidharrishmc]

fmadd.d_b15-01.S/ref/ref.elf is 15 MB. Something still seems funny that it would take 2 GB of memory to produce a 15 MB executable. Even the Sail log fmadd.d_b15-01.log is 365 MB.

I'm not disputing the hassle of this file being 10x longer to simulate than all the others, but I'm still postulating that a 10x split of _b15 might be sufficient, even if the tools have weird issues that consume excessive memory.

[allenjbaum]

I don't know what causes it, but I think I shouldn't have to care. I just need a rule of thumb for how big a test can be in terms of bytes of code, data, and signature - but it can't be in terms of the amount of memory the compilation needs unless that can be easily predicted from an examination of the source. Emphasis on "easily".

…

On Sat, May 11, 2024 at 7:34 PM David Harris ***@***.***> wrote: fmadd.d_b15-01.S/ref/ref.elf is 15 MB. Something still seems funny that it would take 2 GB of memory to produce a 15 MB executable. Even the Sail log fmadd.d_b15-01.log is 365 MB. I'm not disputing the hassle of this file being 10x longer to simulate than all the others, but I'm still postulating that a 10x split of _b15 might be sufficient, even if the tools have weird issues that consume excessive memory. — Reply to this email directly, view it on GitHub <#461 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AHPXVJW4TJZEQYQPEOEYRVLZB3ILZAVCNFSM6AAAAABG2WO6MSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGA4TKNJRGQ> . You are receiving this because you modified the open/close state.Message ID: ***@***.***>