Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KokkosCore_UnitTest_Cuda_MPI_1 failing in ATDM Trilinos 'waterman', 'ats2'/'vortex', 'ride', 'sems-rhel7' CUDA 'opt' builds starting 2020-02-04 #6799

Closed
bartlettroscoe opened this issue Feb 11, 2020 · 58 comments
Assignees
Labels
ATDM Sev: Nonblocker Problems with Trilinos that should not block ATDM APPs from getting updates client: ATDM Any issue primarily impacting the ATDM project impacting: tests The defect (bug) is primarily a test failure (vs. a build failure) PA: Data Services Issues that fall under the Trilinos Data Services Product Area pkg: Kokkos stage: in review Primary work is completed and now is just waiting for human review and/or test feedback type: bug The primary issue is a bug in Trilinos code or tests

Comments

@bartlettroscoe
Copy link
Member

bartlettroscoe commented Feb 11, 2020

CC: @trilinos/kokkos, @kddevin (Trilinos Data Services Product Lead)

Next Action Status

Unit tests cuda.debug_pin_um_to_host and cuda.debug_serial_execution are fragile and need to be rewritten (see kokkos/kokkos#2506). These two unit tests are disabled in all ATDM Trilinos CUDA PR builds in PR #7407 and has been merged to 'atdm-nightly' in commit 4804b08. Next: Waiting for confirmation on CDash that this test is passing and the unit tests are not running ATDM Trilinos CUDA builds starting testing day 2020-05-21 ...

Description

As shown in this query and this query the test:

  • KokkosCore_UnitTest_Cuda_MPI_1

in the builds:

  • Trilinos-atdm-waterman-cuda-9.2-opt
  • Trilinos-atdm-waterman_cuda-9.2_fpic_static_opt
  • Trilinos-atdm-waterman_cuda-9.2_shared_opt

started failing and timing out on 'waterman' on testing day 2020-02-04, which was the first day after the Kokkos 2.99 update.

As shown in this query, when the test does not timeout, it fails the unit test cuda.debug_pin_um_to_host showing:

[ RUN      ] cuda.debug_pin_um_to_host
Time CudaSpace: 0.059752 CudaUVMSpace_1: 0.626746 CudaUVMSpace_2: 0.797016 CudaPinnedHostSpace: 5.441882 CudaUVMSpace_Pinned: 1.407892
/home/jenkins/waterman/workspace/Trilinos-atdm-waterman-cuda-9.2-opt/SRC_AND_BUILD/Trilinos/packages/kokkos/core/unit_test/cuda/TestCuda_DebugPinUVMSpace.cpp:127: Failure
Value of: passed
  Actual: false
Expected: true
[  FAILED  ] cuda.debug_pin_um_to_host (9332 ms)

(That output gives zero clue why the test failed but at least it gives a line number.)

Current Status on CDash

Steps to Reproduce

One should be able to reproduce this failure on the machine 'waterman' as described in:

The specific commands given for the system 'waterman' are provided at:

The exact commands to reproduce this failing test, for the build Trilinos-atdm-waterman-cuda-9.2-opt, for example, should be:

$ cd <some_build_dir>/

$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh \
    Trilinos-atdm-waterman-cuda-9.2-opt

$ cmake \
  -GNinja \
  -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \
  -DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_ALL_PACKAGES=ON \
  $TRILINOS_DIR

$ make NP=20

$ bsub -x -Is -n 20 ctest -j 4
@bartlettroscoe bartlettroscoe added type: bug The primary issue is a bug in Trilinos code or tests pkg: Kokkos client: ATDM Any issue primarily impacting the ATDM project ATDM Sev: Blocker Problems that make Trilinos unfit to be adopted by one or more ATDM APPs PA: Data Services Issues that fall under the Trilinos Data Services Product Area labels Feb 11, 2020
@ndellingwood
Copy link
Contributor

@bartlettroscoe that test cuda.debug_pin_um_to_host makes a comparison of time results to determine a "pass" criteria but is fragile and I think needs to be revisited, can the tests cuda.debug_pin_um_to_host and cuda.debug_serial_execution be disabled in the ATDM builds until a better criterion is put in place for the test?
Cross-referencing kokkos/kokkos#2506

@bartlettroscoe bartlettroscoe added the impacting: tests The defect (bug) is primarily a test failure (vs. a build failure) label Feb 11, 2020
@bartlettroscoe
Copy link
Member Author

The test:

  • KokkosCore_UnitTest_Cuda_MPI_1

failed in the build:

  • Trilinos-atdm-waterman-cuda-9.2-release-debug

yesterday as shown here showing:

[ RUN      ] cuda.atomics
Loop<N10TestAtomic11SuperScalarILi4EEE>( test = 3 FAILED : { 4950, 9900, 14850, 19800} != { 4854, 9708, 14562, 19416}
/home/jenkins/waterman/workspace/Trilinos-atdm-waterman-cuda-9.2-release-debug/SRC_AND_BUILD/Trilinos/packages/kokkos/core/unit_test/TestAtomic.hpp:560: Failure
Value of: (TestAtomic::Loop<TestAtomic::SuperScalar<4>, TEST_EXECSPACE>(100, 3))
  Actual: false
Expected: true
[  FAILED  ] cuda.atomics (754 ms)

@ndellingwood, is this another timing problem? Should we expect to be seeing more random failures like this?

@ndellingwood
Copy link
Contributor

ndellingwood commented Feb 18, 2020

@bartlettroscoe I don't think that test (cuda.atomics) relies on timing data (I'll take a look to confirm), let me test your build as well as a kokkos-only version and check if there can be anything random about this failure, afterwards I'll file a bug report as necessary.

@ndellingwood
Copy link
Contributor

I did not reproduce failure of that test within a Kokkos VOTD develop branch nor Trilinos VOTD develop branch, and I see nothing in the test depending on unreliable pass/fail criteria that would cause randomness in results.

@crtrott can running multiple tests on a GPU using ctest -j N result in resource contention that might cause the atomics test to fail as posted above #6799 (comment) ?

@ndellingwood
Copy link
Contributor

I tried something simple to see if I could reproduce, launched a job on Waterman where I ran the test 10000 times in a Kokkos build and in a Trilinos build (using the ATDM environment configuration provided earlier) but saw no occurrences of the failure.

@bartlettroscoe
Copy link
Member Author

@ndellingwood, it may only occur when running it with all of the other tests. I have updated the instructions as such.

@bartlettroscoe
Copy link
Member Author

@ndellingwood, could this happen when multiple kernels are running on the same GPU at the same time?

@ndellingwood
Copy link
Contributor

could this happen when multiple kernels are running on the same GPU at the same time

@bartlettroscoe I'm not certain, not clear to me if this could impact the atomic operations or disrupt something in the test that's pounding the atomics
@crtrott any thoughts?

@bartlettroscoe
Copy link
Member Author

FYI: As shown in this query, there are more builds that show the error which include:

  • Trilinos-atdm-ats2-cuda-10.1.243-gnu-7.3.1-spmpi-2019.06.24_static_opt (vortex)
  • Trilinos-atdm-ats2-cuda-10.1.243-gnu-7.3.1-spmpi-2019.06.24_static_opt_cuda-aware-mpi (vortex)
  • Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug (ascigpu14)
  • Trilinos-atdm-waterman-cuda-9.2-opt (waterman)
  • Trilinos-atdm-waterman-cuda-9.2-release-debug (waterman)
  • Trilinos-atdm-waterman_cuda-9.2_fpic_static_opt (waterman)
  • Trilinos-atdm-waterman_cuda-9.2_shared_opt (waterman)

This is not a fluke.

Again, the error is in the unit test cuda.debug_pin_um_to_host and looks like:

[ RUN      ] cuda.debug_pin_um_to_host
Time CudaSpace: 0.052340 CudaUVMSpace_1: 0.052490 CudaUVMSpace_2: 0.049860 CudaPinnedHostSpace: 0.096996 CudaUVMSpace_Pinned: 0.052756
/vscratch1/jenkins/vortex-slave/workspace/Trilinos-atdm-ats2-cuda-10.1.243-gnu-7.3.1-spmpi-2019.06.24_static_opt-exp/SRC_AND_BUILD/Trilinos/packages/kokkos/core/unit_test/cuda/TestCuda_DebugPinUVMSpace.cpp:127: Failure
Value of: passed
  Actual: false
Expected: true
[  FAILED  ] cuda.debug_pin_um_to_host (378 ms)

@bartlettroscoe bartlettroscoe added ATDM Sev: Nonblocker Problems with Trilinos that should not block ATDM APPs from getting updates and removed ATDM Sev: Blocker Problems that make Trilinos unfit to be adopted by one or more ATDM APPs labels Feb 24, 2020
@bartlettroscoe
Copy link
Member Author

FYI: As shown in this query, we are also seeing failures in the unit test cuda.debug_serial_execution showing:

[ RUN      ] cuda.debug_serial_execution
Time For1: 0.001218 For2: 0.001222 ForSerial: 0.009890
/home/jenkins/ride/workspace/Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug/SRC_AND_BUILD/Trilinos/packages/kokkos/core/unit_test/cuda/TestCuda_DebugSerialExecution.cpp:140: Failure
Value of: passed_par_for
  Actual: false
Expected: true
[  FAILED  ] cuda.debug_serial_execution (48 ms)

with history:

Site Build Name Test Name Status Time Proc Time Details Build Time Processors
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_UnitTest_Cuda_MPI_1 Failed 1m 28s 520ms 1m 28s 520ms Completed (Failed) 2020-02-23T03:20:45 MST 1
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-debug KokkosCore_UnitTest_Cuda_MPI_1 Failed 4m 35s 770ms 4m 35s 770ms Completed (Failed) 2020-02-21T03:06:35 MST 1

@bartlettroscoe bartlettroscoe changed the title KokkosCore_UnitTest_Cuda_MPI_1 failing in ATDM Trilinos 'waterman' CUDA 'opt' builds starting 2020-02-04 KokkosCore_UnitTest_Cuda_MPI_1 failing in ATDM Trilinos 'waterman' and 'ats2'/'vortex' CUDA 'opt' builds starting 2020-02-04 Mar 15, 2020
@bartlettroscoe
Copy link
Member Author

FYI: As shown in this query and this query, this test:

  • KokkosCore_UnitTest_Cuda_MPI_1

is also now failing every testing day starting 2020-03-22 in the build:

  • Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release

showing the errors:

[ RUN      ] cuda.debug_serial_execution
Time Scan1: 0.023175 Scan2: 0.004769 ScanSerial: 0.023451
/home/jenkins/ride/workspace/Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release/SRC_AND_BUILD/Trilinos/packages/kokkos/core/unit_test/cuda/TestCuda_DebugSerialExecution.cpp:192: Failure
Value of: passed_par_scan
  Actual: false
Expected: true
[  FAILED  ] cuda.debug_serial_execution (235 ms)

and

[ RUN      ] cuda.debug_pin_um_to_host
Time CudaSpace: 0.063499 CudaUVMSpace_1: 0.279313 CudaUVMSpace_2: 0.077930 CudaPinnedHostSpace: 1.058533 CudaUVMSpace_Pinned: 0.077453
/home/jenkins/ride/workspace/Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release/SRC_AND_BUILD/Trilinos/packages/kokkos/core/unit_test/cuda/TestCuda_DebugPinUVMSpace.cpp:127: Failure
Value of: passed
  Actual: false
Expected: true
[  FAILED  ] cuda.debug_pin_um_to_host (1637 ms)

@bartlettroscoe bartlettroscoe changed the title KokkosCore_UnitTest_Cuda_MPI_1 failing in ATDM Trilinos 'waterman' and 'ats2'/'vortex' CUDA 'opt' builds starting 2020-02-04 KokkosCore_UnitTest_Cuda_MPI_1 failing in ATDM Trilinos 'waterman' and 'ats2'/'vortex' and 'ride' CUDA 'opt' builds starting 2020-02-04 Mar 25, 2020
@bartlettroscoe
Copy link
Member Author

@bartlettroscoe that test cuda.debug_pin_um_to_host makes a comparison of time results to determine a "pass" criteria but is fragile and I think needs to be revisited, can the tests cuda.debug_pin_um_to_host and cuda.debug_serial_execution be disabled in the ATDM builds until a better criterion is put in place for the test?

@ndellingwood, sorry I missed this comment of yours from before.

Yes, we can disable just those unit tests for just the ATDM Trilinos builds (or just the CUDA builds) as described in:

I think we likely just want to disable these for all ATDM Trilinos CUDA builds? IF that is the case, the instructions for doing that are in:

and use the CMake cache var <full_test_name>_EXTRA_ARGS. See examples of this in:

$ cd Trilinos/

$ find cmake/std/atdm/ -name "*.cmake" -exec grep -nH "_EXTRA_ARGS" {} \;
cmake/std/atdm/ride/tweaks/CUDA-10.0_GNU-7.4.0_DEBUG_CUDA_POWER8_KEPLER37.cmake:5:ATDM_SET_CACHE(KokkosKernels_sparse_serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/ride/tweaks/CUDA-9.2_GNU-7.2.0_DEBUG_CUDA_POWER8_KEPLER37.cmake:5:ATDM_SET_CACHE(KokkosContainers_UnitTest_Serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/ride/tweaks/CUDA-9.2_GNU-7.2.0_DEBUG_CUDA_POWER8_KEPLER37.cmake:8:ATDM_SET_CACHE(KokkosKernels_graph_serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/ride/tweaks/CUDA-9.2_GNU-7.2.0_DEBUG_CUDA_POWER8_KEPLER37.cmake:11:ATDM_SET_CACHE(KokkosKernels_sparse_serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/ride/tweaks/GNU-7.2.0_DEBUG_OPENMP_POWER8.cmake:8:ATDM_SET_CACHE(KokkosContainers_UnitTest_Serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/ride/tweaks/GNU-7.2.0_DEBUG_OPENMP_POWER8.cmake:11:ATDM_SET_CACHE(KokkosContainers_UnitTest_OpenMP_MPI_1_EXTRA_ARGS
cmake/std/atdm/ride/tweaks/GNU-7.2.0_DEBUG_OPENMP_POWER8.cmake:14:ATDM_SET_CACHE(KokkosKernels_graph_serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/ride/tweaks/GNU-7.2.0_DEBUG_OPENMP_POWER8.cmake:17:ATDM_SET_CACHE(KokkosKernels_sparse_openmp_MPI_1_EXTRA_ARGS
cmake/std/atdm/ride/tweaks/GNU-7.2.0_DEBUG_OPENMP_POWER8.cmake:20:ATDM_SET_CACHE(KokkosKernels_sparse_serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/ride/tweaks/GNU-7.4.0_DEBUG_OPENMP_POWER8.cmake:5:ATDM_SET_CACHE(KokkosKernels_sparse_serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/shiller/tweaks/GNU_DEBUG_SERIAL_HSW.cmake:5:ATDM_SET_CACHE(KokkosKernels_sparse_serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/shiller/tweaks/CUDA-9.0_DEBUG_CUDA_KEPLER37.cmake:2:ATDM_SET_CACHE(KokkosKernels_sparse_serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/shiller/tweaks/INTEL_DEBUG_OPENMP_HSW.cmake:2:ATDM_SET_CACHE(KokkosKernels_sparse_serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/shiller/tweaks/INTEL_DEBUG_SERIAL_HSW.cmake:4:ATDM_SET_CACHE(KokkosKernels_sparse_serial_MPI_1_EXTRA_ARGS
cmake/std/atdm/waterman/tweaks/CUDA-9.2_DEBUG_CUDA_POWER9_VOLTA70.cmake:8:ATDM_SET_CACHE(KokkosKernels_sparse_serial_MPI_1_EXTRA_ARGS

But I think you want to put this in the file:

  • Trilinos/cmake/std/atdm/ATDMDisables.cmake

in the if block for CUDA builds and just disable these unit tests in all CUDA builds

@bartlettroscoe
Copy link
Member Author

FYI: As shown here, we also saw this test:

  • KokkosCore_UnitTest_Cuda_MPI_1

failing today 2020-03-25 in the build:

  • Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug

showing:

[ RUN      ] cuda.debug_pin_um_to_host
Time CudaSpace: 0.035394 CudaUVMSpace_1: 0.080651 CudaUVMSpace_2: 0.100436 CudaPinnedHostSpace: 0.555502 CudaUVMSpace_Pinned: 0.094931
/scratch/jenkins/ascicgpu14/workspace/Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug/SRC_AND_BUILD/Trilinos/packages/kokkos/core/unit_test/cuda/TestCuda_DebugPinUVMSpace.cpp:127: Failure
Value of: passed
  Actual: false
Expected: true
[  FAILED  ] cuda.debug_pin_um_to_host (999 ms)

That suggests that these unit tests should be disabled in all of that ATDM Trilinos CUDA builds for the time being.

@ndellingwood, do you just want me to do this and create the PR and have you review it?

@ndellingwood
Copy link
Contributor

do you just want me to do this and create the PR and have you review it

@bartlettroscoe that would be great thanks, I pinged the corresponding kokkos issue as well with your comment.

@bartlettroscoe bartlettroscoe self-assigned this Mar 25, 2020
@bartlettroscoe
Copy link
Member Author

bartlettroscoe commented Mar 25, 2020

@ndellingwood, okay, I assigned this issue to myself for now and will work to get these unit tests disabled.

@ndellingwood
Copy link
Contributor

Nathan can you move all the relevant tests which use this timing stuff to Cuda3?

@crtrott yes, I can group the tests together, and if you like I'll place them in a new test with a descriptive name like @bartlettroscoe mentioned

@ndellingwood
Copy link
Contributor

I opened kokkos/kokkos#3405 and self-assigned with the request to group these time-based tests into a common executable

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-09-27

Tests with issue trackers Passed: twip=7

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=7

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 9 4 26 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 4 5 25 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 9 3 27 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 3 2 28 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 12 1 23 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 12 1 28 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 11 1 29 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-10-04

Tests with issue trackers Passed: twip=6

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=6

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 16 4 26 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 2 5 25 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 5 4 26 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 1 4 26 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 19 1 28 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 18 1 29 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-10-11

Tests with issue trackers Passed: twip=6
Tests with issue trackers Failed: twif=1

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=6

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 4 3 27 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 9 5 25 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 8 3 27 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 5 2 23 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 26 1 28 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 25 1 29 #6799

Tests with issue trackers Failed: twif=1

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Failed Completed (Failed) 1 5 25 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-10-18

Tests with issue trackers Passed: twip=7

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=7

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 11 1 29 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 2 4 26 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 7 4 26 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 15 3 27 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 12 1 26 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 30 0 30 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 30 0 30 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-10-25

Tests with issue trackers Passed: twip=6
Tests with issue trackers Failed: twif=1

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=6

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 9 2 28 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 14 4 26 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 22 2 28 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 6 2 26 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 28 0 28 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 28 0 28 #6799

Tests with issue trackers Failed: twif=1

Site Build Name Test Name Status Details Consec­utive Non-pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Failed Completed (Failed) 1 2 28 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-11-01

Tests with issue trackers Passed: twip=6
Tests with issue trackers Missing: twim=1

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=6

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 7 2 28 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 4 3 27 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 3 2 28 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 13 2 26 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 28 0 28 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 28 0 28 #6799

Tests with issue trackers Missing: twim=1

Site Build Name Test Name Status Details Consec­utive Missing Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Missing Missing -1 1 30 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-11-08

Tests with issue trackers Passed: twip=7

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=7

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 14 1 29 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 23 1 29 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 2 3 27 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 10 1 29 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 5 2 28 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 25 0 25 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 27 0 27 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-11-15

Tests with issue trackers Passed: twip=7

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=7

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 21 1 29 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 5 1 29 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 9 2 28 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 1 3 27 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 12 2 28 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 2 3 22 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 3 2 25 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-11-22

Tests with issue trackers Passed: twip=7

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=7

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 28 1 29 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 1 4 26 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 6 3 27 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 8 3 27 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 19 1 29 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 8 3 23 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 9 2 26 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-11-29

Tests with issue trackers Passed: twip=7

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=7

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 30 0 30 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 8 4 26 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 13 2 28 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 15 2 28 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 26 1 29 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 15 3 23 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 16 2 26 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-12-06

Tests with issue trackers Passed: twip=7

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=7

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 30 0 30 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 15 4 26 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 20 1 29 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 22 2 28 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 30 0 30 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 22 3 25 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 23 2 27 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-12-13

Tests with issue trackers Passed: twip=7

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=7

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 30 0 30 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 22 3 27 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 27 1 29 #6799
cee-rhel6 Trilinos-atdm-cee-rhel6_­mini_­cuda-10.1.243_­gcc-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 29 1 29 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 30 0 30 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 27 0 27 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 27 0 27 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-12-21

Tests with issue trackers Passed: twip=2

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=2

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 28 0 28 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 28 0 28 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2020-12-27

Tests with issue trackers Passed: twip=2

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=2

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 28 0 28 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 28 0 28 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2021-01-10

Tests with issue trackers Passed: twip=7

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=7

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel7 Trilinos-atdm-cee-rhel7_­cuda-10.1.243_­gnu-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 5 0 5 #6799
cee-rhel7 Trilinos-atdm-cee-rhel7_­cuda-10.1.243_­gnu-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 5 0 5 #6799
cee-rhel7 Trilinos-atdm-cee-rhel7_­mini_­cuda-10.1.243_­gnu-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 5 0 5 #6799
cee-rhel7 Trilinos-atdm-cee-rhel7_­mini_­cuda-10.1.243_­gnu-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 5 0 5 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 10 0 10 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 24 0 24 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 24 0 24 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@grover-trilinos
Copy link

Test results for issue #6799 as of 2021-01-17

Tests with issue trackers Passed: twip=7

Detailed test results: (click to expand)

Tests with issue trackers Passed: twip=7

Site Build Name Test Name Status Details Consec­utive Pass Days Non-pass Last 30 Days Pass Last 30 Days Issue Tracker
cee-rhel7 Trilinos-atdm-cee-rhel7_­cuda-10.1.243_­gnu-7.2.0_­openmpi-4.0.3_­shared_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 12 0 12 #6799
cee-rhel7 Trilinos-atdm-cee-rhel7_­cuda-10.1.243_­gnu-7.2.0_­openmpi-4.0.3_­shared_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 12 0 12 #6799
cee-rhel7 Trilinos-atdm-cee-rhel7_­mini_­cuda-10.1.243_­gnu-7.2.0_­openmpi-4.0.3_­static_­dbg KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 12 0 12 #6799
cee-rhel7 Trilinos-atdm-cee-rhel7_­mini_­cuda-10.1.243_­gnu-7.2.0_­openmpi-4.0.3_­static_­opt KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 12 0 12 #6799
sems-rhel7 Trilinos-atdm-sems-rhel7-cuda-9.2-Volta70-complex-shared-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 13 0 13 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release-debug KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 24 0 24 #6799
ride Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-release KokkosCore_­UnitTest_­Cuda3_­MPI_­1 Passed Completed 24 0 24 #6799

This is an automated comment generated by Grover. Each week, Grover collates and reports data from CDash in an automated way to make it easier for developers to stay on top of their issues. Grover saw that there are tests being tracked on CDash that are associated with this open issue. If you have a question, please reach out to Ross. I'm just a cat.

@crtrott
Copy link
Member

crtrott commented Jan 22, 2021

Shouldn't this be closed? I mean this has been passing all the time now or?

@crtrott
Copy link
Member

crtrott commented Jan 22, 2021

Basically it looks like this was fixed in Kokkos 3.2.01

@e10harvey
Copy link
Contributor

Closing since grover posted more than two consecutive comments showing this test as passing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ATDM Sev: Nonblocker Problems with Trilinos that should not block ATDM APPs from getting updates client: ATDM Any issue primarily impacting the ATDM project impacting: tests The defect (bug) is primarily a test failure (vs. a build failure) PA: Data Services Issues that fall under the Trilinos Data Services Product Area pkg: Kokkos stage: in review Primary work is completed and now is just waiting for human review and/or test feedback type: bug The primary issue is a bug in Trilinos code or tests
Projects
None yet
Development

No branches or pull requests

5 participants