Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Additional RT log information #941

Merged
merged 10 commits into from
May 1, 2024
Merged

Additional RT log information #941

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
e17e5cc
additional log info
FernandoAndrade-NOAA Apr 25, 2024
5ffd8e0
Update rt.sh
FernandoAndrade-NOAA Apr 25, 2024
16e0934
Merge branch 'NOAA-EMC:develop' into feature/add-log-info
FernandoAndrade-NOAA Apr 28, 2024
1177ae8
Update rt.sh
FernandoAndrade-NOAA Apr 28, 2024
8062620
Merge branch 'develop' into feature/add-log-info
WenMeng-NOAA Apr 30, 2024
422a6e0
hera RT pass
FernandoAndrade-NOAA May 1, 2024
83792dd
Merge branch 'develop' into feature/add-log-info
WenMeng-NOAA May 1, 2024
61edb5a
orion RT pass
FernandoAndrade-NOAA May 1, 2024
e30d245
orion submodule hash fix
FernandoAndrade-NOAA May 1, 2024
0d0f7a9
hercules RT pass
FernandoAndrade-NOAA May 1, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
35 changes: 31 additions & 4 deletions ci/rt.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,11 @@
# Wen Meng, 12/2020, First version.
# Fernando Andrade-Maldonado 5/2023 rework for CLI Options
# Fernando Andrade-Maldonado / Wen Meng 9/2023 Add Hercules, fix typos, and refactor
#
# Fernando Andrade-Maldonado 4/2024 Additional Log info
######################################################################

SECONDS=0

git_branch="develop"
git_url="https://github.com/NOAA-EMC/UPP.git"
clone_on="no"
Expand Down Expand Up @@ -236,17 +238,42 @@ for job_id in $jobid_list; do
fi
done

elapsed_time=$( printf '%02dh:%02dm:%02ds\n' $((SECONDS%86400/3600)) $((SECONDS%3600/60)) $((SECONDS%60)) )

python ${test_v}/ci/rt-status.py
test_results=$?

# Cleanup rt log
cd ${test_v}

UPP_HASH=$(git rev-parse HEAD)
SUBMODULE_HASHES=$(git submodule status --recursive)
DATE="$(date '+%Y%m%d %T')"

cd ${test_v}/ci
echo "rundir: ${rundir}" > rt.log.${machine}.temp

cat << EOF > rt.log.${machine}.temp
===== Start of UPP Regression Testing Log =====
UPP Hash Tested:
${UPP_HASH}

Submodule hashes:
${SUBMODULE_HASHES}

Run directory: ${rundir}
Baseline directory: ${homedir}

Total runtime: ${elapsed_time}
Test Date: ${DATE}
Summary Results:

EOF

cat rt.log.${machine} | grep "test:" >> rt.log.${machine}.temp
cat rt.log.${machine} | grep "baseline" >> rt.log.${machine}.temp
python ${test_v}/ci/rt-status.py >> rt.log.${machine}.temp
cat rt.log.${machine}.temp > rt.log.${machine}
rm rt.log.${machine}.temp
echo "===== End of UPP Regression Testing Log =====" >> rt.log.${machine}.temp
mv rt.log.${machine}.temp rt.log.${machine}
mv rt.log.${machine} ${test_v}/tests/logs

# should indicate failure to Jenkins
Expand Down
122 changes: 69 additions & 53 deletions tests/logs/rt.log.HERA
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,53 +1,69 @@
rundir: /scratch2/NAGAPE/epic/Fernando.Andrade-maldonado/regression-tests/upp/780/UPP/ci/rundir-upp-HERA
10/13 06:21:38Z -hrrr pe test: your new post executable generates bit-identical WRFTWO.GrbF04 as the trunk
10/13 06:21:40Z -hrrr pe test: your new post executable generates bit-identical WRFPRS.GrbF04 as the trunk
10/13 06:21:42Z -hrrr pe test: your new post executable generates bit-identical WRFNAT.GrbF04 as the trunk
10/13 06:21:48Z -fv3gefs test: your new post executable generates bit-identical geaer.t00z.master.grb2f060 as the trunk
10/13 06:22:09Z -fv3r test: your new post executable generates bit-identical PRSLEV10.tm00 as the trunk
10/13 06:22:14Z -rtma pe test: your new post executable generates bit-identical NATLEV00.tm00 as the trunk
10/13 06:22:16Z -fv3r test: your new post executable generates bit-identical NATLEV10.tm00 as the trunk
10/13 06:22:20Z -rtma pe test: your new post executable generates bit-identical PRSLEV00.tm00 as the trunk
10/13 06:22:20Z -rtma pe test: your new post executable generates bit-identical IFIFIP00.tm00 as the trunk
10/13 06:22:36Z -hrrr test: your new post executable generates bit-identical WRFTWO.GrbF04 as the trunk
10/13 06:22:38Z -hrrr test: your new post executable generates bit-identical WRFPRS.GrbF04 as the trunk
10/13 06:22:40Z -hrrr test: your new post executable generates bit-identical WRFNAT.GrbF04 as the trunk
10/13 06:22:45Z -fv3gefs pe test: your new post executable generates bit-identical geaer.t00z.master.grb2f060 as the trunk
10/13 06:22:57Z -fv3hafs test: your new post executable generates bit-identical HURPRS09.tm00 as the trunk
10/13 06:23:09Z -fv3hafs pe test: your new post executable generates bit-identical HURPRS09.tm00 as the trunk
10/13 06:23:26Z -rap test: your new post executable generates bit-identical WRFPRS.GrbF16 as the trunk
10/13 06:23:27Z -rap test: your new post executable generates bit-identical WRFNAT.GrbF16 as the trunk
10/13 06:23:43Z -nmmb pe test: your new post executable generates bit-identical BGDAWP03.tm00.Grib2 as the trunk
10/13 06:23:43Z -rap pe test: your new post executable did generate changed results in WRFPRS.GrbF16
10/13 06:23:45Z -rap pe test: your new post executable generates bit-identical WRFNAT.GrbF16 as the trunk
10/13 06:23:45Z -nmmb pe test: your new post executable generates bit-identical BGRD3D03.tm00.Grib2 as the trunk
10/13 06:23:45Z -nmmb pe test: your new post executable generates bit-identical BGRDSF03.tm00.Grib2 as the trunk
10/13 06:23:48Z -nmmb test: your new post executable generates bit-identical BGDAWP03.tm00.Grib2 as the trunk
10/13 06:23:49Z -nmmb test: your new post executable generates bit-identical BGRD3D03.tm00.Grib2 as the trunk
10/13 06:23:49Z -nmmb test: your new post executable generates bit-identical BGRDSF03.tm00.Grib2 as the trunk
10/13 06:24:00Z -fv3r pe test: your new post executable generates bit-identical PRSLEV10.tm00 as the trunk
10/13 06:24:05Z -fv3r pe test: your new post executable generates bit-identical NATLEV10.tm00 as the trunk
10/13 06:24:09Z -rtma test: your new post executable generates bit-identical NATLEV00.tm00 as the trunk
10/13 06:24:13Z -rtma test: your new post executable generates bit-identical PRSLEV00.tm00 as the trunk
10/13 06:24:13Z -rtma test: your new post executable generates bit-identical IFIFIP00.tm00 as the trunk
10/13 06:31:06Z gfs_post_00.127117-fv3gfs test: your new post executable generates bit-identical gfs.t00z.master.grb2f006 as the trunk
10/13 06:31:07Z gfs_post_00.127117-fv3gfs test: your new post executable generates bit-identical gfs.t00z.sfluxgrbf006.grib2 as the trunk
10/13 06:31:07Z gfs_post_00.127117-fv3gfs test: your new post executable generates bit-identical gfs.t00z.special.grb2f006 as the trunk
10/13 06:31:45Z gfs_post_00.104523-fv3gfs pe test: your new post executable generates bit-identical gfs.t00z.master.grb2f006 as the trunk
10/13 06:31:46Z gfs_post_00.104523-fv3gfs pe test: your new post executable generates bit-identical gfs.t00z.sfluxgrbf006.grib2 as the trunk
10/13 06:31:46Z gfs_post_00.104523-fv3gfs pe test: your new post executable generates bit-identical gfs.t00z.special.grb2f006 as the trunk
10/13 06:24:01Z -Runtime: nmmb_test 00:01:17 -- baseline 00:01:00
10/13 06:24:01Z -Runtime: nmmb_pe_test 00:01:12 -- baseline 00:01:00
10/13 06:24:01Z -Runtime: fv3gefs_test 00:00:22 -- baseline 00:40:00
10/13 06:24:02Z -Runtime: fv3gefs_pe_test 00:00:24 -- baseline 00:40:00
10/13 06:24:02Z -Runtime: rap_test 00:01:04 -- baseline 00:02:00
10/13 06:24:02Z -Runtime: rap_pe_test 00:01:12 -- baseline 00:02:00
10/13 06:24:03Z -Runtime: hrrr_test 00:02:16 -- baseline 00:02:00
10/13 06:24:03Z -Runtime: hrrr_pe_test 00:02:18 -- baseline 00:02:00
10/13 06:31:22Z -Runtime: fv3gfs_test 00:12:09 -- baseline 00:15:00
10/13 06:31:52Z -Runtime: fv3gfs_pe_test 00:12:47 -- baseline 00:15:00
10/13 06:31:53Z -Runtime: fv3r_test 00:01:51 -- baseline 00:03:00
10/13 06:31:53Z -Runtime: fv3r_pe_test 00:01:51 -- baseline 00:03:00
10/13 06:31:53Z -Runtime: fv3hafs_test 00:00:39 -- baseline 00:03:00
10/13 06:31:54Z -Runtime: fv3hafs_pe_test 00:00:41 -- baseline 00:03:00
10/13 06:31:54Z -Runtime: rtma_test 00:01:59 -- baseline 00:03:00
10/13 06:31:54Z -Runtime: rtma_test_pe_test 00:01:56 -- baseline
===== Start of UPP Regression Testing Log =====
UPP Hash Tested:
80626206f72dc6051afa502a10d27691308aea3c

Submodule hashes:
-1ba8270870947b583cd51bc72ff8960f4c1fb36e ../sorc/libIFI.fd
-7476b8f2790a47d788f79cebfdbb551567ae7cf8 ../sorc/ncep_post.fd/post_gtg.fd

Run directory: /scratch2/NAGAPE/epic/Fernando.Andrade-maldonado/regression-tests/upp/941/UPP/ci/rundir/upp-HERA
Baseline directory: /scratch2/NAGAPE/epic/UPP/test_suite

Total runtime: 00h:15m:36s
Test Date: 20240501 16:11:45
Summary Results:

05/01 16:09:05Z -fv3gefs pe test: your new post executable generates bit-identical geaer.t00z.master.grb2f060 as the trunk
05/01 16:09:07Z -fv3gefs test: your new post executable generates bit-identical geaer.t00z.master.grb2f060 as the trunk
05/01 16:09:21Z -fv3hafs test: your new post executable generates bit-identical HURPRS09.tm00 as the trunk
05/01 16:09:27Z -fv3hafs pe test: your new post executable generates bit-identical HURPRS09.tm00 as the trunk
05/01 16:09:53Z -rap test: your new post executable generates bit-identical WRFPRS.GrbF16 as the trunk
05/01 16:09:54Z -rap test: your new post executable generates bit-identical WRFNAT.GrbF16 as the trunk
05/01 16:10:04Z -nmmb pe test: your new post executable generates bit-identical BGDAWP03.tm00.Grib2 as the trunk
05/01 16:10:06Z -nmmb pe test: your new post executable generates bit-identical BGRD3D03.tm00.Grib2 as the trunk
05/01 16:10:07Z -nmmb pe test: your new post executable generates bit-identical BGRDSF03.tm00.Grib2 as the trunk
05/01 16:10:09Z -nmmb test: your new post executable generates bit-identical BGDAWP03.tm00.Grib2 as the trunk
05/01 16:10:11Z -rap pe test: your new post executable did generate changed results in WRFPRS.GrbF16
05/01 16:10:11Z -nmmb test: your new post executable generates bit-identical BGRD3D03.tm00.Grib2 as the trunk
05/01 16:10:12Z -nmmb test: your new post executable generates bit-identical BGRDSF03.tm00.Grib2 as the trunk
05/01 16:10:12Z -rap pe test: your new post executable generates bit-identical WRFNAT.GrbF16 as the trunk
05/01 16:10:17Z -fv3r test: your new post executable generates bit-identical PRSLEV10.tm00 as the trunk
05/01 16:10:20Z -rtma pe test: your new post executable generates bit-identical NATLEV00.tm00 as the trunk
05/01 16:10:22Z -fv3r test: your new post executable generates bit-identical NATLEV10.tm00 as the trunk
05/01 16:10:24Z -fv3r pe test: your new post executable generates bit-identical PRSLEV10.tm00 as the trunk
05/01 16:10:24Z -rtma test: your new post executable generates bit-identical NATLEV00.tm00 as the trunk
05/01 16:10:25Z -rtma pe test: your new post executable generates bit-identical PRSLEV00.tm00 as the trunk
05/01 16:10:25Z -rtma pe test: your new post executable generates bit-identical IFIFIP00.tm00 as the trunk
05/01 16:10:29Z -fv3r pe test: your new post executable generates bit-identical NATLEV10.tm00 as the trunk
05/01 16:10:29Z -rtma test: your new post executable generates bit-identical PRSLEV00.tm00 as the trunk
05/01 16:10:29Z -rtma test: your new post executable generates bit-identical IFIFIP00.tm00 as the trunk
05/01 16:10:49Z -hrrr pe test: your new post executable generates bit-identical WRFTWO.GrbF04 as the trunk
05/01 16:10:50Z -hrrr pe test: your new post executable generates bit-identical WRFPRS.GrbF04 as the trunk
05/01 16:10:53Z -hrrr pe test: your new post executable generates bit-identical WRFNAT.GrbF04 as the trunk
05/01 16:10:59Z gfs_post_00.1144644-fv3gfs test: your new post executable generates bit-identical gfs.t00z.master.grb2f006 as the trunk
05/01 16:10:59Z gfs_post_00.1144644-fv3gfs test: your new post executable generates bit-identical gfs.t00z.sfluxgrbf006.grib2 as the trunk
05/01 16:11:00Z gfs_post_00.1144644-fv3gfs test: your new post executable generates bit-identical gfs.t00z.special.grb2f006 as the trunk
05/01 16:11:11Z -hrrr test: your new post executable generates bit-identical WRFTWO.GrbF04 as the trunk
05/01 16:11:12Z -hrrr test: your new post executable generates bit-identical WRFPRS.GrbF04 as the trunk
05/01 16:11:14Z -hrrr test: your new post executable generates bit-identical WRFNAT.GrbF04 as the trunk
05/01 16:11:34Z gfs_post_00.3917834-fv3gfs pe test: your new post executable generates bit-identical gfs.t00z.master.grb2f006 as the trunk
05/01 16:11:34Z gfs_post_00.3917834-fv3gfs pe test: your new post executable generates bit-identical gfs.t00z.sfluxgrbf006.grib2 as the trunk
05/01 16:11:35Z gfs_post_00.3917834-fv3gfs pe test: your new post executable generates bit-identical gfs.t00z.special.grb2f006 as the trunk
05/01 16:10:24Z -Runtime: nmmb_test 00:01:17 -- baseline 00:01:00
05/01 16:10:24Z -Runtime: nmmb_pe_test 00:01:12 -- baseline 00:01:00
05/01 16:10:25Z -Runtime: fv3gefs_test 00:00:17 -- baseline 00:40:00
05/01 16:10:25Z -Runtime: fv3gefs_pe_test 00:00:22 -- baseline 00:40:00
05/01 16:10:25Z -Runtime: rap_test 00:01:07 -- baseline 00:02:00
05/01 16:10:26Z -Runtime: rap_pe_test 00:01:22 -- baseline 00:02:00
05/01 16:11:26Z -Runtime: hrrr_test 00:02:27 -- baseline 00:02:00
05/01 16:11:27Z -Runtime: hrrr_pe_test 00:02:10 -- baseline 00:02:00
05/01 16:11:27Z -Runtime: fv3gfs_test 00:11:37 -- baseline 00:15:00
05/01 16:11:43Z -Runtime: fv3gfs_pe_test 00:12:12 -- baseline 00:15:00
05/01 16:11:43Z -Runtime: fv3r_test 00:01:43 -- baseline 00:03:00
05/01 16:11:43Z -Runtime: fv3r_pe_test 00:01:46 -- baseline 00:03:00
05/01 16:11:44Z -Runtime: fv3hafs_test 00:00:38 -- baseline 00:03:00
05/01 16:11:44Z -Runtime: fv3hafs_pe_test 00:00:37 -- baseline 00:03:00
05/01 16:11:44Z -Runtime: rtma_test 00:01:50 -- baseline 00:03:00
05/01 16:11:45Z -Runtime: rtma_test_pe_test 00:01:50 -- baseline
No changes in test results detected.
===== End of UPP Regression Testing Log =====
69 changes: 69 additions & 0 deletions tests/logs/rt.log.HERCULES
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
===== Start of UPP Regression Testing Log =====
UPP Hash Tested:
83792dd6842a841262e012e230024a7a261d018d

Submodule hashes:
-1ba8270870947b583cd51bc72ff8960f4c1fb36e ../sorc/libIFI.fd
-7476b8f2790a47d788f79cebfdbb551567ae7cf8 ../sorc/ncep_post.fd/post_gtg.fd

Run directory: /work2/noaa/epic/nandoam/regression-testing/upp/hercules/941/UPP/ci/rundir/upp-HERCULES
Baseline directory: /work/noaa/epic/UPP

Total runtime: 00h:26m:55s
Test Date: 20240501 15:19:33
Summary Results:

05/01 19:58:27Z -nmmb pe test: your new post executable generates bit-identical BGDAWP03.tm00.Grib2 as the trunk
05/01 19:58:28Z -nmmb pe test: your new post executable generates bit-identical BGRD3D03.tm00.Grib2 as the trunk
05/01 19:58:28Z -nmmb pe test: your new post executable generates bit-identical BGRDSF03.tm00.Grib2 as the trunk
05/01 19:58:35Z -nmmb test: your new post executable generates bit-identical BGDAWP03.tm00.Grib2 as the trunk
05/01 19:58:36Z -nmmb test: your new post executable generates bit-identical BGRD3D03.tm00.Grib2 as the trunk
05/01 19:58:36Z -nmmb test: your new post executable generates bit-identical BGRDSF03.tm00.Grib2 as the trunk
05/01 19:59:15Z -fv3gefs test: your new post executable generates bit-identical geaer.t00z.master.grb2f060 as the trunk
05/01 19:59:22Z -fv3gefs pe test: your new post executable generates bit-identical geaer.t00z.master.grb2f060 as the trunk
05/01 19:59:50Z -rap test: your new post executable generates bit-identical WRFPRS.GrbF16 as the trunk
05/01 19:59:51Z -rap test: your new post executable generates bit-identical WRFNAT.GrbF16 as the trunk
05/01 19:59:54Z -rap pe test: your new post executable did generate changed results in WRFPRS.GrbF16
05/01 19:59:54Z -rap pe test: your new post executable generates bit-identical WRFNAT.GrbF16 as the trunk
05/01 20:00:44Z -hrrr pe test: your new post executable generates bit-identical WRFTWO.GrbF04 as the trunk
05/01 20:00:44Z -fv3r test: your new post executable generates bit-identical PRSLEV10.tm00 as the trunk
05/01 20:00:45Z -hrrr pe test: your new post executable generates bit-identical WRFPRS.GrbF04 as the trunk
05/01 20:00:46Z -hrrr pe test: your new post executable generates bit-identical WRFNAT.GrbF04 as the trunk
05/01 20:00:47Z -fv3r test: your new post executable generates bit-identical NATLEV10.tm00 as the trunk
05/01 20:00:57Z -fv3r pe test: your new post executable generates bit-identical PRSLEV10.tm00 as the trunk
05/01 20:00:59Z -fv3r pe test: your new post executable generates bit-identical NATLEV10.tm00 as the trunk
05/01 20:01:21Z -rtma pe test: your new post executable generates bit-identical NATLEV00.tm00 as the trunk
05/01 20:01:22Z -rtma test: your new post executable generates bit-identical NATLEV00.tm00 as the trunk
05/01 20:01:23Z -rtma pe test: your new post executable generates bit-identical PRSLEV00.tm00 as the trunk
05/01 20:01:24Z -rtma test: your new post executable generates bit-identical PRSLEV00.tm00 as the trunk
05/01 20:01:24Z -rtma pe test: your new post executable generates bit-identical IFIFIP00.tm00 as the trunk
05/01 20:01:24Z -rtma test: your new post executable generates bit-identical IFIFIP00.tm00 as the trunk
05/01 20:02:07Z -fv3hafs pe test: your new post executable generates bit-identical HURPRS09.tm00 as the trunk
05/01 20:02:08Z -fv3hafs test: your new post executable generates bit-identical HURPRS09.tm00 as the trunk
05/01 20:05:02Z -hrrr test: your new post executable generates bit-identical WRFTWO.GrbF04 as the trunk
05/01 20:05:03Z -hrrr test: your new post executable generates bit-identical WRFPRS.GrbF04 as the trunk
05/01 20:05:04Z -hrrr test: your new post executable generates bit-identical WRFNAT.GrbF04 as the trunk
05/01 20:14:46Z gfs_post_00.896623-fv3gfs pe test: your new post executable generates bit-identical gfs.t00z.master.grb2f006 as the trunk
05/01 20:14:47Z gfs_post_00.896623-fv3gfs pe test: your new post executable generates bit-identical gfs.t00z.sfluxgrbf006.grib2 as the trunk
05/01 20:14:47Z gfs_post_00.896623-fv3gfs pe test: your new post executable generates bit-identical gfs.t00z.special.grb2f006 as the trunk
05/01 20:19:17Z gfs_post_00.896618-fv3gfs test: your new post executable generates bit-identical gfs.t00z.master.grb2f006 as the trunk
05/01 20:19:17Z gfs_post_00.896618-fv3gfs test: your new post executable generates bit-identical gfs.t00z.sfluxgrbf006.grib2 as the trunk
05/01 20:19:17Z gfs_post_00.896618-fv3gfs test: your new post executable generates bit-identical gfs.t00z.special.grb2f006 as the trunk
05/01 19:58:38Z -Runtime: nmmb_test 00:01:30 -- baseline 00:03:00
05/01 19:58:38Z -Runtime: nmmb_pe_test 00:01:22 -- baseline 00:03:00
05/01 19:59:24Z -Runtime: fv3gefs_test 00:00:20 -- baseline 01:20:00
05/01 19:59:24Z -Runtime: fv3gefs_pe_test 00:00:27 -- baseline 01:20:00
05/01 19:59:54Z -Runtime: rap_test 00:00:56 -- baseline 00:02:00
05/01 20:00:09Z -Runtime: rap_pe_test 00:00:59 -- baseline 00:02:00
05/01 20:05:10Z -Runtime: hrrr_test 00:06:09 -- baseline 00:02:00
05/01 20:05:11Z -Runtime: hrrr_pe_test 00:01:51 -- baseline 00:02:00
05/01 20:19:29Z -Runtime: fv3gfs_test 00:20:23 -- baseline 00:18:00
05/01 20:19:29Z -Runtime: fv3gfs_pe_test 00:15:52 -- baseline 00:18:00
05/01 20:19:29Z -Runtime: fv3r_test 00:01:52 -- baseline 00:03:00
05/01 20:19:29Z -Runtime: fv3r_pe_test 00:02:04 -- baseline 00:03:00
05/01 20:19:29Z -Runtime: fv3hafs_test 00:00:36 -- baseline 00:00:40
05/01 20:19:30Z -Runtime: fv3hafs_pe_test 00:00:36 -- baseline 00:00:40
05/01 20:19:30Z -Runtime: rtma_test 00:02:29 -- baseline 00:04:00
05/01 20:19:30Z -Runtime: rtma_pe_test 00:02:29 -- baseline 00:04:00
No changes in test results detected.
===== End of UPP Regression Testing Log =====
Loading
Loading