-
-
Notifications
You must be signed in to change notification settings - Fork 16
/
INSTALL_With_CMake.txt
848 lines (692 loc) · 44.1 KB
/
INSTALL_With_CMake.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
************************************************************************
* Build and Install HDF5 Filter Libraries and tools with CMake *
************************************************************************
Table of Contents
Section I: Preconditions
Section II: Quick Step Building HDF5 Filters with CMake Script Mode
Section III: Quick Step Building HDF5 Filters with CMake Command Mode
Section IV: Further considerations
Section V: Options for building HDF5 Filters with CMake command line
Section VI: CMake option defaults for HDF5 Filters
Section VII: Using CMakePresets.json for compiling
************************************************************************
========================================================================
I. Preconditions
========================================================================
Obtaining HDF5 Filter source code
1. Create a directory for your development; for example, "myhdfstuff".
2. Obtain HDF5 Filter source from Github
development branch: https://github.com/HDFGroup/hdf5_plugins
last release: https://github.com/HDFGroup/hdf5_plugins/releases/latest
hdf5_plugins-1.16."X".tar.gz or hdf5_plugins-1.16."X".zip
and put it in "myhdfstuff".
Uncompress the file. There should be a hdf5_plugins-1."Y.X" folder.
CMake version
1. We suggest you obtain the latest CMake from the Kitware web site.
The HDF5 Filters 1."Y.X" product requires a minimum CMake version 3.18,
where "Y.X" is the current HDF5 release version. If you are using
VS2022, the minimum version is 3.21.
Note:
To change the install prefix from the platform defaults initialize
the CMake variable, CMAKE_INSTALL_PREFIX. Users of build scripts
will use the INSTALLDIR option.
========================================================================
II. Quick Step Building HDF5 Filters with CMake Script Mode
========================================================================
This short set of instructions is written for users who want to quickly
build the HDF5 Filter libraries. This procedure will use the default
settings in the config/cmake/cacheinit.cmake file.
HDF Group recommends using the ctest script mode to build HDF5.
-------------------------------------------------------------------------
-------------------------------------------------------------------------
Individual files needed as mentioned in this document
-------------------------------------------------------------------------
CMake build script from https://github.com/HDFGroup/hdf5_plugins/blob/master/config/cmake:
CTestScript.cmake
Configuration files from https://github.com/HDFGroup/hdf5_plugins/blob/master/config/cmake:
HDF5PLconfig.cmake
HDFoptions.cmake
External compression libraries are in the source libs folder.
Build scripts for windows or linux
-----------------------------------------------
To build HDF5 Filter libraries you will need to:
1. Change to the development directory "myhdfstuff".
2. Download/copy the individual files mentioned above to "myhdfstuff".
Do not uncompress the tar.gz files.
3. Change to the source directory "hdf5_plugins-1.y.x".
CTestScript.cmake file should not be modified.
4. Edit the platform configuration file, HDFoptions.cmake, if you want to change
the default build environment. The file is a compilation of the most used
options and by commenting/uncommenting lines the options can easily be changed.
5. From the "myhdfstuff" directory execute the CTest Script with the
following options:
On 32-bit Windows with Visual Studio 2022, execute:
ctest -S HDF5PLconfig.cmake,BUILD_GENERATOR=VS2022 -C Release -VV -O hdf5.log
On 64-bit Windows with Visual Studio 2022, execute:
ctest -S HDF5PLconfig.cmake,BUILD_GENERATOR=VS202264 -C Release -VV -O hdf5.log
On 32-bit Windows with Visual Studio 2019, execute:
ctest -S HDF5PLconfig.cmake,BUILD_GENERATOR=VS2019 -C Release -VV -O hdf5.log
On 64-bit Windows with Visual Studio 2019, execute:
ctest -S HDF5PLconfig.cmake,BUILD_GENERATOR=VS201964 -C Release -VV -O hdf5.log
On 32-bit Windows with Visual Studio 2017, execute:
ctest -S HDF5PLconfig.cmake,BUILD_GENERATOR=VS2017 -C Release -VV -O hdf5.log
On 64-bit Windows with Visual Studio 2017, execute:
ctest -S HDF5PLconfig.cmake,BUILD_GENERATOR=VS201764 -C Release -VV -O hdf5.log
On Linux and Mac, execute:
ctest -S HDF5PLconfig.cmake,BUILD_GENERATOR=Unix -C Release -VV -O hdf5.log
The supplied build scripts are versions of the above.
The command above will configure, build, test, and create an install
package in the myhdfstuff folder. It will have the format:
HDF5_Plugins-1."Y.X"-<platform>.<zip or tar.gz>
On Unix, <platform> will be "Linux". A similar .sh file will also be created.
On Windows, <platform> will be "win64" or "win32". If you have an
installer on your system, you will also see a similar file that ends
in either .exe (NSIS) or .msi (WiX).
Notes on the command line options.
The -S option uses the script version of ctest.
The value for the -C option (as shown above, "-C Release") must
match the setting for CTEST_CONFIGURATION_TYPE in the platform
configuration file.
The -VV option is for most verbose; use -V for less verbose.
The "-O hdf5.log" option saves the output to a log file hdf5.log.
6. To install, "X" is the current release version
On Windows (with WiX installed), execute:
HDF5_plugins-1."Y.X"-win32.msi or HDF5_plugins-1."Y.X"-win64.msi
By default this program will install the hdf5 filter libraries into the
"C:\Program Files" directory and will create the following
directory structure:
HDF_Group
--HDF5
----1."Y.X"
------lib
--------plugin
------cmake
On Linux, change to the install destination directory
(create it if doesn't exist) and execute:
<path-to>/myhdfstuff/HDF5_plugins-1."Y.X"-Linux.sh
After accepting the license, the script will prompt:
By default the HDF5 filter libraries will be installed in:
"<current directory>/HDF5-1."Y.X"-Linux"
Do you want to include the subdirectory HDF5-1."Y.X"-Linux?
Saying no will install in: "<current directory>" [Yn]:
Note that the script will create the following directory structure
relative to the install point:
HDF_Group
--HDF5
----1."Y.X"
------lib
--------plugin
------share
On Mac you will find HDF5_plugins-1."Y.X"-Darwin.dmg in the myhdfstuff folder. Click
on the dmg file to proceed with installation. After accepting the license,
there will be a folder with the following structure:
HDF_Group
--HDF5
----1."Y.X"
------lib
--------plugin
------share
By default the installation will create or merge the lib and cmake
folders in the <install destination directory>/HDF_Group/HDF5/1."Y.X"
The <install destination directory> depends on the build platform;
Windows will set the default to:
C:/Program Files/HDF_Group/HDF5/1."Y.X"
Linux will set the default to:
"myhdfstuff/HDF_Group/HDF5/1."Y.X"
The default can be changed by adding ",INSTALLDIR=<my new dir>" to the
"ctest -S HDF5config.cmake..." command. For example on linux:
ctest -S HDF5config.cmake,INSTALLDIR=/usr/local/myhdf5,BUILD_GENERATOR=Unix -C Release -VV -O hdf5.log
========================================================================
III. Quick Step Building HDF5 Filters with CMake
========================================================================
Notes: This short set of instructions is written for users who want to
quickly build just the HDF5 Filter libraries from the HDF5 filter
source code package using the CMake command line tools.
Avoid the use of drive letters in paths on Windows.
Go through these steps:
1. Change to the development directory "myhdfstuff".
2. Uncompress the HDF5 Filter source file
3. Create a folder "build" in the "myhdfstuff" directory.
4. Change into the "build" folder.
5. Configure the C filter libraries with one of the following commands:
On Windows 32 bit
cmake -G "Visual Studio 16 2019" -A Win32 -DCMAKE_BUILD_TYPE:STRING=Release -DBUILD_SHARED_LIBS:BOOL=ON -DH5PL_BUILD_TESTING:BOOL=ON -DHDF5_BUILD_EXAMPLES:BOOL=ON ..\hdf5_plugins-1."Y.X"
On Windows 64 bit
cmake -G "Visual Studio 16 2019" -A x64 -DCMAKE_BUILD_TYPE:STRING=Release -DBUILD_SHARED_LIBS:BOOL=ON -DH5PL_BUILD_TESTING:BOOL=ON -DHDF5_BUILD_EXAMPLES:BOOL=ON ..\hdf5_plugins-1."Y.X"
On Linux and Mac
cmake -G "Unix Makefiles" -DCMAKE_BUILD_TYPE:STRING=Release -DBUILD_SHARED_LIBS:BOOL=ON -DH5PL_BUILD_TESTING:BOOL=ON -DHDF5_BUILD_EXAMPLES:BOOL=ON ../hdf5_plugins-1."Y.X"
where "X" is the current release version.
6. Build the C library, tools and tests with this command:
cmake --build . --config Release
7. Test the C library and tools with this command:
ctest . -C Release
8. Create an install image with this command:
cpack -C Release CPackConfig.cmake
9. To install
On Windows (with WiX installed), execute:
HDF5_plugins-1."Y.X"-win32.msi or HDF5_plugins-1."Y.X"-win64.msi
By default this program will install the hdf5 library into the
"C:\Program Files" directory and will create the following
directory structure:
HDF_Group
--HDF5
----1."Y.X"
------lib
--------plugin
------cmake
On Linux, change to the install destination directory
(create if doesn't exist) and execute:
<path-to>/myhdfstuff/build/HDF5_plugins-1."Y.X"-Linux.sh
After accepting the license, the script will prompt:
By default the HDF5 will be installed in:
"<current directory>/HDF5_plugins-1."Y.X"-Linux"
Do you want to include the subdirectory HDF5_plugins-1."Y.X"-Linux?
Saying no will install in: "<current directory>" [Yn]:
Note that the script will create the following directory structure
relative to the install point:
HDF_Group
--HDF5
----1."Y.X"
------lib
--------plugin
------share
On Mac you will find HDF5_plugins-1."Y.X"-Darwin.dmg in the build folder. Click
on the dmg file to proceed with installation. After accepting the license,
there will be a folder with the following structure:
HDF_Group
--HDF5
----1."Y.X"
------lib
--------plugin
------share
========================================================================
IV. Further considerations
========================================================================
1. We suggest you obtain the latest CMake for windows from the Kitware
web site. The HDF5 1."Y.X" product requires a minimum CMake version 3.18.
If you are using VS2022, the CMake minimum version is 3.21.
2. If you are building on Apple Darwin platforms, you should add the
following options:
Compiler choice - use xcode by setting the ENV variables of CC and CXX
Additional options:
CMAKE_ANSI_CFLAGS:STRING=-fPIC
CTEST_USE_LAUNCHERS:BOOL=ON
CMAKE_BUILD_WITH_INSTALL_RPATH:BOOL=OFF
5. Windows developers should install NSIS or WiX to create an install image with CPack.
Visual Studio Express users will not be able to package HDF5 Filters into
an install image executable.
6. Developers can copy the config/cmake/cacheinit.cmake file and alter the
the settings for the developers' environment. Then the only options needed
on the command line are those options that are different. Example using HDF
default cache file:
cmake -C ../config/cmake/cacheinit.cmake -G "Visual Studio 16 2019" \
-DHDF5_MSVC_NAMING_CONVENTION:BOOL=OFF \
-DCMAKE_BUILD_TYPE:STRING=Release ..
7. CMake uses a toolchain of utilities to compile, link libraries and
create archives, and other tasks to drive the build. The toolchain
utilities available are determined by the languages enabled. In normal
builds, CMake automatically determines the toolchain for host builds
based on system introspection and defaults. In cross-compiling
scenarios, a toolchain file may be specified with information about
compiler and utility paths.
Variables and Properties
Several variables relate to the language components of a toolchain which
are enabled. CMAKE_<LANG>_COMPILER is the full path to the compiler used
for <LANG>. CMAKE_<LANG>_COMPILER_ID is the identifier used by CMake for
the compiler and CMAKE_<LANG>_COMPILER_VERSION is the version of the compiler.
The CMAKE_<LANG>_FLAGS variables and the configuration-specific equivalents
contain flags that will be added to the compile command when compiling a
file of a particular language.
As the linker is invoked by the compiler driver, CMake needs a way to
determine which compiler to use to invoke the linker. This is calculated
by the LANGUAGE of source files in the target, and in the case of static
libraries, the language of the dependent libraries. The choice CMake makes
may be overridden with the LINKER_LANGUAGE target property.
See the CMake help for more information on using toolchain files.
To use a toolchain file with the supplied cmake scripts, see the
HDFoptions.cmake file under the toolchain section.
Notes: CMake and HDF5
1. Using CMake for building and using HDF5 is under active development.
We have attempted to provide error-free files. The CMake specific
files may change before the next release.
2. CMake support for HDF5 development should be usable on any
system where CMake is supported. Please send us any comments on
how CMake support can be improved on any system. Visit the
KitWare site for more information about CMake.
3. Build and test results can be submitted to our CDash server:
The CDash server for community submissions of hdf5 is at
https://my.cdash.org.
We ask that all submissions include the configuration information and
contact information in the CTest Notes Files upload step. See the
current reports on CDash for examples.
Please follow the convention that "NIGHTLY" submissions maintain the same
configuration every time. "EXPERIMENTAL" submissions can be expected to
be different for each submission.
4. See the appendix at the bottom of this file for examples of using
a ctest script for building and testing. Using a ctest script is
preferred because of its flexibility.
Notes: CMake in General
1. More information about using CMake can be found at the KitWare site at
www.cmake.org.
2. CMake uses the command line; however, the visual CMake tool is
available for the configuration step. The steps are similar for
all the operating systems supported by CMake.
========================================================================
V. Options for Building HDF5 Filter Libraries with the CMake Command Line
========================================================================
To build the HDF5 Filter Libraries with CMake, go through these five steps:
1. Run CMake
2. Configure the cache settings
3. Build HDF5 Filters
4. Test HDF5 Filters
5. Package HDF5 Filters(create install image)
These five steps are described in detail below.
========================================================================
1. Run CMake
The visual CMake executable is named "cmake-gui.exe" on Windows and should be
available in your Start menu. For Linux, UNIX, and Mac users the
executable is named "cmake-gui" and can be found where CMake was
installed.
Specify the source and build directories.
***** Make the build and source directories different. ******
For example on Windows, if the source is at c:\MyHDFstuff\hdf5pl,
then use c:\MyHDFstuff\hdf5pl\build or c:\MyHDFstuff\build\hdf5pl as the
build directory.
RECOMMENDED:
Users can perform the configuration step without using the visual
cmake-gui program. We use the file cacheinit.cmake in the
config/cmake source folder for our testing. This file enables all of the
basic options and we turn specific options on or off for testing
using the following command line within the build directory:
cmake -C <sourcepath>/config/cmake/cacheinit.cmake -G "<generator>" [-D<options>] <sourcepath>
Where <generator> is
* MinGW Makefiles
* NMake Makefiles
* Unix Makefiles
* Visual Studio 14 2015
* Visual Studio 14 2015 Win64
* Visual Studio 15 2017
* Visual Studio 15 2017 Win64
* Visual Studio 16 2019
* Visual Studio 17 2022
<options> is:
* XXX_INCLUDE_DIR:PATH=<path to XXX includes directory>
* XXX_LIBRARY:FILEPATH=<path to XXX/library file>
* <HDF5OPTION>:BOOL=[ON | OFF]
<cacheinit.cmake> is:
# This is the CMakeCache file used by HDF Group for daily tests.
########################
# EXTERNAL cache entries
########################
set (USE_SHARED_LIBS ON CACHE BOOL "Use Shared Libraries" FORCE)
set (H5PL_BUILD_TESTING ON CACHE BOOL "Build h5blosc Unit Testing" FORCE)
set (H5PL_BUILD_TESTING ON CACHE BOOL "Enable h5pl examples" FORCE)
set (H5PL_BUILD_EXAMPLES ON CACHE BOOL "Build h5pl Examples" FORCE)
set (HDF_ENABLE_PARALLEL OFF CACHE BOOL "Enable parallel build (requires MPI)" FORCE)
set (HDF5_PACKAGE_NAME "hdf5" CACHE STRING "Name of HDF5 package" FORCE)
set (HDF5_NAMESPACE "hdf5::" CACHE STRING "Name space of HDF5 library" FORCE)
set (H5PL_ALLOW_EXTERNAL_SUPPORT "NO" CACHE STRING "Allow External Library Building (NO GIT TGZ)" FORCE)
set_property (CACHE H5PL_ALLOW_EXTERNAL_SUPPORT PROPERTY STRINGS NO GIT TGZ)
set (H5PL_GIT_URL "https://github.com/HDFGroup/h5plugin.git" CACHE STRING "Use plugins from HDF repository" FORCE)
set (H5PL_GIT_BRANCH "master" CACHE STRING "" FORCE)
set (H5PL_TGZ_ORIGPATH "https://github.com/HDFGroup/hdf5_plugins/releases/download/snapshots" CACHE STRING "Use PLUGINS from original location" FORCE)
set (H5PL_TGZ_NAME "hdf5_plugins-master.tar.gz" CACHE STRING "Use plugins from compressed file" FORCE)
set (PL_PACKAGE_NAME "pl" CACHE STRING "Name of plugins package" FORCE)
set (H5PL_CPACK_ENABLE ON CACHE BOOL "Enable the CPACK include and components" FORCE)
############################# bitshuffle ################################################
set (BUILD_BSHUF_LZ4_LIBRARY_SOURCE ON CACHE BOOL "build the lz4 library within the BSHUF plugin" FORCE)
set (BSHUF_GIT_URL "https://github.com/kiyo-masui/bitshuffle.git" CACHE STRING "Use BSHUF from HDF repository" FORCE)
set (BSHUF_GIT_BRANCH "master" CACHE STRING "" FORCE)
set (BSHUF_TGZ_ORIGPATH "https://github.com/kiyo-masui/bitshuffle/archive/refs/tags" CACHE STRING "Use PLUGINS from original location" FORCE)
set (BSHUF_TGZ_NAME "bitshuffle-0.5.1.tar.gz" CACHE STRING "Use BSHUF from compressed file" FORCE)
set (BSHUF_PACKAGE_NAME "bshuf" CACHE STRING "Name of BSHUF package" FORCE)
############################# blosc ################################################
set (BLOSC_GIT_URL "https://github.com/Blosc/c-blosc.git" CACHE STRING "Use BLOSC from Github repository" FORCE)
set (BLOSC_GIT_BRANCH "main" CACHE STRING "" FORCE)
set (BLOSC_TGZ_ORIGPATH "https://github.com/Blosc/c-blosc/archive/refs/tags" CACHE STRING "Use PLUGINS from original location" FORCE)
set (BLOSC_TGZ_NAME "c-blosc-1.21.6.tar.gz" CACHE STRING "Use BLOSC from compressed file" FORCE)
set (BLOSC_PACKAGE_NAME "blosc" CACHE STRING "Name of BLOSC package" FORCE)
set (BLOSC_ZLIB_GIT_URL "https://github.com/madler/zlib.git" CACHE STRING "Use ZLIB from GitHub repository" FORCE)
set (BLOSC_ZLIB_GIT_BRANCH "develop" CACHE STRING "" FORCE)
set (BLOSC_ZLIB_TGZ_ORIGPATH "https://github.com/madler/zlib/releases/download/v1.3" CACHE STRING "Use PLUGINS from original location" FORCE)
set (BLOSC_ZLIB_TGZ_NAME "zlib-1.3.tar.gz" CACHE STRING "Use ZLib from compressed file" FORCE)
set (BLOSC_ZLIB_PACKAGE_NAME "zlib" CACHE STRING "Name of BLOSC_ZLIB package" FORCE)
############################# blosc2 ################################################
set (BLOSC2_GIT_URL "https://github.com/Blosc/c-blosc2.git" CACHE STRING "Use BLOSC2 from Github repository" FORCE)
set (BLOSC2_GIT_BRANCH "main" CACHE STRING "" FORCE)
set (BLOSC2_TGZ_ORIGPATH "https://github.com/Blosc/c-blosc2/archive/refs/tags" CACHE STRING "Use PLUGINS from original location" FORCE)
set (BLOSC2_TGZ_NAME "c-blosc2-2.15.1.tar.gz" CACHE STRING "Use BLOSC2 from compressed file" FORCE)
set (BLOSC2_PACKAGE_NAME "blosc2" CACHE STRING "Name of BLOSC2 package" FORCE)
set (BLOSC2_ZLIB_GIT_URL "https://github.com/madler/zlib.git" CACHE STRING "Use ZLIB from GitHub repository" FORCE)
set (BLOSC2_ZLIB_GIT_BRANCH "develop" CACHE STRING "" FORCE)
set (BLOSC2_ZLIB_TGZ_ORIGPATH "https://github.com/madler/zlib/releases/download/v1.3" CACHE STRING "Use PLUGINS from original location" FORCE)
set (BLOSC2_ZLIB_TGZ_NAME "zlib-1.3.tar.gz" CACHE STRING "Use ZLib from compressed file" FORCE)
set (BLOSC2_ZLIB_PACKAGE_NAME "zlib" CACHE STRING "Name of BLOSC2_ZLIB package" FORCE)
############################# bzip2 ################################################
set (BZ2_GIT_URL "https://github.com/libarchive/bzip2.git" CACHE STRING "Use BZ2 from GitHub repository" FORCE)
set (BZ2_GIT_BRANCH "bzip2-1.0.8" CACHE STRING "" FORCE)
set (BZ2_TGZ_ORIGPATH "https://github.com/libarchive/bzip2/archive/refs/tags" CACHE STRING "Use PLUGINS from original location" FORCE)
set (BZ2_TGZ_NAME "bzip2-bzip2-1.0.8.tar.gz" CACHE STRING "Use BZ2 from compressed file" FORCE)
set (BZ2_PACKAGE_NAME "bz2" CACHE STRING "Name of BZ2 package" FORCE)
############################# fpzip ################################################
set (FPZIP_GIT_URL "https://github.com/LLNL/fpzip.git" CACHE STRING "Use FPZIP from GitHub repository" FORCE)
set (FPZIP_GIT_BRANCH "develop" CACHE STRING "" FORCE)
set (FPZIP_TGZ_ORIGPATH "https://github.com/LLNL/fpzip/releases/download/1.3.0" CACHE STRING "Use PLUGINS from original location" FORCE)
set (FPZIP_TGZ_NAME "fpzip-1.3.0.tar.gz" CACHE STRING "Use FPZIP from compressed file" FORCE)
set (FPZIP_PACKAGE_NAME "fpzip" CACHE STRING "Name of FPZIP package" FORCE)
############################# jpeg ################################################
set (JPEG_GIT_URL "https://github.com/libjpeg-turbo/libjpeg-turbo.git" CACHE STRING "Use JPEG from TurboJPEG" FORCE)
set (JPEG_GIT_BRANCH "jpeg-9e" CACHE STRING "" FORCE)
set (JPEG_TGZ_ORIGPATH "https://www.ijg.org/files" CACHE STRING "Use PLUGINS from original location" FORCE)
set (JPEG_TGZ_NAME "jpegsrc.v9e.tar.gz" CACHE STRING "Use JPEG from compressed file" FORCE)
set (JPEG_PACKAGE_NAME "jpeg" CACHE STRING "Name of JPEG package" FORCE)
############################# lz4 ################################################
set (BUILD_LZ4_LIBRARY_SOURCE ON CACHE BOOL "build the lz4 library within the plugin" FORCE)
set (LZ4_GIT_URL "https://github.com/lz4/lz4.git" CACHE STRING "Use LZ4 from GitHub repository" FORCE)
set (LZ4_GIT_BRANCH "dev" CACHE STRING "" FORCE)
set (LZ4_TGZ_ORIGPATH "https://github.com/lz4/lz4/releases/download/v1.10.0" CACHE STRING "Use PLUGINS from original location" FORCE)
set (LZ4_TGZ_NAME "lz4-1.10.0.tar.gz" CACHE STRING "Use LZ4 from compressed file" FORCE)
set (LZ4_PACKAGE_NAME "lz4" CACHE STRING "Name of LZ4 package" FORCE)
############################# lzf ################################################
set (LZF_URL "http://software.schmorp.de/pkg/liblzf.html" CACHE STRING "LZF home" FORCE)
set (LZF_TGZ_ORIGPATH "http://dist.schmorp.de/liblzf" CACHE STRING "Use LZF from original location" FORCE)
set (LZF_TGZ_NAME "liblzf-3.6.tar.gz" CACHE STRING "Use LZF from compressed file" FORCE)
set (LZF_PACKAGE_NAME "lzf" CACHE STRING "Name of LZF package" FORCE)
############################# mafisc ################################################
#set (BUILD_MAFISC_LIBRARY_SOURCE OFF CACHE BOOL "build the mafisc library within the plugin" FORCE)
#set (MAFISC_TGZ_ORIGPATH "" CACHE STRING "Use PLUGINS from original location" FORCE)
#set (MAFISC_TGZ_NAME ".tar.gz" CACHE STRING "Use MAFISC from compressed file" FORCE)
#set (MAFISC_PACKAGE_NAME "mafisc" CACHE STRING "Name of MAFISC package" FORCE)
############################# sz ################################################
set (SZ_GIT_URL "https://github.com/szcompressor/SZ.git" CACHE STRING "Use SZ filter from GitHub repository" FORCE)
set (SZ_GIT_BRANCH "master" CACHE STRING "" FORCE)
set (SZ_TGZ_ORIGPATH "https://github.com/szcompressor/SZ/releases/download/v2.1.12.5" CACHE STRING "Use PLUGINS from original location" FORCE)
set (SZ_TGZ_NAME "SZ-2.1.12.5.tar.gz" CACHE STRING "Use SZ filter from compressed file" FORCE)
set (SZ_PACKAGE_NAME "SZ" CACHE STRING "Name of SZ filter package" FORCE)
############################# zfp ################################################
set (ZFP_GIT_URL "https://github.com/LLNL/zfp.git" CACHE STRING "Use ZFP from GitHub repository" FORCE)
set (ZFP_GIT_BRANCH "develop" CACHE STRING "" FORCE)
set (ZFP_TGZ_ORIGPATH "https://github.com/LLNL/zfp/releases/download/1.0.0" CACHE STRING "Use PLUGINS from original location" FORCE)
set (ZFP_TGZ_NAME "zfp-1.0.1.tar.gz" CACHE STRING "Use ZFP from compressed file" FORCE)
set (ZFP_PACKAGE_NAME "zfp" CACHE STRING "Name of ZFP package" FORCE)
############################# zstd ################################################
set (ZSTD_GIT_URL "https://github.com/facebook/zstd.git" CACHE STRING "Use ZSTD from GitHub repository" FORCE)
set (ZSTD_GIT_BRANCH "dev" CACHE STRING "" FORCE)
set (ZSTD_TGZ_ORIGPATH "https://github.com/facebook/zstd/releases/download/v1.5.6" CACHE STRING "Use PLUGINS from original location" FORCE)
set (ZSTD_TGZ_NAME "zstd-1.5.6.tar.gz" CACHE STRING "Use ZSTD from compressed file" FORCE)
set (ZSTD_PACKAGE_NAME "zstd" CACHE STRING "Name of ZSTD package" FORCE)
2. Configure the cache settings
2.1 Visual CMake users, click the Configure button. If this is the first time you are
running cmake-gui in this directory, you will be prompted for the
generator you wish to use (for example on Windows, Visual Studio 14).
CMake will read in the CMakeLists.txt files from the source directory and
display options for the HDF5 filter project. After the first configure you
can adjust the cache settings and/or specify the locations of other programs.
Any conflicts or new values will be highlighted by the configure
process in red. Once you are happy with all the settings and there are no
more values in red, click the Generate button to produce the appropriate
build files.
On Windows, if you are using a Visual Studio generator, the solution and
project files will be created in the build folder.
On linux, if you are using the Unix Makefiles generator, the Makefiles will
be created in the build folder.
2.2 Preferred command line example on Windows in c:\MyHDFstuff\hdf5pl\build directory:
cmake -C ../config/cmake/cacheinit.cmake -G "Visual Studio 16 2019" "-Ax64" \
-DHDF5_MSVC_NAMING_CONVENTION:BOOL=OFF \
-DCMAKE_BUILD_TYPE:STRING=Release ..
2.3 On Windows, if you are using a Visual Studio Express version you must
be sure that the following two options are correctly set/unset:
HDF_NO_PACKAGES:BOOL=ON
HDF_USE_FOLDERS:BOOL=OFF
3. Build HDF5 Filters
On Windows, you can build HDF5 Filters using either the Visual Studio Environment
or the command line. The command line can be used on all platforms;
Windows, linux, Unix, and Mac.
To build from the command line, navigate to your build directory and
execute the following:
cmake --build . --config {Debug | Release}
NOTE: "--config {Debug | Release}" may be optional on your platform. We
recommend choosing either Debug or Release on Windows.
3.1 If you wish to use the Visual Studio environment, open the solution
file in your build directory. Be sure to select either Debug or
Release and build the solution.
3.2.1 The external compression libraries can be configured
to allow building the libraries by downloading from a GIT repository.
The option is 'HDFPL_ALLOW_EXTERNAL_SUPPORT'; by adding the following
configuration option:
-DHDFPL_ALLOW_EXTERNAL_SUPPORT:STRING="GIT"
The options to control the GIT URL (config/cmake/cacheinit.cmake file) are:
<FilterName>_GIT_URL:STRING="http://${<filter>_url}/<filter>"
<FilterName>_GIT_BRANCH="${git_branch}"
${<filter>_url} should be changed to your location. Also define CMAKE_BUILD_TYPE
to be the configuration type.
3.2.2 Or the external compression libraries can be configured
to allow building the libraries by using a compressed file.
The option is 'HDFPL_ALLOW_EXTERNAL_SUPPORT' and is enabled by
adding the following configuration option:
-DHDFPL_ALLOW_EXTERNAL_SUPPORT:STRING="TGZ"
The options to control the TGZ URL (config/cmake/cacheinit.cmake
file) are:
<FilterName>_TGZ_NAME:STRING="<filter>_src.ext"
H5PL_TGZPATH:STRING="some_location"
where "some_location/xxxx_src.ext" is the URL or full path to
the compressed file and where ext is the type of the compression
file such as .bz2, .tar, .tar.gz, .tgz, or .zip. Also define
CMAKE_BUILD_TYPE to be the configuration type.
4. Test HDF5 filters
To test the build, navigate to your build directory and execute:
ctest . -C {Debug | Release}
NOTE: "-C {Debug | Release}" may be optional on your platform. We
recommend choosing either Debug or Release to match the build
step on Windows.
5. Packaging HDF5 filters (create an install image)
To package the build into a simple installer using WiX toolset or the NullSoft installer NSIS
on Windows, or into compressed files (.tar.gz, .sh, .zip), use the CPack tool.
To package the build, navigate to your build directory and execute;
cpack -C {Debug | Release} CPackConfig.cmake
NOTE: See note 8 of this document for NSIS information.
See note 9 of this document for WiX information.
Also, if you are using a Visual Studio Express version or
want to disable the packaging components, set HDF_NO_PACKAGES
to ON (on the command line add -DHDF_NO_PACKAGES:BOOL=ON)
6. The files that support building HDF5 filters with CMake are all the files in the
config/cmake folder, the CMakeLists.txt files in each source folder, and
CTestConfig.cmake. CTestConfig.cmake is specific to the internal testing
performed by The HDF Group. It should be altered for the user's
installation and needs. The cacheinit.cmake file settings are used by
The HDF Group for daily testing. It should be altered/ignored for the user's
installation and needs.
7. More information about using CMake can be found at the KitWare site,
www.cmake.org.
8. Nullsoft Scriptable Install System
The Nullsoft Scriptable Install System (NSIS) is an open source installation
system. It was created by the WinAmp authors to distribute that application,
but it is now a general-purpose system which anyone might use. NSIS installers
recognize /S for silent installation and /D=dir to specify the
"output directory", which is where the program will be installed. These
options are case-sensitive, so be sure to type them in upper case.
9. WiX Toolset
WiX--the Windows Installer XML toolset--lets developers create installers for
Windows Installer, the Windows installation engine. See http://wixtoolset.org.
========================================================================
VI. CMake Option Defaults for HDF5 Filters
========================================================================
In the options listed below, there are three columns of information:
Option Name, Option Description, and Option Default.
The config/cmake/cacheinit.cmake file can override the following values.
---------------- General Build Options ---------------------
BUILD_SHARED_LIBS "Build Shared Libraries" ON
USE_SHARED_LIBS "Use Shared Libraries" ON
H5PL_BUILD_TESTING "Build h5pl Unit Testing" OFF
H5PL_CPACK_ENABLE "Enable the CPACK include and components" ON
---------------- HDF5 Filter Build Options ----------------
H5PL_BUILD_TESTING "Build <filter> Unit Testing" ON
H5PL_BUILD_EXAMPLES "Build <filter> Examples" ON
DISABLE_<filter>_ENCODER "build the <filter> library without encoding" OFF
---------------- HDF5 Advanced Options ---------------------
HDF_DISABLE_COMPILER_WARNINGS "Disable compiler warnings" OFF
HDF_ENABLE_LARGE_FILE "Enable support for large (64-bit) files on Linux." ON
HDF_NO_PACKAGES "Do not include CPack Packaging" OFF
HDF_PACK_EXAMPLES "Package the HDF5 Library Examples Compressed File" OFF
HDFPL_USE_FOLDERS "Enable folder grouping of projects in IDEs." ON
HDF5_MSVC_NAMING_CONVENTION "Use MSVC Naming conventions for Shared Libraries" OFF
if (APPLE)
<filter>_BUILD_WITH_INSTALL_NAME "Build with library install_name set to the installation path" OFF
<filter>_PACK_MACOSX_FRAMEWORK "Package the <filter> Library in a Frameworks" OFF
<filter>_BUILD_FRAMEWORKS "TRUE to build as frameworks libraries, FALSE to build according to BUILD_SHARED_LIBS" FALSE
---------------- External Library Options ---------------------
HDF_PACKAGE_EXTLIBS "CPACK - include external libraries" OFF
H5PL_ALLOW_EXTERNAL_SUPPORT "Allow External Library Building (NO GIT TGZ)" "NO"
ENABLE_<filter> "Enable Library Building for <filter> plugin" ON
HDF_<filter>_USE_EXTERNAL "Use External Library Building for <filter> plugin" 0
------ BLOSC ------
HDF_ENABLE_BLOSC_SUPPORT "Enable blosc" ON
HDF_ENABLE_BLOSC_ZLIB_SUPPORT "Enable Zlib Filters" ON
BLOSC_ZLIB_USE_EXTERNAL "Use External Library Building for ZLIB" 1
BLOSC_USE_EXTERNAL "Use External Library Building for BLOSC" 1
------ BLOSC2 ------
HDF_ENABLE_BLOSC2_SUPPORT "Enable blosc2" ON
HDF_ENABLE_BLOSC2_ZLIB_SUPPORT "Enable Zlib Filters" ON
BLOSC2_ZLIB_USE_EXTERNAL "Use External Library Building for ZLIB" 1
BLOSC2_USE_EXTERNAL "Use External Library Building for BLOSC2" 1
------ BSHUF ------
BUILD_BSHUF_LZ4_LIBRARY_SOURCE "build the lz4 library within the BSHUF plugin" ON
BUILD_BSHUF_LIBRARY_SOURCE "build the bitshuffle library within the plugin" ON
BSHUF_LZ4_USE_EXTERNAL "Use External Library Building for BSHUF_LZ4" 1
BSHUF_USE_EXTERNAL "Use External Library Building for BSHUF" 1
------ BZIP2 ------
BZ2_USE_EXTERNAL "Use External Library Building for BZ2" 1
------ JPEG ------
JPEG_USE_EXTERNAL "Use External Library Building for JPEG" 1
------ LZ4 ------
BUILD_LZ4_LIBRARY_SOURCE "build the lz4 library within the plugin" ON
LZ4_USE_EXTERNAL "Use External Library Building for LZ4" 1
------ LZF ------
LZF_USE_EXTERNAL "Use External Library Building for LZF" 1
------ ZFP ------
COND_MAIN_ENCODER "Enable encoding" ON
COND_MAIN_DECODER "Enable decoding" ON
COND_CHECK_CRC32 "Enable check crc32" ON
COND_CHECK_CRC64 "Enable check crc64" ON
COND_CHECK_SHA256 "Enable check sha256" ON
COND_FILTER_LZ "Enable lz filter" ON
COND_ENCODER_LZ "Enable lz encoder" ON
COND_DECODER_LZ "Enable lz decoder" ON
COND_FILTER_LZMA1 "Enable lzma1 filter" ON
COND_ENCODER_LZMA1 "Enable lzma1 encoder" ON
COND_DECODER_LZMA1 "Enable lzma1 decoder" ON
COND_ENCODER_LZMA2 "Enable lzma2 encoder" ON
COND_DECODER_LZMA2 "Enable lzma2 decoder" ON
COND_FILTER_DELTA "Enable delta filter" ON
COND_ENCODER_SIMPLE "Enable delta encoder" ON
COND_DECODER_DELTA "Enable delta decoder" ON
COND_FILTER_SIMPLE "Enable simple filter" ON
COND_ENCODER_SIMPLE "Enable simple encoder" ON
COND_DECODER_SIMPLE "Enable simple decoder" ON
ZFP_USE_EXTERNAL "Use External Library Building for ZFP" 0
------ ZSTD ------
ZSTD_USE_EXTERNAL "Use External Library Building for ZSTD" 1
========================================================================
VII: Using CMakePresets.json for compiling
========================================================================
One problem that CMake users often face is sharing settings with other people for common
ways to configure a project. This may be done to support CI builds, or for users who
frequently use the same build. CMake supports two main files, CMakePresets.json and CMakeUserPresets.json,
that allow users to specify common configure options and share them with others. CMake also supports
files included with the include field.
CMakePresets.json and CMakeUserPresets.json live in the project's root directory. They
both have exactly the same format, and both are optional (though at least one must be
present if --preset is specified). CMakePresets.json is meant to specify project-wide build
details, while CMakeUserPresets.json is meant for developers to specify their own local build details.
See CMake documentation for details: https://cmake.org/cmake/help/latest/manual/cmake-presets.7.html
HDF-provided CMakePresets.json
-------------------------------
The CMakePresets.json provided by HDF requires CMake version 3.25, which supports package
and workflow presets, and ninja build system. The top-level configuration group is intended to be
a standard set of options to produce a package of shared and staic libraries and tools. Other configurations
used for inheriting settings are in the included json file in "config/cmake-presets/hidden-presets.json".
Available configurations presets can be displayed by executing:
cmake -S <path-to-source> --list-presets
Using individual command presets (where <compiler-type> is GNUC or MSVC or Clang):
change directory to the hdf5 source folder
cmake --preset ci-StdShar-<compiler-type>
cmake --build --preset ci-StdShar-<compiler-type>
ctest --preset ci-StdShar-<compiler-type>
cpack --preset ci-StdShar-<compiler-type>
Using the workflow preset to configure, build, test and package the standard configuration:
change directory to the hdf5 source folder
execute "cmake --workflow --preset ci-StdShar-<compiler-type> --fresh"
where <compiler-type> is GNUC or MSVC or Clang
Also needed is the path to where HDF5 is installed, which can be set with a HD5_ROOT environment variable:
export HDF5_ROOT=<path>/HDF_Group/HDF5/1.Y.X; cmake --workflow --preset ci-StdShar-GNUC --fresh
Creating your own configurations
--------------------------------
The quickest way is to copy CMakePresets.json to CMakeUserPresets.json and
edit CMakeUserPresets.json configuration names from ci-* to my-*. Change the
"configurePresets" section "inherits" field only for those that you have alternate
options. Then change the "configurePreset" field entries in the "buildPresets",
"testPresets", "packagePresets" sections to match your my-StdShar-<compiler-type>.
And finally the names settings in the "workflowPresets" steps will also need the ci-* to my-* change.
For instance, to change the support files to use a local directory, edit CMakeUserPresets.json:
{
"version": 6,
"configurePresets": [
{
"name": "my-HDF5116",
"hidden": true,
"environment": {
"HDF5_ROOT": "${sourceParentDir}/HDF_Group/HDF5/1.16.0"
},
"cacheVariables": {
"HDF5_ROOT": {"type": "STRING", "value": "${sourceParentDir}/HDF_Group/HDF5/1.16.0"},
"H5PL_VERS_MAJOR": {"type": "STRING", "value": "1"},
"H5PL_VERS_MINOR": {"type": "STRING", "value": "16"},
"H5PL_VERS_RELEASE": {"type": "STRING", "value": "0"},
"H5PL_BUILD_TESTING": "ON",
"H5PL_BUILD_EXAMPLES": "ON"
}
},
{
"name": "my-HDF5Dev",
"hidden": true,
"environment": {
"HDF5_ROOT": "${sourceParentDir}/HDF_Group/HDF5/1.17.0"
},
"cacheVariables": {
"HDF5_ROOT": {"type": "STRING", "value": "${sourceParentDir}/HDF_Group/HDF5/1.17.0"},
"H5PL_BUILD_TESTING": "ON",
"H5PL_BUILD_EXAMPLES": "ON"
}
},
{
"name": "my-base-tgz",
"hidden": true,
"inherits": "ci-base",
"cacheVariables": {
"H5PL_ALLOW_EXTERNAL_SUPPORT": {"type": "STRING", "value": "TGZ"},
"H5PL_TGZPATH": {"type": "STRING", "value": "${sourceParentDir}/temp"}
}
},
{
"name": "my-StdShar",
"hidden": true,
"inherits": "my-StdCompression",
"cacheVariables": {
......
{
"name": "my-StdShar-GNUC",
"description": "GNUC Standard Config for x64 (Release)",
"inherits": [
"ci-x64-Release-GNUC",
"ci-CPP",
"ci-Fortran",
"ci-Java",
"my-StdShar",
"my-StdExamples"
]
}
......
Then you can change or add options for your specific case.
========================================================================
For further assistance, send email to [email protected]
========================================================================