Compiling hylo compiler on Fedora - help - assist - Please

[tomaszdrozdz]

Hello all.

---

My OS:

Fedora

> uname -r
6.12.11-200.fc41.x86_64

---

I am trying to compile hylo compiler.
What I do is as follows.

1. I install
   swift-lang llvm llvm-devel llvm-cmake-utils cmake ninja-build
   rpms.

mkdir -p /opt/hylo/build
cd /opt/hylo/
git clone https://github.com/hylo-lang/hylo.git
mv hylo source
cd source/
git submodule update --init

3a)

cmake -D CMAKE_BUILD_TYPE=Release -D LLVM_DIR=/usr/lib64/cmake/llvm -D BUILD_TESTING=1 -D LLVM_ENABLE_ASSERTIONS=ON -G Ninja -S . -B /opt/hylo/build/

but I get:

CMake Error at /opt/hylo/build/_deps/hylo-cmakemodules-src/FindHyloLLVM.cmake:20 (find_package):
Could not find a configuration file for package "LLVM" that is compatible
 with requested version "17.0".

The following configuration files were considered but not accepted:

/usr/lib64/cmake/llvm/LLVMConfig.cmake, version: 19.1.7
 /lib64/cmake/llvm/LLVMConfig.cmake, version: 19.1.7

Call Stack (most recent call first):
/opt/hylo/build/_deps/swifty-llvm-src/Sources/CMakeLists.txt:1 (find_package)

3b)
So I install
llvm17-devel
rpm

I try again:

cmake -D CMAKE_BUILD_TYPE=Release -D LLVM_DIR=/usr/lib64/cmake/llvm -D BUILD_TESTING=1 -D LLVM_ENABLE_ASSERTIONS=ON -G Ninja -S . -B /opt/hylo/build/

but I get:

-- The C compiler identification is GNU 14.2.1
-- The CXX compiler identification is GNU 14.2.1
-- The Swift compiler identification is Apple 6.0.3
-- Detecting C compiler ABI info                          
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features                                                                                       
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped                                                             
-- Detecting CXX compile features                                                                                     
-- Detecting CXX compile features - done                                                                              
-- Check for working Swift compiler: /usr/bin/swiftc
-- Check for working Swift compiler: /usr/bin/swiftc - works
Cloning into 'hylo-cmakemodules-src'...
HEAD is now at 0bd50f8 Merge pull request #11 from hylo-lang/update-swifty-llvm
Cloning into 'swiftargumentparser-src'...
HEAD is now at c8ed701 Update changelog with latest changes (#600)
-- Could NOT find dispatch (missing: dispatch_DIR)
-- Could NOT find Foundation (missing: Foundation_DIR)
-- Could NOT find XCTest (missing: XCTest_DIR)
Cloning into 'swiftcollections-src'...
HEAD is now at d029d9d Merge pull request #347 from lorentey/update-cmake
Cloning into 'swiftnumerics-src'...
HEAD is now at 0a5bc04 Merge pull request #215 from stephentyrone/arm64-mac-cmake-1.0
Cloning into 'swiftalgorithms-src'...
HEAD is now at f6919df Documentation improvements
Cloning into 'durian-src'...
HEAD is now at 16e6096 Add CMake support and CI (#1)
Cloning into 'bigint-src'...
HEAD is now at 0ed110f Update jazzy.yml
Cloning into 'swifty-llvm-src'...
HEAD is now at 5095674 Ensure proper alignment for store instructions. (#83)
-- Could NOT find FFI (missing: FFI_LIBRARIES HAVE_FFI_CALL) 
-- Looking for histedit.h
-- Looking for histedit.h - found
-- Found LibEdit: /usr/include (found version "2.11")
-- Performing Test Terminfo_LINKABLE
-- Performing Test Terminfo_LINKABLE - Success
-- Found Terminfo: /usr/lib64/libtinfo.so
-- Could NOT find ZLIB (missing: ZLIB_LIBRARY ZLIB_INCLUDE_DIR) 
Cloning into 'generateswiftxctestmain-src'...
Already on 'main'
Your branch is up to date with 'origin/main'.
Cloning into 'swiftsyntax-src'...
HEAD is now at b32df0ee Replace the manually maintained `TokenSpecSet` `TypeSpecifier` by the generated `TypeSpecifierSyntax.SpecifierOptions`
-- Module triple: x86_64-unknown-linux-gnu
-- Configuring done (29.3s)
CMake Error at /usr/lib64/llvm17/lib/cmake/llvm/LLVMExports.cmake:73 (set_target_properties):
  The link interface of target "LLVMSupport" contains:

    ZLIB::ZLIB

  but the target was not found.  Possible reasons include:

    * There is a typo in the target name.
    * A find_package call is missing for an IMPORTED target.
    * An ALIAS target is missing.

Call Stack (most recent call first):
  /usr/lib64/llvm17/lib/cmake/llvm/LLVMConfig.cmake:348 (include)
  /opt/hylo/build/_deps/hylo-cmakemodules-src/FindHyloLLVM.cmake:20 (find_package)
  /opt/hylo/build/_deps/swifty-llvm-src/Sources/CMakeLists.txt:1 (find_package)


-- Generating done (0.4s)
CMake Generate step failed.  Build files cannot be regenerated correctly.

but I already have
zlib-ng-compat
rpm installed.

Anyway I install
zlib-ng-devel
rpm
but still the same.

It is still the same even when I add options like:

-D ZLIB_LIBRARY=/usr/lib64/libz.so.1
                           libz-ng.so
                           libzstd.so

or

-D ZLIB_ROOT=/var/usr/lib64/

---

Can You please assist/ help/ advice ?

[joehillen]

You're going to have a tough time resolving the dependencies. I recommend using the dev container instead.

[kyouko-taiga]

I have no experience building on linux platforms or using CMAKE but I know that LLVM is sometimes capricious when it comes to its own dependencies. I would look for solutions to similar issues encountered in other project, as I suspect the error you have can easily occur in other build setups.

I see that you tried setting up ZLIB_ROOT but it seems the Internet also suggests other flags.

[tomaszdrozdz]

It was zlib-ng-devel rpm
and
-D ZLIB_LIBRARY=/usr/lib64/libz-ng.so -D ZLIB_INCLUDE_DIR=/usr/include/
flags.

So whole line is:
> cmake -D ZLIB_LIBRARY=/usr/lib64/libz-ng.so -D ZLIB_INCLUDE_DIR=/usr/include/ -D CMAKE_BUILD_TYPE=Release -D LLVM_DIR=/usr/lib64/llvm17/lib/cmake/llvm -DBUILD_TESTING=1 -DLLVM_ENABLE_ASSERTIONS=ON -G Ninja -S . -B /opt/hylo/build/

and it works - thank You :)

But now:
> cmake --build /opt/hylo/build/

[56/230] Linking Swift executable Sources/hc
FAILED: Sources/hc 
: && /usr/bin/swiftc -j 4 -num-threads 4 -emit-executable -o Sources/hc -O -swift-version 5 Sources/CMakeFiles/hc.dir/hc/FullPathInFatalErrors.swift.o Sources/CMakeFiles/hc.dir/hc/main.swift.o  -L /opt/hylo/build/Sources  -L /opt/hylo/build/_deps/durian-build/Sources  -L /opt/hylo/build/_deps/swifty-llvm-build/Sources  -L /opt/hylo/build/Sources  -L /opt/hylo/build/_deps/swifty-llvm-build/Sources  -L /opt/hylo/build/_deps/swifty-llvm-build/Sources  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /usr/lib64/llvm17/lib  -L /opt/hylo/build/Sources  -L /opt/hylo/build/Sources  -L /opt/hylo/build/Sources  -L /opt/hylo/build/_deps/durian-build/Sources  -L /opt/hylo/build/Sources  -L /opt/hylo/build/Sources  -L /opt/hylo/build/Sources  -L /opt/hylo/build/_deps/swiftnumerics-build/Sources/RealModule  -L /opt/hylo/build/_deps/swiftargumentparser-build/Sources/ArgumentParser  -L /opt/hylo/build/_deps/swiftargumentparser-build/Sources/ArgumentParserToolInfo  -L /opt/hylo/build/_deps/swiftcollections-build/Sources/Collections  -L /opt/hylo/build/_deps/swiftcollections-build/Sources/OrderedCollections  -L /opt/hylo/build/_deps/swiftcollections-build/Sources/DequeModule   -L /usr/lib/gcc/x86_64-redhat-linux/14 Sources/libDriver.a  _deps/durian-build/Sources/libDurian.a  _deps/swifty-llvm-build/Sources/libSwiftyLLVM.a  Sources/libCodeGenLLVM.a  _deps/swifty-llvm-build/Sources/libSwiftyLLVM.a  _deps/swifty-llvm-build/Sources/libllvmshims.a  /usr/lib64/llvm17/lib/libLLVMPasses.a  /usr/lib64/llvm17/lib/libLLVMCoroutines.a  /usr/lib64/llvm17/lib/libLLVMipo.a  /usr/lib64/llvm17/lib/libLLVMLinker.a  /usr/lib64/llvm17/lib/libLLVMFrontendOpenMP.a  /usr/lib64/llvm17/lib/libLLVMIRPrinter.a  /usr/lib64/llvm17/lib/libLLVMVectorize.a  /usr/lib64/llvm17/lib/libLLVMX86CodeGen.a  /usr/lib64/llvm17/lib/libLLVMInstrumentation.a  /usr/lib64/llvm17/lib/libLLVMAsmPrinter.a  /usr/lib64/llvm17/lib/libLLVMCFGuard.a  /usr/lib64/llvm17/lib/libLLVMGlobalISel.a  /usr/lib64/llvm17/lib/libLLVMSelectionDAG.a  /usr/lib64/llvm17/lib/libLLVMCodeGen.a  /usr/lib64/llvm17/lib/libLLVMBitWriter.a  /usr/lib64/llvm17/lib/libLLVMObjCARCOpts.a  /usr/lib64/llvm17/lib/libLLVMScalarOpts.a  /usr/lib64/llvm17/lib/libLLVMAggressiveInstCombine.a  /usr/lib64/llvm17/lib/libLLVMInstCombine.a  /usr/lib64/llvm17/lib/libLLVMTransformUtils.a  /usr/lib64/llvm17/lib/libLLVMTarget.a  /usr/lib64/llvm17/lib/libLLVMAnalysis.a  /usr/lib64/llvm17/lib/libLLVMProfileData.a  /usr/lib64/llvm17/lib/libLLVMSymbolize.a  /usr/lib64/llvm17/lib/libLLVMDebugInfoDWARF.a  /usr/lib64/llvm17/lib/libLLVMDebugInfoPDB.a  /usr/lib64/llvm17/lib/libLLVMObject.a  /usr/lib64/llvm17/lib/libLLVMIRReader.a  /usr/lib64/llvm17/lib/libLLVMBitReader.a  /usr/lib64/llvm17/lib/libLLVMAsmParser.a  /usr/lib64/llvm17/lib/libLLVMTextAPI.a  /usr/lib64/llvm17/lib/libLLVMDebugInfoMSF.a  /usr/lib64/llvm17/lib/libLLVMDebugInfoBTF.a  /usr/lib64/llvm17/lib/libLLVMCore.a  /usr/lib64/llvm17/lib/libLLVMRemarks.a  /usr/lib64/llvm17/lib/libLLVMBitstreamReader.a  /usr/lib64/llvm17/lib/libLLVMX86AsmParser.a  /usr/lib64/llvm17/lib/libLLVMMCParser.a  /usr/lib64/llvm17/lib/libLLVMX86Desc.a  /usr/lib64/llvm17/lib/libLLVMCodeGenTypes.a  /usr/lib64/llvm17/lib/libLLVMX86Disassembler.a  /usr/lib64/llvm17/lib/libLLVMMCDisassembler.a  /usr/lib64/llvm17/lib/libLLVMX86Info.a  /usr/lib64/llvm17/lib/libLLVMMC.a  /usr/lib64/llvm17/lib/libLLVMBinaryFormat.a  /usr/lib64/llvm17/lib/libLLVMTargetParser.a  /usr/lib64/llvm17/lib/libLLVMDebugInfoCodeView.a  /usr/lib64/llvm17/lib/libLLVMSupport.a  /usr/lib64/llvm17/lib/libLLVMDemangle.a  -lrt  -ldl  -lm  /usr/lib64/libz-ng.so  /usr/lib64/libtinfo.so  Sources/libIR.a  Sources/libStandardLibrary.a  Sources/libFrontEnd.a  _deps/durian-build/Sources/libDurian.a  Sources/libUtils.a  Sources/libBigInt.a  Sources/libAlgorithms.a  _deps/swiftnumerics-build/Sources/RealModule/libRealModule.a  _deps/swiftargumentparser-build/Sources/ArgumentParser/libArgumentParser.a  -lFoundation  _deps/swiftargumentparser-build/Sources/ArgumentParserToolInfo/libArgumentParserToolInfo.a  _deps/swiftcollections-build/Sources/Collections/libCollections.a  _deps/swiftcollections-build/Sources/OrderedCollections/libOrderedCollections.a  _deps/swiftcollections-build/Sources/DequeModule/libDequeModule.a  -lgcc  -lgcc_s  -lc  -lgcc  -lgcc_s  -lstdc++  -lm  -lgcc_s  -lgcc  -lc  -lgcc_s  -lgcc && :
error: link command failed with exit code 1 (use -v to see invocation)
/usr/lib64/llvm17/lib/libLLVMSupport.a(Compression.cpp.o):function llvm::compression::zlib::compress(llvm::ArrayRef<unsigned char>, llvm::SmallVectorImpl<unsigned char>&, int):(.text._ZN4llvm11compression4zlib8compressENS_8ArrayRefIhEERNS_15SmallVectorImplIhEEi+0x2d): error: undefined reference to 'compressBound'
/usr/lib64/llvm17/lib/libLLVMSupport.a(Compression.cpp.o):function llvm::compression::zlib::compress(llvm::ArrayRef<unsigned char>, llvm::SmallVectorImpl<unsigned char>&, int):(.text._ZN4llvm11compression4zlib8compressENS_8ArrayRefIhEERNS_15SmallVectorImplIhEEi+0x71): error: undefined reference to 'compress2'
/usr/lib64/llvm17/lib/libLLVMSupport.a(Compression.cpp.o):function llvm::compression::decompress(llvm::DebugCompressionType, llvm::ArrayRef<unsigned char>, unsigned char*, unsigned long):(.text._ZN4llvm11compression10decompressENS_20DebugCompressionTypeENS_8ArrayRefIhEEPhm+0x2e): error: undefined reference to 'uncompress'
/usr/lib64/llvm17/lib/libLLVMSupport.a(Compression.cpp.o):function llvm::compression::zlib::decompress(llvm::ArrayRef<unsigned char>, unsigned char*, unsigned long&):(.text._ZN4llvm11compression4zlib10decompressENS_8ArrayRefIhEEPhRm+0x33): error: undefined reference to 'uncompress'
/usr/lib64/llvm17/lib/libLLVMSupport.a(Compression.cpp.o):function llvm::compression::zlib::decompress(llvm::ArrayRef<unsigned char>, llvm::SmallVectorImpl<unsigned char>&, unsigned long):(.text._ZN4llvm11compression4zlib10decompressENS_8ArrayRefIhEERNS_15SmallVectorImplIhEEm+0x72): error: undefined reference to 'uncompress'
/usr/lib64/llvm17/lib/libLLVMSupport.a(CRC.cpp.o):function llvm::crc32(unsigned int, llvm::ArrayRef<unsigned char>):(.text._ZN4llvm5crc32EjNS_8ArrayRefIhEE+0x36): error: undefined reference to 'crc32'
/usr/lib64/llvm17/lib/libLLVMSupport.a(CRC.cpp.o):function llvm::crc32(llvm::ArrayRef<unsigned char>):(.text._ZN4llvm5crc32ENS_8ArrayRefIhEE+0x36): error: undefined reference to 'crc32'
/usr/lib64/llvm17/lib/libLLVMSupport.a(CRC.cpp.o):function llvm::JamCRC::update(llvm::ArrayRef<unsigned char>):(.text._ZN4llvm6JamCRC6updateENS_8ArrayRefIhEE+0x46): error: undefined reference to 'crc32'
clang: error: linker command failed with exit code 1 (use -v to see invocation)
[57/230] Building Swift Module 'SwiftParser' with 45 sources
ninja: build stopped: subcommand failed.

[tomaszdrozdz]

zlib-ng-devel rpm provides /usr/lib64/libz-ng.so:

readelf -a /usr/lib64/libz-ng.so | grep crc32

shows nothing.

But zlib-ng-compat rpm provides /usr/lib64/libz.so.1:

> readelf -a /usr/lib64/libz.so.1 | grep crc32
29: 0000000000007cc0    35 FUNC    GLOBAL DEFAULT    7 crc32_z@@ZLIB_1.2.9
55: 0000000000007cf0    35 FUNC    GLOBAL DEFAULT    7 crc32

So instead -D ZLIB_LIBRARY=/usr/lib64/libz-ng.so I use -D ZLIB_LIBRARY=/usr/lib64/libz.so.1 and building goes OK.

(I was afraid that it will not work because -D ZLIB_INCLUDE_DIR=/usr/include/ comes from zlib-ng-devel rpm, but -D ZLIB_LIBRARY=/usr/lib64/libz-ng.so comes from zlib-ng-compat rpm.)

Also tests goes OK

> ctest --parallel --test-dir /opt/hylo/build/
...
100% tests passed, 0 tests failed out of 32
Total Test time (real) = 583.21 sec