[BUG] CMake Error "The required target arrow_compute is not in any export set when calling with target arrow_static"

[NvTimLiu]

Describe the bug
CMake Error "The required target arrow_compute is not in any export set when calling with target arrow_static", after PR Upgrade arrow to 16  got merged

  -- ---------------------------------------------------------------------
  -- Arrow version:                                 16.0.0
  -- 
  -- Build configuration summary:
  --   Generator: Ninja
  --   Build type: RELEASE
  --   Source directory: /home/jenkins/agent/workspace/jenkins-cudf_nightly-dev-github-1246-cuda12/cpp/build/_deps/arrow-src/cpp
  --   Install prefix: /usr/local/rapids
  -- Installing: /home/jenkins/agent/workspace/jenkins-cudf_nightly-dev-github-1246-cuda12/cpp/build/_deps/arrow-src/cpp/src/arrow/util/config.h
  -- CPM: Adding package [email protected] (v0.8)
  -- CPM: Adding package [email protected] (2101cb31d0210b609cd02c88f9b538e10881d91d)
  -- CPM: Adding package [email protected] (v1.13.0)
  -- Could NOT find Python (missing: Python_EXECUTABLE Interpreter) 
  -- Found cuFile: /usr/local/cuda/lib64/libcufile.so  
  -- CPM: Adding package [email protected] (branch-24.06)
  -- Found cuFile Batch API: TRUE
  -- Found cuFile Stream API: TRUE
  -- CPM: Adding package [email protected] (11e73a8c85b45e3d49c8c541b4e1497a649fe03c)
  -- Building using CMake version: 3.26.4
  -- Configuring done (216.0s)
  CMake Error in CMakeLists.txt:
    export called with target "arrow_static" which requires target
    "arrow_array" that is not in any export set.
  
  
  CMake Error in CMakeLists.txt:
    export called with target "arrow_static" which requires target
    "arrow_compute" that is not in any export set.
  
  CMake Error in CMakeLists.txt:
    export called with target "arrow_static" which requires target
    "arrow_filesystem" that is not in any export set.
  
  CMake Error in CMakeLists.txt:
    export called with target "arrow_static" which requires target "arrow_io"
    that is not in any export set.
  
  CMake Error in CMakeLists.txt:
    export called with target "arrow_static" which requires target "arrow_ipc"
    that is not in any export set.
  
  CMake Error in CMakeLists.txt:
    export called with target "arrow_static" which requires target
    "arrow_memory_pool" that is not in any export set.
  
  CMake Error in CMakeLists.txt:
    export called with target "arrow_static" which requires target "arrow_util"
    that is not in any export set.
  
  CMake Error in CMakeLists.txt:
    export called with target "arrow_static" which requires target
    "arrow_vendored" that is not in any export set.
  
  -- Generating done (2.6s)
  CMake Generate step failed.  Build files cannot be regenerated correctly.

Steps/Code to reproduce bug
Follow this guide to run build in docker container
https://github.com/rapidsai/cudf/blob/branch-24.06/java/ci/README.md

[NvTimLiu]

@galipremsagar

[davidwendt]

This maybe the same as #15714

[NvTimLiu]

dup to #15714