deepspeed v0.12.3 #40
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…nda-forge-pinning 2023.11.13.15.41.39
regro-cf-autotick-bot
requested review from
loadams and
weiji14
as code owners
|
Hi! This is the friendly automated conda-forge-linting service. I just wanted to let you know that I linted all conda-recipes in your PR ( |
|
The builds on OSX ARM are failing at the test step on TEST START: /Users/runner/miniforge3/conda-bld/osx-64/deepspeed-0.12.3-cpu_py311hcced6b1_1.conda
Renaming work directory '/Users/runner/miniforge3/conda-bld/deepspeed_1699925507117/work' to '/Users/runner/miniforge3/conda-bld/deepspeed_1699925507117/work_moved_deepspeed-0.12.3-cpu_py311hcced6b1_1_osx-64'
shutil.move(work)=/Users/runner/miniforge3/conda-bld/deepspeed_1699925507117/work, dest=/Users/runner/miniforge3/conda-bld/deepspeed_1699925507117/work_moved_deepspeed-0.12.3-cpu_py311hcced6b1_1_osx-64)
Reloading output folder (local): ...working... done
Solving environment (_test_env): ...working... done
## Package Plan ##
environment location: /Users/runner/miniforge3/conda-bld/deepspeed_1699925507117/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_plac
The following NEW packages will be INSTALLED:
annotated-types: 0.6.0-pyhd8ed1ab_0 conda-forge
bzip2: 1.0.8-h10d778d_5 conda-forge
ca-certificates: 2023.7.22-h8857fd0_0 conda-forge
colorama: 0.4.6-pyhd8ed1ab_0 conda-forge
deepspeed: 0.12.3-cpu_py311hcced6b1_1 local
filelock: 3.13.1-pyhd8ed1ab_0 conda-forge
fsspec: 2023.10.0-pyhca7485f_0 conda-forge
gmp: 6.3.0-h93d8f39_0 conda-forge
gmpy2: 2.1.2-py311hc5b4402_1 conda-forge
hjson-py: 3.1.0-pyhd8ed1ab_0 conda-forge
jinja2: 3.1.2-pyhd8ed1ab_1 conda-forge
libabseil: 20230802.1-cxx17_h048a20a_0 conda-forge
libblas: 3.9.0-19_osx64_openblas conda-forge
libcblas: 3.9.0-19_osx64_openblas conda-forge
libcxx: 16.0.6-hd57cbcb_0 conda-forge
libexpat: 2.5.0-hf0c8a7f_1 conda-forge
libffi: 3.4.2-h0d85af4_5 conda-forge
libgfortran: 5.0.0-13_2_0_h97931a8_1 conda-forge
libgfortran5: 13.2.0-h2873a65_1 conda-forge
liblapack: 3.9.0-19_osx64_openblas conda-forge
libopenblas: 0.3.24-openmp_h48a4ad5_0 conda-forge
libprotobuf: 4.24.4-h0ee05dc_0 conda-forge
libsqlite: 3.44.0-h92b6c6a_0 conda-forge
libuv: 1.46.0-h0c2f820_0 conda-forge
libzlib: 1.2.13-h8a1eda9_5 conda-forge
llvm-openmp: 17.0.4-hb6ac08f_0 conda-forge
markupsafe: 2.1.3-py311h2725bcf_1 conda-forge
mkl: 2022.2.1-h44ed08c_16952 conda-forge
mpc: 1.3.1-h81bd1dd_0 conda-forge
mpfr: 4.2.1-h0c69b56_0 conda-forge
mpmath: 1.3.0-pyhd8ed1ab_0 conda-forge
ncurses: 6.4-h93d8f39_2 conda-forge
networkx: 3.2.1-pyhd8ed1ab_0 conda-forge
ninja: 1.11.1-hb8565cd_0 conda-forge
numpy: 1.26.0-py311hc44ba51_0 conda-forge
openssl: 3.1.4-hd75f5a5_0 conda-forge
packaging: 23.2-pyhd8ed1ab_0 conda-forge
pip: 23.3.1-pyhd8ed1ab_0 conda-forge
psutil: 5.9.5-py311h2725bcf_1 conda-forge
py-cpuinfo: 9.0.0-pyhd8ed1ab_0 conda-forge
pydantic: 2.4.2-pyhd8ed1ab_1 conda-forge
pydantic-core: 2.10.1-py311h299eb51_0 conda-forge
pynvml: 11.5.0-pyhd8ed1ab_0 conda-forge
python: 3.11.6-h30d4d87_0_cpython conda-forge
python_abi: 3.11-4_cp311 conda-forge
pytorch: 2.1.0-cpu_mkl_py311h5cbed28_100 conda-forge
readline: 8.2-h9e318b2_1 conda-forge
setuptools: 68.2.2-pyhd8ed1ab_0 conda-forge
sleef: 3.5.1-h6db0672_2 conda-forge
sympy: 1.12-pypyh9d50eac_103 conda-forge
tbb: 2021.10.0-h1c7c39f_2 conda-forge
tk: 8.6.13-h1abcd95_1 conda-forge
tqdm: 4.66.1-pyhd8ed1ab_0 conda-forge
typing-extensions: 4.8.0-hd8ed1ab_0 conda-forge
typing_extensions: 4.8.0-pyha770c72_0 conda-forge
tzdata: 2023c-h71feb2d_0 conda-forge
wheel: 0.41.3-pyhd8ed1ab_0 conda-forge
xz: 5.2.6-h775f41a_0 conda-forge
Preparing transaction: ...working... done
Verifying transaction: ...working... done
Executing transaction: ...working... done
export PREFIX=/Users/runner/miniforge3/conda-bld/deepspeed_1699925507117/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_plac
export SRC_DIR=/Users/runner/miniforge3/conda-bld/deepspeed_1699925507117/test_tmp
import: 'deepspeed'
2023-11-14 01:38:08.332 python[5505:47929] -[MPSGraphExecutionDescriptor setEnableCommitAndContinue:]: unrecognized selector sent to instance 0x7f9cf35c92c0
2023-11-14 01:38:08.344 python[5505:47929] *** Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '-[MPSGraphExecutionDescriptor setEnableCommitAndContinue:]: unrecognized selector sent to instance 0x7f9cf35c92c0'
*** First throw call stack:
(
0 CoreFoundation 0x00007fff2049a88f __exceptionPreprocess + 242
1 libobjc.A.dylib 0x00007fff201d3bbb objc_exception_throw + 48
2 CoreFoundation 0x00007fff2051d3d8 -[NSObject(NSObject) __retain_OA] + 0
3 CoreFoundation 0x00007fff2040299d ___forwarding___ + 1448
4 CoreFoundation 0x00007fff20402368 _CF_forwarding_prep_0 + 120
5 libtorch_cpu.dylib 0x000000012046173d _ZN2at3mps9MPSStreamC2EN3c106StreamE + 189
6 libtorch_cpu.dylib 0x00000001204622ef _ZN2at3mps19getDefaultMPSStreamEv + 47
7 libtorch_cpu.dylib 0x000000012044a48a _ZN2at3mps13HeapAllocator20MPSHeapAllocatorImplC2Ev + 762
8 libtorch_cpu.dylib 0x000000012044936c _ZN2at3mps12MPSAllocatorC2Ej + 444
9 libtorch_cpu.dylib 0x0000000120449146 _ZN2at3mps16getIMPSAllocatorEb + 182
10 libtorch_cpu.dylib 0x000000012045389b _ZNK2at3mps8MPSHooks25getCurrentAllocatedMemoryEv + 11
11 libtorch_python.dylib 0x000000011619d2d0 _ZN5torch3mpsL32MPSModule_currentAllocatedMemoryEP7_objectS2_ + 48
12 python 0x000000010e4ad37d cfunction_vectorcall_NOARGS + 93
13 python 0x000000010e59f174 _PyEval_EvalFrameDefault + 234452
14 python 0x000000010e563b1a _PyEval_Vector + 1658
15 python 0x000000010e55c4fd builtin___build_class__ + 381
16 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
17 python 0x000000010e59f174 _PyEval_EvalFrameDefault + 234452
18 python 0x000000010e563b1a _PyEval_Vector + 1658
19 python 0x000000010e56342a PyEval_EvalCode + 250
20 python 0x000000010e55e35b builtin_exec + 379
21 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
22 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
23 python 0x000000010e44880a _PyFunction_Vectorcall + 490
24 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
25 python 0x000000010e44c7c7 object_vacall + 407
26 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
27 python 0x000000010e5e4066 PyImport_ImportModuleLevelObject + 3190
28 python 0x000000010e55cbe1 builtin___import__ + 289
29 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
30 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
31 python 0x000000010e44880a _PyFunction_Vectorcall + 490
32 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
33 python 0x000000010e44c7c7 object_vacall + 407
34 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
35 python 0x000000010e5e38ad PyImport_ImportModuleLevelObject + 1213
36 python 0x000000010e58e60f _PyEval_EvalFrameDefault + 165999
37 python 0x000000010e563b1a _PyEval_Vector + 1658
38 python 0x000000010e56342a PyEval_EvalCode + 250
39 python 0x000000010e55e35b builtin_exec + 379
40 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
41 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
42 python 0x000000010e44880a _PyFunction_Vectorcall + 490
43 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
44 python 0x000000010e44c7c7 object_vacall + 407
45 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
46 python 0x000000010e5e4066 PyImport_ImportModuleLevelObject + 3190
47 python 0x000000010e58e60f _PyEval_EvalFrameDefault + 165999
48 python 0x000000010e563b1a _PyEval_Vector + 1658
49 python 0x000000010e56342a PyEval_EvalCode + 250
50 python 0x000000010e55e35b builtin_exec + 379
51 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
52 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
53 python 0x000000010e44880a _PyFunction_Vectorcall + 490
54 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
55 python 0x000000010e44c7c7 object_vacall + 407
56 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
57 python 0x000000010e5e4066 PyImport_ImportModuleLevelObject + 3190
58 python 0x000000010e55cbe1 builtin___import__ + 289
59 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
60 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
61 python 0x000000010e44880a _PyFunction_Vectorcall + 490
62 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
63 python 0x000000010e44c7c7 object_vacall + 407
64 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
65 python 0x000000010e5e38ad PyImport_ImportModuleLevelObject + 1213
66 python 0x000000010e58e60f _PyEval_EvalFrameDefault + 165999
67 python 0x000000010e563b1a _PyEval_Vector + 1658
68 python 0x000000010e56342a PyEval_EvalCode + 250
69 python 0x000000010e55e35b builtin_exec + 379
70 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
71 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
72 python 0x000000010e44880a _PyFunction_Vectorcall + 490
73 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
74 python 0x000000010e44c7c7 object_vacall + 407
75 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
76 python 0x000000010e5e4066 PyImport_ImportModuleLevelObject + 3190
77 python 0x000000010e58e60f _PyEval_EvalFrameDefault + 165999
78 python 0x000000010e563b1a _PyEval_Vector + 1658
79 python 0x000000010e56342a PyEval_EvalCode + 250
80 python 0x000000010e55e35b builtin_exec + 379
81 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
82 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
83 python 0x000000010e44880a _PyFunction_Vectorcall + 490
84 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
85 python 0x000000010e44c7c7 object_vacall + 407
86 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
87 python 0x000000010e5e4066 PyImport_ImportModuleLevelObject + 3190
88 python 0x000000010e58e60f _PyEval_EvalFrameDefault + 165999
89 python 0x000000010e563b1a _PyEval_Vector + 1658
90 python 0x000000010e56342a PyEval_EvalCode + 250
91 python 0x000000010e55e35b builtin_exec + 379
92 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
93 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
94 python 0x000000010e44880a _PyFunction_Vectorcall + 490
95 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
96 python 0x000000010e44c7c7 object_vacall + 407
97 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
98 python 0x000000010e5e4066 PyImport_ImportModuleLevelObject + 3190
99 python 0x000000010e58e60f _PyEval_EvalFrameDefault + 165999
100 python 0x000000010e563b1a _PyEval_Vector + 1658
101 python 0x000000010e56342a PyEval_EvalCode + 250
102 python 0x000000010e55e35b builtin_exec + 379
103 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
104 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
105 python 0x000000010e44880a _PyFunction_Vectorcall + 490
106 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
107 python 0x000000010e44c7c7 object_vacall + 407
108 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
109 python 0x000000010e5e4066 PyImport_ImportModuleLevelObject + 3190
110 python 0x000000010e55cbe1 builtin___import__ + 289
111 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
112 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
113 python 0x000000010e44880a _PyFunction_Vectorcall + 490
114 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
115 python 0x000000010e44c7c7 object_vacall + 407
116 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
117 python 0x000000010e5e38ad PyImport_ImportModuleLevelObject + 1213
118 python 0x000000010e58e60f _PyEval_EvalFrameDefault + 165999
119 python 0x000000010e563b1a _PyEval_Vector + 1658
120 python 0x000000010e56342a PyEval_EvalCode + 250
121 python 0x000000010e55e35b builtin_exec + 379
122 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
123 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
124 python 0x000000010e44880a _PyFunction_Vectorcall + 490
125 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
126 python 0x000000010e44c7c7 object_vacall + 407
127 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
128 python 0x000000010e5e4066 PyImport_ImportModuleLevelObject + 3190
129 python 0x000000010e55cbe1 builtin___import__ + 289
130 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
131 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
132 python 0x000000010e44880a _PyFunction_Vectorcall + 490
133 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
134 python 0x000000010e44c7c7 object_vacall + 407
135 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
136 python 0x000000010e5e38ad PyImport_ImportModuleLevelObject + 1213
137 python 0x000000010e58e60f _PyEval_EvalFrameDefault + 165999
138 python 0x000000010e563b1a _PyEval_Vector + 1658
139 python 0x000000010e56342a PyEval_EvalCode + 250
140 python 0x000000010e55e35b builtin_exec + 379
141 python 0x000000010e4ad48f cfunction_vectorcall_FASTCALL_KEYWORDS + 95
142 python 0x000000010e5a58a2 _PyEval_EvalFrameDefault + 260866
143 python 0x000000010e44880a _PyFunction_Vectorcall + 490
144 python 0x000000010e4466ac _PyObject_VectorcallTstate.753 + 60
145 python 0x000000010e44c7c7 object_vacall + 407
146 python 0x000000010e44c5d2 PyObject_CallMethodObjArgs + 226
147 python 0x000000010e5e4066 PyImport_ImportModuleLevelObject + 3190
148 python 0x000000010e58e60f _PyEval_EvalFrameDefault + 165999
149 python 0x000000010e563b1a _PyEval_Vector + 1658
150 python 0x000000010e56342a PyEval_EvalCode + 250
151 python 0x000000010e610157 run_mod + 167
152 python 0x000000010e60ff65 pyrun_file + 133
153 python 0x000000010e60fa33 _PyRun_SimpleFileObject + 275
154 python 0x000000010e60f3df _PyRun_AnyFileObject + 143
155 python 0x000000010e63481b pymain_run_file_obj + 267
156 python 0x000000010e634235 pymain_run_file + 85
157 python 0x000000010e633bad Py_RunMain + 1965
158 python 0x000000010e3d7038 main + 56
159 libdyld.dylib 0x00007fff20343f3d start + 1
)
libc++abi: terminating with uncaught exception of type NSException
/Users/runner/miniforge3/conda-bld/deepspeed_1699925507117/test_tmp/conda_test_runner.sh: line 3: 5505 Abort trap: 6 "/Users/runner/miniforge3/conda-bld/deepspeed_1699925507117/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_plac/bin/python" -s "/Users/runner/miniforge3/conda-bld/deepspeed_1699925507117/test_tmp/
WARNING: Tests failed for deepspeed-0.12.3-cpu_py311hcced6b1_1.conda - moving package to /Users/runner/miniforge3/conda-bld/broken
TESTS FAILED: deepspeed-0.12.3-cpu_py311hcced6b1_1.conda
##[error]Bash exited with code '1'.
##[section]Finishing: Run OSX buildSeems like a segfault, and this is happening on #38 and #41 too. |
This was referenced Dec 16, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
It is very likely that the current package version for this feedstock is out of date.
Checklist before merging this PR:
license_fileis packagedInformation about this PR:
@conda-forge-admin,please add bot automergein the title and merge the resulting PR. This command will add our bot automerge feature to your feedstock.bot-rerunlabel to this PR. The bot will close this PR and schedule another one. If you do not have permissions to add this label, you can use the phrase@conda-forge-admin, please rerun botin a PR comment to have theconda-forge-adminadd it for you.Pending Dependency Version Updates
Here is a list of all the pending dependency version updates for this repo. Please double check all dependencies before merging.
Dependency Analysis
Please note that this analysis is highly experimental. The aim here is to make maintenance easier by inspecting the package's dependencies. Importantly this analysis does not support optional dependencies, please double check those before making changes. If you do not want hinting of this kind ever please add
bot: inspection: falseto yourconda-forge.yml. If you encounter issues with this feature please ping the bot teamconda-forge/bot.Analysis by grayskull shows a discrepancy between it and the the package's stated requirements in the meta.yaml.
Packages found by grayskull but not in the meta.yaml:
Packages found in the meta.yaml but not found by grayskull:
This PR was created by the regro-cf-autotick-bot. The regro-cf-autotick-bot is a service to automatically track the dependency graph, migrate packages, and propose package version updates for conda-forge. Feel free to drop us a line if there are any issues! This PR was generated by https://github.com/regro/cf-scripts/actions/runs/6857744114, please use this URL for debugging.