Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deployment is failing on main #2623

Open
4 tasks done
sacpis opened this issue Feb 15, 2025 · 0 comments
Open
4 tasks done

Deployment is failing on main #2623

sacpis opened this issue Feb 15, 2025 · 0 comments
Labels
build The issue related to the CUDA Quantum build

Comments

@sacpis
Copy link
Collaborator

sacpis commented Feb 15, 2025

Required prerequisites

  • Consult the security policy. If reporting a security vulnerability, do not report the bug using this form. Use the process described in the policy to report the issue.
  • Make sure you've read the documentation. Your issue may be addressed there.
  • Search the issue tracker to verify that this hasn't already been reported. +1 or comment there if it has.
  • If possible, make a PR with a failing test to give us a starting point to work on!

Describe the bug

Deployment is failing with Segmentation fault on the main branch due to failure in test_mpi_api.py

Steps to reproduce the bug

Here is the job
https://github.com/NVIDIA/cuda-quantum/actions/runs/13335693612/job/37254100357#step:8:6360

Fatal Python error: Segmentation fault

Current thread 0x0000e3b78e679800 (most recent call first):
  File "/tmp/tests/parallel/test_mpi_api.py", line 19 in testMPI
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/python.py", line 159 in pytest_pyfunc_call
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_callers.py", line 103 in _multicall
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_manager.py", line 120 in _hookexec
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_hooks.py", line 513 in __call__
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/python.py", line 1627 in runtest
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 174 in pytest_runtest_call
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_callers.py", line 103 in _multicall
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_manager.py", line 120 in _hookexec
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_hooks.py", line 513 in __call__
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 242 in <lambda>
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 341 in from_call
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 241 in call_and_report
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 132 in runtestprotocol
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 113 in pytest_runtest_protocol
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_callers.py", line 103 in _multicall
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_manager.py", line 120 in _hookexec
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_hooks.py", line 513 in __call__
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/main.py", line 362 in pytest_runtestloop
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_callers.py", line 103 in _multicall
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_manager.py", line 120 in _hookexec
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_hooks.py", line 513 in __call__
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/main.py", line 337 in _main
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/main.py", line 283 in wrap_session
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/main.py", line 330 in pytest_cmdline_main
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_callers.py", line 103 in _multicall
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_manager.py", line 120 in _hookexec
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_hooks.py", line 513 in __call__
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/config/__init__.py", line 175 in main
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/config/__init__.py", line 201 in console_main
  File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pytest/__main__.py", line 9 in <module>
  File "<frozen runpy>", line 88 in _run_code
  File "<frozen runpy>", line 198 in _run_module_as_main

Extension modules: numpy._core._multiarray_umath, numpy.linalg._umath_linalg, scipy._lib._ccallback_c, cuquantum.bindings._utils, cuquantum.bindings._internal.cudensitymat, cuquantum.bindings.cycudensitymat, cuquantum.bindings.cudensitymat, cuquantum._utils, cuquantum.custatevec._internal.custatevec, cuquantum.custatevec.cycustatevec, cuquantum.custatevec.custatevec, cupy_backends.cuda._softlink, cupy_backends.cuda.api._runtime_enum, cupy_backends.cuda.api.runtime, cupy._util, cupy.cuda.device, fastrlock.rlock, cupy.cuda.memory_hook, cupy_backends.cuda.stream, cupy.cuda.graph, cupy.cuda.stream, cupy_backends.cuda.api._driver_enum, cupy_backends.cuda.api.driver, cupy.cuda.memory, cupy._core.internal, cupy._core._carray, cupy.cuda.texture, cupy.cuda.function, cupy_backends.cuda.libs.nvrtc, cupy.cuda.pinned_memory, cupy.cuda.common, cupy.cuda.cub, cupy_backends.cuda.libs.nvtx, cupy.cuda.thrust, cupy._core._dtype, cupy._core._scalar, cupy._core._accelerator, cupy._core._memory_range, cupy._core._fusion_thread_local, cupy._core._kernel, cupy._core._routines_manipulation, cupy._core._routines_binary, cupy._core._optimize_config, cupy._core._cub_reduction, cupy._core._reduction, cupy._core._routines_math, cupy._core._routines_indexing, cupy._core._routines_linalg, cupy._core._routines_logic, cupy._core._routines_sorting, cupy._core._routines_statistics, cupy._core.dlpack, cupy._core.flags, cupy._core.core, cupy._core._fusion_variable, cupy._core._fusion_trace, cupy._core._fusion_kernel, cupy._core.new_fusion, cupy._core.fusion, cupy._core.raw, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, charset_normalizer.md, scipy.sparse._sparsetools, _csparsetools, scipy.sparse._csparsetools, scipy.linalg._fblas, scipy.linalg._flapack, scipy.linalg.cython_lapack, scipy.linalg._cythonized_array_utils, scipy.linalg._solve_toeplitz, scipy.linalg._decomp_lu_cython, scipy.linalg._matfuncs_sqrtm_triu, scipy.linalg._matfuncs_expm, scipy.linalg._linalg_pythran, scipy.linalg.cython_blas, scipy.linalg._decomp_update, scipy.sparse.linalg._dsolve._superlu, scipy.sparse.linalg._eigen.arpack._arpack, scipy.sparse.linalg._propack._spropack, scipy.sparse.linalg._propack._dpropack, scipy.sparse.linalg._propack._cpropack, scipy.sparse.linalg._propack._zpropack, scipy.sparse.csgraph._tools, scipy.sparse.csgraph._shortest_path, scipy.sparse.csgraph._traversal, scipy.sparse.csgraph._min_spanning_tree, scipy.sparse.csgraph._flow, scipy.sparse.csgraph._matching, scipy.sparse.csgraph._reordering, cupy.fft._cache, cupy.fft._callback, cupy.random._bit_generator, scipy._lib._uarray._uarray, scipy.special._ufuncs_cxx, scipy.special._ufuncs, scipy.special._specfun, scipy.special._comb, scipy.special._ellip_harm_2, cupy.lib._polynomial, cuquantum.cutensornet._internal.cutensornet, cuquantum.cutensornet.cycutensornet, cuquantum.cutensornet.cutensornet, scipy.integrate._odepack, scipy.integrate._quadpack, scipy.integrate._vode, scipy.integrate._dop, scipy.integrate._lsoda, scipy.optimize._group_columns, scipy._lib.messagestream, scipy.optimize._trlib._trlib, scipy.optimize._lbfgsb, _moduleTNC, scipy.optimize._moduleTNC, scipy.optimize._cobyla, scipy.optimize._slsqp, scipy.optimize._minpack, scipy.optimize._lsq.givens_elimination, scipy.optimize._zeros, scipy.optimize._cython_nnls, scipy.linalg._decomp_interpolative, scipy.optimize._bglu_dense, scipy.optimize._lsap, scipy.spatial._ckdtree, scipy.spatial._qhull, scipy.spatial._voronoi, scipy.spatial._distance_wrap, scipy.spatial._hausdorff, scipy.spatial.transform._rotation, scipy.optimize._direct (total: 137)
tmp/tests/parallel/test_mpi_api.py::testMPI 
collecting 1 item                                                              
collected 1 item                                                               

collecting 1 item                                                              
collected 1 item                                                               

tmp/tests/parallel/test_mpi_api.py::testMPI 
tmp/tests/parallel/test_mpi_api.py::testMPI 
collecting 1 item                                                              
collected 1 item                                                               

Fatal Python error: Segmentation fault

Current thread 0x0000f777b2a9c800 (most recent call first):
  File "/tmp/tests/parallel/test_mpi_api.py", line 19 in Fatal Python error: Segmentation fault

Expected behavior

Should run successfully

Is this a regression? If it is, put the last known working version (or commit) here.

Not a regression

Environment

  • CUDA-Q version: 11272024
  • Python version: 3.10.12
  • C++ compiler: 11272024
  • Operating system:

Suggestions

No response

@schweitzpgi schweitzpgi added the build The issue related to the CUDA Quantum build label Feb 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build The issue related to the CUDA Quantum build
Projects
None yet
Development

No branches or pull requests

2 participants