ERROR: Failed building wheel for xformers

[proto1994]

I am on Apple M1 Pro, and the python environment is 3.9.13. When I execute the following command, I get an error.

pip install --no-deps "xformers<0.0.26" trl peft accelerate bitsandbytes

Defaulting to user installation because normal site-packages is not writeable
Collecting xformers<0.0.26
Using cached xformers-0.0.25.post1.tar.gz (4.1 MB)
Preparing metadata (setup.py) ... done
Collecting trl
Using cached trl-0.8.6-py3-none-any.whl.metadata (11 kB)
Collecting peft
Using cached peft-0.10.0-py3-none-any.whl.metadata (13 kB)
Collecting accelerate
Using cached accelerate-0.29.3-py3-none-any.whl.metadata (18 kB)
Collecting bitsandbytes
Using cached bitsandbytes-0.42.0-py3-none-any.whl.metadata (9.9 kB)
Using cached trl-0.8.6-py3-none-any.whl (245 kB)
Using cached peft-0.10.0-py3-none-any.whl (199 kB)
Using cached accelerate-0.29.3-py3-none-any.whl (297 kB)
Using cached bitsandbytes-0.42.0-py3-none-any.whl (105.0 MB)
Building wheels for collected packages: xformers
Building wheel for xformers (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [248 lines of output]
running bdist_wheel
/Users/proto/Library/Python/3.9/lib/python/site-packages/torch/utils/cpp_extension.py:500: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
warnings.warn(msg.format('we could not find ninja.'))
running build
running build_py
creating build
creating build/lib.macosx-10.9-universal2-3.9
creating build/lib.macosx-10.9-universal2-3.9/xformers
copying xformers/_deprecation_warning.py -> build/lib.macosx-10.9-universal2-3.9/xformers
copying xformers/attn_bias_utils.py -> build/lib.macosx-10.9-universal2-3.9/xformers
copying xformers/checkpoint.py -> build/lib.macosx-10.9-universal2-3.9/xformers
copying xformers/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers
copying xformers/test.py -> build/lib.macosx-10.9-universal2-3.9/xformers
copying xformers/utils.py -> build/lib.macosx-10.9-universal2-3.9/xformers
copying xformers/_cpp_lib.py -> build/lib.macosx-10.9-universal2-3.9/xformers
copying xformers/info.py -> build/lib.macosx-10.9-universal2-3.9/xformers
creating build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/fused_linear_layer.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/vararg_kernel.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/k_activations.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/k_layer_norm.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/k_fused_matmul_fw.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/dropout.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/k_dropout.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/softmax.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/layer_norm.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/k_fused_matmul_bw.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
copying xformers/triton/k_softmax.py -> build/lib.macosx-10.9-universal2-3.9/xformers/triton
creating build/lib.macosx-10.9-universal2-3.9/xformers/components
copying xformers/components/simplicial_embedding.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components
copying xformers/components/residual.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components
copying xformers/components/reversible.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components
copying xformers/components/activations.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components
copying xformers/components/multi_head_dispatch.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components
copying xformers/components/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components
copying xformers/components/input_projection.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components
copying xformers/components/patch_embedding.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components
creating build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_mem_eff_attention.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_indexing.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_mlp.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_blocksparse_transformers.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_mem_eff_attn_decoder.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_transformer.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_revnet.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_swiglu.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_triton_layernorm.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_causal_blocksparse.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_triton_fused_linear.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_tiled_matmul.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_triton_blocksparse.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_triton_softmax.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_mem_eff_attention_mqa.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/utils.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_triton_dropout.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_nystrom_utils.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_attn_decoding.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_multi_head_dispatch.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_sequence_parallel_fused.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_sddmm.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_sp24.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
copying xformers/benchmarks/benchmark_core.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks
creating build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/rmsnorm.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/modpar_layers.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/swiglu_op.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/unbind.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/rope_padded.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/seqpar.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/ipc.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/sequence_parallel_fused_ops.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/sp24.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/common.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/differentiable_collectives.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/tiled_matmul.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
copying xformers/ops/indexing.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops
creating build/lib.macosx-10.9-universal2-3.9/xformers/profiler
copying xformers/profiler/device_limits.py -> build/lib.macosx-10.9-universal2-3.9/xformers/profiler
copying xformers/profiler/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/profiler
copying xformers/profiler/profiler_dcgm_impl.py -> build/lib.macosx-10.9-universal2-3.9/xformers/profiler
copying xformers/profiler/profiler_dcgm.py -> build/lib.macosx-10.9-universal2-3.9/xformers/profiler
copying xformers/profiler/api.py -> build/lib.macosx-10.9-universal2-3.9/xformers/profiler
copying xformers/profiler/slow_ops_profiler.py -> build/lib.macosx-10.9-universal2-3.9/xformers/profiler
copying xformers/profiler/profiler.py -> build/lib.macosx-10.9-universal2-3.9/xformers/profiler
creating build/lib.macosx-10.9-universal2-3.9/xformers/sparse
copying xformers/sparse/_csr_ops.py -> build/lib.macosx-10.9-universal2-3.9/xformers/sparse
copying xformers/sparse/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/sparse
copying xformers/sparse/utils.py -> build/lib.macosx-10.9-universal2-3.9/xformers/sparse
copying xformers/sparse/blocksparse_tensor.py -> build/lib.macosx-10.9-universal2-3.9/xformers/sparse
copying xformers/sparse/csr_tensor.py -> build/lib.macosx-10.9-universal2-3.9/xformers/sparse
creating build/lib.macosx-10.9-universal2-3.9/xformers/helpers
copying xformers/helpers/test_utils.py -> build/lib.macosx-10.9-universal2-3.9/xformers/helpers
copying xformers/helpers/hierarchical_configs.py -> build/lib.macosx-10.9-universal2-3.9/xformers/helpers
copying xformers/helpers/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/helpers
copying xformers/helpers/timm_sparse_attention.py -> build/lib.macosx-10.9-universal2-3.9/xformers/helpers
creating build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn
copying xformers/_flash_attn/fused_softmax.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn
copying xformers/_flash_attn/flash_blocksparse_attn_interface.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn
copying xformers/_flash_attn/flash_blocksparse_attention.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn
copying xformers/_flash_attn/bert_padding.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn
copying xformers/_flash_attn/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn
copying xformers/_flash_attn/flash_attn_triton_og.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn
copying xformers/_flash_attn/flash_attn_triton.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn
copying xformers/_flash_attn/flash_attn_interface.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn
creating build/lib.macosx-10.9-universal2-3.9/xformers/factory
copying xformers/factory/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/factory
copying xformers/factory/hydra_helper.py -> build/lib.macosx-10.9-universal2-3.9/xformers/factory
copying xformers/factory/block_factory.py -> build/lib.macosx-10.9-universal2-3.9/xformers/factory
copying xformers/factory/model_factory.py -> build/lib.macosx-10.9-universal2-3.9/xformers/factory
copying xformers/factory/block_configs.py -> build/lib.macosx-10.9-universal2-3.9/xformers/factory
copying xformers/factory/weight_init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/factory
creating build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/global_tokens.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/ortho.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/blocksparse.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/local.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/compositional.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/pooling.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/_sputnik_sparse.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/core.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/lambda_layer.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/random.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/fourier_mix.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/scaled_dot_product.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/utils.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/attention_mask.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/linformer.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/attention_patterns.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/visual.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/sparsity_config.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/nystrom.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/favor.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
copying xformers/components/attention/base.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention
creating build/lib.macosx-10.9-universal2-3.9/xformers/components/feedforward
copying xformers/components/feedforward/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/feedforward
copying xformers/components/feedforward/mixture_of_experts.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/feedforward
copying xformers/components/feedforward/mlp.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/feedforward
copying xformers/components/feedforward/conv_mlp.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/feedforward
copying xformers/components/feedforward/fused_mlp.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/feedforward
copying xformers/components/feedforward/base.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/feedforward
creating build/lib.macosx-10.9-universal2-3.9/xformers/components/positional_embedding
copying xformers/components/positional_embedding/vocab.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/positional_embedding
copying xformers/components/positional_embedding/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/positional_embedding
copying xformers/components/positional_embedding/param.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/positional_embedding
copying xformers/components/positional_embedding/sine.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/positional_embedding
copying xformers/components/positional_embedding/rotary.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/positional_embedding
copying xformers/components/positional_embedding/base.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/positional_embedding
creating build/lib.macosx-10.9-universal2-3.9/xformers/components/attention/feature_maps
copying xformers/components/attention/feature_maps/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention/feature_maps
copying xformers/components/attention/feature_maps/softmax.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention/feature_maps
copying xformers/components/attention/feature_maps/base.py -> build/lib.macosx-10.9-universal2-3.9/xformers/components/attention/feature_maps
creating build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA
copying xformers/benchmarks/LRA/batch_submit.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA
copying xformers/benchmarks/LRA/batch_fetch_results.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA
copying xformers/benchmarks/LRA/run_with_submitit.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA
copying xformers/benchmarks/LRA/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA
copying xformers/benchmarks/LRA/run_tasks.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA
copying xformers/benchmarks/LRA/run_grid_search.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA
creating build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA/code
copying xformers/benchmarks/LRA/code/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA/code
copying xformers/benchmarks/LRA/code/model_wrapper.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA/code
copying xformers/benchmarks/LRA/code/dataset.py -> build/lib.macosx-10.9-universal2-3.9/xformers/benchmarks/LRA/code
creating build/lib.macosx-10.9-universal2-3.9/xformers/ops/_triton
copying xformers/ops/_triton/k_scaled_index_add.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/_triton
copying xformers/ops/_triton/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/_triton
copying xformers/ops/_triton/rope_padded_kernels.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/_triton
copying xformers/ops/_triton/sequence_parallel_fused_kernels.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/_triton
copying xformers/ops/_triton/tiled_matmul_kernels.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/_triton
copying xformers/ops/_triton/k_index_select_cat.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/_triton
copying xformers/ops/_triton/rmsnorm_kernels.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/_triton
creating build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/decoder.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/dispatch.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/attn_bias.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/ck.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/common.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/ck_decoder.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/flash.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/small_k.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/cutlass.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/ck_splitk.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
copying xformers/ops/fmha/triton_splitk.py -> build/lib.macosx-10.9-universal2-3.9/xformers/ops/fmha
creating build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/losses
copying xformers/_flash_attn/losses/cross_entropy.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/losses
copying xformers/_flash_attn/losses/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/losses
creating build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/layers
copying xformers/_flash_attn/layers/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/layers
copying xformers/_flash_attn/layers/patch_embed.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/layers
copying xformers/_flash_attn/layers/rotary.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/layers
creating build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/utils
copying xformers/_flash_attn/utils/pretrained.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/utils
copying xformers/_flash_attn/utils/generation.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/utils
copying xformers/_flash_attn/utils/benchmark.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/utils
copying xformers/_flash_attn/utils/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/utils
copying xformers/_flash_attn/utils/distributed.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/utils
creating build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/bigcode.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/gptj.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/opt.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/llama.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/vit.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/btlm.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/baichuan.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/bert.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/falcon.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/gpt_neox.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
copying xformers/_flash_attn/models/gpt.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/models
creating build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops
copying xformers/_flash_attn/ops/activations.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops
copying xformers/_flash_attn/ops/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops
copying xformers/_flash_attn/ops/fused_dense.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops
copying xformers/_flash_attn/ops/rms_norm.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops
copying xformers/_flash_attn/ops/layer_norm.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops
creating build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/modules
copying xformers/_flash_attn/modules/embedding.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/modules
copying xformers/_flash_attn/modules/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/modules
copying xformers/_flash_attn/modules/mlp.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/modules
copying xformers/_flash_attn/modules/block.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/modules
copying xformers/_flash_attn/modules/mha.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/modules
creating build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops/triton
copying xformers/_flash_attn/ops/triton/cross_entropy.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops/triton
copying xformers/_flash_attn/ops/triton/linear.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops/triton
copying xformers/_flash_attn/ops/triton/k_activations.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops/triton
copying xformers/_flash_attn/ops/triton/init.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops/triton
copying xformers/_flash_attn/ops/triton/mlp.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops/triton
copying xformers/_flash_attn/ops/triton/rotary.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops/triton
copying xformers/_flash_attn/ops/triton/layer_norm.py -> build/lib.macosx-10.9-universal2-3.9/xformers/_flash_attn/ops/triton
running build_ext
building 'xformers._C' extension
creating build/temp.macosx-10.9-universal2-3.9
creating build/temp.macosx-10.9-universal2-3.9/xformers
creating build/temp.macosx-10.9-universal2-3.9/xformers/csrc
creating build/temp.macosx-10.9-universal2-3.9/xformers/csrc/attention
creating build/temp.macosx-10.9-universal2-3.9/xformers/csrc/attention/autograd
creating build/temp.macosx-10.9-universal2-3.9/xformers/csrc/attention/cpu
creating build/temp.macosx-10.9-universal2-3.9/xformers/csrc/sequence_parallel_fused
creating build/temp.macosx-10.9-universal2-3.9/xformers/csrc/sparse24
creating build/temp.macosx-10.9-universal2-3.9/xformers/csrc/swiglu
clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -iwithsysroot/System/Library/Frameworks/System.framework/PrivateHeaders -iwithsysroot/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/Headers -arch arm64 -arch x86_64 -Werror=implicit-function-declaration -I/private/var/folders/v5/94yjmmq93s1bk1l4nq8q90d40000gr/T/pip-install-6rc03t1i/xformers_584eec7fa0c44a389cb5867f7e08966d/xformers/csrc -I/Users/proto/Library/Python/3.9/lib/python/site-packages/torch/include -I/Users/proto/Library/Python/3.9/lib/python/site-packages/torch/include/torch/csrc/api/include -I/Users/proto/Library/Python/3.9/lib/python/site-packages/torch/include/TH -I/Users/proto/Library/Python/3.9/lib/python/site-packages/torch/include/THC -I/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/include/python3.9 -c xformers/csrc/attention/attention.cpp -o build/temp.macosx-10.9-universal2-3.9/xformers/csrc/attention/attention.o -O3 -std=c++17 -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_clang" -DPYBIND11_STDLIB="_libcpp" -DPYBIND11_BUILD_ABI="_cxxabi1002" -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0
clang: error: unsupported option '-fopenmp'
clang: error: unsupported option '-fopenmp'
error: command '/usr/bin/clang' failed with exit code 1
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for xformers
Running setup.py clean for xformers
Failed to build xformers
ERROR: Could not build wheels for xformers, which is required to install pyproject.toml-based projects

[danielhanchen]

Wait does Apple M1 Pro have a NVIDIA GPU?

[proto1994]

emm, probably not. Is there any way to train on a mac computer?