machine learning: hardware acceleration on apple silicon (metal) #10454

traktuner · 2024-06-18T07:38:42Z

traktuner
Jun 18, 2024

Hello,
just wanted to ask if it's planned to support ML hardware acceleration on apple silicon gpu's (metal).
This would result in a good performance for the initial ML scan on macs with "max" and/or "ultra" CPUs.
Thank you!

radh21301 · 2024-09-12T13:35:31Z

radh21301
Sep 12, 2024

This would be awesome! Even people that have macbook air or pro as a daily driver laptop would benefit if they had immich running on low capability server. Say a pi or something.

Maybe convert this into a feature request instead of 'Q&A'

2 replies

Qhilm Sep 12, 2024

just to clarify: a MacBook is already insanely faster than a Pi, even without the hardware acceleration. My MacBook is 30-50 times faster than my Synology NAS, even though there is no hardware acceleration.

I still would love to have this feature though, because then I can rerun machine learning on my entire library with a different model in a matter of hours (or maybe even faster?) instead of taking two days 🙂

radh21301 Sep 12, 2024

updated my comment. I meant - many users have a macbook air or pro as a daily driver laptop. but use a pi as a server for immich. They would definitely befefit like you say.

bo0tzz · 2024-09-12T14:06:13Z

bo0tzz
Sep 12, 2024
Maintainer

To my understanding, docker on mac runs inside of a Linux VM and it's not possible to pass the Apple Metal hwaccel through to that.

2 replies

xobust Sep 12, 2024

Seems to be possible using GPU virtio-gpu.
See this post using podman and llama https://sinrega.org/2024-03-06-enabling-containers-gpu-macos/
I wonder if a similar technique can be used with Immich

tdonovic Sep 13, 2024

Is virtio-gpu not an intel only thing?
This would require the underlying models to support the apple gpu bindings too no?
When I check on openclip it doesn't look like native mac support is there yet openai/CLIP#255

Establishing that would be the first step to whether its even worth trying to expose the gpu through docker.
Then I read something like https://chariotsolutions.com/blog/post/apple-silicon-gpus-docker-and-ollama-pick-two/, (only 3 months old) which says its not possible to expose the gpu and suggests running it locally.

I get the impression there is a lot of dev required elsewhere if its even possible before its worth spending time on the immich end.

mertalev · 2024-09-13T06:01:56Z

mertalev
Sep 13, 2024
Maintainer

You would have to run the machine learning service directly outside of Docker. The instructions to do this are as follows:

Clone the immich repo
Navigate to the machine-learning folder
Add CoreMLExecutionProvider to the start of this list
Install Poetry
Install dependencies with poetry install --with cpu
Set the cache folder with export MACHINE_LEARNING_CACHE_FOLDER=~/.model-cache (you can set a different path here if you like)
Create the model cache folder with mkdir $MACHINE_LEARNING_CACHE_FOLDER
Run ./start.sh

It should then be listening on 3003.

Keep in mind that none of the models have been tested for CoreML compatibility, so you might need to experiment with different models to find one that works well.

14 replies

pippo73 Jan 24, 2025

Hello,
I'm trying to follow your instructions but I'm saving some problem :-( maybe you can help me

Install dependencies with poetry install --with cpu

When I try this command I get the following error :


% poetry install --with cpu
Installing dependencies from lock file

Package operations: 102 installs, 0 updates, 0 removals

  - Installing scipy (1.11.4): Failed

PEP517 build of a dependency failed

Backend subprocess exited when trying to invoke build_wheel

    | Command '['/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmpn81qzc48/.venv/bin/python', '/Users/z-lmutt/Library/Application Support/pypoetry/venv/lib/python3.13/site-packages/pyproject_hooks/_in_process/_in_process.py', 'build_wheel', '/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp4m4gnodf']' returned non-zero exit status 1.
    |
    | + meson setup /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp6u57tove/scipy-1.11.4 /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp6u57tove/scipy-1.11.4/.mesonpy-bw6c5y5z -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp6u57tove/scipy-1.11.4/.mesonpy-bw6c5y5z/meson-python-native-file.ini
    | The Meson build system
    | Version: 1.6.1
    | Source dir: /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp6u57tove/scipy-1.11.4
    | Build dir: /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp6u57tove/scipy-1.11.4/.mesonpy-bw6c5y5z
    | Build type: native build
    | Project name: SciPy
    | Project version: 1.11.4
    | C compiler for the host machine: cc (clang 16.0.0 "Apple clang version 16.0.0 (clang-1600.0.26.6)")
    | C linker for the host machine: cc ld64 1115.7.3
    | C++ compiler for the host machine: c++ (clang 16.0.0 "Apple clang version 16.0.0 (clang-1600.0.26.6)")
    | C++ linker for the host machine: c++ ld64 1115.7.3
    | Cython compiler for the host machine: cython (cython 0.29.37)
    | Host machine cpu family: aarch64
    | Host machine cpu: aarch64
    | Program python found: YES (/private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmpn81qzc48/.venv/bin/python)
    | Found pkg-config: YES (/opt/homebrew/bin/pkg-config) 2.3.0
    | Run-time dependency python found: YES 3.13
    | Program cython found: YES (/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmpn81qzc48/.venv/bin/cython)
    | Compiler for C supports arguments -Wno-unused-but-set-variable: YES
    | Compiler for C supports arguments -Wno-unused-function: YES
    | Compiler for C supports arguments -Wno-conversion: YES
    | Compiler for C supports arguments -Wno-misleading-indentation: YES
    | Library m found: YES
    |
    | ../meson.build:80:0: ERROR: Unknown compiler(s): [['gfortran'], ['flang-new'], ['flang'], ['nvfortran'], ['pgfortran'], ['ifort'], ['ifx'], ['g95']]
    | The following exception(s) were encountered:
    | Running `gfortran --help` gave "[Errno 2] No such file or directory: 'gfortran'"
    | Running `gfortran --version` gave "[Errno 2] No such file or directory: 'gfortran'"
    | Running `gfortran -V` gave "[Errno 2] No such file or directory: 'gfortran'"
    | Running `flang-new --help` gave "[Errno 2] No such file or directory: 'flang-new'"
    | Running `flang-new --version` gave "[Errno 2] No such file or directory: 'flang-new'"
    | Running `flang-new -V` gave "[Errno 2] No such file or directory: 'flang-new'"
    | Running `flang --help` gave "[Errno 2] No such file or directory: 'flang'"
    | Running `flang --version` gave "[Errno 2] No such file or directory: 'flang'"
    | Running `flang -V` gave "[Errno 2] No such file or directory: 'flang'"
    | Running `nvfortran --help` gave "[Errno 2] No such file or directory: 'nvfortran'"
    | Running `nvfortran --version` gave "[Errno 2] No such file or directory: 'nvfortran'"
    | Running `nvfortran -V` gave "[Errno 2] No such file or directory: 'nvfortran'"
    | Running `pgfortran --help` gave "[Errno 2] No such file or directory: 'pgfortran'"
    | Running `pgfortran --version` gave "[Errno 2] No such file or directory: 'pgfortran'"
    | Running `pgfortran -V` gave "[Errno 2] No such file or directory: 'pgfortran'"
    | Running `ifort --help` gave "[Errno 2] No such file or directory: 'ifort'"
    | Running `ifort --version` gave "[Errno 2] No such file or directory: 'ifort'"
    | Running `ifort -V` gave "[Errno 2] No such file or directory: 'ifort'"
    | Running `ifx --help` gave "[Errno 2] No such file or directory: 'ifx'"
    | Running `ifx --version` gave "[Errno 2] No such file or directory: 'ifx'"
    | Running `ifx -V` gave "[Errno 2] No such file or directory: 'ifx'"
    | Running `g95 --help` gave "[Errno 2] No such file or directory: 'g95'"
    | Running `g95 --version` gave "[Errno 2] No such file or directory: 'g95'"
    | Running `g95 -V` gave "[Errno 2] No such file or directory: 'g95'"
    |
    | A full log can be found at /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp6u57tove/scipy-1.11.4/.mesonpy-bw6c5y5z/meson-logs/meson-log.txt

Note: This error originates from the build backend, and is likely not a problem with poetry but one of the following issues with scipy (1.11.4)

  - not supporting PEP 517 builds
  - not specifying PEP 517 build requirements correctly
  - the build requirements are incompatible with your operating system or Python version
  - the build requirements are missing system dependencies (eg: compilers, libraries, headers).

You can verify this by running pip wheel --no-cache-dir --use-pep517 "scipy (==1.11.4)".

and if I try to install scipy


% python3 -m pip wheel --no-cache-dir --use-pep517 "scipy (==1.11.4)"
Collecting scipy==1.11.4
  Downloading scipy-1.11.4.tar.gz (56.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.3/56.3 MB 11.7 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [53 lines of output]
      + meson setup /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-k546235c/scipy_394b558f68be4f0f8638d54459896d20 /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-k546235c/scipy_394b558f68be4f0f8638d54459896d20/.mesonpy-2udjwa5o -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-k546235c/scipy_394b558f68be4f0f8638d54459896d20/.mesonpy-2udjwa5o/meson-python-native-file.ini
      The Meson build system
      Version: 1.6.1
      Source dir: /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-k546235c/scipy_394b558f68be4f0f8638d54459896d20
      Build dir: /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-k546235c/scipy_394b558f68be4f0f8638d54459896d20/.mesonpy-2udjwa5o
      Build type: native build
      Project name: SciPy
      Project version: 1.11.4
      C compiler for the host machine: cc (clang 16.0.0 "Apple clang version 16.0.0 (clang-1600.0.26.6)")
      C linker for the host machine: cc ld64 1115.7.3
      C++ compiler for the host machine: c++ (clang 16.0.0 "Apple clang version 16.0.0 (clang-1600.0.26.6)")
      C++ linker for the host machine: c++ ld64 1115.7.3
      Cython compiler for the host machine: cython (cython 0.29.37)
      Host machine cpu family: aarch64
      Host machine cpu: aarch64
      Program python found: YES (/opt/homebrew/Cellar/python@3.13/3.13.1/bin/python3.13)
      Found pkg-config: YES (/opt/homebrew/bin/pkg-config) 2.3.0
      Run-time dependency python found: YES 3.13
      Program cython found: YES (/private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-build-env-h_0x1jtu/overlay/bin/cython)
      Compiler for C supports arguments -Wno-unused-but-set-variable: YES
      Compiler for C supports arguments -Wno-unused-function: YES
      Compiler for C supports arguments -Wno-conversion: YES
      Compiler for C supports arguments -Wno-misleading-indentation: YES
      Library m found: YES

      ../meson.build:80:0: ERROR: Unknown compiler(s): [['gfortran'], ['flang-new'], ['flang'], ['nvfortran'], ['pgfortran'], ['ifort'], ['ifx'], ['g95']]
      The following exception(s) were encountered:
      Running `gfortran --help` gave "[Errno 2] No such file or directory: 'gfortran'"
      Running `gfortran --version` gave "[Errno 2] No such file or directory: 'gfortran'"
      Running `gfortran -V` gave "[Errno 2] No such file or directory: 'gfortran'"
      Running `flang-new --help` gave "[Errno 2] No such file or directory: 'flang-new'"
      Running `flang-new --version` gave "[Errno 2] No such file or directory: 'flang-new'"
      Running `flang-new -V` gave "[Errno 2] No such file or directory: 'flang-new'"
      Running `flang --help` gave "[Errno 2] No such file or directory: 'flang'"
      Running `flang --version` gave "[Errno 2] No such file or directory: 'flang'"
      Running `flang -V` gave "[Errno 2] No such file or directory: 'flang'"
      Running `nvfortran --help` gave "[Errno 2] No such file or directory: 'nvfortran'"
      Running `nvfortran --version` gave "[Errno 2] No such file or directory: 'nvfortran'"
      Running `nvfortran -V` gave "[Errno 2] No such file or directory: 'nvfortran'"
      Running `pgfortran --help` gave "[Errno 2] No such file or directory: 'pgfortran'"
      Running `pgfortran --version` gave "[Errno 2] No such file or directory: 'pgfortran'"
      Running `pgfortran -V` gave "[Errno 2] No such file or directory: 'pgfortran'"
      Running `ifort --help` gave "[Errno 2] No such file or directory: 'ifort'"
      Running `ifort --version` gave "[Errno 2] No such file or directory: 'ifort'"
      Running `ifort -V` gave "[Errno 2] No such file or directory: 'ifort'"
      Running `ifx --help` gave "[Errno 2] No such file or directory: 'ifx'"
      Running `ifx --version` gave "[Errno 2] No such file or directory: 'ifx'"
      Running `ifx -V` gave "[Errno 2] No such file or directory: 'ifx'"
      Running `g95 --help` gave "[Errno 2] No such file or directory: 'g95'"
      Running `g95 --version` gave "[Errno 2] No such file or directory: 'g95'"
      Running `g95 -V` gave "[Errno 2] No such file or directory: 'g95'"

      A full log can be found at /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-k546235c/scipy_394b558f68be4f0f8638d54459896d20/.mesonpy-2udjwa5o/meson-logs/meson-log.txt
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Have you any hint?

xobust Jan 27, 2025

Looks like you are missing a compiler for fourtran.
You can install gfourtran with brew brew install gfortran.

pippo73 Jan 27, 2025

Hi @xobust ,
I've tried to install gfortran as you wrote me, but I' still having problems to install it :-(


% poetry install --with cpu
Installing dependencies from lock file

Package operations: 108 installs, 0 updates, 0 removals

  - Installing numpy (1.26.4)
  - Installing joblib (1.3.2)
  - Installing markupsafe (2.1.3)
  - Installing setuptools (70.3.0)
  - Installing scipy (1.11.4): Failed

PEP517 build of a dependency failed

Backend subprocess exited when trying to invoke build_wheel

    | Command '['/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmpaa1yxpcr/.venv/bin/python', '/Users/z-lmutt/Library/Application Support/pypoetry/venv/lib/python3.13/site-packages/pyproject_hooks/_in_process/_in_process.py', 'build_wheel', '/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp0rrb1zkg']' returned non-zero exit status 1.
    |
    | + meson setup /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp0amc1j_a/scipy-1.11.4 /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp0amc1j_a/scipy-1.11.4/.mesonpy-23xcjutd -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp0amc1j_a/scipy-1.11.4/.mesonpy-23xcjutd/meson-python-native-file.ini
    | The Meson build system
    | Version: 1.7.0
    | Source dir: /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp0amc1j_a/scipy-1.11.4
    | Build dir: /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp0amc1j_a/scipy-1.11.4/.mesonpy-23xcjutd
    | Build type: native build
    | Project name: SciPy
    | Project version: 1.11.4
    | C compiler for the host machine: cc (clang 16.0.0 "Apple clang version 16.0.0 (clang-1600.0.26.6)")
    | C linker for the host machine: cc ld64 1115.7.3
    | C++ compiler for the host machine: c++ (clang 16.0.0 "Apple clang version 16.0.0 (clang-1600.0.26.6)")
    | C++ linker for the host machine: c++ ld64 1115.7.3
    | Cython compiler for the host machine: cython (cython 0.29.37)
    | Host machine cpu family: aarch64
    | Host machine cpu: aarch64
    | Program python found: YES (/private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmpaa1yxpcr/.venv/bin/python)
    | Found pkg-config: YES (/opt/homebrew/bin/pkg-config) 2.3.0
    | Run-time dependency python found: YES 3.13
    | Program cython found: YES (/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmpaa1yxpcr/.venv/bin/cython)
    | Compiler for C supports arguments -Wno-unused-but-set-variable: YES
    | Compiler for C supports arguments -Wno-unused-function: YES
    | Compiler for C supports arguments -Wno-conversion: YES
    | Compiler for C supports arguments -Wno-misleading-indentation: YES
    | Library m found: YES
    | Fortran compiler for the host machine: gfortran (gcc 14.2.0 "GNU Fortran (Homebrew GCC 14.2.0_1) 14.2.0")
    | Fortran linker for the host machine: gfortran ld64 1115.7.3
    | Compiler for Fortran supports arguments -Wno-conversion: YES
    | Compiler for C supports link arguments -Wl,-ld_classic: YES
    | Checking if "-Wl,--version-script" links: NO
    | Program pythran found: YES (/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmpaa1yxpcr/.venv/bin/pythran)
    | Found CMake: /opt/homebrew/bin/cmake (3.31.5)
    | WARNING: CMake Toolchain: Failed to determine CMake compilers state
    | Run-time dependency xsimd found: NO (tried pkgconfig, framework and cmake)
    | Run-time dependency threads found: YES
    | Library npymath found: YES
    | Library npyrandom found: YES
    | pybind11-config found: YES (/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmpaa1yxpcr/.venv/bin/pybind11-config) 2.11.0
    | Run-time dependency pybind11 found: YES 2.11.0
    | Run-time dependency openblas found: NO (tried pkgconfig, framework and cmake)
    | Run-time dependency openblas found: NO (tried pkgconfig, framework and cmake)
    |
    | ../scipy/meson.build:159:9: ERROR: Dependency "OpenBLAS" not found, tried pkgconfig, framework and cmake
    |
    | A full log can be found at /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/tmp0amc1j_a/scipy-1.11.4/.mesonpy-23xcjutd/meson-logs/meson-log.txt

Note: This error originates from the build backend, and is likely not a problem with poetry but one of the following issues with scipy (1.11.4)

  - not supporting PEP 517 builds
  - not specifying PEP 517 build requirements correctly
  - the build requirements are incompatible with your operating system or Python version
  - the build requirements are missing system dependencies (eg: compilers, libraries, headers).

You can verify this by running pip wheel --no-cache-dir --use-pep517 "scipy (==1.11.4)".

  - Installing pillow (10.4.0)
  - Installing threadpoolctl (3.2.0)
(.venv) user@macminim4 machine-learning % pip wheel --no-cache-dir --use-pep517 "scipy (==1.11.4)"
Collecting scipy==1.11.4
  Downloading scipy-1.11.4.tar.gz (56.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.3/56.3 MB 11.7 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [44 lines of output]
      + meson setup /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-520y5htb/scipy_ac5b559ce0c34fb1abefe19784163a8d /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-520y5htb/scipy_ac5b559ce0c34fb1abefe19784163a8d/.mesonpy-hpkl4jrr -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-520y5htb/scipy_ac5b559ce0c34fb1abefe19784163a8d/.mesonpy-hpkl4jrr/meson-python-native-file.ini
      The Meson build system
      Version: 1.7.0
      Source dir: /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-520y5htb/scipy_ac5b559ce0c34fb1abefe19784163a8d
      Build dir: /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-520y5htb/scipy_ac5b559ce0c34fb1abefe19784163a8d/.mesonpy-hpkl4jrr
      Build type: native build
      Project name: SciPy
      Project version: 1.11.4
      C compiler for the host machine: cc (clang 16.0.0 "Apple clang version 16.0.0 (clang-1600.0.26.6)")
      C linker for the host machine: cc ld64 1115.7.3
      C++ compiler for the host machine: c++ (clang 16.0.0 "Apple clang version 16.0.0 (clang-1600.0.26.6)")
      C++ linker for the host machine: c++ ld64 1115.7.3
      Cython compiler for the host machine: cython (cython 0.29.37)
      Host machine cpu family: aarch64
      Host machine cpu: aarch64
      Program python found: YES (/Users/z-lmutt/Git/immich/machine-learning/.venv/bin/python3.13)
      Found pkg-config: YES (/opt/homebrew/bin/pkg-config) 2.3.0
      Run-time dependency python found: YES 3.13
      Program cython found: YES (/private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-build-env-efedc8yd/overlay/bin/cython)
      Compiler for C supports arguments -Wno-unused-but-set-variable: YES
      Compiler for C supports arguments -Wno-unused-function: YES
      Compiler for C supports arguments -Wno-conversion: YES
      Compiler for C supports arguments -Wno-misleading-indentation: YES
      Library m found: YES
      Fortran compiler for the host machine: gfortran (gcc 14.2.0 "GNU Fortran (Homebrew GCC 14.2.0_1) 14.2.0")
      Fortran linker for the host machine: gfortran ld64 1115.7.3
      Compiler for Fortran supports arguments -Wno-conversion: YES
      Compiler for C supports link arguments -Wl,-ld_classic: YES
      Checking if "-Wl,--version-script" links: NO
      Program pythran found: YES (/private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-build-env-efedc8yd/overlay/bin/pythran)
      Found CMake: /opt/homebrew/bin/cmake (3.31.5)
      WARNING: CMake Toolchain: Failed to determine CMake compilers state
      Run-time dependency xsimd found: NO (tried pkgconfig, framework and cmake)
      Run-time dependency threads found: YES
      Library npymath found: YES
      Library npyrandom found: YES
      pybind11-config found: YES (/private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-build-env-efedc8yd/overlay/bin/pybind11-config) 2.11.0
      Run-time dependency pybind11 found: YES 2.11.0
      Run-time dependency openblas found: NO (tried pkgconfig, framework and cmake)
      Run-time dependency openblas found: NO (tried pkgconfig, framework and cmake)

      ../scipy/meson.build:159:9: ERROR: Dependency "OpenBLAS" not found, tried pkgconfig, framework and cmake

      A full log can be found at /private/var/folders/kt/jnkjbc4j58lfnfcr_wdtt7jr0000gn/T/pip-wheel-520y5htb/scipy_ac5b559ce0c34fb1abefe19784163a8d/.mesonpy-hpkl4jrr/meson-logs/meson-log.txt
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Sorry :-(

xobust Jan 27, 2025

Sounds like the dependancies, are a mess. You could look up each missing dependancy but that seems annoyding.
Try installing it with brew on the system first brew install scipy the formula seems to contain OpenBLAS and other requirements:
https://formulae.brew.sh/formula/scipy

pippo73 Jan 28, 2025

Thank you @xobust.
It was a problem of environment.
Here is how I fix it (hope It could help someone else)


$ brew update
$ brew upgrade
$ pyenv install 3.11.6
$ pyenv global 3.11.6
$ poetry env use 3.11

< follower the steps on the comment 10633589 >
$ poetry install --with cpu
$ export MACHINE_LEARNING_CACHE_FOLDER=~/.model-cache 
$ mkdir $MACHINE_LEARNING_CACHE_FOLDER
$  ./start.sh
[01/28/25 09:33:07] INFO     Starting gunicorn 23.0.0
[01/28/25 09:33:07] INFO     Listening at: http://[::]:3003 (251)
[01/28/25 09:33:07] INFO     Using worker: app.config.CustomUvicornWorker
[01/28/25 09:33:07] INFO     Booting worker with pid: 278



Fontconfig warning: ignoring UTF-8: not a valid region tag
[01/28/25 09:33:37] INFO     Started server process [278]
[01/28/25 09:33:37] INFO     Waiting for application startup.
[01/28/25 09:33:37] INFO     Created in-memory cache with unloading after 300s of inactivity.
[01/28/25 09:33:37] INFO     Initialized request thread pool with 10 threads.
[01/28/25 09:33:37] INFO     Application startup complete.
[01/28/25 09:33:53] INFO     Handling signal: winch
[01/28/25 09:45:28] INFO     Handling signal: winch

Now it seems working and listening a the port 3003 of my server.
Now I would like to connect my other server to this one.

In the gui of the second server I've added the ip of this server but is seems not talking each other

I've launched the jobs no the server, but it seems not talking to this one :-(
Do I miss something?

pippo73 · 2025-01-16T21:20:56Z

pippo73
Jan 16, 2025

I all,
I'm planing to buy a mac mini m4, and I was looking about infos if I can squeeze it somehow.
Does anybody of you heard about news of it?
Update :

if it could help to do some tests I can use also a mac mini m4 (not pro) to see how it works :)

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

machine learning: hardware acceleration on apple silicon (metal) #10454

{{title}}

Replies: 4 comments 18 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

machine learning: hardware acceleration on apple silicon (metal) #10454

Replies: 4 comments · 18 replies

bo0tzz Sep 12, 2024 Maintainer

mertalev Sep 13, 2024 Maintainer

Replies: 4 comments 18 replies

bo0tzz
Sep 12, 2024
Maintainer

mertalev
Sep 13, 2024
Maintainer