You've already forked immich
mirror of
https://github.com/immich-app/immich.git
synced 2025-07-04 05:50:38 +02:00
2b37caba03
* feat(ml): introduce support of onnxruntime-rocm for AMD GPU * try mutex for algo cache use OrtMutex * bump versions, run on mich use 3.12 use 1.19.2 * acquire lock before any changes can be made guard algo benchmark results mark mutex as mutable re-add /bin/sh (?) use 3.10 use 6.1.2 * use composite cache key 1.19.2 fix variable name fix variable reference aaaaaaaaaaaaaaaaaaaa * bump deps * disable algo caching * fix gha * try ubuntu runner * actually fix the gha * update patch * skip mimalloc preload for rocm * increase build threads * increase timeout for rocm * Revert "increase timeout for rocm" This reverts commit 2c4452f5d132198ed381a7b262b4a5cab5114b5f. * attempt migraphx * set migraphx_home * Revert "set migraphx_home" This reverts commit c121d3e48754b3bce100636f8d666deec58a44b7. * Revert "attempt migraphx" This reverts commit 521f9fb72dbe506dc6cb8faeb6494817d87265c6. * migraphx, take two * bump rocm * allow cpu * try only targeting migraphx * skip tests * migraph ❌ * known issues * target gfx900 and gfx1102 * mention `HSA_USE_SVM` * update lock * set device id for rocm --------- Co-authored-by: Mehdi GHESH <mehdi.ghesh@hotmail.fr>
32 lines
926 B
Bash
Executable File
32 lines
926 B
Bash
Executable File
#!/usr/bin/env sh
|
|
|
|
echo "Initializing Immich ML $IMMICH_SOURCE_REF"
|
|
|
|
if ! [ "$DEVICE" = "openvino" ]; then
|
|
: "${MACHINE_LEARNING_WORKER_TIMEOUT:=120}"
|
|
else
|
|
: "${MACHINE_LEARNING_WORKER_TIMEOUT:=300}"
|
|
fi
|
|
|
|
# mimalloc seems to increase memory usage dramatically with openvino, need to investigate
|
|
if ! [ "$DEVICE" = "openvino" ] && ! [ "$DEVICE" = "rocm" ]; then
|
|
lib_path="/usr/lib/$(arch)-linux-gnu/libmimalloc.so.2"
|
|
export LD_PRELOAD="$lib_path"
|
|
export LD_BIND_NOW=1
|
|
fi
|
|
|
|
: "${IMMICH_HOST:=[::]}"
|
|
: "${IMMICH_PORT:=3003}"
|
|
: "${MACHINE_LEARNING_WORKERS:=1}"
|
|
: "${MACHINE_LEARNING_HTTP_KEEPALIVE_TIMEOUT_S:=2}"
|
|
|
|
gunicorn app.main:app \
|
|
-k app.config.CustomUvicornWorker \
|
|
-c gunicorn_conf.py \
|
|
-b "$IMMICH_HOST":"$IMMICH_PORT" \
|
|
-w "$MACHINE_LEARNING_WORKERS" \
|
|
-t "$MACHINE_LEARNING_WORKER_TIMEOUT" \
|
|
--log-config-json log_conf.json \
|
|
--keep-alive "$MACHINE_LEARNING_HTTP_KEEPALIVE_TIMEOUT_S" \
|
|
--graceful-timeout 0
|