11 Commits

Author	SHA1	Message	Date
Mert	87a0ba3db3	feat(ml): export clip models to ONNX and host models on Hugging Face (#4700) ... * export clip models * export to hf refactored export code * export mclip, general refactoring cleanup * updated conda deps * do transforms with pillow and numpy, add tokenization config to export, general refactoring * moved conda dockerfile, re-added poetry * minor fixes * updated link * updated tests * removed `requirements.txt` from workflow * fixed mimalloc path * removed torchvision * cleaner np typing * review suggestions * update default model name * update test	2023-10-31 05:02:04 -05:00
Mert	41461e0d5d	chore(ml): memory optimisations (#3934)	2023-08-31 18:30:53 -05:00
Mert	bcc36d14a1	feat(ml)!: customizable ML settings (#3891) ... * consolidated endpoints, added live configuration * added ml settings to server * added settings dashboard * updated deps, fixed typos * simplified modelconfig updated tests * Added ml setting accordion for admin page updated tests * merge `clipText` and `clipVision` * added face distance setting clarified setting * add clip mode in request, dropdown for face models * polished ml settings updated descriptions * update clip field on error * removed unused import * add description for image classification threshold * pin safetensors for arm wheel updated poetry lock * moved dto * set model type only in ml repository * revert form-data package install use fetch instead of axios * added slotted description with link updated facial recognition description clarified effect of disabling tasks * validation before model load * removed unnecessary getconfig call * added migration * updated api updated api updated api --------- Co-authored-by: Alex Tran <alex.tran1502@gmail.com>	2023-08-29 08:58:00 -05:00
Mert	165b91b068	feat(ml)!: switch image classification and CLIP models to ONNX (#3809)	2023-08-25 06:28:51 +02:00
Mert	c73832bd9c	refactor(ml): model downloading (#3545) ... * download facial recognition models * download hf models * simplified logic * updated `predict` for facial recognition * ensure download method is called * fixed repo_id for clip * fixed download destination * use st's own `snapshot_download` * conditional download * fixed predict method * check if loaded * minor fixes * updated mypy overrides * added pytest-mock * updated tests * updated lock	2023-08-05 21:45:13 -05:00
Mert	8f08100a30	moved deps (#3379)	2023-07-22 15:04:52 -05:00
Mert	df1e8679d9	chore(ml): added testing and github workflow (#2969) ... * added testing * github action for python, made mypy happy * formatted with black * minor fixes and styling * test model cache * cache test dependencies * narrowed model cache tests * moved endpoint tests to their own class * cleaned up fixtures * formatting * removed unused dep	2023-06-27 18:21:33 -05:00
Mert	a58482cb2b	added locustfile (#2926)	2023-06-25 13:20:45 -05:00
Zeeshan Khan	34201be74c	feat(ml) backend takes image over HTTP (#2783) ... * using pydantic BaseSetting * ML API takes image file as input * keeping image in memory * reducing duplicate code * using bytes instead of UploadFile & other small code improvements * removed form-multipart, using HTTP body * format code --------- Co-authored-by: Alex Tran <alex.tran1502@gmail.com>	2023-06-17 22:49:19 -05:00
Mert	d0cc231782	feat(ml): model unloading (#2661) ... * model cache * fixed revalidation when using cache namespace * fixed ttl not being set, added lock	2023-06-06 20:48:51 -05:00
Mert	1e748864c5	chore(ml): updated dockerfile, added typing, packaging (#2642) ... * updated dockerfile, added typing, packaging apply env change * added arm64 support * added ml version pump, second try for arm64 * added linting config to pyproject.toml * renamed ml input field * fixed linter config * fixed dev docker compose	2023-06-05 09:40:48 -05:00