12 Commits

Author	SHA1	Message	Date
Mert	bd826b0b9b	feat(ml): round-robin device assignment (#13237) ... * round-robin device assignment * docs and tests clarify doc	2024-10-07 17:37:45 -04:00
Richard Kojedzinszky	f3e176e192	feat(ml): support dynamic scaling (#12065) ... feat(ml): make http keep-alive configurable Closes #12064	2024-08-29 15:11:49 +00:00
Mert	173c9070c8	fix(ml): re-add worker env (#11192) ... re-add worker env	2024-07-18 17:50:52 +00:00
Mert	88f62087fd	chore(ml): set higher worker timeout for openvino (#11174)	2024-07-18 10:50:57 -04:00
Jason Rasmussen	d61418886f	refactor!: port env (#9559) ... refactor: port env	2024-05-17 12:59:05 -04:00
Mert	3a045b33ca	chore(deps): update onnxruntime-openvino (#7854)	2024-03-16 00:04:45 -04:00
Andrew Rowson	37e5b91dc2	fix(server): ml gunicorn listen on ipv4 and ipv6 by default (#7930)	2024-03-13 12:13:56 -05:00
martin	ddae707ea9	fix: shell scripts (#7186) ... * fix: bash scripts * pr feedback * wrong variable * ci: add shellcheck workflow * fix: missing scripts	2024-02-18 17:03:01 -06:00
Mert	d729c863c8	chore(ml): improve shutdown (#5689)	2023-12-14 13:51:24 -06:00
Mert	0a24ff90bb	fix(ml): set higher default worker timeout (#4007)	2023-09-07 08:27:29 +07:00
Mert	b7fd5dcb4a	dev(ml): fixed docker-compose.dev.yml, updated locust (#3951) ... * fixed dev docker compose * updated locustfile * deleted old script, moved comments to locustfile	2023-09-01 21:59:17 -04:00
Mert	41461e0d5d	chore(ml): memory optimisations (#3934)	2023-08-31 18:30:53 -05:00