You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The model would be launched using the [default parameters](vec-inf/models/models.csv), you can override these values by providing additional options, use `--help` to see the full list.
21
+
If you'd like to see the Slurm logs, they are located in the `.vec-inf-logs` folder in your home directory. The log folder path can be modified by using the `--log-dir` option.
21
22
22
23
You can check the inference server status by providing the Slurm job ID to the `status` command:
23
24
```bash
@@ -36,7 +37,7 @@ There are 5 possible states:
36
37
***FAILED**: Inference server in an unhealthy state. Job failed reason will be shown.
37
38
***SHUTDOWN**: Inference server is shutdown/cancelled.
38
39
39
-
Note that the base URL is only available when model is in `READY` state.
40
+
Note that the base URL is only available when model is in `READY` state, and if you've changed the Slurm log directory path, you also need to specify it when using the `status` command.
40
41
41
42
Finally, when you're finished using a model, you can shut it down by providing the Slurm job ID:
0 commit comments