Skip to content

Commit fcf23ee

Browse files
committed
update readme
1 parent abb7857 commit fcf23ee

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed

README.md

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -75,15 +75,15 @@ You can download the [latest release](https://github.com/bytedance/UI-TARS-deskt
7575

7676
### Deployment
7777

78-
### Cloud Deployment
78+
#### Cloud Deployment
7979
We recommend using HuggingFace Inference Endpoints for fast deployment.
8080
We provide two docs for users to refer:
8181

8282
English version: [GUI Model Deployment Guide](https://juniper-switch-f10.notion.site/GUI-Model-Deployment-Guide-17b5350241e280058e98cea60317de71)
8383

8484
中文版: [GUI模型部署教程](https://bytedance.sg.larkoffice.com/docx/TCcudYwyIox5vyxiSDLlgIsTgWf#U94rdCxzBoJMLex38NPlHL21gNb)
8585

86-
### Local Deployment [vLLM]
86+
#### Local Deployment [vLLM]
8787
We recommend using vLLM for fast deployment and inference. You need to use `vllm>=0.6.1`.
8888
```bash
8989
pip install -U transformers
@@ -92,7 +92,7 @@ CUDA_VERSION=cu124
9292
pip install vllm==${VLLM_VERSION} --extra-index-url https://download.pytorch.org/whl/${CUDA_VERSION}
9393

9494
```
95-
#### Download the Model
95+
##### Download the Model
9696
We provide three model sizes on Hugging Face: **2B**, **7B**, and **72B**. To achieve the best performance, we recommend using the **7B-DPO** or **72B-DPO** model (based on your hardware configuration):
9797

9898
- [2B-SFT](https://huggingface.co/bytedance-research/UI-TARS-2B-SFT)
@@ -102,13 +102,14 @@ We provide three model sizes on Hugging Face: **2B**, **7B**, and **72B**. To ac
102102
- [72B-DPO](https://huggingface.co/bytedance-research/UI-TARS-72B-DPO)
103103

104104

105-
#### Start an OpenAI API Service
105+
##### Start an OpenAI API Service
106106
Run the command below to start an OpenAI-compatible API service:
107107

108108
```bash
109109
python -m vllm.entrypoints.openai.api_server --served-model-name ui-tars --model <path to your model>
110110
```
111111

112+
##### Input your API key
112113

113114
<img src="./images/settings_model.png" width="500px" />
114115

0 commit comments

Comments
 (0)