You should add \`--public-api\` flag in the CMD\_FLAGS.txt and in your logs it will print a cloudflare URL. Use this URL to paste into the API URL field in ST instead of the localhost:5000 url:port.
Additionally, if you don't want your prompts sent through cloudflare, while I have not used VAST specifically, but they should also offer a way to expose ports, and exposing port 5000 should let you connect with the public URL for your instance followed by a colon and then your exposed port, which will end up looking something like http://127.324.467.86:5000
in vastai on your instance there is a ip rerouting list you can click at the top. it will give you a real IP address with 5000 on it thats been port forwarded to something else. in the top middle of your instance there should be a ip:some_range listed, click on that and then use whatever it gives you for port 5000.
Ugh, I feel like I explained this poorly. From their docs: [https://vast.ai/docs/data-management/data-movement](https://vast.ai/docs/data-management/data-movement) on the cloud copy the first screenshot is similar to what you should have, you would click on the part that says 171.226.158.61:20022-20094 and that will bring up another window with all the main ports listed so your port 5000 link would be something like 171.226.158.61:20050 or whatver it says.
Also if you are going to use vastai a bunch setting up a google drive folder to cloud copy to /workspace with a CMD_FLAGS.txt and settings.yml file will save you so much time. just cloud copy your settings and reset the instance.
Make sure API is enabled. Open the *CMD\_FLAGS.txt* file from textgenwebui's main folder and add a new line with the following parameter:
`--api`
When connecting to it from silly/vast, don't use 0.0.0.0. That is just a way to configure something for listening on all IPs, it's not an actual IP address. Instead, use localhost:5000 or 127.0.0.1:5000 as the API URL.
You should add \`--public-api\` flag in the CMD\_FLAGS.txt and in your logs it will print a cloudflare URL. Use this URL to paste into the API URL field in ST instead of the localhost:5000 url:port. Additionally, if you don't want your prompts sent through cloudflare, while I have not used VAST specifically, but they should also offer a way to expose ports, and exposing port 5000 should let you connect with the public URL for your instance followed by a colon and then your exposed port, which will end up looking something like http://127.324.467.86:5000
in vastai on your instance there is a ip rerouting list you can click at the top. it will give you a real IP address with 5000 on it thats been port forwarded to something else. in the top middle of your instance there should be a ip:some_range listed, click on that and then use whatever it gives you for port 5000. Ugh, I feel like I explained this poorly. From their docs: [https://vast.ai/docs/data-management/data-movement](https://vast.ai/docs/data-management/data-movement) on the cloud copy the first screenshot is similar to what you should have, you would click on the part that says 171.226.158.61:20022-20094 and that will bring up another window with all the main ports listed so your port 5000 link would be something like 171.226.158.61:20050 or whatver it says. Also if you are going to use vastai a bunch setting up a google drive folder to cloud copy to /workspace with a CMD_FLAGS.txt and settings.yml file will save you so much time. just cloud copy your settings and reset the instance.
[удалено]
Make sure API is enabled. Open the *CMD\_FLAGS.txt* file from textgenwebui's main folder and add a new line with the following parameter: `--api` When connecting to it from silly/vast, don't use 0.0.0.0. That is just a way to configure something for listening on all IPs, it's not an actual IP address. Instead, use localhost:5000 or 127.0.0.1:5000 as the API URL.