luv_2261/test-upload/vllm-llama-3_2-1b-instruct
0
--

Run with API

See our complete quickstart for how to get started with our API in minutes.


from clarifai.client.model import Model

prompt = "What's the future of AI?"

model_url="https://clarifai.com/luv_2261/test-upload/models/vllm-llama-3_2-1b-instruct"
model_prediction = Model(url=model_url, pat="YOUR_PAT_HERE").predict_by_bytes(prompt.encode())

print(model_prediction.outputs[0].data.text.raw)