vLLM is a language model serving platform that processes multimodal requests from clients. An attacker can send a specially crafted request to the unauthenticated /tokenize endpoint that causes vLLM to execute arbitrary Python code when the model uses dynamic processor code and trust_remote_code is enabled, potentially compromising the entire API process and any models or data it has access to.
Yes. vllm (PyPI): upgrade to 0.31.0 or later. Junglewise finds every place you run it, drafts the upgrade and applies it once you approve.
Am I affected?
Check whether you run vllm (PyPI) at an affected version. Junglewise does that check for you around the clock: connect your code, cloud and domains, and it matches new vulnerabilities like this one against what you actually run and tells you when one reaches you.