ray.serve.llm.LLMRouter.as_deployment

classmethod LLMRouter.as_deployment(llm_configs: List[LLMConfig] | None = None) → Deployment

Converts this class to a Ray Serve deployment with ingress.

Returns:

A Ray Serve deployment.