Skip to content

provider.timeout

The provider did not answer in time

Type https://mthds.ai/errors/provider.timeout
Family provider: The inference provider behind a model.
Domain runtime: nobody could have acted beforehand, so whoever made the call waits, retries or reports the problem
Retry yes: repeating the operation may succeed, after retry_after seconds when the problem gives it
HTTP status 504
Raised as a problem document, sent as the body of an HTTP response or kept in a run's record

What it means

The provider timed out, or the runtime stopped waiting for it, on a call that is safe to repeat.

What to do

Run the method again. If calls keep timing out, the inputs may be too large for the model to answer in time.

Next steps

A problem carries the step aimed at whoever reads it: the first when its reader is the domain's actor, whoever made the call, and the second for any other reader.

Reader Kind Detail
The domain's actor retry Run the method again.
Any other reader retry Run the method again.

Detail

The problem's detail is written from this template, filled with the occurrence's parameters:

The provider '{provider}' did not answer in time.

Parameters

Every parameter is present on every occurrence of the code.

Name Type Description
provider identifier The provider.

See also