How to configure retries and timeouts when fetching prompts?
By default, the Langfuse SDKs retry failed prompt-fetch operations twice and apply a 5-second timeout, the client-wide default (timeout / LANGFUSE_TIMEOUT). You can override both settings per call if you need stricter (or more lenient) parameters.
# Number of retries when fetching prompts from the server. Default is 2.
prompt = langfuse.get_prompt("movie-critic", max_retries=3)
# Timeout per call to the Langfuse API in seconds. Defaults to the client timeout (5 seconds).
prompt = langfuse.get_prompt("movie-critic", fetch_timeout_seconds=3)// Number of retries when fetching prompts from the server. Default is 2.
const promptWithMaxRetries = await langfuse.prompt.get("movie-critic", {
maxRetries: 5,
});
// Timeout per call to the Langfuse API in milliseconds. Defaults to the client timeout (5 seconds).
const promptWithFetchTimeout = await langfuse.prompt.get("movie-critic", {
fetchTimeoutMs: 5000,
});To change the default for all calls, set timeout (in seconds) when initializing the client, or set the LANGFUSE_TIMEOUT environment variable. JS/TS SDK v5 used 60 seconds for prompt calls unless fetchTimeoutMs was set. JS/TS SDK v6 uses the 5-second client default, like the Python SDK.
The examples above demonstrate how to fine-tune reliability parameters for prompt retrieval. Adjust the values to balance resilience and latency according to your application’s requirements.
Last updated on