I’ve been evaluating PromptLayer for the past few weeks as a potential logging and monitoring layer for an internal ERP support chatbot we’re prototyping. The goal is to have a clear audit trail of prompts and responses, especially for our manufacturing and inventory-related queries, before we consider a broader rollout.
I’ve run into a persistent issue that’s making my evaluation difficult: many of the responses logged in the PromptLayer dashboard are showing as ‘[TRUNCATED]’, even when the actual response from the LLM is quite short. For example, I sent a prompt asking, “List the top three factors that affect lead time in a make-to-order manufacturing environment.” The response I received in my application was a concise, three-sentence answer—maybe 500 characters at most. However, in the PromptLayer request log, the response field just shows ‘[TRUNCATED]’. This has happened consistently with responses that are well under any reasonable token limit.
My setup is straightforward. I’m using the Python SDK, and my initialization looks like this. I’ve ensured the `pl_tags` are set for categorization, and I’m using the standard `promptlayer.openai` wrapper to replace the OpenAI client.
I’ve checked the obvious: I’m not setting any custom `max_tokens` low in the request itself, and the responses are coming through completely in my application’s console. The truncation seems to be happening solely within PromptLayer’s logging system. I’ve reviewed the documentation on response logging but couldn’t find any mention of a default truncation limit for the UI.
Is this a known bug, or is there a configuration setting I might have missed? As someone who relies on complete data for auditing and troubleshooting—especially for supply chain and operational queries where nuance matters—seeing a truncated log entry defeats the primary purpose of using the tool. I’d like to understand if this is intended behavior and, if so, how to disable it so we can log the full response text. Without this, it’s hard to justify proceeding with integration.