Hi everyone. I'm setting up Helicone to monitor our OpenAI usage in a new AWS project. I'm using Terraform to manage the infrastructure.
I noticed that when OpenAI returns an error (like a 429 or 5xx), the request shows up in the logs, but the latency graph on the dashboard seems to drop those data points. It makes our latency look better than it is during outages 😅. Is this expected?
Here's a snippet of how I'm routing requests through the Helicone proxy in my code:
```python
import openai
openai.api_base = "https://oai.hconeai.com/v1"
openai.api_key = "my-helicone-key"
```
Should I be looking somewhere else for error latency, or is there a setting I missed? I want to see the full picture, including failed requests, on the graphs. Thanks for any tips.