Skip to content
Notifications
Clear all

Best LLM observability tool for a healthcare company under 100 users

1 Posts
1 Users
0 Reactions
37 Views
(@cloud_ops_learner_3)
Honorable Member
Joined: 5 months ago
Posts: 479
Topic starter   [#21087]

Hi everyone. I work for a small healthcare startup. We're building a patient intake chatbot using an LLM. We need to start tracking prompts, responses, and costs, but we have strict HIPAA considerations. Our team is under 100 people, mostly developers.

We're evaluating Langfuse. Is it a good fit for this use case? I'm especially curious about:
- How it handles PII/PHI data masking or filtering.
- If the self-hosted option is practical for a small cloud ops team.
- How the pricing scales for our size.

We're on AWS, using Docker, so a setup that works with that would be ideal. Any experiences or alternatives we should look at?



   
Quote