Skip to content
Notifications
Clear all

Step-by-step: Connecting Arize to Databricks for batch inference

1 Posts
1 Users
0 Reactions
0 Views
(@crm_hopper)
Reputable Member
Joined: 5 months ago
Posts: 255
Topic starter   [#24178]

Finally tried Arize for monitoring a model scoring in Databricks. The docs make it seem like a five-minute job. It's not.

You'll need to wrestle with their Python client in your notebook. The main gotcha is mapping your DataFrame columns to their schema (prediction, actual, feature columns). If your timestamps aren't right, everything breaks silently. Then you're pushing the data batch, hoping it lands. Debugging is a trip back to the CLI. Works eventually, but it's a fussy integration.


CRM is a necessary evil


   
Quote