Though Vom takes great care to serve decisions fast and reliably, you might still want to check how that is going. As the old saying goes, "trust, but verify".
Some decisions also use external data, like from Credit Bureaus, and those providers tend to be unreliable.
So to help you understand operational performance Vom now has a built-in dashboard that shows decision counts, error rate, latency, among other operational metrics. Here's how it looks:
This is the dashboard for a real customer, which shows Vom is being used to take 10-15k decisions per day for them, each taking an average latency of 30ms, with 0.0% error rate.
Similar charts also exist for feature accesses (data internal to Vom) and for connector runs (fetching data from external providers), so you can check how those affect latency and how reliable are the providers, or crosscheck what they charged with how many calls were done.
Finally, You can also filter policy or its versions, or plot lines per policy/version. That allows you to quickly compare metrics across different decisions.
In the future we plan to create alerts on top of these metrics so that teams know something is off, such as a data provider outage or a policy misconfiguration as soon as it happens.
Comments