Measurement and rollout
What Ocular measures on after-hours calls, how it is compared against the previous assistant with the same calls, and what we need from the store to start.
Dashboard metrics
| Metric | What it measures | Why it matters |
|---|---|---|
| Correct classification | Calls assigned to the right category | The central failure of free-prompt assistants |
| Correct routing | Calls that ended at the right destination | Measures the outcome, not just the intent |
| Calls reaching the store | How many ring at the store and how many were avoidable | Direct goal: fewer interruptions for staff |
| Resolution without a person | Calls resolved by Ocular | Read together with abandonment and callbacks, so badly closed calls are not rewarded |
| Abandonment | Callers who hang up before an outcome | Signal of loops or frustration |
| Completed transfers | Handoffs that connect with someone | With Ocular, if it fails the call is not lost |
| Callback for the same reason | Callers who call again | Indicates the first call did not resolve |
| Incorrect information | Wrong answers found in review | The second typical problem of basic assistants |
| Abusive calls contained | Calls closed without reaching staff | Protects the store team |
Following standard contact-center practice, resolution, transfer and abandonment are reported separately and no targets are set from external figures: the baseline is the previous assistant, measured with the same calls.
The dashboard is live and the analytics are configurable per store, with SLA and routing policies. Every action of the agent and its tools is logged (agent action log), which makes it possible to audit why a call ended where it did.
Three-phase comparison plan
| Phase 1: lab | Phase 2: live, in parallel | Phase 3: decision |
|---|---|---|
| The previous assistant's export, the knowledge base and the categories are loaded. Testing uses a test number, simulations and, if the store shares them, real recordings. | Part of the after-hours calls go through Ocular and the rest stay on the previous assistant. The split is made at the entry point (by hours, by day or by percentage). | Results are compared per category and a decision is made: continue, adjust or extend to more hours or stores. |
How calls arrive from Zoom Phone
Zoom Phone keeps the store number, its queues and its voicemail. After hours, the call is handed to Ocular in one of these ways:
- Forwarding the number to an Ocular number (a +1 number provided by Ocular, for example +1 555 010 0150). It is the fastest way and requires no network changes.
- SIP from Zoom Phone to Ocular's edge, with the original number and the caller identity.
The details of both paths and what to ask the provider are in SIP URI forwarding into Ocular.
What we need from the store
| Input | Detail |
|---|---|
| Previous assistant export | Exported configuration file (prompt, skills, destinations). It is the starting point for the rules. |
| Knowledge base | Content or access. It is connected directly or copied to Ocular and tested with real questions. |
| Hours and forwarding | When and how calls reach Ocular (closing hours per day, holidays). |
| Categories and destinations | Who receives shifts, complaints and order summaries, and through which channel (platform, email, SMS, WhatsApp, Zoom queue). |
| Aggregators | Which ones operate with the store and their support links. |
| Employee verification | List of registered numbers or a code per employee. |
| Entry point and test number | Where Ocular comes in and a +1 number to test with. |
| Recordings | Whether real recordings will be used for the lab test. |
| Recording and AI notices | Text to play, according to state law. |
The Zoom Phone account inputs (access, numbers, routes, entry point) are in Zoom Phone inputs for the integration. The general telephony form is in Inputs we need from the customer.
What Ocular provides
- Functional comparison between the previous assistant and Ocular.
- Documentation of supported endpoints, desk phones and connectors.
- Categories and routing rules configured with the store's real information.
- Initial demo with the test number.
- Comparison plan, metrics and measurement method.
- Joint review and follow-up meeting.
Related: After-hours call handling with Ocular · Call categories and routing rules