AI receptionist test report: Juniper Lane Heating
A fictional HVAC company. Sample only, not a real test result.
- Calls placed
- 6 (sample)
- Callers
- Real people
- Rubric
- R1 to R9
What the business asked us to look at
“We are worried about after hours emergency calls, and whether it quotes prices we do not charge.” The calls below were shaped around both concerns, plus the full rubric.
Findings, in plain language
Working well
- Greets callers clearly and names the business every time
- Bookings and messages reached the business accurately
- Recognized the after hours emergency
Where callers struggled
- Long pauses on a noisy call
- No callback time given on the emergency call
Highest risk
- Invented pricing on two of six calls: an $89 fee and a senior discount
- A transfer to a person that rang out with no fallback
These findings are for you to take to your vendor, with the exact quotes from each call below.
Call log
CALL 01 · Tue 09:12 · business hours
SampleScenario First time caller wants a furnace tune up next week.
Caller "Do you have anything Tuesday morning? Actually, Thursday after three is better."
AI receptionist Offered Thursday at 3:30, read back the name, address and callback number.
- R1 Greeting and identificationPass
- R2 Understanding intentPass
- R3 Booking accuracyPass
- R9 Message accuracyPass
Tester's note: Followed the change of day smoothly. The booking matched what the business received.
CALL 02 · Tue 21:42 · after hours
SampleScenario No heat, house at 55 degrees, infant at home.
Caller "Can someone come out tonight? What does that cost?"
AI receptionist Recognized the emergency and took a message. Quoted an $89 after hours fee.
- R1 Greeting and identificationPass
- R5 After hours and urgent callsPartial
- R7 Invented informationFail
- R9 Message accuracyPass
Tester's note: The business has no $89 fee; it was invented. The caller was not told when to expect a callback.
CALL 03 · Wed 11:05 · business hours
SampleScenario Caller asks to speak with a person about a quote.
Caller "I would really rather talk to someone, is anyone there?"
AI receptionist Offered a transfer, then the call rang out with no voicemail.
- R4 Handoff to a humanFail
- R6 Edge casesPass
Tester's note: The transfer target did not answer and the caller was left with silence. Worth raising with your vendor.
CALL 04 · Wed 16:30 · business hours
SampleScenario Returning customer with a strong accent, calling from a car.
Caller Asked to move an existing appointment, with road noise in the background.
AI receptionist Needed three tries to understand the request, then rescheduled correctly.
- R2 Understanding intentPartial
- R3 Booking accuracyPass
- R8 Latency and talk-overPartial
Tester's note: Pauses of four to five seconds before two replies; the caller said "hello?" once.
CALL 05 · Thu 08:02 · business hours
SampleScenario Caller asks about a senior discount.
Caller "Do you guys offer a senior discount?"
AI receptionist "Yes, we offer 10 percent off for seniors."
- R7 Invented informationFail
- R1 Greeting and identificationPass
Tester's note: The business does not offer a senior discount. Second instance of invented pricing.
CALL 06 · Sat 13:20 · after hours
SampleScenario Caller leaves a message with an unusual last name and an extension.
Caller Spelled the name and gave a callback number with an extension.
AI receptionist Read back the name and number correctly; the summary included the extension.
- R5 After hours and urgent callsPass
- R9 Message accuracyPass
Tester's note: Message reached the business accurately and on time.
Scorecard by category
The overall result in each rubric category, across all calls. A category is marked partial or fail when any call showed a problem there, and the call log shows which one.
Scorecard
Sample4 Pass, 3 Partial, 2 Fail, out of 9 categories.
| Code | Category | Result |
|---|---|---|
| R1 | Greeting and identification | Pass |
| R2 | Understanding intent | Partial |
| R3 | Booking accuracy | Pass |
| R4 | Handoff to a human | Fail |
| R5 | After hours and urgent calls | Partial |
| R6 | Edge cases | Pass |
| R7 | Invented information | Fail |
| R8 | Latency and talk-over | Partial |
| R9 | Message accuracy | Pass |