The mortgage CRM demo scorecard: ten questions to ask every vendor, us included
Every CRM demo is designed to go well. The rep drives, the data is clean, and the one thing you were worried about somehow never comes up. So you leave with a good feeling and no evidence.
This is the fix I'd use if I were buying today: the same ten questions, put to every vendor, scored on what they actually showed you. Leaf360 included. Print this page, take it into each demo, and don't let anyone answer a question with a roadmap.
How to score
Give each question one of three scores, based on what happened on screen, not on what was said.
| Score | Means |
|---|---|
| 0 | Not shown. Described, promised, or "on the roadmap". |
| 1 | Partially shown. You saw it, but on their data, or only half the flow, or with a caveat you'd need to check. |
| 2 | Demonstrated. You watched it happen end to end, ideally on your sample file. |
Write down what you saw in the evidence column while it's fresh. A month later, "they showed it" won't mean anything without the note.
The ten questions
| # | Ask them to show you | What counts as evidence | Evidence you saw | Score |
|---|---|---|---|---|
| 1 | Which lead should I work first, right now? | The system picks from a real pipeline and explains why. Not a saved filter you have to build first. | ||
| 2 | Draft the follow-up for that lead. | A message written from that record's details: loan type, amount, where they are in the process. Not a template with a first name merged in. | ||
| 3 | What sends without me reading it, and what waits? | A clear answer per channel: email, text, record changes, automations. Watch one thing that waits and one thing that doesn't. | ||
| 4 | Where did this lead come from? | Source and sub-source on the record, set automatically from the form, the web lead, or the referral. Not typed in by the rep. | ||
| 5 | Import my sample file. | Bring a CSV of about a hundred made-up or de-identified records in your real column layout, with a few deliberate duplicates and a couple of messy phone numbers. Watch the mapping, the duplicate handling, and the counts at the end. | ||
| 6 | Change a loan status in my LOS. What moves here? | Name your LOS. In a sandbox, or on a test loan your shop has approved for this, see which fields sync, in which direction, and what happens to the pipeline when a milestone changes. | ||
| 7 | Log in as a loan officer, not an admin. | What a producer sees and can change, versus what only an admin can. Especially who can see whose leads. | ||
| 8 | Export everything. | Leads, contacts, notes and activity history as files you could load somewhere else. If the answer is "contact support", score it as shown. | ||
| 9 | What is the all-in monthly number for my team? | Seats, phone and texting usage, the AI features, add-ons, implementation and the contract term, in writing. Not the seat price alone. | ||
| 10 | Show me the AI being wrong. | Ask it something the data can't support and watch what it does. A good answer says so, or flags that it can make mistakes, and leaves the decision with you. |
A perfect score is 20. Nobody gets 20 on a first demo, and that's fine. The point is the gaps: a 0 on question 3 or question 8 should worry you more than a 1 anywhere else, because those are the two you can't fix after you've moved.
Run the same test everywhere
Three habits make the scores comparable.
- Bring the same sample file to every demo. About a hundred rows in your real column layout, made up or de-identified, with a few duplicates left in and a couple of messy phone numbers. Don't hand a vendor your actual client list for a demo. Every vendor imports the same thing, so question 5 means the same thing each time.
- Ask the same lead question first. "Which lead should I work first, right now?" before anything else. It's the question you'll ask every morning, so it should be the first thing you watch.
- Don't let the rep drive question 6. Ask for a sandbox, or use a test loan your shop has approved for this, and have someone from your side change the status. A slide of logos is a 0.
Take the test with us
We should be held to the same ten. Two places to start, neither of which is the test itself. The Lia preview is a recording of the first two questions inside Leaf360, on demo data. The compare hub says, vendor by vendor, where we think the other product is the better choice. Then run the ten questions live: Talk to Lia puts the real assistant in front of you with no account, and a free account or a sandbox demo is where questions 5 through 10 get answered. The recording proves nothing past question 2.
If you're already sold and planning the move, the next read is how to switch mortgage CRMs without losing a deal, which has the migration checklist. If you've just signed up, what happens after you click Start free is the first-session checklist.
Christian Mourra
Founder, Leaf360
Christian Mourra is the founder of Leaf360 and a mortgage loan originator. He built Leaf360 after running his own origination business on the cobbled stack it replaces.