You have defined your requirements.
You have talked to vendors.
You have watched the important workflows in the demos.
Now several products may look capable.
One may be easier for technicians. Another may handle an important integration better. One may cost less. Another may require less implementation work. A third may have more functionality, including capabilities your operation does not need.
This is where a feature checklist starts to lose value.
The comparison needs to preserve the evidence you gathered and connect it back to the operation you are trying to support.
A useful evaluation looks at several things separately:
- must-have requirements
- evidence from the evaluation
- functional fit
- implementation and adoption
- cost
- uncertainty and risk
You can use scoring to organize the decision.
Do not ask the score to make the decision for you.
Start with gates before scores
Some requirements should not be averaged together with everything else.
They are conditions the system needs to satisfy.
Examples might include:
- offline operation
- a required ERP integration
- SSO
- a security requirement
- a regulatory requirement
- support for a required asset structure
- a critical mobile workflow
- a required deployment or hosting model
Call these gates.
A gate should be something you genuinely need, not a convenient way to eliminate a vendor you happen to like less.
Ask:
If this requirement cannot be satisfied, would we still buy the system?
If the answer is no, treat it as a gate.
That prevents an important problem.
Suppose a CMMS performs particularly well on ten lower-priority requirements but cannot support a critical offline workflow.
A large total score should not hide that failure.
Resolve the gate first.
Do not score an unanswered question
After the demonstrations, carry forward the evidence states you recorded:
Demonstrated — You saw the requirement work in the software.
Explained — The vendor described how it works but you did not see it.
Documented — Supporting product or technical documentation was provided.
Future — The capability depends on planned or roadmap functionality.
Unresolved — You still do not have enough information.
An unresolved must-have is not a zero.
It is an unresolved must-have.
That distinction matters.
Giving it a numerical score can create the appearance that the issue has been evaluated when the real next step is to get an answer.
Before completing the comparison, create an open-items list:
| Requirement / question | Vendor | Status | What is needed | Owner |
|---|---|---|---|---|
| Offline synchronization | Vendor A | Unresolved | Live demonstration | |
| ERP integration | Vendor B | Explained | Architecture / reference | |
| SSO | Vendor C | Documented | Security review | |
| Mobile inspection workflow | Vendor A | Future | Confirm release status |
Resolve the important items before relying on the final comparison.
Compare requirements using the same evidence
Build a matrix using the requirements you defined before the vendor conversations.
For example:
| Requirement | Priority | Vendor A | Evidence | Vendor B | Evidence | Vendor C | Evidence |
|---|---|---|---|---|---|---|---|
| Offline mobile | GATE | Meets | Demonstrated | ? | Unresolved | Meets | Demonstrated |
| ERP integration | GATE | Meets | Documented | Meets | Explained | Custom | Explained |
| PM workflow | High | 3 | Demonstrated | 3 | Demonstrated | 2 | Demonstrated |
| Asset history | High | 3 | Demonstrated | 4 | Demonstrated | 3 | Demonstrated |
| Inventory workflow | Medium | 2 | Demonstrated | 3 | Demonstrated | 3 | Explained |
| Reporting | Medium | 3 | Demonstrated | 4 | Demonstrated | 3 | Demonstrated |
The purpose of the evidence column is to stop different kinds of proof from becoming equivalent.
"Yes, we support that."
"We can build that."
"It is on our roadmap."
"You watched it work."
Those statements should not become the same checkmark.
Brevard County, Florida used a CMMS requirements structure that required vendors to distinguish how requirements would be satisfied, including whether functionality was available through the proposed solution, third-party software, customization, or was unsupported.[1]
Your terminology does not have to match a public RFP.
The principle is useful: record how the requirement is satisfied, not only whether the vendor says yes.
Use priorities that came from the operation
If you use weighted scoring, establish importance based on the operation.
A simple model is enough:
High = 3
Medium = 2
Low = 1
Then score how well the demonstrated solution appears to meet the requirement:
0 = Unsupported or not demonstrated
1 = Major gap or significant workaround
2 = Partially meets
3 = Meets
4 = Meets particularly well
For non-gate requirements:
Requirement score = importance × performance
This can help organize a large comparison.
But the weights are yours.
There is no universal CMMS weighting formula.
Real CMMS procurements use very different evaluation structures.
Indian River County's 2026 procurement allocated points across the proposed CMMS, implementation approach and schedule, migration and technical architecture, training and change management, project team and references, cost/value, and assumptions or exceptions.[2]
Brevard County used a different weighting structure involving technical requirements, implementation/support, price, team experience and organizational factors.[1]
Eastern Washington University used another structure, with separate technical, management and cost components.[3]
The lesson is not to copy any of those percentages.
The lesson is that sophisticated buyers evaluate more than a product feature list, and the relative importance of those areas depends on the purchase.
A weighted total is a summary, not a verdict
Suppose your spreadsheet produces:
Vendor A: 287
Vendor B: 281
That six-point difference does not prove Vendor A is the better decision.
Look underneath the total.
Ask:
- Which requirements created the difference?
- Were those requirements genuinely important?
- Were they demonstrated or merely explained?
- Does either vendor have an unresolved gate?
- Does one require substantially more implementation?
- Is one dependent on custom work?
- Are there meaningful differences in technician usability?
- Are the costs based on the same scope?
- Are important capabilities dependent on future releases?
Scoring can expose differences.
It can also hide them if the total is treated as the answer.
A failed critical requirement should not disappear inside a strong overall score.
An unresolved requirement should not acquire false certainty because someone entered a number into a spreadsheet.
Do not reward functionality you do not need
A product with more features is not automatically a better fit.
NASA facilities-maintenance guidance advises NASA Centers to establish their maintenance data needs before acquiring or modifying a CMMS and acquire only what is required to accomplish the maintenance organization's goals.[4]
Apply that discipline to the comparison.
Suppose Vendor A supports all of your important requirements.
Vendor B supports those same requirements plus dozens of additional capabilities your operation is unlikely to use.
Those additional capabilities may be valuable in another environment.
They should not automatically increase Vendor B's score in yours.
Compare products against the operation and requirements you defined.
Compare implementation separately
Two products can both meet the functional requirements and still represent very different projects.
Build a separate implementation comparison.
| Delivery area | Vendor A | Vendor B | Vendor C |
|---|---|---|---|
| Configuration required | |||
| Data preparation / cleanup | |||
| Data migration | |||
| Integrations | |||
| Custom development | |||
| Training | |||
| Testing | |||
| Internal project effort | |||
| Vendor / partner services | |||
| Ongoing administration | |||
| Expected implementation timeline |
Ask what each organization would actually have to do to reach a working production system.
A solution that meets a requirement through standard configuration is different from one that reaches the same result through custom development.
An existing integration is different from an integration project.
A clean migration is different from months of data reconstruction.
A familiar technician workflow is different from one that will require substantial process change.
Indian River County's CMMS evaluation treated implementation approach, migration/technical architecture, and training/change management as separate areas of evaluation rather than treating the software itself as the entire decision.[2]
That is a useful model even if you do not copy its scoring.
Evaluate adoption where the work happens
A system can satisfy functional requirements and still create unnecessary friction for the people expected to use it every day.
Return to the technician workflows from the demo.
Consider:
- number of steps for common work
- mobile usability
- offline behavior
- amount of required typing
- ability to find asset history
- labor and parts entry
- photos and attachments
- navigation
- error correction
- follow-up work
- required training
- supervisor workflow
Do the same for planners, supervisors, storeroom staff or other frequent users where their workflow matters.
Do not replace this with a general question such as "Which interface looks nicest?"
Evaluate the work.
If possible, include actual future users in this part of the comparison.
Compare cost only after the scope matches
A lower quote is not necessarily a lower-cost proposal if it contains less. Two CMMS prices are only meaningfully comparable when they describe sufficiently similar boundaries: the same operational scope, the same included components, the same period of time and the same commercial assumptions about what can change the price. Our CMMS cost research works through that comparison using documented purchases.
Before comparing totals, normalize the scope.
For each finalist, identify whether the price includes:
- software
- required product tier
- expected users
- requester access
- sites
- modules
- implementation
- configuration
- migration
- integrations
- training
- support
- third-party products
- custom work
- recurring services
Then compare the same time horizon.
| Cost | Vendor A | Vendor B | Vendor C |
|---|---|---|---|
| Year 1 | |||
| Annual recurring | |||
| 3-year total | |||
| 5-year total |
Make assumptions visible.
If one proposal assumes 50 paid users and another assumes 30, resolve the difference.
If one includes ERP integration and another does not, resolve it.
If one includes implementation and another lists professional services separately, bring them onto comparable scope.
For more detail, see How CMMS Pricing Works and What Should a CMMS Cost?
Separate current capability from future promises
Carry roadmap items into the comparison explicitly.
Create a small list for each finalist:
Required capability dependent on roadmap: ___
Expected release: ___
Evidence provided: ___
Consequence if delayed: ___
A future feature may be worth considering.
But a requirement that exists today in one product and may exist later in another does not carry the same delivery risk.
If the future capability is important, decide what would happen if it arrived six months late, twelve months late, or changed before release.
Do not quietly score the roadmap as though it were already production software.
Identify custom and third-party dependencies
For every important requirement, understand whether the proposed solution is:
- standard product functionality
- configuration
- add-on/module
- third-party software
- integration
- custom development
- future functionality
This does not mean configuration, third-party products or custom work are automatically bad.
It means they belong in the decision.
Ask:
Who supports it?
Who upgrades it?
What happens when the core CMMS changes?
Is another contract required?
Is another vendor involved?
Does it change implementation time?
Does it change recurring cost?
What happens if the integration fails?
A "yes" in the requirements matrix may contain a much larger project behind it.
Build an uncertainty and risk view
After requirements, implementation and cost are compared, create one more table.
| Risk / uncertainty | Vendor A | Vendor B | Vendor C |
|---|---|---|---|
| Unresolved requirements | |||
| Roadmap dependencies | |||
| Custom development | |||
| Third-party dependencies | |||
| Integration uncertainty | |||
| Migration uncertainty | |||
| Adoption concern | |||
| Contract / pricing assumption |
Do not score every risk simply because you can.
The purpose is visibility.
Some risks can be resolved before selection.
Others can be reduced through contract terms, implementation planning, additional testing or another demonstration.
Some may be acceptable.
Some may change the decision.
Use a clarification round when the evidence is incomplete
You do not have to select a CMMS immediately after the first round of demonstrations.
If two or three finalists remain close, use a focused clarification session.
Do not request another generic demo.
Bring the unresolved items.
For example:
- Show the offline synchronization we did not see.
- Walk us through the ERP integration architecture.
- Demonstrate the workflow that required a workaround.
- Show exactly how the asset hierarchy would be configured.
- Explain what is standard product versus custom work.
- Reconcile the user counts in the pricing proposal.
- Show the administrator workflow for correcting an error.
- Clarify the migration responsibilities.
- Demonstrate the report we could not reproduce.
The goal is to reduce uncertainty.
A second session that answers five important questions can be more valuable than another two-hour product tour.
Check references around the risks you found
Vendor references can be useful if you ask about the things your evaluation identified.
Generic questions such as:
"Are you happy with the software?"
usually produce generic answers.
Instead, if migration concerns you, ask:
- What condition was your data in before implementation?
- Who cleaned it?
- What did the vendor handle?
- What took longer than expected?
If technician adoption concerns you:
- How quickly did technicians begin using the system consistently?
- What caused resistance?
- What required additional training?
- What parts of the mobile workflow created difficulty?
If an integration concerns you:
- What systems did you integrate?
- Was the integration standard or custom?
- Who built and supports it?
- What problems appeared after go-live?
If implementation staffing concerns you:
- How much internal time did the project require?
- Which roles were most involved?
- What did you underestimate?
Use references to investigate uncertainty, not to collect compliments.
Review contract assumptions before the final decision
Before selecting the solution, compare the commercial assumptions behind it.
Confirm:
- users and user types
- sites
- modules
- implementation scope
- migration scope
- integrations
- training
- support
- service levels where relevant
- renewal terms
- price increases or escalation terms
- third-party costs
- custom work
- data access and export
- termination provisions
- responsibilities on both sides
A favorable product evaluation and an unclear commercial agreement are two separate issues.
Make sure the contract reflects the solution you evaluated.
Write a one-page decision memo
Before final approval, explain the decision without relying on the spreadsheet total.
Use a simple structure:
Selected solution:
___
Why it fits the operation:
___
Critical requirements verified:
___
Important strengths:
___
Tradeoffs accepted:
___
Implementation implications:
___
Year 1 cost:
___
3- or 5-year cost:
___
Remaining risks and how they will be handled:
___
Why the other finalists were not selected:
___
The memo forces the reasoning into plain language.
Someone who did not attend every demo should be able to understand the decision.
Months later, the implementation team should be able to see what assumptions were made.
Years later, the organization should be able to understand why the system was selected.
If the explanation is simply "it received the highest score," go back to the evidence.
A final comparison
Before making the selection, you should be able to answer:
Requirements
- Have all true gates been satisfied?
- Which important requirements were demonstrated?
- Which were only explained or documented?
- Are any important requirements still unresolved?
- Does anything important depend on future functionality?
Operation
- Can technicians perform the work they need to perform?
- Can supervisors manage the work?
- Can managers get the information they need?
- Does the system fit the asset and location structure?
- Are required integrations practical?
Delivery
- What configuration is required?
- What data work is required?
- What integrations need to be built?
- How much internal effort will implementation require?
- What training and change management are needed?
- What custom or third-party dependencies exist?
Economics
- Are the proposals based on comparable scope?
- What is Year 1 cost?
- What is recurring annual cost?
- What is the three- or five-year cost?
- What could cause those costs to increase?
Risk
- What remains uncertain?
- What depends on a roadmap?
- What depends on custom development?
- What are the major implementation risks?
- What tradeoffs are you accepting?
Decision
- Can you explain why the selected system fits the operation?
- Can you explain why the tradeoffs are acceptable?
- Can you explain why the alternatives were not selected?
The comparison is finished when the important requirements have evidence behind them, the implementation is understood, the costs are comparable, the remaining risks are visible, and the organization can explain the decision.
Then the work changes.
The question is no longer which CMMS to buy.
It becomes how to get the chosen system working in the operation.
Next → What to Expect During CMMS Implementation
Sources
- Brevard County, Florida — Computerized Maintenance Management System Procurement
Supports the discussion of a CMMS evaluation using separate technical, implementation/support, price, team and organizational criteria and a requirements structure distinguishing proposed-solution, third-party, custom and unsupported responses.
- Indian River County, Florida — RFP 2026016, CMMS Software Services and Implementation
Supports the discussion of separate evaluation areas for the proposed CMMS, implementation, migration/technical architecture, training/change management, project team/references, cost/value and assumptions/exceptions.
- Eastern Washington University — CMMS Procurement
Supports the discussion of another CMMS procurement using separate technical, management and cost proposal components.
- NASA — Facilities Maintenance and Operations Management
Supports the principle that maintenance organizations should establish maintenance data requirements before acquiring or modifying a CMMS and acquire only the capability required for the maintenance organization's goals.