Choose between options

Technology Evaluation

Compare software, platforms, or technical solutions across practical and strategic criteria. Useful for software selection, IT planning, procurement, and digital transformation. The criteria can be changed, added to and weighted.

What the framework is

Technology evaluation compares software, platforms or technical solutions against the criteria that matter to the people who will use and run them. The template starts with five criteria: Ease of Use, Integration Capability, Scalability, Cost Effectiveness, and Security and Reliability. The criteria can be changed, added to and weighted.

What the result looks like

EXAMPLE
Which platform should we adopt?
Top ranked
Platform A
Ease of Use 92% · 1st
Integration Capability 63% · 1st
Scalability 38% · 3rd
Cost Effectiveness 75% · 1st
Security and Reliability 50% · 2nd
63%
Weighted win rate

Overall

Options Weighted win rate
01
Platform A
Ease of Use 1st · Integration Capability 1st · Scalability 3rd · Cost Effectiveness 1st · Security and Reliability 2nd
63%
02
Platform B
Ease of Use 2nd · Integration Capability 2nd · Scalability 1st · Cost Effectiveness 3rd · Security and Reliability 1st
52%
03
Platform C
Ease of Use 3rd · Integration Capability 3rd · Scalability 2nd · Cost Effectiveness 2nd · Security and Reliability 3rd
35%

Overall with the criteria

Rank
Options
Ease of Use
20%
Integration Capability
20%
Scalability
20%
Cost Effectiveness
20%
Security and Reliability
20%
Overall
Weighted win rate
01 Platform A
92%
1st
63%
1st
38%
3rd
75%
1st
50%
2nd
63%
02 Platform B
42%
2nd
58%
2nd
71%
1st
33%
3rd
54%
1st
52%
03 Platform C
17%
3rd
29%
3rd
42%
2nd
42%
2nd
46%
3rd
35%

By the options

01 · Platform A 63% weighted win rate
–
Ease of Use
92%
1st of 3 · 22 Wins · 2 Losses
–
Integration Capability
63%
1st of 3 · 15 Wins · 9 Losses
–
Scalability
38%
3rd of 3 · 9 Wins · 15 Losses
–
Cost Effectiveness
75%
1st of 3 · 18 Wins · 6 Losses
–
Security and Reliability
50%
2nd of 3 · 12 Wins · 12 Losses
02 · Platform B 52% weighted win rate
–
Ease of Use
42%
2nd of 3 · 10 Wins · 14 Losses
–
Integration Capability
58%
2nd of 3 · 14 Wins · 10 Losses
–
Scalability
71%
1st of 3 · 17 Wins · 7 Losses
–
Cost Effectiveness
33%
3rd of 3 · 8 Wins · 16 Losses
–
Security and Reliability
54%
1st of 3 · 13 Wins · 11 Losses
03 · Platform C 35% weighted win rate
–
Ease of Use
17%
3rd of 3 · 4 Wins · 20 Losses
–
Integration Capability
29%
3rd of 3 · 7 Wins · 17 Losses
–
Scalability
42%
2nd of 3 · 10 Wins · 14 Losses
–
Cost Effectiveness
42%
2nd of 3 · 10 Wins · 14 Losses
–
Security and Reliability
46%
3rd of 3 · 11 Wins · 13 Losses
Scoring Explanations
CRITERIA WEIGHTINGS — The % weighting for each criterion is shown in the table header. Unless this was entered in the setup, the weighting is equal across criteria.
WEIGHTED WIN RATE — Each criterion's result, in the measure they share, averaged using the assigned weightings.

When it earns its place

Use it for software selection, platform migrations, procurement shortlists or build-versus-buy decisions, once you have two to six real candidates.

The trap is the demo. The solution with the best demonstration is not always the one that fits. Compare on evidence from trials, references and documentation, and include the people who will support it.

How to run it with a group

  1. Shortlist two to six solutions, and agree what evidence each will be judged on.
  2. Agree the weights. Security and Reliability may be a minimum bar rather than a trade-off.
  3. Participants compare the solutions two at a time on each criterion. Participants do not need an account to respond. Include users and the people who will run it.
  4. Read the overall ranking, then the ranking per criterion. A winner that ranks last on integration needs a plan for that before you sign.

Get started