Criteria Category 1:
Database Management and Other General Considerations
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
0 0 0
0 0
Tool # 2 Tool # 3 Tool # 4 Tool # 5
0 0 0 0 0 0 0 Tool # 5 0 0 0 0 0 0 0 Tool # 2 0 0 0 Tool # 3 Tool # 4 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
3 Supports entry of annotative comments and appending documents, images, and links for project documentation
0 0 2 Accommodates all project types and project information
1 Easy to create, change, delete, and view projects and project data. 0
5 Supports data import from your existing systems and databases (e.g., planning, financial systems)
6 Supports data export to your existing systems and databases
Data Management Weight Tool # 1
4 Accommodates hundreds/thousands of projects
9 Provides completeness/error checks and data warnings
10 Allows multiple portfolios and portfolio hierarchies (parent-child links) 7 Supports dependency links among projects
8 Provides data cut-and-paste, project cloning, and data roll-over
13 Provides data archiving
14 Provides statistical analysis of historical data (e.g., trend analysis) 11 Allows dynamic portfolios (portfolios defined based on latest project
data)
12 Provides search, filter, and sort
15 Accommodates hundreds/thousands of users
Governance and Security Weight Tool # 1
0
16 Provides security (encryption), controlled access and change privileges, and audit trail (who changed what when)
17 Provides PPM workflow guidance, status, and progress reporting
Criteria Category 1:
Database Management and Other General Considerations
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
Totals (all categories): 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0
Vendor Weight Tool # 1 Tool # 2 Tool # 3 Tool # 4 Tool # 5
0
0 0 0
Tool # 5
0 0 0 0
0
Delivery Weight Tool # 1 Tool # 2 Tool # 3 Tool # 4
0
0 0 0 0
Tool # 5
0 0 0 0
Help and Training Weight Tool # 1 Tool # 2 Tool # 3 Tool # 4
0 0 0 0 0 0 0 0 0 0 0 0 0
Communication and Collaboration Weight Tool # 1 Tool # 2
0 0
Totals (this category):
Tool # 3 Tool # 4 Tool # 5
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Tool # 4 Tool # 5 0 0 0
Displays and Reporting Weight Tool # 1 Tool # 2 Tool # 3
Able to slice, dice, and aggregate data with ability to load and change aggregation hierarchies
19 Easy to generate useful, understandable, schedulable displays and reports
0
20 Provides dashboard views plus ability to drill down
21 Allows users to configure/customize/format views, graphs, and reports
0 18
24 Supports mass communication and notification (via home page "bulletin board, mass emails, etc.)
25 Provides targeted communication and notification (selective, rule-based notifications via email)
22 Provides document management (document storage, read, save-as, check-in, check-out, version control, history, etc.)
23 Supports multiple languages and currencies
0
29 Provides desired delivery platform (on-demand service, desktop installation, web-based, etc.)
26 Supports real-time group communication (e.g., on-line chats, discussion forums, instant messaging)
27 Tool delivered with training for installation and operation
0 0
32 Vendor can be counted on to provide on-going support (maintenance, enhancements, warranties, escrow policy, etc.)
30 Supports your server and workstation operating systems and database environment
31 Vendor has expertise (in PPM, your industry, etc.)
28 Tool incorporates help features (e.g., mouse roll-over, documentation, educational videos, on-line training)
Criteria Category 2:
Project Evaluation and Portfolio Optimization
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
0 0
13 Able to support sophisticated computations/simulations (more than rate-and-weight scoring)
0 12 Supports customizable/user-defined metrics, scales, models, logic 0 11 Provides "out of box" project evaluation metrics
0
0
Financial Analysis
Tool # 2
8 Quantifies project risk
9 Quantifies project deferral risk (risks if the project is not conducted) 7 Supports after-tax financial analysis, including forecasting using pro
forma statements 0
0
Risk Analysis
6 Allows business-case cash-flow analysis over project/asset life-cycle with summary metrics (e.g., NPV, IRR, payback period)
Tool # 1 0 0 0 Tool # 4 0 0 0 14 Able to address non-financial project benefits (e.g., impacts on
corporate image, service quality, learning, safety) 10 Supports evaluation of risk-reward tradeoffs
0 0
0
0 0
5 Able to evaluate and optimize multi-year plans and scenarios
16 Able to provide/utilize default data/uncertainty ranges & turn off measures if data is unavailable or too time-consuming to acquire 15 Able to capture and model alignment with strategy and/or strategic
objectives
0 2 Accommodates mandated projects (including requirement that at least
one project version be funded) 1
0 3 Accounts for choice dependencies (e.g., project B may be selected only
if version 2 of project A is selected)
0 0
Decision Aid Weight Tool # 1
0 Evaluates real project choices (e.g., choice among alternative project
versions, do project now vs. do next year)
4 Able to evaluate alternative spending levels for pooled projects (e.g.,
what fraction of similar tasks to complete) 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Tool # 5 Tool # 3 0
Weight Tool # 1 Tool # 2 Tool # 3 Tool # 4 Tool # 5
Weight
Tool # 2 Tool # 3 Tool # 4 Tool # 5
0 0 0 0 0 0 0 0 0 0 0 0 Tool # 3 0 0 Tool # 4 Tool # 5 Project Evaluation Tool # 1 Tool # 2
0 0 0 0 0 0 0 0 0 Prioritization Page 3
Criteria Category 2:
Project Evaluation and Portfolio Optimization
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
0 Provides "sand box analysis" (local data entry/analysis prior to saving to
central database) 0 0 0
0
Allows setting performance goals/targets for a subset of portfolios 0
0
0
0 0
0 0
0 Selects project versions based on budget (e.g., lower-cost project
version may be optimal under tighter budget constraint) 0 0
0
32 Provides mechanisms for preventing/minimizing input "gaming" 28 Supports tiered/staged portfolio optimization (to allow business unit
priorities to be optimized/finalized prior to enterprise optimization)
31 Able to provides real-time feedback to users on impact of project inputs 19
20 Provides quantitative (cardinal) measure of project priority (not just project rank)
17 Able to quantify project value in dollar units (to allow direct comparison with project cost)
18 Value estimation based on comparing doing vs. not doing project (not doing project can produce negative value)
Project Valuation Weight Tool # 1 Tool # 2
0 0
22 Able to compute and display the efficient frontier of portfolios 0
0 0 0
0 0 0
0
23 Provides true portfolio optimization (solves "knapsack" problem) 21 Able to account for project urgency as well as cost and value when
computing priorities 0 0 0 0 0 0 0 0 0
24 Allows multiple constraints (e.g., multi-year costs, separate constraints
for different org. units, resource constraints) 0
27 0 25 26 30 29
Displays individual sources of project and portfolio value (e.g., financial,
customer service, safety) 0
0 0
Able to optimize/re-optimize portfolios with some projects being "forced
in" 0
0
0
Tool # 3
0 0 0 0
Totals (this category):
0 0 0 0 0 0 0 0 0 Tool # 4 Tool # 5 0 0 0 0 0 0
Prioritization and Portfolio Optimization Weight Tool # 1 Tool # 2
Able to adjust project value based on risk and risk tolerance (risk-adjusted project value)
0
Tool # 3 Tool # 4 Tool # 5
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Totals (all categories): 0 0 0 0
Criteria Category 3:
Project Planning and Project Management
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
0
0 1
0 12 Supports issue tracking and management (e.g., issue definition,
assigning to issue owners, converting issues to tasks) 13
0 10 Provides template library for project tasks (charter, issues log, request
forms, etc.) with ability to add, modify & save templates 11 Provides meeting schedule with automated invites
15
1
0 1 0
Workflow Management
9 Supports workflow management (generates individual task lists, reports status, routes action notifications, supports approvals, etc.)
Weight
1 8 Supports project risk assessment and risk mitigation planning
1 0
0 6 Supports timing and scheduling (e.g., via Gantt charts and Pert charts
7 Provide compliance-based processes (e.g., PMBOK, SDLC, ISO 9000, Sarbanes-Oxley, CMMI)
0 1
0 5 Allows defining projct-specific phases, gating processes, and
milestones
0 0 3 Allows linking mult--level project and task plans
1
2 Provides project baseline tracking, version control, audit trail, and plan history
4 Able to compute total project costs (e.g., via labor hours, rates, burden, materials and other expenses)
Tool # 4
0 0
0 0
0
Project Planning Weight Tool # 1 Tool # 2 Tool # 3
Supports workplan development (via templates, etc.), controls plan creation/modification/deletion, and provides plan storage
0 0
0
0
1 0 1
Provides change management (change reporting, approvals, change
impact analysis) 0 1 0 1 0 0 1 0 1 0 0 0 1 0 1 0
14 Povides analytics and project trade-offs for supporting task level
decisions 0 1 0 1 0 0 1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 0 0 1 0 0 1 0 1 0 0 0 1 0 0 1 0 0 0 0 0 Tool # 1 Tool # 2 0 1 0 1 Tool # 3 Tool # 4
Provides analytics/models for project performance assessment, benefits measurement, and value realization management
Tool # 5
Tool # 5
1
Criteria Category 3:
Project Planning and Project Management
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
0 0
24 Supports risk monitoring and on-going multi-project risk management 0
26 Able to capture and transmit project costs, expenses, commitments,
etc. for accounting. 0 0
0 0 0 0 0 0 0 0 0 0 23 Supports project reporting/forecasting according to government
contracting requirements (e.g., earned value analysis - EVA) 0 0
22 0 0
32 Supports project management knowledge database for storage and mining
31 Supports post-implementation reviews and lessons learned 30 Provides project outcome performance monitoring/reporting (e.g.,
project payback, benefits tracking)
0 Supports payroll and billing (e.g., expense reporting)
29 Supports verification of project deliverable acceptance criteria
Project Close Out and Knowledge Management Weight
28
25 Able to use project status and project forecasts to update financial budget forecasts
27 Suppot preparation and generation fo wok oders for project and accounting system integration
19 Able to calculate performance ratios manually or automatically at secified points in time or at project milestones
0 16
0
0
18 Able to aggregate cost, effort, and schedule data across pojects (e.g., Gantt dta roll-up)
Project Data and Status Reporting Weight
Able to manually/auto load and selectively change project data (start/end dates, units of work requied, etc.)
17 Able to capture, compute, and report real-time actuals (e.g., costs, effort, and shedule status)
20 Provides dashboard view of status of all projects with ability to drill
down 0 0
Tool # 3
0
0 0
Provides comparison of acutal vs. planned progress with variance analysis, alerts, and rule-based notification
0
Tool # 2
21 Computes/displays estimates of remaining work (hours to completion, percent of wok completed, end-date forecasting, etc.)
0 0
Tool # 1 Tool # 4 Tool # 5
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Tool # 3 Tool # 4 Tool # 5
0
0 0
0
0 0
Totals (this category):
Support for Accounting, Accual, Payroll, Billing, Etc. Weight Tool # 1 Tool # 2
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Tool # 1 Tool # 2 Tool # 3 Tool # 4
0 Tool # 5 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Totals (all categories): 0 0 0 0
Criteria Category 4:
Resource Management and Supply Demand Balancing
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
Provides dashboard view with drill down to individual resource
availability (eg., by time, skill, location, assignments) 0 0
Tool # 2 Tool # 3 Tool # 4 Tool # 5
0
0
0
Tool # 3 Tool # 4 Tool # 5
0 0 0 0 Tool # 1 Tool # 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
5 Includes non-human resources (normal, consumable, perishable) for non-human resource management
0 4 Tracks evolution and development of individual resources (e.g.,
experiences, skill growth)
1 Captures all people resource categories and allows segmentation
based on geography, organizationl unit, resource pool, etc. 0 0
0 3
Supports obtaining time-to-complete estimates directly from individuals
(which may provide more accurate availability estimates) 0
Resource Management Weight Tool # 1
6 Supports resource queries (e.g., chargeable/non-chargeable hours)
0
0 0
0 7 Provides automated, rule-based routing of updates regarding individual
resources (e.g., change in availability, rate)
0 8
0
0 0 0
0 0 0
10 Supports formal resource request system (preparation of requests, aggregate views by demand categories and over time, etc.)
Demand Management
9 Allows specifying resource demand categories (e.g.,projects, organization units, applications)
Weight
11 Reports resource request and application status per your demand management workflow process
13 Provides statistical analysis of requests (e.g., trend analysis of request types, resonse times, escalations)
12 Able to schedule requests based on priority, date, contribution, or other criteria
0
0 0
2 Captures necessary information for characterizing individual resources
(e.g., skills, certifications, education, rates, interests) 0
0
Criteria Category 4:
Resource Management and Supply Demand Balancing
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
Score Total Score Total Score Total Score Total Score Total
0
0 0
0 0
Totals (all categories): 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Tool # 1 Tool # 2 Tool # 3 Tool # 4 Tool # 5
0 0
0 0
0 0
Totals (this category): 0
0 0
Supply-Demand Weight Tool # 1 Tool # 2
21 Allows viewing resource assignments by individual and project
0 0 0 0 0 0 0 0 0 0 0
Weight Tool # 1 Tool # 2
0
0 0
20 Provides scheduling engine for assigning and scheduling resources 0 0
Resource Assignment
0 0 0
Tool # 3 Tool # 4 Tool # 5
19 Provides automated resource assignment (based on availability and
user defined criteria) 0 0
0 0 0 0 0 0 0 18 Includes operational and administrative resource assignment (in
addition to project resource assignment) 0 0
0
0 22 Allows manual changes to resource assignments for individual projects
after project initiation 0 0 0 0 0
23 Supports approval processes for the assignment of resources 0 0
Supports time-phased resource booking to projects (by manually loading resource assignments).
17 Support resource booking to organizational requests (for subsequent assignment to projects)
Supports top-down resource assignment (e.g., provides search and sort based on roll, skill, location)
15 Supports bottom-up resource assignment (e.g., by allowing individuals to review and select from availability assignments)
14
0 26 Summarizes utilization levels by resource category and over time
Provides analytics to support planning for acquiring additional internal/external resources
0
16
29 Exports project data to timesheet systems (e.g., ability to load time sheet with allocated activities)
Time Tracking Weight
0
32 Exports accepted time data to payroll and billing systems 31 Includes electronic time clock
30 Includes employee timesheet system
0 28 0 0 0 0 0
24 Synchronization of availability schedules with personal calendars (to
incorporte non-project commitments, planned absences) 0
0 0
0
0 0 0 0
0
Tool # 3 Tool # 4 Tool # 5
0
0 0 0
25 Supports non-human resource allocation management 0
27 Compares resource supply-demand by resource category, identifies
gaps, bottlenecks, and over-allocated resources 0 0
