National IT Project Management Methodology

(1)

Project Reporting Support Guide version 0.5 Page 1

NATIONAL INFORMATION TECHNOLOGY AUTHORITY -

UGANDA

National IT Project Management

Methodology

Project Reporting Support Guide

(2)

Projects Reporting Support Guide version 0.5 Page 2

Document Version Control

Version Date Author Change Description

0.1 02-04-2013 Gerald Kisongoch, PMP. Draft

0.2 10-06-2013 Gerald Kisongoch,PMP, PMI-RMP Content Review

0.3 13-06-2013 Abdul Nsubuga, PMP Document general review and restructuring

0.5 26 July 2013 Taskforce Incorporated Workshop

comments

(3)

1. Introduction

1.1 Project Reporting Overview

1.1.1 This document provides guidance on the performance reporting

used to monitor and control projects using the guidelines provided in the National IT Project Management Methodology. The guidelines in this document have been developed to ensure all IT projects in government apply similar control mechanisms and report in a consistent manner. It is designed to be used by stakeholders who are participating in the project and are required to provide project reports.

1.1.2 Project progress should be monitored and reported throughout the project life-cycle to be able to establish the follow among other aspects:

1) Measure objectives and outcomes presented in the Business case VS the actual deliverables

2) Monitor whether the business case is still justified 3) Assess that the project still meets Business / Institution

needs

4) Measure what is actually achieved against the baseline (time, budget and quality)

5) Assess what remains to be achieved and the effort required to achieve it

6) Update plans and revise forecasts

7) Identify what control actions and corrective actions are required to keep the project on track

8) Establish how efficiently are we using resources 9) Forecast what the project is likely to cost and time

required

10) Provide the basis for lessons learned

11) Obtain performance metrics to provide estimates for future projects

(5)

2. Project Reporting Scalability

2.1 The project reports will look similar for all projects regardless of their key characteristics of size, risk and complexity. The only difference between projects reporting will be the level of granularity applied to the monitoring and control activities. For example small projects, Project team may only monitor summary performance information at the overall project level, such as, the start and end dates and total spend against total budget, whilst a medium and large projects monitor at a much lower level of detail down to key milestone and key deliverables’ start and finish timelines, key dependencies, monthly spend by activity/cost element against budget, risks, issues, changes and forecasts among others.

2.2 It is the Project Managers’ responsibility to engage with the Steering Committee and other stakeholders to agree on the appropriate level of details for their project reports.

3. Monitoring Project Performance

3.1 Project performance should be monitored and controlled against the approved business case, project management plan and project baselines to ensure the project is delivered to the agreed timelines, cost and expected quality deliverables. Controlling the project baseline is absolutely essential to project success. Project quality will be monitored using the project health indicators and project quality assurance and controls, which must be agreed up in the early stages (initiation and planning) of the project.

3.2 Table 1 below provides guidelines for the performance reports expected throughout the lifecycle of a project:

(6)

Projects Reporting Support Guide version 0.5 Page 6 Table 1: Guidelines on Performance Reports

Project Status Definition Report Type

Project Initiation

Funnel Project is proposed and awaiting approval and funding to proceed.

Pipeline Report

Pipeline Project is committed and is awaiting funding approval , and Project Manager to be assigned to enable it to start. Active In Progress The project is in-progress

in its project planning or execution or stages

Project Status Report

Project/Programme Summary Report

Dashboard Report Finance Report

Earned Value Report (optional) Exception Report (for projects off-track)

Close-out Project Manager is being de-assigned and the project accounts are still open until all project costs are accounted for or until the financial year has closed.

Final Project Status Report Final Project/Programme Summary Report

Final Dashboard Report Final Finance Report Procurement status report In-active Deferred The project is on hold or

deferred to be re-started at a later date.

Dashboard Report Finance Report Cancelled The project is cancelled,

the project manager is de-assigned and the project accounts are closing or closed.

Final Project Status Report Final Project/Programme Summary Report

Final Dashboard Report Final Finance Report Closed Project Manager has been

de-assigned and the project and finances have been closed.

Post Implementation Review

(7)

4.1 The performance reporting process involves the collection of all project/programme data, and distribution of performance information to stakeholders. Project performance should be reported at a detailed level for each individual project, and a one-page overview produced to report performance of all projects in the MDA.

4.2 All projects ‘In-progress’, the Project Manager should report on project performance each month, as a minimum. At the end of the ‘Project Close-out’ stage, and before the project manager is de-assigned and the project is formally ‘Closed’, a final project closure report should be produced.

4.3 The table below outlines the project performance areas that should be monitored and controlled to maximise the success of a project: Table 2: Project Performance Areas to be Monitored and Controlled

Monitoring Performance: Reporting:

Project Schedule against the Baseline

The actual and estimated start and completion dates for the project, stages and milestones are reported to monitor any deviation from the agreed baseline start and completion dates. If the deviation from the agreed baseline is greater than the agreed threshold for performance corrective action will be required. A baselined Project Implementation Plan will be the source of information.

Project Spend against the Baseline Budget

The actual spend and forecast cost at completion is reported to monitor any deviation from the agreed baseline budget. If the deviation from the agreed baseline is greater than the agreed threshold for performance corrective action will be required. Approved Budget will be the baseline source of information

Project Health ‘Traffic Light’ indicators are reported to monitor the health of a project and identify whether corrective

(8)

Projects Reporting Support Guide version 0.5 Page 8 action is required in the following areas:

o Delivery Confidence o Project Governance o Business Change o Benefits Realisation o Project Dependency o Project Resourcing o Project Scope

The definitions section of this document describes how to apply these indicators.

Project Achievements The actual achievements of the project within a set time period should be reported to monitor the progress of the project. An achievement is generally the completion of a key milestone or key deliverable, and the set time period is usually aligned to the reporting schedule i.e. over the previous reporting month.

Project Outlook The project outlook monitors the planned

achievements of the project over a set time period, which is usually aligned to the reporting schedule i.e. over next reporting month.

The combination of Achievements and Outlook provides another checking mechanism for project performance i.e. if the achievements that were planned within a set time period were not actually achieved with that time period, the project may be experiencing problems with delay.

Escalated Risks The escalated risks are those that are of ‘high’ impact and probability and cannot be mitigated within the threshold of the project and have been escalated to the Steering Committee for higher level management prevention. These are taken from the project Risk Log and closely monitored as they could severely impact the successful delivery of the project.

Escalated Issues The escalated issues are those that are of ‘high’ impact and cannot be resolved within the threshold of the project and have therefore been escalated to the Steering Committee for higher level management

(9)

Projects Reporting Support Guide version 0.5 Page 9 intervention and corrective action. These are taken from the project Issue Log and closely monitored as they are severely impacting the successful delivery of the project.

5. Reporting Schedule

Project managers should produce projects and/or programmes performance reports monthly. The following report schedule should be observed.

5.1 Projects Off-Track and Exception Reporting

Despite an exceptionally well planned project, the actual performance of the project may not always achieve the agreed thresholds set out in the project management plan, due to unforeseen influencing factors, namely risks and issues. The Project Manager should always agree the performance thresholds for each project with the Sponsor and Steering Committee, as percentage margins of time, cost and quality. This should allow actual performance to fluctuate within these percentage margins and the project will still be considered under control.

The Project Manager should produce an Exception Report to advise the Steering

Committee that the plan has deviated or is predicted to deviate, significantly, outside of its agreed threshold margins. An exception report describes the forecast deviation, and provides analysis of both the exception and corrective action in terms of cost, time and quality. The recommended options to bring the project back on track should also highlight any impact on the benefits stated in the business case to ensure its continued viability. Template is available in the project reporting tool kit.

5.2 Performance Reports

All projects should produce performance reports unless there are exceptional circumstances and the Steering Committee. Template is available in the project reporting tool kit.

(10)

5.3 Pipeline Report

The Pipeline Report should be produced to provide a high level view of all proposed projects that are in either ‘Funnel’ or ‘Pipeline’ status, in the Project initiation stage. Each proposed initiative is reviewed and prioritised, on a regular basis, as part of the business as –usual planning process to decide whether it is a viable proposition, and therefore should be allocated funding to proceed. Template is available in the project reporting tool kit.

5.4 Project Status Report

The Project Status Report should be produced monthly to enable key stakeholders track project schedule and budget against the baseline plan, assess the project health, and monitor risks, issues and changes.

The information supplied in this report should be used to produce Dashboard Reports as part of the monthly reporting cycle. Template is available in the project reporting tool kit.

5.5 Project Finance Report

The Project Finance Report should be produced monthly to track actual spend and forecast costs against the baseline Budget. The report should include the summary KPI information that can be extracted from the Project Cost Tracker. The summary finance information should be used to produce Dashboard Reports. Template is available in the project reporting tool kit.

5.6 Project Cost Tracker

The Project Cost Tracker should be maintained by the by the Project Manager to capture and track the detailed project costs and latest forecasts. It is recommended that the project manager updates the Project Cost Tracker on a weekly basis and extracts the summary KPI information to update the Project Finance Report. Template is available in the project reporting tool kit.

(11)

5.7 Dashboard Report

The Dashboard Report should be produced monthly to provide key stakeholders with a summary of project performance. The report provides KPI information on project schedule and budget against the baseline plan and project health. Template is available in the project reporting tool kit.

6. Performance Report Definitions

6.1 Project / Programme Health

6.1.1 A project health should be monitored in the following areas

indicators:

1) Delivery Confidence 2) Project Governance

3) Business Change Management 4) Benefits Realisation Plan 5) Project Dependency 6) Project Resourcing 7) Scope

6.1.2 Guidance on Programmes: When reporting status on programme

health, determine the overall importance of each project that is included within the Programme. Based on the project’s health in a given area and based on the Programme Manager’s judgement of all the factors

influencing the overall performance of the programme the overall health of the Programme can be determined. Note: this is an informed but subjective view of project/programme health.

Table 3: Project Health Reporting Tool

Project Name: ... Implementing Agency: ...

Project Manager:... Reporting Period:... No. Project Health Indicator

(12)

Projects Reporting Support Guide version 0.5 Page 12 (Dashboard Elements)

1 Delivery Confidence 2 Project Governance

3 Business Change Management 4 Benefits Realisation Plan 5 Project Dependency 6 Project Resourcing 7 Scope

Overall Project Health

Project Managers Signature and Date:

Steering Committee Chairperson Signature and Date:

Table 4: Programme Health Reporting Tool

Programme Name: ... Implementing Agency: ... Project A:... Project B: ... Project C: ... Period of Reporting: ...

No. Health Indicator (Dashboard Elements)

Project A Project B Project C

1 Delivery Confidence 2 Project Governance

(13)

Projects Reporting Support Guide version 0.5 Page 13 3 Business Change Management

4 Benefits Realisation Plan 5 Project Dependency 6 Project Resourcing 7 Scope

Overall Project Health Overall Programme Health

Project Manager Name, Sign & Date ... ... ... ... ... ... ... ... ... Steering Committee Sign Off

6.2 Project Health (Traffic Light) Indicators

6.2.1 Traffic light indicators should highlight the health status of the

project/programme to the best of the Project Manager's knowledge and judgement. ‘Amber’ and ‘Red’ indicators should be used to highlight whether the project is experiencing issues that may impact its success if corrective action is not taken in time.

6.2.2 Although ‘Amber’ and ‘Red’ indicators signal the need for

management attention, the Project Manager should also follow normal escalation channels via the Steering Committee to escalate risks and issues that need management intervention.

Table 5: Overall Programme / Project Health Indicators Definitions

Traffic Light

Definition

Green Programme/project is performing within the agreed thresholds for the specified health indicator, and although there may be issues, these are

(14)

Projects Reporting Support Guide version 0.5 Page 14 under control and are not expected to impact the ability to deliver the project with the agreed thresholds.

Amber There are risks and issues affecting the health of the project that may impact the ability to deliver the project within the agreed thresholds. A corrective action plan in place/being agreed with higher management and the project is being monitored as high risk. The return to green comments should specifically state the level to which the issues have been escalated and what corrective action is being taken. An Exception Report may be required if there are significant risks with a number of health indicators that will impact the ability to deliver the project within the agreed thresholds.

Red There are serious issues affecting the health of the project that are significantly impacting the ability to deliver the project, the project has exceeded its threshold The issues have been escalated for higher management attention for resolution, and a plan for corrective action is already in place. The return to green comments should specifically state the level to which the issues have been escalated and what corrective action is being taken.

6.3 Delivery Confidence

6.3.1 This provides an overall indicator of the level of confidence in

project delivery, based on the reported status of the other dashboard elements and latest estimates at completion.

6.3.2 It is recognised that large complex programmes/projects contain a

mixture of good progress and problematic issues. The

project/programme manager will use their judgment and insight to select the appropriate indicator using the guidelines as a common framework for their decision-making.

Table 6: Delivery Confidence Indicators Definitions

Definition

Green High: The project is running smoothly. Any issues experienced by project

are under control and there is confidence that the project will be delivered within the agreed thresholds of time, quality and cost, and the benefits outlined in the business case are achievable.

(15)

Projects Reporting Support Guide version 0.5 Page 15 management attention as they may impact the ability to delivery project within the agreed thresholds of time, quality, cost or the benefits outlined in the business case. A corrective action plan in place/being agreed with higher management and this area is being monitored as high risk. The return to green comments should specifically state the level to which the issues have been escalated and what corrective action is being taken. Red Low: The project/programme is not performing within the agreed

thresholds of the project management plan, as there are significant issues impacting the schedule, budget, quality, or benefits delivery that have been escalated to higher management for intervention and corrective action. The project/programme plan maybe undergoing a re-baseline and will require higher management attention until the issues are considered as under control and confidence in the delivery of the project has been regained.

6.4 Project Governance

6.4.1 This indicates whether an appropriate governance structure is in

place, the effectiveness of the governance structure and associated processes, and the engagement of key stakeholders.

Table 7: Project Governance Indicators Definitions

Definition

Green Active/ Full Representation: An effective and clear governance structure

has been implemented that is setting direction and actively managing major project issues on a regular basis. All appropriate stakeholder groups are represented within the process.

Amber Active/ Partial Representation: A governance structure has been

implemented, setting direction but not actively managing major project issues on a regular basis. Not all stakeholder groups are represented within the structure, and/or the structure is not entirely clear. Although this is not immediately impacting the ability to deliver successfully, corrective action is needed, and this area should be monitored as high risk.

Red None/ Not Effective: No governance structure is in place, or the existing

governance structure is ineffective, e.g. inappropriate stakeholder representation to ensure effective management decisions/intervention. There is a significant risk the governance structure will not be able to resolve project issues if/when they arise.

(16)

6.5 Business Change Management

6.5.1 This indicates the readiness of the business with regards to

managing and supporting the business and the ‘human’ side of change, ensuring any new processes required are defined, the targeted

community is ready, willing and able to utilise the new processes and tools and a change management implementation plan exists.

Table 8: Business Change Management Indicators Definitions

Definition

Green Actively Managed: The following framework of activities are underway:

 The impact of changes and the risks involved have been analysed and are being actively managed.

 Any new processes required have been defined, or plans exist to define them.

 Stakeholders are involved and are actively preparing for the transition.

 Business Change management Plans have been built and are being executed.

 The appropriate communications and training are being provided.

 Incentives are being provided to stakeholders to realise the change.

 Change agents are identified and equipped with reasons for and advantages of the change

 Top management support exists

Amber Minor Issues/Major Risks: The issues experienced in this area are

considered as under control and a corrective action plan is being/has been agreed with higher management and this area is being monitored as high risk.

Red Significant Issues: Significant issues exist in this area, which need

immediate attention, as there is a significant impact on the successful delivery of the project due to inability of the business to effectively accept and adopt the change. The return to green comments should specifically state the level to which the issues have been escalated and what corrective action is being taken.

(17)

6.6.1 This indicates whether the Institution has developed, documented

and committed to a robust benefits realisation plan that will ensure all planned benefits are realised when the project is completed.

Table 9: Benefits Realization Indicators Definitions

Definition

Green The Benefits Realisation Plan is documented to ensure the benefits outlined in the business case are achieved.

Amber The Benefits Realisation Plan has been documented and agreed; however, the benefits may not be realized due to changes in environment or policy Red The Benefits Realisation Plan has not been formulated. The return to

green comments should specifically state the level to which the issues have been escalated and what corrective action is being taken.

6.7 Project Dependency

6.7.1 This indicates how well project dependencies are being managed. Table 10: Project Dependency Indicators Definitions

Definition

Green Agreed and managed: All external and internal project dependencies have

been identified. All relevant meetings with all parties have been set-up and the project plans have been integrated with those of the affected parties. Low risk of dependencies impacting the ability to deliver the project/programme successfully.

Amber Minor Issues/High Risk: There are issues, which may delay, or cause

material changes to the project due to a dependency on an affected party or another project. The dependencies are either 1) being managed with the risk of impact being closely monitored and controlled, or 2) a corrective action plan is in place/being agreed with higher management to prevent the dependencies from having an impact. Impact is considered as under control and being monitored as high risk.

Red Significant Issues: There is a major impact on the ability to deliver the

project due to dependencies either 1) not having been identified or 2) being unmanageable. The issues have been escalated to higher management for intervention and corrective action, to enable the project to be delivered within the agreed thresholds.

(18)

6.8 Project Resourcing

6.8.1 This indicates the status of project resources. Project managers provide their management judgment and insight on the appropriateness of the number and quality of their resources.

Table 11: Project Resourcing Indicators Definitions

Definition

Green Fully Resourced: All resources have been identified in the plan or are

already assigned.

Amber Minor Issues/High Risk: Resources have not been identified, or made

sufficiently available, or do not have the right capabilities to deliver the project work required. The issue with resources is either 1) being managed with the risk of impact being closely monitored and controlled, or 2) a corrective action plan is in place/being agreed with higher management. Impact is considered as under control and being monitored as high risk.

Red Significant Issues: The project is significantly under-resourced, which is

having a major impact on the ability to deliver within the agreed thresholds. The issues have been escalated to higher management for intervention and corrective action, to enable the project to be delivered within the agreed thresholds.

6.9 Project Scope

6.9.1 This indicates how well the scope is being managed and all

changes are being controlled. Table 12: Project Scope Indicators Definitions

Definition

Green Stable: Scope is well defined and a robust change control process is in

place and being strictly adhered to. All changes have been assessed effectively and can be delivered within the agreed thresholds of the project. Project scope is considered as stable.

(19)

Projects Reporting Support Guide version 0.5 Page 19 Amber Minor Issues/High Risk: There are a number of issues which may require a

change to the project scope. The impact of the potential change to scope is either 1) being assessed, or has been assessed, and is considered as high risk as contingency will be required, or 2) management intervention may be required.

Red Significant Scope Issues: There are significant scope issues and/or change

control processes are not effective. The issues have been escalated to higher management for intervention and corrective action, to enable the project to be delivered within the agreed thresholds.

7. Project Stage Gates

7.1 Project Stage Gate Definitions

7.1.1 The stage gates should be used to monitor and control project

delivery, and additional information regarding to required

documentation can be found in the main methodology section 3.14. There are four stage gates and in the following section we define the indicators.

Table 13: Stage Gate Status Indicators Definitions

Definition

White Not Started.

Green Achieving Schedule: The project is performing within the agreed baseline

threshold for the stage schedule.

Amber Recoverable Deviation: The project is experiencing minor deviation

(ranges from 6% - 15%) from the agreed baseline schedule, which is recoverable through corrective action recovery plan. There is minor or no impact on the critical path, business benefits or dependent projects. Red Significant Deviation: The project is experiencing major deviation (> 15%)

from the agreed baseline schedule, and cannot be recovered with corrective action. There is sufficient impact on the critical path, business benefits or dependent projects that a correct action recovery plan will not bring the project back on track. The project scope and plan may need to be re-assessed and re-baselined.

(20)

Projects Reporting Support Guide version 0.5 Page 20 Blue Completed.

8. Project Schedule Indicators

8.1 The following indicators should be referenced when monitoring and reporting project schedule Variance:

Table 14: Schedule Variance Indicators Definitions

Definition

Green Achieving Schedule: The project is on or ahead of time (schedule).

Amber _{Recoverable Deviation:}

The project has experienced some setbacks, which have led to a delay of between 5% - 15% over schedule.

Has a minor and recoverable impact to the overall project delivery, i.e. the delays will not adversely affect the critical path, or impact dependent projects or committed benefits.

Red Significant Deviation:

Delays are >15% behind schedule.

The project has experienced setbacks, which have led to delays that cannot be recovered. The overall project delivery will have to be put back, which may impact dependent projects and benefits delivery. The project plan is likely to require re-baselining to fully understand the business impact.

8.2. Percentage (%) Schedule variance is based on the difference between the planned schedule thresholds with the actual. Final Completion date Variance = Final date – Planned .

Schedule Variance

Is a useful metric used to measure schedule performance on a project. SV = EV-PV.

Positive SV means ahead of schedule; negative means the project is behind schedule. Zero means that all planned value was earned.

(21)

9. Project Budget Indicators

9.1 The Project Budget includes the agreed planned spend for the project. Additional information on Project Budget can be found in the Cost Management Guide. The following indicators are applied to monitor budget variance.

Table 15: Budget Variance Indicators Definitions

Definition

Green Achieving Budget for Current Spend to Date: The actual spend for the

project to date is within the budgeted spend to date.

Amber Recoverable Deviation: The actual spend for the project to date is

between 6% and 15% over / under the budgeted spend to date.

Red Significant Deviation: The actual spend for the project to date is more

than 15% over / under the budgeted spend to date.

9.2 Budget Variance % based on Estimate at Completion s the

variance, as a percentage, between the Estimate at Completion (EAC) and the Total Project Budget. Variance = (EAC – Budget) / Budget.

Cost Variance

Is a useful metric used to measure cost performance on a project. CV = EV- AC

Positive CV means below budget; negative means the project is above budget. Zero means on budget

It is important to determine the cause of variance and deciding whether corrective or preventive action is required.

The larger percentage variances allowed at the start of the project can decrease as the project nears completion.

(22)

10. Related Support Guides

The following support guides should be referenced when using this guide: 1. Project Initiation Support Guide

2. IT Project Steering Committee Support Guide 3. Project Manager Selection Support Guide 4. Project Change Management Guide 5. Project Reporting Support Guide

Monthly Project Reporting Templates Detailed report

(23)

National IT Project Management Methodology

NATIONAL INFORMATION TECHNOLOGY AUTHORITY -

UGANDA

National IT Project Management

Methodology

Project Reporting Support Guide

Table of Contents

1. Introduction

2. Project Reporting Scalability

3. Monitoring Project Performance

5. Reporting Schedule

6. Performance Report Definitions

7. Project Stage Gates

8. Project Schedule Indicators

9. Project Budget Indicators