1 At this stage in the project, the contractor will be provided with additional data sets as described in Attachments 2.3 and 2.4. Data from New York City will be excluded; only data from the rest of NYS will be included in the data sets.
Page 34 of 119
anomaly detection (including validation of parties and transactional testing);
data visualization; and
social network analysis.
The following requirements provide more specificity as to how OCFS envisages the Program Integrity Application will function.
5.3 Report Requirements
The Program Integrity application must provide reporting capabilities. Reports shall be designed to provide and support investigative workers with various risk reporting analyses based on risk indicators.
Reporting information will be related to different subject types to include: Provider; Parent/Child; and Local District Social Services worker.
Reports shall be made available by: District, Multiple District and statewide.
• Overall Risk Score for each Subject
• Raw Score for each Indicator & the weight of each indicator
• Investigative Status
Report 2 (See Attachment 3.2) – Overall Report.
Display on screen and/or be able to export into MS Excel or PDF, the following information: Display on screen and/or be able to export into MS Excel or PDF, the following information:
Page 35 of 119 investigative stages and/or Status of any provider or family flagged as possibly being involved in fraud, waste and/or abuse. Will include aggregate reports of totals for administrative purposes.
5.4 Search Capability
The system must provide the ability to search by the following criteria:
The system must have drilldown capability allowing end users to access the underlying data that led to the case being flagged as at risk for fraud.
Mandatory Requirement
Describe how this capability will be achieved.
5.6 History and Audit
The system must maintain history of all risk rankings generated.
At a minimum, the system shall provide the ability to capture, track and display the following information:
• Investigative case notes
• Flagged cases
• Cases currently being worked on
• Investigator(s) currently working on the case
• Outcome of the case
• Monies recovered
• Start and end dates of investigation
• Type of fraud – e.g. undisclosed income, no
Page 36 of 119
Ref # Requirement Response Requirement
5.9 Risk Ranking Thresholds and Weightings
The system must allow authorized system administrators to change threshold and weightings used to define risk categories. controls that allow system administrators to create user roles and assign access to the user roles.
The system must allow users to be assigned to single, multiple or all districts. Access to information shall be restricted to the district(s) to which the user is assigned. Investigators need to be able to see all cases from their district even if the fraud appears to be taking place in another county.
Mandatory Requirement
Describe how this capability will be achieved.
5.11 Program Integrity Application – Version 1.0 (Available in New York State Data Center) Because of the inclusion of data sets that are owned by an agency external to OCFS, namely the New York State Office of Temporary and Disability Assistance (OTDA), it will be necessary for the Program Integrity Application to be developed and hosted in the New York State Data Center in a development environment to be provided jointly by OCFS and the Office for Information Technology Services – OITS - (formerly the Office for Technology).
The contractor must work with OCFS and OITS staff to ensure the Program Integrity Application is developed and deployed in the New York State Data Center.
Initially the implementation of the Program Integrity Application will be available to a restricted group of key OCFS staff.
Mandatory Requirement
Describe how the Program Integrity Application will be developed.
Describe how the Program Integrity Application will “self-learn” based on repeated execution of the tool. Program Integrity Application to a limited number of field staff in local district offices on a Pilot basis for three months.
The Pilot will be subject to OCFS approval.
Mandatory Requirement
Describe how the Program Integrity Application will be piloted. Program Integrity Application to all field staff in local district offices (refer to section 8 – Training and Ongoing Support Requirements).
Mandatory Requirement
Describe how the Program Integrity Application will be deployed to all field staff.
Describe the testing processes to be used to ensure full testing of the Program Integrity Application.
Page 37 of 119
Ref # Requirement Response Requirement
Deployment to all field staff will not occur until the contractor has fully tested the tool and its graphical user interface. Deployment will be subject to OCFS approval.
5.14 Program Integrity Application Evaluation
OCFS will work with the contractor to evaluate how Version 1.0 responds to and learns from user input regarding cases that were flagged as potentially involving fraud. Criteria for this evaluation will be mutually agreed by OCFS and the contractor.
Mandatory Requirement
Describe the criteria expected to be used to evaluate that the Program Integrity Application is responding to and learning from.
5.15 Forensic Review Services
At OCFS’s option, the contractor must provide forensic review services for cases that the model predicts are at risk.
Mandatory Requirement
Describe the forensic review services and the benefits that these services would bring to OCFS’s Child Care Program Integrity initiative.
Page 38 of 119