SBAC RFP #7 Item Authoring and Item Pool Application
2-30
cost though scalable computing resources (i.e. “cloud resources”) to help reduce impacts to state and local systems.
ORCA Application Requirements and Performance
The ORCA family of products has the following general hardware and software requirements for operation.
Hardware:
• Enterprise class x86 servers for virtualization servers and database servers
• Enterprise class firewall and switching equipment
• Hardware load balancer components Software:
• VMWare Virtualization Software
• Red Hat Enterprise Linux
• JBOSS or Weblogic Application Server
• Enterprise Mysql or Oracle Database Server
• Apache Foundation Components (httpd, Tomcat, etc)
• RealObjects EditOnPro Web-based Editor
3.C Knowledge Transfer, Transition, and Turnover
Pacific Metrics has extensive prior experience with the management and maintenance of production applications, including the transfer of these responsibilities to a third party at the end of a program. For many contracts, application transition and knowledge transfer have been required deliverables of the programs. Pacific Metrics will employ this past experience to ensure a smooth knowledge transfer, application transition and turnover of the Item Authoring and Pool Application to SBAC as part of completing the program.
Below we provide more detail on the components of the Knowledge Transfer, Transmission, and Turnover deliverable.
Transition Plan
We will develop a transition plan beginning approximately one year prior to the completion of the program in September, 2014. The Transition Plan will detail work plan components specific to transitioning the Item Authoring and Pool Application including those described in this proposal.
Planning will be completed for the following activities.
• Construction of a technical systems manual
• Transitioning application hardware and software to SBAC
• Administrative training
• Development of application transition checklist
• Professional support after transition
The work plan developed a the beginning of the program is expected to cover these activities, but the Transition Plan will cover them in greater detail, leveraging experience working with SBAC, State DOEs and other system vendors to ensure a smooth transition of the application at the end of the program.
SBAC RFP #7 Item Authoring and Item Pool Application
2-31 Technical Systems Manual
As part of this deliverable, Pacific Metrics will produce a Technical Systems Manual. The intended primary audience for the Technical Systems Manual is the staff responsible for
managing and maintaining the Item Authoring and Pool Application after transition. The purpose of the Technical Systems Manual is to document technical system specifications, descriptions of the components of the application system and processes for managing and maintaining the application. The manual will include but is not limited to the following technical information:
a. Application components
b. Application operational requirements i. Server Hardware
ii. Software
iii. Networking Infrastructure (bandwidth, load balancing, switching, etc.) iv. Build and deployment environment
c. Application build process
d. Application deployment process e. Application configuration procedures f. Application operational procedures
g. Database maintenance and tuning procedures h. Required data migration
Costs for this manual assume that it is an internal document for use by SBAC, Pacific Metrics, and any SBAC designee, and not developed for public release. We have budgeted to produce a document of approximately 100 pages.
Knowledge Transfer and Training
As part of its larger training effort for this program, Pacific Metrics will complete training specifically related to the management, maintenance and enhancement of the Item Authoring and Pool Application. This training will be conducted by Pacific Metrics staff that have deep knowledge of the application being customized, and it may include staff originally responsible for developing and customizing the application. The content of the training will be similar to what is covered in the Technical Systems Manual outlined above.
Professional Support after Transition
We anticipate that Pacific Metrics will need to provide some level of support to SBAC or its designee after the Item Authoring and Pool application has been transitioned. We have
allocated two weeks of Level 3 professional support time for this activity. Needed support will be provided by phone and online meeting. Support will be provided via the defined support
Cost Option
Knowledge Transfer and Training
Pacific Metrics will provide onsite trainings specifically related to the management, maintenance and enhancement of the Item Authoring and Pool Application to ensure
seamless handoff of the IAIP application to SBAC at the conclusion of the contract. Costs for this training would assume three consecutive training sessions conducted at
SBAC-designated facility in which two Pacific Metrics Trainers conduct the training and five or less SBAC staff members are involved with each session.
SBAC RFP #7 Item Authoring and Item Pool Application
2-32
channel, with Pacific Metrics staff knowledgeable with the management and maintenance of the application providing Level 3 support.
In order for this support to be most effective, transition of the application must be completed by September 30, 2014. If it is desired by SBAC, Pacific Metrics can develop a cost option for additional post-transition support beyond September 30, 2014.
4. I TEM A UTHORING AND I TEM P OOL A PPLICATION S OFTWARE
The COTS application proposed by Pacific Metrics and customized for SBAC is designed to efficiently and accurately meet the requirements identified within the RFP. Because the system was designed by and specifically for Pacific Metrics’ assessment specialists working on multiple state contracts, it offers an inherent flexibility that is typically lacking in systems built for a single state’s purposes and specific needs. The IAIP application was architected from a broader perspective, to allow support for assessment development across multiple states, programs, and vendors.
This proposal outlines how the consortium-owned SBAC IAIP application supports the four main functional aspects enumerated in Appendix A:
1. item/task/stimuli development 2. test form development
3. psychometric information 4. dynamic reporting/querying
We provide a high-level overview of each feature below, and then provide specific details related to each of these functional aspects in the table in Appendix A of this proposal.
Item Development:
The SBAC IAIP application is a scalable online assessment content editing and management system provided through an intuitive Web-based interface. It allows test developers to construct content that can be delivered seamlessly to test delivery systems. Alignment to content
standards is an inherent feature of the system, as is the creation, alignment, and storage of stimuli associated with item content. The application provides a versatile, flexible and secure means of developing, managing, importing and exporting test content with many benefits including:
• Configurable process integration and workflow
• Automation of time consuming and potentially error prone processes
• Standardization and quality management of test development processes
• Editorial processes for approvals
• Management and end-to-end publication of test content
• Management of Users and Permissions
The SBAC IAIP application supports high-quality item development, providing the front end for item creation, management and review functions. Figure 4 shows the integration of the
application with other assessment components.
SBAC RFP #7 Item Authoring and Item Pool Application
2-33 Authoring/Editing Interface
The SBAC IAIP application leverages an intuitive and comprehensive HTML editor to support the creation and revision of test content. While users typically interact with the editor in WYSIWYG mode, XHTML content is simultaneously generated to support downstream Web