Teniendo en cuenta los requerimientos y las asunciones el proveedor debe realizar una propuesta que satisfaga al cliente presentándole, si es posible, más de una opción entre las que el cliente pueda elegir la que le mejor le convenga a sus intereses, indicando en cada caso las ventajas y desventajas de cada una de las propuestas así como el impacto en el mantenimiento en caso de que la opción ofertada lo requiera.
Una vez presentada la propuesta el trabajo previo por parte del proveedor termina y sólo le queda esperar la decisión final del cliente, tanto elegir si el proveedor es el elegido de entre todos los que se hayan presentado a concurso como elegir cual es la opción de las presentadas por dicho proveedor, si es que se han presentado varias, que más se ajusta a sus intereses (económicos y técnicos).
En el ejemplo que estamos siguiendo encontramos dos diferentes opciones:
Opción 1:
- Ventajas:
Tabla 5.3. Ventajas de la Opción 1 de la propuesta
- Desventajas:
ID DESCRIPTION
DAV01 Manual start of test user sessions and also their scripts makes not possible to measure detailed resource
consumption, only a general average.
DAV02 It is not possible to get the real responses times for any application or test user, it is only possible to get measures of general CPU load and memory consumption. DAV03 No information available about causes of test execution
errors (environment/server, test tool, scripts,
performance, etc.). Wrong values on results cannot be isolated.
DAV04 No information available about specific test users activity and in consequence about a specific test scenario.
DAV05 This is only a temporary solution; it is a workaround while a corporate testing tool is defined. This means, ID DESCRIPTION
AV01 Cost reduction by reusing license of testing tool what is now in place.
AV02 Low effort for developing, since the current scripts can be used without less additional effort. Only a new
scenario to include the new scripts for Titicaca must be created.
AV03 Short timeline to begin development and the load test execution.
- Propuesta:
The overall effort estimation for all scenarios (I+II+III) is 27 MDs, including analysis, set-up, development, test and delivery
Following a detailed description of the tasks covered:
Tabla 5.5. Descripción de la propuesta de la Opción 1.
effort
TOTAL
27,00
Proof of Concept 1,00 Application Analysis 3,00 Scripts Development 5,00 Scenarios Creation 3,00 Project documentation 0,00 Execution 9,00 Results Analysis 2,00 Report 1,00 Project Management 3,00project tracking and reporting tasks
After the execution, scripts must be developed to gather values from the perfmon logs. An analysis is also necessary to extract the meaningful information.
Current management summary will be deliver adding information about Titicaca
In this phase, all applications involved in the Load Test will be analyzed from a performance point of view. All information sent by each step performed by the user will be examined in order to detect which fields need to be parameterized or correlated
During the development phase, all business flows will be recorded using Visual Test. Scripts will be parameterized and correlated.
Once the business flows are developed, scenarios need to be built with scripts. Within the scenarios, duration, number of users and server monitoring will be configured.
All scenarios previously created will be performed. During the execution phase, a daily execution report will be delivered with a summary of all executions performed and general results
Opción 2:
- Ventajas:Tabla 5.6. Ventajas de la Opción 2 de la propuesta.
- Desventajas:
ID DESCRIPTION
DAV01 All scripts included in the Crosstest must be created for LoadRunner. Existing scripts can not be reused.
DAV02 Additional LoadRunner license to use Citrix ICA protocol is required
(see general chapter assumptions)
DAV03 LoadRunner environment is shared by other projects. This environment must be booked for all Crosstest executions.
Tabla 5.7. Desventajas de la Opción 2 de la propuesta
ID DESCRIPTION
AV01 Highly scalable scenarios.
If a load increase is required, from simulating 20 to 50 users, no additional effort is required.
AV02 All performance results at one side.
LoadRunner lets collect all information from (application response times and server monitoring) and create graphs automatically.
Furthermore, following information can be gathered:
• Running Virtual Users
• Error statistics (providing the type of error and the line number in the script)
• Transactions per second
• Transactions Response Time (Average, Min, Max)
• Windows Resources o CPU
o Memory o Paging
• Network Traffic AV03 Scripts consistency.
As LoadRunner is not a functional test tool, any change in the presentation layer doesn’t affect to the script. AV04 Error management.
Information regarding the execution is displayed live, seeing all users simulated and if there is any error. AV05 Test Reports.
LoadRunner lets you create HTML reports for any
execution. It also includes a Word Report generation tool to automatically summarize and display the test's
- Propuesta:
The overall effort estimation for the solution for all scenarios (I+II+III) is 69,5 MDs, including analysis, set-up, development, test and delivery
Following a detailed description of the tasks covered:
effort TOTAL 69,50 Proof of Concept 2,00 Application Analysis 16,00 Scripts Development 33,00 Scenarios Creation 1,00 Project documentation 5,00 Execution 3,00 Results Analysis 2,00 Report 0,50 Project Management 7,00
project tracking and reporting tasks
From the execution, several graphs and tables are created from LoadRunner. An analysis is necessary to extract the meaningful information.
From the execution, several graphs and tables are created from LoadRunner. An analysis is necessary to extract the meaningful information.
In this phase, all applications involved in the Load Test will be analyzed from a performance point of view. All information sent by each step performed by the user will be examined in order to detect which fields need to be parameterized or correlated
During the development phase, all business flows will be recorded using Mercury Virtual User Generation through the Cirtrix ICA protocol. Scripts will be parameterized and correlated.
Once the business flows are developed, scenarios need to be built with LoadRunner Controller. Within the scenarios, duration, number of users and server monitoring will be configured.
All scenarios previously created will be performed. During the execution phase, a daily execution report will be delivered with a summary of all executions performed and general results