Click the Options tab

Setting Description

Repository Settings

Save Real-Time Counter Information

Saves Benchmark Factory real time counters and performance monitor counters to the repository during test.

Save User Statistics Saves user level statistics.

Save Distribution Saves transactions per second and response time distribution.

Error Handling Stops the test when an error is returned.

Options Tab-Mixed Workload, Goal, and Scalability Test

The Options tab specifies Repository, error handling, file execution, and database checkpoint settings.

Section Field/Icon Description

Repository Settings SaveReal-Time Counter Information

Note: To change real-time counters please refer to Profile Properties Real-Time Counter Tab.

Saves counters and performance monitor counters to the Repository during test. Sample rate is determined in job settings.

Save User Statistics Saves user level statistics

Save Response Distribution Saves transaction per

Section Field/Icon Description

second and response time per user distribution.

Log Transaction Results to disk Logs the transaction results of a job to disk.

Note: Checking this option imposes performance penalties.

Error Handling Stop test after first error When checked, the test is stopped when an error is reported.

Name of the program to execute at the beginning of an iteration.

Enforce Timeout Enforces a timeout on the file being executed.

Execute the following program at the end of each iteration

File Name

Note: This field accepts BFScripts.

Name of the program to execute at the end of an iteration.

Enforce Timeout Enforces a timeout on the file being executed so that if the program does not complete in the specified time, it will be stopped, and the load scenario will continue.

Database Checkpoints Perform checkpoint at start of each test iteration

Number of checkpoints Specifies the number of checkpoints to initiate.

Run Reports Node

Benchmark Factory Run Reports is a separate executable that opens outside of Benchmark Factory and provides a comprehensive and detailed collection of database load testing results.

With Benchmark Factory you can drill down into a database to view a wide array of information and statistics that gives you accurate insight into database performance. Run Reports Viewer allows you to access Benchmark Factory load testing results. See "Run Reports Viewer" (page 212) for more information.

Note: Three instances of Run Reports can be viewed at one time.

Cutting and Pasting of Run Reports

From Benchmark Factory run reports you can cut and paste test results into the Clipboard. See Cut and Pasting Reportsfor more information.

Testing Server Throughput

Server throughput is the measurement of database capacity. Benchmark Factory allows you to view a variety of server throughput statistics that include:

l Transaction/Second (TPS)

l Transaction Time

l Bytes/Second (BPS)

l Rows/Second (RPS)

l Total Bytes

l Total Errors

l Total Rows

l Response Time

Testing SQL Scalability

The Benchmark Factory transaction comparison graph provides users with a comparison of the individual transaction performance as they compare to each other. This is most useful when analyzing a SQL Scalability test.

Testing Real Application Clusters

Benchmark Factory allows you to load test Oracle Real Application Clusters (RAC) to determine system capacity. The cluster performance graph allows users to view the performance of

individual nodes.

SQL Statement Node

The SQL statement node displays individual SQL statements and allows you edit a SQL statement or use the BFScript Wizard. See "BFScript Wizard" (page 176) for more information.

Create/Delete Benchmark Objects Node Note: In the Jobs Queue view, no properties are editable.

The Create/Delete Benchmark node allows you to either create the benchmark objects or delete the benchmark objects. Benchmark objects are used by standard benchmark load scenarios.

Benchmarks can be added to a job using the Benchmark Objects Wizard. See "Benchmark Objects Wizard" (page 150) for more information.

Field Description

Benchmark Name of the benchmark whose benchmark properties are being edited.

Scale The factor used to increase the amount of data added to the database.

Valid benchmark scales are dependent upon the benchmark selected.

For example, the AS3AP scales by a factor of 10 with valid scales of

"1, 10, 20, 30..." and the TPC-C benchmark scales by a factory of 1, with valid scales of "1, 2, 3, 4..."

Displays the Benchmark Properties page and allows you to edit the benchmark scale and map database tables and indexes. See

"Benchmark Properties" (page 67) for more information.

Always delete objects before create

Checking this box deletes benchmark objects before creating new ones.

When unchecked, Benchmark Factory checks for the benchmark tables. If they exist, then the creation will be skipped.

Note: The scale factor is not checked.

Execute File Node

Note: In the Jobs Queue view, no properties are editable.

The Execute File node allows you to place a file execution in a job as a sibling to a load scenario. The file executes during the running of a job.

Field Description

Execute File Type in or Select the File Name to execute:

Name of the file you wish to execute.

Note: This field accepts BFScripts. See "About Scripts" (page 234) for more information.

Click to open a file.

Enforce Timeout Places a time constraint on the number of seconds a file has to execute.

Enter a number The number of seconds a file has to execute.

Field Description between 30 and 10000

[n] Secs.

Jobs Queue Node Properties

About the Jobs Node

Some of the nodes in the Jobs Queue are the same as the Script view.

Note: Not all nodes in the Jobs Queue are editable and provide property viewing only.

The following nodes display:

l Jobs Queue Node

l Load Scenario Node (page 56)

l User Scenario Node (page 56)

l Transaction Node (page 57)

l Create/Delete Benchmark Objects Node (page 57)

l Run Reports Node (page 207)

l Run Status Node (page 203)

l Real-Time Statistics Node (page 203)

l Summary Node (page 205)

l Messages Node (page 64)

Jobs Node

Note: In the Jobs Queue view, not all properties are editable.

The Jobs node provides the following tabs:

l General

l Job Schedule

l Jobs Alerts

Global Variables Node

From the global variable node, you can add or delete the required variables.

To add a global variable:

1. Right-click to display the global variable dialog.

2. Enter the name and value.