• No results found

Run-time test configurations for load testing

N/A
N/A
Info
Download
Protected

Academic year: 2021

Share "Run-time test configurations for load testing"

Copied!
11
0
0

Loading.... (view fulltext now)

Download now ( 11 Page )

Full text

(1)

Run-time test configurations

for load testing

Gábor Ziegler,

Ericsson Hungary Ltd.

Contents

Introduction

– What is TITANSim – Motivation for TITANSim

– Functional description of the parts of TITANSim

CLL, Application Libraries and Control Logic – Three different perspectives of TITANSim:

HW, SW, Run-time configurations

(2)

Introduction

About TITANSim

Introduction

TITANSim is aimed at performance testing

– With TTCN-3 as the specification language

– With Ericsson’s internal TTCN-3 Executor and Compiler tool

Performance testing needs highly optimized test suite

code

Two contradicting requirements:

– A framework shall be general generalization – Optimization is task specific specialization

(3)

© Ericsson AB 2007 ETSI TUC 2007 5 (25) Run-time test configuration for load testing 2007-05-15

Motivation for TITANSim

TTCN-3 and TITAN is widely used for functional testing

throughout Ericsson

TITANSim aims to achieve cost savings via

– reuse of the function test code base – reuse of testers’ competence – reuse of existing, in-house tools

– reuse of the new performance test solution by different projects through-out the company

Introduction

(4)

© Ericsson AB 2007 ETSI TUC 2007 7 (25) Run-time test configuration for load testing 2007-05-15

Functionality of TITANSim CLL

Run-time interaction with the test suite

– A dynamically configurable run-time GUI and … – …Parameters

– …Statistics

Generic support for common programming tasks

– Memory management support: “resource” pools – Scheduling support

A logging framework

Generic support for distributed scheduling:

– EventQueue data type + support functions

Concrete support for central scheduling

– Ready-made scheduler component for central scheduling – Load balancing, regulated load, external execution control,

traffic-mixer and a graphical console for all these

Other useful data types and algorithms:

– Linked lists (FreeBusyQueue), hash tables, binary search tree (Red-Black trees)

Functionality of Application

Libraries and Control logic

Application libraries: simulated entity specific tasks

– Protocol message handling

– Inbound message routing in case of multiple generator PTC – Protocol specific TITANSim parameters and TITANSim

statistics

– Building blocks and state-machine support for Control Logic

(5)

Introduction

The 3 perspectives of TITANSim

Views of a TTCN-3 load test library

At least 3 perspectives have to be considered:

1. HW perspective: which hardware to use? 2. SW perspective: how to modularize your code? 3. Run-time perspective: what is the best run-time

test-configuration?

Th is ta

lk ’s m

a in t o p

(6)

© Ericsson AB 2007 ETSI TUC 2007 11 (25) Run-time test configuration for load testing 2007-05-15

UE#1 IMS Core SIP PUBLISH

SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP Registration

1. The HW perspective

One SW – many HW

SW

control

UE#1 IMS Core SIP PUBLISH

SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP RegistrationUE#1 IMS Core

SIP PUBLISH SIP 200 OK SIP Registration

SW and HW are

separated

To expand load

capacity only HW

units shall be added

2. The SW perspective

Three levels approach:

– “Core Load Library” (CLL)

provides the generalization

– “Application specific framework libraries” (AppLibs)

provides the ”specialization”

code provided in-cooperation with project experts, relies on core library code

– “Control logic”: can provided by non-experts, as well

builds on both application specific and core libraries code

(7)

© Ericsson AB 2007 ETSI TUC 2007 14 (25) Run-time test configuration for load testing 2007-05-15

3 Run-time configuration perspective

Careful trade-off must be made between

– Efficiency

– Resulted code complexity

Load testing means concurrency handling:

– Many(!) parallel traffic flows… – …over some shared resource pools!

TTCN-3 has a special concurrency model

– PTC-s are run concurrently – A PTC is a “single CPU system”

No concurrency support below PTC level by the language – PTC-s are run isolated from each other

no shared memory

Our dilemma: on which level do we handle the concurrency?

This

talk

’s m

ain t

opic

Alternatives for run time

configurations

The “simple” approach is follow the “usual” TTCN-3

semantics

– Concurrency is to be handled on PTC-level

– A single PTC is responsible for a single transaction

The “advanced” approach is to let a single PTC handle

multiple concurrent transaction

– Concurrency is to be handled below PTC-level – A single PTC is responsible for multiple transactions

(8)

TITANSim Run-time test

configurations

Central scheduling

XXX_CT XXX_YYY_Routing Host #j Control logic and stack for protocol XXX

ZZZ_CT

ZZZ_WWW_Routing Control logic and stack for protocol ZZZ Run-time GUI/CLI Traffic generator components XXX_Scheduler ZZZ_Scheduler

Central

scheduling

Host_Admin CPU monitoring MainAdmin MTC Host #i LoadRegulator Execution Control Host #m ZZZ_Logger ZZZ_Logger External control DB DB

(9)

© Ericsson AB 2007 ETSI TUC 2007 18 (25) Run-time test configuration for load testing 2007-05-15

Central scheduling

Pros

– It is the most user-friendly

– It requires no coding-paradigm changewith respect to function tests

– Suitable for ad-hoc load testingprojects – It can be used without an application library

Can use ready-made scheduling functions that are totally

independent of load generator component-type

Cons

– Less efficient

– Wrong scalability

Each traffic initiation requires internal communication— with a single central entity: extra overheads and delays

Sharing data of a run-time database across traffic cases / entities is difficultand inefficient

TITANSim Run-time test

configurations

(10)

© Ericsson AB 2007 ETSI TUC 2007 20 (25) Run-time test configuration for load testing 2007-05-15 MTC Host #i

Local scheduling

Host #l XXX_LGen_CT XXX_YYY_Routing YYY_TP XXX_Logger Host #j Host #k PtcFunctions Control logic and stack for protocol

XXX

ZZZ_LGen_CT

ZZZ_WWW_Routing PtcFunctions

Control logic and stack for protocol ZZZ

WWW_TP ZZZ_Logger Run-time GUI/CLI SUT Traffic generator components Traffic generator components Load measurement Host #m ZZZ_ApplAdmin MainAdmin LoadRegulator XXX_ApplAdmin

Local (distributed) scheduling

Pros

– It is the most-efficient

– Less dependent on OS-scheduler

– Sharing dataof a run-time database across traffic cases of the same PTC can be easy and efficient

– Load generator PTC-s schedule on their own

no internal communication overhead needed for load generation

They can run autonomously scalability!

Cons:

– It requiressome sort of an application library: Explicit concurrency handling shall be set up

(11)

Thank you for your attention!

Questions?

References

Download now ( PDF - 11 Page - 232.90 KB )

Related documents

sharekhan top picks Visit us at April 29, 2016 Sharekhan Top Picks

Š HDFC Bank is well poised to tap the growth opportunities going ahead due to strong capital ratios, healthy asset quality and steady revival in consumer spending.. Therefore,

Managing technological change by committee: Adoption of computers in Spanish and British savings banks (circa 1960-1988)

Finally, just as CECA was to spearhead the link of Spanish savings banks with international wholesale financial markets, the industry association was key in the creation

New rules of cooperation with the Distribution System Operators. Warsaw, 13 May 2014 the system, that connects

The ability offered by TSO for WPWE OSD is published on TSO’s website and is equivalent to the total capacity (contractual capacity) acquired by the DSO from

Making Everything Easier! Limited Edition. UK Edition EPAS. William Vanobberghen

The EPAS Acquirer protocol is composed of a series of standard ISO 20022 messages (CAPE) for authorising or pre-authorising card payment transactions, cancelling or rejecting

Real-world, high-stakes deceptive speech: Theoretical validation and an examination of its potential for detection automation

Because audio recording are a strong source of deceptive cues (DePaulo et al, 2003), they are capable of capturing many dimensions of verbal and nonverbal behavior simultaneously,

The effect of consumer perceptions towards intention to buy air tickets online in Malaysia

Based on the Technology Acceptance Model, this paper reviews the literature on the effects of Perceived Ease-of-Use and Perceived Usefulness on ticket purchasing

A Smooth Transition: A Phenomenological Approach to Understanding the Experiences of First‐time, Full‐time, Provisionally Accepted Black Male Students

Georgia? 2) What are the common perceptions of provisionally accepted, first-time, full- time, Black male students that influence their academic success at state colleges and state