Empirical Model Building and Methods
Exercise
Liliana Guzmán Introduction
Outline
`Purpose
`Organization
`Schedule
`Literature
`Administrative information
Purpose
`
Discussing and complementing the content of the lecture
`
Gathering experience in the empirical evaluation of
software technologies
`
Learning to document and review empirical evaluations
`
Preparing the examination
Organization
`
Overview
` At the beginning of the semester, students will build teams of 4
members.
` During the semester, each team will be responsible for:
` Planning and designing an empirical evaluation of a software technology ` Taking part in an empirical evaluation of a software technology
` Analyzing empirical data
` Presenting and documenting their results
The planning and design of an empirical evaluation (along with the submission of the corresponding reports) during the semester time is mandatory for being allowed to take the exam.
Organization
Empirical Model Building and Methods Slide 1 - 5
`
How to?
`
Exercise sheet will be published 1 week before the exercise class
`Teams are expected to:
` Solve the assigned tasks
` Document their results using the predefined templates ` Present their solutions during the exercise class
`
Students and tutor will discuss the proposed solutions together in
the exercise class.
`
Teams are expected to enhance their solutions based on the
Schedule
` 20.04.2012 Administrative Information and topic assignments
` 27.04.2012 Research plan (1): Problem statement: Understanding object of study and quality
focus
` 11.05.2012 Research plan (II): Problem statement: Research purpose, research goal,
hypotheses and preliminary operationalization
` 25.05.2012 Research design I: Problem statement, sampling strategy, study selection and
overview of evaluation design (Postpone to 01.06.2012)
` 08.06.2012 Research design II: Concrete Design. Separates deadlines for each team.
(15/22/29.06.2012)
` 22/29.06.2012 and 06.07.2012 Submission of final version of research plan and design. ` 06.07.2012 Empirical evaluation
Literature
Empirical Model Building and Methods Slide 1 - 7
`
Books available in university library:
`
Wohlin, C. , Runeson, P., Höst, M., Ohlsson, M., Regnell, B.,
Wesslén, A.: Experimentation in Software Engineering: An
Introduction, Kluwer Academic Publishers, 2000
`
Boehm, Rombach, Zelkowitz (Eds): Foundations of Empirical
Software Engineering – Legacy of Victor R. Basili, Springer
Berlin Heidelberg New York, 2005
`
Juristo, N., and Moreno, A.: Basics of Software Engineering
Experimentation, Kluwer Academic Publishers, 2001
Administrative information
`
Exercise class
`
Tutor: Liliana Guzmán
`
Contact:
[email protected]
`
Location: Building 32 Room 426
`
Website:
http://wwwagse.informatik.uni-kl.de/teaching/ese/ss2012/
Empirical Model Building and Methods
Exercise
Liliana Guzmán
Topics
`
Project management
`
Case 1: Effort estimation
` Characterizing expert estimation of software development effort with respect to the factors used and accuracy from the
perspective of a project manager in the context of incremental software development
`
Case 2: Project control approach
` Evaluating SPECULA with respect to its usability and ease to use from the perspective of project manager and software developers in the context of software development
Topics
Empirical Model Building and Methods Slide 1 - 11
`
Process modeling
`
Case 3: Process modeling technique
` Evaluating the Software & Systems Process Engineering
Meta-Model (SPEM) with respect to its understandability and process
compliance for modeling software development processes from the perspective of quality manager in the context of software development
`
Case 4: Process models
` Comparison of SPEM models and MVP-L models with respect to
the generality from the perspective of quality managers in the context of software development
`
Case 5: Process models
` Comparison of SPEM models and MVP-L models with respect to the
changeability from the perspective of quality managers in the context
Topics
`
Software improvement and measurement
`
Case 6: GQM+ tool
` Evaluating GQM+ tool with respect to its usability for modeling measureable goals and its impact on the collaboration during the modeling process from the perspective of a quality manager in the context of software organizations
Topics
Empirical Model Building and Methods Slide 1 - 13
`
Safety modeling
`
Case 7: Safety modeling techniques
` Characterizing safety modeling techniques with respect to their
state of the practice in the context of embedded systems in the
avionic domain from the perspective of project manager in the
context of the development of software-based safety critical systems
`
Case 8: Safety models
` Comparison of safety models (i.e. Fault trees and Component fault trees models) with respect to their impact on the communication among stakeholders from the perspective of software and system engineers in the context of the development of software-based safety critical systems
Topic assignment
`
Case 1: Effort estimation
`
S. Lutsch, S.A. Scherr, S. Hupp and M. Koch
`
Case 2: Project control approach
`
Z. Dai, M. Mlitat and A. Guschkwoski
`
Case 3: Process modeling technique
`
A. Selleri Rocha and A. Bogo
`
Case 6: GQM+ tool
`
P. Iraguha and B. Palanisamy
`
Case 7: Safety modeling techniques
`
A. Atalar and A. C. Kurur
`
Case 8: Safety models
First exercise sheet
Empirical Model Building and Methods Slide 1 - 15
`
Purpose:
`
Specification of the study object
`
Specification of the quality focus (preliminary draft)
`
Documentation:
`
Template will be published on April 23
`
