“Comparison Test Management Tools HP ALM11 &
MS VS/TFS2010”
22 mei 2012
voordracht georganiseerd door
Discussiegroep Software Testing
24/05/2012
HP ALM 11
HP ALM 11
Microsoft TFS 2010
Microsoft TFS 2010
Moderator: Rik Kochuyt Moderator: Rik KochuytComparison Test Management Tools – May 22
nd, 2012
First time life demo comparison between
•
HP ALM 11
J
S l
k
(jsaelemakers@hp com)What?
What?
Jerry Saelemakers
([email protected])•
Microsoft TFS 2010
Pieter Ostyn
Jan Willem van Buuren
Gerard van der Pol
2 similar tools with a different background, …
24/05/2012
•
Short positioning of
each tool
d
d
Agenda
Agenda
•
Hands‐on demo on a
standard test practice
•
Q&A
•
Networking
May 22nd, 2012 Comparison Test Management Tools 3•
Short positioning of
each tool
d
d
Agenda
Agenda
•
Hands‐on demo on a
standard test practice
•
Q&A
•
Networking
May 22nd, 2012 Comparison Test Management Tools 424/05/2012
•
Short positioning of
each tool
d
d
Agenda
Agenda
•
Hands‐on demo on a
standard test practice
•
Q&A
•
Networking
May 22nd, 2012 Comparison Test Management Tools 5•
We’ve some “Requirements”
•
From there, Test Cases get created
Scenario…
Scenario…
•
The Test Cases get executed
•
During execution, Defects get found
•
Defects get handled (repaired, …)
•
To keep overview and to follow‐up the process
some reporting is needed
24/05/2012
•
Short positioning of
each tool
d
d
Agenda
Agenda
•
Hands‐on demo on a
standard test practice
•
Q&A
•
Networking
May 22nd, 2012 Comparison Test Management Tools 7 Software Testing Discussie groep May 22nd, 2012 Comparison Test Management Tools 8Thanks !
Thanks !
HP Application
Lifecycle
Management
K.V.I.V., May 22th 2012
©2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
Jerry Saelemakers
HP Software
The goal of
The goal of
ALM?
ALM?
ALM?
ALM?
How to …
How to …
connect business & IT
connect business & IT •• shorten release cycles
shorten release cycles •• adopt to
adopt to
change
Some History …
1995 TD 1.52 Windows like interface (and 1.52 for OS/2!)
1997TD 4.0, 1999, TD 6.01
2000 TD 7 0i F ll b bl d i t d l
2000 TD 7.0i Fully web enabled, new requirements module
2001- TD 7.2, 2002- TD 7.5, 2002- TD 7.6, 2003- TD 8.0
2004 QC 8.0 New Java Server, High Availability, BPT module
2004 QC 8.2 Advanced reporting, requirement traceability rules
2006 QC 9.0 Dashboard server, STM module, defects traceability, repository over database
November 2006 Mercury acquired by HP November 2006 - Mercury acquired by HP
2007 QC 9.2 Risk based testing, releases module, Excel reporting
2009 QC 10.0 Versioning, sharing, baselining, New Premier version
TODAY QC/ALM 11
TestDirector 1.51
Defects Tracking
TestDirector 1.51
Test Planning
TestDirector 6.01
Test Planning
TestDirector 7.0i
Requirements
TestDirector 7.0i
Test Planning
Quality Center 8.0
Requirements
THE COMPLETE AND CORE APPLICATION LIFECYCLE
CORE LIFECYCLE EXCELLENCE
Lifecycle Management &
COMPLETE LIFECYCLE COVERAGE
Project & Portfolio Lifecycle Management & Automation Requirements Development Integration
Quality & Performance Security Project & Portfolio
Management
Application Governance Business Availability Service Management
Archiving
BEST-IN-CLASS MODULAR HETEROGENEOU S TRACEABILITY & INSIGHT UNIFIED PLATFORM TECHNOLOGY AGNOSTIC LEADERSHIP IN QUALITY
HP Application Lifecycle Management
Application Lifecycle ManagementProject Planning & Tracking Enterprise Release Management
Requirements Management Development Management Quality Management Requirements Management Requirements Definition* Developme nt Integrations Defect Managemen t Functional Performanc e Security Secure Developmen t Foundation
Deliver optimal business results through high-quality applications
HP ALM core
Facilitates distributed collaboration
and communication between QA teams, developers and business analysts on a single platform
Single, scalable platform
that enables a consistent,
repeatable process for:
Allows organizations tolower costs
by capturing critical defects before they reach production
analysts on a single platform
Enables organizations to manage release process and makeinformed go/no go decisions through real
• Requirement management
• Test planning, scheduling & execution
• Release & cycle management
• Defect management
• Real time reporting of progress and status
Integration with Developer
Supporting key stakeholders from across IT & the business
Development Teams Business
Analysts QA Teams
go/no go decisions through real time reports
•Integration with Developer Environments
Development Tools Integration
Project\Program
Mangers
•
IDEs - Eclipse or VSTS
HP ALM QA M Development Developer s BA Mangers
•
Task or Work Item Management
•
Build & Continuous Integration
•
Source Code Management
•
Project Management
Manager e e op e Manager PCOE Performanc e Eng TestersProject Management
The application lifecycle with HP ALM
Requirements
Microsoft TFS SubversionTests
D f
t
Tasks
Ch
HP ALM
Perforce Bugzilla Trac Mantis Mingle VersionOne Hudson JIRABuild
Defects
Change
sets
Git HPHP ALI 2.0 – how it works
Waterfall Scrum
•• Surfacing actionable information across Surfacing actionable information across various development tools
various development tools
•• Bringing intelligence to HP ALM and Bringing intelligence to HP ALM and developers’ IDE developers’ IDE TFS TFS Perforce Hudson Hybrid n Lea n SVN
Jenkins ClearCase Electric Cloud
n n Single Platform Test Build Req
HP ALM
Agile Project Planning
•Define and automate Agile processes •Enforce and accelerate process •Release / sprint / backlog management •User story and task definition
HP AGILE ACCELERATOR V 5.0
HP Agile Accelerator 5.0
Agile Quality Mgmt •Task Mgmt •Test Execution mgmt •Defect\Issue Mgmt •Quality progress Agile Dev Mgmt •Task Mgmt •Effort estimation •IDE plug-ins •SCM integrationTaskboard
Agile Dashboard and Reporting
•Burn up/burn down charts •Cross-sprint velocity charts •Agile development progress dashboard •Agile testing progress dashboard
Unit Testing • Integrate with: • Nunit • Junit • FitNesse Continuous Integration •Automatic Integration with CI tools •Schedule •Build •Deploy On Demand Reporting
• Generate from Requirements Module
HP ALM—applications empowered by
connectivity
VP ENTERPRISE ARCHITECT QUALITY ENGINEERS BIZ ANALYST APPS SCRUM MASTER VISIBILITY CONTROL Requirement s Build Tests Defect s Task s SCCM ALM PRODUCTHP ALM - Conclusion
Requirements Tests TasksALM
Predictable Build Defects SCCMALM
CHANGE-READINESS
PREDICTABILITY
ed ctab eCOLLABORATION
outcome?
CHANGE READINESS
9Traceability
9change impact
9Risk assessment
PREDICTABILITY
9Real-time collaboration
9Measurements and
intelligence
COLLABORATION
9Heterogeneous
environments
9Unobtrusive
usability
www.hp.com/go/almdev
LEARN MORE
Twitter:
@HPSoftwareALM;
Read our blog:
Application lifecycle management and application
transformation blog
20 Footer goes here
24/05/2012
Software Quality with Visual Studio/Team
Foundation Server (TFS)
Microsoft Platform
(
)
Jan Willem van Buuren
[email protected]
Gerard van der Pol
[email protected]
Goal of this overview
Quickly update you on Microsoft Test
Quickly update you on Microsoft Test
and Platform Solution
24/05/2012
Challenges to Software Quality
●
●
●
●
●
●
Challenges to Development
●
●●
●
●
●
●
●
●
●
24/05/2012
Evolution of people and contexts
Trustworthy Transparency bridges the team
PM
Devs
DB Test
Arch
24/05/2012
Testing Across the Lifecycle
An integrated offering optimized to discover issues early and streamline
the flow actionable information
Manual Testing
g
Virtualized Labs
.
The majority of testing is done here ‘no more, no repro’ - Actionable feedback
- Fast forward for manual testing
Developer Test
Performance & Load
.
Dramatically improving the build, deploy test workflow - Test from an on-demand, known state - Snapshot complex environments
Test Management
A 360 degree view of relationships and progress ensures you are ready to ship.
- Transparency across all roles
- Streamlined flow of feedback
70% Testing
Here
7
As code is developed automate critical tests
- Unit testing, Code Coverage, Coded UI Testing - Test impact analysis, Gated Check-ins
Find problems early lowering the impact of design flaws - Validate design decisions
24/05/2012
Demo Workflow
1
Requirements and Test Case creation
1.
Requirements and Test Case creation
2.
Test Execution, Defect Registration
3.
Defect Management and Reporting
Scenarios & Information
1.
Eliminate bugs:
1.Eliminate bugs:
http://www.microsoft.com/visualstudio/en-us/scenarios/eliminate-bugs
2.Manual Testing:
http://www.microsoft.com/visualstudio/en-us/scenarios/manual-testing
3Virtual Labmanagement:
3.Virtual Labmanagement:
http://www.microsoft.com/visualstudio/en-us/scenarios/virtual-lab-management
24/05/2012
Scenarios & Information cont’d
1.
Building the Business Case
1.
Building the Business Case
http://go.microsoft.com/?linkid=9776094
2.
Test Release Management
http://vsartestreleaseguide.codeplex.com/
3.