Continuous Integration Processes and SCM To Support Test Automation

(1)

Continuous Integration

Processes and SCM

To Support Test Automation

SIGIST Conference, July 2013

Gal Fatal

[email protected]

054-342-3864

(2)

AT&T Israel Center of Excellence

AT&T Worldwide

• One of the largest telecom companies in the world

• Over 250,000 employees worldwide

AT&T Israel R&D Center

• Formerly Interwise, Ltd.

• Purchased by AT&T in 2007

• Employment growth of 1,000% in 5 years

Main Lines of Business

• Connect

• Unified Communications

• Consumer Mobility

• IMS (Backend Components)

2

(3)

Gal Fatal

MBA

Managing Configuration Management teams since 1999

Pre-AT&T: Intel, Siemens, Perigen

AT&T (Interwise) since 1997

Experience:

• Source control services

• Installer development

• Continuous integration processes

(4)

Moving from Waterfall to Agile (scrum) at AT&T

Continuous Integration processes

Bug lifecycle in scrum

How we provide fast and flexible builds

Sanity tests and automation

How we make multi-platform testing possible

Saving time with automatic environment installations

Demo

Agenda

4

(5)

5 Waterfall Development

1994-2011

(6)

Waterfall

6

(7)

Waterfall

7

(8)

Waterfall Lifecycle at AT&T Connect®

Main Development

8 Dev

Build and

Integration tests

QA runs tests and

opens bugs

Milestone

3 weeks

1 week

Build took 4 days

• Compilation problems

• Manual processes

• Build machine resources

• Environments

Bugs and Stability

Version Release

(9)

Waterfall Lifecycle at AT&T Connect

Stability and Bugs

9 Dev

resolves bugs

Build and

Integration tests

QA verifies bugs

Milestone

3 weeks

1 week

Bugs and stability

Version release

(10)

Agile Scrum

10

(11)

Waterfall to Agile Scrum at AT&T Connect

Agile Scrum Development

11 Dev + QA

Sprint

3 weeks

_{Continuous Integration}

Stability

Version Release

9

(12)

Continuous Integration Processes

12 Source

control

build

Static

code

analysis

Run

automated

unit Tests

Packaging

Prepare test

environment

Deploy to test

environment

Run automated

sanity tests

Publish report

Continuous

Integration

(13)

Bug Lifecycle in Scrum

In scrums, bugs have the highest priority and there’s a “Zero-bug-approach!”

13 Sometimes, to save time, QA don’t open bug entries

We have to rapidly supply builds as part of Continuous Integration

Complete

user story

Build

(14)

How We Provide Fast and Flexible Builds

• We moved from physical-build machines to VMs

• Each product build runs on a separate VM

• Builds are run in parallel

• We use IncrediBuild for a 10-fold increase in

compilation time

• Scrum Masters or authorized users can start a

build, any time, with a single click

• We added flexible reporting

• We use Jenkins

14

(15)

Sanity Tests: We Automate Them

Sanity test =

• Product installation

• Application load

• Basic functionality working as expected

• Reporting

We use JSystem (based on Java®) to write the tests

QA team write and maintain scenarios

We run nightly sanity tests, using PowerShell® scripts

15

(16)

How We Made Multi-platform Testing Possible

The Challenge

We don’t know our client configurations…

• OS: XP®/Windows 7®/Windows 8®, 32/64 bit

• Browsers: Chrome™/Internet Explorer® 7- 10

• MS Office®: 2003/2007/2010

• Admin/None Admin

We can think of 100s of combinations

Manual testing by QA on all platforms is impossible

Early feedback is missing

16

(17)

How We Made Multi-platform Testing Possible

17 Win7 32

Win7 64

XP 32

Win 8

Restart

VM

Go back

to

snapshot

Install

latest

product

version

Run sanity

tests

Report

Shutdown

VM

Running nightly

Chrome

FireFox

IE9

IE10

Virtual Machines

(18)

We Save Time with Automatic

Environment Installations

• Our environment includes more than 10 different kinds

of servers and DBs

• Environment preparation takes no more than 1 day

• We use VMs

• We prepare snapshots in advance

• CI environments go back to production versions every

night and automatically upgrade to latest versions

• We have different environments for QA, Dev, CI, etc.

18

(19)

Demo

19

(20)

Report Example

20

(21)

Summary

Waterfall to Agile

Continuous Integration

Rapid, fast builds

Sanity tests

Multi-platform testing

Environment installations

21

(22)

Thank You

SIGIST Conference, July 2013

Gal Fatal

[email protected]

054-342-3864