MagenTys Testing Services Page 2

(1)

(2)

CONTENTS

1 MAGENTYS ... 3

2 COMPANY DETAILS ... 4

2.1 Overview ... 4

2.2 ETHICS and values ... 4

3 Services ... 5

3.1 Test Automation ... 5

3.1.1 Test Automation Framework and Automated Test Regression Packs ... 6

3.2 Manual Testing ... 6

3.3 Defect Management ... 7

3.4 Usability Testing ... 7

3.5 Cross Browser and Cross Device Testing ... 8

3.6 Performance Testing ... 8

3.7 Additional Testing Capability ... 8

4 Additional Information ... 10

(3)

MagenTys Testing Services Page 3

1 MAGENTYS

MagenTys is a UK based Software Testing company established in 2004 with ISO9001:2008 accreditation. We have successfully developed a comprehensive and flexible Managed Testing Service to address the full lifecycle and production support of complex and diverse enterprise, web and mobile applications. Our aim is to continually improve quality and ensure IT and Digital business goals are delivered to the highest quality standard, within time and budget.

We specialise in the Financial Services, Insurance, Retail and Digital sectors. Our innovative testing expertise help large and small organisations save money by reducing IT project spend and delivering applications that are robust and fit for purpose.

Our service and delivery model encompasses a Managed Testing Service, Test Consultancy and Test Products. The Managed Testing Service provides highly skilled and experienced teams of Test Consultants that can deliver both functional and non-functional requirements.

Managed Testing Service:

 Test Strategic Planning

 Test Management

 Test Automation

 Functional and Non-Functional Testing

 Acceptance Test Driven Development

 Behavioural Driven Development

 Defect Management

Our test approach is industry, technology and product agnostic, enabling us to successfully deliver major testing programmes across Finance Business Applications, Data Warehouse & Business Intelligence, Web/eCommerce, Mobile, System Integrations and Data Migrations.

(4)

2 COMPANY DETAILS

2.1 OVERVIEW

ISO9001:2008 Accredited Oracle Partners

HP Partners and LoadRunner and Performance Center certified Experts Exclusive UK Sauce Labs Partners

The European Software Testing Awards – Best Overall Testing Project – Finance, 2013 Finalist

2.2 ETHICS AND VALUES

MagenTys are values based company. Every employee and sub-contractor must adhere to the following values:

1. SMALL ENOUGH TO CARE, LARGE ENOUGH TO DELIVER

2. THE REPUTATION OF THE ENTIRE COMPANY LIES IN THE HAND OF EACH INDIVIDUAL 3. ALWAYS TREAT OTHERS AS WE OURSELVES WOULD LIKE TO BE TREATED

(5)

3 SERVICES

MagenTys can deliver an exceptional tailored and flexible Context-Driven Managed Testing Service to deliver both Functional and Non-Functional Testing. Our track record of success and expertise span Test Automation, Test Process Improvement, Usability Testing, Accessibility Testing, Cross Browser and Cross Device Testing and Performance Testing. However, we also recognise that by choosing to develop relationships with strategic partners for specialist areas of testing such as Usability and Accessibility testing, MagenTys can offer a more comprehensive service than what would usually be expected from one supplier.

Tools used include:

 Jira & Jira Capture

 Selenium  Cucumber  WebDriver  TestFairy (mobile)  Sauce Labs  Appium  Fidler  Eclipse  Jenkins  BitBucket  QTP  LoadRunner  JMeter  The Grinder  Quality Center 3.1 TEST AUTOMATION

The MagenTys test automation service helps clients apply good practice and implement tools effectively to achieve optimum return on their investment and provide real benefit to the projects in which they are implemented.

The benefits of our test automation solution include:

 Increased test coverage; over 250 OS/Browsers/Devices with a single framework

 Increased accuracy

 Reduction in time to run tests

 Defect found earlier in the SDLC

 Technology agnostic

 Reduction in labour head count

 Suitable for Agile/BDD projects

 Significant cost reduction

We have successfully implemented reusable Test Automation Frameworks for numerous clients, adding significant value to the test delivery of an IT programme. These frameworks have been designed for Web/eCommerce, Data Warehouse/Business Intelligence, Data Migration and Application testing utilising a range of test tools.

(6)

3.1.1 TEST AUTOMATION FRAMEWORK AND AUTOMATED TEST REGRESSION PACKS MagenTys can develop and implement a Test Automation Framework that is specifically designed and tailored for a wide range of projects. If appropriate, an automated regression pack of scripts can be created that can be executed after every software release within a suitable Test Environment. Advantages of this solution include:

 Any manual testing effort can be used to focus entirely on testing new functionality

 Continuous Integration

 Software can be released in shorter iterations

 Rapid defect detection

 High level of accuracy

 Extensive test coverage

 Capability to be for the entire pack to be run across multiple browsers

Regression Packs can be executed after every code release via Continuous Integration and maintained on a monthly basis. This will provide confidence that any regression issues that occur will be rapidly detected before any customer impact in live environments. Any new pieces of functionality or changes to existing functionality can be built into the Test Pack as part of a maintenance monthly retainer.

MagenTys raise defects and incidents detected during the monthly execution of the Regression Pack via the JIRA Defect Management tool. In addition, a Test Closure report can be submitted each month that details the evidence of all the testing undertaken.

 Test coverage

 Defects found

 Regression Test Pack pass/fail statistics (including screenshots of defects found)

3.2 MANUAL TESTING

MagenTys Functional Testing is based on developing Test Cases and Scripts based from business and testing requirements. In scope functional areas are loaded as JIRA Components, each functional area requirement is loaded as JIRA Story and each requirement test case is loaded as a JIRA session. Components link to Stories and Stories will link to sessions. Components, stories and sessions are prioritised accordingly and any defects raised are linked to the effected story.

A Test Strategy document is produced prior to any test execution. The purpose of the test approach document is to define:

 High Level Scope

 Test Approach

 Methodology

 Test Levels

 Requirement Traceability

 Test Incident Management

 Test Artefacts & Reporting

 Individual Roles and Responsibilities

 Test Data and Environment

 Configuration and Release Management

(7)

 Assumptions and Known Constraints

MagenTys also execute Session Based Exploratory Testing to promote swift and effective defect discovery; typical for Agile and Digital projects. We generate Session Charters using the information sourced from requirements documents and user stories.

Typical areas covered include:

 Structured Exploratory Testing - (link checking, field validation, user scenarios)

 Compatibility Testing – (testing across multiple browsers i.e. IE, Chrome, Firefox)

 Usability Testing – (navigation, content, general look & feel/user experience)

3.3 DEFECT MANAGEMENT

All defects will be raised in JIRA as a BUG issue. Each BUG issue will be linked to the test case that generated the defect.

The defect will contain the following details:

 Type: BUG  Priority  Component  Release Cycle  Status  Assignee  Reporter  Creation Date  Update Date  Description

 Relevant Attachments (Screen Shots etc.)

 Comments

3.4 USABILITY TESTING

MagenTys have many years’ experience of Usability Testing for business, web and mobile applications. Our expert User Experience (UX) Test Consultants adopt a Holistic Session Based Exploratory Testing approach to assess, report and recommend on issues that may affect the look, feel and emotional response of IT and digital applications.

Usability testing is based on UX knowledge, industry standards, benchmarking against competitors and digital technology innovators. MagenTys are in the process of becoming members of the Customer Experience professionals Association (CXPA).

MagenTys complement expert usability testing with tools such as SortSite, PowerMapper and the W3C Validator Suite. These help check web standard conformity, broken links and other web standards. MagenTys can also use the ClickTale real-time analytics tool to video record and analyse all customer journeys post release. This can Help gain a greater understanding of their entire digital audience, understand bottlenecks and use real time video playback to diagnose customer issues. MagenTys can implement and manage this solution.

(8)

3.5 CROSS BROWSER AND CROSS DEVICE TESTING

MagenTys have an excellent reputation and capability within the Cross Browser and Cross Device Compatibility Testing area. We have developed a robust web and mobile Test Automation Framework which can be used within a BDD environment and for regression testing purposes across multiple Browsers, Operating Systems and Devices. MagenTys are one of the few worldwide companies and the UK’s only company who are recognised as Authorised Partners for Sauce Labs, the world’s leading testing platform for mobile and web on 250+ OS / browser platforms.

The MagenTys Test Lab also has multiple Browser environments that we use for manual testing. MagenTys utilise Sauce Labs, Calabash, Eclipse, Robotium and Appium for automated testing of devices. The MagenTys Test Lab is proud to include a wide range of the most popular and newest mobile devices spanning IOS, Android, Windows and Blackberry.

3.6 PERFORMANCE TESTING

The MagenTys performance testing service elements include:

 Load and stress testing

 Scalability and volume testing

 Endurance and soak testing

 Fail-over and resilience testing

Our approach to Performance Testing is similar to our approach with every testing project, which is to choose the testing objectives, techniques, and deliverables (including test documentation) by looking first to the details of the specific situation, including the requirements of the business. The key dependencies are:

 Business Context

 Timescales

 Requirements

 Cost

 Tools

 Methodologies (Agile, Waterfall)

 Technical Context

 Application Type (web, windows, native mobile etc)

 Architecture / Technology / Topology

MagenTys are HP partners and LoadRunner and Performance Center certified experts. We also use tools such as VSTS and RPT. However, for digital projects we promote the use of Open Source technologies such as JMeter and The Grinder. An area of interest is integrating JMeter into an Agile environment using CI tools such as Jenkins. MagenTys are in the process of developing our own Performance Testing Framework and Tool which we intend to launch in 2014 for web and mobile applications

3.7 ADDITIONAL TESTING CAPABILITY

MagenTys has a specialist Security Penetration Testing division. We utilise a combination of automated and manual methods using the latest tools and techniques to ensure comprehensive testing coverage. Our aim is to identify all potential vulnerabilities during an assessment

(9)

This includes the top ten threats identified by the Open Web Application Security Project (OWASP):

 Cross site scripting (XSS)

 Injection flaws

 Malicious file execution

 Insecure direct object reference

 Cross site request forgery (CSRF)

 Information leakage and improper error handling

 Broken authentication and session management

 Insecure cryptographic storage

 Insecure communications

(10)

4 ADDITIONAL INFORMATION

4.1 EXAMPLE PROJECTS BAML – DW/BI Test Automation

The project entailed the delivery of multiple Data Warehouse & Business Intelligence projects in a limited timeframe to meet business and regulatory demands. MagenTys led the team and devised a test strategy which consisted of close to 100% upfront automation of all functional tests.

Infrastructure included QTP, Jira, Netezza, Oracle, MicroStrategy and Informatica. Bank of America now use our Test Automation Framework for all projects

Leading High Street Bank – BDD Banking Project

The project is a top secret banking application, labelled as a game changer in the industry. MagenTys introduced a BDD methodology and a Cucumber (jvm) based automation suite.

Infrastructure included Jira, Cucumber (jvm), Git, Jenkins, Eclipse, HTML, Javascript, CSS and JSON. This has resulted is a far greater quality of product going out to the customer.

Thorntons – eCommerce Automation project (Cucumber)

MagenTys came in to retrospectively automate the regression testing of the Thornton’s eCommerce site through persistent poor releases of software from a third party provider. Thorntons were losing £1m+ per year from website errors. MagenTys has helped stabilise the site and identify these usability, compatibility, device and performance issues before they go into a live environment. Sales are now growing at 14%.

Infrastructure included Jira, Cucumber (jvm), Git, Jenkins, Eclipse, HTML, Javascript and CSS.

Hailo – BDD Web and Mobile Automation Project (Cucumber)

MagenTys introduced a BDD methodology and Web and Mobile Test Automation across the company. Being innovators in the mobile sector, Hailo grew aggressively from 80 to over 150 in a few months. MagenTys were key to ensuring product quality remained at a high standard. We were also responsible for manual usability, device and compatibility testing for Hailo’s global apps and sites

Infrastructure included Jira, Cucumber (ruby), Calabash, Android, iOS, Git, Jenkins, Eclipse, HTML, Javascript, CSS, JSON and RestFul.