Archive

Publication: Linux Magazine
Title: Test amplification for DevOps
Date: June 2019
Author: Caroline Landry (INRIA)

Descartes, DSpot, CAMP and Botsing, the four main STAMP testing tools are described in the June 2019 issue of the French printed publication Linux Magazine. The article explains testing amplification as a new technique to automatically analyze and transform the tests produced by the development teams to increase confidence with each commit. The approach  starts with the code produced by the developers: unit tests case, APIs, configuration files. Then, the amplification automatically analyzes and transforms this code to generate variants which will make it possible to test more intensely.

• Linux Magazine June 2019
• Caroline Landry French Article about STAMP tools (PDF)
• HAL: "L'amplification de tests pour DevOps"

Title: OW2con'19 confirms the industrial maturity of open source

Abstract: The OW2 open source community supports many innovative European projects. It signals cooperation around open codes as a key for IT industry services.

On June 12th and 13th, at Orange's innovation center in Paris Châtillon, the OW2 open source community brought together more than 300 decision-makers and developers from 13 different nationalities. The opportunity to confirm the concrete progress of the members and projects of the association, and its growing role in European research, through Horizon 2020 projects in particular. OW2's annual conference provides an overview of European open source research with Aegis, Crossminer, Decoder, Fasten, Melodic, ReachOut, and Stamp projects, with research projects often delivering open and actionable tools by corporate IT departments.

• Read the full (French) article in Solutions Numériques
• Read the full (French) article in Global Security Magazine
• Read the full (French) article in Programmez

In this post we share a visualization of the unit test amplification process. In the example, DSpot is used to amplify two unit tests from JSoup.

More than 30 presentations and breakout sessions showing open source software industrial maturity
 are offered at OW2con’19, the free OW2 community conference, June 12-13, 2019.

Paris, June 12, 2019 - OW2, the international community dedicated to develop and to promote an open source code base for information systems announces the program of its 2019 annual conference. With this year theme  “Open Source: Toward industry Maturity”, OW2con’19 offers two days of project presentations and demonstrations, round tables, workshops and prestigious guest speakers.

Date: 12-13 June 2019
Place: Orange Gardens, Paris Châtillon
Registration: https://www.ow2con.org

During the OW2 open source community annual conference, the STAMP project is represented in a couple of talks:

• STAMP test automation for Continuous Integration, a talk by Caroline Landry (Inria)
• Functional testing with Docker and TestContainers, a talk by Vincent Massol (XWiki) 

The STAMP project also offers a dedicated Breakout Session: Improve your tests with STAMP
Date: 13 June 2019 from 9:15 to 10:45

Publication: Information and Software Technology
Authors: Jeff Anderson, Maral Azizi, Saeed Salem, and Hyunsook Do
URL: https://www.sciencedirect.com/science/article/abs/pii/S0950584919301223?dgcid=rss_sd_all

Title: On the Use of Usage Patterns from Telemetry Data for Test Case Prioritization

In an original work about Production Traffic for Testing, Jeff Anderson, Maral Azizi, Saeed Salem, and Hyunsook Do present a new opportunity in the area of regression testing techniques. Here is the abstract:

Context: Modern applications contain pervasive telemetry to ensure reliability and enable monitoring and diagnosis. This presents a new opportunity in the area of regression testing techniques, as we now have the ability to consider usage profiles of the software when making decisions on test execution. Objective: The results of our prior work on test prioritization using telemetry data showed improvement rate on test suite reduction, and test execution time. The objective of this paper is to further investigate this approach and apply prioritization based on multiple prioritization algorithms in an enterprise level cloud application as well as open source projects. We aim to provide an effective prioritization scheme that practitioners can implement with minimum effort. The other objective is to compare the results and the benefits of this technique factors with code coverage-based prioritization approaches, which is the most commonly used test prioritization technique. 

Method: We introduce a method for identifying usage patterns based on telemetry, which we refer to as “telemetry fingerprinting.” Through the use of various
algorithms to compute fingerprints, we conduct empirical studies on multiple software products to show that telemetry fingerprinting can be used to more effectively prioritize regression tests. 

Results: Our experimental results show that the proposed techniques were able to reduce over 30 percent in regression test suite run times compared to the coverage-based prioritization technique in detecting discoverable faults. Further, the results indicate that fingerprints are effective in identifying usage patterns, and that the fingerprints can be applied to improve regression testing techniques.

Conclusion: In this research, we introduce the concept of fingerprinting software usage patterns through telemetry. We provide various algorithms to compute fingerprints and conduct empirical studies that show that fingerprints are effective in identifying distinct usage patterns. By applying these techniques, we believe that regression testing techniques can be improved beyond the current state-of-the-art, yielding additional cost and quality benefits.

• Read the Information & Software Technology article: "On the Use of Usage Patterns from Telemetry Data for Test Case Prioritization"