STAMP: Software testing amplification for DevOps -- Research project

STAMP: Software testing amplification for DevOps

A collaborative effort between 10 organizations, from 6 European countries to advance the state of the art in DevOps and automatic software testing

STAMP is a collaborative research project funded by the European Commission which ran from December 2016 to December 2019.

Key Results

Ongoing Experiments

We thank the European Commission and the H2020 framework program for their strong support in the project. We also thank all the partner organizations for their commitment to science, innovation and open source software. Finally, we thank all our collaborators, all the students, software developers, fellow researchers who have provided feedback, who have contributed to the tools and who are still experimenting with the STAMP technology today. 

Congratulations to Carolin Brandt (TU Delft) who successfully defended her PhD thesis on "Test Amplification For and With Developers" in July 2024!


STAMP Interview

Jeff_Offutt.jpg "Mutation testing can improve software reliability, including security", says Jeff Offutt, Professor of Software Engineering at George Mason University (Virginia) Software companies, and companies that depend on software, succeed only if their software works well. 



In this wrap-up video, STAMP partners are sharing recent DevOps trends, software testing amplification experience, and a few lessons learned during the STAMP project.


Four Testing Tools Ready to Try

DESCARTES tool is designed for software developers who wish to strengthen their test suite, as Descartes is a service that spots weak test cases and suggests improvements. Unlike code coverage tools which provide feedback about the breadth of the testing, our product focuses on providing feedback about the effectiveness of the testing. 

DSpot will increase coverage and that the generated tests are also of better “quality" than existing tests (higher mutation score). For software developers and QA teams who wish to consolidate their test suite, DSpot is a service that automatically generates variants of existing test cases to cover more behaviors. Unlike Evosuite or AFL, DSpot starts from existing tests written by the developers. This way, the generated tests have a clear provenance and developers can understand the intention of these tests. Check out the DSpot video demontration.

CAMP helps software developers to ship their applications to a large number of platforms and environments. Using CAMP, software teams can formalize the variations that their applications need to support different databases, application servers, etc. While other configuration tests only address a small number of fixed configurations, CAMP automatically explores the space of valid configurations, selects a relevant subset, automates the tests and produces aggregated reports. 

BOTSING is for software developers who wish to reproduce a runtime exception. Botsing is a service that fully and automatically generates a test case that reproduces a crash starting from a stack trace, helping developers find out where the bug lies and thus increasing productivity. 



What STAMP means

commit_bubble.jpgSTAMP stands for Software Testing AMPlification. STAMP brings test automation and amplification to the DevOps world.



LinuxMagJune2019.jpg A STAMP toolset article by Caroline Landry (Inria) has been published in the French printed publication Linux Magazine. The 12 pages article details the four main STAMP testing tools. It also describes the testing amplification technique used to increase confidence with each commit. 


STAMP News and Events


Vincent Massol, XWiki CTO


POSS 2019


Slide Deck


STAMP Use Cases


Check out the five use cases. They come from different application domains, such as collaboration and knowledge management, smart cities, workflow automation, open source middleware and eHealth software. And they provide new  experimental foundations for the STAMP testing automation toolkit. 



Be part of the growing STAMP community. Subscribe to our user list and stay updated.



Check out the next opportunities to meet the STAMP project team, at your convenience. 


Report a Bug

Are you facing an issue or a bug while working with STAMP tools? Please let us know.


Contact Us

Do not hesitate to write to us directly for any other questions, proposals or partnership enquiries.

STAMP Consortium