TitleDefects4J: A Database of existing faults to enable controlled testing studies for Java programs
Publication TypeConference Paper
Year of Publication2014
AuthorsJust R, Jalali D, Ernst MD
Conference NameISSTA 2014, Proceedings of the 2014 International Symposium on Software Testing and Analysis
Pagination437–440
Date or Month PublishedJuly
Conference LocationSan Jose, CA, USA
AbstractEmpirical studies in software testing research may not be comparable, reproducible, or characteristic of practice. One reason is that real bugs are too infrequently used in software testing research. Extracting and reproducing real bugs is challenging and as a result hand-seeded faults or mutants are commonly used as a substitute. \par This paper presents Defects4J, a database and extensible framework providing real bugs to enable reproducible studies in software testing research. The initial version of Defects4J contains 357 real bugs from 5 real-world open source programs. Each real bug is accompanied by a comprehensive test suite that can expose (demonstrate) that bug. Defects4J is extensible and builds on top of each program's version control system. Once a program is configured in Defects4J, new bugs can be added to the database with little or no effort. \par Defects4J features a framework to easily access faulty and fixed program versions and corresponding test suites. This framework also provides a high-level interface to common tasks in software testing research, making it easy to conduct and reproduce empirical studies. Defects4J is publicly available at \urlhttps://defects4j.org.
NotesTool demo
Downloadshttps://defects4j.org/ Defects4J website https://homes.cs.washington.edu/~mernst/pubs/bug-database-issta2014.pdf PDF
Citation KeyJustJE2014