![Thumbnail](/xmlui/bitstream/handle/20.500.11984/5906/On%20the%20Cost-Effectiveness%20of%20Composite%20Metamorphic%20Relations%20for%20Testing%20Deep%20Learning%20Systems.pdf.jpg?sequence=4&isAllowed=y)
Izenburua
On the Cost-Effectiveness of Composite Metamorphic Relations for Testing Deep Learning SystemsEgilea
Beste instituzio
https://katalogoa.mondragon.edu/janium-bin/janium_login_opac.pl?find&ficha_no=167748Bertsioa
Postprinta
Eskubideak
© 2022 ACMSarbidea
Sarbide bahituaArgitaratzailearen bertsioa
https://doi.org/10.1145/3524846.3527335Non argitaratua
2022 IEEE/ACM 7th International Workshop on Metamorphic Testing (MET) 09 May. Pp. 42-47. IEEE, 2022Argitaratzailea
IEEEGako-hitzak
Deep learning
Learning systems
Costs
Automation ... [+]
Learning systems
Costs
Automation ... [+]
Deep learning
Learning systems
Costs
Automation
Conferences
Autonomous vehicles
testing [-]
Learning systems
Costs
Automation
Conferences
Autonomous vehicles
testing [-]
Laburpena
Deep Learning (DL) components are increasing their presence in mission and safety-critical systems, such as autonomous vehicles. The verification process of such systems needs to be rigorous, for whic ... [+]
Deep Learning (DL) components are increasing their presence in mission and safety-critical systems, such as autonomous vehicles. The verification process of such systems needs to be rigorous, for which automated solutions are paramount. To allow test automation, test oracles are necessary. In the context of DL systems, meta-morphic test oracles have found to be effective. However, such oracles require the execution of multiple tests, which makes testing more expensive. Metamorphic relation composition can reduce the cost of metamorphic testing. However, its effectiveness has found mixed answers. This paper reports the preliminary results of our study on measuring the cost-effectiveness of composite metamor-phic relations for testing DL systems. To this end, we empirically evaluate the cost-effectiveness of composite metamorphic relations within a DL model for object classification. Our results suggest that composite metamorphic relations reduce the failure revealing capability when compared to their component metamorphic relations. [-]