Timezone: »

Evaluating Adversarial Attacks on ImageNet: A Reality Check on Misclassification Classes
Utku Ozbulak · Maura Pintor · Arnout Van Messem · Wesley De Neve
Event URL: https://openreview.net/forum?id=oWk2dULs1x »
Although ImageNet was initially proposed as a dataset for performance benchmarking in the domain of computer vision, it also enabled a variety of other research efforts. Adversarial machine learning is one such research effort, employing deceptive inputs to fool models in making wrong predictions. To evaluate attacks and defenses in the field of adversarial machine learning, ImageNet remains one of the most frequently used datasets. However, a topic that is yet to be investigated is the nature of the classes into which adversarial examples are misclassified. In this paper, we perform a detailed analysis of these misclassification classes, leveraging the ImageNet class hierarchy and measuring the relative positions of the aforementioned type of classes in the unperturbed origins of the adversarial examples. We find that $71\%$ of adversarial examples that achieve model-to-model adversarial transferability are misclassified into one of the top-5 classes predicted for the underlying source images. We also find that a large subset of untargeted misclassifications are, in fact, misclassifications into semantically similar classes. Based on these findings, we discuss the need to take into account the ImageNet class hierarchy when evaluating untargeted adversarial successes. Furthermore, we advocate for future research efforts to incorporate categorical information.

Author Information

Utku Ozbulak (Ghent University)
Maura Pintor (University of Cagliari)
Arnout Van Messem (Université de Liège)
Wesley De Neve (Ghent University)

More from the Same Authors

  • 2021 Poster: Fast Minimum-norm Adversarial Attacks through Adaptive Norm Constraints »
    Maura Pintor · Fabio Roli · Wieland Brendel · Battista Biggio
  • 2018 : Accepted papers »
    Sven Gowal · Bogdan Kulynych · Marius Mosbach · Nicholas Frosst · Phil Roth · Utku Ozbulak · Simral Chaudhary · Toshiki Shibahara · Salome Viljoen · Nikita Samarin · Briland Hitaj · Rohan Taori · Emanuel Moss · Melody Guan · Lukas Schott · Angus Galloway · Anna Golubeva · Xiaomeng Jin · Felix Kreuk · Akshayvarun Subramanya · Vipin Pillai · Hamed Pirsiavash · Giuseppe Ateniese · Ankita Kalra · Logan Engstrom · Anish Athalye