Existence of Adversarial Examples for Random Convolutional Networks via Isoperimetric Inequalities on 𝕊𝕆(d)

Abstract

We show that adversarial examples exist for various random convolutional networks, and furthermore, that this is a relatively simple consequence of the isoperimetric inequality on the special orthogonal group 𝕊𝕆(d). This extends and simplifies a recent line of work which shows similar results for random fully connected networks.