Face, Happy, Head, Person, Smile, Blonde, Laughing, Adult, Female, Woman

What are adversarial attacks on AI models, and how do they pose a threat to AI-driven defenses?

View favourites
  • From Live Chat
  • 4 replies
  • 2 views
  • Author: Thomson A.
  • Category: General
  • Date asked:
  • Last update:
  • Anonymous

    There are a lot of adversarial attacks! Do you have any in particular you want to chat about, or I can give a general overview of the ones we come across the most/I find most interesting?

  • Anonymous

    Not sure if you're referring to adversarial inputs, which is an attack where the actual individual input data is slightly modified (imperceptible to humans) and exploits the model's ability to make decisions - I find this really cool as it could be something as simple as changing a few pixels in a picture of a giraffe which you upload to the AI model and it can break it!

  • TA
    Thomson A. Candidate

    In particular MITREE Attack

  • Anonymous

    I think a lot fall into the "Defence Evasion" part of the framework. It is so tricky to keep up though when you have AI models attacking AI models that are meant to defend against other AI models... so definitely a change because they are all full of innovative attacks and defences!