Even if it's not a sexual fetish, (though I can pretty much guarantee it is for some of them) I still wouldn't want to be there. There is a marked distinction between mickey mouse and some random guy in a fur suit. First: Mickey Mouse gets payed, the furry doesn't, second: Mikey Mouse is a cartoon character, and is well known to people, and has transcended beyond simply being furry into being something beyond simply a person in a suit. I will say right now that I'm not exactly a fan of those guys going around dressed like Mickey Mouse either. Different reasons, but I still don't care for them. Sure, they're great for the kids and that, but I drive absolutely 0 enjoyment out of them, and if they were to insist on intruding on my privacy and ability to enjoy the park, I would in fact become frustrated/angry.
Furries are people who either A) are losers trying to fit into a group, B) Freaks who get off on half-animal drawn porn/imagining people/themselves as part animals/having sex with animals, C) people who believe some variation or such of the idea that they are more animal than human, or have some aspect of some animal in them.
The first 2 types bother me quite a bit more than the last one. However, people going around in fur suits and most things I've seen associated with Furdom so far are enough to make me know that I would more likely than not wish to be very far away had I actually attended AnthroCon.
I'm fine with Furries existing, but as is my general rule with most things I don't like: I don't want to know about it. Just like there are people who are illiterate/negligent/abusive/etc. I don't want to hear about that stuff. I know it goes on, but I also know that I can't really do anything about it in pretty much every case. If I can't do anything about it, and I don't like it, I don't want to hear about it.