Some are exclusive and many are non-exclusive.
It isn’t really something to be ashamed of, especially if a fixation on cartoons can help divert people off real children, a cartoon child is just a drawing after-all. If there was a way to reliably train people to have that disposition, then that could be highly beneficial in child protection.
One of the weird phenomena reported is that you can be attracted to body types and physiques completely unlike those you would be attracted to in reality. For instance, someone who is into lolicon might not necessarily be a pedophile, but someone more interested into the aesthetics of it.