Lol, I actually understand that wholeheartedly, believe it or not. My grandfather was slightly on the racist side... but I didn't hold it against him, I still loved him. He just grew up in a different era and environment and had it completely ingrained in him to the point where it wasn't so easy to shake those feelings off, but I can tell that he at least tried to "tone it down".
To put it respectfully that is.
However I was raised around racism and discrimination to people like you. Therefore I automatically have a notion to hate gay people.