My guess is the silver key you're missing is in the cave (I forget the name) in Mistpeak, there's a really awkward one to get. You can see it just fine if you go in one entrance of the caves, but you actually have to go into another entrance to get it. I don't remember the exact directions but...