Make an extremely complex/boring/long/difficult/everything to the left line of quests that would end with an ultimate reward - the questgiver saying "Yeah, yeah, thanks I guess...get off my property now!"
Possibly make him invulnerable and hostile after that.
Possibly make him invulnerable and hostile after that.