Up here our deer are basically grain fed, and if you trim off every teeny weeny bit of fatty stuff (for steaks, we even trim off the sheen-type fat), it tastes amazing. We've even had avowed venison-haters ask us if it was beef!
That's how it was where i worked. They took off all the fat and used organic beef fat when needed. I really never couldn tell the difference, except for that one studly that one time.