IMO, taking the wheel off just isn't *that* big a screaming deal; it's re-installation (without scratching up the rim) that can give some folks a rough time.
Key to it all is patience... a lot of patience. Once you get the hang of it, it's relatively easy (note I said "relatively"

)
That having been said, I have gone through 6 rear tire changes in the past 5 months, so I get to practice this R/R procedure a goodly amount.....