I'm not a drummer, and I don't do that for anything that I do, but..
Even years and years ago, some of the drummers I knew IRL really liked vDrums (or similar) largely for the same reasons that we like modelers - more control over the sounds themselves, easy editing/config, changing sounds after the fact (assuming you capture dry and "re-amp"), quiet practice, etc.. The only serious complaints I heard even in mid-2000s had to do with hi-hats and rimshots.
I haven't heard the rimshot complaint in a while, but I guess it would really depend on the sample pack you use.
And, apparently, Roland recently came out with a hi-hat controller that actually works like a hi-hat and is waaaaay closer. It's expensive....just the hi-hat costs over a grand. But, apparently, it's to the point that even really picky drummers can use the same techniques they use on a real one and get the sounds they want.
Personally....if I were setting up a more complete "music room" and certainly if I were setting up an actual home studio capable of recording...what I've heard at least heavily implies that a $5,000 or so vDrum kit is probably worth investing in, especially compared to a $5,000 normal kit and the thousands worth of mics and pres and even more on a good-sounding live room it would take to record it.
Obviously YMMV. But, if you're recording at home....
If you're just doing scratch tracks and plan on going to a "real" studio to record drums...it's probably not worth the cost compared to more basic pads.
But...it does seem like it's to the point that you can get what you want "at home" for a lot less money between modelers, vDrums, and some vocal shields. It's still different. But, a lot of people like the "raw" recordings from a basic space, low-end equipment, etc.. It seems like this stuff gives a very different set of trade-offs that are probably perfect for a lot of projects.
My bet would be that the band performing together and getting the performance all at once with clean recordings is worth more than the kit maybe sounding a bit better if the cost is recording it separately.