to be fair you want to defend the RvR objectives because they give boons to the side who has them and you don't want the enemy to have those, plus it can prevent them from doing their quests there too. that and because you don't want to be a loser...do you???
True enough you get buffs for having all locations in a zone, but honestly those buffs are not that useful. You basically get 5% more exp (and I am pretty sure this is only from kills, which makes it useless as killing things rewards such a small amount of exp it is hardly worth it) and deal 5% more damage (I guess it is better than nothing, but not that great).
Also, the PVP quests are stupidly easy to do. They either involve walking next to a zone, which anyone can do by using flee and potions (even if you end up dead shortly afterwards), or they will be something silly like kill players of a certain class (this can easily be achieved by simply making sure you get one hit on a player before they die, even if you did not start the fight and there is a lot of people attacking that player).
The only quests that might be challenging are collecting the stationary items from certain locations in the PVP zone (which basically means standing still for 3s without being hit), but I would imagine if people are constantly fighting you could quickly sneak in and do that anyway.
Also, I suspect RvR will be more active when the game goes live. But yeah, whenever I have played, regardless of time of day it has been pretty much dead. I've ran into two people, one a very low level Bright Wizard who I killed in like 3 hits, and the other a War Priest, who I was fighting with for like 20 minutes and neither of us were even below 95% Hp.