[Should I care about] Fans and Followers?

Social Media is mass media. More than 500 Million users in Facebook, more than 160 Million on Twitter. I am sure you know the numbers. But what about your Fanpage or your Twitter account? Are there are lot of people around? Is it even neccessary to have the ultimate goal to boost those numbers? Really: should I care about my Fans and Followers?