Your cavalier attitude about not wanting any part of it is a large part of what is wrong with society. What if we allowed dogs and cats to be killed on a whim like we are a 3rd world country....does that affect you at all?
Does the mom beating her kid in the store have any impact on the rest of your day?
Does Boko Haram slaughtering innocent Christians in Nigeria bother you or is it the equivalent of the next blue light special at K-Mart?
Your ignorance blocks you from understanding how "society" works, and yes, moral obligations come into play. If you want to be a recluse and stay in your mom's basement forever, then fine. But when you come out and play in the real world, we all have responsibilities to our community and to each other.
If you truly are anti-abortion like you stated before, then yes, the subject matter should concern you, and you should use your voice.