it confuses me why so few people see it that way

Willful ignorance fuelled by religious indoctrination that getting out of your head is immoral.