What OP lacks in his logic is that there is a range of attractive in both sexes equally distributed from ugly to super attractive
The key for people is to understand where they stand in attractiveness and aim at targeting equivalently attractive women on that scale, when it comes to plain sex...