There is no right answer. Your not wrong or stupid for deciding against finasteride anymore then you are deciding to take it. If you tried finasteride and had some rare major issue you would certainly regret ever trying it. So do you want to roll the dice for a good chance at saving your hair? Keeping in mind I still have trouble seeing propecia as a long term 10+ year solution to male pattern baldness. Your probably going to start losing again even with it, and if you ever stopped all that money is down the drain since your back to start.
In 10 years from now though something better will exist you wont be on it that long if you started today