I do agree that full removal of breast tissue would result in noticeable "i had obvious surgery" sign. For FtMs, i sympathize with alot because they don't have a choice and just like most MtFs hating their male parts and such, FtMs hate their apparent female sides. Mastectomy, despite the scars and look wise, it brings FtMs some relief and acceptance with their bodies, and when done by an expert surgeon, it can look natural and just part of the body.
For MtFs, alot do complain about breast size as you have mentioned, but some don't even know that cis-females do so as well. The first thing you would hear a cis-female complain about, is her breast size, followed by her eyes, her nose, her hair ect... So it is not weird at all in the grand scheme of things.
Estradiol (talking about its effects on MtFs) will give you breast tissue, ducts and lobules no matter your chest size, because that is what it does (when in high levels or paired with progesterone, it can also enable lactation). I am happy that you are satisfied with your breast growth, as you should be, cause breast implants just scream "fake" to people.
Moral of the story is, bcwywf.