If you are confortable where you are in your exploration, then you are definitely where you need to be. Sometimes, at least in my experience, we have a tendency not to feel "real" or "genuine" (whatever those terms mean in relation to our selves), if we don't meet some external standard or behave/dress/act in a particular fashion. I've seen this in TG world where participants feel compelled to segregate each other into "one size fits all" boxes - CDer, Genderqueer, transsexual, etc, etc, etc. Categorizing is just human nature, I guess, but most people don't fit into one category very easily. That's what I'm finding out about myself, at least, but it has taken years to get to this point.
The bottom line is, as the old saw goes, just be yourself. If that's living as a male who happens to like female attire, go for it. Clothes don't make the man (or woman). Rather, we make ourselves. So, what you choose to wear only defines you to the extent that you want it to. True, society does judge based on external characteristics, but you are completely in control of how much you choose to subject yourself to the world's "microscope". Of course, there are certain societal conventions that, for safety's sake, are best adhered to - I would strongly recommend not wearing a nightie into a family restaurant
Again, wherever this journey takes you, if you're not comfortable there, you're in the wrong place. Changes will always be unsettling at first, but if they don't soon turn in a positive direction, it is not for you.
Take Care,
Angie