There are a number of women in the USCCA headquarters who are partial to dresses (especially during summer). A number of them use a thigh holster/carry shorts under their dresses.
I’ve heard this these mentioned - but there are a lot of other great options out there as well.
Be sure to give us some feedback on what you’ve found works for you! We’d love to have more suggestions!