I guess the thing is to look “normal” and/or blend in to your environment. That is the ‘grey man’ from above. My clothing styles are very common here, but pretty much common in most places I would go. I am trying not to scream “tactical guy!!”. Heck, you want something like tac pants, but are not? Go find some Wrangler Riggs work pants (tough as nails too), or Carhartt’s. Lots of construction etc guys wear them.
My partner actually wears 5.11 pants to work (all in black). They look fairly like regular slacks on her, plus she gets pockets for all her phones!! Very business like, in her case anyway.