do I need to keep the AC on the whole time in Houston, even when I’m away?

I feel that in terms of body feel, I should definitely turn off the AC when I'm not home, but some peoplel say that in humid places like Houston, AC should be on 24/7 to keep the mold away. Anybody with relevant experience?