Learning the downtown area?

How have you guys learned the downtown area? Everyone I talk to is so intimidated to drive/walk around downtown.

I too, find it confusing. I want to know it so well I don’t need to use my GPS to get around most places. Please help, thanks!