Fishing Near Downtown

Is fishing allowed in the bayous downtown? I don’t plan to eat anything caught or even keep it but just want to get out. If this might me a thing.. does any one have a recommendation on where to go or where to buy bait?