"The man had over 100 chickens here at one point" – Fifth Ward neighbors say community garden is now nuisance property