Residents, and athletes, are not happy with officials’ decision to address rising COVID cases by having no spectators in the stands