Abercrombie & Fitch expected same-store sales to be off this year and that was before the company’s CEO came under fire for his remarks about the type of people who wear the retailer’s clothes and work in its stores.