Bigger stores are in the plans for the Casual Male Retail Group, the parent company of Casual Male XL and Rochester Big & Tall stores.