Best Buy is looking for a new chief financial officer with the announcement that James Muehlbauer is leaving the company.