Department store consolidation could strengthen the bargaining power of wholesale buyers thereby hurting Polo's wholesale revenues.