Havertys will not be renewing the lease on the building.