Ben Affleck Spends Time With Family Following Apology to Hilarie Burton