As much as not knowing bothers him, he finds it impossible to think that Charley's hiding something terrible she's done, something that that he couldn't forgive her for.

And he's not so clueless as not to notice this is distressing her, and he doesn't want that. He holds his hand out to her again, a quiet way of letting her know he's not upset with her, that he's still here for her. (He definitely does note the 'not amymore', though.)