told me, told, said to me, said

He told me the whole story.

He told the whole story. [Can I omit "me"?]

He said to me the whole story.

He said the whole story. [Can I omit "to me"?]