"first things first" refers to doing things in the correct order when you're beginning a task -- e.g. dealing with preparatory matters first, rather than jumping straight into the middle of the task.
"to start as one means to go on" means to begin doing something in the way that one intends to continue doing it; to set a consistent pattern of behaviour right from the