I just turned on the option
Comment author must have a previously approved comment
and removed the administrator approval requirement. They way I understand it, a comment from a first time commentor on the blog will be held for approval. Subsequent comments from that same commentor will be posted immediately.
