allow override of crawl immediately

also allow override of crawl once

also actually use the two config options, in some way,
because currently they are not even used anywhere, it seems.

tests not included yet, want to see opinion on construct.