Remove unhelpful CountDownLatch from startup

A simple join() is all that is necessary, so use that instead of the
less familiar CountDownLatch.