This follows the heroku pattern of ensuring applications are "freshly" created, routing-wise. Closes #2740