Fate of singularities and horizons in higher derivative gravity