When Should You Not Prune