The storage properties of an optimal neural network with correlated patterns is studied allowing for a finite fraction of errors determined by the Gardner-Derrida cost function. A discontinuity in the probability distribution of the local stabilities is seen as a drastic decrease in the minimal fraction of errors. There is also an enlargement of the domain in which the replica symmetric solution is stable, allowing for higher storage capacities.