How to interpret the sentence in the first paragraph:
“for a binary classifier assigning a real-valued score to each object, a better correlation between output scores and the probability of correct classification is highly desirable”
The “output scores” should be the predicted probability score by the model
The “probability of correct classification” might be