Learning to discriminate on the job