On Loss Functions

Notes on loss functions.

  1. Hinge loss
  • We use hinge loss when we care about relative ordering with a margine –> good for ranking. And also when we want clear separation

  • NOTE: Hinge loss vs contrastive loss (InfoNCE)

  1. InfoNCE loss