PaperKey Ideas
[2019] Transfusion: Understanding transfer learning for medical imaging
  • ImageNet and medical data are different: classification objective, dataset size, number of labels
  • transfer learning from ImageNet models, do not affect significant performance, despite increase parameters
  • feature reuse at the lowest layers could be useful, as larger model has smaller hidden representation changes, also improve convergence speed