Self-supervised learning and computer vision

Introduction to self-supervised learning Wherever possible, you should aim to start your neural network training with a pre-trained model, and fine tune it. You really don’t want to be starting with random weights, because that’s means that you’re starting with a model that doesn’t know how to do anything at all! With pretraining, you can use 1000x less data than starting from scratch. So, what do you do if there are no pre-trained models in your domain? For instance, there are very few pre-tra...

Submit