Has anyone tried to use a Siamese neural network for image classification at Commons? I don't know if it will be good enough to run in autonomous mode, but it will probably be a huge help for those that do manual classification.
Imagine a network providing a list of possible categories, and the user just ticks off usable categories.
A Siamese network can be learned by using a triplet loss function, where the anchor and the positive candidate comes from the same category, and the negative candidate comes from an other category but are otherwise close to the anchor.
Output from the network is like a fingerprint, and those fingerprints can be compared to other images with known fingerprints, or against a generalized fingerprint for a category.
John Erling Blad