A method for populating an inventory catalog includes receiving an image showing an item in the inventory catalog and comprising a plurality of pixels. A machine learned segmentation neural network is retrieved to determine location of pixels in an image that are associated with an image label and the property. The method determines a subset of pixels associated with the item label in the received image and identifies locations of the subset of pixels of the received image, and extracts the subset of pixels from the received image. The method retrieves a machine learned classifier to determine whether an image shows the item label. The method determines, using the machine learned classifier, that the extracted subset of pixels shows the item label. The method updates the inventory catalog for the item to indicate that the item has the property associated with the item label.