The present invention relates to an information processing device, an information processing method, and a program capable of easily adding an annotation to content and providing an application, which utilizes the annotation. A learning device 312 extracts an image feature amount of each frame of an image of learning content and extracts word frequency information regarding a frequency of appearance of each word in a description text describing a content of the image of the learning content as a text feature amount of the description text, and learns an annotation model, which is a multi-stream HMM, by using a multi-stream including the image feature amount and the text feature amount. A browsing control device 314 extracts a scene, which is a group of one or more temporally continuous frames, from target content by using the annotation model and displays representative images of the scenes so as to be arranged in chronological order. The present invention may be applied to a case of adding the annotation to the content, for example.