clustering art

Clustering Art : 

Clustering Art Our recently developed method for structuring image collections has now been applied to images from the Fine Arts Museum of San Francisco Enabling enhancements Scalability--Tens of thousands of images can now be clustered Natural language pre-processing--hand picked keywords are no longer needed Segmentation--we take advantage of recent N-cuts release Feature selection--no longer reliant on Blobworld features

Method Overview: 

Method Overview We construct a generative probabablistic model for the dataset using N-cut segment features and text descriptions of the images. Applications Browsing image collections Probabilistic search using text, feautures or both Choosing pictures for text--”Auto-illustration” Attaching words to pictures--”Auto-annotation”

Slide3: 

Sample clusters for the FAMSF data

Slide4: 

Auto-illustration Text Passage (Moby Dick) “The large importance attached to the harpooneer's vocation is evinced by the fact, that originally in the old Dutch Fishery, two centuries and more ago, the command of a whale-ship was not wholly lodged in the person now called the captain, but was divided between him and an officer called the  …“ Extracted Query Retrieved Images large importance attached fact old dutch century more command whale ship was per son was divided officer word means fat cutter time made days was general vessel whale hunting concern british title old dutch official present rank such more good american officer boat night watch ground command ship deck grand political sea men mast way professional superior

Slide5: 

Auto-illustration Text Passage (Moby Dick) “The large importance attached to the harpooneer's vocation is evinced by the fact, that originally in the old Dutch Fishery, two centuries and more ago, the command of a whale-ship was not wholly lodged in the person now called the captain, but was divided between him and an officer called the  …“ Extracted Query large importance attached fact old dutch century more command whale ship was per son was divided officer word means fat cutter time made days was general vessel whale hunting concern british title old dutch official present rank such more good american officer boat night watch ground command ship deck grand political sea men mast way professional superior

Slide6: 

Auto-illustration Retrieved Images