Timezone: »

 
Demonstration
MosAIc: Finding Artistic Connections across Culture with Conditional Image Retrieval
Mark Hamilton · Stephanie Fu · Mindren Lu · Johnny Bui · Margaret Wang · Felix Tran · Marina Rogers · Darius Bopp · Christopher Hoder · Lei Zhang · Bill Freeman

Tue Dec 08 07:40 AM -- 08:00 AM & Wed Dec 09 07:40 AM -- 08:00 AM (PST) @
in Demonstrations 1 »
Event URL: https://aka.ms/mosaic »

We introduce MosAIc, an interactive website that allows users to discover hidden connections between works of art across culture, media, artists, and time. MosAIc finds "visual analogies", or works of art with the same semantic structure but very different cultural and artistic context, within the combined works of the Metropolitan Museum of Art and the Rijksmuseum. Users can take any work from the collection and find analogous works in particular genres, cultures, or media of art. Our approach finds visual analogies that mirror larger scale cultural trends, such as the flows of artistic techniques across the globe due to trade routes. Our approach is based on generalizing deep image retrieval methods to flexibly adapt to logical filters and predicates. This allows image retrieval methods to find close matches in different regions of the image collection, an approach we call "Conditional Image Retrieval".

Author Information

Mark Hamilton (Microsoft and MIT)
Stephanie Fu (Massachusetts Institute of Technology)
Mindren Lu (MIT)
Johnny Bui (Massachusetts Institute of Technology)
Margaret Wang (MIT)
Felix Tran (MIT)
Marina Rogers (Massachusetts Institute of Technology)
Darius Bopp (Massachusetts Institute of Technology)
Christopher Hoder (Microsoft)
Lei Zhang (Microsoft)
Bill Freeman (MIT/Google)

More from the Same Authors