Skip to yearly menu bar Skip to main content


Livestream
in
Workshop: Workshop on Machine Learning for Creativity and Design

Paper Spotlight: Visualizing Semantic Walks

Shumeet Baluja · David Marwood


Abstract:

An embedding space trained from both a large language model and vision model contains semantic aspects of both and provides connections between words, images, concepts, and styles. This paper visualizes characteristics and relationships in this semantic space. We traverse multi-step paths in a derived semantic graph to reveal hidden connections created from the immense amount of data used to create these models. We specifically examine these relationships in the domain of painters, their styles, and their subjects. Additionally, we present a novel, non-linear sampling technique to create informative visualization of semantic graph transitions.

Chat is not available.