Leveraging Large Language Models for Multimodal Search

Multimodal search lets people combine an image, for fine-grained product detail, with text, for modifications. Natural-language queries are often ambiguous, implicit or partly irrelevant, so this paper introduces a multimodal search system that uses large language models for query parsing and rewriting.