Typical systems develop various ways to search for each signal separately (for example, image search, keywords in text transcripts used in visual patterns, and text searches) and combine the results.
Multimodal search simultaneously uses different input data of a different nature and search methods to combine results by combining all input search elements.
Google announced the new applications of Google MUM technology at its SearchOn event, including the use of Google Lens for multimodal searches, related topics in videos, and other new search results features.
Learn more about Multimodal Search by watching our Web Stories.
