GOOGLE'S MUM  MULTIMODAL SEARCH

By Valentina Izzo & CyberAndy

AI SEO Weekly

#GoogleMUM

Google is introducing new multimodal capabilities thanks to Google MUM. Google Multitask Unified Model (MUM) is a giant  transformer-based AI model trained with images-and-text that revolutionizes how Google Search and Google Lens work.

WHAT IS GOOGLE MUM

MUM IMPACTS ON THE SEARCH EXPERIENCE OF GOOGLE LENS AND GOOGLE SEARCH

1

Support for "point-and-ask" scenarios on Google Lens 

2

Phygital search, I run queries with both images and text

TADA 🎉  I can find socks using the image of a pattern that a friend is wearing!

Google Lens is becoming central in Google's ecosystem thanks to the ability of MUM to turn photos into shoppable items. Google Shopping Graph now includes over 24 billions items .

GOOGLE SHOPPING GRAPH

1. "Things to know":  a list of recommendations, how tos and tips to help users explore a given topic. 2. "Refine this search" and "Broaden this ."

OTHER MUM  POWERED SEARCH FEATURES

THINGS TO KNOW

WHAT TO DO TO PREPARE?

1. Improve quality  and scale of the media content, 2. Integrate schema markup (to help MUM connect both images and videos with other assets), 3. Work on your knowledge graph.