AI SEO Weekly

Prompt engineering in SEO

By @ValeIzzo86 & @CyberAndy

2015

2015

Automated images captioning

Machine learning algorithms were already able to label objects in images, and now they were learning to convert those labels into natural language descriptions.

IMAGE

CAPTION

Curved Arrow

What if you flipped that process around?聽

PROMPT

IMAGE

Curved Arrow

WHAT IS A DIFFUSION MODEL?

WHAT IS A DIFFUSION MODEL?聽

DIFFUSION MODELS are generative models that learn to create images by gradually noising and denoising their training samples.聽

Diffusion models are like autoencoders, which transform input data into an embedding representation and then reproduce the original data from the embedding information.

ORIGINAL GIOTTO

FAKE GIOTTO

Curved Arrow

A new AI System - Converts text prompts into images. - Maintain semantic consistency in the images it creates. - Can generate multiple variations of the same image. - Can edit an existing image.

WHAT IS DALL路E 2 ?

WHAT IS DALL路E 2 ?

DALL-E 2 is a new AI system that can create realistic images and art from a description in natural language.

WHAT DOES IT MEAN FOR SEO ?

WHAT DOES IT MEAN FOR SEO ?

馃憠 It helps us understand how Google Lens works

馃憠 It is precious to generate content both textual and visual

If we have data (let鈥檚 say in a Knowledge Graph), we can convert structured data into natural language.

You can train your model to write, for example, the recipe for Amatriciana, using triples in your knowledge graph.

聽data-to-text

聽data-to-text

More importantly you can create product descriptions where they are missing.

Can we make our prompt even better by combining image with text generation?

Can we make our prompt even better by combining image with text generation?

Yes we can!

Here are a few experiments that we鈥檙e running to improve the quality of our prompts.

We basically evaluate the quality of the completion (the AI generated product description) by generating an image with DALL路E 2. Then we compare the visual similarity between the generated image and the real photo of that product to see what completion works best.

ORIGINAL IMAGE

Synthetic Images聽 (generated using DALL路E 2)

We compare synthetic images with the real product image to evaluate the best prompt.