Published 26th February 2024
CMS 12 / Commerce 14

What's the Magic Behind It?

Picture this: You've got an image, and it's pretty good, but you're thinking, "What if I could make it epic?" That's where Image Transformer steps in. It's like having a creative buddy that speaks two languages fluently – picture and prose. First, it uses GPT-4-Vision to get what your image is all about, like really gets it. Then, it chats with DALL·E 3, another AI pal, to cook up some variations of your original pic based on a super descriptive text prompt it comes up with.

But Wait, There's More!

Here's the kicker: You're not just stuck with the original scene. Want to add a person? Sure. Make it sunset instead of noon? You got it. The idea is to let you mess around and add or change details. It's perfect for when you've got a cool photo and think, "This is nice, but it'd be awesome with some other details the background."

How Image Transformer Works

Image Transformer is a marvel of AI engineering, designed to transform the way we interact with images. Here's a glimpse into the magic behind it:

1. Image Analysis with GPT-4-Vision: The process begins with GPT-4-Vision analyzing the input image. This powerful model deciphers the visual content, extracting key features and understanding the context, objects, and themes present in the image.

2. Extracting Visual Features: By breaking down the image into comprehensible elements, GPT-4-Vision provides a detailed representation of the visual data, ensuring that the essence of the original image is captured accurately.

3. Generating Textual Descriptions: The extracted visual information is then converted into a descriptive text prompt. This step is crucial, as it bridges the gap between visual understanding and textual representation, setting the stage for the creative process.

4. Creative Generation with DALL·E 3: The descriptive text prompt is fed into DALL·E 3, which interprets the description and generates variations of the original image. This is where creativity knows no bounds; DALL·E 3 uses the prompt to reimagine the image in ways that are both astonishing and artistically rich.

5. Unveiling the Variants: The generated images are presented as variants of the original, each reflecting a unique interpretation based on the textual prompt. Users can explore a diverse range of creative possibilities, from subtle modifications to entirely new artistic expressions.

The Origin of Image Transformer

The idea behind Image Transformer came from a simple question: What if we could use artificial intelligence to not just understand images, but also imagine them in endless ways? Inspired by this idea, our team created a feature that combines the advanced visual understanding of GPT-4-Vision with the impressive image generation abilities of DALL·E 3.

Example

Original Image: 

First variation:

Change to "French man": 

What is your opinion?

The AI Assistant: This is what you get

Feature-Rich for Enhanced Editorial Efficiency

Epicweb's AI Assistant comes with an impressive array of features:

1. Text Suggestions and Alternatives: Overcome creative blocks with AI-generated suggestions and phrasings for your text.

2. Multilingual Translation: Seamlessly translate your text into various languages, catering to a diverse audience.

3. Image Generation: Create relevant and engaging images that complement your content.

4. Image Transformer: Take any image, enhance it, and add new elements with AI-powered creativity. Transform the way you interact with images.

5. New Text Generation: Generate fresh content that keeps your audience engaged.

6. Text Summarization: Quickly condense long texts into concise summaries, saving time and maintaining essence, perfect for SEO descriptions.

7. HTML Formatting: The AI-Assistant offers a range of formatting capabilities within the Rich Text Editor. WCAG Compatible.

8. Spell-Checking: Ensure your content is error-free and professionally polished.

9. Tone Adjustment: Tailor the tone of your writing to match your content's purpose, be it persuasive, informative, or otherwise.

10. Keyword Extraction: Identify and extract key terms from your text for SEO optimization.

11. Custom Prompts with ChatGPT: Leverage the power of ChatGPT to run your own prompts for unique content creation.

12. Custom Shortcut Prompts: Add your own shortcuts for frequently used commands, enhancing productivity.

13. Inline ChatGPT Help: Use ChatGPT directly within the platform for instant assistance.

Streamlined Integration into Optimizely

The AI Assistant is seamlessly integrated into every field within the Optimizely CMS and Commerce platform, ensuring that these powerful features are accessible right where you need them—in the editor mode.

Getting Started with The Epicweb AI-Assistant:

To get started with the free evaluation, simply fill in the form in our website to get started and download the addon to your Optimizely CMS and Customizable Commerce platform from the Optimizely Nuget feed.

Follow our beginner-friendly guide or dive deep with our comprehensive documentation.

Installation is quick and easy, taking about 10 minutes, allowing you to start harnessing the power of AI assistance in no time.

Note: This blog post has been enhanced with the help of the AI-Assistant for Optimizely.