AI Training for Shopify Product Pages

I connected Jotform to our shopify store, but there are many pages that did not get crawled. Mainly all of the product pages do not show up in the knowledge base, and the large majority of the information we offer is on product pages. It did get a lot of our info pages, but I need it to crawl the full site. Is there an easy way to do this, or do I have to train the AI on products one URL at a time?

Hi Andy,

Thanks for reaching out to us for help. I'm an AI assistant. I'll do my best to help you until someone from the support team is available.

Regarding your issue with the AI agent not crawling all product pages from your Shopify store, you do not need to train the AI on each product URL individually. In Jotform AI Builder, you can train your AI agent using your website URL and have it crawl the pages automatically.

Here’s how to do it:

1. Go to AI Builder and click on Train.
2. Select Knowledge Base, then click on Link.
3. Add your Shopify store URL and click the Crawl button.
4. If needed, click Crawl again to scan subpages like product pages.

This will allow the AI to gather information from your entire site, including product pages, without manual URL-by-URL training.

Give it a try and let us know how it goes.

Where do I find the Crawl again option?

Hi Andy,

The "Crawl again" option appears after you add your website URL and start the initial crawl in AI Builder's Knowledge Base training section. Once the first crawl finishes, you'll see a button to crawl again, which lets you scan additional pages like product pages.

Try starting the crawl with your main URL, then look for the option to crawl again to include all subpages.

Hi Andy,

Thanks for reaching out to Jotform Support. To ensure the AI accurately references and understands your product details, each product page needs to be manually crawled. Unlike general informational pages, product-specific content often includes structured data, unique descriptions, and pricing that may not be automatically indexed. Training the AI agent on individual product URLs allows it to retrieve precise information and improve the overall accuracy of responses. 

Give it a try and let us know if you have any other questions.

Is there a limit to what the AI can crawl when you connect it to the shopify app? Seems like product pages would be the primary thing to crawl.

Ah I see, thank you for the explanation.

Hi Andy,

Regarding your question about the AI crawling limits with the Shopify app integration. To clarify, while the AI can crawl your entire website including product pages by using the crawl feature in AI Builder, there may be some limitations depending on the structure and data format of your product pages. Product pages often contain unique, structured data that might require manual crawling of individual URLs to ensure the AI accurately indexes and understands all the details.

In summary, the AI can crawl a large portion of your site automatically, but for the most precise and comprehensive product information, manual crawling of product URLs is recommended. This approach helps the AI provide more accurate responses based on your product details.

Let us know if there’s anything else we can help you with.