The latest Screaming Frog tips
Posted: Sun Apr 20, 2025 7:03 am
Use OpenAI prompts
The integration of OpenAI into Screaming Frog enables the automation of complex tasks such as intent analysis, text summarization, or the creation of alt tags for images. Configuration is done directly within the tool, without requiring panama phone number data any JavaScript knowledge.
One-time setup of the API key
Selection of predefined or individually created prompts
Export of results for further processing
Thanks to the intuitive operation, analyses can be carried out quickly and precisely.
Embeddings for deeper insights
Vector embeddings are numerical representations that capture semantic relationships and similarities between content. Nadine explained how to create embeddings using an OpenAI API key and Screaming Frog, and how to further process them with a tool developed by Claneo.
Embeddings help with the following SEO tasks:
Creating thematic keyword clusters
Identification of duplicate content
Optimization of internal linking
Redirect mapping
Actions with JavaScript snippets
Custom JavaScript snippets allow Screaming Frog to perform actions during the crawl, including:
Simulated scrolling on pages
Capture dynamically loaded content
Automatic acceptance of cookie banners
N-Gram analysis for internal link optimization
The N-Gram feature in Screaming Frog analyzes the frequency of individual words of different lengths (1-gram, 2-gram, 3-gram, etc.) to better categorize content. According to Nadine, this feature is particularly useful for:
Uncovering keyword gaps
Detecting cannibalizing content
Improving internal links
She also showed an Excel formula that can be used to create an internal linking matrix.
Segments for more precise analyses
Segmentation by page type facilitates targeted analysis of errors and optimization potential. For example, category, product, or blog pages can be examined separately. Nadine demonstrated how segments can be defined and the results efficiently evaluated.
Bonus: Differences between Raw HTML and Rendered HTML
Enabling JavaScript rendering allows you to compare raw HTML with rendered HTML. This feature is especially useful when analyzing dynamic websites, as it reveals differences between the initial HTML and the visible content.
The integration of OpenAI into Screaming Frog enables the automation of complex tasks such as intent analysis, text summarization, or the creation of alt tags for images. Configuration is done directly within the tool, without requiring panama phone number data any JavaScript knowledge.
One-time setup of the API key
Selection of predefined or individually created prompts
Export of results for further processing
Thanks to the intuitive operation, analyses can be carried out quickly and precisely.
Embeddings for deeper insights
Vector embeddings are numerical representations that capture semantic relationships and similarities between content. Nadine explained how to create embeddings using an OpenAI API key and Screaming Frog, and how to further process them with a tool developed by Claneo.
Embeddings help with the following SEO tasks:
Creating thematic keyword clusters
Identification of duplicate content
Optimization of internal linking
Redirect mapping
Actions with JavaScript snippets
Custom JavaScript snippets allow Screaming Frog to perform actions during the crawl, including:
Simulated scrolling on pages
Capture dynamically loaded content
Automatic acceptance of cookie banners
N-Gram analysis for internal link optimization
The N-Gram feature in Screaming Frog analyzes the frequency of individual words of different lengths (1-gram, 2-gram, 3-gram, etc.) to better categorize content. According to Nadine, this feature is particularly useful for:
Uncovering keyword gaps
Detecting cannibalizing content
Improving internal links
She also showed an Excel formula that can be used to create an internal linking matrix.
Segments for more precise analyses
Segmentation by page type facilitates targeted analysis of errors and optimization potential. For example, category, product, or blog pages can be examined separately. Nadine demonstrated how segments can be defined and the results efficiently evaluated.
Bonus: Differences between Raw HTML and Rendered HTML
Enabling JavaScript rendering allows you to compare raw HTML with rendered HTML. This feature is especially useful when analyzing dynamic websites, as it reveals differences between the initial HTML and the visible content.