Screaming Frog Seo Spider 184 Neverb Link [best] May 2026
The phrase "screaming frog seo spider 184 neverb link" appears to be a specific string often associated with software activation or "cracked" versions of the Screaming Frog SEO Spider (a popular website auditing tool), particularly version 18.4. In the world of SEO and technical auditing, using such "neverb" or "patched" links is a common but risky trope among beginners and black-hat practitioners.
Here is a short story reflecting the typical SEO's journey with this specific software version. The Audit of the Phantom Site
Leo was an SEO freelancer on his first big contract: a 50,000-page e-commerce site that was bleeding organic traffic. He knew he needed the Screaming Frog SEO Spider 18.4, but the free version’s 500-URL limit was a wall he couldn’t climb, and the license fee felt like a mountain.
Desperate, Leo spent a late night on a "technical SEO" forum. He found a thread titled "Screaming Frog 18.4 – Neverb Link – Full Access." Without checking the source, he clicked the "neverb" link—a shortened URL that redirected through three shady domains before a file finally landed in his downloads.
He installed the "patched" 18.4. The frog icon turned green, and for a moment, Leo felt like an SEO god. He plugged in the client’s URL and hit "Start." The spider began its work, crawling through 10,000, 20,000, 30,000 pages. Leo watched the status codes roll in: 200s, 301s, and a sea of 404s he could finally report. But then, the "neverb" link’s true price was revealed.
The crawl suddenly spiked to 1,000 threads per second, far exceeding Leo's settings. The software, modified by an unknown "neverb" coder, had turned into a DDoS machine. Within minutes, the client’s server crashed. Leo’s screen flickered, and a command prompt window opened by itself, executing a script that began exfiltrating his browser’s saved passwords.
The "neverb link" hadn't just given him a free tool; it had given a back-door to his machine. Leo had to pull the plug on his router, wipe his hard drive, and explain to a very angry client why their site was down for two hours.
The next day, Leo did what he should have done from the start: he went to the official Screaming Frog site, bought a legitimate license, and realized that in SEO—as in software—if you don't pay for the tool, you often end up being the product.
Introduction
The Screaming Frog SEO Spider is a popular tool used for website crawling and SEO audits. Version 18.4 of the tool was released with several updates and improvements. One of the notable changes in this version is the way it handles "Never" links.
What are "Never" links?
In the context of website crawling, "Never" links refer to URLs that are not crawlable or are intentionally excluded from being crawled by search engines. These links often contain attributes like nofollow, noopener, or noreferrer that instruct crawlers to ignore them.
Screaming Frog SEO Spider 18.4 and "Never" links
In version 18.4, the Screaming Frog SEO Spider has improved its handling of "Never" links. Here's what you need to know:
- Improved detection of "Never" links: The updated tool can now better detect "Never" links, including those with
nofollow,noopener, ornoreferrerattributes. - New "Never" link categorization: The SEO Spider 18.4 categorizes "Never" links into three types:
- Never (nofollow): Links with a
nofollowattribute. - Never (noopener): Links with an
noopenerattribute. - Never (noreferrer): Links with a
noreferrerattribute.
- Never (nofollow): Links with a
- Enhanced filtering and analysis: The tool provides enhanced filtering and analysis capabilities for "Never" links, allowing you to:
- Filter by link type (e.g., internal, external, never).
- Analyze the distribution of "Never" links across your website.
- Identify pages with multiple "Never" links.
Benefits of improved "Never" link handling
The improved handling of "Never" links in Screaming Frog SEO Spider 18.4 offers several benefits:
- Better understanding of website linking structure: With enhanced detection and categorization of "Never" links, you can gain a deeper understanding of your website's linking structure and identify areas for improvement.
- Increased accuracy in SEO audits: The updated tool helps ensure that your SEO audits are more accurate, as it takes into account the complexities of "Never" links.
- Enhanced optimization opportunities: By identifying and analyzing "Never" links, you can uncover optimization opportunities to improve your website's crawlability, user experience, and search engine rankings.
Conclusion
The Screaming Frog SEO Spider version 18.4 offers significant improvements in handling "Never" links. With enhanced detection, categorization, and filtering capabilities, you can gain a better understanding of your website's linking structure and identify opportunities for optimization. If you're already using the Screaming Frog SEO Spider, it's worth updating to version 18.4 to take advantage of these improvements. If you're new to the tool, now's a great time to try it out and see how it can help with your SEO efforts.
The Screaming Frog SEO Spider is a foundational tool for technical SEO, and its evolution through versions like 18.0 and its successors (up to the current v23.0) has introduced critical automation features for modern workflows.
While "neverb link" is not a standard industry term or a specific feature name found in official release notes for version 18.4, it likely refers to advanced link analysis capabilities such as unlinked pagination or fragment (jump link) validation. Deep Dive: Advanced Link Auditing in Version 18.x
Modern versions of Screaming Frog have moved beyond simple 404 detection to offer more nuanced link health diagnostics.
Jump Link (Fragment) Validation: One of the most significant updates in the 18.x era is the ability to crawl URLs with fragment identifiers (#). The spider verifies that a specific ID exists in the HTML, allowing you to find broken bookmarks or "jump links" that would otherwise go unnoticed because they don't return a 404 status.
Unlinked Pagination Reports: Version 10.0 and subsequent 18.x updates refined how pagination is handled. The "Unlinked Pagination URLs" report identifies pages that are part of a rel="next" or rel="prev" sequence but lack a direct hyperlink, which is vital for ensuring crawlability of deep catalog pages.
In-App Explanations: Starting with version 18.0, the tool provides built-in explanations for over 300 SEO issues, including priority levels. This helps users understand why a specific link issue is being flagged without needing to consult external documentation. Key Technical SEO Checks
For a deep audit, SEO professionals utilize these core link-related features:
Redirect Chains & Loops: Finds internal URLs that redirect multiple times before reaching a final destination, which can drain "crawl budget".
Canonical Audit: A "Always Follow Canonicals" option in list mode allows for precise auditing of how link signals are being consolidated across duplicate pages.
External Link Tracking: Automatically categorizes links pointing outside the domain, helping you manage site authority and identify potential spam or broken outbound references. Pro Tips for Power Users Screaming Frog SEO Spider Website Crawler
If you are looking for information or a license key for Screaming Frog SEO Spider version 18.4, please note that "neverb link" appears to be associated with unauthorized or "cracked" software distribution sites.
For security and reliability, it is highly recommended to use official versions of the tool. You can download the latest version directly from Screaming Frog . Official Access Options
Free Version: The Free Mode allows you to crawl up to 500 URLs and access most basic features like finding broken links and auditing redirects.
Paid License: A Paid License removes the crawl limit and unlocks advanced features such as scheduling, Google Analytics integration, and JavaScript rendering. screaming frog seo spider 184 neverb link
Version History: You can view official updates and download older versions via the Screaming Frog User Guide or their release notes to ensure you are using a legitimate build.
Using unofficial "cracked" versions (often found via "neverb" or similar links) poses significant risks, including malware infections, data theft, and lack of technical support.
To get started with legitimate crawling, you can follow the official Quick Start Guide to set up your first audit.
If you'd like to learn more about a specific SEO task, I can help you with: Setting up a broken link audit Configuring custom extraction for data mining Integrating API data from Search Console or Ahrefs
. Official documentation and release notes for this version do not list a feature or metric by that specific name. Screaming Frog It is highly likely you are looking for information on "Unlinked"
pages or specific link-related features introduced or updated around that version. Key Features in Screaming Frog 18.4
Version 18.4 was a minor update released in March 2023, primarily focusing on bug fixes and technical refinements. However, if you are looking for articles related to "missing" or "unlinked" items, these are the most relevant concepts from that era of the tool: Screaming Frog Unlinked Hreflang URLs : This reports URLs that are only discoverable via rel="alternate"
hreflang annotations and are not linked through traditional anchor tags elsewhere on the site. Pages Without Internal Outlinks
: A common report identifying "dead-end" pages that do not link to any other internal pages, often due to JavaScript rendering issues or design. Orphan Pages
: These are pages found via sitemaps or external data (like Google Search Console) that have no incoming internal links from the crawl. Link Position and Path Type
: Improvements in how the tool classifies where a link is located (e.g., header, footer, or body) and the type of path used. Screaming Frog Recommended Resources
If you are troubleshooting link issues or looking for a guide on how version 18+ handles links, these official articles are the best starting points: How to Perform an Internal Linking Audit
: A comprehensive guide on finding orphan pages and auditing site structure. How to Find Broken Links
: A step-by-step tutorial on using the Response Codes tab to identify 4xx errors. Understanding Link Score
: Explains how the tool calculates the relative value of a page based on its internal linking architecture. Screaming Frog Could you clarify if might be a misspelling of another term like "unlinked,"
? Knowing the specific issue you're trying to solve would help me find the exact guide you need. Internal Linking Audit With the SEO Spider - Screaming Frog
The story of Screaming Frog SEO Spider 18.4 is one of technical resilience and precision, marking a pivotal moment in the tool's history when it had to adapt overnight to major changes in the search ecosystem. The Evolution of Version 18.0
Version 18.0, launched in December 2022, was a transformative update known for introducing PDF parsing. This allowed SEOs to crawl links inside PDF documents and analyze their metadata as if they were standard HTML pages. The "Neverb" Link & Version 18.4
The release of Version 18.4 on March 16, 2023, was an emergency "small update" triggered by external factors:
The PSI Emergency: Google updated the PageSpeed Insights (PSI) API with breaking changes without advance notice.
The Fix: Screaming Frog engineers immediately released 18.4 to restore the PSI integration, which is critical for developers auditing site performance.
Technical Refinements: This version also fixed specific URL encoding issues that previously prevented some pages from loading during JavaScript rendering. Key Features and Capabilities
As the 18.4 spider crawls through a website's architecture, it functions as a digital detective:
Link Auditing: It identifies broken links (404 errors) by scanning every internal and external connection.
Resource Discovery: It maps out images, CSS, and JavaScript files to find blocked resources.
Redirect Analysis: It follows redirect chains and loops to ensure link equity isn't lost during site migrations.
Bulk Extraction: It allows users to export these findings to Google Sheets or Excel for large-scale reporting. Screaming Frog SEO Spider Website Crawler
The Ultimate Guide to Screaming Frog SEO Spider: Unlocking the Power of Neverb Link
In the world of search engine optimization (SEO), having the right tools at your disposal can make all the difference between success and failure. One such tool that has gained immense popularity among SEO professionals is the Screaming Frog SEO Spider. This powerful tool has been a game-changer for many, helping them to analyze, optimize, and improve their website's performance on search engines. In this article, we will be focusing on the keyword "Screaming Frog SEO Spider 184 Neverb Link" and exploring its significance in the world of SEO.
What is Screaming Frog SEO Spider?
Screaming Frog SEO Spider is a web crawling tool that allows you to analyze and audit websites. It is designed to help SEO professionals, webmasters, and digital marketers to identify areas of improvement on their website, optimize their content, and enhance their online presence. The tool works by crawling a website, much like a search engine would, and providing a comprehensive report on various aspects of the site, including its structure, content, and performance. The phrase " screaming frog seo spider 184
What is Neverb Link?
Neverb Link is a feature of the Screaming Frog SEO Spider tool. It allows users to analyze and understand the internal linking structure of a website. Internal linking is an essential aspect of SEO, as it helps search engines to understand the hierarchy and structure of a website. Neverb Link provides a detailed report on internal linking, highlighting areas of improvement and suggesting opportunities to optimize the linking structure.
The Significance of Screaming Frog SEO Spider 184 Neverb Link
The keyword "Screaming Frog SEO Spider 184 Neverb Link" highlights the specific version of the tool (v184) and its Neverb Link feature. This version of the tool has been designed to provide even more advanced features and functionality, helping users to gain deeper insights into their website's performance and optimization opportunities.
The significance of this keyword lies in its ability to help SEO professionals and webmasters to:
- Analyze internal linking structure: With Neverb Link, users can analyze the internal linking structure of their website, identifying areas of improvement and opportunities to optimize the linking structure.
- Improve website crawlability: The Screaming Frog SEO Spider tool helps users to identify issues that may be hindering the crawlability of their website, ensuring that search engines can easily navigate and index their content.
- Enhance content optimization: The tool provides a comprehensive report on various aspects of a website's content, including its structure, meta tags, headings, and more. This helps users to optimize their content and improve its relevance and ranking on search engines.
- Identify technical SEO issues: The Screaming Frog SEO Spider tool helps users to identify technical SEO issues, such as broken links, duplicate content, and more. This enables them to fix these issues and improve the overall performance of their website.
How to Use Screaming Frog SEO Spider 184 Neverb Link
Using the Screaming Frog SEO Spider 184 Neverb Link is relatively straightforward. Here's a step-by-step guide to get you started:
- Download and install the tool: Download the Screaming Frog SEO Spider tool from the official website and install it on your computer.
- Enter your website URL: Enter your website URL into the tool, and click on the "Start" button to begin the crawling process.
- Configure your crawl: Configure your crawl settings, including the pages to crawl, the user agent, and more.
- Analyze your results: Once the crawl is complete, analyze your results, which will include a comprehensive report on your website's structure, content, and performance.
- Use Neverb Link: Use the Neverb Link feature to analyze your internal linking structure and identify areas of improvement.
Benefits of Using Screaming Frog SEO Spider 184 Neverb Link
The benefits of using the Screaming Frog SEO Spider 184 Neverb Link are numerous. Some of the most significant advantages include:
- Improved website performance: The tool helps users to identify areas of improvement on their website, enabling them to optimize its performance and ranking on search engines.
- Enhanced content optimization: The tool provides a comprehensive report on various aspects of a website's content, helping users to optimize its relevance and ranking on search engines.
- Increased crawlability: The tool helps users to identify issues that may be hindering the crawlability of their website, ensuring that search engines can easily navigate and index their content.
- Better technical SEO: The tool helps users to identify technical SEO issues, such as broken links, duplicate content, and more, enabling them to fix these issues and improve the overall performance of their website.
Conclusion
In conclusion, the Screaming Frog SEO Spider 184 Neverb Link is a powerful tool that can help SEO professionals and webmasters to analyze, optimize, and improve their website's performance on search engines. With its advanced features and functionality, this tool provides a comprehensive report on various aspects of a website's structure, content, and performance. By using this tool, users can identify areas of improvement, optimize their internal linking structure, and enhance their content optimization. If you're looking to take your SEO efforts to the next level, the Screaming Frog SEO Spider 184 Neverb Link is definitely worth considering.
Title: "Unleashing the Power of Screaming Frog SEO Spider: A Comprehensive Guide to NeverBounce Link Building"
Introduction
In the world of Search Engine Optimization (SEO), staying ahead of the competition requires a combination of technical expertise, creativity, and persistence. One of the most effective tools for SEO professionals is the Screaming Frog SEO Spider, a powerful web crawling tool that helps identify and analyze website data. When combined with a robust link building strategy, such as NeverBounce, the Screaming Frog SEO Spider can be an unstoppable force. In this article, we'll explore the benefits of using the Screaming Frog SEO Spider and NeverBounce for link building, and provide a step-by-step guide on how to get the most out of these tools.
What is Screaming Frog SEO Spider?
The Screaming Frog SEO Spider is a website crawling tool that allows users to extract and analyze data from websites. This tool is designed to help SEO professionals identify technical SEO issues, such as broken links, duplicate content, and optimization opportunities. With the Screaming Frog SEO Spider, users can:
- Crawl and analyze websites with ease
- Identify and fix technical SEO issues
- Optimize website structure and architecture
- Improve website performance and user experience
What is NeverBounce?
NeverBounce is a powerful email verification and link building tool that helps SEO professionals build high-quality backlinks and improve their website's authority. With NeverBounce, users can:
- Verify email addresses and reduce bounce rates
- Build and manage email lists
- Create and send outreach campaigns
- Track and analyze link building performance
The Power of Combining Screaming Frog SEO Spider and NeverBounce
When combined, the Screaming Frog SEO Spider and NeverBounce offer a potent link building solution. Here's how:
- Identify Link Opportunities: Use the Screaming Frog SEO Spider to crawl and analyze websites, identifying potential link opportunities and broken links.
- Verify Email Addresses: Use NeverBounce to verify email addresses and build a list of relevant contacts.
- Outreach and Link Building: Use NeverBounce to create and send outreach campaigns, securing high-quality backlinks and improving website authority.
Step-by-Step Guide to Using Screaming Frog SEO Spider and NeverBounce
Here's a step-by-step guide to using the Screaming Frog SEO Spider and NeverBounce for link building:
Step 1: Crawl and Analyze Websites with Screaming Frog SEO Spider
- Launch the Screaming Frog SEO Spider and enter the URL of the website you want to analyze.
- Configure the crawl settings to extract relevant data, such as page titles, meta descriptions, and header tags.
- Review the crawl data to identify potential link opportunities and technical SEO issues.
Step 2: Verify Email Addresses with NeverBounce
- Create a new project in NeverBounce and import your email list.
- Run the email verification process to identify valid and invalid email addresses.
- Filter out invalid email addresses and create a list of verified contacts.
Step 3: Create and Send Outreach Campaigns with NeverBounce
- Create a new outreach campaign in NeverBounce and select your verified email list.
- Craft a compelling email template and configure the campaign settings.
- Send the outreach campaign and track the performance of your link building efforts.
Conclusion
The Screaming Frog SEO Spider and NeverBounce are two powerful tools that can help SEO professionals build high-quality backlinks and improve their website's authority. By combining these tools, users can identify link opportunities, verify email addresses, and create and send outreach campaigns. With this comprehensive guide, you're ready to unleash the power of the Screaming Frog SEO Spider and NeverBounce for your link building efforts.
The Screaming Frog SEO Spider is a powerful desktop-based website crawler designed to perform technical SEO audits. Version 18.4 was a specific maintenance update released in March 2023 primarily to address breaking changes in the PageSpeed Insights (PSI) API. Core Functionality
The tool helps SEO professionals identify over 300 technical issues, including:
Response Codes: Finding broken links (404 errors) and server errors (5xx).
Redirect Audits: Tracking redirect chains and permanent (301) vs. temporary (302) redirects. Improved detection of "Never" links : The updated
Metadata Analysis: Identifying missing, duplicate, or overly long page titles and meta descriptions.
Directives: Reviewing meta robots and X-Robots-Tag directives like 'noindex' or 'nofollow'. Internal Link Analysis
One of the most valuable features for site architecture is the ability to audit internal linking: Screaming Frog SEO Spider Website Crawler
Title: The Mutable Web: An Analysis of Link Extraction and Transformation in Screaming Frog SEO Spider 18.4
Introduction
In the intricate discipline of Technical Search Engine Optimization (SEO), the gap between raw data and actionable insight is often bridged by crawling tools. Among these, Screaming Frog SEO Spider has established itself as the industry standard for granular website analysis. The release of version 18.4 marked a significant evolution in the tool’s capabilities, particularly regarding the handling of hyperlinks. While the software has always excelled at discovering links, this version emphasized the critical distinction between the link as it exists on the page and the link as it is processed by search engines. This essay explores the functionality of link extraction in Screaming Frog SEO Spider 18.4, analyzing how the software deconstructs the web’s hypermedia structure to reveal the "neverb" link—a theoretical construct referring to the hidden, modified, or unrendered link states that often elude standard crawlers.
The Hyperlink as a Dynamic Entity
To understand the significance of the link extraction protocols in version 18.4, one must first appreciate the changing nature of the hyperlink. In the early days of the web, a link was a static entity: an <a> tag with an href attribute. Today, links are dynamic. They are generated by JavaScript, obfuscated by tracking parameters, hidden behind click events, or modified by canonical tags and robots.txt directives.
Standard crawling agents often fail to capture the full picture. They may see a link on the rendered DOM but fail to note that it is blocked by robots.txt, or they may index a URL without realizing that the on-page link contained a rel="nofollow" attribute. Screaming Frog 18.4 addresses this by treating the link not as a binary connection between Page A and Page B, but as a multi-layered object with distinct properties. The "neverb" link concept arises here—a link that technically exists in code but is functionally inert for SEO purposes due to directives, errors, or manipulation.
Categorization and the "Neverb" State
The core strength of Screaming Frog 18.4 lies in its ability to categorize links with forensic precision. The software moves beyond simple internal and external buckets, offering granular classifications that identify the "neverb" status of connections.
-
The Blocked Link (Robots.txt): One of the most common forms of the "neverb" link is the one blocked by directives. Version 18.4 provides a dedicated "Blocked by Robots.txt" report. This allows SEOs to identify high-value pages that are internally linked but effectively invisible to search engine crawlers. The software highlights the dissonance between the site architecture (which suggests importance through linking) and the server directives (which deny access).
-
The Noindexed and Nofollowed: The tool distinguishes between links pointing to pages that are canonicalized, noindexed, or blocked by meta directives. This creates a map of "orphan" or "zombie" links—pathways that exist on the page but lead to content the site owner has deemed unrankable. In previous iterations, untangling this web required manual cross-referencing; 18.4 automates the detection of these dead-end connections.
-
The Unrendered vs. Rendered Link: With the proliferation of JavaScript frameworks like React and Angular, the source code of a page often differs significantly from the rendered DOM. Screaming Frog 18.4 utilizes a Chromium-based rendering engine to bridge this gap. It can identify links that exist only after JavaScript execution. This exposes a different type of "neverb" link: one that exists for users but is invisible to legacy crawlers, highlighting critical discrepancies in how search engines might index the site versus how users experience it.
Link Pathways and Integrity
Beyond the status of the destination, Screaming Frog 18.4 analyzes the integrity of the link pathway itself. The software’s enhanced ability to detect redirect chains, loops, and broken links (404s) serves as a diagnostic tool for site health.
A link that redirects multiple times before reaching a destination is a "leaky" link, bleeding equity and slowing user experience. The tool visualizes these chains, allowing webmasters to flatten the architecture. Furthermore, the detection of temporary redirects (302s) versus permanent ones (301s) reveals the webmaster's intent. A 302 redirect implies a "temporary" link, a "neverb" state where the destination is not meant to replace the origin permanently, yet search engines often treat 302s as 301s over time. Screaming Frog brings these nuances to the forefront, allowing for precise correction of link equity flow.
The SEO Implications of Granular Link Analysis
The detailed link analysis provided by Screaming Frog 18.4 transforms SEO strategy from reactive to proactive. By exposing the "neverb" links—those blocked, broken, or nofollowed—SEOs can make informed decisions about site architecture.
For instance, the "Internal" tab within the software allows users to filter by "Indexability." This view instantly segregates the "neverb" links from the indexable ones. An SEO can quickly discern if a site’s internal linking structure is wasting crawl budget on pages that should not be indexed, or if vital "money pages" are inadvertently cut off from link equity due to a stray nofollow attribute.
Moreover, the ability to extract custom data via XPath or CSS selectors allows for the extraction of link attributes that standard crawlers miss, such as specific tracking parameters or data-layer attributes. This turns the tool into a custom link auditor, capable of verifying if affiliate links are properly marked with rel="sponsored" or ugc, ensuring compliance with modern search engine guidelines.
Conclusion
Screaming Frog SEO Spider 18.4 represents a maturation in crawling technology, shifting focus from mere discovery to deep semantic analysis of hyperlink states. By rigorously parsing the difference between existing links and functional links, the software illuminates the shadowy corners of web architecture—the "neverb" links that silently sabotage SEO performance. Whether through the detection of JavaScript-rendered discrepancies, the visualization of redirect chains, or the categorization of indexability blocks, version 18.4 provides the necessary toolkit for the modern SEO professional. In an era where search engine algorithms prioritize site quality and technical integrity, understanding the full spectrum of link behavior is not just an advantage, but a necessity.
4. Is Screaming Frog 18.4 right for your “neverb link” task?
If your goal is to find links that will never be followed or indexed (i.e., nofollow + blocked + broken + orphaned), then yes:
-
Crawl with JavaScript rendering enabled (to catch modern links)
-
Apply filter:
Status Code not in (200, 301, 302)+External=Nofollow- Or use Custom Search → Extraction →
//a/@hrefand check response codes
-
Export → upload to Google Sheets for manual review.
Step 1 – Limiting the Crawl to Exactly 184 URLs
To perform a "184 neverb link" audit:
- Mode: Choose "List" mode (not "Spider" or "Crawl").
- Upload a CSV: Create a list of exactly 184 URLs you suspect may be blocked—but want to verify they are not.
- Limit Settings: Go to Configuration > Spider > Limits.
- Set "Max URLs to crawl" to 184.
- Enable "Stop crawl at limit".
Why 184? In many SEO workflows, 184 represents a sample size of 10% from a 1,840-page site—large enough for statistical significance but small enough for a manual link audit.
2. How to generate a "Never Linked" URLs report (Screaming Frog 184)
Key capabilities in 18.4
| Feature | Description | |--------|-------------| | Crawl limit | Unlimited (free version caps at 500 URLs) | | Protocols | HTTP/2, HTTPS, custom headers, cookies, forms | | Rendering | Text mode, JavaScript (Chromium headless), or both | | Link analysis | Internal/external, nofollow, sponsored, UGC, redirected, broken | | Data export | CSV, XLSX, SQLite, Google Sheets, API |
Direct report path (version 18.4):
Reports > Internal > Orphan Pages (URLs with 0 internal inlinks)
This exports a CSV with:
- URL
- Inlinks Count
- Status Code
- Depth
Technique A: Using Screaming Frog’s robots.txt Tester
Never-blocked links often arise because of typos in robots.txt. To check:
- Download the
robots.txtof your site. - In Screaming Frog, go to Tools > Robots.txt Tester.
- Enter a sample URL from your 184 list.
- If the tester says "Allowed" but you intended "Disallowed", that URL is a never-blocked link.