Google: Noindexed Pages Do Not Effect Crawl Budget

Posted by

Google’s Search Relations group verifies that noindexed pages do not negatively impact a website’s crawl budget, no matter how many a site has.

This topic is attended to not once but thrice throughout the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Search Supporters John Mueller and Gary Illyes take turns answering three similar questions from individuals concerned they have a lot of noindexed pages on their websites.

From Mueller’s and Illyes’ reactions, we learn there’s no such thing as “a lot of” indexed pages. Even more, unless your website has over a million pages, there’s no requirement to worry about crawl spending plan.

Here’s a quick wrap-up of each question and response.

Question 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a question asking if an “extreme” variety of indexed pages is a concern for discovery or indexed.

Illyes states noindex is a tool to assist sites keep material out of online search engine. Google motivates utilizing the noindex tag when needed, and because of that, there are no unfavorable impacts connected with it.

“Noindex is an extremely effective tool that online search engine support to help you, this site owner, keep material out of their indexes. For this reason, it doesn’t carry any unintended impacts when it comes to crawling and indexing. For instance, having numerous pages with noindex will not affect how Google crawls and indexes your site.”

Concern 2: Ratio Of Indexed/Noindexed Pages

The following concern shows up at the 10:22 mark:

“Should we watch on the ratio between indexed and non-indexed pages in Browse Console in order to better recognize possibly lost crawl budget on non-indexed pages?”

Mueller exposes that websites must attempt to balance their indexed and nonindexed pages.

To that end, crawl budget is an element that few sites require to think of; Mueller says:

“No, there is no magic ratio to look out for. Likewise, for a website that’s not enormous, with less than a million pages, perhaps, you truly don’t need to stress over the crawl budget of your site. It’s fine to remove unneeded internal links, but for little to medium-sized sites, that’s more of a website health subject than an SEO one.”

Question 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a concern comes up about no indexed pages that’s a little various from the previous two.

The concern checks out:

“A lot of SEOs are complaining about having countless URLs flagged as excluded by noindex in Google Browse Console. All to nonsense internal search pages connected from spammy sites. Is this a problem for crawl budget?”

Ilyes reiterates the earlier point about noindex being a tool for sites to utilize as required.

Assuming the pages are intentionally noindexed, there’s no requirement to stress over Browse Console flagging them. It doesn’t suggest you’re doing anything incorrect.

Illyes states:

“Noindex is there to help you keep things out of the index, and it does not come with unintentional negative results, as we said previously. If you wish to ensure that those pages or their URLs, more particularly, don’t end up in Google’s index, continue utilizing noindex and do not worry about crawl budget.”

Source: Google