.Google.com's Gary Illyes exposes Googlebot gathers hyperlinks as opposed to "complying with" them, negating formal records.Googlebot accumulates web links as opposed to observing them in real-time.Gary Illyes discussed this information in Google.com's 'Explore Off The Report' podcast.Google's paperwork negates the true spider habits.