Can I hide ads for Googlebot so it loads my site faster?
I have ads which load sometimes slower, I want to hide those ads for Googlebot. I plan to hide that ad code for googlebot only and show them only to users.
googlebot
Stop googlebot crawling URL more than once?
I have a site that usually creates a few thousand pages a day, which don’t change after they have been created. Recently my dedicated server has crashed due to googlebot crawling the site too often. According to the search console, many days googlebot crawls the site tens of thousands of times a day, indicating they keep crawling pages they already crawled. I am aware I can limit the googlebot crawl rate, but is it possible to force googlebot to crawl a page ONCE and ONCE only?
Can Google crawl dynamic structured data added in a window.onload() event?
I inject some JSON-LD into a page dynamically via Javascript, when I test the page using Google’s Structured Data Testing Tool, the expected output appears and I can see the Product Element is rendered.
Google live test can’t load AngularJS XHR resources due to CORS policy
I implemented my website using AngularJs, It works correctly on any browsers and locations I’ve tested.
Although they claimed that Google Search Engine sees exactly what modern browsers display, my website not indexed correctly.
Will I get penalized by Google for cloaking if I redirect mobile users to a sub domain?
I have a website https://example.com which is responsive but it came a time where it displays too much text. So I decided to create a progressive web application version and would like to deploy it lets say in https://m.example.com.
How to resolve Google “Indexed, though blocked by robots.txt” warning for a user login protected page?
Or, in other words, how can I tell google this is a user login protected page?
Google is ignoring meta tags and robots.txt
I have the following meta tags on my website (dev server):
GoogleBot doing POST requests
Why has GoogleBot started last Friday to do POST-requests on a page. I can see in the logfile (just an example, had about 10.000 entries over the weekend – the url in the log is changed):
How exactly does GoogleBot discover internal search result pages?
I know internal search result pages can be indexed sometimes but what I don’t get is how it is crawled? Crawler only crawls links. Does that mean that someone would have to link to an internal search result page to get it indexed?
Is possible to prevent third-party links to web page from appearing in Google Search results?
We have a situation in which a sensitive website is blocked from being crawled using a robots.txt file. This works well, however the problem is that for a period of time the team used semantic urls in which /sensitive-stuff-are-leaked-through-the-very-url.