How deep search engine spider crawls when it comes to link?
- SEO |
Hi Everybody,
I have always in my mind about above question when I started doing SEO but still now I have not satisfied with answers.
Suppose let say spider reaches a link X and X has 50000 links. So my questions are:
How many links will it crawl?
Is it able to crawl all 50000 links?
Is there any speed rate for the spider?If yes then what are the major factor may affect the speed of the spider?
What need to be done to make the spider crawl all the links?
Any replies or ideas of suggestion is a great learning for me as well as for the community.
Regards
Kalu
I have always in my mind about above question when I started doing SEO but still now I have not satisfied with answers.
Suppose let say spider reaches a link X and X has 50000 links. So my questions are:
How many links will it crawl?
Is it able to crawl all 50000 links?
Is there any speed rate for the spider?If yes then what are the major factor may affect the speed of the spider?
What need to be done to make the spider crawl all the links?
Any replies or ideas of suggestion is a great learning for me as well as for the community.
Regards
Kalu