Home› General support

google sitecrawling/indexing

levista Member
in General support
How does everyone else find google's ability to index all their pages? Good? Bad?

My site has been live about a fortnight, i have promoted it fairly well (early days yet) and while the number of pages google has indexed is increasing (as seen in webmaster tools) out of say 70 currently indexed pages, only ONE is the final destination eg

http://www.site.com/gallery/cats/wallpaper/wallpaper-21.jpg.php

the rest of the indexed pages are the catagory/folder pages eg

http://www.site.com/gallery/cats/
http://www.site.com/gallery/dogs/
http://www.site.com/gallery/monkeys/
http://www.site.com/gallery/sharks/

There is well over a thousand final destination pages on my site, seeing only one indexed is very disheartening.

Hoping the issue is just due to the sites newness. Whats everyone elses experience of this? Anybody have/had a similar problem? i would have thought zenphoto would be the easiest thing on earth to crawl around with its ease of navigation.

Comments

  • sbillard Member
    Did you setup the robots file? See the example file in the root folder. Sometimes Google will not index pages which it thinks are not unique.
  • levista Member
    from what i read if i dont have one then everything in the site is "fair game" for indexing. so why would it not be happeneing..? (yet?)
  • sbillard Member
    Because pages which appear multiple times often get invalidated by the web crawlers and do not show up in the indices.
  • treebonker Member
    I took a look at the example_robots.txt file.

    Wouldn't disallowing the /cache and /album folders prevent google's image bot from indexing the thumbnails and images?
  • kjtooke Member
    Is mod_rewrite required to get 'googled'...?
Sign In or Register to comment.