Home› General support

robots.txt not created

harootun Member
in General support
I recently moved my site to another server, and when I run the setup, it doesn't create a robot.txt file. is there any advice on what to do to create one? Can I hack one together myself? What folders, by default, should be protected using robots.txt in zenphoto?

Comments

  • kagutsuchi Member
    If setup.php cannot create the robots.txt for you, you can simply take `example_robots.txt` from the `zp-core` folder and use that. You'll need to follow the directions in the example to get it working correctly.
  • reneesanguinetti Member
    Hello,
    I have a question concerning my robots.txt file.
    First of all I have created a site example.example.com. Also I have example.example.com/example and example.example.com/example1. There is an installation of Zenphoto in each sub-album and a robots.txt file in each that was automatically created with the installation.

    I left these robots files in the sub-albums, but I thought THE robots.txt file needs to be located in the root directory (example.example.com). So I created a single file including all the lines for the folders of both sub-albums.

    I was wondering if someone could take a look at the actual file to see if it is constructed properly and let me know if I have put it in the correct location?
    'http://gallery.original-vintage-ads.com/robots.txt'

    Google has not indexed any pages of either sub-album according to the Webmasters Tools, so I thought there may be a problem with my robots file.

    Any information would be greatly appreciated.
    Thank-you!
  • acrylian Administrator, Developer
    "sub albums"? You probably mean sub folders???

    A robots.txt file should always and only be in the root of your installation/site. If you have several sites with independend domains one should be in the root of each of those sites. But if all are just in folders one in the root should do it. All info about these files on http://www.robotstxt.org/
  • reneesanguinetti Member
    Yes, I did mean sub folders. Just one more quick question. Why is an "album" disallowed in the robots file when that is where my images are located?
    Thank-you!
  • acrylian Administrator, Developer
    Because in the "albums" folder are the full images, the sized ones that actually are displayed on the theme (thumbs etc) are in the "cache" folder. No need to scan the images itself, as Zenphoto does not directly point to those albums.
  • reneesanguinetti Member
    Ok. Then does that mean I Should "allow" the cache? Because in the example_robots.txt. from the zp-core folder, the cache is "disallowed". Which is what I have put in my robots file.
  • sbillard Member
    You need to review the link acrylian gave you. The robots file is to "direct" robots that are discovering WEB pages. In the Zenphoto case those are typically the URLS that link to the gallery, album, and image pages. NONE of the folders involved in the zenphoto installation itself should be considered as WEB pages, thus the example file disallows them.
  • reneesanguinetti Member
    Thank-you! I believe I may have jumped the gun with my last question. I read the answer over again. Just confused myself a little.
Sign In or Register to comment.