Zenphoto's Large Scalability

Have anyone scale Zenphoto to include millions of photos? Last time I tried Pre-Caching Images, my Core 2 Duo computer lags for 1 hour processing around 300 photos. I'm running Firefox 3 and all the Zenphoto servers are on the same computer.

Can Zenphoto handle a Flickr-like networking site with millions of photos?

Is there an easy way to register users? I can't seem to find it, I know I can manually add users. Maybe this is a plugin?

Comments

  • Connie Member
    aren't you a little megalomaniac?

    If you are really planning such a big application, you would know about the capability of databases, scalability of servers, and you could differ between a normal pc and a real strong multi-processored server ;=)
  • acrylian Administrator, Developer
    Actually Zenphoto is mainly filesystem based, so please read here: http://www.zenphoto.org/2007/12/installation-and-upgrading/#6
    Depending on the size of your original images, precaching of course could take some time. This also depends on your servers speed.

    No, there is no way for users to register themselves and it's not planned either.
  • LOLsim Member
    Yes, I am a megalomaniac. I mean, if some Core 2 Duo can't even handle processing a few hundred images in 1 hour, it's not scalable enough. Maybe it's running on single core, I don't know.

    Oh, by the way, these are 2MB+ images.

    Thanks for answering my questions, though. Still love Zenphoto.
  • trisweb Administrator
    I still (still) do not understand the obsession with pre-caching around here.

    With a gallery of a million images, you surely would not even want to process them all at once, ever, on any system, regardless of its capabilities. That would be absurd.

    Better to leave them be, let the gallery work as it is, and process them when they're first requested. For users, this will mean a very slight delay the first time an image is *ever* viewed, and absolutely none after that. This is how Zenphoto is designed to work, and I think how it works best. No need to pre-cache anything, just quit worrying about the initial lag from the first processing, it only happens once.

    In a case like that, Zenphoto will shine. Organize your albums effectively (speed will be proportional to the number of images in any one album) and it will scale to a million and beyond. I have tested this personally.
  • Connie Member
    Who on earth will present 2MB-sized photos on a website in a gallery?

    Your visitors will be very happy...
  • trisweb Administrator
    Agreed, it's in your best interest to scale down the images for web viewing. The file size doesn't matter, only the pixel dimensions. Cut it down to 1600x1200 or lower or of *course* processing will take forever.

    I still contest - It's not that it's not scalable enough, you just have the wrong expectation. Zenphoto was designed to lazy-load images to allow a gallery of unlimited size while still allowing viewing any image at any time regardless of whether it has been processed or not. It does it on the fly. It was not designed to process them all at once, the pre-caching was a hack that was added on later.
  • LOLsim Member
    I don't really understand how Zenphoto works. So sorry about that.

    So, now I only had to make sure albums don't contain too many photos. No matter how many albums, it'll still be fast and scalable?

    Now I understand more, thanks for explaining it to me. Loving Zenphoto more and more.
  • Connie Member
    If you really want to administrate so big amounts of images (not big images) and many users, you should find out whether Gallery4 or Menalto etc. are able to do this

    and keep your personal portfolio with zenphoto!
  • I think the key thing here is to simplify. That's what zenphoto is about.

    Unfortunately I deteste having to create a separate folder, run some utility to batch convert all my pictures to a smaller resolution and then upload it and then remember to delete them after I'm done. It's an extra step that makes me not want to upload albums.

    For me I don't mind the server taking an hour to precache because I hate resizing even more. And I precache because I don't like the lag time because my original files are big (again not an issue if wasn't so darn large).

    What could be done is if there was a separate project for an uploader function for zenphoto. I'm taking this from using Walmart or similar online printing websites where they make you run this application to upload and submit the files to them. Something like a java application (for more os compability) or some activex application where you can select and upload your images. Then select the folder or images you wish to upload, and hit the upload button. From there the java/activex application will resize and upload the files to zenphoto. This will reduce the sizes of both resolution and filesize making zenphoto able to do the initial caching in real-time when it is first requested without too much lag time.

    Just throwing it out there! :)
  • Also I forgot to mention that I think I added code to cache the next image automatically in my theme. So zenphoto is always one step ahead of the user in loading time if I didn't pre-cache.
  • willamz: <QUOTE> I'm taking this from using Walmart or similar online printing websites where they make you run this application to upload and submit the files to them.

    Use FTP and you can upload all you want :) You're not restricted to using ZP's upload feature.
  • macalter: You're missing the point, the whole thing is to reduce the workload of the server and the suggestion is to reduce the sizes of the files prior to upload. And to follow the traits of zenphoto of simplicity, I'd rather not resize my photos because it's just so tedious. So if there was a client-based java or web application that can process the images client-side before the upload then it would help immensely by doing the process on the client side and take the tedious task of the user manually resizing them out of the way as well!
  • Connie Member
    There are a lot of client side applications to process images, and many of them are free and there is no reason why this must be part of a server-side application ;=)

    just use irfanview in batchmode and you get everything you want:

    resize, 72 dpi, saving in 80% quality, sharpening a little bit ... and the results are perfect, much more perfect than a gd-lib- or image-magick-treatment ;=)

    I am not sure why everybody wants to re-invent the wheel and to make apps, which are ment to be simple and handy, monsterous and not handy ;=(
  • Nick Member
    72 dpi? it doesn't matter what you set the dpi (ppi) to your monitor and browser ignore it
  • code Member
    I have a 10MP camera, I upload the full sizes and use "No Access" to help protect them. I dont have millions of pictures. I do use pre-cache, but I really dont care. I could let them get cashed on their own I really dont care. I dont see the point. Let it happen natually if you have a problem with it...
  • acrylian Administrator, Developer
    72 dpi? it doesn't matter what you set the dpi (ppi) to your monitor and browser ignore it
    That is actually correct, dpi/ppi is absolutly unimportant, the actual pixel dimensions matter.
Sign In or Register to comment.