This is probably because you have random album thumbs set. If these are not already cached they will be generated and depending on the full image size and your server that might slow down. Try to set a fixed album thumbnail so that not every time a new one needs to be used.
The tags should not be the issue, but there is static_html_cache plugin you might want to try.