Does an extension is avalaible to display the number of images by album inside the gallery ?

No, but there are methods and functions available to get the count of images in an album itself. Using the object model you could build something to display the full tree. Besides the print_album_menu plugin also has an option to display the image number and subalbum number of an album.

Thanks Acrylian.