OMERO 5.1.4 Fiji Plugin behaviour vs Java heap space usage

[rhamedy]

Hi guys,

We are thinking of replacing our network drive (storing images) with an OMERO server (as image repository) and I wanted to do a bit of analysis to find out how OMERO 5.1.4 plugin for Fiji behave when opening Images from OMERO rather than a network drive.

I configured the jstatd in our server and connect Java VisualVM to monitor both server performance as well as client performance of Fiji in OSX El Capitan (running Java 1.8).

I figured out that every time I open images via OMERO 5.1.4 plugin in Fiji, the Java heap space usage keeps rising (I have a 10 GB Ram and 8 threads Fiji settings) until the upload finishes. Once the upload finished, the Java heap space usage stays the same (does not drop) and as soon as I open another image via OMERO 5.1.4 plugin, then Java heap space usage keeps rising again ... see the rises underlined with a line (marked as A).

ImageJ 1.50d

Screen Shot 2015-11-06 at 15.35.42.png (148.17 KiB) Viewed 1912 times

When opening images (located in network drive) from the file menu of Fiji app, the Java heap space usage keeps rising until upload is completed. Once the upload is complete then it stays steady (even if you close the image windows, etc.) and as soon as you try to upload another image (from network drive directly to Fiji) there is a sudden drop (marked as C - circles) in usage of the Java heap space and I believe that is the garbage collection. This drop happens nearly every time a new image is uploaded to Fiji directly from network drive, meaning that probably garbage collection is triggered when starting new upload. The same is not true if you open images via the OMERO plugin from OMERO server, there is no sudden drop except for when the Java heap space usage reaches nearly 8.x GB (marked as B).

I started doing this comparison after someone said that their Fiji slows down after 30 minutes of work on it. I just wanted to know how the garbage collection takes place when images are opened via the OMERO plugin in Fiji?

I used tiff files of size 2.x to 6.x GB in size.

Note: Opening a 6.x GB file directly in Fiji give exception shown below (Probably because not enough memory). Opening the same 6.x GB images stored in OMERO server via OMERO 5.1.4 plugin to Fiji works fine.

Importing 6.x GB tiff to Fiji

Screen Shot 2015-11-06 at 12.24.55.png (119.65 KiB) Viewed 1912 times

[dgault]

Hi Raf,

Thanks for the detailed report and information. This is an issue which we have been investigating recently as we had seen reports of similar behaviour. The root cause was due to a memory leak when viewing composite images, in short when the image window was closed and garbage collection called the image data was still being referenced.

I have submitted a fix for this to Image J and it will be included in the latest ImageJ daily build (1.50e18).
You can view the relevant changes here: https://github.com/imagej/imagej1/commi ... f5de13ce1e

Thanks again for the feedback and hopefully this will resolve your issues going forward.
David Gault

[rhamedy]

Hi David,

Thank you for the quick fix. What you explained makes perfect sense, it was unfair to blame the GC for this.

Raf.