OMERO 5.1.4 Fiji Plugin behaviour vs Java heap space usage
Posted: Fri Nov 06, 2015 4:28 pm
Hi guys,
We are thinking of replacing our network drive (storing images) with an OMERO server (as image repository) and I wanted to do a bit of analysis to find out how OMERO 5.1.4 plugin for Fiji behave when opening Images from OMERO rather than a network drive.
I configured the jstatd in our server and connect Java VisualVM to monitor both server performance as well as client performance of Fiji in OSX El Capitan (running Java 1.8).
I figured out that every time I open images via OMERO 5.1.4 plugin in Fiji, the Java heap space usage keeps rising (I have a 10 GB Ram and 8 threads Fiji settings) until the upload finishes. Once the upload finished, the Java heap space usage stays the same (does not drop) and as soon as I open another image via OMERO 5.1.4 plugin, then Java heap space usage keeps rising again ... see the rises underlined with a line (marked as A).
When opening images (located in network drive) from the file menu of Fiji app, the Java heap space usage keeps rising until upload is completed. Once the upload is complete then it stays steady (even if you close the image windows, etc.) and as soon as you try to upload another image (from network drive directly to Fiji) there is a sudden drop (marked as C - circles) in usage of the Java heap space and I believe that is the garbage collection. This drop happens nearly every time a new image is uploaded to Fiji directly from network drive, meaning that probably garbage collection is triggered when starting new upload. The same is not true if you open images via the OMERO plugin from OMERO server, there is no sudden drop except for when the Java heap space usage reaches nearly 8.x GB (marked as B).
I started doing this comparison after someone said that their Fiji slows down after 30 minutes of work on it. I just wanted to know how the garbage collection takes place when images are opened via the OMERO plugin in Fiji?
I used tiff files of size 2.x to 6.x GB in size.
Note: Opening a 6.x GB file directly in Fiji give exception shown below (Probably because not enough memory). Opening the same 6.x GB images stored in OMERO server via OMERO 5.1.4 plugin to Fiji works fine.
We are thinking of replacing our network drive (storing images) with an OMERO server (as image repository) and I wanted to do a bit of analysis to find out how OMERO 5.1.4 plugin for Fiji behave when opening Images from OMERO rather than a network drive.
I configured the jstatd in our server and connect Java VisualVM to monitor both server performance as well as client performance of Fiji in OSX El Capitan (running Java 1.8).
I figured out that every time I open images via OMERO 5.1.4 plugin in Fiji, the Java heap space usage keeps rising (I have a 10 GB Ram and 8 threads Fiji settings) until the upload finishes. Once the upload finished, the Java heap space usage stays the same (does not drop) and as soon as I open another image via OMERO 5.1.4 plugin, then Java heap space usage keeps rising again ... see the rises underlined with a line (marked as A).
When opening images (located in network drive) from the file menu of Fiji app, the Java heap space usage keeps rising until upload is completed. Once the upload is complete then it stays steady (even if you close the image windows, etc.) and as soon as you try to upload another image (from network drive directly to Fiji) there is a sudden drop (marked as C - circles) in usage of the Java heap space and I believe that is the garbage collection. This drop happens nearly every time a new image is uploaded to Fiji directly from network drive, meaning that probably garbage collection is triggered when starting new upload. The same is not true if you open images via the OMERO plugin from OMERO server, there is no sudden drop except for when the Java heap space usage reaches nearly 8.x GB (marked as B).
I started doing this comparison after someone said that their Fiji slows down after 30 minutes of work on it. I just wanted to know how the garbage collection takes place when images are opened via the OMERO plugin in Fiji?
I used tiff files of size 2.x to 6.x GB in size.
Note: Opening a 6.x GB file directly in Fiji give exception shown below (Probably because not enough memory). Opening the same 6.x GB images stored in OMERO server via OMERO 5.1.4 plugin to Fiji works fine.