On our Zeiss Axioscan slide scanner, we generate very large images (50k by 60k pixels in 4 fl. colors). Understood that the default jpeg-xr compression in Zeiss's CZI is not supported in BioFormats, I tried exporting the files as OME-Tiffs using the BIGTIFF checkbox checked and Stitching on. The resulting file is large (20+ GB) and I tried to use the CLI importer to import into OMERO 5.1.4. In the Pixel-Data.log at first it all looks good but then there's a NullPointer exception:
2015-10-03 12:22:24,066 INFO [ ome.io.nio.FilePathResolver] (2-thread-1) Metadata only file, resulting path: /data/OMERO.data/ManagedRepository/dsudar_2/2015-10/03/12-11-02.553/Stitched_NewOUtput_s1.ome.tiff
2015-10-03 12:22:24,066 INFO [ ome.io.nio.FilePathResolver] (2-thread-5) Metadata only file, resulting path: /data/OMERO.data/ManagedRepository/dsudar_2/2015-10/03/12-11-02.553/Stitched_NewOUtput_s1.ome.tiff
2015-10-03 12:22:24,088 WARN [ ome.services.pixeldata.PixelDataHandler] (2-thread-5) Pixels:312801 -- Already locked! /data/OMERO.data/Pixels/Dir-312/.312801_pyramid.pyr_lock
2015-10-03 12:22:25,072 INFO [ ome.io.nio.PixelsService] (2-thread-1) Creating BfPixelBuffer: /data/OMERO.data/ManagedRepository/dsudar_2/2015-10/03/12-11-02.553/Stitched_NewOUtput_s1.ome.tiff Series: 0
2015-10-03 12:22:25,073 INFO [ ome.io.nio.PixelsService] (2-thread-1) Destination pyramid tile size: java.awt.Dimension[width=1664,height=1232]
2015-10-03 12:22:25,074 INFO [ ome.io.nio.PixelsService] (2-thread-1) Pyramid creation for Pixels:312801 1/6888 (0%).
2015-10-03 12:22:25,774 INFO [ loci.formats.in.MinimalTiffReader] (2-thread-1) Reading IFDs
2015-10-03 12:22:25,776 INFO [ loci.formats.in.MinimalTiffReader] (2-thread-1) Populating metadata
2015-10-03 12:22:25,844 INFO [ loci.formats.in.JPEG2000MetadataParser] (2-thread-1) Unknown JPEG 2000 box 0x2900 at 28002
2015-10-03 12:22:25,845 INFO [ loci.formats.in.JPEG2000MetadataParser] (2-thread-1) File is a raw codestream not a JP2.
2015-10-03 12:22:25,854 INFO [ loci.formats.in.TiffReader] (2-thread-1) Checking comment style
2015-10-03 12:22:25,856 INFO [ loci.formats.in.BaseTiffReader] (2-thread-1) Populating OME metadata
2015-10-03 12:22:28,922 ERROR [ ome.services.pixeldata.PixelDataHandler] (2-thread-1) Failed to handle pixels 312801
java.lang.NullPointerException: null
at loci.common.RandomAccessInputStream.getFilePointer(RandomAccessInputStream.java:198) ~[formats-common.jar:5.1.4]
at loci.formats.tiff.OnDemandLongArray.toArray(OnDemandLongArray.java:79) ~[formats-bsd.jar:5.1.4]
at loci.formats.tiff.TiffParser.getSamples(TiffParser.java:858) ~[formats-bsd.jar:5.1.4]
at loci.formats.tiff.TiffParser.getSamples(TiffParser.java:785) ~[formats-bsd.jar:5.1.4]
at loci.formats.in.OMETiffReader.openBytes(OMETiffReader.java:314) ~[formats-bsd.jar:5.1.4]
at loci.formats.ImageReader.openBytes(ImageReader.java:453) ~[formats-api.jar:5.1.4]
at loci.formats.ChannelFiller.openBytes(ChannelFiller.java:156) ~[formats-bsd.jar:5.1.4]
at loci.formats.ChannelSeparator.openBytes(ChannelSeparator.java:225) ~[formats-bsd.jar:5.1.4]
at loci.formats.ReaderWrapper.openBytes(ReaderWrapper.java:349) ~[formats-api.jar:5.1.4]
at loci.formats.ReaderWrapper.openBytes(ReaderWrapper.java:349) ~[formats-api.jar:5.1.4]
at loci.formats.MinMaxCalculator.openBytes(MinMaxCalculator.java:269) ~[formats-bsd.jar:5.1.4]
at ome.io.bioformats.BfPixelsWrapper.getTile(BfPixelsWrapper.java:345) ~[romio.jar:na]
at ome.io.bioformats.BfPixelBuffer.getTile(BfPixelBuffer.java:475) ~[romio.jar:na]
at ome.io.nio.PixelsService$1.run(PixelsService.java:418) ~[romio.jar:na]
at ome.io.nio.Utils.forEachTile(Utils.java:88) ~[romio.jar:na]
at ome.io.nio.Utils.forEachTile(Utils.java:39) ~[romio.jar:na]
at ome.io.nio.PixelsService.performWrite(PixelsService.java:402) ~[romio.jar:na]
at ome.io.nio.PixelsService.makePyramid(PixelsService.java:306) ~[romio.jar:na]
at ome.services.pixeldata.PixelDataHandler.process(PixelDataHandler.java:146) [server.jar:na]
at ome.services.pixeldata.PixelDataHandler.handleEventLog(PixelDataHandler.java:113) [server.jar:na]
at ome.services.pixeldata.PixelDataThread$HandleEventLog.doWork(PixelDataThread.java:246) [server.jar:na]
at sun.reflect.GeneratedMethodAccessor118.invoke(Unknown Source) ~[na:na]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_79]
at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_79]
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307) [org.springframework.aop.jar:3.0.1.RELEASE-A]
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) [org.springframework.aop.jar:3.0.1.RELEASE-A]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) [org.springframework.aop.jar:3.0.1.RELEASE-A]
at ome.services.util.Executor$Impl$Interceptor.invoke(Executor.java:566) [server.jar:na]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) [org.springframework.aop.jar:3.0.1.RELEASE-A]
at ome.security.basic.NullEventHandler.invoke(NullEventHandler.java:39) [server.jar:na]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) [org.springframework.aop.jar:3.0.1.RELEASE-A]
at org.springframework.orm.hibernate3.HibernateInterceptor.invoke(HibernateInterceptor.java:111) [org.springframework.orm.jar:3.0.1.RELEASE-A]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) [org.springframework.aop.jar:3.0.1.RELEASE-A]
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:108) [org.springframework.transaction.jar:3.0.1.RELEASE-A]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) [org.springframework.aop.jar:3.0.1.RELEASE-A]
at ome.tools.hibernate.ProxyCleanupFilter$Interceptor.invoke(ProxyCleanupFilter.java:249) [server.jar:na]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) [org.springframework.aop.jar:3.0.1.RELEASE-A]
at ome.services.util.ServiceHandler.invoke(ServiceHandler.java:121) [server.jar:na]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) [org.springframework.aop.jar:3.0.1.RELEASE-A]
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202) [org.springframework.aop.jar:3.0.1.RELEASE-A]
at com.sun.proxy.$Proxy71.doWork(Unknown Source) [na:na]
at ome.services.util.Executor$Impl.execute(Executor.java:447) [server.jar:na]
at ome.services.util.Executor$Impl.execute(Executor.java:391) [server.jar:na]
at ome.services.pixeldata.PixelDataThread.go(PixelDataThread.java:255) [server.jar:na]
at ome.services.pixeldata.PixelDataThread.access$000(PixelDataThread.java:52) [server.jar:na]
at ome.services.pixeldata.PixelDataThread$1.call(PixelDataThread.java:203) [server.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_79]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [na:1.7.0_79]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_79]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_79]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_79]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]
2015-10-03 12:22:29,000 INFO [ ome.io.nio.FilePathResolver] (2-thread-5) Metadata only file, resulting path: /data/OMERO.data/ManagedRepository/dsudar_2/2015-10/03/12-11-02.553/Stitched_NewOUtput_s1.ome.tiff
2015-10-03 12:22:29,000 INFO [ ome.io.nio.FilePathResolver] (2-thread-3) Metadata only file, resulting path: /data/OMERO.data/ManagedRepository/dsudar_2/2015-10/03/12-11-02.553/Stitched_NewOUtput_s1.ome.tiff
2015-10-03 12:25:16,036 INFO [ ome.io.nio.FilePathResolver] (2-thread-5) Metadata only file, resulting path: /data/OMERO.data/ManagedRepository/dsudar_2/2015-10/03/12-11-02.553/Stitched_NewOUtput_s1.ome.tiff
This file was 20+ GB but I'll try to create a file that gives the same error that is a little smaller. And I'll upload that to the QA system.
Thanks,
- Damir