Page 1 of 1

UNREADABLE_FILE error for Dropbox

PostPosted: Thu Sep 22, 2011 2:03 am
by heidip
Hi,
I'm having some troubles uploading my files using DropBox...

I've got the Dropbox settings in templates.xml set up as follows (the default):
Code: Select all
<property name="omero.fs.importUsers"  value="default"/>
        <property name="omero.fs.watchDir"  value=""/>
        <property name="omero.fs.eventTypes"  value="Creation,Modification"/>
        <property name="omero.fs.pathMode"  value="Follow"/>
        <property name="omero.fs.whitelist"  value=""/>
        <property name="omero.fs.blacklist"  value=""/>
        <property name="omero.fs.timeout"  value="0.0"/>
        <property name="omero.fs.timeToLive"  value="0"/>
        <property name="omero.fs.timeToIdle"  value="600"/>
        <property name="omero.fs.blockSize"  value="0"/>
        <property name="omero.fs.ignoreSysFiles"  value="True"/>
        <property name="omero.fs.ignoreDirEvents"  value="True"/>
        <property name="omero.fs.dirImportWait"  value="60"/>
        <property name="omero.fs.readers"  value=""/>
        <property name="omero.fs.importArgs"  value=""/>
    </properties>


I've got a user with username user, and a folder in OMERO/DropBox called user

After setting up the user folder I restarted omero, and checked the log files, they all semed ok and the folder was being monitored.

Then I used WinSCP to copy a .tif file to the user folder.
My DropBox.log says:
Code: Select all
2011-09-22 11:30:54,574 INFO  [                            omero.remote] (Dummy-5   )  Meth: MonitorClientI.fsEventHappened
2011-09-22 11:30:54,575 INFO  [         fsclient.fsDropBoxMonitorClient] (Dummy-5   ) EVENT_RECORD::Cookie::1316655054.58::Batch::1
2011-09-22 11:30:54,575 INFO  [         fsclient.fsDropBoxMonitorClient] (Dummy-5   ) EVENT_RECORD::Cookie::1316655054.58::Create::/OMERO/DropBox/user/20090114 - 6-OHDA  SN1 TH. GFAP.1.D.6 ST - 398 convert_Alexa 594 mod.tif.filepart
2011-09-22 11:30:54,591 INFO  [                            omero.remote] (Dummy-5   )  Rslt: None
2011-09-22 11:30:59,669 INFO  [         fsclient.fsDropBoxMonitorClient] (Thread-3  ) Processing 1 events (1 ids). 0 remaining
2011-09-22 11:30:59,670 INFO  [         fsclient.fsDropBoxMonitorClient] (Thread-3  ) Getting filesets on : set(['/OMERO/DropBox/user/20090114 - 6-OHDA  SN1 TH. GFAP.1.D.6 ST - 398 convert_Alexa 594 mod.tif.filepart'])
2011-09-22 11:31:00,861 INFO  [         fsclient.fsDropBoxMonitorClient] (Thread-3  ) EVENT_RECORD::Cookie::1316655060.86::Filesets::{}


And the master.err says:
Code: Select all
2011-09-22 11:31:00,400 0          [      main] INFO          ome.formats.importer.ImportConfig  - OMERO Version: 4.3.1-6d4b8c61-b2602
2011-09-22 11:31:00,408 8          [      main] INFO          ome.formats.importer.ImportConfig  - Bioformats version: 4.3.1 revision: 27e733b date: 7 July 2011
2011-09-22 11:31:00,416 16         [      main] INFO   formats.importer.cli.CommandLineImporter  - Log levels -- Bio-Formats: ERROR OMERO.importer: INFO
2011-09-22 11:31:00,853 453        [      main] INFO      ome.formats.importer.ImportCandidates  - Depth: 4 Metadata Level: MINIMUM
2011-09-22 11:31:00,855 455        [      main] ERROR     ome.formats.importer.cli.ErrorHandler  - UNREADABLE_FILE: /OMERO/DropBox/user/20090114 - 6-OHDA  SN1 TH. GFAP.1.D.6 ST - 398 convert_Alexa 594 mod.tif.filepart
java.io.FileNotFoundException: /OMERO/DropBox/user/20090114 - 6-OHDA  SN1 TH. GFAP.1.D.6 ST - 398 convert_Alexa 594 mod.tif.filepart
   at ome.formats.importer.ImportCandidates.singleFile(ImportCandidates.java:398)
   at ome.formats.importer.ImportCandidates.handleFile(ImportCandidates.java:595)
   at ome.formats.importer.ImportCandidates.execute(ImportCandidates.java:371)
   at ome.formats.importer.ImportCandidates.<init>(ImportCandidates.java:229)
   at ome.formats.importer.ImportCandidates.<init>(ImportCandidates.java:180)
   at ome.formats.importer.cli.CommandLineImporter.<init>(CommandLineImporter.java:80)
   at ome.formats.importer.cli.CommandLineImporter.main(CommandLineImporter.java:394)
2011-09-22 11:31:00,857 457        [      main] INFO      ome.formats.importer.ImportCandidates  - 1 file(s) parsed into 0 group(s) with 0 call(s) to setId in 0ms. (5ms total) [0 unknowns]


I'm not sure why I'm getting an unreadable_file error in mater.err, and when I login to omero.webclient as 'user' there are no images in Orphaned images.

Anyone have any ideas? Or am I missing something with my config?

Cheers,
Heidi

Re: UNREADABLE_FILE error for Dropbox

PostPosted: Thu Sep 22, 2011 6:10 am
by jmoore
Hi Heidi,

the name of the file that's failing from master.err is "...Alexa 594 mod.tif.filepart" which will be a temporary file created by wincp during copying. After the copy is finished, the "*.filepart" file should be moved to "...Alexa 594 mod.tif". Does that show up in your logs at all? I would think that once the copy is finished, that the "*.tif" file would get picked up by DropBox and that the image would show up in your account.

Nevertheless, we should prevent DropBox from looking at such files. I've added ticket 6834 for that work.

Thanks for letting us know!
~Josh.