Open Microscopy Environment

Hi,

I have a question about multiple connections with the same account.

I was importing a 1,000 image batch to OMERO server using 'import' command from omero shell.
for each image importing, my custom bridge submits a python function job into queue.
this python function connects to OMERO server using the same account by

Code: Select all

conn = BlitzGateway(ID, PW, host='localhost', port=int(14064))
conn.connect()

Then this function does the following things
1. do some calculation
2. creates a new OMERO.table (linking to the image)
3. updating a global OMERO.table

after this process is done,
-only 979 images have attached OMERO.table (4 of them have an empty OMERO.table)
-only 892 images are updated to the global OMERO.table

my guess is....
If I submit a job into a queue, there might be multiple connections with the same account. Does this causes any problem?

If I do not use a queue manager and do the process one by one, then everything looks good (even though it takes longer time).

Best,
BK

bhcho wrote:If I submit a job into a queue, there might be multiple connections with the same account. Does this causes any problem?

Multiple connections from one account is fine, but there is a limit to how many connections can be made in a very short period of time. You may have to add a small delay or a retry to let them all connect. Are you seeing any exceptions?

Also, you can share the session, if you'd like, and just use multiple processes; but 1000 simultaneous processes is very likely going to be too much power. Try 4 or 8.

Cheers,
~Josh.