Re: What is RabbitMQ for?

[ayleph]

Here's some more information for the curious.

https://issues.mediagoblin.org/ticket/5464#comment:5

On 5/14/20 8:51 AM, ayleph wrote:
> After Celery dropped support for SQLite, they made RabbitMQ the default
> broker. So that's probably the easiest to use. If someone's more
> familiar with Redis, they can use that instead.
> 
> On 5/13/20 7:35 AM, Amelia Rose Khan wrote:
>> Would there be a better message queue to use?
>>
>> On Wed., May 13, 2020, 10:28 Christopher Lemmer Webber,
>> <address@hidden <mailto:address@hidden>> wrote:
>>
>>     RabbitMQ is a message queue which can speak to Celery (which processes
>>     the media).
>>
>>     By default and for simplicity's sake, MediaGoblin by default uses
>>     sqlite as kind of hacky but easy to set up queue... the main advantage
>>     of it is that it prevents the need to run one more daemon.  The
>>     disadvantage is that it really isn't a good message queue.
>>
>>
>>     Olivier Mehani writes:
>>
>>     > Hey there,
>>     >
>>     > There is something that I never quite manage to put my finger on.
>>     >
>>     > What is RabbitMQ needed for?
>>     >
>>     > It is mentioned in the deployment guide [0] as an option for
>>     > production servers, but it's not clear what for.
>>     >
>>     > I do run celery separate from paster, and all has been working quite
>>     > well despite the absence of RabbitMQ.
>>     >
>>     > I have, however, had a recuring problem of the uploads sometimes
>>     > choking on a locked (SQLite) DB when I upload a few files in a row. I
>>     > am now wondering if RabbitMQ would actually make this issue disappear
>>     > by, perhaps, serialising the requests so they get processed once at a
>>     > time?
>>     >
>>     > [0]
>>     https://mediagoblin.readthedocs.io/en/stable/siteadmin/deploying.html
>>
>>
> 

-- 
ayleph