Downloaded 16 times
![email.py
from celery.task import task
from django.core.mail import send_mail
@task
def send(subject, message, recipient_list,
from_email=None, **kwargs):
if subject[0] != "[":
subject = "[projeto] "+ subject
if from_email is None:
from_email = "suporte@fuuuuuu.com"
send_mail(subject, message, from_email,
recipient_list, **kwargs)](https://image.slidesharecdn.com/procrastinando-110711081151-phpapp02/75/Deixa-para-depois-Procrastinando-com-Celery-em-Python-31-2048.jpg)
![Map Reduce
tarefas = []
livros =["iliada.txt","odisseia.txt"....]
for filename in livros:
tarefas.append(
conta_palavras.delay(filename)
)
para pegar o resultado
if all([i.ready() for i in tarefas]):
palavras = sum([i.result for i in tarefas])](https://image.slidesharecdn.com/procrastinando-110711081151-phpapp02/75/Deixa-para-depois-Procrastinando-com-Celery-em-Python-34-2048.jpg)
![Muitas tarefas
subtasks = []
for i in algo_grande:
subtasks.append(subtask(avisa_novo, args=(i)))
TaskSet(tasks=subtasks).apply_async()](https://image.slidesharecdn.com/procrastinando-110711081151-phpapp02/75/Deixa-para-depois-Procrastinando-com-Celery-em-Python-47-2048.jpg)
![Dúvidas?
@fractal
+Adriano Petrich
[codando.com.br, sfp.adrianopetrich.com,
blog.adrianopetrich.com]](https://image.slidesharecdn.com/procrastinando-110711081151-phpapp02/75/Deixa-para-depois-Procrastinando-com-Celery-em-Python-49-2048.jpg)
Uploaded byAdriano Petrich
Deixa para depois, Procrastinando com Celery em Python
The document discusses Celery, an asynchronous task queue/job queue based on distributed message passing. It notes that Celery's key strengths are that it is an asynchronous task manager that can distribute tasks across multiple machines. It also supports scheduling, fault tolerance, and can integrate with various databases, message brokers and operating systems. The document then provides more details on how Celery works, including its use of tasks, publishers, queues, workers and consumers. It also discusses common patterns and best practices for using Celery.
More Related Content
Similar to Deixa para depois, Procrastinando com Celery em Python
![[Quase] Tudo que você precisa saber sobre tarefas assíncronas](https://cdn.slidesharecdn.com/ss_thumbnails/tarefasasincronas-170505123700-thumbnail.jpg?width=640&height=640&fit=bounds)
![Coded Agents – with UiPath SDK + LangGraph [Virtual Hands-on Workshop]](https://cdn.slidesharecdn.com/ss_thumbnails/codedagentsdeck-251215155422-5497c599-thumbnail.jpg?width=640&height=640&fit=bounds)
Deixa para depois, Procrastinando com Celery em Python
- 1. Procrastinando com Celery . adrianopetrich petrich@gmail.com #TDC2011
- 2. O que éo Celery?
- 3. Ponto forte doCelery • Gerenciador de tarefas assíncrono
- 4. Ponto forte doCelery • Gerenciador de tarefas assíncrono • Distribuído entre máquinas
- 5. Os dois pontosfortes do Celery • Gerenciador de tarefas assíncrono • Distribuído entre máquinas
- 6. Os dois pontosfortes do Celery • Gerenciador de tarefas assíncrono • Distribuído entre máquinas • Agendador
- 7. Celery Dentre os pontosfortes do Celery destacam-se • Gerenciador de tarefas assíncrono • Distribuído entre máquinas • Agendador • Com tolerância a falhas
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
- 14. Tarefa from celery.task importtask @task def foo(val): return val
- 15.
- 16.
- 17. Publicadores Assincronamente >>> res= foo.delay(5)
- 18. Dois Jeitos # nãobloqueia >>> res.ready() True ou False >>> res.result 5 # ou bloqueia >>> res.get() 5
- 19.
- 20. Fila Backend sugerido éo RabbitMQ (todas as crianças legais do bairro usam erlang)
- 21. Mas também suporta Redis Beanstalk MongoDB CouchDB ebancos suportados pelo ORM do Django
- 22.
- 23. Trabalhador Pode estar rodandoem outra máquina Cada Worker process ainda pode usar vários threads
- 24.
- 25.
- 26.
- 27. Web Painel de Escalabilidade(djangocon.eu) http://2011.djangocon.eu/talks/47/
- 28. Problemas comuns What arethe common mistakes you see. -------------------------------------- Things that take a long time ("sending an email") that lock up a process. Using the filesystem for caching. Testing locally and pushing it live and see it fall over. Using an external API can also take a long time. Work with timeouts to work around it.
- 29.
- 30. Soluções comuns Tenha umcelery de criança: Scaling wise, what should you think about before scaling becomes an actual issue? And what should you definitely leave until the moment comes you need to scale? ---------------------------------------------- First things first: use a queue like celery, even on small sites. Get used to such a queue and have it in place, that'll help a lot with performance later.Make sure you've got your database schema is mostly OK. It doesn't have to be perfect right away, but at least mostly OK. Expect something to change and assume you'll have to swap something out later to improve the performance.
- 31. email.py from celery.task importtask from django.core.mail import send_mail @task def send(subject, message, recipient_list, from_email=None, **kwargs): if subject[0] != "[": subject = "[projeto] "+ subject if from_email is None: from_email = "suporte@fuuuuuu.com" send_mail(subject, message, from_email, recipient_list, **kwargs)
- 32. Um bom padrão fromemail import send @task def relatorio(dados): ....gera relatorio.... send.delay("Relatorio Pronto", """ Pode baixadas daqui: http://fuuuuuu.com/relatorios/%s.pdf """% filename, (email,))
- 33.
- 34. Map Reduce tarefas= [] livros =["iliada.txt","odisseia.txt"....] for filename in livros: tarefas.append( conta_palavras.delay(filename) ) para pegar o resultado if all([i.ready() for i in tarefas]): palavras = sum([i.result for i in tarefas])
- 35.
- 36.
- 37. Inicia um worker $./manage.py celeryd -l info -E
- 38.
- 39. Tem que rolartambém $ ./manage.py celerycam
- 40. Testar #no settings.py TEST_RUNNER='djcelery.contrib.test_runner.run_tests' from django.testimport TestCase from myapp.tasks import add class AddTestCase(TestCase): def testNoError(self): """Test that the ``add`` task runs with no errors, and returns the correct result.""" result = add.delay(8, 8) self.assertEquals(result.get(), 16) self.assertTrue(result.successful())
- 41.
- 42. Transactions no django def bar(request): sanduiche = Sanduiche("Pernil") sanduiche.save() avisa_novo.delay(sanduiche.id)
- 43. Especialmente se MIDDLEWARE_CLASSES =( 'django.middleware.transaction.TransactionMiddleware', ...
- 44. Assim def bar(request): sanduiche = Sanduiche("Pernil") sanduiche.save() if transaction.is_managed(): transaction.commit() avisa_novo.delay(sanduiche.id)
- 45. Para desenvolvimento from socketimport error try: avisa_novo.delay(sanduiche.id) except error: log.error("conexao recusada") if not DEBUG: raise error
- 46. Muitas tarefas for iin algo_grande: avisa_novo.delay(i)
- 47. Muitas tarefas subtasks =[] for i in algo_grande: subtasks.append(subtask(avisa_novo, args=(i))) TaskSet(tasks=subtasks).apply_async()
- 48.
- 49.