![how to organize tasks?
@task
def post_on_wall(facebook_id, message):
params = {}
params['id'] = facebook_id
params['message'] = message
response = requests.post(url, params=params)](https://image.slidesharecdn.com/celeryandthesocialnetworks-130702043034-phpapp01/75/Celery-and-the-social-networks-25-2048.jpg)
![rate limits
# make sure we will never spam our wall
@task(rate_limit=’5/h’)
def post_on_wall(facebook_id, message):
params = {}
params['id'] = facebook_id
params['message'] = message
response = requests.post(url, params=params)](https://image.slidesharecdn.com/celeryandthesocialnetworks-130702043034-phpapp01/75/Celery-and-the-social-networks-29-2048.jpg)
Uploaded byAndrew Mleczko
Celery and the social networks
Celery can help address issues with posting to social networks at scale during crisis situations by allowing tasks like posting messages and sending SMS to be organized asynchronously and with built-in rate limiting. The presenter discusses how Celery was used to build a notification application and website to provide earthquake information and relief coordination in Italy within 36 days of the initial earthquake. Key lessons include using Celery's task organization, rate limiting, and distributed execution to engage stakeholders, collect needs, and share updates across social networks without exceeding API limits.
![Coded Agents – with UiPath SDK + LangGraph [Virtual Hands-on Workshop]](https://cdn.slidesharecdn.com/ss_thumbnails/codedagentsdeck-251215155422-5497c599-thumbnail.jpg?width=640&height=640&fit=bounds)
Celery and the social networks
- 1. agile.open.connected Celery And TheSocial Networks 5 Things I Have Learned During Earthquake Hackathon Andrew Mleczko
- 2. Andrew Mleczko Python Dev RedTurtle- Italy - Poland amleczko@redturtle.it @amleczko www.redturtle.it Andrew Mleczko
- 3. May, 20th -the earthquake
- 4.
- 5.
- 6. the earthquake this isnot “parmesan” this is real italian PARMIGIANO ;-D
- 7. re-start, do itfast!
- 8. and the realneeds the virtual idea
- 9.
- 10. keep attention alive onlineresources newspapers radio television
- 11. EARTHQUAKE 20/5 first idea24/5engage stakeholders collect specs 28/5 get the server placeholder page 27/5 design layout 4/6 hackaton 11-14/6 find companies GOLIVE 26/6 36 days from event
- 12.
- 13.
- 14.
- 15. Celery can fix alloff it!
- 16.
- 17. The website architecture NotificationApp (REST) website stories ecommerce companies products news SMS Social Networks email github.com/RedTurtle/ restarter.buildout +
- 18.
- 19.
- 20.
- 21.
- 22. The website architecture NotificationApp (REST) website stories ecommerce companies products news SMS Social Networks email github.com/RedTurtle/ restarter.buildout +
- 23. how to organizetasks?
- 24. how to organizetasks? small atomic minimal state
- 25. how to organizetasks? @task def post_on_wall(facebook_id, message): params = {} params['id'] = facebook_id params['message'] = message response = requests.post(url, params=params)
- 26. how to organizetasks? @task def send_sms(login, password, message, phone): payload = {'login': login, 'password': password, 'phone': phone, 'body' : message } try: r = requests.get('%s/send' % GATEWAY, params=payload, timeout=TIMEOUT) except requests.exceptions.Timeout as e: send_sms.retry(e, countdown=3)
- 27.
- 28. rate limits # makesure to not hit 3rd party limits @task(rate_limit=’1/m’) def send_sms(login, password, message, phone): ...
- 29. rate limits # makesure we will never spam our wall @task(rate_limit=’5/h’) def post_on_wall(facebook_id, message): params = {} params['id'] = facebook_id params['message'] = message response = requests.post(url, params=params)
- 30. rate limits gotchas ➡Fails on worker daemon restart ➡ Doesn’t work with multiple worker daemons ➡ External rate limits are based on many factors: ➡ who’s asking ➡ public/private info ➡ what feature
- 31. rate limits gotchas https://api.twitter.com/1/account/settings.json 'x-ratelimit-class':'api_identified', 'x-ratelimit-limit': '350', 'x-ratelimit-remaining': '257' https://api.twitter.com/1/users/search.json?q=europython 'x-featureratelimit-class': 'usersearch', 'x-featureratelimit-limit': '180', 'x-featureratelimit-remaining': '179'
- 32.
- 33.
- 34.
- 35.
- 36. Questions ? Andrew Mleczko PythonDev Plone Framework Team member amleczko@redturtle.it tw: @amleczko
- 37.