Lanyrd.com is a definitive database of professional events and speakers that provides social event recommendation and comprehensive speaker profiles. It features a social event recommendation engine, comprehensive speaker profiles that include archives of slides, notes and videos, and a definitive database of professional events and speakers.
Rails and the Apache SOLR Search EngineDavid Keener
What good is content if nobody can find it? Many information sites are like icebergs, with only a limited amount of content directly accessible to users and the rest, the "underwater" potion, only available through searches. This talk shows how Rails web sites can take advantage of the world-class Apache SOLR search engine to provide sophisticated and customizable search features. We'll cover how to get started with SOLR, integrating with SOLR using the Sunspot gem, indexing, hit highlighting and other topics.
Apache Solr serves search requests at the enterprises and the largest companies around the world. Built on top of the top-notch Apache Lucene library, Solr makes indexing and searching integration into your applications straightforward. Solr provides faceted navigation, spell checking, highlighting, clustering, grouping, and other search features. Solr also scales query volume with replication and collection size with distributed capabilities. Solr can index rich documents such as PDF, Word, HTML, and other file types.
Come learn how you can get your content into Solr and integrate it into your applications!
Rails and the Apache SOLR Search EngineDavid Keener
What good is content if nobody can find it? Many information sites are like icebergs, with only a limited amount of content directly accessible to users and the rest, the "underwater" potion, only available through searches. This talk shows how Rails web sites can take advantage of the world-class Apache SOLR search engine to provide sophisticated and customizable search features. We'll cover how to get started with SOLR, integrating with SOLR using the Sunspot gem, indexing, hit highlighting and other topics.
Apache Solr serves search requests at the enterprises and the largest companies around the world. Built on top of the top-notch Apache Lucene library, Solr makes indexing and searching integration into your applications straightforward. Solr provides faceted navigation, spell checking, highlighting, clustering, grouping, and other search features. Solr also scales query volume with replication and collection size with distributed capabilities. Solr can index rich documents such as PDF, Word, HTML, and other file types.
Come learn how you can get your content into Solr and integrate it into your applications!
GNU, Apache, PHP, Mozilla, Ubuntu, Wikipedia, LibreOffice -- Today, there are hundreds of open source groups, each with its own culture, methodology, and governance model.
How are these groups alike?
How are they different?
Is there one true path to open source enlightenment,
or do many paths converge around a common singularity?
Join open source insider Ted Husted as we look behind the curtain to see who's pulling strings that steer your favorite open source projects.
ElasticSearch in Production: lessons learnedBeyondTrees
With Proquest Udini, we have created the worlds largest online article store, and aim to be the center for researchers all over the world. We connect to a 700M solr cluster for search, but have recently also implemented a search component with ElasticSearch. We will discuss how we did this, and how we want to use the 30M index for scientific citation recognition. We will highlight lessons learned in integrating ElasticSearch in our virtualized EC2 environments, and challenges aligning with our continuous deployment processes.
Building Intelligent Search Applications with Apache Solr and PHP5israelekpo
ZendCon 2010 - Building Intelligent Search Applications with Apache Solr and PHP5. This is a presentation on how to create intelligent web-based search applications using PHP 5 and the out-of-the-box features available in Solr 1.4.1 After we finish we finish the illustration of adding, updating and removing data from the Solr index, we will discuss how to add features such as auto-completion, hit highlighting, faceted navigation, spelling suggestions etc
Apache Solr is the popular, blazing fast open source enterprise search platform; it uses
Lucene as its core search engine. Solr’s major features include powerful full-text search, hit
highlighting, faceted search, dynamic clustering, database integration, and complex queries.
Solr is highly scalable, providing distributed search and index replication, and it powers the
search and navigation features of many of the world's largest internet sites.
Apache Solr is the popular, blazing fast open source enterprise search platform; it uses
Lucene as its core search engine. Solr’s major features include powerful full-text search, hit
highlighting, faceted search, dynamic clustering, database integration, and complex queries.
Solr is highly scalable, providing distributed search and index replication, and it powers the
search and navigation features of many of the world's largest internet sites.
This white paper describes the new features and improvements in the latest version, Apache Solr
1.4. In the simplest terms, Solr is now faster and better than before. Central components of Solr
have been improved to cut the time needed for processing queries and indexing documents.
Solr offers a rich, flexible set of features for search. To understand the extent of this flexibility, it's helpful to begin with an overview of the steps and components involved in a Solr search.http://www.lucidimagination.com/developers/whitepapers/whats-new-solr-14
Sol 1.4 is better than ever! Read this white paper and learn about these new features, including:
* enhanced data import capabilities
* rich document handling
* speedier numeric range queries
* duplicate detection
* java-based replication and deployment
* smarter handling of index changes
* faster faceting
* streamlined caching
Apache Solr! Enterprise Search Solutions at your Fingertips!Murshed Ahmmad Khan
Get an overview of Apache Solr as an enterprise search server. Get to know the available alternatives and why the Solr is cool! Get Excited! Enterprise Search Solutions are ready to pick.
GNU, Apache, PHP, Mozilla, Ubuntu, Wikipedia, LibreOffice -- Today, there are hundreds of open source groups, each with its own culture, methodology, and governance model.
How are these groups alike?
How are they different?
Is there one true path to open source enlightenment,
or do many paths converge around a common singularity?
Join open source insider Ted Husted as we look behind the curtain to see who's pulling strings that steer your favorite open source projects.
ElasticSearch in Production: lessons learnedBeyondTrees
With Proquest Udini, we have created the worlds largest online article store, and aim to be the center for researchers all over the world. We connect to a 700M solr cluster for search, but have recently also implemented a search component with ElasticSearch. We will discuss how we did this, and how we want to use the 30M index for scientific citation recognition. We will highlight lessons learned in integrating ElasticSearch in our virtualized EC2 environments, and challenges aligning with our continuous deployment processes.
Building Intelligent Search Applications with Apache Solr and PHP5israelekpo
ZendCon 2010 - Building Intelligent Search Applications with Apache Solr and PHP5. This is a presentation on how to create intelligent web-based search applications using PHP 5 and the out-of-the-box features available in Solr 1.4.1 After we finish we finish the illustration of adding, updating and removing data from the Solr index, we will discuss how to add features such as auto-completion, hit highlighting, faceted navigation, spelling suggestions etc
Apache Solr is the popular, blazing fast open source enterprise search platform; it uses
Lucene as its core search engine. Solr’s major features include powerful full-text search, hit
highlighting, faceted search, dynamic clustering, database integration, and complex queries.
Solr is highly scalable, providing distributed search and index replication, and it powers the
search and navigation features of many of the world's largest internet sites.
Apache Solr is the popular, blazing fast open source enterprise search platform; it uses
Lucene as its core search engine. Solr’s major features include powerful full-text search, hit
highlighting, faceted search, dynamic clustering, database integration, and complex queries.
Solr is highly scalable, providing distributed search and index replication, and it powers the
search and navigation features of many of the world's largest internet sites.
This white paper describes the new features and improvements in the latest version, Apache Solr
1.4. In the simplest terms, Solr is now faster and better than before. Central components of Solr
have been improved to cut the time needed for processing queries and indexing documents.
Solr offers a rich, flexible set of features for search. To understand the extent of this flexibility, it's helpful to begin with an overview of the steps and components involved in a Solr search.http://www.lucidimagination.com/developers/whitepapers/whats-new-solr-14
Sol 1.4 is better than ever! Read this white paper and learn about these new features, including:
* enhanced data import capabilities
* rich document handling
* speedier numeric range queries
* duplicate detection
* java-based replication and deployment
* smarter handling of index changes
* faster faceting
* streamlined caching
Apache Solr! Enterprise Search Solutions at your Fingertips!Murshed Ahmmad Khan
Get an overview of Apache Solr as an enterprise search server. Get to know the available alternatives and why the Solr is cool! Get Excited! Enterprise Search Solutions are ready to pick.
A talk on my experiences building crowdsourcing applications, both at the Guardian newspaper and for my own personal projects. Presented at Web Directions @media 2010 on June 9th.
Keynote for DjangoCon 2009, presented on the 8th of September 2009. Covers two cowboy projects - WildLifeNearYou.com and MP expenses - and talks about ways of "reigning in the cowboy" and developing in a more sustainable way.
Keeping your web application secure is an ongoing process - new classes of vulnerabilities are discovered with surprising frequency, and if you don't keep on top of them you could be in for a nasty surprise. This talk will discuss both common and obscure vulnerabilities, with real-world examples of attacks that have worked against high profile sites in the past.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
3. Lanyrd.com
Definitive database Social event recommendation
of professional events Comprehensive speaker profiles
and speakers Archive of slides, notes and video
6. • Aug 31st, 11:22: Launch! (1 linode)
• Aug 31st, 12:41: Unlaunch
• Aug 31st, 12:54: Read only mode
• Aug 31st, 14:15: DB server (2 linodes)
• Sep 1st: Limit 50 on dashboard
• Sep 1st: disable-dashboard setting
7. • Sep 3rd: dConstruct (and Twitter bot)
• Sep 4th: TechCrunched (read only :( )
• Sep 5th: 3 large EC2 + 1 RDS
• Sep 6th: Downgrade to 3 small EC2
13. apache > lucene > solr
Search the site with Solr Search
Main Wiki Powered by Lucid Imagination
Last Published: Sat, 04 Jun 2011 12:23:42 GMT
About
Welcome
Who We Are
Welcome to Solr
Documentation
PDF
Resources
What Is Solr?
Related Projects
Get Started
News
May 2011 - Solr 3.2 Released
March 2011 - Solr 3.1 Released
25 June 2010 - Solr 1.4.1 Released
7 May 2010 - Apache Lucene Eurocon 2010 Coming to Prague May 18-21
10 November 2009 - Solr 1.4 Released
20 August 2009 - Solr's first book is published!
18 August 2009 - Lucene at US ApacheCon
09 February 2009 - Lucene at ApacheCon Europe 2009 in Amsterdam
19 December 2008 - Solr Logo Contest Results
03 October 2008 - Solr Logo Contest
15 September 2008 - Solr 1.3.0 Available
28 August 2008 - Lucene/Solr at ApacheCon New Orleans
03 September 2007 - Lucene at ApacheCon Atlanta
06 June 2007: Release 1.2 available
17 January 2007: Solr graduates from Incubator
22 December 2006: Release 1.1.0 available
15 August 2006: Solr at ApacheCon US
21 April 2006: Solr at ApacheCon
21 February 2006: nightly builds
17 January 2006: Solr Joins Apache Incubator
What Is Solr?
14. More Like This
Faceting
Stored (non-indexed) fields
Highlighting
Spelling Suggestions
Boost
Find the needle you're looking for. Download Documentation
Search doesn't have to be hard. Haystack lets you write your search code Sprinting to 1.1-final
Posted on 2010/11/16 by Daniel
once and choose the search engine you want it to run on. With a familiar API Though this site has sat out of
that should make any Djangonaut feel right at home and an architecture that date, there has been a lot of
work put into Haystack 1.1. As
allows you to swap things in and out as you need to, it's how search ought of writing, there are eight issues
to be. blocking the release. I aim to
have those down to zero by the
end of the week.
Haystack is BSD licensed , plays nicely with third-party app without needing
to modify the source and supports Solr , Whoosh and Xapian . Once those eight are done, I will
be releasing 1.1-final. The RC
process really didn't do much
Get started last time and this release has
been a long time in coming. This
1. Get the most recent source. release will feature:
2. Add haystack to your INSTALLED_APPS.
3. Create search_indexes.py files for your models. Vastly improved faceting
4. Setup the main SearchIndex via autodiscover. Whoosh 1.X support!
5. Include haystack.urls to your URLconf. Document & field boost
6. Search! support
15. Model-oriented search
• Define search_indexes.py (like
admin.py) for your application
• Hook up default haystack search views
• Write a quick search.html template
• Run ./manage.py rebuild_index
16.
17. add a conference you are signed in as simonw, do you want to sign out?
calendar conferences coverage profile
search
Search
We found 3 results for “django”
FILTER BY
django Search type
Sessions 3
Your current filters are…
TYPE: Sessions TOPIC: NoSQL PLACE: United States Clear all filters
FILTER BY
topic
NoSQL and Django Panel
EVENT DjangoCon US 2010 NoSQL 3
TIME 9th September 2010 09:00-10:00
SPEAKERS Jacob Burch Django 2
Cassandra 1
Step Away From That Database
EVENT DjangoCon US 2010
TIME 8th September 2010 11:20-12:00 FILTER BY
SPEAKERS Andrew Godwin
place
Apache Cassandra in Action United States 3
EVENT Strata 2011 Multnomah 2
TIME 1st February 2011 13:30-17:00
Oregon 2
SPEAKERS Jonathan Ellis
Portland 2
Santa Clara 1
California 1
18. class BookIndex(indexes.SearchIndex):
text = indexes.CharField(document=True, use_template=True)
speakers = indexes.MultiValueField()
topics = indexes.MultiValueField()
def prepare_speakers(self, obj):
return [a.user.t_id for a in obj.authors.exclude(
user = None
).select_related('user')]
def prepare_topics(self, obj):
return list(obj.topics.values_list('pk', flat=True))
19. search/indexes/books/
book_text.txt
{{ object.title }}
{{ object.tagline }}
{% for author in object.authors.all %}
{{ author.display_name }}
{{ author.user.t_screen_name }}
{% endfor %}
{% for topic in object.topics.all %}
{{ topic.name_en }}
{% endfor %}
20. Staying fresh
• Search engines usually don’t like accepting
writes too frequently
• RealTimeSearchIndex for low traffic sites
• ./manage.py update_index --age=6 (hours)
• Uses index.get_updated_field()
• Roll your own (message queue or similar...)
23. index = site.get_index(model)
updated_pks = []
objects = index.load_all_queryset().filter(
needs_indexing=True
)[:100]
if not objects:
return
for object in objects:
updated_pks.append(object.pk)
index.update_object(object)
index.load_all_queryset().filter(
pk__in = updated_pks
).update(needs_indexing = False)
24. nginx + Solr
replication trick
upstream solrmaster { server {
server 10.68.43.214:8080; listen 8983;
} location /solr/update {
upstream solrslaves { proxy_pass http://solrmaster;
server 10.68.43.214:8080; }
server 10.193.138.80:8080; location /solr/select {
server 10.204.143.106:8080; proxy_pass http://solrslaves;
} }
}
25. add a conference you are signed in as simonw, do you want to sign out?
calendar conferences coverage profile
search
Your contacts' calendar
yours 24 contacts 182
Simon
We've found 182 conferences your Twitter contacts are Willison
interested in. Your profile
page
TODAY Café Scientifique: Exploring Attend
21
the dark side of star Track
formation with the Herschel From our blog
Space Observatory Welcoming Sophie
United Kingdom / Brighton Barrett to team
21st June 2011 Lanyrd
Astronomy Science Today we have a very special
announcement (and for once,
4 contacts tracking
it's not a new feature!) We
would like to welcome the
super-wonderful Sophie Barrett
to the Lanyrd team.
21 Usability Professionals' Attend Session schedules in
Association – International Track your calendar
Conference You can now subscribe to event
schedules in your calendar of
United States / Atlanta
choice. Stay up to date at the
21st–24th June 2011 event with the schedule in the
Usability User Experience pocket where you need it.
1 contact speaking and 3 contacts tracking
Venues (and venue
maps)
29. Commands Clients Documentation Community Download Issues
Redis is an open source, advanced key-value store. It is often What people are saying
referred to as a data structure server since keys can contain Comparison of CouchDB, Redis,
MongoDB, Casandra, Neo4J &
strings, hashes, lists, sets and sorted sets.
strings hashes lists sets others http://j.mp/l32SqM via
@DZone
Learn more →
@__NeverGiveup Oh YAY, oui tu
me redis ! *-* Hm, on s'rejoint à
Try it Download it 14h au bahut ? :o
Ready for a test drive? Check this interactive Redis 2.2.10 is the latest stable version. JE L REDIS JE FOLLOW BACK
SUR @Fuckement_TL
tutorial that will walk you through the most Interested in legacy or unstable versions?
important features of Redis. Check the downloads page. une question : "How to use
ServiceStack Redis in a web
application to take advantage of
pub / sub paradigm"
http://t.co/EOgyLU1 #redis #web
Nice - Cassandra vs MongoDB vs
CouchDB vs Redis vs Riak vs
HBase vs Membase vs Neo4j
comparison http://bit.ly/l32SqM
from @kkovacs
More...
Sponsored by
This website is open source software developed by Citrusbyte.
The Redis logo was designed by Carlos Prioglio.
31. add a conference you are signed in as simonw, do you want to sign out?
Lanyrd.com
calendar conferences coverage profile
search
EuroPython 2011 You're
speaking
The European Python Conference AT THIS EVENT
19 –26 JUNE
2011
Florence
in Italy
97 attending
http://ep2011.europython.eu/ @europython PEOPLE
View the schedule on Lanyrd #europython
80 tracking
PEOPLE
Save to iCal / iPhone / Outlook / lanyrd.com/ccdpc (short URL)
GCal
TELL YOUR FRIENDS!
Tweet about this
event
119 speakers
Andreas Alan Anna
Schreiber Franzoni Ravenscroft
Topics
@onyame @franzeur
Django
Andrew Alessandro Anselm Kruis
Godwin Dentella Plone
@andrewgodwin Pyramid
Andrii Alex Martelli Antonio Cuni
@antocuni
Python
Mishkovskyi
@mishok13 Twisted
Ali Afshar Armin Rigo
Armin Edit topics
33. Home Download Community Documentation Code
Background Processing Distributed
Asynchronous/Synchronous Concurrency
Background Processing Distributed
Periodic Tasks Retries
Asynchronous/Synchronous Concurrency
Periodic Tasks Retries
Distributed Task Queue Celery 2.2 released!
By @asksol on 2011-02-01.
Celery is an asynchronous task queue/job queue based on distributed
message passing. It is focused on real-time operation, but supports A great number of new features,
scheduling as well. including Jython, eventlet and gevent
support. Everything is detailed in the
The execution units, called tasks, are executed concurrently on a single
Changelog, which you should have read
or more worker servers using multiprocessing, Eventlet, or gevent.
before upgrading.
Tasks can execute asynchronously (in the background) or
synchronously (wait until ready). Users of Django must also upgrade to
django-celery 2.2.
Celery is used in production systems to process millions of tasks a day.
This release would not have been
Celery is written in Python, but the protocol can be implemented in
possible without the help of
any language. It can also operate with other languages using
contributors and users, so thank you,
webhooks.
and congratulations!
The recommended message broker is RabbitMQ, but limited support
for Redis, Beanstalk, MongoDB, CouchDB, and databases (using
Celery 2.1.1 bugfix
SQLAlchemy or the Django ORM) is also available.
release
By @asksol on 2010-10-14.
Celery is easy to integrate with Django, Pylons and Flask, using the
All users are urged to upgrade. For a list
django-celery, celery-pylons and Flask-Celery add-on packages.
of changes see the Changelog.
Example Users of Django must also upgrade to
This is a simple task adding two numbers: django-celery 2.1.1.
34. Tasks?
• Anything that takes more than about 200ms
• Updating a search index
• Resizing images
• Hitting external APIs
• Generating reports
35. Trivial example
• Fetch the content of a web page
from celery.task import task
@task
def fetch_url(url):
return urllib.urlopen(url).read()
>>> result = fetch_url.delay(‘http://cnn.com/’)
>>> html = result.wait()
36. Python and MongoDB EuroPython 2011
Italy / Florence
tutorial
19th–26th June 2011
TELL YOUR FRIENDS!
Tweet about this
A session at EuroPython 2011 session
Andreas
Jung WHEN
CEO, ZOPYX Ltd Time 14:30–18:30 CET
Date 20th June 2011
MongoDB is the new star of the so-called NoSQL databases. Using
Python with MongoDB is the next logical step after having used SESSION HASH TAG
Python for years with relational databases. #sftzh
This talk will give an introduction into MongoDB and demonstrate SHORT URL
how MongoDB can be be used from Python. lanyrd.com/sftzh
More information can be found under: OFFICIAL SESSION
PAGE
http://www.zopyx.com/resources/python-mongodb-tutorial-at... ep2011.europython.eu/conf
View the schedule
More sessions at EuroPython 2011 on Python
Topics
MongoDB
Add coverage to this session Python
http://www.slideshare.net/ajung/python-mo Edit topics
A URL to coverage such as videos, slides, podcasts, handouts, sketchnotes, photos
etc. SCHEDULE
INCOMPLETE?
Add Add another session
38. The task itself...
• Tries using http://embed.ly/ to find a
preview
• Fetches the HTTP headers and first 2048
bytes
• If HTML, attempts to extract the <title>
• If other, gets the file type and size from
headers
39. Behind the scenes...
ar = enhance_link.delay(url)
poll_url = '/working/%s/' % signed.dumps({
'task_id': ar.task_id,
'on_done_url': on_done_url,
})
if 'ajax' in request.POST:
return render_json(request, {
'ok': True,
'poll_url': poll_url,
})
else:
return HttpResponseRedirect(poll_url)
40. And when it’s done...
from celery.backends import default_backend
...
task_id = request.REQUEST.get('id', '')
result = default_backend.get_result(task_id)
41. Configuration
# Carrot / Celery: queue uses Redis
CARROT_BACKEND = "ghettoq.taproot.Redis"
BROKER_HOST = " 10.11.11.11" # redis server
BROKER_PORT = 6379
BROKER_VHOST = "6"
# Task results stored in memcached, so they can
# expire automatically
CELERY_RESULT_BACKEND = "cache"
CELERY_CACHE_BACKEND =
"memcached://10.11.11.12:11211;..."
43. Phantom load testing
• Deploy a new architecture on a brand new
EC2 cluster
• Leave your existing site on the old cluster
• Invisibly link to the new stack from an
<img width=1 height=1> element on your
live site (not for very long though)
• (sensible alternative: find a way to replay log files)
45. add a conference you are signed in as simonw, do you want to sign out?
calendar conferences coverage profile
search
Django conferences
Django
Django events looking for participants coverage
1 Django event is looking for participants
52 videos
Most recent added 3
weeks ago
ON NOW EuroPython 2011 52 slide decks
19 Most recent added 4
Italy / Florence hours ago
19th–26th June 2011
Django Plone Pyramid Python Twisted 3 audio clips
Most recent added 1
week ago
27 write-ups
SEPTEMBER DjangoCon US 2011
6 Most recent added 1
2011 United States / Portland
6th–8th September 2011
week ago
11 handouts
Django Open Source Python
Most recent added 18
hours ago
17 PyCON FR 2011 3 notes
France / Rennes Most recent added 10
17th–18th September 2011 hours ago
Django Python
By country
OCTOBER PyCon DE 2011 Ireland 1
4
50. Pass data through an untrusted
source with confidence that it
hasn't been tampered with
51. Signing uses
• "Unsubscribe" links in emails
• lanyrd.com/un/ImN6VyI.ii0Hwm7p71DEcGfaVzziQaxeuu
?redirect_to=URL protection
Signed cookies
"You are logged in as simonw" without
hitting the database
52. Signing in Django 1.4
from django.core import signing
signing.dumps({"foo": "bar"})
signing.loads(signed_string)
response.set_signed_cookie(key, value...)
response.get_signed_cookie(key)
55. Benefits
• Far futures expiry headers
• Cache-Control: max-age=315360000
• Expires: Fri, 18 Jun 2021 06:45:00 -0000 GMT
• Guaranteed updated CSS in IE
• Deploy new assets in advance of application
• Old versions stick around for rollbacks
58. UserBasedExceptionMiddleware
from django.views.debug import technical_500_response
import sys
class UserBasedExceptionMiddleware(object):
def process_exception(self, request, exception):
if request.user.is_superuser:
return technical_500_response(request, *sys.exc_info())
59. mysql-proxy
• Very handy lua-customisable proxy for all
of your MySQL traffic
• Worst documented software ever
• log.lua - logs out ALL queries
• https://gist.github.com/1039751
60. django_instrumented
• (Unreleased) code I wrote for Lanyrd
• Collects various runtime stats about the
current request, stashes a profile JSON in
memcached
• Writes out the profile UUID as part of the
HTML
• A bookmarklet to view the profile
61.
62. mongodb logging
• Super-fast inserts, log everything!
• Capped collections
• Structured queries
• Ask me about it in a few months
63. For the future...
• Much better profiling, monitoring and alerts
• Varnish in front of everything
• Replicated MySQL for analytics + upgrades