With Gearman, a client/server infrastructure for generic tasks, you can work on distributed servers easily, with little worry about the details.
No matter what language you speak, Gearman can meet your needs in C, PHP, Perl, Ruby, shell scripting, and several more.
Gearman is a client/server infrastructure for generic tasks, usable on distributed servers, with little worry about the details. No matter what language you speak, Gearman can meet your needs in C, PHP, Perl, Ruby, shell scripting, and several more. Gearman can also work in conjunction with MySQL, either using UDFs, or simply through its basic architecture.
This talk will show examples of how to use Gearman for remote installation and how to call functions written in Perl from any other language or from inside MySQL server, with no knowledge of Perl at all.
Portfolio: ActionBase Fireworks, a Hardware-Software ComplexEdgewood Services
AcionBase Fireworks system has long history of success, starting from 2006. It is a hardware-software complex, an affordable digital system to control the launch of fireworks igniters during the pyromusical displays. Today, more than 10 professional pyrotechnical teams use ABF as a primary equipment for all scale shows. Instead of expensive, cumbersome and complex systems, our engineers designed a simplified and modern one. We have a long-term upgrade plan.
Gearman is a client/server infrastructure for generic tasks, usable on distributed servers, with little worry about the details. No matter what language you speak, Gearman can meet your needs in C, PHP, Perl, Ruby, shell scripting, and several more. Gearman can also work in conjunction with MySQL, either using UDFs, or simply through its basic architecture.
This talk will show examples of how to use Gearman for remote installation and how to call functions written in Perl from any other language or from inside MySQL server, with no knowledge of Perl at all.
Portfolio: ActionBase Fireworks, a Hardware-Software ComplexEdgewood Services
AcionBase Fireworks system has long history of success, starting from 2006. It is a hardware-software complex, an affordable digital system to control the launch of fireworks igniters during the pyromusical displays. Today, more than 10 professional pyrotechnical teams use ABF as a primary equipment for all scale shows. Instead of expensive, cumbersome and complex systems, our engineers designed a simplified and modern one. We have a long-term upgrade plan.
This presentation describes how to use perl to run a sample data processing application using the MapReduce framework and gearmand servers.
The original demo code was hosted at the Ann Arbor Perl Mongers web site but moved to github:jpitts/gearman-mapreduce-demo.
Gearman is a framework for writing distributed applications across many nodes. It allows you to do work in parallel, load balance processes and write applications across several programming languages. In this presentation we'll learn how to get started writing Gearman-powered applications in Perl.
Many services / applications now a day are ill equipped with handling a sudden rush of popularity, as is often the case on the internet now a days, to a point where the services either become unavailable or unbearably slow.
By taking a chapter from the ant colonies in the wild, where their strength lies in their numbers and the fact that everyone works together towards the same goal, we can apply the same principle to our service by using systems such as
- gearman
- memcache
- daemons
- message queues
- load balancers
and many more, you can achieve greater performance, more redundancy, higher availability and have the ability to scale your services up and down as required easily.
During this talk attendees will be lead through the world of distributed systems and scalability, and shown the how, where and what, of how to take the average application and splitting it into smaller more manageable pieces
Building a Scalable Web Crawler with Hadoop by Ahad Rana from CommonCrawl
Ahad Rana, engineer at CommonCrawl, will go over CommonCrawl’s extensive use of Hadoop to fulfill their mission of building an open, and accessible Web-Scale crawl. He will discuss their Hadoop data processing pipeline, including their PageRank implementation, describe techniques they use to optimize Hadoop, discuss the design of their URL Metadata service, and conclude with details on how you can leverage the crawl (using Hadoop) today.
The MIMIC Simulation Suite, designed by Gambit Communications, consists of SNMP Simulator, NetFlow, Web, IOS, IPMI, JUNOS, IPFIX Simulators , is used to create a virtual site that contains a large number of devices.
Since the advent of SNMP as a defacto “standard” management protocol, enterprise management tools have achieved great strides in capability. Yet product complexity and scalability remain significant barriers to the effective use of these products in mid-size and large enterprise NMS environments.
This presentation describes how to use perl to run a sample data processing application using the MapReduce framework and gearmand servers.
The original demo code was hosted at the Ann Arbor Perl Mongers web site but moved to github:jpitts/gearman-mapreduce-demo.
Gearman is a framework for writing distributed applications across many nodes. It allows you to do work in parallel, load balance processes and write applications across several programming languages. In this presentation we'll learn how to get started writing Gearman-powered applications in Perl.
Many services / applications now a day are ill equipped with handling a sudden rush of popularity, as is often the case on the internet now a days, to a point where the services either become unavailable or unbearably slow.
By taking a chapter from the ant colonies in the wild, where their strength lies in their numbers and the fact that everyone works together towards the same goal, we can apply the same principle to our service by using systems such as
- gearman
- memcache
- daemons
- message queues
- load balancers
and many more, you can achieve greater performance, more redundancy, higher availability and have the ability to scale your services up and down as required easily.
During this talk attendees will be lead through the world of distributed systems and scalability, and shown the how, where and what, of how to take the average application and splitting it into smaller more manageable pieces
Building a Scalable Web Crawler with Hadoop by Ahad Rana from CommonCrawl
Ahad Rana, engineer at CommonCrawl, will go over CommonCrawl’s extensive use of Hadoop to fulfill their mission of building an open, and accessible Web-Scale crawl. He will discuss their Hadoop data processing pipeline, including their PageRank implementation, describe techniques they use to optimize Hadoop, discuss the design of their URL Metadata service, and conclude with details on how you can leverage the crawl (using Hadoop) today.
The MIMIC Simulation Suite, designed by Gambit Communications, consists of SNMP Simulator, NetFlow, Web, IOS, IPMI, JUNOS, IPFIX Simulators , is used to create a virtual site that contains a large number of devices.
Since the advent of SNMP as a defacto “standard” management protocol, enterprise management tools have achieved great strides in capability. Yet product complexity and scalability remain significant barriers to the effective use of these products in mid-size and large enterprise NMS environments.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Welocme to ViralQR, your best QR code generator.ViralQR
Welcome to ViralQR, your best QR code generator available on the market!
At ViralQR, we design static and dynamic QR codes. Our mission is to make business operations easier and customer engagement more powerful through the use of QR technology. Be it a small-scale business or a huge enterprise, our easy-to-use platform provides multiple choices that can be tailored according to your company's branding and marketing strategies.
Our Vision
We are here to make the process of creating QR codes easy and smooth, thus enhancing customer interaction and making business more fluid. We very strongly believe in the ability of QR codes to change the world for businesses in their interaction with customers and are set on making that technology accessible and usable far and wide.
Our Achievements
Ever since its inception, we have successfully served many clients by offering QR codes in their marketing, service delivery, and collection of feedback across various industries. Our platform has been recognized for its ease of use and amazing features, which helped a business to make QR codes.
Our Services
At ViralQR, here is a comprehensive suite of services that caters to your very needs:
Static QR Codes: Create free static QR codes. These QR codes are able to store significant information such as URLs, vCards, plain text, emails and SMS, Wi-Fi credentials, and Bitcoin addresses.
Dynamic QR codes: These also have all the advanced features but are subscription-based. They can directly link to PDF files, images, micro-landing pages, social accounts, review forms, business pages, and applications. In addition, they can be branded with CTAs, frames, patterns, colors, and logos to enhance your branding.
Pricing and Packages
Additionally, there is a 14-day free offer to ViralQR, which is an exceptional opportunity for new users to take a feel of this platform. One can easily subscribe from there and experience the full dynamic of using QR codes. The subscription plans are not only meant for business; they are priced very flexibly so that literally every business could afford to benefit from our service.
Why choose us?
ViralQR will provide services for marketing, advertising, catering, retail, and the like. The QR codes can be posted on fliers, packaging, merchandise, and banners, as well as to substitute for cash and cards in a restaurant or coffee shop. With QR codes integrated into your business, improve customer engagement and streamline operations.
Comprehensive Analytics
Subscribers of ViralQR receive detailed analytics and tracking tools in light of having a view of the core values of QR code performance. Our analytics dashboard shows aggregate views and unique views, as well as detailed information about each impression, including time, device, browser, and estimated location by city and country.
So, thank you for choosing ViralQR; we have an offer of nothing but the best in terms of QR code services to meet business diversity!
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
2. Gearman: a technology
for distributed
computing
Giuseppe Maxia
MySQL Community Team Lead
Sun Microsystems
Sunday, 25 October 2009
3. Mainframe
terminal
Mainframe
terminal
operating system
client
terminal
hardware
application
terminal
0 100
USER FRIENDLINESS
Sunday, 25 October 2009
4. Mini computers
Mainframe Mini terminal
terminal
operating system Mini
client
hardware terminal
application
terminal
0 100
USER FRIENDLINESS
Sunday, 25 October 2009
5. Networks
server personal
computer
personal
operating operating computer
system system
personal client
hardware hardware computer
hardware
personal
application
0 computer 100
USER FRIENDLINESS
Sunday, 25 October 2009
6. Web applications
web server browser
INTERNET
browser
operating operating
operating
system system systemoperating
system
client
browser
hardware hardware
hardware
application browser
0 100
USER FRIENDLINESS
Sunday, 25 October 2009
7. service
Cloud applications
provider service
provider
service
provider
service browser
provider web
INTERNET
server
browser
operating operating
operating
system system system
client
browser
hardware hardware
hardware
application applicationapplication browser
0 100
USER FRIENDLINESS
Sunday, 25 October 2009
8. Some actors
• memcached
• gearman
Used in production by Facebook and Digg
Sunday, 25 October 2009
20. Simple usage
GEARMAN
• Command line client and worker
Sunday, 25 October 2009
21. starting the server
/usr/local/sbin/gearmand -d
# started as daemon.
# No feedback given on the command line
Sunday, 25 October 2009
22. starting the server (2)
/usr/local/sbin/gearmand -v -v
INFO Starting up
INFO Listening on :::4730 (5)
INFO Listening on 0.0.0.0:4730 (6)
# started as normal application
# verbose output requested
Sunday, 25 October 2009
23. starting the worker
gearman -w -h hostname -p 4730
-f conta wc
# -w = act as worker
# -f = function
# conta = function name
# wc = command to execute when function
# 'conta' is called
Sunday, 25 October 2009
24. what the server says
/usr/local/sbin/gearmand -v -v
INFO Starting up
INFO Listening on :::4730 (5)
INFO Listening on 0.0.0.0:4730 (6)
…
INFO Accepted connection from 127.0.0.1:4994
INFO [ 0] 127.0.0.1:4994 Connected
Sunday, 25 October 2009
25. starting the client
gearman -h hostname -p 4730
-f conta < ~/.bashrc
57 135 2149 # <- output
# from worker
# -f = function
# conta = function name
# < ~/.bashrc = input data
Sunday, 25 October 2009
26. what the server says
/usr/local/sbin/gearmand -v -v
INFO Starting up
INFO Listening on :::4730 (5)
INFO Listening on 0.0.0.0:4730 (6)
…
INFO Accepted connection from 127.0.0.1:4994
INFO [ 0] 127.0.0.1:4994 Connected
…
INFO Accepted connection from 127.0.0.1:5181
INFO [ 0] 127.0.0.1:5181 Connected
INFO [ 0] 127.0.0.1:5181 Disconnected
Sunday, 25 October 2009
27. What happened
1 server start
listen to port 4730
Sunday, 25 October 2009
28. What happened
2 worker starts
registers function 'conta' to server
Sunday, 25 October 2009
29. What happened
3 client starts
requires function 'conta' from server
provides input data
Sunday, 25 October 2009
30. What happened
4 server sends client request to worker
passes all input data to worker
Sunday, 25 October 2009
31. What happened
5 worker receives request and data
processes input
Sunday, 25 October 2009
32. What happened
6 worker returns processed data
server passes it to client
Sunday, 25 October 2009
33. What happened
7 client receives processed data
client displays result
Sunday, 25 October 2009
35. A simple perl worker
1. add server
2. add function
3. loop
4. function definition
Sunday, 25 October 2009
36. simple worker (1)
use strict;
use warnings;
use Gearman::XS qw(:constants);
use Gearman::XS::Worker;
my $host = '127.0.0.1';
my $port = 4730;
my $worker = new Gearman::XS::Worker;
my $ret = $worker->add_server($host, $port);
if ($ret != GEARMAN_SUCCESS) {
printf(STDERR "%sn", $worker->error());
exit(1);
}
Sunday, 25 October 2009
37. simple worker (2)
my $options = '';
$ret = $worker->add_function(
"reverse", # public function name
0, # timeout
&myreverse, # reference to function
$options); # function arguments
if ($ret != GEARMAN_SUCCESS) {
printf(STDERR "%sn", $worker->error());
}
Sunday, 25 October 2009
38. simple worker (3)
while (1) {
my $ret = $worker->work();
if ($ret != GEARMAN_SUCCESS) {
printf(STDERR "%sn", $worker->error());
}
}
Sunday, 25 October 2009
39. simple worker (4)
sub myreverse {
my ($job) = @_;
my $workload = $job->workload();
my $result = reverse($workload);
printf(
"Job=%s F_Name=%s Workload=%s Result=%sn",
$job->handle(),
$job->function_name(),
$job->workload(),
$result);
return $result;
}
Sunday, 25 October 2009
41. A simple perl client
• add server
• run a task
Sunday, 25 October 2009
42. simple client (1)
use strict;
use warnings;
use Gearman::XS qw(:constants);
use Gearman::XS::Client;
my $client = new Gearman::XS::Client;
my $host = '127.0.0.1';
my $port = 4730;
my $ret = $client->add_server($host, $port);
if ($ret != GEARMAN_SUCCESS) {
printf(STDERR "%sn", $client->error());
exit(1);
}
Sunday, 25 October 2009
43. simple client (2)
my $input = shift || 'teststring';
my ($return, $result) =
$client->do("reverse", $input);
if ($return == GEARMAN_SUCCESS) {
printf("Result=%sn", $result);
}
Sunday, 25 October 2009
59. remote sandbox worker (4)
sub make_sandbox {
my ($job, $options) = @_;
my $command = $job->workload();
chomp $command;
print STDERR "<$command>n";
my $result = qx(make_sandbox $command) ;
if ($?) {
print $result, "n";
return "Error ($!)n";
}
else {
return "okn"
}
}
Sunday, 25 October 2009
60. Client to install
Remote sandboxes
•add server
•run remote installation on master
•run remote installation on each slave
•run configuration queries on slaves
Sunday, 25 October 2009
61. sample call to remote worker
my $ret =
qx(echo "$MASTER_SANDBOX" |
gearman -h $master_ip -f make_sandbox ) ;
# using the gearman command line utility
Sunday, 25 October 2009
62. More on similar matters
• FOSS.MY, Kuala Lumpur, Malaysia, 25-Oct-2009
• CodeBits, Lisbon, Portugal, 3-4-5-Dec-2009
http://datacharmer.blogspot.com
http://gearman.org
Sunday, 25 October 2009
63. THANKS
Let's talk!
This work is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported License. To view a copy of this license, visit http://
creativecommons.org/licenses/by-sa/3.0/ or send a letter to Creative Commons, 171 Second Street, Suite 300, San Francisco, California, 94105, USA.
Sunday, 25 October 2009