Graphistry: Low-code & no-code GPU-accelerated visual graph analytics

G R A P H I S T R Y info@graphistry.com
G R A P H I S T R Y
Low-coding & no-coding GPU-accelerated visual graph analytics
Graph Gurus, 2021
Leo Meyerovich, CEO
@LMeyerov

1. Graph era of visual analytics: Graphistry
2. No-code: Data -> relationship insights in 10s
3. Scale with GPUs: 412GB/s on a single GPU node
4. Low-code apps with graph-app-kit
Today: 100X graph tech
3

Tech
Security, fraud, user analytics, genomics, …
Graph, viz, GPUs, automation
Users
100X VISUAL INVESTIGATIONS

5
(launch graph-app-kit)
GRAPHISTRY

6
Graph era of visual analytics
knowledge graph
neural search
event & log analysis
correlation
high-cardinality
& high-dimensionality
process mining
people analytics
embedding spaces
graph neural nets
Identity graph
dimensionality reduction
workflow automation
graph API
virtual graph
hypergraphs
GPUs
informatics

7
Tables getting longer: Events
Time
More tables: Every co is a tech co
Tables getting wider: Metadata, AI scores, …
Name, Email, IP, ..
IT analyst:
Digital assets & users: Dependencies, activities, ..
Fintech analyst:
Companies, people: Dependencies, trades, …
Product analyst
Users, offerings: Journeys, preferences, …
Security analyst:
User, asset, incident: Timelines and scopes, …
Fraud analyst:
Account, payment: Timeline, pattern, outlier, …
What is my graph of …
Data becoming graph-y
journey
correlation

8
IT analyst:
Digital assets & users: Dependencies, activities, ..
Fintech analyst:
Companies, people: Dependencies, trades, …
Product analyst
Users, offerings: Journeys, preferences, …
Security analyst:
User, asset, incident: Timelines and scopes, …
Fraud analyst:
Account, payment: Timeline, pattern, outlier, …
What is my graph of …
Tabular views hide
the relationship insights
??

9
Visual graph tools
help us work with the
relationships in our data
Understand Explore Collaborate Automate
Visual graph tools
increase data project ROI
& eliminate project risks
Deliver faster Build better Multiply reach

Data Scientist
Notebooks
Dev API for
Embedding
Analyst
Tool Suite
3. Automate
Templatize, link, & embed
1. Connect DBs & APIs
as a unified virtual graph
2. Visual analytics
• 100X via GPUs
• Correlate w/ graph
• Time, histograms, …
Graphistry: Visually answer relationship questions across your data sources
Graphistry Hub (Cloud) Cloud Marketplace On-Prem

11
Demo: Graph investigation of
social media manipulation
in the XRP cryptocurrency community
geoff@socialforensics.com

12
”[OK…] as long as it’s really cool”

13
“I had to wait 2 minutes in
[Tool X] for every little thing,
and now I can see everything,
so I use Graphistry instead”
New: No-code csv  graph

14
Follow for XRP Especially in Japan
… that
are fake
And if inauthentic
XRP
COMMUNITY
SEGMENTATION
… Likely of interest to SBI Holdings,
a Japanese megacorp that then went big on XRP …

15
Big with Arabic
speakers
Who are
inauthentic

16
1 year later…

17
70% of the XRP Arabic accounts were removed due to Twitter’s breach & sweep

18
… Ripple CTO David Schwartz
still has not changed his icon to a robot ...

Graph is powerful
Market & user analysts
✓ More ROI: Find influencers, communities, …
✓ Less waste: Don’t spend on fraudsters, spammers, wrong communities…
Fraud & abuse analysts
✓ Detect & investigate fake accounts & activities
✓ Detect behaviors like abuse, misinformation, …
Graph tech: No code & GPUs
✓ See bigger picture, “I was waiting 2 minutes in <TOOL X> and…”
✓ Enable domain expert to not get bogged down
19

20
data scientist, data engineer, dev, …
scientist, analyst, investigator, …
sales, marketing, trading, ...
Graph is useful for coders + non-coders

21
Embedding APIs
No-code
Low-code create dashboards + automations
supercharge existing tools
Built to multiply the reach & ROI of graph projects

22
Graph low-coding on GPUs
Demo: Windows logs
Graphistry is building the first
RAPIDS-native visual analytics platform

23
your
app
…
graphistry.hypergraph(
cudf.read_csv(‘events.csv’),
entity_types=[‘user’, ‘user_ip’, ‘asset_id’]
)['graph'].plot()
Give an inch, get a mile
 Interactive
 Filters
 Time bar
 Sharing
 Search
 …

24
your
app
…
graphistry.hypergraph(
cudf.read_csv(‘events.csv’),
entity_types=[‘user’, ‘user_ip’, ‘asset_id’]
)['graph'].plot()
# cudf: optional GPU Python lib
# … that devours heavier files
Give an inch, get a mile
 Interactive
 Filters
 Time bar
 Sharing
 Search
 …

25
Launch with everything
ready for 1+ GPUs

26
BENCHMARK
Windows event logs
280M rows
320 GB raw text
44 GB mostly raw parquet
Time column: 1.5GB

27
import cudf
gdf = cudf.read_parquet(‘my_logs.parquet’)
print(“latest time:”, gdf[‘_time’].max())
### Time: 0.6s +/ 0.1s
### Rate: 1.9GB/s
### Rate: 369M rows/s
### PCI is 8GB/s…
Graph low-coding on a GPU: Hello – max time
### already on GPU
gdf[‘_time’].max()
### Time: 3.6ms +/- 720us
### Rate: 412GB/s
### Rate: 78B rows/s
280M timestamps (1.5GB)

28
Graph low-coding on a GPU:
Compute login graph
# Extract table: logins[[ ‘EventCode’, ‘src_NetworkAddress’, ‘dst_ComputerName’]]
gdf['EventCode’] = gdf['_raw'].str.extract(r'EventCode=(d+)').astype('int32’)
logins_gdf = gdf[ gdf['EventCode'] == 4624 ]
logins_gdf['src_NetworkAddress'] = logins['_raw'].str.extract(r'Source Network Address:t(.*)n’)
logins_gdf['dst_ComputerName’] = logins['_raw'].str.extract(r'ComputerName=(.*)n’)
### Rate: 25 GB/s
### Rate: 25M rows/s

29
Graph low-coding
on 8 GPUs
dgdf = dask_cudf.read_parquet(‘logs.parquet’)
is_login = “EventCode=4624”
dgdf[‘_raw’].str.match(is_login).count().compute()
### Time: 37s
### Rate: 1GB/s
### Rate: 8M rows/s
### ~100X below our target

30
Graph low-coding on 8 GPUs:
Compute login graph
… Sign up at hub.graphistry.com to find out!
SSD 1
SSD 2
…
SSD 20
GPU 1 (40GB)
GPU 2 (40GB)
…
GPU 8 (40GB)
120 GB/s
1 STORAGE NODE 1 GPU NODE
300 GB/s
4 NUMA nodes
(the hard part)

31

32
Introducing graph-app-kit

33
Most people are busy so
graph-app-kit helps you
make Easy Buttons

34
…
quicklaunch
connect
low-code
share
G R A P H I S T R
Y

35
privately
script
point-and-click graph apps
(public + private)
…

36
Minimal app
• Name
• Some text
 Auto-loads into app picker
Connector Templates
• CSV
• TigerGraph
• Neptune
• …

37
Pipeline template
Most apps are copy/edit of: Form controls -> run queries & filter -> viz

1. Graph era of visual analytics: Graphistry
2. No-code: Data -> relationship insights in 10s
3. Scale with GPUs: 412GB/s on a single GPU node
4. Low-code apps with graph-app-kit
100X graph platform
38
graphistry.com/get-started
github.com/graphistry/pygraphistry
github.com/graphistry/graph-app-kit
G R A P H I S T R Y
Subscribe, explore, & contribute:

39
graphistry.com/get-started
github.com/graphistry/pygraphistry
github.com/graphistry/graph-app-kit
G R A P H I S T R Y
Subscribe, try, & contribute:

Graphistry: Low-code & no-code GPU-accelerated visual graph analytics

Recommended

Recommended

More Related Content

What's hot

What's hot (14)

Similar to Graphistry: Low-code & no-code GPU-accelerated visual graph analytics

Similar to Graphistry: Low-code & no-code GPU-accelerated visual graph analytics (20)

Recently uploaded

Recently uploaded (20)

Graphistry: Low-code & no-code GPU-accelerated visual graph analytics