Alibaba Cloud Intelligence TST
•
•
• SimpleFeature
Geometry
• SimpleFeatureType
• WKT Well-known text
SimpleFeature
- -
• )
• - -
• -
• - -
3
3
3
3
3
-
-
-
-
-
-
0A D D A B D
• 0 H- -, /
Ø H- -, /
Ø A D 1
Ø , 1-
Ø 0EAA BD D B B D B A D E DB D BG D
• 0 H
Ø H
Ø 0E D B - B
Ø , -
Ø 0EAA BD D B DB D BG D
• HBase Ganos is a new generation of Spatio-temporal Data Engine (SDE) based on GeoMesa
and Ali-HBase storage platform.
• Enable large-scale geospatial analytics on cloud and distributed computing systems
• Support data analysis based on Apache Spark using HBase Ganos as the backend datastore.
• Support hot and cold data separation
HBase Ganos HBase Ganos Spark
GeoHash uses interval halving on latitude and longitude to build up a bit-string of alternating
dimensions.
a: Define query region
b: spatial partition
c: calculate query range
•
•
•
•
•
•
Testing Environment: Huabei-2
•Master node 2CPU 4GB (hbase.n1.medium)
•Core node 3 Node 4CPU 8GB (hbase.sn1.2xlarge)
•Writing Thread Num. 10
•Batching Size:1000
•Reading Thread Num. 10
l 6 6A A6
• A3 6
• -
• 3 A D 6 A A 53 3 6 6A
• 4 BA6 5 06 6AD
l - BA6
• % %
• % % A 0 3
• 3 A6 3 A 3 A D 6 A B3 D
• 3 A D 6 5 3 6
• - 3 A 53 3
• GeoMesa Spark allows for execution of jobs on Apache Spark using
data stored in HBase Ganos.
• The library allows creation of Spark RDDs and DataFrames, writing of
Spark RDDs and DataFrames to HBase Ganos.
Global Index:
•Grid
•RTree
•QuadTree
•KDBTree
Local Index:
•QuadTree
•Rtree
SELECT ship_id,ST_PointToTrajectory(ship_id,dtg,geom) AS traj FROM point GROUP BY point.ship_id
SELECT * FROM aispoint WHERE st_contains(st_makeBBOX(114.00000,22.00000,115.00000,23.00000), geom)
|AND dtg between cast('2018-09-08T01:00:00Z' as timestamp) AND cast('2018-09-13T01:00:00Z' as timestamp)
Amount of Points:
985,800,104 Time 53ms
Result count 15
1. Spatial Query
Time 145ms
Result count 7
2. Id and time query
hbaseconasia2019 Spatio temporal Data Management based on Ali-HBase Ganos and its Spark Extension

hbaseconasia2019 Spatio temporal Data Management based on Ali-HBase Ganos and its Spark Extension