InfluxDB Client Libraries and Applications | Miroslav Malecha | Bonitoo

Miroslav Malecha / Product Manager
Bonitoo.io
InfluxDB
Client Libraries
and Applications

© 2019 InfluxData. All rights reserved. 2
SW Engineering Company
● InfluxData consulting partner
Delivered Client Libraries and other deliverables
● End-to-end R&D Services (architecture, agile development,
documentation, support, hosting, operation)
● Strong team of professionals (development for SaaS Startups,
Enterprise Software, Mobile applications)
Technologies
● Java, JS, C#, Python, SQL, ML
https://github.com/bonitoo-io

● Client Libraries
○ Java & Spring integration
○ C#
○ Python
● Embedded analytics
Agenda

Clustered
InfluxDB Data Flow
InfluxDB 2
Time Series Database
Telegraf
Agent for Collecting and
Reporting Metrics and
Events
210+ plugins
System
Stats
Databases
Networking
Message
Queues
Apps
Apps/IoT
Apps/
IoT
InfluxDB
Client
Java
.NET
Python
HTTP GET/POST
1.
2.
3.

Benefits of Client Libraries
● Performance/Reliability
○ Client write ~50 times faster* than HTTP POST approach
○ Batching, Jittering, Retriable, Backpressure
● Customization & Easy to use
○ Interface vs study format and build API messages manually
○ Error handling - HTTP codes vs standard exceptions and listeners
○ 3rd party application monitoring systems integration (Micrometer.io)
● Management API Support
○ Configure InfluxData Cloud
● Compatibility
○ Stable libraries interface developed by InfluxData
*) InfluxDB Java Client, 2 CPUs, 16GB RAM, 2.000 threads, 100 lines per write for both methods

InfluxDB 2
Java Client Library

Java Client Library
NEW Client for InfluxDB 2 (replacement of Java Client for InfluxDB 1.x)
● Github repo: https://github.com/influxdata/influxdb-client-java
● Capabilities: Query, Write, Management, Security, Reactive streams
● Uses RxJava library (automated Batching, Jittering, Retriable, Backpressure)
● Improved data types support
Extensions
● Support Kotlin, Scala (Akka Streams)
● Flux queries support for InfluxDB 1.7+
● Flux-DSL query builder (Flux language in Java code)
Replaces custom fast ingress solutions such as Hystrix, etc.
Flux sampleFlux = Flux.from("telegraf")
.range(-1L, ChronoUnit.DAYS)
.filter(
Restrictions.and(
Restrictions.measurement().equal("cpu"),
Restrictions.field().equal("usage_system"))
)
.sample(5, 1);

Write API Configuration
Configuration parameters similar to Telegraf
InfluxDBClient client = InfluxDBClientFactory.create("http://localhost:9999", "my-token".toCharArray());
WriteApi writeApi = client.getWriteApi(WriteOptions.builder()
.batchSize(5000)
.flushInterval(1000)
.jitterInterval(1000)
.bufferLimit(10000)
.retryInterval(5000)
.backpressureStrategy(BackpressureOverflowStrategy.DROP_OLDEST)
.build());

Write Data
Write by POJO (annotated measures)
Write By Point
Write Line Protocol
Temperature temperature = new Temperature();
temperature.setLocation("south");
temperature.setValue(62D);
temperature.setTime(Instant.now());
writeApi.writeMeasurement("my-bucket", "my-org", WritePrecision.NS, temperature);
Point point = Point.measurement("temperature")
.addTag("location","west")
.addField("value", 55D)
.time(Instant.now().toEpochMilli(), WritePrecision.NS);
writeApi.writePoint("my-bucket", "my-org", point);
String record = "temperature,location=north value=60.0";
writeApi.writeRecord("my-bucket", "my-org", WritePrecision.NS, record);

Query InfluxDB
Asynchronous querying using Flux
InfluxDBClientOptions clientOptions = InfluxDBClientOptions.builder()
.url("http://localhost:9999").authenticate Token("my-token".toCharArray()).org("my-org")
.build();
InfluxDBClient client = InfluxDBClientFactory.create(clientOptions);
String fluxQuery = "from(bucket: "my-bucket")n"
+ " |> range(start: -1d)"
+ " |> filter(fn: (r) => (r._measurement == "cpu" and r._field == "usage_system"))"
+ " |> sample(n: 5, pos: 1)";
QueryApi queryApi = client.getQueryApi();
queryApi.query(
fluxQuery, (cancellable, record) -> {
// process the flux query result record
System.out.println(
record.getTime() + ": " + record.getValue());
}, error -> {
// error handling while processing result
error.printStackTrace();
}, () -> {
// on complete
System.out.println("Query completed");
});

Advanced Configuration
Set organization, bucket, permissions and authorization
InfluxDBClient influxDBClient = InfluxDBClientFactory.create("http://localhost:9999", "my-
token".toCharArray());
Organization medicalGMBH = influxDBClient.getOrganizationsApi().createOrganization("Medical Corp");
Bucket temperatureBucket = influxDBClient.getBucketsApi().createBucket("temperature-sensors", medicalGMBH);
PermissionResource resource = new PermissionResource();
resource.setId(temperatureBucket.getId());
resource.setOrgID(medicalGMBH.getId());
resource.setType(PermissionResource.TypeEnum.BUCKETS);
Permission readBucket = new Permission();
readBucket.setResource(resource);
readBucket.setAction(Permission.ActionEnum.READ);
Permission writeBucket = new Permission();
writeBucket.setResource(resource);
writeBucket.setAction(Permission.ActionEnum.WRITE);
Authorization authorization = influxDBClient.getAuthorizationsApi()
.createAuthorization(medicalGMBH, Arrays.asList(readBucket, writeBucket));
String token = authorization.getToken();
System.out.println("The token to write to temperature-sensors bucket " + token);

InfluxDB integrated into Spring framework
Application framework for Java
Supported autoconfiguration based on class path presence
1) Add Maven dependency
Package com.influxdb.spring.influx - Auto configuration, Health check, Metrics exporter
2) Define Client configuration (application.properties)
<dependency>
<groupId>org.influxdata</groupId>
<artifactId>influxdb-spring</artifactId>
<version>${influxdb-spring.version}</version>
</dependency>
spring.influx2.url=http://localhost:9999
spring.influx2.org=03ea32773f1d0000
spring.influx2.bucket=my-bucket
spring.influx2.token=my-token-123
spring.influx2.username=my-user

Monitor Spring Application using Micrometer.io
Micrometer: metrics collection library included in Spring
● Provides timers, gauges, counters, distribution summaries in your JVM application
● Preconfigured metrics support
1) Define new dependency into the pom.xml
2) Add properties to the application.properties
<dependency>
<groupId>io.micrometer</groupId>
<artifactId>micrometer-registry-influx2</artifactId>
<version>${micrometer.version}</version>
</dependency>
management.metrics.export.influx2.enabled=true
management.metrics.export.influx2.uri=http://localhost:9999/api/v2
management.metrics.export.influx2.org=my-org
management.metrics.export.influx2.bucket=micrometer-bucket
management.metrics.export.influx2.autoCreateBucket=false
management.metrics.export.influx2.token=my-token-123
management.metrics.export.influx2.step=10s

InfluxDB Visualizing APM Data

C# Client Library
● NEW since InfluxDB 2
● Github Repository: https://github.com/influxdata/influxdb-client-csharp
● Same API as the Java Client
● Compatible with Windows IoT Core
● Query API
● Write API - Line Protocol, Data Point, POCO
● Management API - Sources, buckets, tasks, permissions, health check
● Flux queries support for InfluxDB 1.7+

Write Data
influxDB = InfluxDBClientFactory.Create("http://localhost:9999", authorization.Token.ToCharArray());
var writeOptions = WriteOptions
.CreateNew()
.BatchSize(5000)
.FlushInterval(1000)
.JitterInterval(1000)
.RetryInterval(5000)
.Build();
using (var writeClient = influxDB.GetWriteApi(writeOptions))
{
// Write by POCO
var temperature = new Temperature {Location = "south", Value = 62D, Time = DateTime.UtcNow};
writeClient.WriteMeasurement("temperature-sensors", medicalGMBH.Id, WritePrecision.Ns, temperature);
// Write by Point
var point = PointData.Measurement("temperature")
.Tag("location", "west")
.Field("value", 55D)
.Timestamp(DateTime.UtcNow.AddSeconds(-10), WritePrecision.Ns);
writeClient.WritePoint("temperature-sensors", medicalGMBH.Id, point);
// Write by LineProtocol
var record = "temperature,location=north value=60.0";
writeClient.WriteRecord("temperature-sensors", medicalGMBH.Id, WritePrecision.Ns, record);
writeClient.Flush();
}

Query InfluxDB
var options = InfluxDBClientOptions.Builder.CreateNew()
.Url("http://localhost:9999").Org("my-org")
.AuthenticateToken("my-token".ToCharArray()).Build();
var client = InfluxDBClientFactory.Create(options);
var fluxQuery = "from(bucket: "my-bucket")n"
+ " |> range(start: -1d)"
+ " |> filter(fn: (r) => (r._measurement == "cpu" and r._field == "usage_system"))"
+ " |> sample(n: 5, pos: 1)";
var queryApi = client.GetQueryApi();
await queryApi.Query<Cpu>(fluxQuery,
(cancellable, cpu) => // process the flux query records
Console.WriteLine(cpu.ToString());
},
(error) =>
{ // error handling while processing result
Console.WriteLine(error.ToString());
},
() =>
{ // on complete
Console.WriteLine("Query completed");
}
);

InfluxDB 2
Python Client Library (Alpha)

● NEW since InfluxDB 2
● Github Repository: https://github.com/influxdata/influxdb-client-python
● Same API as the Java Client
● Capabilities: Query, Write, Management, Security
● Uses RxPY library
Python Library

Write
import codecs
from datetime import datetime
from influxdb_client import WritePrecision, InfluxDBClient, Point
client = InfluxDBClient(url="http://localhost:9999", token="my-token", org="my-org")
write_api = client.write_api()
p = Point("my_measurement").tag("location", "Prague").field("temperature",25.3).time(datetime.now(),
WritePrecision.MS)
write_api.write(org="my-org", bucket="my-bucket", record=p)

Query
import codecs
from datetime import datetime
from influxdb_client import WritePrecision, InfluxDBClient, Point
client = InfluxDBClient(url="http://localhost:9999", token="my-token", org="my-org")
query_api = client.query_api()
query = '''
from(bucket:"my-bucket")
|> range(start: -1m)
|> filter(fn: (r) => (r._measurement == "cpu" and r._field == "usage_system"))
'''
tables = query_api.query(query)
for table in tables:
print(table)
for record in table.records:
print(record.values)

Embedded Analytics with InfluxDB

Demo Application
Github repo: https://github.com/bonitoo-io/influxdata-iot-petstore
Demo Application
InfluxDB 2 Java Client
InfluxDB 2
Application Data
Spring Services
Vaadin Web Framework
+Vaadin Charts Library
OpenAPI
swagger generated from Java using SpringFox
Micrometer.io
push internal app metric to InfluxDB
App MetricsData
InfluxDB 2
Application Monitoring
micrometer-registry-influx

Predefined UI
● Filters
● Responsive - Mobile devices
● Various chart options - Vaadin
End Users UI

Data Analyst View
Custom Data Explorer
● Visual Flux Builder
● Generates internally Flux queries
● Visualises data
from(bucket: “my-bucket”)
|> range (start: -2d,stop: now() )
|> filter(fn: (r) => r._measurement == “air” )
|> filter(fn: (r) => r._field == “temperature” )
|> filter(fn: (r) => r.location == “Prerov” )
Generated Flux Query

IoT On Device Display
Realtime values
internal sensors data
Aggregated values
Using Flux from InfluxDB 2
Github repo: https://github.com/bonitoo-io/BuildAzure.IoT.Adafruit.BME280

Summary & THANK YOU
New Client Libraries
● For InfluxDB 2
● Java, C#, Python (alpha), Scala and Kotlin Support
○ Query, Write, Management API
○ High performance/reliability write and query
○ Easy to use
● Github repo: https://github.com/influxdata
Embedded analytics
● InfluxDB Client libraries (Query API)
● Demo github repo: https://github.com/bonitoo-io/influxdata-iot-petstore

InfluxDB Client Libraries and Applications | Miroslav Malecha | Bonitoo

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to InfluxDB Client Libraries and Applications | Miroslav Malecha | Bonitoo

Similar to InfluxDB Client Libraries and Applications | Miroslav Malecha | Bonitoo (20)

More from InfluxData

More from InfluxData (20)

Recently uploaded

Recently uploaded (20)

InfluxDB Client Libraries and Applications | Miroslav Malecha | Bonitoo