Josef Adersberger, profile picture
Uploaded byJosef Adersberger
PDF, PPTX763 views

JEE on DC/OS

The document discusses cloud-native application development using Java EE (JEE), focusing on leveraging microservices and containers for enterprise applications. It highlights the modular and lightweight characteristics of modern JEE, encourages the use of microcontainers for scalable architectures, and covers aspects like service discovery, monitoring, and API management. It also provides practical examples and sample code for implementing these concepts effectively.

Technology◦
Related topics:
cloud-native•

Embed presentation

Download as PDF, PPTX
JEE ON DC/OS 101 AND FUN Dr. Josef Adersberger ( @adersberger)
DC/OS = #GIFEE Google’s
 (and Facebook’s, Twitter’s, Airbnb’s, …)
 Infrastructure
 For
 Everyone
 Else
#GIFEE => Cloud Native Applications
 (apps like Google’s, Facebook’s, …)
TRAFFIC DATA FEATURES AT NO OPPORTUNITY COSTSHORIZONTAL
The second largest monolith on earth!* *) only beaten by the guys who are writing PHP code at large scale
JEE CLOUD
 NATIVE + = CLOUD
 NATIVE
 JEE instagram.com/toby_littledude
JEE IS NEITHER UGLY NOR FOCUSED ON MONOLITHIC APPS ▸ Java EE by itself is modular und lightweight in the recent versions.
 (to be honest: Spring feels more heavyweight than JEE to me from time to time) ▸ Java EE micro containers allow to modularize applications into self-contained runnable units. ▸ How to develop enterprise applications based on Java EE is well understood and knowledge is widespread. ▸ API is mature and standardized. Implementations are battle proven.
JEE CLOUD
 NATIVE + = CLOUD
 NATIVE
 JEE instagram.com/toby_littledude
ARCHITECT’S VIEW CLOUD NATIVE JEE
JEE IS NOT AN OVERALL MONOLITH. BUT PEOPLE TEND TO RUN JEE APPS AS MONOLITHS WITHIN HEAVY WEIGHT APP SERVERS. DESIGN CODE RUN startup-cluster.sh JEE Impl. JEE App Server
JEE MICRO CONTAINER TO THE RESCUE: ENABLING MICROSERVICES ON JEE DESIGN CODE RUN main() JEE impl. parts
A CLOUD OF JEE MICRO CONTAINERS. MISSION ACCOMPLISHED? image: https://www.dreamstime.com
a cloud is not nothing! what’s inside our cloud?
THE CLOUD NATIVE STACK CLOUD NATIVE STACK JEE MICROSERVICES
CLUSTER VIRTUALIZATION (computing, network, storage, memory) CLUSTER RESOURCE MANAGER CLUSTER ORCHESTRATOR APPLICATIONS CONTAINER CLUSTER RESOURCES MICROSERVICE PLATFORM
 API Gateway Micro Container Configuration & Coordination Diagnosability &
 Monitoring Infrastructure-as-a-Service Bare Metal Local Host Service
 Client Service Discovery DevOps Interface ‣ deploy ‣ rollback ‣ scale ‣ configure Diagnose Interface ‣ analyze logs ‣ analyze metrics ‣ analyze traces Edge Interface ‣ request service ‣ authenticate
CLUSTER VIRTUALIZATION (computing, network, storage, memory) CLUSTER RESOURCE MANAGER CLUSTER ORCHESTRATOR APPLICATIONS CONTAINER CLUSTER RESOURCES MICROSERVICE PLATFORM
 API Gateway Micro Container Configuration & Coordination Diagnosability &
 Monitoring Infrastructure-as-a-Service Bare Metal Local Host Service
 Client Service Discovery DevOps Interface ‣ deploy ‣ rollback ‣ scale ‣ configure Diagnose Interface ‣ analyze logs ‣ analyze metrics ‣ analyze traces Edge Interface ‣ request service ‣ authenticate how to provide the right resources for container execution? how to decouple from physical hardware? how to run (containerized) applications on a cluster? how to detect and solve operational anomalies? how to call other microservices resilient and responsive? how to execute a microservice and embed it within the platform? how to provide cluster-wide consensus on config values etc.? how to expose microservice endpoints to the internet? how to manage microservice endpoints within the whole platform?
goo.gl/xrVg3J
CLUSTER VIRTUALIZATION (computing, network, storage, memory) CLUSTER RESOURCE MANAGER CLUSTER ORCHESTRATOR APPLICATIONS CONTAINER CLUSTER RESOURCES MICROSERVICE PLATFORM
 API Gateway Micro Container Configuration & Coordination Diagnosability &
 Monitoring Infrastructure-as-a-Service Bare Metal Local Host Service
 Client Service Discovery DevOps Interface Diagnose InterfaceEdge Interface
THE ZWITSCHER JEE SHOWCASE ZWITSCHER-APP-HISTORY ZWITSCHER-APP-WIKIPEDIAZWITSCHER-APP-CHUCK ZWITSCHER-APP-BOARD keyword results + keyword history random joke
 (because every chuck norris joke matches on every keyword) JDBC Open API ZWITSCHER-APP-CHUCK fallback https://github.com/adersberger/cloud-native-zwitscher-jee
DEVELOPER’S VIEW CLOUD NATIVE JEE 101
MICRO CONTAINERDEPENDENCY INJECTION APPLICATION LIFECYCLE ENDPOINT EXPOSITION
THE JEE MICRO CONTAINER ECOSYSTEM http://wildfly-swarm.io https://ee.kumuluz.com http://microprofile.io (to come) http://tomee.apache.org http://www.payara.fish/payara_micro EMBEDDED implements (unstable)
JEE MICRO CONTAINER COMPARISON CHART Payara Micro Wildfly Swarm TomEE+ kumuluzEE Servlets et al. x x x x WebSockets x x x JSF x x x JAX-RS x x x x JAX-WS x x EJB *2 x x x CDI x x x x JTA x x x JCA x x JMS x x JPA x x x x Bean Validation x x x x JBatch x x Concurrency x x JCache x x JEE version JEE 7 JEE 7 JEE 6, JEE 7 part.*1 JEE 7 part. Packaging WAR + JAR JAR JAR classes + JARs Startup time 4s 4s 2s 1s Size 57MB 83 MB 44 MB 15 MB *1) http://tomee.apache.org/javaee7-status.html *2) http://stackoverflow.com/questions/13487987/where-to-use-ejb-3-1-and-cdi
@Path(“/joke") @RequestScoped
 public class ChuckJokeResource {
 @Inject
 private IcndbIntegration icndb;
 @GET
 @Produces("application/json")
 public Response getJoke() {
 Map<String, String> json = new HashMap<>();
 json.put("message", icndb.getRandomJoke());
 return Response.ok(json).build();
 }
 } @ApplicationPath("/chuck")
 public class ChuckJokeApplication extends ResourceConfig {
 public ChuckJokeApplication() {
 super(); register(ChuckJokeResource.class);
 }
 } JAX-RS WITH CDI bean-discovery-mode="all"
public class Main {
 
 /**
 * Starts the microservice container.
 *
 * Requires environment variable "PORT" according
 * on what port to listen.
 *
 * @param args no arguments evaluated
 */
 public static void main(String[] args) {
 com.kumuluz.ee.EeApplication.main(args);
 }
 } JEE MICRO CONTAINER STARTUP
TESTING @RunWith(CdiTestRunner.class)
 public class TestChuckJokeResource {
 
 @Inject
 private ChuckJokeResource chuckJokeResource;
 
 @Test
 public void testChuckJokeResource() {
 Response response = chuckJokeResource.getJoke();
 assertThat( response.getStatusInfo().getStatusCode(), equalTo(200));
 }
 }
SERVICE CLIENTSERVICE DISCOVERY LOAD BALANCING REQUEST MONITORING CIRCUIT BREAKING
SERVICE CLIENT WITH JERSEY, RXJAVA AND HYSTRIX ‣ Circuit Breaker (Resiliency) ‣ Request Monitoring ‣ JAX-RS 2.0 compliant REST clients‣ Parallel & async execution 
 (Responsive)
SERVICE CLIENT WITH JERSEY, RXJAVA AND HYSTRIX @RequestScoped
 public class IcndbIntegration implements IChuckNorrisJokes {
 
 @Override public String getRandomJoke() {
 IcndbIntegrationCommand cmd = new IcndbIntegrationCommand();
 return cmd.observe().toBlocking().toFuture().get();
 }
 
 private class IcndbIntegrationCommand extends HystrixObservableCommand<String> {
 
 IcndbIntegrationCommand() {
 super(Setter.withGroupKey(HystrixCommandGroupKey.Factory.asKey("zwitscher"))
 .andCommandPropertiesDefaults(HystrixCommandProperties.Setter()
 .withExecutionTimeoutInMilliseconds(3000)));
 }
 
 @Override protected Observable<String> construct() {
 return RxObservable.newClient()
 .target("http://api.icndb.com").path("jokes/random").request(MediaType.APPLICATION_JSON_TYPE)
 .rx().get()
 .map(response -> {
 Map<String, Map<String, String>> json = response.readEntity(Map.class);
 return json.get("value").get("joke");
 });
 }
 }
 }
FALLBACK JOKES @RequestScoped
 public class IcndbIntegration implements IChuckNorrisJokes { @Inject @Named("chucknorrisjoke-chucknorrisio")
 private IChuckNorrisJokes fallback; @Override public Observable<String> getRandomJokeObservable() { 
 return new IcndbIntegrationCommand().observe(); }
 
 //…
 
 private class IcndbIntegrationCommand extends HystrixObservableCommand<String> {
 
 //…
 
 @Override
 protected Observable<String> resumeWithFallback() {
 return fallback.getRandomJokeObservable();
 }
 }
 }
MONITORING & DIAGNOSABILITYCOLLECT, STORE, ANALYZE METRICS COLLECT, STORE, ANALYZE LOGS COLLECT, STORE, ANALYZE TRACES DASHBOARDING & ALERTING
THE MAGIC DIAGNOSABILITY TRIANGLE Metrics Logs Traces Cluster-wide
 Diagnosis
DIAGNOSABILITY BIG PICTURE DROPWIZARD METRICS JERSEY HYSTRIX SLF4J MICRO SERVICE PROMETHEUS SERVLET METRICS SERVLET HYSTRIX SERVLET Dashboard / Turbine Health 
 Checks Service
 Lookup
INSTRUMENTING THE MICROSERVICE WITH DROPWIZARD METRICS @ApplicationPath("/chuck")
 public class ChuckJokeApplication extends ResourceConfig {
 public ChuckJokeApplication() {
 super();
 //Instrument application with metrics
 MetricRegistry METRIC_REGISTRY = MetricsProvider.getMetricRegistryInstance();
 register(new InstrumentedResourceMethodApplicationListener(METRIC_REGISTRY));
 HystrixPlugins.getInstance().registerMetricsPublisher(
 new HystrixCodaHaleMetricsPublisher(METRIC_REGISTRY));
 //Register Prometheus metric exporter
 CollectorRegistry.defaultRegistry.register(new DropwizardExports(METRIC_REGISTRY));
 }
 } Instrument inbound REST calls Instrument outbound REST calls Export all metrics to Prometheus Obtain the singleton Metric Registry
HYSTRIX DASHBOARD
SERVICE DISCOVERYSERVICE REGISTRATION SERVICE LOOKUP SERVICE HEALTH CHECKING & API GATEWAYAPI EXPOSITION & REQUEST ROUTING AUTHENTICATION & AUTORISATION LOAD BALANCING & SHEDDING RATE LIMITING REQUEST MONITORING & AUDITING
THE BIG PICTURE MICRO SERVICE SERVICE DISCOVERY register 
 web-facing 
 services lookup 
 internal 
 endpoints web requests lookup routes API GATEWAY health
 checks (metrics servlet) java.security.Security.setProperty("networkaddress.cache.ttl", "0" );
SERVICE REGISTRATION WITHIN A JEE MICROSERVICE @ApplicationPath("/chuck")
 public class ChuckJokeApplication extends ResourceConfig {
 
 @Inject
 public ChuckJokeApplication(
 @ConsulFabio IServiceDiscovery serviceDiscovery) {
 super();
 //Register service
 serviceDiscovery.registerService( "zwitscher-chuck", "/chuck/joke");
 }
 } Service Name URL Path to Service
SERVICE REGISTRATION: THE HEAVY LIFTING /**
 * Registeres a service
 *
 * see https://github.com/eBay/fabio/wiki/Service-Configuration
 */
 public synchronized void registerService(String serviceName, String servicePath) {
 
 String applicationHost = getOutboundHost();
 int applicationPort = getOutboundPort();
 HostAndPort consulEndpoint = getConsulHostAndPort();
 logger.info("Will register service on host {} and port {} at consul endpoint {}",
 applicationHost, applicationPort, consulEndpoint.toString());
 
 //generate unique serviceId
 String serviceId = serviceName + "-" + applicationHost + ":" + applicationPort;
 String fabioServiceTag = "urlprefix-" + servicePath;
 
 //point healthcheck URL to dropwizard metrics healthcheck servlet
 URL serviceUrl = UrlBuilder.empty()
 .withScheme("http")
 .withHost(applicationHost)
 .withPort(applicationPort)
 .withPath("/metrics/ping").toUrl();
 
 // Service bei Consul registrieren inklusive einem Health-Check auf die URL des REST-Endpunkts.
 logger.info("Registering service with ID {} and NAME {} with healthcheck URL {} and inbound ROUTE {}",
 serviceId, serviceName, serviceUrl, fabioServiceTag);
 
 //use consul API to register service
 ConsulClient client = new ConsulClient(consulEndpoint.toString());
 NewService service = new NewService();
 service.setId(serviceId);
 service.setName(serviceName);
 service.setPort(applicationPort);
 service.setAddress(applicationHost);
 List<String> tags = new ArrayList<>();
 tags.add(fabioServiceTag);
 service.setTags(tags);
 //register health check
 NewService.Check check = new NewService.Check();
 check.setHttp(serviceUrl.toString());
 check.setInterval(ConsulFabioServiceDiscovery.HEALTHCHECK_INTERVAL + "s");
 service.setCheck(check);
 client.agentServiceRegister(service);
 }
 
 public static String getOutboundHost() {
 String hostName = System.getenv(HOSTNAME_ENVVAR);
 String host = System.getenv(HOST_ENVVAR);
 if (hostName == null && host == null) return DEFAULT_HOST;
 else if (host != null) return host;
 else {
 File etcHosts = new File("/etc/hosts");
 List<String> lines;
 try {
 lines = Files.readLines(etcHosts, Charset.defaultCharset());
 } catch (IOException e) {
 return DEFAULT_HOST;
 }
 for (String line: lines){
 if (!line.trim().startsWith("#") && !line.trim().isEmpty()) {
 String[] etcEntry = line.split("s+");
 if (etcEntry[1].equals(hostName)) return etcEntry[0];
 }
 }
 return DEFAULT_HOST;
 }
 }
 
 public static int getOutboundPort() {
 String portEnv = System.getenv(PORT_ENVVAR);
 if (portEnv == null) return DEFAULT_PORT;
 return Integer.valueOf(portEnv);
 }
 
 public static HostAndPort getConsulHostAndPort() {
 String consulEnv = System.getenv(CONSUL_ENVVAR);
 if (consulEnv == null) return HostAndPort.fromString(CONSUL_DEFAULT_HOSTANDPORT);
 else return HostAndPort.fromString(consulEnv);
 } @ConsulFabio
 @ApplicationScoped
 public class ConsulFabioServiceDiscovery implements IServiceDiscovery { figure out Consul-visible host name and port compose health check add meta data for Fabio register service at Consul 
 (as well as API doc and diagnosability endpoints)
ET VOILA: CONSUL (STARTING 3 INSTANCES)
ET VOILA: FABIO
APPOP’S VIEW CLOUD NATIVE JEE
SELF-DELIVERING SOFTWARE RUNNING
 TESTED
 SOFTWARE
 INCREMENT EVERYTHING AS CODE: ‣ codes application ‣ codes tests ‣ codes infrastructure ‣ codes delivery workflow{ }
FOCUS ON SHORT ROUND TRIPS WITH MULTIPLE RUN MODES In-Process Local Cluster Remote Cluster ‣ longer round trip time ‣ but: more realistic Group with dependencies: Single applications:
MARATHON APP DEFINITION {
 "id": "/zwitscher",
 "groups": [
 {
 "id": "/zwitscher/infrastructure",
 "apps": [
 {
 "id": "consul",
 "cpus": 1,
 "mem": 256,
 "disk": 0,
 "instances": 1,
 "cmd": "/bin/consul agent -server -ui -advertise=$HOST -config-dir=/config -data-dir=/tmp/consul -bootstrap-expect=1 -node=consul-server -client=0.0.0.0",
 "container": {
 "docker": {
 "image": "gliderlabs/consul-server:0.6",
 "forcePullImage": true,
 "privileged": false,
 "network": "HOST",
 "portDefinitions": [
 { "port": 8300, "protocol": "tcp", "name": "server-rpc" },
 { "port": 8301, "protocol": "tcp", "name": "serf-lan" },
 { "port": 8302, "protocol": "tcp", "name": "serf-wan" },
 { "port": 8400, "protocol": "tcp", "name": "cli-rpc" },
 { "port": 8500, "protocol": "tcp", "name": "http-api" },
 { "port": 8600, "protocol": "udp", "name": "dns" }
 ],
 "requirePorts" : true
 }
 },
 "env": {
 "GOMAXPROCS": "10"
 },
 "healthChecks": [
 {
 "protocol": "HTTP",
 "port": 8500,
 "path": "/v1/status/leader",
 "intervalSeconds": 10,
 "timeoutSeconds": 10,
 "maxConsecutiveFailures": 3
 }
 ]
 },
 {
 "id": "fabio",
 "cpus": 1,
 "mem": 256,
 "disk": 0,
 "instances": 1,
 "env": {
 "registry_consul_addr": "consul.infrastructure.zwitscher.marathon.mesos:8500"
 },
 "container": {
 "docker": {
 "image": "magiconair/fabio:latest",
 "forcePullImage": true,
 "privileged": false,
 "network": "HOST",
 "portDefinitions": [
 { "port": 9998, "protocol": "tcp", "name": "web-ui" },
 { "port": 9999, "protocol": "tcp", "name": "proxy-port" }
 ],
 "requirePorts" : true
 }
 },
 "acceptedResourceRoles":["slave_public"],
 "healthChecks": [
 {
 "protocol": "HTTP",
 "port": 9998,
 "path": "/health",
 "intervalSeconds": 10,
 "timeoutSeconds": 10,
 "maxConsecutiveFailures": 3
 }
 ]
 }
 ]
 },
 {
 "id": "/zwitscher/services",
 "apps": [
 {
 "id": "zwitscher-chuck",
 "cpus": 1,
 "mem": 256,
 "disk": 0,
 "instances": 1,
 "container": {
 "docker": {
 "image": "adersberger/zwitscher-app-chuck:1.0.0-SNAPSHOT",
 "forcePullImage": true,
 "privileged": false,
 "network": "HOST",
 "portDefinitions": [
 { "port": 12340, "protocol": "tcp", "name": "rest-api" }
 ],
 "requirePorts" : true
 }
 },
 "env": {
 "PORT": "12340",
 "CONSUL": "consul.infrastructure.zwitscher.marathon.mesos:8500",
 "CONFIG_ENV" : "zwitscher"
 },
 "args": [
 "-Xmx256m"
 ],
 "healthChecks": [
 {
 "protocol": "HTTP",
 "port": 12340,
 "path": "/metrics/ping",
 "intervalSeconds": 10,
 "timeoutSeconds": 10,
 "maxConsecutiveFailures": 3
 }
 ],
 "dependencies": [
 "/zwitscher/infrastructure/consul"
 ]
 }
 ]
 }
 ]
 } marathon-appgroup.json /zwitscher /infrastructure /consul /fabio /service /zwitscher-chuck dependency "healthChecks": [
 {
 "protocol": “HTTP", "port": 9998, "path": "/health",
 "intervalSeconds": 10, "timeoutSeconds": 10, "maxConsecutiveFailures": 3
 }
 ] Define health checks for every app: "network": "HOST",
 "ports": [9998, 9999],
 "requirePorts" : true HOST networking (so that Mesos-DNS works) with fixed ports: "acceptedResourceRoles":["slave_public"] Run API gateway on public slave (accessible from www): "env": {
 "PORT": "12340",
 "CONSUL": "consul.infrastructure.zwitscher.marathon.mesos:8500"
 },
 "args": ["-Xmx256m"] Configuration @ startup with env vars and args: "container": { "docker": {
 "image": "adersberger/zwitscher-app-chuck:1.0.0-SNAPSHOT",
 "forcePullImage": true forcePullImage = true to get the latest pushed docker image: "dependencies": [ "/zwitscher/infrastructure/consul"] Yes, sometimes you need dependencies (but you should avoid them to get more resilient):
SUMMARY CLOUD NATIVE JEE
CLOUD NATIVE JEE 101 SUMMARY ▸ Implementing JEE microservices on DC/OS is simple & fun. ▸ The JEE APIs are out of the box not cloud native but can easily be enhanced with the required functionality. You can use our JCloudEE util classes to glue JEE together with cloud native tech.
 
 
 
 
 ▸ Short round trip times are essential to be productive. You need full portability and automation from local host up to the cloud.
FUN! CLOUD NATIVE JEE
https://github.com/qaware/kubepad ‣ First things first: Will be renamed to 
 CloudPad soon! ‣ Controlling a DC/OS cluster 
 with a DJ pad. ‣ Written in fancy Kotlin. ‣ Turned out to be really helpful for cloud native newbies to better grasp cluster orchestration. ‣ Kicky colored lights and well-hidden snake game easter egg. Set colors with app label.
MESSAGING JEE ON DC/OS 201 SNEAK PREVIEW SECURITY WEB USER INTERFACE STATEFUL SERVICES
TWITTER.COM/QAWARE - SLIDESHARE.NET/QAWARE Thank you! Questions? josef.adersberger@qaware.de @adersberger https://github.com/adersberger/cloud-native-zwitscher-jee
BONUS SLIDES
CONFIGURATION & COORDINATIONKEY-VALUE STORE NOTIFICATIONS, EVENTS LOCKS LEADER ELECTIONS
READING CONFIGURATION VALUES @Inject
 private ConfigurationProvider config;
 //…
 String messageTag = config.getProperty("messageTag", String.class); try to read config value in Consul fallback to file if Consul is not available or no config value is set in Consul
THE CONSUL AGENT AND CONFIG ENVIRONMENT CAN BE SET WITH A ENV VAR. "env": {
 "CONFIG_ENV" : "zwitscher"
 } The config environment (e.g. “zwitscher”, “zwitscher-test”, “zwitscher-prod”). Refers to 
 a path in Consul or to a local path where the config file is.
MONITORING & DIAGNOSABILITYCOLLECT, STORE, ANALYZE METRICS COLLECT, STORE, ANALYZE LOGS COLLECT, STORE, ANALYZE TRACES DASHBOARDING & ALERTING
CUSTOM INSTRUMENTATIONS ▸ Logging
 
 ▸ Business Metrics
 
 
 
 ▸ Timers @Inject
 private Logger logger; @ApplicationScoped
 public class Slf4jLoggerProvider {
 
 @Produces
 public Logger produceLogger(InjectionPoint injectionPoint) {
 return LoggerFactory.getLogger(
 injectionPoint.getMember() .getDeclaringClass() .getName());
 }
 
 } @Inject
 MetricRegistry metrics;
 
 //…
 
 metrics.counter("fun counter").inc(); @GET
 @Timed
 @Produces("application/json")
 public Response getJoke() { //…

More Related Content

PDF
Chronix: Long Term Storage and Retrieval Technology for Anomaly Detection in ...
byFlorian Lautenschlager
 
PDF
Time Series Processing with Solr and Spark
byJosef Adersberger
 
PDF
Chronix Poster for the Poster Session FAST 2017
byFlorian Lautenschlager
 
PDF
A Fast and Efficient Time Series Storage Based on Apache Solr
byQAware GmbH
 
PDF
The new time series kid on the block
byFlorian Lautenschlager
 
PDF
Time Series Processing with Apache Spark
byJosef Adersberger
 
PDF
Efficient and Fast Time Series Storage - The missing link in dynamic software...
byFlorian Lautenschlager
 
PDF
Lessons from Cassandra & Spark (Matthias Niehoff & Stephan Kepser, codecentri...
byDataStax
 
Chronix: Long Term Storage and Retrieval Technology for Anomaly Detection in ...
byFlorian Lautenschlager
 
Time Series Processing with Solr and Spark
byJosef Adersberger
 
Chronix Poster for the Poster Session FAST 2017
byFlorian Lautenschlager
 
A Fast and Efficient Time Series Storage Based on Apache Solr
byQAware GmbH
 
The new time series kid on the block
byFlorian Lautenschlager
 
Time Series Processing with Apache Spark
byJosef Adersberger
 
Efficient and Fast Time Series Storage - The missing link in dynamic software...
byFlorian Lautenschlager
 
Lessons from Cassandra & Spark (Matthias Niehoff & Stephan Kepser, codecentri...
byDataStax
 

What's hot

PDF
Beyond the Query – Bringing Complex Access Patterns to NoSQL with DataStax - ...
byStampedeCon
 
PPTX
MongoDB Chunks - Distribution, Splitting, and Merging
byJason Terpko
 
PDF
Escape from Hadoop: Ultra Fast Data Analysis with Spark & Cassandra
byPiotr Kolaczkowski
 
PDF
Spark Streaming with Cassandra
byJacek Lewandowski
 
PPTX
Massively Scalable Real-time Geospatial Data Processing with Apache Kafka and...
byPaul Brebner
 
PPTX
MongoDB - Sharded Cluster Tutorial
byJason Terpko
 
PDF
Zero to Streaming: Spark and Cassandra
byRussell Spitzer
 
PPTX
Sharded cluster tutorial
byAntonios Giannopoulos
 
PDF
Building a Fast, Resilient Time Series Store with Cassandra (Alex Petrov, Dat...
byDataStax
 
PPTX
Triggers In MongoDB
byJason Terpko
 
PDF
Using MongoDB with Kafka - Use Cases and Best Practices
byAntonios Giannopoulos
 
PPTX
New Indexing and Aggregation Pipeline Capabilities in MongoDB 4.2
byAntonios Giannopoulos
 
PDF
Cassandra is great but how do I test my application?
byChristopher Batey
 
PPTX
Michael Häusler – Everyday flink
byFlink Forward
 
PPTX
Massively Scalable Real-time Geospatial Data Processing with Apache Kafka and...
byPaul Brebner
 
PDF
Spark and Cassandra 2 Fast 2 Furious
byRussell Spitzer
 
PDF
Jörg Schad - Hybrid Cloud (Kubernetes, Spark, HDFS, …)-as-a-Service - Codemot...
byCodemotion
 
Beyond the Query – Bringing Complex Access Patterns to NoSQL with DataStax - ...
byStampedeCon
 
MongoDB Chunks - Distribution, Splitting, and Merging
byJason Terpko
 
Escape from Hadoop: Ultra Fast Data Analysis with Spark & Cassandra
byPiotr Kolaczkowski
 
Spark Streaming with Cassandra
byJacek Lewandowski
 
Massively Scalable Real-time Geospatial Data Processing with Apache Kafka and...
byPaul Brebner
 
MongoDB - Sharded Cluster Tutorial
byJason Terpko
 
Zero to Streaming: Spark and Cassandra
byRussell Spitzer
 
Sharded cluster tutorial
byAntonios Giannopoulos
 
Building a Fast, Resilient Time Series Store with Cassandra (Alex Petrov, Dat...
byDataStax
 
Triggers In MongoDB
byJason Terpko
 
Using MongoDB with Kafka - Use Cases and Best Practices
byAntonios Giannopoulos
 
New Indexing and Aggregation Pipeline Capabilities in MongoDB 4.2
byAntonios Giannopoulos
 
Cassandra is great but how do I test my application?
byChristopher Batey
 
Michael Häusler – Everyday flink
byFlink Forward
 
Massively Scalable Real-time Geospatial Data Processing with Apache Kafka and...
byPaul Brebner
 
Spark and Cassandra 2 Fast 2 Furious
byRussell Spitzer
 
Jörg Schad - Hybrid Cloud (Kubernetes, Spark, HDFS, …)-as-a-Service - Codemot...
byCodemotion
 

Viewers also liked

PDF
Soa with consul
byRajesh Sharma
 
PDF
Simple REST with Dropwizard
byAndrei Savu
 
PDF
Production Ready Web Services with Dropwizard
bysullis
 
PDF
Dropwizard Spring - the perfect Java REST server stack
byJacek Furmankiewicz
 
PDF
Dropwizard and Groovy
bytomaslin
 
PPTX
Dropwizard Introduction
byAnthony Chen
 
PDF
WildFly Swarm: Criando Microservices com Java EE 7
byGeorge Gastaldi
 
PDF
Simple REST-APIs with Dropwizard and Swagger
byLeanIX GmbH
 
PDF
Dropwizard
byScott Leberknight
 
PPTX
J1 2015 "Building a Microservice Ecosystem: Some Assembly Still Required"
byDaniel Bryant
 
PDF
Cloud Native Microservices with Spring Cloud
byConor Svensson
 
PDF
promgen - prometheus managemnet tool / simpleclient_java hacks @ Prometheus c...
byTokuhiro Matsuno
 
ODP
Microservice Architecture JavaCro 2015
byNenad Pecanac
 
PDF
Spring IO 2016 - Spring Cloud Microservices, a journey inside a financial entity
byToni Jara
 
PPTX
Building REST APIs with Spring Boot and Spring Cloud
byKenny Bastani
 
PDF
Microservices - java ee vs spring boot and spring cloud
byBen Wilcock
 
PDF
Service discovery in a microservice architecture using consul
byJos Dirksen
 
PDF
Power, patterns and pains of microservices
byMarcos Barbero
 
PDF
DockerCon SF 2015: Enabling Microservices @Orbitz
byDocker, Inc.
 
PPTX
Service Discovery using etcd, Consul and Kubernetes
bySreenivas Makam
 
Soa with consul
byRajesh Sharma
 
Simple REST with Dropwizard
byAndrei Savu
 
Production Ready Web Services with Dropwizard
bysullis
 
Dropwizard Spring - the perfect Java REST server stack
byJacek Furmankiewicz
 
Dropwizard and Groovy
bytomaslin
 
Dropwizard Introduction
byAnthony Chen
 
WildFly Swarm: Criando Microservices com Java EE 7
byGeorge Gastaldi
 
Simple REST-APIs with Dropwizard and Swagger
byLeanIX GmbH
 
Dropwizard
byScott Leberknight
 
J1 2015 "Building a Microservice Ecosystem: Some Assembly Still Required"
byDaniel Bryant
 
Cloud Native Microservices with Spring Cloud
byConor Svensson
 
promgen - prometheus managemnet tool / simpleclient_java hacks @ Prometheus c...
byTokuhiro Matsuno
 
Microservice Architecture JavaCro 2015
byNenad Pecanac
 
Spring IO 2016 - Spring Cloud Microservices, a journey inside a financial entity
byToni Jara
 
Building REST APIs with Spring Boot and Spring Cloud
byKenny Bastani
 
Microservices - java ee vs spring boot and spring cloud
byBen Wilcock
 
Service discovery in a microservice architecture using consul
byJos Dirksen
 
Power, patterns and pains of microservices
byMarcos Barbero
 
DockerCon SF 2015: Enabling Microservices @Orbitz
byDocker, Inc.
 
Service Discovery using etcd, Consul and Kubernetes
bySreenivas Makam
 

Similar to JEE on DC/OS

PDF
Automated scaling of microservice stacks for JavaEE applications - JEEConf 2017
byJelastic Multi-Cloud PaaS
 
PDF
JEEconf 2017
byIhor Kolodyuk
 
PPTX
Modern application development with oracle cloud sangam17
byVinay Kumar
 
PDF
Automated Scaling of Microservice Stacks for JavaEE Applications
byJelastic Multi-Cloud PaaS
 
PPTX
Microservices on Application Container Cloud Service
byMaarten Smeets
 
PPTX
Microservices with kubernetes @190316
byJupil Hwang
 
PDF
Microservices - not just with Java
byEberhard Wolff
 
PPTX
A first Draft to Java Configuration
byAnatole Tresch
 
PPTX
Are you ready for cloud-native Java?
byGraham Charters
 
PDF
SpringBoot and Spring Cloud Service for MSA
byOracle Korea
 
PDF
Spring Cloud: Why? How? What?
byOrkhan Gasimov
 
PDF
A Hitchhiker's Guide to Cloud Native Java EE
byMario-Leander Reimer
 
PDF
A Hitchhiker's Guide to Cloud Native Java EE
byQAware GmbH
 
PPTX
"The Cloud Native Enterprise is Coming"
byJames Watters
 
PPTX
Geode Performance Architecture for the Agile Enterprise Using Cloud Native API's
byVMware Tanzu
 
PPTX
JCON_15FactorWorkshop.pptx
byGrace Jansen
 
PPTX
Amazon Webservices for Java Developers - UCI Webinar
byCraig Dickson
 
PDF
Effective out-of-container Integration Testing
bySam Brannen
 
PDF
Easy integration of Bluemix services with your applications
byJack-Junjie Cai
 
PPTX
High Performance Cloud Native APIs Using Apache Geode
byVMware Tanzu
 
Automated scaling of microservice stacks for JavaEE applications - JEEConf 2017
byJelastic Multi-Cloud PaaS
 
JEEconf 2017
byIhor Kolodyuk
 
Modern application development with oracle cloud sangam17
byVinay Kumar
 
Automated Scaling of Microservice Stacks for JavaEE Applications
byJelastic Multi-Cloud PaaS
 
Microservices on Application Container Cloud Service
byMaarten Smeets
 
Microservices with kubernetes @190316
byJupil Hwang
 
Microservices - not just with Java
byEberhard Wolff
 
A first Draft to Java Configuration
byAnatole Tresch
 
Are you ready for cloud-native Java?
byGraham Charters
 
SpringBoot and Spring Cloud Service for MSA
byOracle Korea
 
Spring Cloud: Why? How? What?
byOrkhan Gasimov
 
A Hitchhiker's Guide to Cloud Native Java EE
byMario-Leander Reimer
 
A Hitchhiker's Guide to Cloud Native Java EE
byQAware GmbH
 
"The Cloud Native Enterprise is Coming"
byJames Watters
 
Geode Performance Architecture for the Agile Enterprise Using Cloud Native API's
byVMware Tanzu
 
JCON_15FactorWorkshop.pptx
byGrace Jansen
 
Amazon Webservices for Java Developers - UCI Webinar
byCraig Dickson
 
Effective out-of-container Integration Testing
bySam Brannen
 
Easy integration of Bluemix services with your applications
byJack-Junjie Cai
 
High Performance Cloud Native APIs Using Apache Geode
byVMware Tanzu
 

More from Josef Adersberger

PDF
Into the cloud, you better fly by sight
byJosef Adersberger
 
PDF
Serverless containers … with source-to-image
byJosef Adersberger
 
PDF
The need for speed – transforming insurance into a cloud-native industry
byJosef Adersberger
 
PDF
The good, the bad, and the ugly of migrating hundreds of legacy applications ...
byJosef Adersberger
 
PDF
Patterns and Pains of Migrating Legacy Applications to Kubernetes
byJosef Adersberger
 
PDF
Istio By Example (extended version)
byJosef Adersberger
 
PDF
Docker und Kubernetes Patterns & Anti-Patterns
byJosef Adersberger
 
PDF
The Good, the Bad and the Ugly of Migrating Hundreds of Legacy Applications ...
byJosef Adersberger
 
PDF
Dataservices - Processing Big Data The Microservice Way
byJosef Adersberger
 
PDF
Cloud Native und Java EE: Freund oder Feind?
byJosef Adersberger
 
PDF
Big Data Landscape 2016
byJosef Adersberger
 
PDF
Clickstream Analysis with Spark
byJosef Adersberger
 
PDF
Software-Sanierung: Wie man kranke Systeme wieder gesund macht.
byJosef Adersberger
 
Into the cloud, you better fly by sight
byJosef Adersberger
 
Serverless containers … with source-to-image
byJosef Adersberger
 
The need for speed – transforming insurance into a cloud-native industry
byJosef Adersberger
 
The good, the bad, and the ugly of migrating hundreds of legacy applications ...
byJosef Adersberger
 
Patterns and Pains of Migrating Legacy Applications to Kubernetes
byJosef Adersberger
 
Istio By Example (extended version)
byJosef Adersberger
 
Docker und Kubernetes Patterns & Anti-Patterns
byJosef Adersberger
 
The Good, the Bad and the Ugly of Migrating Hundreds of Legacy Applications ...
byJosef Adersberger
 
Dataservices - Processing Big Data The Microservice Way
byJosef Adersberger
 
Cloud Native und Java EE: Freund oder Feind?
byJosef Adersberger
 
Big Data Landscape 2016
byJosef Adersberger
 
Clickstream Analysis with Spark
byJosef Adersberger
 
Software-Sanierung: Wie man kranke Systeme wieder gesund macht.
byJosef Adersberger
 

Recently uploaded

PDF
Founder & Tech Lead | Web Development & Digital Growth Consultant | Helping B...
byShyamal Das
 
PDF
AI in the Real World: From University to Industry
byDarvan Shvan
 
PDF
From Artificial Intelligence to African Intelligence: Transforming Research &...
byMoses Kemibaro
 
PPTX
Spacecraft Guidance Quick Research Guide by Arthur Morgan
byArthur Morgan
 
PPTX
The Transformative Technology in Contemporary Businesses
bygreyaudrina
 
PDF
Chapter 5 Security Mechanisms iin computer security.pdf
byGetnet Tigabie Askale -(GM)
 
PDF
Digital Twin in IBM for Accelerated Discovery of Climate & Sustainability, K...
byMichiaki Tatsubori
 
PDF
Session 1/5: Enhancing Automation with Screenplay & Business Rules
bysuhanisingh58689
 
PDF
GenerationAI_Paris_2025_Architecting_Intelligence.pdf
byapidays
 
PPTX
Real-Time KPI Dashboard Playbook: What to Track Live and What Not To
byvictorworkvebo
 
PPTX
Workflow and decision Automation with Flowable
bychakib ch
 
PDF
AI TOOLS FOR PRODUCTIVITY IN MODERN TIMES.pdf
bySantunu
 
PDF
Odoo Implementation Checklist: A Strategic ERP Blueprint for Business-Ready D...
byBANIBRO IT SOLUTION
 
PDF
Spec-Driven Development with Kiro: Elevating Software Quality, Traceability, ...
byHaim Michael
 
PDF
Towards a Vibrant AI Hardware Accelerator Ecosystem, invited talk at the 4th ...
byMichiaki Tatsubori
 
PDF
final.pdf
byomarbishtawi04
 
PDF
GTM-and-Sales-Plan for a cyber security product
byAshish Jangir
 
PDF
Escape from the Forbidden Zone: Smuggling green and inclusive tech past the g...
byBookNet Canada
 
PDF
Empower your IT team with cloud-based PC management using Dell Management Por...
byPrincipled Technologies
 
PDF
February 2026 Patch Tuesday hosted by Chris Goettl and Todd Schell
byIvanti
 
Founder & Tech Lead | Web Development & Digital Growth Consultant | Helping B...
byShyamal Das
 
AI in the Real World: From University to Industry
byDarvan Shvan
 
From Artificial Intelligence to African Intelligence: Transforming Research &...
byMoses Kemibaro
 
Spacecraft Guidance Quick Research Guide by Arthur Morgan
byArthur Morgan
 
The Transformative Technology in Contemporary Businesses
bygreyaudrina
 
Chapter 5 Security Mechanisms iin computer security.pdf
byGetnet Tigabie Askale -(GM)
 
Digital Twin in IBM for Accelerated Discovery of Climate & Sustainability, K...
byMichiaki Tatsubori
 
Session 1/5: Enhancing Automation with Screenplay & Business Rules
bysuhanisingh58689
 
GenerationAI_Paris_2025_Architecting_Intelligence.pdf
byapidays
 
Real-Time KPI Dashboard Playbook: What to Track Live and What Not To
byvictorworkvebo
 
Workflow and decision Automation with Flowable
bychakib ch
 
AI TOOLS FOR PRODUCTIVITY IN MODERN TIMES.pdf
bySantunu
 
Odoo Implementation Checklist: A Strategic ERP Blueprint for Business-Ready D...
byBANIBRO IT SOLUTION
 
Spec-Driven Development with Kiro: Elevating Software Quality, Traceability, ...
byHaim Michael
 
Towards a Vibrant AI Hardware Accelerator Ecosystem, invited talk at the 4th ...
byMichiaki Tatsubori
 
final.pdf
byomarbishtawi04
 
GTM-and-Sales-Plan for a cyber security product
byAshish Jangir
 
Escape from the Forbidden Zone: Smuggling green and inclusive tech past the g...
byBookNet Canada
 
Empower your IT team with cloud-based PC management using Dell Management Por...
byPrincipled Technologies
 
February 2026 Patch Tuesday hosted by Chris Goettl and Todd Schell
byIvanti
 

JEE on DC/OS

  • 1.
    JEE ON DC/OS 101AND FUN Dr. Josef Adersberger ( @adersberger)
  • 2.
    DC/OS = #GIFEEGoogle’s
 (and Facebook’s, Twitter’s, Airbnb’s, …)
 Infrastructure
 For
 Everyone
 Else
  • 3.
    #GIFEE => CloudNative Applications
 (apps like Google’s, Facebook’s, …)
  • 6.
  • 8.
    The second largestmonolith on earth!* *) only beaten by the guys who are writing PHP code at large scale
  • 9.
  • 10.
    JEE IS NEITHERUGLY NOR FOCUSED ON MONOLITHIC APPS ▸ Java EE by itself is modular und lightweight in the recent versions.
 (to be honest: Spring feels more heavyweight than JEE to me from time to time) ▸ Java EE micro containers allow to modularize applications into self-contained runnable units. ▸ How to develop enterprise applications based on Java EE is well understood and knowledge is widespread. ▸ API is mature and standardized. Implementations are battle proven.
  • 11.
  • 13.
  • 14.
    JEE IS NOTAN OVERALL MONOLITH. BUT PEOPLE TEND TO RUN JEE APPS AS MONOLITHS WITHIN HEAVY WEIGHT APP SERVERS. DESIGN CODE RUN startup-cluster.sh JEE Impl. JEE App Server
  • 15.
    JEE MICRO CONTAINERTO THE RESCUE: ENABLING MICROSERVICES ON JEE DESIGN CODE RUN main() JEE impl. parts
  • 16.
    A CLOUD OFJEE MICRO CONTAINERS. MISSION ACCOMPLISHED? image: https://www.dreamstime.com
  • 17.
    a cloud isnot nothing! what’s inside our cloud?
  • 18.
    THE CLOUD NATIVESTACK CLOUD NATIVE STACK JEE MICROSERVICES
  • 19.
    CLUSTER VIRTUALIZATION (computing,network, storage, memory) CLUSTER RESOURCE MANAGER CLUSTER ORCHESTRATOR APPLICATIONS CONTAINER CLUSTER RESOURCES MICROSERVICE PLATFORM
 API Gateway Micro Container Configuration & Coordination Diagnosability &
 Monitoring Infrastructure-as-a-Service Bare Metal Local Host Service
 Client Service Discovery DevOps Interface ‣ deploy ‣ rollback ‣ scale ‣ configure Diagnose Interface ‣ analyze logs ‣ analyze metrics ‣ analyze traces Edge Interface ‣ request service ‣ authenticate
  • 20.
    CLUSTER VIRTUALIZATION (computing,network, storage, memory) CLUSTER RESOURCE MANAGER CLUSTER ORCHESTRATOR APPLICATIONS CONTAINER CLUSTER RESOURCES MICROSERVICE PLATFORM
 API Gateway Micro Container Configuration & Coordination Diagnosability &
 Monitoring Infrastructure-as-a-Service Bare Metal Local Host Service
 Client Service Discovery DevOps Interface ‣ deploy ‣ rollback ‣ scale ‣ configure Diagnose Interface ‣ analyze logs ‣ analyze metrics ‣ analyze traces Edge Interface ‣ request service ‣ authenticate how to provide the right resources for container execution? how to decouple from physical hardware? how to run (containerized) applications on a cluster? how to detect and solve operational anomalies? how to call other microservices resilient and responsive? how to execute a microservice and embed it within the platform? how to provide cluster-wide consensus on config values etc.? how to expose microservice endpoints to the internet? how to manage microservice endpoints within the whole platform?
  • 21.
  • 22.
    CLUSTER VIRTUALIZATION (computing,network, storage, memory) CLUSTER RESOURCE MANAGER CLUSTER ORCHESTRATOR APPLICATIONS CONTAINER CLUSTER RESOURCES MICROSERVICE PLATFORM
 API Gateway Micro Container Configuration & Coordination Diagnosability &
 Monitoring Infrastructure-as-a-Service Bare Metal Local Host Service
 Client Service Discovery DevOps Interface Diagnose InterfaceEdge Interface
  • 23.
    THE ZWITSCHER JEESHOWCASE ZWITSCHER-APP-HISTORY ZWITSCHER-APP-WIKIPEDIAZWITSCHER-APP-CHUCK ZWITSCHER-APP-BOARD keyword results + keyword history random joke
 (because every chuck norris joke matches on every keyword) JDBC Open API ZWITSCHER-APP-CHUCK fallback https://github.com/adersberger/cloud-native-zwitscher-jee
  • 24.
  • 25.
  • 26.
    THE JEE MICROCONTAINER ECOSYSTEM http://wildfly-swarm.io https://ee.kumuluz.com http://microprofile.io (to come) http://tomee.apache.org http://www.payara.fish/payara_micro EMBEDDED implements (unstable)
  • 27.
    JEE MICRO CONTAINERCOMPARISON CHART Payara Micro Wildfly Swarm TomEE+ kumuluzEE Servlets et al. x x x x WebSockets x x x JSF x x x JAX-RS x x x x JAX-WS x x EJB *2 x x x CDI x x x x JTA x x x JCA x x JMS x x JPA x x x x Bean Validation x x x x JBatch x x Concurrency x x JCache x x JEE version JEE 7 JEE 7 JEE 6, JEE 7 part.*1 JEE 7 part. Packaging WAR + JAR JAR JAR classes + JARs Startup time 4s 4s 2s 1s Size 57MB 83 MB 44 MB 15 MB *1) http://tomee.apache.org/javaee7-status.html *2) http://stackoverflow.com/questions/13487987/where-to-use-ejb-3-1-and-cdi
  • 28.
    @Path(“/joke") @RequestScoped
 public classChuckJokeResource {
 @Inject
 private IcndbIntegration icndb;
 @GET
 @Produces("application/json")
 public Response getJoke() {
 Map<String, String> json = new HashMap<>();
 json.put("message", icndb.getRandomJoke());
 return Response.ok(json).build();
 }
 } @ApplicationPath("/chuck")
 public class ChuckJokeApplication extends ResourceConfig {
 public ChuckJokeApplication() {
 super(); register(ChuckJokeResource.class);
 }
 } JAX-RS WITH CDI bean-discovery-mode="all"
  • 29.
    public class Main{
 
 /**
 * Starts the microservice container.
 *
 * Requires environment variable "PORT" according
 * on what port to listen.
 *
 * @param args no arguments evaluated
 */
 public static void main(String[] args) {
 com.kumuluz.ee.EeApplication.main(args);
 }
 } JEE MICRO CONTAINER STARTUP
  • 30.
    TESTING @RunWith(CdiTestRunner.class)
 public class TestChuckJokeResource{
 
 @Inject
 private ChuckJokeResource chuckJokeResource;
 
 @Test
 public void testChuckJokeResource() {
 Response response = chuckJokeResource.getJoke();
 assertThat( response.getStatusInfo().getStatusCode(), equalTo(200));
 }
 }
  • 31.
    SERVICE CLIENTSERVICE DISCOVERY LOADBALANCING REQUEST MONITORING CIRCUIT BREAKING
  • 32.
    SERVICE CLIENT WITHJERSEY, RXJAVA AND HYSTRIX ‣ Circuit Breaker (Resiliency) ‣ Request Monitoring ‣ JAX-RS 2.0 compliant REST clients‣ Parallel & async execution 
 (Responsive)
  • 33.
    SERVICE CLIENT WITHJERSEY, RXJAVA AND HYSTRIX @RequestScoped
 public class IcndbIntegration implements IChuckNorrisJokes {
 
 @Override public String getRandomJoke() {
 IcndbIntegrationCommand cmd = new IcndbIntegrationCommand();
 return cmd.observe().toBlocking().toFuture().get();
 }
 
 private class IcndbIntegrationCommand extends HystrixObservableCommand<String> {
 
 IcndbIntegrationCommand() {
 super(Setter.withGroupKey(HystrixCommandGroupKey.Factory.asKey("zwitscher"))
 .andCommandPropertiesDefaults(HystrixCommandProperties.Setter()
 .withExecutionTimeoutInMilliseconds(3000)));
 }
 
 @Override protected Observable<String> construct() {
 return RxObservable.newClient()
 .target("http://api.icndb.com").path("jokes/random").request(MediaType.APPLICATION_JSON_TYPE)
 .rx().get()
 .map(response -> {
 Map<String, Map<String, String>> json = response.readEntity(Map.class);
 return json.get("value").get("joke");
 });
 }
 }
 }
  • 34.
    FALLBACK JOKES @RequestScoped
 public classIcndbIntegration implements IChuckNorrisJokes { @Inject @Named("chucknorrisjoke-chucknorrisio")
 private IChuckNorrisJokes fallback; @Override public Observable<String> getRandomJokeObservable() { 
 return new IcndbIntegrationCommand().observe(); }
 
 //…
 
 private class IcndbIntegrationCommand extends HystrixObservableCommand<String> {
 
 //…
 
 @Override
 protected Observable<String> resumeWithFallback() {
 return fallback.getRandomJokeObservable();
 }
 }
 }
  • 35.
    MONITORING & DIAGNOSABILITYCOLLECT, STORE,ANALYZE METRICS COLLECT, STORE, ANALYZE LOGS COLLECT, STORE, ANALYZE TRACES DASHBOARDING & ALERTING
  • 36.
    THE MAGIC DIAGNOSABILITYTRIANGLE Metrics Logs Traces Cluster-wide
 Diagnosis
  • 37.
  • 38.
    INSTRUMENTING THE MICROSERVICEWITH DROPWIZARD METRICS @ApplicationPath("/chuck")
 public class ChuckJokeApplication extends ResourceConfig {
 public ChuckJokeApplication() {
 super();
 //Instrument application with metrics
 MetricRegistry METRIC_REGISTRY = MetricsProvider.getMetricRegistryInstance();
 register(new InstrumentedResourceMethodApplicationListener(METRIC_REGISTRY));
 HystrixPlugins.getInstance().registerMetricsPublisher(
 new HystrixCodaHaleMetricsPublisher(METRIC_REGISTRY));
 //Register Prometheus metric exporter
 CollectorRegistry.defaultRegistry.register(new DropwizardExports(METRIC_REGISTRY));
 }
 } Instrument inbound REST calls Instrument outbound REST calls Export all metrics to Prometheus Obtain the singleton Metric Registry
  • 40.
  • 41.
    SERVICE DISCOVERYSERVICE REGISTRATION SERVICELOOKUP SERVICE HEALTH CHECKING & API GATEWAYAPI EXPOSITION & REQUEST ROUTING AUTHENTICATION & AUTORISATION LOAD BALANCING & SHEDDING RATE LIMITING REQUEST MONITORING & AUDITING
  • 42.
    THE BIG PICTURE MICRO SERVICE SERVICEDISCOVERY register 
 web-facing 
 services lookup 
 internal 
 endpoints web requests lookup routes API GATEWAY health
 checks (metrics servlet) java.security.Security.setProperty("networkaddress.cache.ttl", "0" );
  • 43.
    SERVICE REGISTRATION WITHINA JEE MICROSERVICE @ApplicationPath("/chuck")
 public class ChuckJokeApplication extends ResourceConfig {
 
 @Inject
 public ChuckJokeApplication(
 @ConsulFabio IServiceDiscovery serviceDiscovery) {
 super();
 //Register service
 serviceDiscovery.registerService( "zwitscher-chuck", "/chuck/joke");
 }
 } Service Name URL Path to Service
  • 44.
    SERVICE REGISTRATION: THEHEAVY LIFTING /**
 * Registeres a service
 *
 * see https://github.com/eBay/fabio/wiki/Service-Configuration
 */
 public synchronized void registerService(String serviceName, String servicePath) {
 
 String applicationHost = getOutboundHost();
 int applicationPort = getOutboundPort();
 HostAndPort consulEndpoint = getConsulHostAndPort();
 logger.info("Will register service on host {} and port {} at consul endpoint {}",
 applicationHost, applicationPort, consulEndpoint.toString());
 
 //generate unique serviceId
 String serviceId = serviceName + "-" + applicationHost + ":" + applicationPort;
 String fabioServiceTag = "urlprefix-" + servicePath;
 
 //point healthcheck URL to dropwizard metrics healthcheck servlet
 URL serviceUrl = UrlBuilder.empty()
 .withScheme("http")
 .withHost(applicationHost)
 .withPort(applicationPort)
 .withPath("/metrics/ping").toUrl();
 
 // Service bei Consul registrieren inklusive einem Health-Check auf die URL des REST-Endpunkts.
 logger.info("Registering service with ID {} and NAME {} with healthcheck URL {} and inbound ROUTE {}",
 serviceId, serviceName, serviceUrl, fabioServiceTag);
 
 //use consul API to register service
 ConsulClient client = new ConsulClient(consulEndpoint.toString());
 NewService service = new NewService();
 service.setId(serviceId);
 service.setName(serviceName);
 service.setPort(applicationPort);
 service.setAddress(applicationHost);
 List<String> tags = new ArrayList<>();
 tags.add(fabioServiceTag);
 service.setTags(tags);
 //register health check
 NewService.Check check = new NewService.Check();
 check.setHttp(serviceUrl.toString());
 check.setInterval(ConsulFabioServiceDiscovery.HEALTHCHECK_INTERVAL + "s");
 service.setCheck(check);
 client.agentServiceRegister(service);
 }
 
 public static String getOutboundHost() {
 String hostName = System.getenv(HOSTNAME_ENVVAR);
 String host = System.getenv(HOST_ENVVAR);
 if (hostName == null && host == null) return DEFAULT_HOST;
 else if (host != null) return host;
 else {
 File etcHosts = new File("/etc/hosts");
 List<String> lines;
 try {
 lines = Files.readLines(etcHosts, Charset.defaultCharset());
 } catch (IOException e) {
 return DEFAULT_HOST;
 }
 for (String line: lines){
 if (!line.trim().startsWith("#") && !line.trim().isEmpty()) {
 String[] etcEntry = line.split("s+");
 if (etcEntry[1].equals(hostName)) return etcEntry[0];
 }
 }
 return DEFAULT_HOST;
 }
 }
 
 public static int getOutboundPort() {
 String portEnv = System.getenv(PORT_ENVVAR);
 if (portEnv == null) return DEFAULT_PORT;
 return Integer.valueOf(portEnv);
 }
 
 public static HostAndPort getConsulHostAndPort() {
 String consulEnv = System.getenv(CONSUL_ENVVAR);
 if (consulEnv == null) return HostAndPort.fromString(CONSUL_DEFAULT_HOSTANDPORT);
 else return HostAndPort.fromString(consulEnv);
 } @ConsulFabio
 @ApplicationScoped
 public class ConsulFabioServiceDiscovery implements IServiceDiscovery { figure out Consul-visible host name and port compose health check add meta data for Fabio register service at Consul 
 (as well as API doc and diagnosability endpoints)
  • 45.
    ET VOILA: CONSUL(STARTING 3 INSTANCES)
  • 46.
  • 47.
  • 48.
    SELF-DELIVERING SOFTWARE RUNNING
 TESTED
 SOFTWARE
 INCREMENT EVERYTHING ASCODE: ‣ codes application ‣ codes tests ‣ codes infrastructure ‣ codes delivery workflow{ }
  • 49.
    FOCUS ON SHORTROUND TRIPS WITH MULTIPLE RUN MODES In-Process Local Cluster Remote Cluster ‣ longer round trip time ‣ but: more realistic Group with dependencies: Single applications:
  • 50.
    MARATHON APP DEFINITION {
 "id":"/zwitscher",
 "groups": [
 {
 "id": "/zwitscher/infrastructure",
 "apps": [
 {
 "id": "consul",
 "cpus": 1,
 "mem": 256,
 "disk": 0,
 "instances": 1,
 "cmd": "/bin/consul agent -server -ui -advertise=$HOST -config-dir=/config -data-dir=/tmp/consul -bootstrap-expect=1 -node=consul-server -client=0.0.0.0",
 "container": {
 "docker": {
 "image": "gliderlabs/consul-server:0.6",
 "forcePullImage": true,
 "privileged": false,
 "network": "HOST",
 "portDefinitions": [
 { "port": 8300, "protocol": "tcp", "name": "server-rpc" },
 { "port": 8301, "protocol": "tcp", "name": "serf-lan" },
 { "port": 8302, "protocol": "tcp", "name": "serf-wan" },
 { "port": 8400, "protocol": "tcp", "name": "cli-rpc" },
 { "port": 8500, "protocol": "tcp", "name": "http-api" },
 { "port": 8600, "protocol": "udp", "name": "dns" }
 ],
 "requirePorts" : true
 }
 },
 "env": {
 "GOMAXPROCS": "10"
 },
 "healthChecks": [
 {
 "protocol": "HTTP",
 "port": 8500,
 "path": "/v1/status/leader",
 "intervalSeconds": 10,
 "timeoutSeconds": 10,
 "maxConsecutiveFailures": 3
 }
 ]
 },
 {
 "id": "fabio",
 "cpus": 1,
 "mem": 256,
 "disk": 0,
 "instances": 1,
 "env": {
 "registry_consul_addr": "consul.infrastructure.zwitscher.marathon.mesos:8500"
 },
 "container": {
 "docker": {
 "image": "magiconair/fabio:latest",
 "forcePullImage": true,
 "privileged": false,
 "network": "HOST",
 "portDefinitions": [
 { "port": 9998, "protocol": "tcp", "name": "web-ui" },
 { "port": 9999, "protocol": "tcp", "name": "proxy-port" }
 ],
 "requirePorts" : true
 }
 },
 "acceptedResourceRoles":["slave_public"],
 "healthChecks": [
 {
 "protocol": "HTTP",
 "port": 9998,
 "path": "/health",
 "intervalSeconds": 10,
 "timeoutSeconds": 10,
 "maxConsecutiveFailures": 3
 }
 ]
 }
 ]
 },
 {
 "id": "/zwitscher/services",
 "apps": [
 {
 "id": "zwitscher-chuck",
 "cpus": 1,
 "mem": 256,
 "disk": 0,
 "instances": 1,
 "container": {
 "docker": {
 "image": "adersberger/zwitscher-app-chuck:1.0.0-SNAPSHOT",
 "forcePullImage": true,
 "privileged": false,
 "network": "HOST",
 "portDefinitions": [
 { "port": 12340, "protocol": "tcp", "name": "rest-api" }
 ],
 "requirePorts" : true
 }
 },
 "env": {
 "PORT": "12340",
 "CONSUL": "consul.infrastructure.zwitscher.marathon.mesos:8500",
 "CONFIG_ENV" : "zwitscher"
 },
 "args": [
 "-Xmx256m"
 ],
 "healthChecks": [
 {
 "protocol": "HTTP",
 "port": 12340,
 "path": "/metrics/ping",
 "intervalSeconds": 10,
 "timeoutSeconds": 10,
 "maxConsecutiveFailures": 3
 }
 ],
 "dependencies": [
 "/zwitscher/infrastructure/consul"
 ]
 }
 ]
 }
 ]
 } marathon-appgroup.json /zwitscher /infrastructure /consul /fabio /service /zwitscher-chuck dependency "healthChecks": [
 {
 "protocol": “HTTP", "port": 9998, "path": "/health",
 "intervalSeconds": 10, "timeoutSeconds": 10, "maxConsecutiveFailures": 3
 }
 ] Define health checks for every app: "network": "HOST",
 "ports": [9998, 9999],
 "requirePorts" : true HOST networking (so that Mesos-DNS works) with fixed ports: "acceptedResourceRoles":["slave_public"] Run API gateway on public slave (accessible from www): "env": {
 "PORT": "12340",
 "CONSUL": "consul.infrastructure.zwitscher.marathon.mesos:8500"
 },
 "args": ["-Xmx256m"] Configuration @ startup with env vars and args: "container": { "docker": {
 "image": "adersberger/zwitscher-app-chuck:1.0.0-SNAPSHOT",
 "forcePullImage": true forcePullImage = true to get the latest pushed docker image: "dependencies": [ "/zwitscher/infrastructure/consul"] Yes, sometimes you need dependencies (but you should avoid them to get more resilient):
  • 51.
  • 53.
    CLOUD NATIVE JEE101 SUMMARY ▸ Implementing JEE microservices on DC/OS is simple & fun. ▸ The JEE APIs are out of the box not cloud native but can easily be enhanced with the required functionality. You can use our JCloudEE util classes to glue JEE together with cloud native tech.
 
 
 
 
 ▸ Short round trip times are essential to be productive. You need full portability and automation from local host up to the cloud.
  • 54.
  • 55.
    https://github.com/qaware/kubepad ‣ First thingsfirst: Will be renamed to 
 CloudPad soon! ‣ Controlling a DC/OS cluster 
 with a DJ pad. ‣ Written in fancy Kotlin. ‣ Turned out to be really helpful for cloud native newbies to better grasp cluster orchestration. ‣ Kicky colored lights and well-hidden snake game easter egg. Set colors with app label.
  • 57.
    MESSAGING JEE ON DC/OS201 SNEAK PREVIEW SECURITY WEB USER INTERFACE STATEFUL SERVICES
  • 58.
    TWITTER.COM/QAWARE - SLIDESHARE.NET/QAWARE Thankyou! Questions? josef.adersberger@qaware.de @adersberger https://github.com/adersberger/cloud-native-zwitscher-jee
  • 59.
  • 60.
  • 61.
    READING CONFIGURATION VALUES @Inject
 privateConfigurationProvider config;
 //…
 String messageTag = config.getProperty("messageTag", String.class); try to read config value in Consul fallback to file if Consul is not available or no config value is set in Consul
  • 62.
    THE CONSUL AGENTAND CONFIG ENVIRONMENT CAN BE SET WITH A ENV VAR. "env": {
 "CONFIG_ENV" : "zwitscher"
 } The config environment (e.g. “zwitscher”, “zwitscher-test”, “zwitscher-prod”). Refers to 
 a path in Consul or to a local path where the config file is.
  • 63.
    MONITORING & DIAGNOSABILITYCOLLECT, STORE,ANALYZE METRICS COLLECT, STORE, ANALYZE LOGS COLLECT, STORE, ANALYZE TRACES DASHBOARDING & ALERTING
  • 64.
    CUSTOM INSTRUMENTATIONS ▸ Logging
 
 ▸Business Metrics
 
 
 
 ▸ Timers @Inject
 private Logger logger; @ApplicationScoped
 public class Slf4jLoggerProvider {
 
 @Produces
 public Logger produceLogger(InjectionPoint injectionPoint) {
 return LoggerFactory.getLogger(
 injectionPoint.getMember() .getDeclaringClass() .getName());
 }
 
 } @Inject
 MetricRegistry metrics;
 
 //…
 
 metrics.counter("fun counter").inc(); @GET
 @Timed
 @Produces("application/json")
 public Response getJoke() { //…