JavaFest. Philipp Krenn. Scale Elasticsearch for Your Java Applications

•

0 likes•176 views

Elasticsearch is a highly scalable system if you use it to its full potential. In this talk we discuss the most important parts to make it scale with your Java applications: Monitoring your setup for performance. Optimize with bulk requests. Distribute the load in your cluster. Pick the right index and shard strategy.

Education

Scale
for Your Java Applications
Philipp Krenn @xeraa
@xeraa

Terminology
Cluster, Node, Index, Shard
@xeraa

Disclaimer
This is not a benchmark
@xeraa

Download
http://download.elastic.co/workshops/basic-kibana/injector/
injector-7.0.jar
@xeraa

Use
$ java -jar injector-7.0.jar
--nb 1000 --bulk 100
--debug
--elasticsearch --es.host http://localhost:9200
--es.user elastic --es.pass changeme
--es.index person
--console --cs.pretty
@xeraa

{
"name": "Mamadou Colombe",
"dateofbirth": "2009-12-26",
"gender": "male",
"children": 4,
"marketing": {
"cars": null,
"shoes": null,
"toys": 1688,
"fashion": null,
"music": 243,
"garden": null,
"electronic": 1222,
"hifi": null,
"food": null
},
"address": {
"country": "France",
"zipcode": "75000",
"city": "Paris",
"countrycode": "FR",
"location": {
"lon": 2.3250817954678284,
"lat": 48.857148516731385
}
}
}
@xeraa

time
$ time java -jar injector-7.0.jar ...
@xeraa

1,000 Docs & Bulk Size 1
Executed in 37.87 secs fish external
usr time 13.08 secs 135.00 micros 13.08 secs
sys time 1.00 secs 752.00 micros 1.00 secs
@xeraa

1,000 Docs & Bulk Size 100
Executed in 4.01 secs fish external
usr time 7.49 secs 134.00 micros 7.49 secs
sys time 0.43 secs 738.00 micros 0.43 secs
@xeraa

1,000 Docs & Bulk Size 100
Executed in 3.91 secs fish external
usr time 6.34 secs 138.00 micros 6.34 secs
sys time 0.38 secs 843.00 micros 0.38 secs
@xeraa

It Depends
Document size (100B, 1KB, 100KB, 1MB,...)
Number of nodes & shards
Node size
Load on the cluster
@xeraa

index.refresh_interval
Default 1s
30s or -1
@xeraa

10,000 Docs & Refresh 1s
Executed in 10.23 secs fish external
usr time 11.50 secs 124.00 micros 11.50 secs
sys time 0.77 secs 845.00 micros 0.77 secs
@xeraa

10,000 Docs & Refresh 30s
Executed in 10.02 secs fish external
usr time 11.87 secs 120.00 micros 11.87 secs
sys time 0.74 secs 730.00 micros 0.74 secs
@xeraa

Distribution
Round Robin
Adaptive Replica Selection for searches
@xeraa

Defaults
7.0: 1 primary, 1 replica
Before: 5 primary, 1 replica
@xeraa

Index Patterns
Static vs Time-Based
@xeraa

Time-Based
Don't _delete_by_query
Do daily / weekly / ... patterns
Or even better Rollover
@xeraa

Shard Size
>10GB, maybe ~50GB
It depends
@xeraa

$Pagination GET person/_search { "from" : 0, "size" : 10, "sort": [ { "dateofbirth": { "order": "asc" } } ] } @xeraa$

$Deep Pagination GET person/_search { "from" : 5000, "size" : 10, "sort": [ { "dateofbirth": { "order": "asc" } } ] } @xeraa$

$Error GET person/_search { "from" : 10000, "size" : 10, "sort": [ { "dateofbirth": { "order": "asc" } } ] } @xeraa$

For Your Protection
index.max_result_window: 10000
Search After
Scroll
@xeraa

Rally
Macrobenchmarking Framework for
Elasticsearch
https://github.com/elastic/rally
@xeraa

Nightly Benchmarks
https://benchmarks.elastic.co
@xeraa

Topics
Monitoring
Bulk & Refresh
Load Distribution
@xeraa

Topics
Index & Shard Strategy
Pagination
Benchmarks
@xeraa

The document discusses the differences between evented and threaded concurrency models for Ruby applications. It explains that evented concurrency handles I/O events asynchronously while threaded concurrency uses threads to perform actual work. The document recommends using an evented model with libraries like Nginx and Trinidad to serve web applications, allowing code to be written as if it were threaded for simplicity.

Tokyo Cassandra Summit 2014: Tunable Consistency by Al Tobey

DataStax Academy

This document discusses strategies for avoiding read-modify-write operations in Cassandra databases. It presents several Cassandra features that allow updating data without explicit read-modify-writes, such as overwriting rows, using collections, and lightweight transactions. It also covers data modeling techniques like journaling, content-addressable storage, and modeling time-series data. The document concludes that Cassandra is well-suited for write-heavy workloads and provides tools to safely perform read-modify-writes when necessary.

Bottom to Top Stack Optimization - CICON2011

CodeIgniter Conference

The document discusses optimization strategies for a LAMP stack using CodeIgniter. It recommends minimizing I/O operations by reducing disk, network and CPU usage. Specific optimizations include tuning the system, MySQL, Apache and PHP configurations, enabling caching, compression, and minimizing assets. Application-level optimizations include batching database operations and using associative arrays.

Slow Database in your PHP stack? Don't blame the DBA!

Harald Zeitlhofer

Your users complain about the bad performance of your app or website? Developers blame the database? How can we find the cause for the performance hotspot? Far too often the database is held responsible for performance or scalability problems. It seems to be main contributor to the overall web request response time. However, in many cases it’s not the database itself, but the way, how the application is using the database! Too many database statements, inefficient queries and poor index selection are among the common problem patterns. Based on real life examples, you will learn how to approach performance problems, how to figure out if the database is really to blame and how to end the finger pointing between developers and DBAs. Slides from my talk at PHP conference Asia 2016 in Singapore

PHP and databases

Harald Zeitlhofer

The document discusses common causes of slow database performance in PHP applications and strategies for improving performance. It outlines issues like making too many database queries, missing caching opportunities, and inefficient query design. It emphasizes that slow performance does not necessarily mean the database itself is slow, and encourages developers to understand how databases work and profile queries to identify hotspots. The document also covers topics like indexing, separating databases for read/write, and the importance of collaboration between developers and database administrators.

Search - Journey Of Delivery On A Budget (2014)

Sam McLeod

Rubyslava + PyVo #48

Jozef Képesi

Skypicker is a flight ticket search and booking engine that processes hundreds of terabytes of airline data monthly and sells thousands of tickets daily in Europe, Russia, and China. It uses PostgreSQL extensively to power its API and databases. The document discusses Skypicker's PostgreSQL infrastructure, which includes 5 database clusters with over 0.5TB of memory each that handle 20 million updates per hour. It also covers optimizations made to scale the databases, such as table partitioning, cascading replication, and query tuning. Skypicker is currently preparing for a large increase in data and is hiring database masters and developers.

Using hiera with puppet

Scott Lackey

"We're hiring!" How many times have you heard this phrase at a conference? Every database-driven company is hiring and that makes for pretty stiff competition when trying to get a new DBA. Instead of searching for the perfect database administrator from a conference or Linkedin, why not look internally at your organization for system administrators or engineers who may be an equally good fit given the right training. In this talk, I'll explain how the DBAs at Box developed a knowledge-sharing culture around databases and disseminated important learnings to other members of the company. I'll also cover the mentorship process we established to train other members of our Operations team to become rock star DBAs and manage our MySQL and HBase infrastructure at Box.

Konfigurasi vlan

Muhammad Afdhol Sodiq Mas

The document describes configuring a router and switches to create separate VLANs and DHCP pools for different user groups. The router is configured with subinterfaces attached to 3 VLANs (MANAGEMENT, MAHASISWA, DOSEN) with corresponding DHCP pools. The central switch is configured as the VTP server to propagate the VLANs. Edge switches are configured as VTP clients to receive the VLANs and assign user ports to the appropriate VLANs.

Cloud patterns applied

Lars Fronius

power-assert, mechanism and philosophy

Takuto Wada

Sending a for ahuh. win32 exploit development old school

Nahidul Kibria

Jk rubyslava 25

Jozef Képesi

The document discusses the technology stack used at skypicker.com, including their use of uWSGI to serve Python applications for features like booking flights. It describes how uWSGI provides benefits like high performance, flexibility to run on multiple web servers, and abilities like shared memory and managing worker processes. It also compares uWSGI's performance to alternatives like using the Python dictionary or Redis for shared memory.

Rapid Infrastructure Provisioning

Uchit Vyas ☁

This is the story of a company that had 10s of customers and were facing severe scaling issues. They approached us. They had a good product predicting a few hundred customers within 6 months. VCs went to them. Infrastructure scaling was the only unknown; funding for software-defined data centers. We introduced Terraform for infrastructure creation, Chef for OS hardening, and then Packer for supporting AWS as well as VSphere. Then, after a few more weeks, when there was a need for faster response from the data center, we went into Serf to immediately trigger chef-clients and then to Consul for service monitoring. Want to describe this journey. Finally, we did the same exact thing in at a Fortune 500 customer to replace 15 year-old scripts. We will also cover sleek ways of dealing with provisioning in different Availability Zones across various AWS regions with Terraform.

Delegated Configuration with Multiple Hiera Databases - PuppetConf 2014

Puppet

This document discusses using Hiera to provide delegated configuration through multiple data sources. It begins with an introduction to Hiera and its uses. It then discusses using multiple backends like YAML and PostgreSQL to store hierarchical data. The document proposes a designed solution to delegate access to certain Hiera keys by filtering and importing data from external sources into a separate database. This database would act as a secondary Hiera backend. The solution is intended to allow certain users to manage configuration parameters for a subset of servers in a secure manner.

Deployment with Fabric

andymccurdy

This document discusses using Fabric for Python application deployment and configuration management. It provides an overview of Fabric basics like tasks, roles, and environments. It also describes using Fabric for common operations like code deployment, database migrations, and managing server growth. Key advantages of Fabric include its simple task-based interface and ability to control multiple servers simultaneously. The document provides an example of using Fabric for a full deployment process including pushing code, running migrations, and restarting processes.

Puppet Camp Portland 2015: Introduction to Hiera (Beginner)

Puppet

RubyEnRails2007 - Dr Nic Williams - Keynote

Dr Nic Williams

Streamline Hadoop DevOps with Apache Ambari

Alejandro Fernandez

High Performance Django 1

DjangoCon2008

This document discusses techniques for improving the performance of Django projects handling high traffic volumes. It identifies common areas of concern like database performance, web server configuration, caching, and template rendering. It provides examples of optimizing ORM queries, implementing object caching with invalidation plans, profiling code to identify bottlenecks, and leveraging tools like Varnish, memcached, and database query profiling. The key lessons are to develop a caching strategy, use profiling to optimize problem areas, and consider alternative web server software or configurations to improve performance.

High Performance Django

DjangoCon2008

This document discusses techniques for improving the performance of Django projects handling high traffic volumes. It identifies common areas of concern like database usage, web server configuration, caching, and template rendering. It provides examples of optimizing database queries, implementing caching strategies, profiling code to identify bottlenecks, and leveraging tools like memcached, Varnish, and multiple web servers. The key lessons are to carefully design caching and database access, use profiling to find problematic areas rather than prematurely optimizing, and leverage server configuration expertise.

[Coscup 2012] JavascriptMVC

Alive Kuo

This document discusses JavascriptMVC, an alternative Javascript MVC framework to BackboneJS. It provides an overview of JavascriptMVC's features such as MIT licensing, clear documentation, and providing an almost total solution for building web applications. Potential pros include the licensing, documentation, and comprehensive features. Potential cons include it being less well known and having fewer online resources than BackboneJS in Taiwan. Examples of how it handles classes, CSS, data loading/validation, and views are also provided.

Socket applications

João Moura

The document discusses socket applications and real-time communication. It describes common examples like chat, live feeds, and games. It then explains the typical solution of using AJAX requests and the problems with that approach. The proposed solution is to use a multi-threaded model with asynchronous I/O and the reactor pattern to process requests while waiting for network responses. Various tools for implementing this pattern in Ruby and JavaScript are also mentioned, including Pusher, Socket.IO, and SocketStream.

Django Performance Recipes

Jon Atkinson

I've written a lot of Django code in my career, some slow, and some fast; my aim is to share a few of the techniques you can use to go from 300ms response times to 30ms. We'll travel up and down the stack, looking to identify, monitor and solve performance issues, while dodging those which just aren't worth solving. Full video is available at: https://skillsmatter.com/skillscasts/6628-django-performance-recipes

Padrino is agnostic

Takeshi Yabe

This document discusses Padrino, a web framework built on Sinatra that aims to provide a structured and flexible structure. Padrino allows developers to choose different options for the ORM, testing framework, JavaScript library, template engine, and stylesheet to use. It has generators to quickly scaffold a project with the chosen options. The philosophy is to keep things simple to use and hack while giving developers freedom. Major features include being agnostic to different options, generators for scaffolding projects, mounting multiple apps, and an admin interface.

Cassandra at Pollfish

Pollfish

Pollfish is a survey platform which provides access to millions of targeted users. Pollfish allows easy distribution and targeting of surveys through existing mobile apps. (https://www.pollfish.com/). At pollfish we use Cassandra for difference use cases, eg. for application data store to maximize write throughput when appropriate and for our analytics project to find insights in application generated data. As a medium to accomplish our success so far, we use the Datastax's DSE 4.6 environment which integrates Appache Cassadra, Spark and a hadoop compatible file system (CFS). We will discuss how we started, how the journey was and the impressions gained so far along with some tips learned the hard way. This is a result of joint work of an excellent team here at Pollfish.

Cassandra at Pollfish

Stavros Kontopoulos

Speed up R with parallel programming in the Cloud

Revolution Analytics

There are many common workloads in R that are "embarrassingly parallel": group-by analyses, simulations, and cross-validation of models are just a few examples. In this talk I'll describe several techniques available in R to speed up workloads like these, by running multiple iterations simultaneously, in parallel. Many of these techniques require the use of a cluster of machines running R, and I'll provide examples of using cloud-based services to provision clusters for parallel computations. In particular, I will describe how you can use the SparklyR package to distribute data manipulations using the dplyr syntax, on a cluster of servers provisioned in the Azure cloud. Presented by David Smith at Data Day Texas in Austin, January 27 2018.

Stack kicker devopsdays-london-2013

Simon McCartney

StackKicker is a tool that allows users to easily and repeatedly build out application stacks in cloud environments like AWS and OpenStack. It defines stacks as configurations that specify the roles, nodes, regions/availability zones, and other details needed to provision the stack. StackKicker leverages configuration management tools like Chef and Puppet to build out the defined stacks across different cloud regions and environments in an automated and repeatable way.

What's hot

To Hire, or to train, that is the question (Percona Live 2014)

Geoffrey Anderson

Konfigurasi vlan

Muhammad Afdhol Sodiq Mas

Cloud patterns applied

Lars Fronius

power-assert, mechanism and philosophy

Takuto Wada

Sending a for ahuh. win32 exploit development old school

Nahidul Kibria

Jk rubyslava 25

Jozef Képesi

Rapid Infrastructure Provisioning

Uchit Vyas ☁

Delegated Configuration with Multiple Hiera Databases - PuppetConf 2014

Puppet

Deployment with Fabric

andymccurdy

Puppet Camp Portland 2015: Introduction to Hiera (Beginner)

Puppet

What's hot (10)

To Hire, or to train, that is the question (Percona Live 2014)

Konfigurasi vlan

Cloud patterns applied

power-assert, mechanism and philosophy

Sending a for ahuh. win32 exploit development old school

Jk rubyslava 25

Rapid Infrastructure Provisioning

Delegated Configuration with Multiple Hiera Databases - PuppetConf 2014

Deployment with Fabric

Puppet Camp Portland 2015: Introduction to Hiera (Beginner)

Similar to JavaFest. Philipp Krenn. Scale Elasticsearch for Your Java Applications

RubyEnRails2007 - Dr Nic Williams - Keynote

Dr Nic Williams

Streamline Hadoop DevOps with Apache Ambari

Alejandro Fernandez

High Performance Django 1

DjangoCon2008

High Performance Django

DjangoCon2008

[Coscup 2012] JavascriptMVC

Alive Kuo

Socket applications

João Moura

Django Performance Recipes

Jon Atkinson

Padrino is agnostic

Takeshi Yabe

Cassandra at Pollfish

Pollfish

Cassandra at Pollfish

Stavros Kontopoulos

Speed up R with parallel programming in the Cloud

Revolution Analytics

Stack kicker devopsdays-london-2013

Simon McCartney

C* Summit 2013: Real-Time Big Data with Storm, Cassandra, and In-Memory Compu...

DataStax Academy

The document discusses real-time big data analytics using Storm, Cassandra, and in-memory computing. It describes how Storm is a popular open-source platform for real-time stream processing. It also explains how an in-memory data grid can interface with Cassandra for a complete solution, providing real-time analytics with high availability and elasticity. Real-time analytics require processing data within seconds, while batch analytics can occur over longer timeframes.

Declarative & workflow based infrastructure with Terraform

Radek Simko

Terraform allows users to define infrastructure as code to provision resources across multiple cloud platforms. It aims to describe infrastructure in a configuration file, provision resources efficiently by leveraging APIs, and manage the full lifecycle from creation to deletion. Key features include supporting composability across different infrastructure tiers, using a graph-based approach to parallelize operations for efficiency, and managing state to track resource unique IDs and allow recreating resources. Providers enable connectivity to different cloud APIs while resources define the specific infrastructure components and their properties.

Lessons learned scaling big data in cloud

Vijay Rayapati

The document discusses lessons learned from scaling Hadoop and big data processing on Amazon EMR. It describes how EMR provides a scalable and cost-effective way to run Hadoop jobs in the cloud without having to manage infrastructure. While EMR enables bootstrapping large clusters easily, performance can vary due to network issues and disk I/O constraints of different instance types. The document outlines best practices for optimizing Hadoop jobs and tuning configurations on EMR.

mongodb-introduction

Tse-Ching Ho

This document provides an introduction and overview of MongoDB. It discusses MongoDB's features such as being document-based, schema-less, easy to learn and use, and having replication and sharding capabilities. It also covers installing and configuring MongoDB, basic CRUD operations, querying, indexing, and common use cases. Tools for managing and working with MongoDB like MongoHub and a demo code repository are also referenced.

Ultra fast web development with sinatra

Sérgio Santos

Ultra fast web development with Classyhat is required. It features Pedro "Frank" Gaspar and Sérgio "Sinatra" Santos. Sinatra is a small web framework for server-side applications in Ruby that allows setting up simple web applications quickly. The document then provides instructions on installing Sinatra and building a basic "Hello New York" application to get started with Sinatra web development.

D Trace Support In My Sql Guide To Solving Reallife Performance Problems

MySQLConference

DTrace is a dynamic tracing framework that can be used to identify performance problems in MySQL. It works by inserting probes into code locations and executing scripts when the probes fire. This allows tracking of events like SQL queries, table locks, and storage engine operations without restarting MySQL. The document provides examples of using static and dynamic probes to trace queries and identify hot database tables.

FreeBSD 2014 Flame Graphs

Brendan Gregg

This document summarizes a presentation on flame graphs for profiling CPU and memory performance on FreeBSD. It introduces flame graphs as a way to visualize stack profiles to easily compare performance across systems. Examples are given profiling MySQL workload CPU usage on two hosts to identify a 30% performance difference. Commands are provided to generate flame graphs from DTrace profiles of CPU stack sampling and page faults.

Performance Profiling in Rust

InfluxData

The document discusses various techniques for profiling CPU and memory performance in Rust programs, including: - Using the flamegraph tool to profile CPU usage by sampling a running process and generating flame graphs. - Integrating pprof profiling into Rust programs to expose profiles over HTTP similar to how it works in Go. - Profiling heap usage by integrating jemalloc profiling and generating heap profiles on program exit. - Some challenges with profiling asynchronous Rust programs due to the lack of backtraces. The key takeaways are that there are crates like pprof-rs and techniques like jemalloc integration that allow collecting CPU and memory profiles from Rust programs, but profiling asynchronous programs

Similar to JavaFest. Philipp Krenn. Scale Elasticsearch for Your Java Applications (20)

RubyEnRails2007 - Dr Nic Williams - Keynote

Streamline Hadoop DevOps with Apache Ambari

High Performance Django 1

High Performance Django

[Coscup 2012] JavascriptMVC

Socket applications

Django Performance Recipes

Padrino is agnostic

Cassandra at Pollfish

Speed up R with parallel programming in the Cloud

Stack kicker devopsdays-london-2013

C* Summit 2013: Real-Time Big Data with Storm, Cassandra, and In-Memory Compu...

Declarative & workflow based infrastructure with Terraform

Lessons learned scaling big data in cloud

mongodb-introduction

Ultra fast web development with sinatra

D Trace Support In My Sql Guide To Solving Reallife Performance Problems

FreeBSD 2014 Flame Graphs

Performance Profiling in Rust

More from FestGroup

JavaFest. Барух Садогурский. DevOps для разработчиков (или против них?!)

FestGroup

DevOps — это заговор сисадминов, чтобы заставить разработчиков делать чужую работу, но мы слишком умны, чтобы попасться на эту элементарную уловку ребрендингом! Посудите сами: мы написали код, он проходит тесты. Он, очевидно, работает и работает хорошо (Мы гордимся собой? Да!). И тут мы закончили. Но приходят эти «визионеры» (все из operations, прошу заметить!) и рассказывают нам, что теперь надо учить YAML, Docker, Kubernetes и Terraform, потому что внезапно это наша головная боль?! В этом докладе мы поговорим о том, зачем разработчикам нужен или не нужен DevOps. Мы рассмотрим аргументы, которые приводят идеологи DevOps, и решим, состоятельны они или нет. К концу доклада, будем надеяться, нам станет понятно, действительно ли это способ, который поможет нам (разработчикам) поставлять лучший код в прод чаще, или это, как всегда, разводка маркетологов и евангелистов.

JavaFest. Виктор Полищук. Legacy: как победить в гонке

FestGroup

У вас древний проект? Все зовут его «Legacy», а вас «неудачник»? Возможно они даже смеются над вами. Давайте взглянем на ситуацию с другого ракурса. Все (все, Карл!) успешные проекты рано или поздно превращаются в Legacy-проекты. Я затрону тему Legacy не просто как явление, а как возможность быть постоянно в тренде, прослыть супер-спецом (даже если ты знаешь всего два фреймворка), сделать карьеру, как делать, то что ты хочешь, а не то что тебя просят. Ладно, ладно, я наврал про два фреймворка, но все остальное чистая правда. Я покажу, что вы можете творить, имея правильный подход к Legacy коду. Суть в том, что Legacy — это не грустно/уныло/немодно, это просто/клево/весело, если с умом подойти к задаче!

JavaFest. Cedrick Lunven. Build APIS with SpringBoot - REST, GRPC, GRAPHQL wh...

FestGroup

Depending on your use cases you may need to access databases with different patterns: CRUD, commands, Streaming, Batches, Asynchronous, Reactive At DataStax, the developer advocates team implements reference applications for developers. We had the chance to implement multiple approaches and can provide feedback. KillrVideo.com is one of this application, it has been written in 4 languages (Java, C#, NodeJS, Python) and implements API with REST, Grpc and GraphQL. Though live session, browsing real code, you will see implementation details, lessons learned and get working source code in Github as a takeaway.

JavaFest. Grzegorz Piwowarek. Hazelcast - Hitchhiker’s Guide

FestGroup

Most of you probably heard about the distributed caching being the most common application of Hazelcast - but I bet not many of you heard about CRDT, HyperLogLog, or CP Subsystem. During this talk, we'll go for quick journey around Hazelcast's ecosystem, revise basic functionality and have a look at some of the hidden flavours. Even if that’s way too much for your use case, there’s still a lot for an engineer to learn from studying these concepts.

JavaFest. Денис Макогон. 6 заблуждений относительно современной Java

FestGroup

Есть сильное ощущение, что разработчики не обновляются на более новую Java только потому что нет отчетливого понимания о том, что творится с современной Java, и это непонимание усилилось после изменения процесса и сроков релиза новых версий. За ближайшие 50 минут я хочу попытаться убедить вас, что обновления это единственный путь успеха для самой Java и бизнеса экосистемы, ведь не стоит забывать, что это парная игра: тех, кто пишет приложения на Java и тех, кто пишет саму Java. Не забывайте, мы тут “в одной лодке”. В рамках этого доклада, я хочу развенчать 6 существующих заблуждений о современной Java: 1. Модули не нужны! 2. Java не годится для облаков. 3. JavaFx мертва! 4. Спецификации проектов OpenJDK крутые, но нет реального прогресса. 5. Java закостенела и не развивается. 6. GraalVM будет заменой HotSpot.

JavaFest. Taras Boychuk. There is always a choice. Spring Data JDBC vs. Hiber...

FestGroup

A relational database is still an industry standard for data persistence, while Hibernate is Java-framework #1 for building a persistence layer of our apps. Its features like Persistence Context, Dirty Checking, Lazy Loading, Action Queue, and Flush bring so much power... And so much complexity. There is literally no way to make Hibernate a simple lightweight framework. No worries, if you don't want to deal with complexity. There is always a choice. Spring Data JDBC is a super-simple framework that perfectly fits into your Spring application and brings you almost no magic. It's simple, predictable, and straightforward. And it's your new option for building a persistence layer.

JavaFest. Вадим Казулькин. Projects Valhalla, Loom and GraalVM

FestGroup

В этом докладе мы рассмотрим мотивацию создания и текущее состояние следующих Java проектов: - Проект Valhalla для внедрения встроенных типов (Inline Types) в Java - Проект Loom для реализации облегченных потоков (Lightweight Threads) в Java - GraalVM - полиглотная виртуальная машина для Java. Мы также поговорим о том, как GraalVM делает приложения на основе Java более доступными для внедрения Serverless парадигмы.

JavaFest. Антон Лемешко. Model-Driven Development in the Open Java Universe

FestGroup

Model-driven development (MDD) - подход к проектированию корпоративных приложений, при котором цифровая модель разрабатываемой системы становиться основным источником информации для разработки всех необходимых компонентов приложения. Однако, сложность применения MDD часто превышает все преимущества данного подхода, поэтому данный подход по-прежнему не находит широкое применение при разработке. Но все изменилось, когда во вселенной Java появился Mr. JHipster. JHipster - это полнофункциональный MDD инструмент с открытым кодом, позволяющий разработчику быстро и просто создавать современные WEB - приложения со сложной масштабируемой архитектурой и не требующий наличия у разработчика глубоких знаний обо всем применяемом стеке технологий. Я поделюсь с вами моим многолетним опытом применения MDD в корпоративной разработке. Я покажу вам на реальном примере, как можно использовать мощные возможности JHipster для быстрого создания WEB - приложений. Я расскажу вам о всех плюсах и минусах JHipster и раскрою секреты, как с помощью данного инструмента достигнуть максимальной продуктивности и не выстрелить себе в ногу.

JavaFest. Дмитрий Сергеев. Data processing with Kafka Streams and Spring Fram...

FestGroup

В процессе доклада напишем приложение, использующее Kafka Streams и Spring, в реальном времени обрабатывающее данные датчика погоды Raspberry Pi. Разберёмся как течёт время в Kafka Streams и почему это грозит вам бессонными ночами debug’a. Вы узнаете как обрабатывать потоки данных в Kafka c помощью библиотеки Kafka Streams и абстракций Spring Cloud. Мы обсудим окна, агрегации, графы обработки данных и топологии. Напоследок, обсудим нюансы деплоя Kafka Streams приложений.

JavaFest. Nanne Baars. Web application security for developers

FestGroup

More from FestGroup (10)