How Fast is Spring? - Dave Syer
•
3 likes•1,706 views
How Fast is Spring? by Dave Syer at SpringOne Tour
Recommended
More Related Content
More from VMware Tanzu
More from VMware Tanzu (20)
Recently uploaded
Recently uploaded (20)
How Fast is Spring? - Dave Syer
- 1. How Fast is Spring?Dave Syer, 2018 How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 1 of 30 30/01/2019, 10:04
- 2. Agenda How much work is Spring doing, compared to other parts of your app? Tools for measurement Comparison between various classpath and packaging choices Speeding things up The future How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 2 of 30 30/01/2019, 10:04
- 3. Baseline Micro App How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 3 of 30 30/01/2019, 10:04
- 4. Spring Boot 2.1 How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 4 of 30 30/01/2019, 10:04
- 5. Heap Memory and Garbage Collection How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 5 of 30 30/01/2019, 10:04
- 6. Garbage Collection How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 6 of 30 30/01/2019, 10:04
- 7. Flame Graph all com/example/demo/DemoApplication.main org/springframework/boot/SpringApplication.run org/springframework/boot/SpringApplication.run org/sp.. org/sp.. or.. o.. or.. or.. org/springframework/boot/SpringApplication.run o.. org/.. o.. org/sprin.. org/spri.. org/spri.. org/spri.. org/spri.. org/spri.. org/spri.. org.. org.. o.. o.. org/springframework/boot/SpringApplication.refreshContext org/springframework/boot/SpringApplication.refresh org/springframework/boot/web/reactive/context/ReactiveWebServerApplicationContext.refresh org/springframework/context/support/AbstractApplicationContext.refresh org/spr.. org/sp.. org/sp.. org/sp.. reacto.. reacto.. reacto.. react.. react.. react.. reac.. reac.. reac.. i.. i.. i.. i.. j.. s.. s.. s.. i.. org/springframework/boot/web/r.. org/springframework/boot/web/r.. org/sp.. org/sp.. react.. react.. react.. re.. re.. re.. r.. r.. i.. r.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. java/lang/reflect.. sun/reflect/Deleg.. sun/reflect/Nativ.. sun/reflect/Nativ.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframewo.. org/springframew.. org/springfram.. org/springfram.. org/springfram.. org/springfram.. org/springfram.. org/springfram.. org/springfram.. org/springfram.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/.. org/.. org/.. org/.. java.. sun/.. sun/.. sun/.. o.. o.. or.. or.. or.. or.. or.. or.. or.. or.. org/springfra.. org/springfra.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/spri.. org/sp.. org/sp.. org/sp.. java/.. sun/r.. sun/r.. sun/r.. org/.. org/.. org/.. org/.. org/.. org/.. org.. org.. org.. org.. org.. org.. org.. org.. org.. org.. org.. jav.. sun.. sun.. sun.. org.. org.. org.. org.. org.. org.. org.. org.. org.. jav.. org/springframework/context/.. org/springframework/context/.. o.. o.. o.. o.. o.. o.. o.. org/springframewo.. org/springframewo.. org/springframewo.. or.. or.. org/springf.. o.. o.. o.. o.. org/spr.. java.. org/.. org/.. org.. or.. or.. org/.. org/.. org/.. org/.. o.. o.. o.. o.. o.. o.. o.. j.. o.. o.. o.. o.. o.. o.. o.. o.. o.. java/lang/Thre.. org/springf.. org/springf.. org.. jav.. jav.. jav.. jav.. jav.. jav.. su.. su.. su.. su.. ja.. ja.. or.. or.. or.. start_thread java_start(Thread*) GCTaskThread::r.. Dr.. Pa.. PS.. Pa.. Mo.. S.. Flame Graph all com/example/demo/DemoApplication.main org/springframework/boot/SpringApplication.run org/springframework/boot/SpringApplication.run org/spri.. org/spri.. org.. or.. org.. org.. org/springframework/boot/SpringApplication.run o.. org/.. o.. org/sprin.. org/spri.. org/spri.. org/spri.. org/spri.. org/spri.. org/spri.. org.. org.. o.. o.. o.. o.. org/springframework/boot/SpringApplication.refreshContext org/springframework/boot/SpringApplication.refresh org/springframework/boot/web/reactive/context/ReactiveWebServerApplicationContext.refresh org/springframework/context/support/AbstractApplicationContext.refresh org/springfram.. org/springfra.. org/springfra.. org/springfra.. reactor/netty.. reactor/netty.. reac.. rea.. rea.. rea.. io.. io.. io.. io.. ja.. su.. su.. su.. io.. reacto.. reacto.. reacto.. reacto.. reacto.. reacto.. reacto.. reacto.. reacto.. rea.. rea.. rea.. re.. re.. i.. i.. i.. i.. i.. i.. i.. org/springframework/boot/web/.. org/springframework/boot/web/.. org/.. org.. rea.. rea.. re.. re.. re.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. java/lang/reflect/.. sun/reflect/Delega.. sun/reflect/Native.. sun/reflect/Native.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewor.. org/springframewo.. org/springframe.. org/springframe.. org/springframe.. org/springframe.. org/springframe.. org/springframe.. org/springframe.. org/springframe.. o.. o.. o.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/springfr.. org/spr.. org/spr.. org/spr.. org/sp.. java/l.. sun/re.. sun/re.. sun/re.. or.. or.. or.. or.. or.. or.. or.. or.. or.. or.. o.. o.. o.. o.. org/springfra.. org/springfra.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/springf.. org/spring.. org/spr.. org/spr.. org/spr.. java/la.. sun/ref.. sun/ref.. sun/ref.. org/s.. org/s.. org/s.. org/s.. org/s.. org/s.. org/.. org/.. org/.. org/.. org/.. org/.. org/.. org/.. org/.. org/.. org/.. java.. sun/.. sun/.. sun/.. org/.. org/.. org/.. org/.. org/.. org/.. org/.. org/.. org/.. java.. org/springframework/context/support.. org/springframework/context/support.. o.. o.. o.. o.. o.. o.. o.. org/springframework/con.. org/springframework/con.. org/springframework/con.. org/.. org/.. o.. org/springfram.. or.. or.. or.. o.. o.. o.. o.. org/sprin.. java/.. org/s.. org/s.. org.. org.. or.. o.. org/sp.. org/sp.. org/sp.. org/sp.. or.. or.. or.. or.. or.. or.. or.. ja.. or.. or.. or.. or.. or.. o.. o.. o.. o.. o.. o.. o.. o.. o.. java/lang/.. org/spri.. org/spr.. org/s.. org/s.. org/s.. or.. o.. star.. java.. GCT.. s.. How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 7 of 30 30/01/2019, 10:04
- 8. all com/example/demo/DemoApplication.main org/springframework/boot/SpringApplication.run org/springframework/boot/SpringApplication.run org/sp.. org/sp.. or.. o.. or.. or.. org/springframework/boot/SpringApplication.run o.. org/.. o.. org/sprin.. org/spri.. org/spri.. org/spri.. org/spri.. org/spri.. org/spri.. org.. o.. org/springframework/boot/SpringApplication.refreshContext org/springframework/boot/SpringApplication.refresh org/springframework/boot/web/reactive/context/ReactiveWebServerApplicationContext.refresh org/springframework/context/support/AbstractApplicationContext.refresh org/spr.. org/sp.. org/sp.. org/sp.. org/springframework/boot/web/r.. org/springframework/boot/web/r.. org/sp.. org/sp.. org/springframewo.. org/springframewo.. or.. or.. org/springfra.. org/springfra.. org/springf.. org/springf.. org/springframework/context/.. org/springframework/context/.. o.. o.. org/springframewo.. org/springframewo.. org/.. org/.. o.. o.. o.. o.. java/lang/Thre.. org/springf.. org/springf.. org.. jav.. jav.. jav.. jav.. jav.. jav.. su.. su.. or.. or.. or.. start_thread java_start(Thread*) GCTaskThread::r.. Dr.. Pa.. PS.. Pa.. Mo.. S.. all com/example/demo/DemoApplication.main org/springframework/boot/SpringApplication.run org/springframework/boot/SpringApplication.run org/spri.. org/spri.. org.. or.. org.. org.. org/springframework/boot/SpringApplication.run o.. org/.. o.. org/sprin.. org/spri.. org/spri.. org/spri.. org/spri.. org/spri.. org/spri.. org.. o.. org/springframework/boot/SpringApplication.refreshContext org/springframework/boot/SpringApplication.refresh org/springframework/boot/web/reactive/context/ReactiveWebServerApplicationContext.refresh org/springframework/context/support/AbstractApplicationContext.refresh org/springfram.. org/springfra.. org/springfra.. org/springfra.. org/springframework/boot/web/.. org/springframework/boot/web/.. org/.. org.. org/springframewor.. org/springframewor.. or.. or.. org/springfra.. org/springfra.. org/springf.. org/springf.. org/springframework/context/support.. org/springframework/context/support.. o.. o.. org/springframework/con.. org/springframework/con.. org/sp.. org/sp.. o.. o.. o.. o.. java/lang/.. org/spri.. org/spr.. org/s.. org/s.. org/s.. or.. o.. star.. java.. GCT.. s.. Spring Boot 2.0 Spring Boot 2.1 How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 8 of 30 30/01/2019, 10:04
- 9. How Fast is Spring? TL;DR How do I make my app go faster? Classpath exclusions from Spring Boot web starters Use the spring-context-indexer Don’t use actuators if you can afford not to Use Spring Boot 2.1 and Spring 5.1 Use explicit spring.config.location Switch off JMX: spring.jmx.enabled=false Make bean definitions lazy by default Unpack the fat jar and run with an explicit classpath Run the JVM with -noverify. Also consider -XX:TieredStopAtLevel=1 Import autoconfigurations individually Use functional bean definition (Build a native image) How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 9 of 30 30/01/2019, 10:04
- 10. Summary Spring was designed ab initio to be lightweight The engineering team cares deeply about performance There are many optional features Packaging: exploded jar with application main is always best Server: there is no measureable difference between Tomcat, Jetty and Undertow Netty is a bit faster on startup - you won’t notice in a large app The more features you use, the more classes are loaded Functional bean definitions rule Spring Boot, HTTP: starts in <1sec and uses <10MB heap How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 10 of 30 30/01/2019, 10:04
- 11. Tools Benchmarks: JMH Profiling: async-profiler GC pressure: JMC a.k.a. Flight Controller Quick metrics for any Spring Boot jar: Benchmark launcher from dsyer/spring-boot-startup. Classpath manipulation: Thin Launcher Profiling with AspectJ How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 11 of 30 30/01/2019, 10:04
- 12. Benchmarks: Application Startup Static benchmarks from https://github.com/dsyer/spring-boot-startup-bench. New JVM (separate process) per application startup, explicit classpath (not fat jar). Benchmark (sample) Mode Cnt Score Error Units Beans Classes MainBenchmark actr avgt 10 1.316 ± 0.060 s/op 186 5666 MainBenchmark jdbc avgt 10 1.237 ± 0.050 s/op 147 5625 MainBenchmark demo avgt 10 1.056 ± 0.040 s/op 111 5266 MainBenchmark slim avgt 10 1.003 ± 0.011 s/op 105 5208 MainBenchmark thin avgt 10 0.855 ± 0.028 s/op 60 4892 MainBenchmark lite avgt 10 0.694 ± 0.015 s/op 30 4580 MainBenchmark func avgt 10 0.652 ± 0.017 s/op 25 4378 How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 12 of 30 30/01/2019, 10:04
- 13. Number of Classes vs. Startup Time How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 13 of 30 30/01/2019, 10:04
- 14. WebFlux and Micro Apps Flux benchmarks from https://github.com/dsyer/spring-boot-startup-bench Benchmark (sample) Mode Cnt Score Error Units Classes MainBenchmark.main jlog ss 10 0.933 ± 0.065 s/op 4367 MainBenchmark.main demo ss 10 1.081 ± 0.075 s/op 5779 MiniBenchmark.boot jlog ss 10 0.486 ± 0.020 s/op 2974 MiniBenchmark.boot demo ss 10 0.579 ± 0.041 s/op 4138 MiniBenchmark.mini jlog ss 10 0.420 ± 0.011 s/op 2351 MiniBenchmark.mini demo ss 10 0.538 ± 0.009 s/op 3138 MiniBenchmark.micro jlog ss 10 0.186 ± 0.006 s/op 1371 MiniBenchmark.micro demo ss 10 0.288 ± 0.006 s/op 2112 How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 14 of 30 30/01/2019, 10:04
- 15. JVM Tweaks Command line: -noverify -XX:TieredStopAtLevel=1 -Djava.security.egd=file:/dev/./urandom Open J9: CDS -Xquickstart -Xshareclasses -Xscmx128m Java 10/11: CDS, AOT (GraalVM) Explicit classpath (exploded archive) How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 15 of 30 30/01/2019, 10:04
- 16. Open J9 Benchmark (sample) Mode Cnt Score Error Units Classes MainBenchmark.main jlog ss 10 0.709 ± 0.034 s/op 4536 MainBenchmark.main demo ss 10 0.939 ± 0.027 s/op 5954 MiniBenchmark.boot jlog ss 10 0.406 ± 0.085 s/op 3090 MiniBenchmark.boot demo ss 10 0.505 ± 0.035 s/op 4314 MiniBenchmark.mini jlog ss 10 0.340 ± 0.018 s/op 2427 MiniBenchmark.mini demo ss 10 0.432 ± 0.019 s/op 3256 MiniBenchmark.micro jlog ss 10 0.152 ± 0.045 s/op 1436 MiniBenchmark.micro demo ss 10 0.204 ± 0.019 s/op 2238 How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 16 of 30 30/01/2019, 10:04
- 17. How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 17 of 30 30/01/2019, 10:04
- 18. Classpath Exclusions YMMV, but consider excluding: Jackson (spring-boot-starter-json) Logback (spring-boot-starter-logging) Hibernate Validator (org.hibernate.validator:hibernate-validator) Actuators (spring-boot-starter-actuator) How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 18 of 30 30/01/2019, 10:04
- 19. Lazy Beans Spring Data @EnableJpaRepositories(bootstrapMode=BootstrapMode.LAZY) or spring.data.jpa.repositories.bootstrap-mode=lazy BeanFactoryPostProcessor that switches all beans to lazy=true Look carefully at custom beans with expensive @PostConstruct Profiling with AspectJ Lazy subsystems, E.g. see Lazy Actuator How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 19 of 30 30/01/2019, 10:04
- 20. Manual Configuration Choose your own autoconfigurations: "a la carte" instead of "all you can eat". @SpringBootConfiguration @ImportAutoConfiguration({ WebFluxAutoConfiguration.class, ReactiveWebServerFactoryAutoConfiguration.class, ErrorWebFluxAutoConfiguration.class, HttpHandlerAutoConfiguration.class, ConfigurationPropertiesAutoConfiguration.class, PropertyPlaceholderAutoConfiguration.class }) @RestController public class DemoApplication { ... } How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 20 of 30 30/01/2019, 10:04
- 21. PetClinic Benchmarks Green: manual autoconfiguration. Red: different "a la carte" option in Spring Init. Blue: out of the box Spring Boot. Yellow: fully functional via Spring Init How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 21 of 30 30/01/2019, 10:04
- 22. Functional Bean Definitions Before: @Configuration public class SampleConfiguration { @Bean public Foo foo() { return new Foo(); } @Bean public Bar bar(Foo foo) { return new Bar(foo); } } How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 22 of 30 30/01/2019, 10:04
- 23. Functional Bean Definitions After: public class SampleConfiguration implements ApplicationContextInitializer<GenericApplicationContext> { public Foo foo() { return new Foo(); } public Bar bar(Foo foo) { return new Bar(foo); } @Override public void initialize(GenericApplicationContext context) { context.registerBean(SampleConfiguration.class); context.registerBean(Foo.class, () -> context.getBean(SampleConfiguration.class).foo()); context.registerBean(Bar.class, () -> context.getBean(SampleConfiguration.class) .bar(context.getBean(Foo.class))); } } How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 23 of 30 30/01/2019, 10:04
- 24. Result C.f. Bunc vs Demo. How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 24 of 30 30/01/2019, 10:04
- 25. Examples Micro apps (FuncApplication and BuncApplication): https://github.com/dsyer/spring- boot-micro-apps Spring Fu: https://github.com/spring-projects/spring-fu Spring Init: https://github.com/spring-projects-experimental/spring-init Spring Cloud Function spring.functional.enabled=true How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 25 of 30 30/01/2019, 10:04
- 26. CPU Constrained Environments container cpus startup(ms) =========================== riff 4 2817 scf 4 664 riff 2 4614 scf 2 653 riff 1 16782 scf 1 2121 scf:n 1 1091 riff is the image built by pack using the riff builder scf same app built with WebFlux and functional beans scf:n also switch off background preinit How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 26 of 30 30/01/2019, 10:04
- 27. Ahead of Time Compilation (AOT) Native images can be very efficient (see Graal VM). $ native-image -H:Name=target/bunc ... com.example.func.BuncApplication $ ./target/bunc . ____ _ __ _ _ / / ___'_ __ _ _(_)_ __ __ _ ( ( )___ | '_ | '_| | '_ / _` | / ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |___, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: ... Aug 07, 2018 11:25:13 AM org.springframework.boot.web.embedded.netty.NettyWebServer start INFO: Netty started on port(s): 8080 Aug 07, 2018 11:25:13 AM org.springframework.boot.StartupInfoLogger logStarted INFO: Started application in 0.036 seconds (JVM running for 0.04) Benchmark app started Started HttpServer: 40ms Downside: you lose all of JVM benefits (debugging, manageability, dynamic compilation, optimization, garbage collection). Also, too many issues still for general purpose use. How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 27 of 30 30/01/2019, 10:04
- 28. How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 28 of 30 30/01/2019, 10:04
- 29. Links https://github.com/dsyer/spring-boot-startup-bench - older (back to Spring Boot 1.3), fat jar data /static benchmarks in the same repo - newer, explores classes loaded correlation /flux benchmarks in the same repo - WebFlux Spring Fu: https://github.com/spring-projects/spring-fu Spring Init Experiment: https://github.com/spring-projects-experimental/spring-init https://github.com/dsyer/spring-boot-allocations - explore functional beans and GC pressure https://github.com/dsyer/spring-boot-micro-apps - functional beans and AOT (samples not benchmarks) https://github.com/dsyer/spring-boot-aot - AOT compilation and Graal VM https://github.com/mp911de/microbenchmark-runner: Microbenchmark runner with JUnit How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 29 of 30 30/01/2019, 10:04
- 30. ← → 1 / 25 Go to Slide: Go How Fast is Spring? http://localhost:4000/decks/how-fast-is-spring.html 30 of 30 30/01/2019, 10:04