Gradle - From minutes to seconds: minimizing build times
•
2 likes•557 views
From minutes to seconds: minimizing build times René Gröschke presented ways to improve build performance in Gradle projects. He discussed general performance improvements like faster configuration times and parallel task execution. The Worker API allows task actions to run in parallel safely. Incremental builds and compile avoidance only re-execute necessary tasks. The build cache reuses results from previous builds. Build scans provide insights into build executions to optimize performance. Gradle Enterprise offers hosted build caching and build scans for collaboration.
More Related Content
What's hot
What's hot (20)
Similar to Gradle - From minutes to seconds: minimizing build times
Similar to Gradle - From minutes to seconds: minimizing build times (20)
Recently uploaded
Recently uploaded (20)
Gradle - From minutes to seconds: minimizing build times
- 1. From minutes to seconds: minimizing build 3mes RENE GROESCHKE GRADLE INC. @JugHH
- 2. • René Gröschke • Principal Engineer @ Gradle Inc. • rene@gradle.com • @breskeby • github.com/breskeby About me
- 3. • Intro • General performance improvements • Gradle Worker API • Incremental builds & Compile avoidance • Gradle Build Cache • Deep build insights Agenda
- 7. Gradle build execuIon Gradle build scripts Execute tasks 2-phase build: ConfiguraIon phase → build task graph ExecuIon phase → execute task graph Configure tasks
- 8. build.gradle apply plugin: 'java-library' repositories { jcenter() } dependencies { api 'org.apache.commons:commons-math3:3.6.1' implementation 'com.google.guava:guava:21.0' testImplementation 'junit:junit:4.12' } task greeting(type: DefaultTask) { doLast { println "Hallo Hamburg!” } }
- 11. • Faster configuraIon Ime • Parallel dependency downloads • Parallel task / acIon execuIon by default General performance improvements
- 12. Worker API
- 13. Worker API • Previously tasks in different projects can run in parallel • New API to run task acIons in single project in parallel safely • Parallel acIons cannot mutate shared state
- 14. Example worker import javax.inject.Inject class ReverseFile implements Runnable { File fileToReverse File destinationFile @Inject public ReverseFile(File fileToReverse, File destinationFile) { this.fileToReverse = fileToReverse this.destinationFile = destinationFile } @Override public void run() { destinationFile.text = fileToReverse.text.reverse() } }
- 15. class ReverseFiles extends SourceTask { final WorkerExecutor workerExecutor @OutputDirectory File outputDir // The WorkerExecutor will be injected by Gradle at runtime @Inject public ReverseFiles(WorkerExecutor workerExecutor) { this.workerExecutor = workerExecutor } @TaskAction void reverseFiles() { source.files.each { file -> workerExecutor.submit(ReverseFile.class) { WorkerConfiguration config -> // Use the minimum level of isolation config.isolationMode = IsolationMode.NONE // Constructor parameters for the unit of work implementation config.params = [ file, project.file("${outputDir}/${file.name}") ] } } } }
- 16. Worker isolaIon levels • NONE - runs in same process, minimum isolaIon • CLASSLOADER - runs in same process with isolated classloader • PROCESS - runs in separate process, maximum isolaIon
- 17. Worker API resources • Video of Gradle Summit presentaIon on worker API • Worker API documentaIon
- 19. The fastest task is the one you don’t need to execute Only re-run tasks affected by changes made between build execuIons Incremental builds
- 21. Compile avoidance & incremental compiler
- 22. Save 3me by only recompiling the minimum number of source files needed for a given change Compile avoidance & incremental compiler
- 23. Compile avoidance Project A Project B MyInternalClass recompile unchanged
- 25. • Analyze class dependencies to opImize which classes are recompiled • Fast in-memory cache of class ABIs inside daemon Incremental compiler
- 26. Enable incremental compiler tasks.withType(JavaCompile) { options.incremental = true }
- 27. Compile avoidance & incremental compiler
- 28. Build cache
- 29. Build cache • Gradle reuses results • from last Ime • when we ran this build • on this machine
- 30. Build cache • Why not • from any3me • when we ran any build • anywhere
- 31. Demo Build cache
- 33. Build cache buildCache { local { enabled = !isCI } remote(HttpBuildCache) { url = "https://my.ge.server/cache/" push = isCI } }
- 34. Build cache in Gradle build
- 35. • IntroducIon to build cache blog post • Extensive guide on using the build cache and improving the cacheability of your build • User guide secIon on build cache • Highly-performant, scalable build cache backend available in Gradle Enterprise • Build cache node Docker image Build cache resources
- 36. Build scans
- 37. Build scans • Details about build failures • Visual Imeline of which tasks ran and in which order • Details on why tasks were executed (up-to-date reasons) • Which dependencies were used • Performance analysis of configuraIon, execuIon, etc. • Aaach custom data to your builds (Git commit, CI or local, Checkstyle errors, etc.) Deep insights into a build execution
- 38. Build scans • Quickly idenIfy places in your build to opImize • Find slowest tasks, long build configuraIon Ime, long dependency download Imes, etc. • See which tasks are and aren’t cacheable • IdenIfy slowest tests Improve build performance
- 39. Build scans • Easily share exactly what happened in when your build ran (tasks, tests, etc.) • Build environment (JDK, OS, CLI switches, etc.) • Share exact links to many different parts of the build scan (specific task, test, dependency, console output line, etc.) Collaborate with colleagues and the community
- 40. Build scans Demo
- 41. • scans.gradle.com • Get started with build scans • Build scan plugin user manual Build scan resources Build scans are a free service for everyone!
- 43. Gradle Enterprise • Build scans + search + comparison + (analyIcs) • Scalable, high-performance build cache backend • Hosted on-premise
- 45. • Gradle Enterprise is a commercial offering • Learn more: gradle.com/enterprise • Free trial at haps://gradle.com/enterprise/trial Gradle Enterprise
- 46. • Incremental builds • Build cache • Compile avoidance & Incremental compiler • Worker API • Gradle Build Scans • Gradle Enterprise Summary
- 47. • IntroducIon to Gradle (Free online training class) • Maximizing Developer ProducIvity with Gradle Enterprise (Free online training class) • Gegng-started and topic-based guides • User documentaIon • Gradle forums AddiIonal resources
- 48. Careers @ Gradle Inc. We’re Hiring! Check at www.gradle.org Engineering Gradle BuildTool Software Engineer Worldwide Gradle Cloud Services Back-End Engineer Worldwide Gradle Cloud Services Front-End Engineer Worldwide
- 49. Q & A