Nashorn is a JavaScript runtime built on top of Java that is compatible with ECMAScript 5.1 and allows for modular development and full interoperability with the JVM. Project Avatar utilizes the Nashorn engine to create a JavaScript service layer that reduces the need for extensive JavaScript knowledge. While Nashorn is improving in speed compared to Node.js, it has some limitations, including slower performance and potential issues with certain frameworks.