The Well-Grounded Java Developer

Polyglot & Functional Programming
This is still not an Oracle legal slide




                                  2
Why Polyglot & Functional?
• The WGJD wants to code rapidly


• The WGJD wants to code concisely


• The WGJD wants to take advantage of:
   - The JVM
   - Non Object-Orientated approaches
   - Dynamic language approaches


• Polyglot and functional languages exist on the JVM
   - The JVM is no longer tied to Java the language
Why Java is not a Golden Hammer
 • Recompilation is laborious


 • Static typing can be inflexible
    - Can lead to long refactoring times


 • Deployment is a heavyweight process
    - JRebel can mitigate this for web apps


 • Java's syntax is not a natural fit for producing DSLs
Java is a conservative language
• New language features take a while to arrive in Java


• This is deliberate


• Languages that move quickly can “repent at leisure”
   - There are some Scala features which everyone now regrets


• Non-Java languages are a test-bed for features
   - A good place to learn and experiment
Language Zoology
• Interpreted vs. Compiled
   - Interpreted source code is executed as-is
   - Compiled code is converted to machine code before
     execution


• Dynamic vs. static
   - Dynamic variables can have different types at different times
   - Dynamic types are only resolved at execution time
   - Static types can be resolved much earlier


• Imperative vs. functional
   - OO and Procedural are both imperative styles
   - Imperative: Code operates on Data
   - Functional: Code & Data are one and the same
Languages on the JVM
• Over 200! Falling into several broad groupings


• Language re-implementations
   - JRuby, Jython


• Attempted Java killers
   - Fantom, Ceylon, Xtend, Scala


• Dynamic languages
   - Groovy, Rhino, Clojure


• Academic
   - Ioke, Seph
Polyglot Programming Pyramid
• Courtesy of Ola Bini
Ola - JVM languages expert.
     Do not talk to him


    Your brain will melt

                           9
Polyglot Layers
• Domain-specific
   - Tightly coupled to a specific part of the application domain.
   - e.g. Apache Camel DSL, Drools, Web templating


• Dynamic
   - Rapid, productive, flexible development of functionality
   - e.g. Groovy, Jython, Clojure


• Stable
   - Core functionality, stable, well-tested, performant.
   - e.g. Java, Scala
Ask yourself before going Poly
• Is the project area low risk?


• How easily does the language interoperate with Java?


• What tooling support is there?


• Is it easy to build, test & deploy in this language?


• How steep is the learning curve?
   - How easy is it to hire developers?
Experts: “use < 5 bullet points”


         sr&%w that!


                             12
Matt Raible - 20 criteria web frameworks
      –   Developer Productivity
      –   Developer Perception
      –   Learning Curve
      –   Project Health
      –   Developer Availability
      –   Job Trends
      –   Templating
      –   Components
      –   Ajax
      –   Plugins or Add-Ons
      –   Scalability
      –   Testing Support
      –   i18n and l10n
      –   Validation
      –   Multi-language Support
      –   Quality of Documentation/Tutorials
      –   Books Published
      –   REST Support (client and server)
      –   Mobile / iPhone Support
      –   Degree of Risk
JVM language web framework shoot out




    • Grails Wins!

    • http://bit.ly/jvm-frameworks-matrix
Functional Programming
• Functional Programming is important again
   - Multi-core CPUs means that your code can truly run parallel
   - map, reduce, filter idioms would be welcome!


• Java's support is mostly missing
   - Java 7's Fork and Join provides a bit of Map/Reduce
   - How would we want it to work in Java?


• Other languages on the JVM already provide support
   - Groovy, Scala, Clojure
Example - Reconciliation Service
 • We have 2 sources of data


 • Source 1 - The upstream system “sourceData”
    - e.g Call a web service for transaction records


 • Source 2 - The downstream database


 • We need a reconciliation system
    - Check that data is actually reaching the DB.
Reconciliation - Java Take 1
Output of Reconciliation - Java Take 1
  7172329 OK

  7173341 OK

  1R6GT OK

  1R6GV OK

  1R6GW OK

  main_ref: 1R6H2 not present in DB

  main_ref: 1R6H3 not present in DB

  1R6H6 OK

  623SRC OK
Analysing the data
• Q: What’s gone wrong?


• A: Upstream system is case-insensitive
   - Whereas the downstream one is case-sensitive


• 1R6H2 is present in the DB
   - It’s just called 1r6h2 instead


• Let’s go back to the code slide
   - Can anyone see a problem with the code now?


• There’s no containsCaseInsensitive() method
   - This is an irritant
Reconciliation - Fixing Case Sensitivity




    • With this:
Functional Realisation
• If you’ve ever found yourself writing collections code


• And get frustrated because...
   - There’s a method which almost provides a way..
   - To do what you need..
   - But you just need to tweak it slightly..


• Then that frustration is an itch
   - That could be scratched by functional programming!
Introducing Functional Concepts
 • Two ideas related to FP in the previous example


 • First idea is:
     - Operating on collections / data structures as a whole
     - Rather than explicitly iterating over their contents


 • Second idea is:
     - A lack of capability to add additional logic to existing
       methods


 • Both ideas help with writing concise, safer OO code
What if we could...
• Tweak the functionality of a method?
   - By adding in some new code of our own?


• We’d need to pass the code into the method
   - As a parameter.


• We'd need some way to treat the as if it was a value
   - We want to be able to put it into a variable.


• FP requires the ability to represent bits of logic as
  though they were values.
Reconciliation - With Match Function
Library Support

• There’s no actual 2-parameter contains() method.


• But that’s what we would want, if we could start again


• Other languages have this functionality
   - Called: Lambda expressions, closures, function literals..


• Need library support as well as the language primitive
“What if” is for namby pamby
            dreamers



                          26
The Map Pattern




• FP fans would call this a map expression
   - extractPrimaryKeys() takes List & returns new List
   - Run an operation on each element in turn
       • And return the new list we built up
More on the Map Pattern

• Note that the type contained in the returned List may
  be different from the incoming List.
   - In our example, incoming type is DBInfo, outgoing String
   - The original List hasn’t been affected in any way.


• This is where “functional programming” comes from
   - The functions behave like mathematical functions


• A function like f(x) = x * x
   - Doesn’t alter the value 2 when it’s passed in.
   - Instead, it returns a different value, 4.
The Filter Pattern




• The use of map is an absolutely classic FP idiom.


• It’s usually paired with the filter idiom.
Functions-as-values
• We can construct our "function-as-a-value"
      - Need a way to represent that “predicate function” for filter


• Here’s one way we could write it (in almost-Scala):

 (msg) -> { !msg.get("status")

            .equalsIgnoreCase("CANCELLED") };



• This is a function which takes one argument
      - msg is a Map<String, String>
      - The function returns boolean


• Actually, this is also how Java 8 is going to write it.
      - In fact this is a very Java-ish way of writing Scala
There you go Scala folks!
We finally gave you some props


       It’s the last time

                               31
What We Didn’t Cover
• Why functional is good for modern concurrency
   - That’s in the next hour!


• The myriad academic definitions of closures


• Groovy, Scala, Clojure, JRuby, Jython, Nashorn
   - Well actually....


• The Groovy folder you copied from the USB stick
   - Unzip the groovy-2.0.0.zip to a location of your choice
   - Work through as much of CH08 as you like!
What? You still here?
Go take a break will you!




                            33

Polyglot and Functional Programming (OSCON 2012)

  • 1.
    The Well-Grounded JavaDeveloper Polyglot & Functional Programming
  • 2.
    This is stillnot an Oracle legal slide 2
  • 3.
    Why Polyglot &Functional? • The WGJD wants to code rapidly • The WGJD wants to code concisely • The WGJD wants to take advantage of: - The JVM - Non Object-Orientated approaches - Dynamic language approaches • Polyglot and functional languages exist on the JVM - The JVM is no longer tied to Java the language
  • 4.
    Why Java isnot a Golden Hammer • Recompilation is laborious • Static typing can be inflexible - Can lead to long refactoring times • Deployment is a heavyweight process - JRebel can mitigate this for web apps • Java's syntax is not a natural fit for producing DSLs
  • 5.
    Java is aconservative language • New language features take a while to arrive in Java • This is deliberate • Languages that move quickly can “repent at leisure” - There are some Scala features which everyone now regrets • Non-Java languages are a test-bed for features - A good place to learn and experiment
  • 6.
    Language Zoology • Interpretedvs. Compiled - Interpreted source code is executed as-is - Compiled code is converted to machine code before execution • Dynamic vs. static - Dynamic variables can have different types at different times - Dynamic types are only resolved at execution time - Static types can be resolved much earlier • Imperative vs. functional - OO and Procedural are both imperative styles - Imperative: Code operates on Data - Functional: Code & Data are one and the same
  • 7.
    Languages on theJVM • Over 200! Falling into several broad groupings • Language re-implementations - JRuby, Jython • Attempted Java killers - Fantom, Ceylon, Xtend, Scala • Dynamic languages - Groovy, Rhino, Clojure • Academic - Ioke, Seph
  • 8.
  • 9.
    Ola - JVMlanguages expert. Do not talk to him Your brain will melt 9
  • 10.
    Polyglot Layers • Domain-specific - Tightly coupled to a specific part of the application domain. - e.g. Apache Camel DSL, Drools, Web templating • Dynamic - Rapid, productive, flexible development of functionality - e.g. Groovy, Jython, Clojure • Stable - Core functionality, stable, well-tested, performant. - e.g. Java, Scala
  • 11.
    Ask yourself beforegoing Poly • Is the project area low risk? • How easily does the language interoperate with Java? • What tooling support is there? • Is it easy to build, test & deploy in this language? • How steep is the learning curve? - How easy is it to hire developers?
  • 12.
    Experts: “use <5 bullet points” sr&%w that! 12
  • 13.
    Matt Raible -20 criteria web frameworks – Developer Productivity – Developer Perception – Learning Curve – Project Health – Developer Availability – Job Trends – Templating – Components – Ajax – Plugins or Add-Ons – Scalability – Testing Support – i18n and l10n – Validation – Multi-language Support – Quality of Documentation/Tutorials – Books Published – REST Support (client and server) – Mobile / iPhone Support – Degree of Risk
  • 14.
    JVM language webframework shoot out • Grails Wins! • http://bit.ly/jvm-frameworks-matrix
  • 15.
    Functional Programming • FunctionalProgramming is important again - Multi-core CPUs means that your code can truly run parallel - map, reduce, filter idioms would be welcome! • Java's support is mostly missing - Java 7's Fork and Join provides a bit of Map/Reduce - How would we want it to work in Java? • Other languages on the JVM already provide support - Groovy, Scala, Clojure
  • 16.
    Example - ReconciliationService • We have 2 sources of data • Source 1 - The upstream system “sourceData” - e.g Call a web service for transaction records • Source 2 - The downstream database • We need a reconciliation system - Check that data is actually reaching the DB.
  • 17.
  • 18.
    Output of Reconciliation- Java Take 1 7172329 OK 7173341 OK 1R6GT OK 1R6GV OK 1R6GW OK main_ref: 1R6H2 not present in DB main_ref: 1R6H3 not present in DB 1R6H6 OK 623SRC OK
  • 19.
    Analysing the data •Q: What’s gone wrong? • A: Upstream system is case-insensitive - Whereas the downstream one is case-sensitive • 1R6H2 is present in the DB - It’s just called 1r6h2 instead • Let’s go back to the code slide - Can anyone see a problem with the code now? • There’s no containsCaseInsensitive() method - This is an irritant
  • 20.
    Reconciliation - FixingCase Sensitivity • With this:
  • 21.
    Functional Realisation • Ifyou’ve ever found yourself writing collections code • And get frustrated because... - There’s a method which almost provides a way.. - To do what you need.. - But you just need to tweak it slightly.. • Then that frustration is an itch - That could be scratched by functional programming!
  • 22.
    Introducing Functional Concepts • Two ideas related to FP in the previous example • First idea is: - Operating on collections / data structures as a whole - Rather than explicitly iterating over their contents • Second idea is: - A lack of capability to add additional logic to existing methods • Both ideas help with writing concise, safer OO code
  • 23.
    What if wecould... • Tweak the functionality of a method? - By adding in some new code of our own? • We’d need to pass the code into the method - As a parameter. • We'd need some way to treat the as if it was a value - We want to be able to put it into a variable. • FP requires the ability to represent bits of logic as though they were values.
  • 24.
    Reconciliation - WithMatch Function
  • 25.
    Library Support • There’sno actual 2-parameter contains() method. • But that’s what we would want, if we could start again • Other languages have this functionality - Called: Lambda expressions, closures, function literals.. • Need library support as well as the language primitive
  • 26.
    “What if” isfor namby pamby dreamers 26
  • 27.
    The Map Pattern •FP fans would call this a map expression - extractPrimaryKeys() takes List & returns new List - Run an operation on each element in turn • And return the new list we built up
  • 28.
    More on theMap Pattern • Note that the type contained in the returned List may be different from the incoming List. - In our example, incoming type is DBInfo, outgoing String - The original List hasn’t been affected in any way. • This is where “functional programming” comes from - The functions behave like mathematical functions • A function like f(x) = x * x - Doesn’t alter the value 2 when it’s passed in. - Instead, it returns a different value, 4.
  • 29.
    The Filter Pattern •The use of map is an absolutely classic FP idiom. • It’s usually paired with the filter idiom.
  • 30.
    Functions-as-values • We canconstruct our "function-as-a-value" - Need a way to represent that “predicate function” for filter • Here’s one way we could write it (in almost-Scala): (msg) -> { !msg.get("status") .equalsIgnoreCase("CANCELLED") }; • This is a function which takes one argument - msg is a Map<String, String> - The function returns boolean • Actually, this is also how Java 8 is going to write it. - In fact this is a very Java-ish way of writing Scala
  • 31.
    There you goScala folks! We finally gave you some props It’s the last time 31
  • 32.
    What We Didn’tCover • Why functional is good for modern concurrency - That’s in the next hour! • The myriad academic definitions of closures • Groovy, Scala, Clojure, JRuby, Jython, Nashorn - Well actually.... • The Groovy folder you copied from the USB stick - Unzip the groovy-2.0.0.zip to a location of your choice - Work through as much of CH08 as you like!
  • 33.
    What? You stillhere? Go take a break will you! 33

Editor's Notes

  • #2 TODO: If we have time, replace images of code with real text based code\n
  • #3 It&amp;#x2019;s always worth repeating a bad joke\n
  • #4 Explain what polyglot means\n
  • #5 Do yourself a favour and get a JRebel license if you web hack in Java\n
  • #6 Learning non-Java languages will make you a better programmer\n
  • #7 * Java confuses matters as it&amp;#x2019;s.... both\n* Static types can be resolved at compile time for example\n
  • #8 \n
  • #9 \n
  • #10 \n
  • #11 \n
  • #12 * Intro the web dev slides. &amp;#x201C;One major use case for poly is web dev.&amp;#x201D;\n* Hands up if you do Struts or JSF. Hands up if you like it.\n
  • #13 Upcoming 20 bullet point slide\n
  • #14 \n
  • #15 Actually I can talk to the start-up story here - MV\n\n\n
  • #16 \n
  • #17 \n
  • #18 * We have 2 sources of data, and we want to check whether the same elements appear in each.\n* We need two loops to do this - as there are 3 cases - id is OK, id only appears in source, and only in DB\n
  • #19 \n
  • #20 \n
  • #21 \n
  • #22 \n
  • #23 \n
  • #24 * So, we&amp;#x2019;ve come at this a different way - we started out by saying that we need to pass in function values to customise functions.\n* This is what&amp;#x2019;s called &amp;#x201C;higher-order functions&amp;#x201D;. This is a different approach.\n
  • #25 * Imaginary FP-in-Java syntax\n* Of course, this method doesn&amp;#x2019;t really exist. That&amp;#x2019;s why Eclipse has red-underlined it.\n
  • #26 \n
  • #27 \n
  • #28 Let&amp;#x2019;s show a bit more context, and show how the reconcile() method gets called. DBInfo is the type which was actually returned from the DB lookup\nAlso, another slightly sneaky trick is in the call to reconcile() &amp;#x2013; we pass the returned List from extractPrimaryKeys() into the constructor for HashSet to convert it to a Set. This handily de-dups the List for us, making the contains() call more compact in the reconcile() method.\n
  • #29 \n
  • #30 \n* Notice the &amp;#x201C;defensive copy&amp;#x201D;. We return a new List. \n* We don&amp;#x2019;t mutate the existing List (the filter() form behaves like a mathematical function). \n* We build up a new List by testing each element against a function which returns boolean. \n* If the result of testing an element is true, we add it into the output List\n
  • #31 Predicate is the jargon for the returns-boolean testing function that we apply to each element in turn.\n\n
  • #32 \n
  • #33 \n
  • #34 \n