1. The Professional
Programmer
Some tips

2. What We Will Cover
● Know your tools
● Adjacent technologies
● Software Engineering and Architecture
● The Business
● Personal Development

3. Fluffiness vs Time

4. In Three Hours
● Lots to cover
● Moving pretty quickly
● High-level view
● Pointers to information
● Homework

5. Administrivia
● Let's keep this informal
● Dialogue > Monologue
● Share experiences
● Ask questions

6. Who Are You?

7. Who Are You?
● Hi, I'm Dave
● I'm very old
● I've been doing this for thirty years
● Freelance since 1995

8. Very Very Old
● When I was a school we did no computing
● First year of a physics degree
● No computing there either
● Dropped out

9. Very Very Old
● Sinclair Spectrum
● "I can do this"
● South Bank Polytechnic
● Computer Studies (1984-88)
● "Data Processing"

10. Course Syllabus
● VAX / VMS
● COBOL
● Assembler
● Prolog
● CODASYL Databases
● 5th Generation Computing

11. Useful Stuff
● C
● Unix
● SQL
● SGML

12. First Job
● C
● SQL
● Windows
● CASE Tool
● SSADM

13. Second Job
● C++
○ OO Programmng
● Network communication

14. Third Job (Disney)
● C
● Unix
● SQL
○ Sybase
● Ka-Ching!

15. Freelancing
● C / Unix / Sybase
● Perl
● City -> Dotcoms
● "New Media"
● BBC / Guardian

16. Lessons Learned
● 75% of my degree course was useless
● Out of date
● Industry in constant change
○ There are still jobs if you get left behind
● Self-taught
● Keep up to date

17. SGML?
● Standardised Generalised Markup Language
● Basis for XML
● Basis for HTML
● Funny how stuff comes around

18. Know Your Tools

19. Know Your Tools
● Three tools you use every day
● Editor
● Operating system
● Source code control

20. Editor
● A programmer's most important tool
● Get to know it well
● Pick one you like
● Not just vi vs emacs
● Lots of alternatives
● I like Atom

21. Programmer's Editor
● Use a real programmer's editor
● Get to know the features
● Take time to become an expert
● You will save time in the end

22. Editor Features
● Syntax highlighting
● Auto-complete
● Indentation
● Folding

23. IDE Features
● Deeper knowledge of languages
● Compile / run
● Debugging
● Source code control
● Multi-file projects

24. More Features
● Everything is configurable
● Everything is extensible
● Everything is programmable

25. Operating System
● Your operating system is where you live
● Get to know its features
● Design your working environment
● Automate things

26. Operating Systems
● What do you use your operating system for?
● Web browsing
● Reading email
● Social media
● Development?
○ Virtual machines
○ Containers

27. Configure Your OS
● Make it as comfortable as possible
● Window decoration
● Window behaviour
● Virtual desktops

28. Automate Common Tasks
● Automate anything the third time you need to do it
● Learn your OS's scripting mechanism
● Linux / Unix shell scripting
○ Aliases
○ Functions
● Powershell

29. SSH Connections
● You will need to connect to other systems
● Secure shell (ssh)
○ ssh-agent / ssh-add
○ ~/.ssh/config
○ Keepalive
○ Username
○ Agent forwarding
● Putty does all of this too

30. Source Code Control
● Why aren't you using git?
● Why aren't you using Github?
○ Microsoft
● Understand how your source code control works

31. Switch to Git
● Git has been the de-facto industry standard for ten years
● More powerful
● More flexible
● Harder to use
● Different paradigm
● "Optimistic concurrency"
● Good merge tools

32. Git Advantages
● Distributed model
○ Off-line access
● Branches are easy and quick
● Rebasing
○ Interactive rebasing
● "Fetch" vs "Pull"
● Safety net

33. Git in the Cloud
● Don't run your own Git infrastructure
● Other people are better than you at doing that
● Social coding
● Github
● Bitbucket

34. Adjacent
Technologies

35. Adjacent Technologies
● What other technologies do you use every day?
● Data storage
○ Databases
○ Data formats
○ XML
○ Caching
● Networking
○ HTTP

36. Adjacent Technologies
● Testing
○ Types of tests
○ Test automation
● Deployment
○ Jenkins
○ Docker
○ AWS

37. Data Storage
● How do you store your persistent data?
● Database
○ RDBMS
○ NoSQL
● Data files
○ JSON
○ YAML
○ XML

38. RDBMS
● Which database vendor do you use?
● Why did you choose MySQL?
● Would PostgreSQL be better?
● How does it scale?
● Replication vs Sharding
● How well do you know SQL?

39. RDBMS Features
● Which RDBMS features do you use?
● How vendor specific are they?
● Vendor-specific SQL extensions
● Referential integrity
● Stored procedures?
● Triggers?

40. RDBMS Usage
● How are your databases split?
● One database?
● One database per application?
● One database per service?
● Who owns the database?
● Who can change the schema?

41. Database Schemas
● How do you change database schemas?
● Can you easily tell which schema version is on a database?
● Do you use a database migration tool?
● What problems does that lead to?

42. NoSQL
● Which NoSQL database do you use?
● MongoDB, Redis, CouchDB, Memcached
● Do you understand the different types?
● Would you be better off with an RDBMS?

43. Data Files
● What formats are your data files?
● How are they processed?
● Are you using the best available tools to process them?

44. JSON
● Javascript Object Notation
● Popular data interchange format
● AJAX
● Decode to native data structures
● Encode from native data structures

45. JQ
● General purpose JSON utility
● Reformat JSON
● Extract data from JSON
● Powerful query language

46. XML
● Still popular
● For some reason
● Need to deal with it
● Find the right tools

47. XPath
● XML query language
● Extract data from XML documents
● Standard syntax

48. Networking
● What networking protocols do you use?
● How well do you know them?
● Seven layer model

49. HTTP
● Can you explain the HTTP request / response cycle?
● To what level of detail?
● What difference does HTTPS / SSL make?

50. HTTP Requests
● Can you name all of the HTTP request types?
● GET, POST, HEAD
● PUT, DELETE, PATCH
● OPTIONS, TRACE, CONNECT
● What are the differences?
● What are they used for?
● REST

51. Testing
● Do you write unit tests?
● Does your system have automated integration tests?
● How are your tests run?
● Automatically?

52. Unit Tests
● Never program without a safety net
● Does your code do what it is supposed to do?
● Will your code continue to do what it is supposed to do?
● Write unit tests
● Run those tests all the time

53. What is Unit Testing?
● Code that exercises an individual element (unit) of your code
● Provide known inputs
● Look for expected outputs
● “Bottom-up” testing

54. Test Driven Development
● Have you tried Test Driven Development?
● What did you like?
● What didn't you like?
● Will you try it again?

55. TDD Advantages
● Tests are a specification of your program
● If the tests pass, the program is finished
● Know when to finish

56. Behaviour Driven Development
● Let end users define tests in their language
● Simple domain-specific language
● Framework converts user tests to running code
● Cucumber

57. Test Automation
● What test automation frameworks do you know?
● What test automation frameworks do you use?
● Selenium

58. Test Coverage
● How good are your tests?
● How much of your code is used in your tests?
● Measure to improve

59. Deployment
● How is your system deployed?
● Where are the servers located?
● Do you care?

60. Deployment Environments
● What environments do you have?
● Development
● Integration
● Staging
● Production

61. Deployment Environments
● How is code moved from environment to environment?
● How similar are those environments?
● How are they kept in step?

62. Database Environments
● How are databases handled in development and testing environments?
● Full database?
● Smaller data sets?
● Anonymised data?

63. Deployment Options
● Real hardware
● Cloud servers
● Virtual machines
● Containers

64. Real Hardware
● Company owns or rents computers in a data centre
● Ops staff spend a lot of time in the data centre
● Commissioning new servers
● Decommissioning old servers
● No scalability

65. Cloud Servers
● Servers commissioned from a huge farm
● Commissioned / decommissioned from a dashboard
● Or with an API
● Never see the actual hardware
● Easily scalable

66. Virtual Machines
● Run one machine inside another
● Many virtual machines on one real server
● Easy to commission / decommission servers
● Easy scaling
○ Within limits of the hardware

67. Containers
● Docker
● Cut-down virtual machines
● Share a lot of the underlying OS
● Very quick to commission / decommission
● Layered architecture
● Store configuration in source code control

68. Cattle Not Pets
● Treat servers as cattle, not pets
● Make it easy to create new ones
● Do that a lot

69. Environment Configuration
● Keep your environments in step
● What software is installed?
● What versions of software is installed?
● Avoid "works on my machine"
● Puppet, Ansible, Chef

70. Jenkins
● Continuous integration
● Run tests on every commit
● Continuous deployment
● Make release available on every commit
● Quality gates
● Other, similar, products are available

71. Amazon Web Services
● Most popular cloud services providers
● Many services available
● Generic cloud servers (EC2)
● File storage (S3)
● Relational databases (RDS / Aurora)
● Caching (ElastiCache)
● Many, many more

72. Amazon Web Services

73. Other Cloud Providers
● Google Cloud Platform
● Microsoft Azure
● Oracle Cloud
● Rack Space
● Open Stack (self hosted)
● Etc...

74. Software
Engineering &
Architecture

75. Software Engineering & Architecture
● Software development lifecycle
● Programming paradigms
● Design patterns

76. Software Development Lifecycle
● Agile vs Waterfall
● Agile Manifesto
● Scrum vs Kanban vs Extreme Programming
● Know your tools
○ Jira
○ Code reviews

77. Agile Manifesto
We are uncovering better ways of developing software by doing it and helping
others do it. Through this work we have come to value:
● Individuals and interactions over processes and tools
● Working software over comprehensive documentation
● Customer collaboration over contract negotiation
● Responding to change over following a plan
That is, while there is value in the items on the right, we value the items on the left
more.

78. Individuals and Interactions
● People are more important than processes
● Development teams know how to organise their work
● Business says what they need
● Development team works out how to achieve that
● Giving people more control and responsibility

79. Working Software
● Documentation is often out of date before it is finished
● Mismatch between business language and technical language
● Business often don't know what they want until they see the options
● Build prototypes and discuss alternatives

80. Customer Collaboration
● Don't just involve users when the project is specified
● Have user representatives as a part of the development team
● Instant response to developer questions
● More involvement leads to more business ownership of project

81. Responding to Change
● Requirements will change during the project lifetime
● Be flexible
● Plan for change

82. Programming Paradigms
● What paradigms does your system use?
● Procedural
● Object Oriented
● Functional
● Who made those choices?
● Why?

83. Procedural Programming
● Dumb variables
● Procedures, functions
● Hard to maintain
● Hard to scale

84. Object Oriented Programming
● Classes define both data (attributes) and behaviour (methods)
● Intelligent variables
● Encapsulation
● Subclassing
● Easy to maintain
● Easy to scale

85. Functional Programming
● Pure functions
○ Take inputs, return values
○ No global variables
● Immutable variables
● Prefer recursion to loops
● Easier to maintain
● Good for asynchronous programming

86. Design Patterns
● "Gang of Four" book
● "Monolithic" architecture
● Service Oriented Architecture
● Microservices

87. The Power of Names
● Design patterns weren't new or exciting
● Naming them was
● Catalogue of known techniques
● Easier to discuss
● Easier to share

88. The Business

89. The Business
● What does your company do?
● What does success look like?
● How do they measure success?
● How do you contribute to that success?

90. What Does Your Company Do?
● What service does your company provide?
● Why do customers choose your company?
● What is the USP?

91. Making Money
● What is your company's business plan?
● Where does the money come from?
● Are there multiple sources of income?
● How secure is that income?
● How much profit does the company make?
● How does that compare to your salary?

92. Competitive Marketplace
● Who are your biggest competitors?
● How are you ranked?
● Why do customers choose your company?
● Why do customers choose your competitors?
● What is your company doing to change the balance?

93. Mergers & Acquisitions
● Has your company bought any other companies?
● Might your company buy any other companies?
● What companies might it buy?
● Who owns your company?
● Might they sell it?

94. Stocks & Shares
● Is the company private or public?
● Can you buy shares?
● Is there an employee share scheme?
● What are the shares worth?
● Can you get share options?

95. Personal
Development

96. Personal Development
● Where do you want to be in five (or two, or ten) years?
● How you you get there?
● Do you have a plan?

97. Career Structure
● What is the hierarchy like?
● Where are you currently?
● Where do you want to be?
● How do you get there?
● Annual reviews

98. Management vs Technical
● Do you want to manage people?
● Team leader
● Development manager
● Help others build a career
● Less time coding
● More politics

99. Management vs Technical
● Do you want to manage systems?
● Technical lead
● Technical architect
● Steer the technical direction of the project
● Less time coding
● More meetings

100. Job Titles
● Job titles in our industry mean very little
● Each company is different
● How senior is a senior developer?
● Flat structures
● Often used as an incentive
● Job spec (and package) is more important

101. Setting Targets
● What do you need to do to get to the next level?
● Specific targets
● "Take responsibility for this subsystem"
● "Lead a project that is estimated to take four weeks"
● Identify training requirements
● Don't forget "soft" training

102. Internal Marketing
● Does the CTO know who you are?
● Does the CEO know who you are?
● Reply to email chains
● Give presentations at company meetings
● Speak to people in the kitchen
● Socialise

103. External Marketing
● How well-know are you outside of your company?
● Write a blog
● Answer questions on forums
● Speak about your work

104. Blogging
● Blog about your work
○ Check first
○ Company tech blog
● Blog about your personal projects
● Use your blog posts to answer questions on forums
● Comment on well-known blogs
● Add your blog to aggregators

105. Blogging Practicalities
● Wordpress
○ Hosted (wordpress.com)
○ Self-hosted (wordpress.org)
● Medium
○ Publications
● Github Pages
● Custom domain

106. Public Speaking
● Give talks about your projects
● Public speaking isn't as hard as you might think
● Start with a lightning talk

107. Some Public Speaking Secrets
● Some people aren't good at public speaking
● Or, at least, they don't make an effort to improve
● Not hard to be good at it
● Very easy to be better than average
● Watch videos to improve

108. TED
● Excellent examples of talks
● Interesting subject matter
● Engaging speakers
● Well-designed slides
● Something to aim at

109. Public Speaking Practicalities
● Find somewhere to speak
● Meet-up groups
● Local user groups
● Conferences

110. Conclusions

111. Conclusions
● Good developers are in short supply
● And that isn't going to change in our lifetimes
● Plenty of opportunity to make a difference
● Plenty of opportunity to do well
● Know your industry
● Know your tools
● Keep up to date

112. The Professional
Programmer
Dave Cross
@davorg
dave@perlhacks.com