How to guarantee your change is integrated to Moodle core

D
Dan PoltawskiDeveloper/Integrator
Dan Poltawski
Integrator
Moodle HQ
How to guarantee your change is
integrated to Moodle core
@dan_p
Who am I?
• Core developer in Moodle community since 2005
• Worked with schools, universities and businesses
around UK
• Moved to Australia and joined Moodle HQ in 2012 as
an Integrator and Developer
• Since joining HQ, i’ve spent a lot of my time
complaining about the price of beer in Perth...
$10!
£7
€8
(http://www.quora.com/Beer/Does-Perth-Australia-have-the-most-expensive-beer-prices-in-the-world)
Who am I
I’m also part of the Integration Team..
• Experienced group of Moodle developers at HQ, who
act as the final ‘gatekeepers’
• Conducting final checks before code makes it into
Moodle release
• Bring historical context and try to facilitate
communication between interested parties
• Consider the whole communities point of view
• http://docs.moodle.org/dev/Integration_Review
How to guarantee your change is
integrated to Moodle core
How to guarantee your change is
integrated to Moodle core
You can’t!
Why not..
• The Moodle community is diverse and we need to support a
large community in a generic way
• We’re maintaining a ‘platform’ with core tools
• We don’t have unlimited resources to maintain every feature
anyone can think of
..use moodle.org/plugins/
• Plugins to support as many types of customisations as possible
• Tightly integrated to Moodle for easy install and upgrades
[DEMO]
• Infrastructure will continue to be improved in this direction
Why contribute anything to core?
• It’s a bug
• You can’t fix core bugs in
plugins!
• There isn’t an appropriate
plugin point
• You’re confident the Moodle
community will be on board
• Its rewarding!
• Dan core contributors
• (we’ve got 2800 open bugs and
appreciate help)
0
25
50
75
100
28
51
76
84
93
2.1 2.2 2.3 2.4 2.5
Non-Moodle HQ core contributors
per release
But if you fit the bill..
Here are some ways to increase your chances of success..
1. Process
• Same for any developer, even Moodle
HQ
Simplified:
• Make code available as a git branch
• Multiple rounds of code review
• Pulled into main Moodle repository and
tested
• If successful, closed and change is
deployed
http://docs.moodle.org/dev/Process
1. Process
Pitfalls:
• Learning the ropes can be daunting, don’t be afraid to
ask for help!
• Some aspects of the process involve waiting for
feedback
• Other parts of the process request your feedback
quickly, in a time limited way (e.g. ‘testing failed’ state)
2. Tracker
• All developments start with a tracker
issue. The ‘home’ of developers, lots of
knowledge recorded on issues
• Be sure to search for and link together
related issues
• Record your thoughts/decisions while
developing code, is useful reference
• Be sure to link to related forum
discussions, docs and materials which
are relevant, else a developer may not
aware of this
2. Tracker
Pitfalls:
• Commenting on an already closed issue
• Useful in some cases, but if new work is required, a
new issue is needed
• Creating duplicate issues
• Please search, make use of component fields to
narrow down issues
• Some actions need additional permissions, see Moodle
Docs: Tracker Guide
3. Community support
• Gather support from the community for your
changes:
• Announce and publicise on forums, twitter,
moots etc.
• For major changes, construct a specification on
the developer docs wiki and solicit feedback
• Be sure to consider use cases other than your
own
• Once you’ve gathered tracker votes, comments
and support, be sure to link from the tracker
3. Community support
Pitfalls
• Not soliciting any feedback
• Bumping forum posts to get attention
• If you are not getting interest it may actually indicate that
nobody else is interested.. which might not be a good
fit.
• Ignoring a use case which doesn’t fit with yours
• We can’t ignore specific use cases in core
4. Coding Style
• Moodle has nearly 1 million lines of code which have
evolved over 10+ years from hundreds of developers
• The Moodle coding style was created to improve
consistency and should be followed for all new code:
http://docs.moodle.org/dev/Coding_style
• Lots of old code sucks, don’t copy it!
• The codechecker and moodlecheck plugins allow
you to check your code against coding style rules
automatically.
• Try to take a sensible approach to any code you are
modifying. Its often sensible to match the surrounding
style for better readability
4. Coding Style
Common Pitfalls
• Not checked against code checker at all
• Gives suggestion of poor attention to detail, don’t give us that
excuse!
• Use of underscores in variable names
• Incorrect spacing on control statements
• Developing without DEBUG_DEVELOPER
5. Code Review
• All Moodle Code is reviewed multiple times before making it into the
final release
• Moodle is so huge and has been evolving for so long that no one person
knows everything
• The code review serves as a way to both improve the code and to share
the historical context which might apply to each change
• Ideally, for the best chance of success, someone experienced with the
area you are coding would review the code (e.g. component maintainer)
• Code review is a two way process, don’t be afraid to justify your
decisions (an important part of the process is to extract the rationale for
others to see)
5. Code Review
Pitfalls:
• Difficulty finding a peer reviewer
• Try to be patient and when your patience runs out, consider campaigning
politely on the forums
• Reviewers can be critical and sometimes frank
• Try not to take it personally, the goal of everyone is to find the best
technical solution for each issue
• Disagreement with reviewer
• Feel free to state your case and if necessary, disregard their advice. But
be sure to justify your rationale for final integration
6. Cross-DB Compatibility
• Moodle supports PostgreSQL, MySQL, Oracle and MS SQL.
Please try to test against another db to your usual environment as
a minimum
• Pay special attention when writing custom SQL
• At this time, transactions cannot be relied upon in core, because
we still support myisam
• Can be useful for constructing complex queries against different
engines: http://sqlfiddle.com/
6. Cross-DB Compatibility
Common pitfalls:
• Forgetting $DB->sql_compare_text() or $DB->sql_concat()
• Using DISTINCT on text columns (not compatible with Oracle)
• Adding LIMIT clauses, rather than using the function params
• Not including all GROUP BY items in the SELECT field-list (MySQL vs
PostgreSQL)
• Not using placeholders for user input
• Not using the XMLDB editor for creating schema definitions
7. Performance
• Don’t decrease performance!
• Database queries are by far one of the most expensive things you
can do, try not to increase them, ensure that they are constant.
• If you improve performance, please record and share your results on
the tracker. We love integrating performance improvements!
• profile, profile, profile (see Tim Hunt’s recent blogpost: Performance-
testing Moodle )
• Make use of the Cache API for adding caching, don’t create your
own caches: http://docs.moodle.org/dev/Cache_API
7. Performance
Common pitfalls
• DB Queries in loops or widely called functions
foreach ($courseids as $courseid) {
//... do stuff..
foreach ($studentids as $studentid) {
$DB->get_record('user', array('id' => $studentid);
// Could be called 50,0000 times even on small sites!
}
}
• Loading a large amount of data into RAM
• Try to use $DB->get_recordset*() on large datasets
• Be mindful with file inclusions
8. Security
• You should know and be using, at least:
• optional_param()/ required_param() or formslib to validate
user input
• PARAM_xxx types for cleaning user input
• XSRF protection using session keys
• s(), p(), format_string() and format_text() for
outputting user-inputted text
• How to control access using capabilities, the context hierarchy and
require_login() etc
• Our process for dealing with security bugs is different, in order to
achieve responsible disclosure.
8. Security
Common pitfalls:
• Forgetting session keys
• Handled for you by formslib, else you need to do it!
• Often missed when simple toggle functions
• Incorrect use of PARAM_ types
• Study the top of lib/moodlelib.php
• Careful with FORMAT_TEXT - it’s name is misleading due to
multilang
9. Internationalisation
• Moodle 2.5 has over 100 language packs and is a strong multilingual
community
• Use get_string() for strings, don’t hardcode english!
• Consider carefully the time of translators in creation of your strings
(tricky tradeoff)
• Remember to use userdate() for times, we provide a number of
standard time formats as standard.
• Not all languages use ‘.’ for floating point numbers! Remember to use
format_float() and unformat_float() to recieve and output
floating point numbers in the users locale
• Consider Right To Left (RTL) languages in CSS/design [.dir-rtl]
9. Internationalisation
Common pitfalls:
• Concatenating strings, this breaks badly for rtl languages or when
its impossible to translate correctly
• Using the same string in different contexts
• Use AMOS SCRIPT in git commits to do an AMOS CPY to make
the translators life easier http://docs.moodle.org/dev/Languages/
AMOS#AMOS_script
• Using PARAM_FLOAT for user input
10. Testing
• A big focus for Moodle over the last two years
• Unit testing with phpunit
• Tests written in php and executed in a sandboxed ‘per unit’ environment.
• Much more powerful than the old simpletest environment
• Test environment is reset between tests
• Data generators allow test data to be easily constructed
• Extensive range of assertions
• Automated acceptance testing, using behat
• Tests written in English and executed automatically in a browser environment
• Used for UI testing in multiple environments
• Manual tests for situations which are not possible to automate
• All automated tests are being run and verified on a weekly basis to check for
regressions
10. Behat Demo
Scenario: Login to course and add forum
Given the following "users" exists:
| username | firstname | lastname | email |
| presenter1 | Presenter | Dan | dan@moodle.com |
And the following "courses" exists:
| fullname | shortname |
| iMoot Course | imoot |
And the following "course enrolments" exists:
| user | course | role |
| presenter1 | imoot | editingteacher |
And I log in as "presenter1"
And I follow "iMoot Course"
And I turn editing mode on
And I add a "Forum" to section "1" and I fill the form with:
| Forum name | iMoot Forum |
| Forum type | Standard forum for general use |
| Description | Test forum description |
When I follow "iMoot Course"
Then I should see "iMoot Forum"
10. Testing
Pitfalls
• No tests at all
• Consider using TDD for new code (its likely to be helpful
for you too!)
• We will become stricter about this over time (no excuses)
• Adding complex logic into tests and other ‘test smells’
• http://xunitpatterns.com/Test%20Smells.html is
recommended reading
• Learning curve setting up the tools
• Please post on the forums and help us improve our tools!
Grab bag..
• Knowledge of git and how to create a git branch is essential. As are
good commit messages (see http://docs.moodle.org/dev/
Commit_cheat_sheet )
• Backwards compatibility must be maintained for for core code,
ensure that your changes don’t break backwards compatibility
• When fixing bugs, we generally need to support the last 3 versions
currently in support, as specified in http://docs.moodle.org/dev/
Releases
• Don’t be put off from contributing your code if you can’t do all of
what I suggest. Moodle HQ can help prepare code for integration
(and appreciate any effort you are able to give).
Questions?
?
1 of 31

Recommended

Postgresql Database Administration- Day3 by
Postgresql Database Administration- Day3Postgresql Database Administration- Day3
Postgresql Database Administration- Day3PoguttuezhiniVP
73 views19 slides
Ch3 gnu make by
Ch3 gnu makeCh3 gnu make
Ch3 gnu make艾鍗科技
3.9K views68 slides
Open Source KMIP Implementation by
Open Source KMIP ImplementationOpen Source KMIP Implementation
Open Source KMIP Implementationsedukull
7.4K views19 slides
Let's keep it simple and streaming.pdf by
Let's keep it simple and streaming.pdfLet's keep it simple and streaming.pdf
Let's keep it simple and streaming.pdfVMware Tanzu
86 views38 slides
An Overview to MySQL SYS Schema by
An Overview to MySQL SYS Schema An Overview to MySQL SYS Schema
An Overview to MySQL SYS Schema Mydbops
864 views24 slides
JavaScript Basics and Best Practices - CC FE & UX by
JavaScript Basics and Best Practices - CC FE & UXJavaScript Basics and Best Practices - CC FE & UX
JavaScript Basics and Best Practices - CC FE & UXJWORKS powered by Ordina
1.3K views57 slides

More Related Content

What's hot

Apache Airflow by
Apache AirflowApache Airflow
Apache AirflowKnoldus Inc.
631 views17 slides
Lessons Learned: Troubleshooting Replication by
Lessons Learned: Troubleshooting ReplicationLessons Learned: Troubleshooting Replication
Lessons Learned: Troubleshooting ReplicationSveta Smirnova
2.3K views185 slides
Logical replication with pglogical by
Logical replication with pglogicalLogical replication with pglogical
Logical replication with pglogicalUmair Shahid
6.6K views32 slides
JavaScript Event Loop by
JavaScript Event LoopJavaScript Event Loop
JavaScript Event LoopThomas Hunter II
2.2K views14 slides
PostgreSQL Query Cache - "pqc" by
PostgreSQL Query Cache - "pqc"PostgreSQL Query Cache - "pqc"
PostgreSQL Query Cache - "pqc"Uptime Technologies LLC
12.9K views16 slides
Introduction to Apache Airflow by
Introduction to Apache AirflowIntroduction to Apache Airflow
Introduction to Apache Airflowmutt_data
898 views30 slides

What's hot(20)

Lessons Learned: Troubleshooting Replication by Sveta Smirnova
Lessons Learned: Troubleshooting ReplicationLessons Learned: Troubleshooting Replication
Lessons Learned: Troubleshooting Replication
Sveta Smirnova2.3K views
Logical replication with pglogical by Umair Shahid
Logical replication with pglogicalLogical replication with pglogical
Logical replication with pglogical
Umair Shahid6.6K views
Introduction to Apache Airflow by mutt_data
Introduction to Apache AirflowIntroduction to Apache Airflow
Introduction to Apache Airflow
mutt_data898 views
Spring IO 2023 - Dynamic OpenAPIs with Spring Cloud Gateway by Iván López Martín
Spring IO 2023 - Dynamic OpenAPIs with Spring Cloud GatewaySpring IO 2023 - Dynamic OpenAPIs with Spring Cloud Gateway
Spring IO 2023 - Dynamic OpenAPIs with Spring Cloud Gateway
Fluentd loves MongoDB, at MongoDB SV User Group, July 17, 2012 by Treasure Data, Inc.
Fluentd loves MongoDB, at MongoDB SV User Group, July 17, 2012Fluentd loves MongoDB, at MongoDB SV User Group, July 17, 2012
Fluentd loves MongoDB, at MongoDB SV User Group, July 17, 2012
Treasure Data, Inc.31.2K views
Airflow presentation by Ilias Okacha
Airflow presentationAirflow presentation
Airflow presentation
Ilias Okacha3.6K views
InnoDB Performance Optimisation by Mydbops
InnoDB Performance OptimisationInnoDB Performance Optimisation
InnoDB Performance Optimisation
Mydbops2.2K views
Parallel Replication in MySQL and MariaDB by Mydbops
Parallel Replication in MySQL and MariaDBParallel Replication in MySQL and MariaDB
Parallel Replication in MySQL and MariaDB
Mydbops861 views
Replication Troubleshooting in Classic VS GTID by Mydbops
Replication Troubleshooting in Classic VS GTIDReplication Troubleshooting in Classic VS GTID
Replication Troubleshooting in Classic VS GTID
Mydbops646 views
Introduction to Apache Camel by Claus Ibsen
Introduction to Apache CamelIntroduction to Apache Camel
Introduction to Apache Camel
Claus Ibsen5.6K views
jstl ( jsp standard tag library ) by Adarsh Patel
jstl ( jsp standard tag library )jstl ( jsp standard tag library )
jstl ( jsp standard tag library )
Adarsh Patel2.7K views

Similar to How to guarantee your change is integrated to Moodle core

Create Your Own Starter Files by
Create Your Own Starter FilesCreate Your Own Starter Files
Create Your Own Starter FilesEmily Lewis
1.5K views57 slides
It's XP, Stupid by
It's XP, StupidIt's XP, Stupid
It's XP, StupidMike Harris
224 views37 slides
Software development fundamentals by
Software development fundamentalsSoftware development fundamentals
Software development fundamentalsAlfred Jett Grandeza
495 views41 slides
NDC London 2020 - Challenges of Managing CoreFx Repo -- Karel Zikmund by
NDC London 2020 - Challenges of Managing CoreFx Repo -- Karel ZikmundNDC London 2020 - Challenges of Managing CoreFx Repo -- Karel Zikmund
NDC London 2020 - Challenges of Managing CoreFx Repo -- Karel ZikmundKarel Zikmund
8 views25 slides
10 clues showing that you are doing OSGi in the wrong manner - Jerome Moliere by
10 clues showing that you are doing OSGi in the wrong manner - Jerome Moliere10 clues showing that you are doing OSGi in the wrong manner - Jerome Moliere
10 clues showing that you are doing OSGi in the wrong manner - Jerome Molieremfrancis
6.5K views31 slides
Movingto moodle2 v1 1 by
Movingto moodle2 v1 1Movingto moodle2 v1 1
Movingto moodle2 v1 1Jisc RSC East Midlands
892 views25 slides

Similar to How to guarantee your change is integrated to Moodle core(20)

Create Your Own Starter Files by Emily Lewis
Create Your Own Starter FilesCreate Your Own Starter Files
Create Your Own Starter Files
Emily Lewis1.5K views
NDC London 2020 - Challenges of Managing CoreFx Repo -- Karel Zikmund by Karel Zikmund
NDC London 2020 - Challenges of Managing CoreFx Repo -- Karel ZikmundNDC London 2020 - Challenges of Managing CoreFx Repo -- Karel Zikmund
NDC London 2020 - Challenges of Managing CoreFx Repo -- Karel Zikmund
Karel Zikmund8 views
10 clues showing that you are doing OSGi in the wrong manner - Jerome Moliere by mfrancis
10 clues showing that you are doing OSGi in the wrong manner - Jerome Moliere10 clues showing that you are doing OSGi in the wrong manner - Jerome Moliere
10 clues showing that you are doing OSGi in the wrong manner - Jerome Moliere
mfrancis6.5K views
It's XP Stupid (2019) by Mike Harris
It's XP Stupid (2019)It's XP Stupid (2019)
It's XP Stupid (2019)
Mike Harris36 views
Devconf 2011 - PHP - How Yii framework is developed by Alexander Makarov
Devconf 2011 - PHP - How Yii framework is developedDevconf 2011 - PHP - How Yii framework is developed
Devconf 2011 - PHP - How Yii framework is developed
Introduction to GoLang by NVISIA
Introduction to GoLangIntroduction to GoLang
Introduction to GoLang
NVISIA352 views
DITA Quick Start Webinar: Defining Your Style Sheet Requirements by Suite Solutions
DITA Quick Start Webinar: Defining Your Style Sheet RequirementsDITA Quick Start Webinar: Defining Your Style Sheet Requirements
DITA Quick Start Webinar: Defining Your Style Sheet Requirements
Suite Solutions2.9K views
14 Habits of Great SQL Developers by Ike Ellis
14 Habits of Great SQL Developers14 Habits of Great SQL Developers
14 Habits of Great SQL Developers
Ike Ellis1.2K views
DITA Quick Start Webinar Series: Building a Project Plan by Suite Solutions
DITA Quick Start Webinar Series: Building a Project PlanDITA Quick Start Webinar Series: Building a Project Plan
DITA Quick Start Webinar Series: Building a Project Plan
Suite Solutions1.1K views
Dipping Your Toe into Drupal 8 Module Development by Suzanne Dergacheva
Dipping Your Toe into Drupal 8 Module DevelopmentDipping Your Toe into Drupal 8 Module Development
Dipping Your Toe into Drupal 8 Module Development
Suzanne Dergacheva381 views
14 Habits of Great SQL Developers by Ike Ellis
14 Habits of Great SQL Developers14 Habits of Great SQL Developers
14 Habits of Great SQL Developers
Ike Ellis471 views
Build software like a bag of marbles, not a castle of LEGO® by Hannes Lowette
Build software like a bag of marbles, not a castle of LEGO®Build software like a bag of marbles, not a castle of LEGO®
Build software like a bag of marbles, not a castle of LEGO®
Hannes Lowette683 views
How Not to Be Conned by Your Drupal Vendor! by pixelonion
How Not to Be Conned by Your Drupal Vendor!How Not to Be Conned by Your Drupal Vendor!
How Not to Be Conned by Your Drupal Vendor!
pixelonion325 views
Dev Ops for systems of record - Talk at Agile Australia 2015 by Mirco Hering
Dev Ops for systems of record - Talk at Agile Australia 2015Dev Ops for systems of record - Talk at Agile Australia 2015
Dev Ops for systems of record - Talk at Agile Australia 2015
Mirco Hering969 views
Untangling - fall2017 - week 7 by Derek Jacoby
Untangling - fall2017 - week 7Untangling - fall2017 - week 7
Untangling - fall2017 - week 7
Derek Jacoby382 views
Connecting Intelligent Content with Micropublishing and Beyond by Don Day
Connecting Intelligent Content with Micropublishing and BeyondConnecting Intelligent Content with Micropublishing and Beyond
Connecting Intelligent Content with Micropublishing and Beyond
Don Day924 views

More from Dan Poltawski

Adding Global Search to your Moodle #mootieuk17 by
Adding Global Search to your Moodle #mootieuk17Adding Global Search to your Moodle #mootieuk17
Adding Global Search to your Moodle #mootieuk17Dan Poltawski
1.1K views16 slides
Moodle 3.3 - API Change Overview #mootieuk17 by
Moodle 3.3 - API Change Overview #mootieuk17Moodle 3.3 - API Change Overview #mootieuk17
Moodle 3.3 - API Change Overview #mootieuk17Dan Poltawski
1.2K views22 slides
Lifecycle of a Moodle Bug - #mootus16 by
Lifecycle of a Moodle Bug - #mootus16Lifecycle of a Moodle Bug - #mootus16
Lifecycle of a Moodle Bug - #mootus16Dan Poltawski
1K views20 slides
Tools and Tips for Moodle Developers - #mootus16 by
 Tools and Tips for Moodle Developers - #mootus16 Tools and Tips for Moodle Developers - #mootus16
Tools and Tips for Moodle Developers - #mootus16Dan Poltawski
2.7K views32 slides
Continuous Integration: Improving Quality in Moodle by
Continuous Integration: Improving Quality in Moodle Continuous Integration: Improving Quality in Moodle
Continuous Integration: Improving Quality in Moodle Dan Poltawski
2.2K views20 slides
How integrators bring you a better Moodle by
How integrators bring you a better MoodleHow integrators bring you a better Moodle
How integrators bring you a better MoodleDan Poltawski
1K views24 slides

More from Dan Poltawski(8)

Adding Global Search to your Moodle #mootieuk17 by Dan Poltawski
Adding Global Search to your Moodle #mootieuk17Adding Global Search to your Moodle #mootieuk17
Adding Global Search to your Moodle #mootieuk17
Dan Poltawski1.1K views
Moodle 3.3 - API Change Overview #mootieuk17 by Dan Poltawski
Moodle 3.3 - API Change Overview #mootieuk17Moodle 3.3 - API Change Overview #mootieuk17
Moodle 3.3 - API Change Overview #mootieuk17
Dan Poltawski1.2K views
Lifecycle of a Moodle Bug - #mootus16 by Dan Poltawski
Lifecycle of a Moodle Bug - #mootus16Lifecycle of a Moodle Bug - #mootus16
Lifecycle of a Moodle Bug - #mootus16
Dan Poltawski1K views
Tools and Tips for Moodle Developers - #mootus16 by Dan Poltawski
 Tools and Tips for Moodle Developers - #mootus16 Tools and Tips for Moodle Developers - #mootus16
Tools and Tips for Moodle Developers - #mootus16
Dan Poltawski2.7K views
Continuous Integration: Improving Quality in Moodle by Dan Poltawski
Continuous Integration: Improving Quality in Moodle Continuous Integration: Improving Quality in Moodle
Continuous Integration: Improving Quality in Moodle
Dan Poltawski2.2K views
How integrators bring you a better Moodle by Dan Poltawski
How integrators bring you a better MoodleHow integrators bring you a better Moodle
How integrators bring you a better Moodle
Dan Poltawski1K views
Preparing For Moodle 2.0 by Dan Poltawski
Preparing For Moodle 2.0Preparing For Moodle 2.0
Preparing For Moodle 2.0
Dan Poltawski343 views
Moodle for 1000 Schools by Dan Poltawski
Moodle for 1000 SchoolsMoodle for 1000 Schools
Moodle for 1000 Schools
Dan Poltawski1.5K views

Recently uploaded

Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ... by
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...ShapeBlue
144 views12 slides
Microsoft Power Platform.pptx by
Microsoft Power Platform.pptxMicrosoft Power Platform.pptx
Microsoft Power Platform.pptxUni Systems S.M.S.A.
80 views38 slides
DRBD Deep Dive - Philipp Reisner - LINBIT by
DRBD Deep Dive - Philipp Reisner - LINBITDRBD Deep Dive - Philipp Reisner - LINBIT
DRBD Deep Dive - Philipp Reisner - LINBITShapeBlue
140 views21 slides
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue by
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlueShapeBlue
103 views23 slides
Network Source of Truth and Infrastructure as Code revisited by
Network Source of Truth and Infrastructure as Code revisitedNetwork Source of Truth and Infrastructure as Code revisited
Network Source of Truth and Infrastructure as Code revisitedNetwork Automation Forum
52 views45 slides
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveNetwork Automation Forum
50 views35 slides

Recently uploaded(20)

Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ... by ShapeBlue
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
ShapeBlue144 views
DRBD Deep Dive - Philipp Reisner - LINBIT by ShapeBlue
DRBD Deep Dive - Philipp Reisner - LINBITDRBD Deep Dive - Philipp Reisner - LINBIT
DRBD Deep Dive - Philipp Reisner - LINBIT
ShapeBlue140 views
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue by ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
ShapeBlue103 views
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by Network Automation Forum
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software385 views
Why and How CloudStack at weSystems - Stephan Bienek - weSystems by ShapeBlue
Why and How CloudStack at weSystems - Stephan Bienek - weSystemsWhy and How CloudStack at weSystems - Stephan Bienek - weSystems
Why and How CloudStack at weSystems - Stephan Bienek - weSystems
ShapeBlue197 views
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ by ShapeBlue
Confidence in CloudStack - Aron Wagner, Nathan Gleason - AmericConfidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
ShapeBlue88 views
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue by ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueElevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
ShapeBlue179 views
Keynote Talk: Open Source is Not Dead - Charles Schulz - Vates by ShapeBlue
Keynote Talk: Open Source is Not Dead - Charles Schulz - VatesKeynote Talk: Open Source is Not Dead - Charles Schulz - Vates
Keynote Talk: Open Source is Not Dead - Charles Schulz - Vates
ShapeBlue210 views
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit... by ShapeBlue
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
ShapeBlue117 views
NTGapps NTG LowCode Platform by Mustafa Kuğu
NTGapps NTG LowCode Platform NTGapps NTG LowCode Platform
NTGapps NTG LowCode Platform
Mustafa Kuğu365 views
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ... by ShapeBlue
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...
ShapeBlue85 views
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... by ShapeBlue
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
ShapeBlue146 views
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue by ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlueCloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
ShapeBlue94 views
Updates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBIT by ShapeBlue
Updates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBITUpdates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBIT
Updates on the LINSTOR Driver for CloudStack - Rene Peinthor - LINBIT
ShapeBlue166 views
The Role of Patterns in the Era of Large Language Models by Yunyao Li
The Role of Patterns in the Era of Large Language ModelsThe Role of Patterns in the Era of Large Language Models
The Role of Patterns in the Era of Large Language Models
Yunyao Li80 views

How to guarantee your change is integrated to Moodle core

  • 1. Dan Poltawski Integrator Moodle HQ How to guarantee your change is integrated to Moodle core @dan_p
  • 2. Who am I? • Core developer in Moodle community since 2005 • Worked with schools, universities and businesses around UK • Moved to Australia and joined Moodle HQ in 2012 as an Integrator and Developer • Since joining HQ, i’ve spent a lot of my time complaining about the price of beer in Perth... $10! £7 €8 (http://www.quora.com/Beer/Does-Perth-Australia-have-the-most-expensive-beer-prices-in-the-world)
  • 3. Who am I I’m also part of the Integration Team.. • Experienced group of Moodle developers at HQ, who act as the final ‘gatekeepers’ • Conducting final checks before code makes it into Moodle release • Bring historical context and try to facilitate communication between interested parties • Consider the whole communities point of view • http://docs.moodle.org/dev/Integration_Review
  • 4. How to guarantee your change is integrated to Moodle core
  • 5. How to guarantee your change is integrated to Moodle core You can’t!
  • 6. Why not.. • The Moodle community is diverse and we need to support a large community in a generic way • We’re maintaining a ‘platform’ with core tools • We don’t have unlimited resources to maintain every feature anyone can think of ..use moodle.org/plugins/ • Plugins to support as many types of customisations as possible • Tightly integrated to Moodle for easy install and upgrades [DEMO] • Infrastructure will continue to be improved in this direction
  • 7. Why contribute anything to core? • It’s a bug • You can’t fix core bugs in plugins! • There isn’t an appropriate plugin point • You’re confident the Moodle community will be on board • Its rewarding! • Dan core contributors • (we’ve got 2800 open bugs and appreciate help) 0 25 50 75 100 28 51 76 84 93 2.1 2.2 2.3 2.4 2.5 Non-Moodle HQ core contributors per release
  • 8. But if you fit the bill.. Here are some ways to increase your chances of success..
  • 9. 1. Process • Same for any developer, even Moodle HQ Simplified: • Make code available as a git branch • Multiple rounds of code review • Pulled into main Moodle repository and tested • If successful, closed and change is deployed http://docs.moodle.org/dev/Process
  • 10. 1. Process Pitfalls: • Learning the ropes can be daunting, don’t be afraid to ask for help! • Some aspects of the process involve waiting for feedback • Other parts of the process request your feedback quickly, in a time limited way (e.g. ‘testing failed’ state)
  • 11. 2. Tracker • All developments start with a tracker issue. The ‘home’ of developers, lots of knowledge recorded on issues • Be sure to search for and link together related issues • Record your thoughts/decisions while developing code, is useful reference • Be sure to link to related forum discussions, docs and materials which are relevant, else a developer may not aware of this
  • 12. 2. Tracker Pitfalls: • Commenting on an already closed issue • Useful in some cases, but if new work is required, a new issue is needed • Creating duplicate issues • Please search, make use of component fields to narrow down issues • Some actions need additional permissions, see Moodle Docs: Tracker Guide
  • 13. 3. Community support • Gather support from the community for your changes: • Announce and publicise on forums, twitter, moots etc. • For major changes, construct a specification on the developer docs wiki and solicit feedback • Be sure to consider use cases other than your own • Once you’ve gathered tracker votes, comments and support, be sure to link from the tracker
  • 14. 3. Community support Pitfalls • Not soliciting any feedback • Bumping forum posts to get attention • If you are not getting interest it may actually indicate that nobody else is interested.. which might not be a good fit. • Ignoring a use case which doesn’t fit with yours • We can’t ignore specific use cases in core
  • 15. 4. Coding Style • Moodle has nearly 1 million lines of code which have evolved over 10+ years from hundreds of developers • The Moodle coding style was created to improve consistency and should be followed for all new code: http://docs.moodle.org/dev/Coding_style • Lots of old code sucks, don’t copy it! • The codechecker and moodlecheck plugins allow you to check your code against coding style rules automatically. • Try to take a sensible approach to any code you are modifying. Its often sensible to match the surrounding style for better readability
  • 16. 4. Coding Style Common Pitfalls • Not checked against code checker at all • Gives suggestion of poor attention to detail, don’t give us that excuse! • Use of underscores in variable names • Incorrect spacing on control statements • Developing without DEBUG_DEVELOPER
  • 17. 5. Code Review • All Moodle Code is reviewed multiple times before making it into the final release • Moodle is so huge and has been evolving for so long that no one person knows everything • The code review serves as a way to both improve the code and to share the historical context which might apply to each change • Ideally, for the best chance of success, someone experienced with the area you are coding would review the code (e.g. component maintainer) • Code review is a two way process, don’t be afraid to justify your decisions (an important part of the process is to extract the rationale for others to see)
  • 18. 5. Code Review Pitfalls: • Difficulty finding a peer reviewer • Try to be patient and when your patience runs out, consider campaigning politely on the forums • Reviewers can be critical and sometimes frank • Try not to take it personally, the goal of everyone is to find the best technical solution for each issue • Disagreement with reviewer • Feel free to state your case and if necessary, disregard their advice. But be sure to justify your rationale for final integration
  • 19. 6. Cross-DB Compatibility • Moodle supports PostgreSQL, MySQL, Oracle and MS SQL. Please try to test against another db to your usual environment as a minimum • Pay special attention when writing custom SQL • At this time, transactions cannot be relied upon in core, because we still support myisam • Can be useful for constructing complex queries against different engines: http://sqlfiddle.com/
  • 20. 6. Cross-DB Compatibility Common pitfalls: • Forgetting $DB->sql_compare_text() or $DB->sql_concat() • Using DISTINCT on text columns (not compatible with Oracle) • Adding LIMIT clauses, rather than using the function params • Not including all GROUP BY items in the SELECT field-list (MySQL vs PostgreSQL) • Not using placeholders for user input • Not using the XMLDB editor for creating schema definitions
  • 21. 7. Performance • Don’t decrease performance! • Database queries are by far one of the most expensive things you can do, try not to increase them, ensure that they are constant. • If you improve performance, please record and share your results on the tracker. We love integrating performance improvements! • profile, profile, profile (see Tim Hunt’s recent blogpost: Performance- testing Moodle ) • Make use of the Cache API for adding caching, don’t create your own caches: http://docs.moodle.org/dev/Cache_API
  • 22. 7. Performance Common pitfalls • DB Queries in loops or widely called functions foreach ($courseids as $courseid) { //... do stuff.. foreach ($studentids as $studentid) { $DB->get_record('user', array('id' => $studentid); // Could be called 50,0000 times even on small sites! } } • Loading a large amount of data into RAM • Try to use $DB->get_recordset*() on large datasets • Be mindful with file inclusions
  • 23. 8. Security • You should know and be using, at least: • optional_param()/ required_param() or formslib to validate user input • PARAM_xxx types for cleaning user input • XSRF protection using session keys • s(), p(), format_string() and format_text() for outputting user-inputted text • How to control access using capabilities, the context hierarchy and require_login() etc • Our process for dealing with security bugs is different, in order to achieve responsible disclosure.
  • 24. 8. Security Common pitfalls: • Forgetting session keys • Handled for you by formslib, else you need to do it! • Often missed when simple toggle functions • Incorrect use of PARAM_ types • Study the top of lib/moodlelib.php • Careful with FORMAT_TEXT - it’s name is misleading due to multilang
  • 25. 9. Internationalisation • Moodle 2.5 has over 100 language packs and is a strong multilingual community • Use get_string() for strings, don’t hardcode english! • Consider carefully the time of translators in creation of your strings (tricky tradeoff) • Remember to use userdate() for times, we provide a number of standard time formats as standard. • Not all languages use ‘.’ for floating point numbers! Remember to use format_float() and unformat_float() to recieve and output floating point numbers in the users locale • Consider Right To Left (RTL) languages in CSS/design [.dir-rtl]
  • 26. 9. Internationalisation Common pitfalls: • Concatenating strings, this breaks badly for rtl languages or when its impossible to translate correctly • Using the same string in different contexts • Use AMOS SCRIPT in git commits to do an AMOS CPY to make the translators life easier http://docs.moodle.org/dev/Languages/ AMOS#AMOS_script • Using PARAM_FLOAT for user input
  • 27. 10. Testing • A big focus for Moodle over the last two years • Unit testing with phpunit • Tests written in php and executed in a sandboxed ‘per unit’ environment. • Much more powerful than the old simpletest environment • Test environment is reset between tests • Data generators allow test data to be easily constructed • Extensive range of assertions • Automated acceptance testing, using behat • Tests written in English and executed automatically in a browser environment • Used for UI testing in multiple environments • Manual tests for situations which are not possible to automate • All automated tests are being run and verified on a weekly basis to check for regressions
  • 28. 10. Behat Demo Scenario: Login to course and add forum Given the following "users" exists: | username | firstname | lastname | email | | presenter1 | Presenter | Dan | dan@moodle.com | And the following "courses" exists: | fullname | shortname | | iMoot Course | imoot | And the following "course enrolments" exists: | user | course | role | | presenter1 | imoot | editingteacher | And I log in as "presenter1" And I follow "iMoot Course" And I turn editing mode on And I add a "Forum" to section "1" and I fill the form with: | Forum name | iMoot Forum | | Forum type | Standard forum for general use | | Description | Test forum description | When I follow "iMoot Course" Then I should see "iMoot Forum"
  • 29. 10. Testing Pitfalls • No tests at all • Consider using TDD for new code (its likely to be helpful for you too!) • We will become stricter about this over time (no excuses) • Adding complex logic into tests and other ‘test smells’ • http://xunitpatterns.com/Test%20Smells.html is recommended reading • Learning curve setting up the tools • Please post on the forums and help us improve our tools!
  • 30. Grab bag.. • Knowledge of git and how to create a git branch is essential. As are good commit messages (see http://docs.moodle.org/dev/ Commit_cheat_sheet ) • Backwards compatibility must be maintained for for core code, ensure that your changes don’t break backwards compatibility • When fixing bugs, we generally need to support the last 3 versions currently in support, as specified in http://docs.moodle.org/dev/ Releases • Don’t be put off from contributing your code if you can’t do all of what I suggest. Moodle HQ can help prepare code for integration (and appreciate any effort you are able to give).