Wednesday the 19th of November 2014
Tutor: Paolo Pareti
* Available from: http://homepages.inf.ed.ac.uk/s1054760/tutorials/irr/2014/index.htm
* Some of the resources used were taken from the IRR wiki:
Homework for this week
● Have you all created a Turnitin account?
● Have you enrolled in the IRR class?
● Can you see the IRR assignment?
● Any issues?
IMPORTANT NOTE: don’t be confused by the deadline displayed on Turnitin
(23rd of January),
the real deadline remains the 15th of January at 4 pm
when do you want individual feedback?
Thanks for participating.
It seems that everyone agrees on the following option:
Submit your draft to me by the 12th of December
→ get feedback from me by the 21st of December
Instructions on the draft submission
by the 12th of December
Use the Turnitin system, as if you were submitting the final version for the IRR course.
Later in January, you will be able to overwrite this submission with your actual final
I am expecting a complete draft. Complete means:
● The paper should be complete of all sections
● No section should miss significant content
● The title should be as precise as possible
● The bibliography should be accurate,
and include all the articles you are citing in the draft
If you don’t manage to have a complete draft, you should still submit what you have.
However I won’t be able to give you much feedback in this last case.
Second Peer review
(refer to my previous email to find out who you should submit to)
● Submit a half-complete draft to your to your peer by email (add me in cc)
by Sunday the 23rd of November at 23:59
● Submit your comments to your peer by email (add me in cc)
by Tuesday the 25th of November at 23:59
Individual feedback from me:
● Submit your draft to me using the Turnitin system (no email!)
by the 12th of December at 23:59
● You will get feedback from me by the 21st
● Submit the final version of your review using the Turnitin system
by the 15th of January at 16:00
Add those deadlines to your calendar
Your feedback on the tutorials
Please let me know what do you think about the tutorials
● Completely anonymous form
(I will email you the link to the survey form)
● It can take less than one minute to complete
● Your feedback matters: it’s in your interest to make tutorials better
● Your opinion on the tutorials will not affect your final pass/fail result
Finding the answer to your questions
If you have questions about this course:
1. Look at the IRR wiki: https://www.wiki.ed.ac.uk/pages/viewpage.action?
2. Look at the tutorial slides:
3. Look on the Web.
4. If the answer is not there, feel free to email me.
Keep reading papers
As you start writing more, you will start reading less.
● However, should still continue keep looking for papers
○ To make sure you are not missing important papers
○ There might be some very recent papers which were not available
when you started the IRR
○ Now that you became an expert in the field you are reviewing, can
you search for papers better than before?
○ After you have formalized your argument: can you find papers which
support your argument?
Improve your scientific writing
● Look for resources on how to improve your writing style: following some
good advice might have a huge impact on the quality of your paper.
○ Try to find resources specifically aimed to scientific papers,
even better if focused on informatics.
○ Make sure you are structuring your paper correctly.
■ Do you know what should the introduction section contain?
■ Where should you state the objective/goal of your review?
● Learn from reading:
○ learn from the example of the high quality papers
○ learn from the mistakes of the lower quality papers
● Finally, practice by writing your research review
Example of scientific style details I
Footnotes should go after punctuation.
● The dataset was created by the XYZ Project1.
● The dataset was created by the XYZ Project.1
Example of scientific style details II
Citations should not be considered as words which are parts of the
● “ has applied method X for the composition of scientific
● If you remove the citation the sentence becomes incomplete.
● “Method X has been applied for the composition of scientific
● If you remove the citation, the sentence still makes sense
Review the quality criteria
Before submitting your paper (including your draft submission)
consider the criteria we have discussed in the previous tutorial.
● Do you think you would score at least 3 out of 5
in all of the Basic Criteria?
○ If not, your review might have some major issues.
Address those first.
○ If yes, look at the Additional Criteria.
Does your paper fulfill all of them?
● “Can you ignore an article because it has no citations?”
● “Can you ignore an article because it is old?”
You can ignore an article only if it is irrelevant. For example if:
● It is in on a different topic than yours
● Its main findings are already included in other papers you are citing
○ This often happens with multiple papers from the same authors.
It might be ok to cite only the most recent and complete publication.
● It is of extremely low quality, and you don’t think it has any scientific
relevance to the topic you are reviewing