Wednesday the 22nd of October 2014
Tutor: Paolo Pareti
* Available from: http://homepages.inf.ed.ac.uk/s1054760/tutorials/irr/2014/index.htm
* Adapted from the slides of Mark van Rossum, Andrew Stewart and Vincent Valton found on the IRR wiki:
How did you find reading?
How do you find reading academic papers?
How long does it take to read one paper ?
Questions you should be able to answer
1. What was the problem the authors were trying to solve?
2. Why has related work not solved this problem?
3. What was the proposed solution?
4. What was the evaluation of the solution?
5. What future work did this work suggest?
6. What is the terminology used?
Write as you read
● Write as you read. This keeps your attention focused and makes you
engage with the paper.
● It also makes sure that you will remember your critical evaluation, to
avoid having to read the paper multiple times
General comments on homework
Still many old core papers...
Most of you have already identified an interesting generic area
Now question you should ask is:
Within this area:
● Which are the sub-topics being researched in the last one or two years?
● Among those (if there are many), which one is the most interesting to
● you should review recent RESEARCH papers,
● REVIEW papers can be useful, but they do not count as a proof that the
field is still alive.
● Do not focus your review on existing reviews
Hint to find most recent research
Old papers are a good starting point to find new research:
● Who are the authors?
○ Did they publish new research on that topic?
■ If not, why did they change topic?
■ Did they discover a more interesting direction in the same area?
● Who cited those papers?
○ Are the researches that cited the paper working on something
exciting in the same area?
Evolution of research fields
The terminology used in some research field can change over time, to reflect
some big or small changes in the field.
However some core ideas and core challenges remain the same.
Expert Systems → Ontologies → Semantic Web → Linked Data → Big Data
How to review ALL the papers for your topic?
Modify the topic to adjust the scope.
1. More specific topics:
○ Approaches of type Y to problem X for application Z
2. Review the state of the art approaches to problem X:
○ review ALL of the most recent works for each type of approach
○ some old approaches can be omitted, if they do not add more to the
most recent ones you are reviewing.
From now on, do NEVER copy and paste what has been written by others
1. Yes, it is plagiarism
2. You need to write your own review with your own opinions
3. If for some reason you want to copy exactly one or two sentences, you
MUST properly quote them.
This kind of quotations should be very rare (e.g. < 5% of your text)
Homework for next week.
(1) Create bullet point draft of the review
● Main sections...what goes in here?
■ depends on your topic
■ give a first attempt: write the names of a few sections and
■ next week we will talk more about the structure.
(2) Improve the abstract (including comments you got today)
Send me a PDF by next Tuesday (the 28th) at 12:00 (noon).
● optional: (...but almost mandatory) use LaTeX and BiBteX!
● optional: (but recommended) store your review safely (e.g. on Dropbox)
● optional: use version control systems, e.g. GitHub or Bitbucket