Miguel Pardal
September 18th and 19th, 2019
LEIC 2000
Unisys Portugal
Lecturer at Técnico since 2002
MEIC 2006
Visiting Student at MIT in 2009
DEIC 2014
Visiting Scholar at TUM in 2017
First publication in 2004
Since then, about 40 more
http://web.tecnico.ulisboa.pt/miguel.pardal
Methods
Tips
Be Effective
Improve
Organize
Papers
Write
Take better notes
Share my experience
Provide tool suggestions
Learn from you
What is research
Find related work
Propose solutions
Evaluate proposal
Write technical papers
What is research
Find related work
Propose solutions
Evaluate proposal
Write technical papers
What is the problem at hand?
How will you solve it?
In a new or better way!
Following the
scientific method:
Ask questions
Study existing work
Construct hypothesis
Test hypothesis with experiments
Analyze data and draw conclusions
Communicate results
“XPTO is better than XPTY!”
How do you know that?
Based on your own results, or
Based on the work of others
Citations
Accepted by the scientific community
How to name the authors in text
One: Smith
Two: Smith and Williams
Three or more: Smith et al.
Presenting a new system/result
“Smith et al. [22] proposed a new system to…”
Supporting a statement
“System XPTO was evaluated as the fastest [22]”
Our research is only possible because of
the work of others before us
Actual People, Labs, Universities
Google Scholar:
http://scholar.google.com/
ResearchGate
Academia.edu
Arlindo Oliveira
Citations
How many papers (from other authors)
cite papers by the author
Hirsch-Index (h-index)
Attempts to measure both the
productivity and citation impact
For instance, an h-index of 17 means
that the scientist has published at
least 17 papers that have each been
cited at least 17 times
i10-index
Number of publications with at least 10
citations
What is research
Find related work
Propose solutions
Evaluate proposal
Write technical papers
Finding the “10” papers
most related to your work
From the start,
keep a reference repository
Save the PDF
Identify each paper
Author name, year
http://www.jabref.org/
IEEExplore:
http://ieeexplore.ieee.org
ACM:
http://portal.acm.org/dl.cfm
AAAI:
http://www.aaai.org/Library/library.php
DBLP:
http://dblp.uni-trier.de/
Technical report
Workshop paper
Conference paper
Book chapter
Journal article
Book
Title
Abstract
Introduction
Figures
Conclusion
References
Read related work
Start with most cited papers
They are the ones the community is reading and
using in their work
Also see the most recent papers
from top sources
Published in the last 3 years
In ACM, IEEE, Usenix, … or others (ask your advisor)
Recent papers will cite previous relevant work
Good conference ?
Check conference rankings
CORE
Accept rate < 20%
Only 1 in 5 submitted papers gets accepted
Good journal ?
Check journal rankings (Q1 are the best)
Scimago
Impact factor
Average number of citations to recent articles published
in the journal
http://portal.core.edu.au/conf-ranks/
http://www.scimagojr.com/journalrank.php
https://www.iannotate.com/
Write a short summary of paper
Should fit in an index card
https://www.onenote.com/
https://evernote.com
Tables are great for comparing things
Start with columns from existing table, or
think of your own
Add more columns if you need
Empty cells show what you don’t know yet
System Initial Release Latest Version …
Windows
[Gates83]
1983 10.0
Mac [Jobs84] 1984 10.11 (El Capitan)
Linux [Torvalds91] 1991
Review your notes
Contribution
Strengths & Weaknesses
Points of interest
Comparison with your work
Study details in depth
As needed for your own work
Come back later for more
As your own work matures, reading a very related
work paper can provide more insight
What is research
Find related work
Propose solutions
Evaluate proposal
Write technical papers
Move 1 – Establish the “territory”
Move 2 – Establish the niche
Move 3 – Occupy the niche
Your advisor is very important for these moves
Move 1 – Establish the “territory”
Claiming centrality and/or
Making topic generalizations and/or
Reviewing items of previous research
Move 2 – Establish the niche
Counter-claiming or
Indicating a gap or
Question-raising or
Continuing a tradition
Move 3 – Occupy the niche
Outlining purposes or
Announcing present research
Announcing principle findings
Indicating research article structure
http://www.wikihow.com/Write-a-Swalesian-Introduction
Functional requirements
What must the solution do?
Quality requirements
How fast?
How secure?
How reliable?
A model is a simplification/abstraction of
a complex object
To show relevant characteristics
Easier to manipulate than the actual object
A model can be textual
Example: attacker model
A model can be visual
Example: package diagram
Represent structure and behavior
Each diagram is a perspective on the system
Class Diagram
Sequence Diagram
What is research
Find related work
Propose solutions
Evaluate proposal
Write technical papers
Asking questions
Finding answers
Checking if answers are good enough
Qualitative
Quantitative
Looks at requirements
Satisfied ?
Partially satisfied
Unsatisfied
Metrics
Key performance indicators
How long, on average, does the system
take to respond to requests?
How many simultaneous users can the
system hold without degrading
performance levels?
…
What is research
Find related work
Propose solutions
Evaluate proposal
Write technical papers
The work is almost complete
Is writing worth it?
YES
To write is to express thoughts into words
So that others may learn
Your own learning is not complete without the
“distillation process” that comes with writing
Use the most common science language,
so that your work may reach the widest
audience
English
What about Portuguese and other languages?
Still important for scientific divulgation
Introduction
Problem and Contributions
Proposal
Evaluation
Results and Discussion
Related Work
Conclusion
Contributions and Future Work
3 tells
Say what you will say
Say
Say what you said
Provide guidance and context to the reader
Each “middle” chapter in a dissertation
should have:
Introduction text
Main content sections
Summary section
Highlight most important points to carry forward
Transition to next chapter
Most important ideas first
Should appear in the beginning of the
paragraph
Details and alternatives should appear later
Be direct, to the point
“There are many important systems in computer
history, in particular, regarding remote graphical
systems, one of the first widely used contributions was
the X system [22]”
->
“The X system [22] was the first widely used remote
graphical system. It was an important system in
computer history.”
Use more formal language
Avoid oral contractions
We’re -> we are
Don’t -> do not
Gonna -> going to
Ain’t -> am not
Avoid possessives
Joana’s work
-> The work by Joana
The system’s characteristics
-> The characteristics of the system
Use correct tense
Proposal – future tense – will do
Dissertation – past tense – did
Use the third person
Sometimes first person plural is OK – we
Avoid passive voice
It creates uncertainty about who is the
subject of the phrase
“The system was shown to have good performance”
vs
“We have shown that the system has good
performance”
Avoid informal (colloquial) expressions
These are bad sentences:
“At the end of the day, the best system is …”
“It is a matter of life and death that…”
“There’s more than one way to skin a cat, so a
different approach was attempted…”
“The performance has hit a wall…”
Avoid exaggerations (hyperboles)
"infinite“
Infinity is not a large number
"innumerable“
It means uncountable
“impossible”
It means outside the realm of possibility
Avoid non-rigorous terms
“Ultra”
“Super”
“Critical”
“Elastic”
“Agile”
If you need them, define them
Avoid possibly rigorous terms used in a
non-rigorous way
“scalable”
It means that the system can sustain a
performance level when the number of users
increases by orders of magnitude (10, 100, 1000)
Not that it supports many users
“real-time“
It means subject to specific time constraints
Not that the system is fast
Avoid quotes
Example: The “advanced” option is …
Conveys imprecision, lack of rigor
Avoid et cetera
Example: The system modules include the
graphical interface, the business logic, etc.
Conveys lack of rigor, again
If you are going to list, list everything
Use categories instead
Process to increase the quality of the writing
Follow sound science practices
Blind review
You will not know who the reviewer is
Double blind review
The reviewer also does not know who you are
Reviews are not always constructive…
Do not get offended by it, the comments are not
about you, they are about your work
You should be the first to know that there is always
something to improve…
English quality
Structure
Literature review
Complete and to the point
Motivation for decisions
Rigor
Avoid misunderstandings
Identify the limitations of your own work
They will be found anyway (sooner or later)
They are future work opportunities
First promising results
Workshop
Ongoing work with evaluation
Conference
Fully developed and
with final innovative findings
Top conference
Journal
Technical report
Workshop paper
Conference paper
Book chapter
Journal article
Book
Increasing
public exposure and
scrutiny
What is research
Find related work
Propose solutions
Evaluate proposal
Write technical papers
Science is personal and social
People are central
Reading related work
Learn from other authors
Cite them
Compare what they did
Writing about your work
Explain in a concise way
Learn from the reviewers
Share with others
Map the world
Choose the destination
Plot the course
Navigate to destination
Arrive at destination
Map the world
Research area
Choose the destination
Problem
Related work
Plot the course
Solution proposal
Technical challenges
Navigate to destination
Evaluation
Arrive at destination
Contributions
Miguel.Pardal@tecnico.ulisboa.pt
Obrigado
Thank you
“The traveler sees what he sees.
The tourist sees what he has come to see.”
― G.K. Chesterton
IEEE Authorship Series and toolbox:
http://www.ieee.org/publications_standards/publications/
authors/authors_journals.html
Guide by Miguel and Joana Pardal:
http://web.tecnico.ulisboa.pt/miguel.pardal/www/doc/
quick-guide-research.pdf
Thanks to Miguel P. Correia for the review
Widely used
Produces documents with excellent aesthetics
Easy to follow template rules
Built-in support for mathematical expressions.
Generates the reference list automatically!
BibTeX
It is a programming language (with comments)
These are the main contributions:
% do not forget to add the prototype!
https://www.overleaf.com/
Master Beginners Workshop - September 2019
Master Beginners Workshop - September 2019

Master Beginners Workshop - September 2019

  • 1.
  • 2.
    LEIC 2000 Unisys Portugal Lecturerat Técnico since 2002 MEIC 2006 Visiting Student at MIT in 2009 DEIC 2014 Visiting Scholar at TUM in 2017 First publication in 2004 Since then, about 40 more http://web.tecnico.ulisboa.pt/miguel.pardal
  • 3.
  • 4.
    Share my experience Providetool suggestions Learn from you
  • 5.
    What is research Findrelated work Propose solutions Evaluate proposal Write technical papers
  • 6.
    What is research Findrelated work Propose solutions Evaluate proposal Write technical papers
  • 8.
    What is theproblem at hand? How will you solve it? In a new or better way! Following the scientific method: Ask questions Study existing work Construct hypothesis Test hypothesis with experiments Analyze data and draw conclusions Communicate results
  • 9.
    “XPTO is betterthan XPTY!” How do you know that? Based on your own results, or Based on the work of others Citations Accepted by the scientific community
  • 10.
    How to namethe authors in text One: Smith Two: Smith and Williams Three or more: Smith et al. Presenting a new system/result “Smith et al. [22] proposed a new system to…” Supporting a statement “System XPTO was evaluated as the fastest [22]”
  • 11.
    Our research isonly possible because of the work of others before us Actual People, Labs, Universities
  • 12.
  • 13.
  • 16.
    Citations How many papers(from other authors) cite papers by the author Hirsch-Index (h-index) Attempts to measure both the productivity and citation impact For instance, an h-index of 17 means that the scientist has published at least 17 papers that have each been cited at least 17 times i10-index Number of publications with at least 10 citations
  • 17.
    What is research Findrelated work Propose solutions Evaluate proposal Write technical papers
  • 18.
    Finding the “10”papers most related to your work
  • 19.
    From the start, keepa reference repository Save the PDF Identify each paper Author name, year
  • 20.
  • 21.
  • 22.
    Technical report Workshop paper Conferencepaper Book chapter Journal article Book
  • 23.
  • 25.
    Start with mostcited papers They are the ones the community is reading and using in their work Also see the most recent papers from top sources Published in the last 3 years In ACM, IEEE, Usenix, … or others (ask your advisor) Recent papers will cite previous relevant work
  • 26.
    Good conference ? Checkconference rankings CORE Accept rate < 20% Only 1 in 5 submitted papers gets accepted Good journal ? Check journal rankings (Q1 are the best) Scimago Impact factor Average number of citations to recent articles published in the journal
  • 27.
  • 28.
  • 30.
  • 31.
    Write a shortsummary of paper Should fit in an index card https://www.onenote.com/ https://evernote.com
  • 32.
    Tables are greatfor comparing things Start with columns from existing table, or think of your own Add more columns if you need Empty cells show what you don’t know yet System Initial Release Latest Version … Windows [Gates83] 1983 10.0 Mac [Jobs84] 1984 10.11 (El Capitan) Linux [Torvalds91] 1991
  • 34.
    Review your notes Contribution Strengths& Weaknesses Points of interest Comparison with your work Study details in depth As needed for your own work Come back later for more As your own work matures, reading a very related work paper can provide more insight
  • 35.
    What is research Findrelated work Propose solutions Evaluate proposal Write technical papers
  • 37.
    Move 1 –Establish the “territory” Move 2 – Establish the niche Move 3 – Occupy the niche Your advisor is very important for these moves
  • 38.
    Move 1 –Establish the “territory” Claiming centrality and/or Making topic generalizations and/or Reviewing items of previous research Move 2 – Establish the niche Counter-claiming or Indicating a gap or Question-raising or Continuing a tradition Move 3 – Occupy the niche Outlining purposes or Announcing present research Announcing principle findings Indicating research article structure http://www.wikihow.com/Write-a-Swalesian-Introduction
  • 39.
    Functional requirements What mustthe solution do? Quality requirements How fast? How secure? How reliable?
  • 40.
    A model isa simplification/abstraction of a complex object To show relevant characteristics Easier to manipulate than the actual object
  • 41.
    A model canbe textual Example: attacker model A model can be visual Example: package diagram Represent structure and behavior Each diagram is a perspective on the system
  • 42.
  • 43.
  • 44.
    What is research Findrelated work Propose solutions Evaluate proposal Write technical papers
  • 46.
  • 47.
  • 48.
    Looks at requirements Satisfied? Partially satisfied Unsatisfied
  • 49.
  • 50.
    How long, onaverage, does the system take to respond to requests? How many simultaneous users can the system hold without degrading performance levels? …
  • 51.
    What is research Findrelated work Propose solutions Evaluate proposal Write technical papers
  • 54.
    The work isalmost complete Is writing worth it? YES To write is to express thoughts into words So that others may learn Your own learning is not complete without the “distillation process” that comes with writing
  • 55.
    Use the mostcommon science language, so that your work may reach the widest audience English What about Portuguese and other languages? Still important for scientific divulgation
  • 56.
    Introduction Problem and Contributions Proposal Evaluation Resultsand Discussion Related Work Conclusion Contributions and Future Work
  • 57.
    3 tells Say whatyou will say Say Say what you said Provide guidance and context to the reader
  • 58.
    Each “middle” chapterin a dissertation should have: Introduction text Main content sections Summary section Highlight most important points to carry forward Transition to next chapter
  • 59.
    Most important ideasfirst Should appear in the beginning of the paragraph Details and alternatives should appear later
  • 60.
    Be direct, tothe point “There are many important systems in computer history, in particular, regarding remote graphical systems, one of the first widely used contributions was the X system [22]” -> “The X system [22] was the first widely used remote graphical system. It was an important system in computer history.”
  • 61.
    Use more formallanguage Avoid oral contractions We’re -> we are Don’t -> do not Gonna -> going to Ain’t -> am not Avoid possessives Joana’s work -> The work by Joana The system’s characteristics -> The characteristics of the system
  • 62.
    Use correct tense Proposal– future tense – will do Dissertation – past tense – did Use the third person Sometimes first person plural is OK – we
  • 63.
    Avoid passive voice Itcreates uncertainty about who is the subject of the phrase “The system was shown to have good performance” vs “We have shown that the system has good performance”
  • 64.
    Avoid informal (colloquial)expressions These are bad sentences: “At the end of the day, the best system is …” “It is a matter of life and death that…” “There’s more than one way to skin a cat, so a different approach was attempted…” “The performance has hit a wall…”
  • 65.
    Avoid exaggerations (hyperboles) "infinite“ Infinityis not a large number "innumerable“ It means uncountable “impossible” It means outside the realm of possibility
  • 66.
  • 67.
    Avoid possibly rigorousterms used in a non-rigorous way “scalable” It means that the system can sustain a performance level when the number of users increases by orders of magnitude (10, 100, 1000) Not that it supports many users “real-time“ It means subject to specific time constraints Not that the system is fast
  • 68.
    Avoid quotes Example: The“advanced” option is … Conveys imprecision, lack of rigor Avoid et cetera Example: The system modules include the graphical interface, the business logic, etc. Conveys lack of rigor, again If you are going to list, list everything Use categories instead
  • 70.
    Process to increasethe quality of the writing Follow sound science practices Blind review You will not know who the reviewer is Double blind review The reviewer also does not know who you are
  • 71.
    Reviews are notalways constructive… Do not get offended by it, the comments are not about you, they are about your work You should be the first to know that there is always something to improve…
  • 72.
    English quality Structure Literature review Completeand to the point Motivation for decisions Rigor Avoid misunderstandings Identify the limitations of your own work They will be found anyway (sooner or later) They are future work opportunities
  • 73.
    First promising results Workshop Ongoingwork with evaluation Conference Fully developed and with final innovative findings Top conference Journal
  • 74.
    Technical report Workshop paper Conferencepaper Book chapter Journal article Book Increasing public exposure and scrutiny
  • 75.
    What is research Findrelated work Propose solutions Evaluate proposal Write technical papers
  • 76.
    Science is personaland social People are central Reading related work Learn from other authors Cite them Compare what they did Writing about your work Explain in a concise way Learn from the reviewers Share with others
  • 78.
    Map the world Choosethe destination Plot the course Navigate to destination Arrive at destination
  • 79.
    Map the world Researcharea Choose the destination Problem Related work Plot the course Solution proposal Technical challenges Navigate to destination Evaluation Arrive at destination Contributions
  • 80.
    Miguel.Pardal@tecnico.ulisboa.pt Obrigado Thank you “The travelersees what he sees. The tourist sees what he has come to see.” ― G.K. Chesterton
  • 81.
    IEEE Authorship Seriesand toolbox: http://www.ieee.org/publications_standards/publications/ authors/authors_journals.html Guide by Miguel and Joana Pardal: http://web.tecnico.ulisboa.pt/miguel.pardal/www/doc/ quick-guide-research.pdf Thanks to Miguel P. Correia for the review
  • 83.
    Widely used Produces documentswith excellent aesthetics Easy to follow template rules Built-in support for mathematical expressions. Generates the reference list automatically! BibTeX It is a programming language (with comments) These are the main contributions: % do not forget to add the prototype!
  • 86.