SlideShare a Scribd company logo
1 of 96
Download to read offline
Your PhD and You
@julian_urbano
7 Nov 2018 · UNED, Spain
• Julián Urbano
• Assistant Professor @ TU Delft, Netherlands
• (Music) Information Retrieval (Evaluation)
• And a few other things over the years
– Information Extraction
– Crowdsourcing
– Software Engineering… ¯_(ツ)_/¯
• Currently
– Reliability of evaluation experiments
– Statistical methods for the construction of datasets
– Stochastic simulation for evaluation
2
EDUCATION
3
• College is where we go to become professionals
• We acquire the knowledge that is necessary to
perform as such
• Teachers impart that knowledge
4
Undergrad
School
Professional
5
“You will not be an engineer
by the time you graduate.
You will just have the necessary vocabulary
to understand what real engineers talk about.”
—Some Professor from Córdoba
6
• But then I went to college…
• The world is much bigger, more complex, and yet
more beautiful than I ever imagined
• Becoming a professional is a life-long process
• Teachers give fundamental knowledge and the
tools to use it and become self-sufficient
7
Undergrad
School
Job
Self-learner
Professional
8
• Keep you motivated
• Enjoy learning as opposed to dislike studying
• Focus on why, not on how
• Think vs. memorize
9
Undergrad
School
Job
Life
Self-learner
Professional
10
• …and then I went to Grad School (twice)
• Produce research, new knowledge
• Rigor
• Evidence-based reasoning
• Scientific Method
11
Undergrad
School
Grad
School
Job
Life
ResearcherSelf-learner
Professional
12
• But a lot of what we learn is useful in real life
• Capability to avoid and detect
– Cognitive biases
– Logical fallacies
– Paradoxes
• How terrible we humans are at reasoning
13
Undergrad
School
Grad
School
Job
Life
Critical
Thinker
Self-learner
Professional
14
Sad Times
• We live in the times of the alternative truths,
where
– we have loads of information around us
– people don’t care about the truth, only about what
support their beliefs
– the media doesn’t give information but opinions
– everyone knows about everything
– clicking the ads is more important than veracity
– people don’t want to learn, but to be entertained
– you’re not allowed to disagree on certain topics
– scientific facts can be disputed with mere opinions
15
Undergrad
School
Grad
School
Job
Life
Critical
Thinker
Self-learner
Professional
16
Your PhD
• It’s not about the book
• It’s not about the title
• It’s not about choosing “Dr.” when you book an
airplane ticket
• It’s not really about your research
It’s about you
17
You
“Learned Doctor,
You now have the right to use the title of doctor.
Your doctorate means that society can rely on your
judgment, that you will act transparently and communicate
independently about your results and the societal relevance
of your work. In other words, your doctorate implies that
you will uphold scientific integrity.
I wish you a great deal of wisdom and prosperity with your
new status. On behalf of the Board for Doctorates of Delft
University of Technology, I congratulate you and your family
on earning your doctoral degree.”
18
• This talk is not be about my research
• It’ll be about you, the PhD student, the person
• Based on own experience and someone else’s
19
LESSONS LEARNED
21
Many things to say for the 1st time
22
Many things to say for the 1st time
22
Many things to say for the 1st time
22
23
Outline
• Tools
• The fundamentals
• Your message
• The others
• You
• Life
24
TOOLS
25
Master your toolbox
• Develop your own data processing workflow ASAP
– It’ll take some iterations, so don’t paralyze
– Learn best practices
• Use Version Control (eg. Git and Github)
– Not just for code, but also data, papers, notes, reviews…
– Might take some time, but saves time in the long run
– Will also save you many times
• Automate, learn scripting languages
• Ditch MsWord. Today. Just do it. Learn LaTeX
• It’s not about how many tools you know, but rather
about how well you know them
26
Be Tidy
• Develop the habit of organizing everything
• Write code as if you wrote it for others
– Do future-yourself that favor
– Learn best practices
• Release code and data
– Don’t be afraid, we’re not professional developers
– Will force you to meet some standards
– There’s never too much documentation, even for you
– Ask someone to try and reproduce you
• When you submit a paper, organize and clean
everything as if it were already accepted
27
Backup
• Everything
• Everyday
• To paranoid levels
• Use synchronization tools
• Pair with version control for mental health
28
THE FUNDAMENTALS
29
Research Methods
• “Everyone is entitled to their own opinions,
but not their own facts”
• Learn the process to reach to the facts
• Learn research methods from day 1
– Not only to carry out your own research, but to assess
someone else’s
• Read from different disciplines
• There’s never too much of it
30
Validity and Reliability
• Validity: are we measuring what we want to?
– Conclusion: are conclusions supported by the data?
– Internal: are observed effects due to hidden factors?
– Construct: do variables reflect the concepts I want?
– External: are my results generalizable?
• Reliability: how much confidence do I have in my
results? How likely is it to obtain the same results
if I ran the study again?
31
18
Not Valid
Reliable
Valid
Not Reliable
Not Valid
Not Reliable
Valid
Reliable
Error
• All your experiments are subject to error. Accept it.
• Systematic error or bias (validity)
– Introduced by measurement instruments, bad
experimental procedure or environment
– If identified, we can often eliminate it
• Random error or noise (reliability)
– Inherent and unpredictable fluctuations
– We can neither control nor explain it, but we can reduce it
Dep.Vars. = f(Ind.Vars.) + errorsystematic + errorrandom
33
Validity & Reliability in CS
• Lab experiments, typically dataset-oriented
– High internal validity
– Low construct and external validity
– More and more reliability
• Field studies, typically user-oriented
– Hard to achieve high interval validity
– High construct validity
– Not much reliability
34
It’s hard
• You’ll hardly ever be completely sure about the
correct way to carry out a study
• But there are many different ways of doing it
wrong
• Learn statistics, data analysis. Really.
• Get familiar with typical mistakes
• At least get familiar with terminology
• Realize that if something is published, it doesn’t
mean it’s correct
35
Same data, different conclusions
36https://fivethirtyeight.com/features/science-isnt-broken/
Intake of Vitamin D
37https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4210929/
Intake of Vitamin D
38https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4210929/
Simpson’s Paradox
• Eg. success of kidney stone treatments, 1986
39
Treatment A
(invasive)
Treatment B
(non-invasive)
78% (273/350) 83% (289/350)
Simpson’s Paradox
• Eg. success of kidney stone treatments, 1986
39
Treatment A Treatment B
Small Stones 93% (81/87) 87% (234/270)
Large Stones 73% (192/263) 69% (55/80)
Treatment A
(invasive)
Treatment B
(non-invasive)
78% (273/350) 83% (289/350)
When the less effective treatment (B) is applied more frequently to less severe
cases, it can appear to be a more effective treatment.
Inspection Paradox
• Eg. the train arrives every 10m on average
• How long are you expected to wait on average?
40
Inspection Paradox
• Eg. the train arrives every 10m on average
• How long are you expected to wait on average?
40
Your arrival at the platform is also random, and you’re more likely to arrive at a
longer interval because, well, it’s longer
Remember
• It’s not about pointing people to the flaws in their
work
• It’s about detecting and preventing them, mainly
in your own work
• It’s the kind of knowledge that those around you
will look you up for
• Use it to help
– Learn from mistakes
– Question everything
– Understand results
41
YOUR MESSAGE
42
Communication
• Your ideas are not as important as how well you
tell the world about them
• If you fail to communicate them, they don’t exist
• Presentations and face-to-face chats can make
the difference
• Often it’s not about telling results, but stories
• Communication is a two-way street
• Know who you’re speaking with/to
43
English
• Learn it. Period.
• It’s not fair, you’re right, but suck it up
– Most of them know it’s not fair
– Try to understand their position as well
• People will simply forget you if you can’t speak
well with them
• Some will not even try, and will ignore you
• Technical English ≠ everyday English
44
Presentations
• Learn the do’s and don’ts
– J. Asher, “Even a geek can speak”
• Give talks whenever you can
• Volunteer
• Practice. Practice. Practice
45
Writing
• Learn how to write technical documents
– W. Zinsser, “On Writing Well: The Classic Guide to
Writing Nonfiction”
• Let it rest for some days and come back to it
– Fresh new eyes
• Find out what works best for you
– Iterative or sequential
– From the abstract or the conclusion
– etc
46
3 Capital Sins
• The assumption that everyone is as familiar with
the topic as you, that they know all the context
• The need to include every single detail to show
how much effort you put in your work
• The need to overcomplicate everything to show
that your work is of high quality
47
Read and Write
• Read. Then read some more
• Take notes of everything you read
• Write summaries for yourself
– Helps remembering
– Helps organizing your ideas
– Makes it easier to explain later
• Log everything you do and think
– Make sure you can search in it
– Keep a notebook always at hand and write nowhere
else, except the whiteboard, of course
48
THE OTHERS
49
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
50http://matt.might.net/articles/phd-school-in-pictures/
51
Them
• Research doesn’t happen in a vacuum
• Know the community, the people
• Know where to read from and where to publish
• Go to conferences, make friends
• Create a Twitter account (for work)
– You’ll know the people before going to conferences
– Be active and positive, don’t just complain
• Review papers
– Ask your advisor
52
Them
• Don’t lose sight of the big picture
• Don’t burst the bubble and make up problems
that don’t exist
• Show interest in the work of others
• Explore other communities and other fields
– Realize that STEM > nothing
• Reach out to industry
53
Them
• Person ≠ idea
• Burn no bridges
• Learn to smell the bullshit, the charlatans
• Join debates, but avoid wars. Learn from them
• Surround by people who complement you
• Learn by working with others
– That you get along well is maybe the most important
– Everyone works differently, so work around it
• We all like to be acknowledged, so acknowledge
• Talk to your fellow students
54
Your Advisor
• You’re on your own
• Be as self-sufficient as possible
• Listen and ping your advisor
• Always ask for feedback
– Take silence as positive feedback
– Ask for hypercritical feedback
• Be proactive in meetings
– Set agenda
– Be clear, direct
– Explain what you’ve done, where you’re going, and how
you want to get there
55
YOU
56
Procrastination
• Try to learn why you do it
– Fear of failure, fear of success
– Fear of attachment, fear of separation
• Make it work for your own advantage
– Accept that you’ll do it last minute anyway, so do those
tedious things in between
• Planning fallacy
• It’s all about when you feel the pressure
– Work in 45m time slots
– Schedule time for yourself
– Use a time tracker, the pressure of yourself
– Set deadlines with your collaborators
57
The Valley of Shit
• You’ve always been a good student, but suddenly
it feels like you can’t manage
• You lose perspective, confidence and belief in
yourself, and start second-guessing everything
• Everyone thinks you’ll make it, but how do they
really know?
• You’re not the best person to judge the value of
your own work, let alone while in the valley
58https://thesiswhisperer.com/2012/05/08/the-valley-of-shit/
The Valley of Shit
• The place is full of brown stuff, and nobody will
be with you because it stinks
• You’re alone in it, but there’s no need to be lonely
• May happen once or multiple times, for long or
short periods, but it will happen, rest assured
• If can feel endless, but it does have and end
• Just keep walking
59
The Pit of Despair
• Nothing seems to go right, it’s all slow, difficult
and stinks more and ore
• Where is it all going to anyway?
• The smell turns into constant depression and
anxiety for no reason
• You stop walking through the valley and start
digging. The more you dig, the deeper you are
• You don’t care for anything anymore, and are
incapable of enjoying what used to make you
happy
60
The Pit of Despair
• It’s time to take time off, ask for help, and get well
• Be kind to yourself, allow you to stand up
• You’ll start caring again, even if just to hate
everything, but that’s the first step to get out
• It’s ok to quit, but only because you don’t like it,
not because you think you’re not capable
• Persistence is more important that intelligence
61
Impostor Syndrome
• You doubt of your accomplishments and fear to
be exposed as a fraud
• If you succeed you were just lucky and don’t
deserve it
– Always put extra effort because otherwise you’ll fail
• They think you’re good because they’re fooled
– You ignore absolutely all forms of positive feedback
• You’re not the best one to judge yourself
• Maybe you’re just normal :-)
62
Dunning-Kruger Effect
• The incompetent believe they know it all
• The wise doubt they know anything
63
knowledge
confidence
Peak of
Mr. Stupid
Valley of
despair
“It’s complicated”
Dunning-Kruger Effect
• Keep learning and practicing
– The more you know about a topic, the more you’ll
recognize how much there is still to learn
• Ask others how you’re doing
– Constructive criticism
• Question what you know and what you do
– Don’t just have eyes to what confirms what you
already know
64
Stupidity
• So far you’ve been evaluated based on your
answers to questions, but in research nobody
knows the answers
• So why should you?
• The amount of things you don’t know is, for all
purposes, infinite
• Rather than discouraging, it should be liberating
• If you don’t feel stupid, you’re doing it wrong
• You’ll fail over and over again, be confortable with
it and take it as an opportunity to learn
65http://jcs.biologists.org/content/121/11/1771
I think, therefore I’m biased
• Cognitive biases are shortcuts that help us
overcome certain problems
– Too much information. Filter what is useful
– Not enough meaning. Connect and fill in the gaps
– Need to act fast. Decide and predict
– What to remember. Simplify and generalize
• They will mostly fail us and make us be wrong
• They are everywhere. Once you know about
them, you’ll see them all around
66
67https://betterhumans.coach.me/cognitive-bias-cheat-sheet-55a472476b18
Survivorship bias
• The tendency to concentrate on the people or
things that made it past some selection process
and overlooking those that did not, typically
because of their lack of visibility
• You don’t see other people’s failures
• Quantity ≠ quality
• Success has many faces
68
Confirmation Bias
• The tendency to search for, interpret, focus on
and remember information in a way that confirms
one's preconceptions
69
Anchoring Bias
• The tendency to rely too heavily on one piece of
information, usually the first one acquired, when
making decisions
70
Authority Bias
• The tendency to attribute greater accuracy to the
statement of an authority figure, regardless of the
content
71https://www.youtube.com/watch?v=vGc4mg5pul4&t=1h22m
Hindsight Bias
• The tendency to see past events as being
predictable at the time those events happened
• Everything is obvious once you know the answer
• Should you publish it?
72
Self-Serving Bias
• The tendency to give yourself credit for successes
but lay the blame for failures on outside causes
73
Self-Handicapping
• The tendency to avoid efforts in the hope of
keeping potential failures from hurting self-
esteem, and amplify the merit of the successes
• Win-win situation
74
Backfire Effect
• In the face of contradictory evidence, established
beliefs do not change but actually get stronger
• If you get a paper rejected, don’t read the
reviews immediately
• Wait until the next day, and listen
75http://theoatmeal.com/comics/believe
You’re biased too, and that’s great
• You may easily fall for the blind spot bias
– Tendency to see oneself as less biased than others
• Don’t kid yourself. We are all biased. Accept it
• Acknowledge that there’s room for improvement
• Confirmation bias will actually help you identify
your own biases, everywhere
• Ultimately helps you understand yourself, how
you think, and how to become better at it
76
LIFE
77
It’s always there
• “That thing that happens while doing your PhD”
• Don’t take family and friends for granted
• They’ll still be there for you, but it won’t be the
same and you’ll have to catch up
• You’ll miss many things, and you’ll regret it
• Learn when you really need to keep working
– Most of the times you don’t
– Go out, have a beer
– Disconnect
78
It’s always there
• Don’t be afraid to talk about your work
– Be enthusiastic about it, you’re supposed to like it
– Teach whenever you can, spread knowledge
• Don’t keep a list of taboo topics
– Use them to improve your skills and help others
• Exercise
– It’s good for your health
– It’s good for your mind
– You feel accomplished
– More ≠ better. When is the key
79
TAKE HOME MESSAGES
80
• A PhD is a wonderful thing
• Remember why you’re doing it
• There will be bad phases
• It happens to everyone
• There’s no point in suffering
• Enjoy it, and grow as a human being
81
It’s all about You
82

More Related Content

What's hot

How to do Research - Dr.C.Thanavathi
How to do Research - Dr.C.ThanavathiHow to do Research - Dr.C.Thanavathi
How to do Research - Dr.C.ThanavathiThanavathi C
 
Managing your postgrad research feb 2014
Managing your postgrad research feb 2014Managing your postgrad research feb 2014
Managing your postgrad research feb 2014carolynejacobs
 
Managing your postgrad research Oct 2014
Managing your postgrad research Oct 2014 Managing your postgrad research Oct 2014
Managing your postgrad research Oct 2014 carolynejacobs
 
Presentation EPINOR-lunsj
Presentation EPINOR-lunsjPresentation EPINOR-lunsj
Presentation EPINOR-lunsjEPINOR
 
CV/Resume/Letters of Intent Preparation
CV/Resume/Letters of Intent PreparationCV/Resume/Letters of Intent Preparation
CV/Resume/Letters of Intent Preparationunmgrc
 
What should a poster contain? 18.03.14
What should a poster contain? 18.03.14What should a poster contain? 18.03.14
What should a poster contain? 18.03.14EPINOR
 
How to choose final project
How to choose final project How to choose final project
How to choose final project M. Raja Reddy
 
Making your research and teaching more efficient, transparent and impactful
Making your research and teaching more efficient, transparent and impactfulMaking your research and teaching more efficient, transparent and impactful
Making your research and teaching more efficient, transparent and impactfulJay Van Bavel
 
Life as a PhD student: identity, tools, hurdles, and supervisions
Life as a PhD student: identity, tools, hurdles, and supervisionsLife as a PhD student: identity, tools, hurdles, and supervisions
Life as a PhD student: identity, tools, hurdles, and supervisionsInge de Waard
 
Science fair presentation 2012
Science fair presentation 2012Science fair presentation 2012
Science fair presentation 2012Bridget.Bradshaw
 
3rd 4th grade science fair presentation
3rd 4th grade science fair presentation3rd 4th grade science fair presentation
3rd 4th grade science fair presentationLaura Goldin
 
Phd viva general questions
Phd viva general questionsPhd viva general questions
Phd viva general questionsMarcus Leaning
 
Surviving Your Viva or Dissertation Defense
Surviving Your Viva or Dissertation DefenseSurviving Your Viva or Dissertation Defense
Surviving Your Viva or Dissertation DefenseDoctoralNet Limited
 
Science Fair Powerpoint
Science Fair PowerpointScience Fair Powerpoint
Science Fair Powerpointsnapchat
 
Key to success for PhD student
Key to success for PhD studentKey to success for PhD student
Key to success for PhD studentArirido Barakuba
 
Life as a ph d student at ou
Life as a ph d student at ouLife as a ph d student at ou
Life as a ph d student at ouInge de Waard
 
Week of November 1st
Week of November 1stWeek of November 1st
Week of November 1stcsvine
 

What's hot (20)

How to do Research - Dr.C.Thanavathi
How to do Research - Dr.C.ThanavathiHow to do Research - Dr.C.Thanavathi
How to do Research - Dr.C.Thanavathi
 
Managing your postgrad research feb 2014
Managing your postgrad research feb 2014Managing your postgrad research feb 2014
Managing your postgrad research feb 2014
 
Project 2016
Project 2016Project 2016
Project 2016
 
Managing your postgrad research Oct 2014
Managing your postgrad research Oct 2014 Managing your postgrad research Oct 2014
Managing your postgrad research Oct 2014
 
Presentation EPINOR-lunsj
Presentation EPINOR-lunsjPresentation EPINOR-lunsj
Presentation EPINOR-lunsj
 
CV/Resume/Letters of Intent Preparation
CV/Resume/Letters of Intent PreparationCV/Resume/Letters of Intent Preparation
CV/Resume/Letters of Intent Preparation
 
Life as a PhD student
Life as a PhD studentLife as a PhD student
Life as a PhD student
 
What should a poster contain? 18.03.14
What should a poster contain? 18.03.14What should a poster contain? 18.03.14
What should a poster contain? 18.03.14
 
How to choose final project
How to choose final project How to choose final project
How to choose final project
 
Making your research and teaching more efficient, transparent and impactful
Making your research and teaching more efficient, transparent and impactfulMaking your research and teaching more efficient, transparent and impactful
Making your research and teaching more efficient, transparent and impactful
 
Life as a PhD student: identity, tools, hurdles, and supervisions
Life as a PhD student: identity, tools, hurdles, and supervisionsLife as a PhD student: identity, tools, hurdles, and supervisions
Life as a PhD student: identity, tools, hurdles, and supervisions
 
Science fair presentation 2012
Science fair presentation 2012Science fair presentation 2012
Science fair presentation 2012
 
3rd 4th grade science fair presentation
3rd 4th grade science fair presentation3rd 4th grade science fair presentation
3rd 4th grade science fair presentation
 
Work life balance
Work life balanceWork life balance
Work life balance
 
Phd viva general questions
Phd viva general questionsPhd viva general questions
Phd viva general questions
 
Surviving Your Viva or Dissertation Defense
Surviving Your Viva or Dissertation DefenseSurviving Your Viva or Dissertation Defense
Surviving Your Viva or Dissertation Defense
 
Science Fair Powerpoint
Science Fair PowerpointScience Fair Powerpoint
Science Fair Powerpoint
 
Key to success for PhD student
Key to success for PhD studentKey to success for PhD student
Key to success for PhD student
 
Life as a ph d student at ou
Life as a ph d student at ouLife as a ph d student at ou
Life as a ph d student at ou
 
Week of November 1st
Week of November 1stWeek of November 1st
Week of November 1st
 

Similar to Your PhD and You

On practical philosophy of research in science and technology
On practical philosophy of research in science and technologyOn practical philosophy of research in science and technology
On practical philosophy of research in science and technologySeppo Karrila
 
How To Write a Thesis (Research Documentation)
How To Write a Thesis (Research Documentation)How To Write a Thesis (Research Documentation)
How To Write a Thesis (Research Documentation)Engku Fadzli Syed Abdullah
 
DATA COLLECTION.pptx
DATA COLLECTION.pptxDATA COLLECTION.pptx
DATA COLLECTION.pptxSuzie De Leon
 
The things they dont tell you about a PhD
The things they dont tell you about a PhDThe things they dont tell you about a PhD
The things they dont tell you about a PhDAryce11
 
How to succeed in the au reu program qin -edited
How to succeed in the au reu program   qin -editedHow to succeed in the au reu program   qin -edited
How to succeed in the au reu program qin -editedbiazsaa
 
How to ace Phd/Doctoral final oral defense or viva voce'
How to ace Phd/Doctoral final oral defense or viva voce'How to ace Phd/Doctoral final oral defense or viva voce'
How to ace Phd/Doctoral final oral defense or viva voce'DoctoralNet Limited
 
Rethinking the Female Image: Promoting Positive Messages for Girls
Rethinking the Female Image: Promoting Positive Messages for GirlsRethinking the Female Image: Promoting Positive Messages for Girls
Rethinking the Female Image: Promoting Positive Messages for GirlsSociety of Women Engineers
 
How to Effectively Communicate Data & Research Results
How to Effectively Communicate Data & Research ResultsHow to Effectively Communicate Data & Research Results
How to Effectively Communicate Data & Research ResultsSociety of Women Engineers
 
Building an engagement toolkit: How you can understand your customers, evalua...
Building an engagement toolkit: How you can understand your customers, evalua...Building an engagement toolkit: How you can understand your customers, evalua...
Building an engagement toolkit: How you can understand your customers, evalua...Kate Davis
 
The science and art of methodology
The science and art of methodologyThe science and art of methodology
The science and art of methodologyJosh LaMar
 
Research Challenges – Am I Doing “Real” Research?
Research Challenges – Am I Doing “Real” Research?Research Challenges – Am I Doing “Real” Research?
Research Challenges – Am I Doing “Real” Research?Dr. Mazlan Abbas
 
Why and How to Get a PhD? (In software engineering)
Why and How to Get a PhD? (In software engineering)Why and How to Get a PhD? (In software engineering)
Why and How to Get a PhD? (In software engineering)Lionel Briand
 
a_good_presentation-2015_IST.ppt image recongnition in AI
a_good_presentation-2015_IST.ppt image recongnition in AIa_good_presentation-2015_IST.ppt image recongnition in AI
a_good_presentation-2015_IST.ppt image recongnition in AISlimAmiri
 
sicsa-phd2016
sicsa-phd2016sicsa-phd2016
sicsa-phd2016turingfan
 

Similar to Your PhD and You (20)

On practical philosophy of research in science and technology
On practical philosophy of research in science and technologyOn practical philosophy of research in science and technology
On practical philosophy of research in science and technology
 
How To Write a Thesis (Research Documentation)
How To Write a Thesis (Research Documentation)How To Write a Thesis (Research Documentation)
How To Write a Thesis (Research Documentation)
 
Research & its methodology
Research & its methodologyResearch & its methodology
Research & its methodology
 
DATA COLLECTION.pptx
DATA COLLECTION.pptxDATA COLLECTION.pptx
DATA COLLECTION.pptx
 
The things they dont tell you about a PhD
The things they dont tell you about a PhDThe things they dont tell you about a PhD
The things they dont tell you about a PhD
 
Effective literature review
Effective literature reviewEffective literature review
Effective literature review
 
How to succeed in the au reu program qin -edited
How to succeed in the au reu program   qin -editedHow to succeed in the au reu program   qin -edited
How to succeed in the au reu program qin -edited
 
How to ace Phd/Doctoral final oral defense or viva voce'
How to ace Phd/Doctoral final oral defense or viva voce'How to ace Phd/Doctoral final oral defense or viva voce'
How to ace Phd/Doctoral final oral defense or viva voce'
 
ASH2023 aug 23 Malina .pptx
ASH2023 aug 23  Malina .pptxASH2023 aug 23  Malina .pptx
ASH2023 aug 23 Malina .pptx
 
Rm17 45 81-120
Rm17 45 81-120Rm17 45 81-120
Rm17 45 81-120
 
Rethinking the Female Image: Promoting Positive Messages for Girls
Rethinking the Female Image: Promoting Positive Messages for GirlsRethinking the Female Image: Promoting Positive Messages for Girls
Rethinking the Female Image: Promoting Positive Messages for Girls
 
How to Effectively Communicate Data & Research Results
How to Effectively Communicate Data & Research ResultsHow to Effectively Communicate Data & Research Results
How to Effectively Communicate Data & Research Results
 
Thesis writing
Thesis writing Thesis writing
Thesis writing
 
Building an engagement toolkit: How you can understand your customers, evalua...
Building an engagement toolkit: How you can understand your customers, evalua...Building an engagement toolkit: How you can understand your customers, evalua...
Building an engagement toolkit: How you can understand your customers, evalua...
 
The science and art of methodology
The science and art of methodologyThe science and art of methodology
The science and art of methodology
 
Research Challenges – Am I Doing “Real” Research?
Research Challenges – Am I Doing “Real” Research?Research Challenges – Am I Doing “Real” Research?
Research Challenges – Am I Doing “Real” Research?
 
Why and How to Get a PhD? (In software engineering)
Why and How to Get a PhD? (In software engineering)Why and How to Get a PhD? (In software engineering)
Why and How to Get a PhD? (In software engineering)
 
a_good_presentation-2015_IST.ppt image recongnition in AI
a_good_presentation-2015_IST.ppt image recongnition in AIa_good_presentation-2015_IST.ppt image recongnition in AI
a_good_presentation-2015_IST.ppt image recongnition in AI
 
MASHLM 1st year thesis workshop
MASHLM 1st year thesis workshopMASHLM 1st year thesis workshop
MASHLM 1st year thesis workshop
 
sicsa-phd2016
sicsa-phd2016sicsa-phd2016
sicsa-phd2016
 

More from Julián Urbano

Statistical Significance Testing in Information Retrieval: An Empirical Analy...
Statistical Significance Testing in Information Retrieval: An Empirical Analy...Statistical Significance Testing in Information Retrieval: An Empirical Analy...
Statistical Significance Testing in Information Retrieval: An Empirical Analy...Julián Urbano
 
Statistical Analysis of Results in Music Information Retrieval: Why and How
Statistical Analysis of Results in Music Information Retrieval: Why and HowStatistical Analysis of Results in Music Information Retrieval: Why and How
Statistical Analysis of Results in Music Information Retrieval: Why and HowJulián Urbano
 
The Treatment of Ties in AP Correlation
The Treatment of Ties in AP CorrelationThe Treatment of Ties in AP Correlation
The Treatment of Ties in AP CorrelationJulián Urbano
 
A Plan for Sustainable MIR Evaluation
A Plan for Sustainable MIR EvaluationA Plan for Sustainable MIR Evaluation
A Plan for Sustainable MIR EvaluationJulián Urbano
 
Crawling the Web for Structured Documents
Crawling the Web for Structured DocumentsCrawling the Web for Structured Documents
Crawling the Web for Structured DocumentsJulián Urbano
 
How Do Gain and Discount Functions Affect the Correlation between DCG and Use...
How Do Gain and Discount Functions Affect the Correlation between DCG and Use...How Do Gain and Discount Functions Affect the Correlation between DCG and Use...
How Do Gain and Discount Functions Affect the Correlation between DCG and Use...Julián Urbano
 
A Comparison of the Optimality of Statistical Significance Tests for Informat...
A Comparison of the Optimality of Statistical Significance Tests for Informat...A Comparison of the Optimality of Statistical Significance Tests for Informat...
A Comparison of the Optimality of Statistical Significance Tests for Informat...Julián Urbano
 
MIREX 2010 Symbolic Melodic Similarity: Local Alignment with Geometric Repres...
MIREX 2010 Symbolic Melodic Similarity: Local Alignment with Geometric Repres...MIREX 2010 Symbolic Melodic Similarity: Local Alignment with Geometric Repres...
MIREX 2010 Symbolic Melodic Similarity: Local Alignment with Geometric Repres...Julián Urbano
 
The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track
The University Carlos III of Madrid at TREC 2011 Crowdsourcing TrackThe University Carlos III of Madrid at TREC 2011 Crowdsourcing Track
The University Carlos III of Madrid at TREC 2011 Crowdsourcing TrackJulián Urbano
 
What is the Effect of Audio Quality on the Robustness of MFCCs and Chroma Fea...
What is the Effect of Audio Quality on the Robustness of MFCCs and Chroma Fea...What is the Effect of Audio Quality on the Robustness of MFCCs and Chroma Fea...
What is the Effect of Audio Quality on the Robustness of MFCCs and Chroma Fea...Julián Urbano
 
Evaluation in (Music) Information Retrieval through the Audio Music Similarit...
Evaluation in (Music) Information Retrieval through the Audio Music Similarit...Evaluation in (Music) Information Retrieval through the Audio Music Similarit...
Evaluation in (Music) Information Retrieval through the Audio Music Similarit...Julián Urbano
 
Symbolic Melodic Similarity (through Shape Similarity)
Symbolic Melodic Similarity (through Shape Similarity)Symbolic Melodic Similarity (through Shape Similarity)
Symbolic Melodic Similarity (through Shape Similarity)Julián Urbano
 
Evaluation in Audio Music Similarity
Evaluation in Audio Music SimilarityEvaluation in Audio Music Similarity
Evaluation in Audio Music SimilarityJulián Urbano
 
Validity and Reliability of Cranfield-like Evaluation in Information Retrieval
Validity and Reliability of Cranfield-like Evaluation in Information RetrievalValidity and Reliability of Cranfield-like Evaluation in Information Retrieval
Validity and Reliability of Cranfield-like Evaluation in Information RetrievalJulián Urbano
 
On the Measurement of Test Collection Reliability
On the Measurement of Test Collection ReliabilityOn the Measurement of Test Collection Reliability
On the Measurement of Test Collection ReliabilityJulián Urbano
 
How Significant is Statistically Significant? The case of Audio Music Similar...
How Significant is Statistically Significant? The case of Audio Music Similar...How Significant is Statistically Significant? The case of Audio Music Similar...
How Significant is Statistically Significant? The case of Audio Music Similar...Julián Urbano
 
Towards Minimal Test Collections for Evaluation of Audio Music Similarity and...
Towards Minimal Test Collections for Evaluation of Audio Music Similarity and...Towards Minimal Test Collections for Evaluation of Audio Music Similarity and...
Towards Minimal Test Collections for Evaluation of Audio Music Similarity and...Julián Urbano
 
The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track: Noteboo...
The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track: Noteboo...The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track: Noteboo...
The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track: Noteboo...Julián Urbano
 
Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Mu...
Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Mu...Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Mu...
Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Mu...Julián Urbano
 
Audio Music Similarity and Retrieval: Evaluation Power and Stability
Audio Music Similarity and Retrieval: Evaluation Power and StabilityAudio Music Similarity and Retrieval: Evaluation Power and Stability
Audio Music Similarity and Retrieval: Evaluation Power and StabilityJulián Urbano
 

More from Julián Urbano (20)

Statistical Significance Testing in Information Retrieval: An Empirical Analy...
Statistical Significance Testing in Information Retrieval: An Empirical Analy...Statistical Significance Testing in Information Retrieval: An Empirical Analy...
Statistical Significance Testing in Information Retrieval: An Empirical Analy...
 
Statistical Analysis of Results in Music Information Retrieval: Why and How
Statistical Analysis of Results in Music Information Retrieval: Why and HowStatistical Analysis of Results in Music Information Retrieval: Why and How
Statistical Analysis of Results in Music Information Retrieval: Why and How
 
The Treatment of Ties in AP Correlation
The Treatment of Ties in AP CorrelationThe Treatment of Ties in AP Correlation
The Treatment of Ties in AP Correlation
 
A Plan for Sustainable MIR Evaluation
A Plan for Sustainable MIR EvaluationA Plan for Sustainable MIR Evaluation
A Plan for Sustainable MIR Evaluation
 
Crawling the Web for Structured Documents
Crawling the Web for Structured DocumentsCrawling the Web for Structured Documents
Crawling the Web for Structured Documents
 
How Do Gain and Discount Functions Affect the Correlation between DCG and Use...
How Do Gain and Discount Functions Affect the Correlation between DCG and Use...How Do Gain and Discount Functions Affect the Correlation between DCG and Use...
How Do Gain and Discount Functions Affect the Correlation between DCG and Use...
 
A Comparison of the Optimality of Statistical Significance Tests for Informat...
A Comparison of the Optimality of Statistical Significance Tests for Informat...A Comparison of the Optimality of Statistical Significance Tests for Informat...
A Comparison of the Optimality of Statistical Significance Tests for Informat...
 
MIREX 2010 Symbolic Melodic Similarity: Local Alignment with Geometric Repres...
MIREX 2010 Symbolic Melodic Similarity: Local Alignment with Geometric Repres...MIREX 2010 Symbolic Melodic Similarity: Local Alignment with Geometric Repres...
MIREX 2010 Symbolic Melodic Similarity: Local Alignment with Geometric Repres...
 
The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track
The University Carlos III of Madrid at TREC 2011 Crowdsourcing TrackThe University Carlos III of Madrid at TREC 2011 Crowdsourcing Track
The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track
 
What is the Effect of Audio Quality on the Robustness of MFCCs and Chroma Fea...
What is the Effect of Audio Quality on the Robustness of MFCCs and Chroma Fea...What is the Effect of Audio Quality on the Robustness of MFCCs and Chroma Fea...
What is the Effect of Audio Quality on the Robustness of MFCCs and Chroma Fea...
 
Evaluation in (Music) Information Retrieval through the Audio Music Similarit...
Evaluation in (Music) Information Retrieval through the Audio Music Similarit...Evaluation in (Music) Information Retrieval through the Audio Music Similarit...
Evaluation in (Music) Information Retrieval through the Audio Music Similarit...
 
Symbolic Melodic Similarity (through Shape Similarity)
Symbolic Melodic Similarity (through Shape Similarity)Symbolic Melodic Similarity (through Shape Similarity)
Symbolic Melodic Similarity (through Shape Similarity)
 
Evaluation in Audio Music Similarity
Evaluation in Audio Music SimilarityEvaluation in Audio Music Similarity
Evaluation in Audio Music Similarity
 
Validity and Reliability of Cranfield-like Evaluation in Information Retrieval
Validity and Reliability of Cranfield-like Evaluation in Information RetrievalValidity and Reliability of Cranfield-like Evaluation in Information Retrieval
Validity and Reliability of Cranfield-like Evaluation in Information Retrieval
 
On the Measurement of Test Collection Reliability
On the Measurement of Test Collection ReliabilityOn the Measurement of Test Collection Reliability
On the Measurement of Test Collection Reliability
 
How Significant is Statistically Significant? The case of Audio Music Similar...
How Significant is Statistically Significant? The case of Audio Music Similar...How Significant is Statistically Significant? The case of Audio Music Similar...
How Significant is Statistically Significant? The case of Audio Music Similar...
 
Towards Minimal Test Collections for Evaluation of Audio Music Similarity and...
Towards Minimal Test Collections for Evaluation of Audio Music Similarity and...Towards Minimal Test Collections for Evaluation of Audio Music Similarity and...
Towards Minimal Test Collections for Evaluation of Audio Music Similarity and...
 
The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track: Noteboo...
The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track: Noteboo...The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track: Noteboo...
The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track: Noteboo...
 
Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Mu...
Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Mu...Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Mu...
Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Mu...
 
Audio Music Similarity and Retrieval: Evaluation Power and Stability
Audio Music Similarity and Retrieval: Evaluation Power and StabilityAudio Music Similarity and Retrieval: Evaluation Power and Stability
Audio Music Similarity and Retrieval: Evaluation Power and Stability
 

Recently uploaded

ISOLATION OF ALGAE (INDOOR) AND PHOTOBIOREACTOR K R.ppt
ISOLATION OF ALGAE (INDOOR) AND PHOTOBIOREACTOR K R.pptISOLATION OF ALGAE (INDOOR) AND PHOTOBIOREACTOR K R.ppt
ISOLATION OF ALGAE (INDOOR) AND PHOTOBIOREACTOR K R.pptKARTHIK REDDY C A
 
Science (Communication) and Wikipedia - Potentials and Pitfalls
Science (Communication) and Wikipedia - Potentials and PitfallsScience (Communication) and Wikipedia - Potentials and Pitfalls
Science (Communication) and Wikipedia - Potentials and PitfallsDobusch Leonhard
 
Potato spindle tuber disease VIRIOID DISEASE
Potato spindle tuber disease  VIRIOID DISEASEPotato spindle tuber disease  VIRIOID DISEASE
Potato spindle tuber disease VIRIOID DISEASEKARTHIK REDDY C A
 
igcse_edexcel_math-_gold_qp1_-igcse_9-1_.pdf
igcse_edexcel_math-_gold_qp1_-igcse_9-1_.pdfigcse_edexcel_math-_gold_qp1_-igcse_9-1_.pdf
igcse_edexcel_math-_gold_qp1_-igcse_9-1_.pdfTeenaSheikh
 
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...Sérgio Sacani
 
Anatomy of Duodenum- detailed ppt presentation for science students
Anatomy of Duodenum- detailed ppt presentation for science studentsAnatomy of Duodenum- detailed ppt presentation for science students
Anatomy of Duodenum- detailed ppt presentation for science studentsgargipatil3210
 
Food_safety_Management_pptx.pptx in microbiology
Food_safety_Management_pptx.pptx in microbiologyFood_safety_Management_pptx.pptx in microbiology
Food_safety_Management_pptx.pptx in microbiologyHemantThakare8
 
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPRPirithiRaju
 
Efficient Fourier Pricing of Multi-Asset Options: Quasi-Monte Carlo & Domain ...
Efficient Fourier Pricing of Multi-Asset Options: Quasi-Monte Carlo & Domain ...Efficient Fourier Pricing of Multi-Asset Options: Quasi-Monte Carlo & Domain ...
Efficient Fourier Pricing of Multi-Asset Options: Quasi-Monte Carlo & Domain ...Chiheb Ben Hammouda
 
Think Science: What Are Eclipses, by Craig Bobchin
Think Science: What Are Eclipses, by Craig BobchinThink Science: What Are Eclipses, by Craig Bobchin
Think Science: What Are Eclipses, by Craig BobchinNathan Cone
 
Fungal Sex Hormones SIRENIN ANTHERIDIOL.
Fungal Sex Hormones SIRENIN ANTHERIDIOL.Fungal Sex Hormones SIRENIN ANTHERIDIOL.
Fungal Sex Hormones SIRENIN ANTHERIDIOL.KARTHIK REDDY C A
 
Interpreting SDSS extragalactic data in the era of JWST
Interpreting SDSS extragalactic data in the era of JWSTInterpreting SDSS extragalactic data in the era of JWST
Interpreting SDSS extragalactic data in the era of JWSTAlexander F. Mayer
 
DETECTION OF MUTATION BY CLB METHOD.pptx
DETECTION OF MUTATION BY CLB METHOD.pptxDETECTION OF MUTATION BY CLB METHOD.pptx
DETECTION OF MUTATION BY CLB METHOD.pptx201bo007
 
FBI Profiling - Forensic Psychology.pptx
FBI Profiling - Forensic Psychology.pptxFBI Profiling - Forensic Psychology.pptx
FBI Profiling - Forensic Psychology.pptxPayal Shrivastava
 
chapter 28 Reproductive System Power Point
chapter 28 Reproductive System Power Pointchapter 28 Reproductive System Power Point
chapter 28 Reproductive System Power Pointchelseakland
 
SANDAL SPIKE MYCOPLASMAL DISEASE K R ppt
SANDAL SPIKE MYCOPLASMAL DISEASE K R pptSANDAL SPIKE MYCOPLASMAL DISEASE K R ppt
SANDAL SPIKE MYCOPLASMAL DISEASE K R pptKARTHIK REDDY C A
 
Environmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptxEnvironmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptxpriyankatabhane
 

Recently uploaded (20)

ISOLATION OF ALGAE (INDOOR) AND PHOTOBIOREACTOR K R.ppt
ISOLATION OF ALGAE (INDOOR) AND PHOTOBIOREACTOR K R.pptISOLATION OF ALGAE (INDOOR) AND PHOTOBIOREACTOR K R.ppt
ISOLATION OF ALGAE (INDOOR) AND PHOTOBIOREACTOR K R.ppt
 
Introduction Classification Of Alkaloids
Introduction Classification Of AlkaloidsIntroduction Classification Of Alkaloids
Introduction Classification Of Alkaloids
 
Science (Communication) and Wikipedia - Potentials and Pitfalls
Science (Communication) and Wikipedia - Potentials and PitfallsScience (Communication) and Wikipedia - Potentials and Pitfalls
Science (Communication) and Wikipedia - Potentials and Pitfalls
 
Potato spindle tuber disease VIRIOID DISEASE
Potato spindle tuber disease  VIRIOID DISEASEPotato spindle tuber disease  VIRIOID DISEASE
Potato spindle tuber disease VIRIOID DISEASE
 
igcse_edexcel_math-_gold_qp1_-igcse_9-1_.pdf
igcse_edexcel_math-_gold_qp1_-igcse_9-1_.pdfigcse_edexcel_math-_gold_qp1_-igcse_9-1_.pdf
igcse_edexcel_math-_gold_qp1_-igcse_9-1_.pdf
 
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...
Observation of Gravitational Waves from the Coalescence of a 2.5–4.5 M⊙ Compa...
 
Bioenergetics and the role of ATP to drive the beats of life.
Bioenergetics and the role of ATP to drive the beats of life.Bioenergetics and the role of ATP to drive the beats of life.
Bioenergetics and the role of ATP to drive the beats of life.
 
Anatomy of Duodenum- detailed ppt presentation for science students
Anatomy of Duodenum- detailed ppt presentation for science studentsAnatomy of Duodenum- detailed ppt presentation for science students
Anatomy of Duodenum- detailed ppt presentation for science students
 
Food_safety_Management_pptx.pptx in microbiology
Food_safety_Management_pptx.pptx in microbiologyFood_safety_Management_pptx.pptx in microbiology
Food_safety_Management_pptx.pptx in microbiology
 
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR
6.1 Pests of Groundnut_Binomics_Identification_Dr.UPR
 
Efficient Fourier Pricing of Multi-Asset Options: Quasi-Monte Carlo & Domain ...
Efficient Fourier Pricing of Multi-Asset Options: Quasi-Monte Carlo & Domain ...Efficient Fourier Pricing of Multi-Asset Options: Quasi-Monte Carlo & Domain ...
Efficient Fourier Pricing of Multi-Asset Options: Quasi-Monte Carlo & Domain ...
 
Think Science: What Are Eclipses, by Craig Bobchin
Think Science: What Are Eclipses, by Craig BobchinThink Science: What Are Eclipses, by Craig Bobchin
Think Science: What Are Eclipses, by Craig Bobchin
 
Fungal Sex Hormones SIRENIN ANTHERIDIOL.
Fungal Sex Hormones SIRENIN ANTHERIDIOL.Fungal Sex Hormones SIRENIN ANTHERIDIOL.
Fungal Sex Hormones SIRENIN ANTHERIDIOL.
 
Interpreting SDSS extragalactic data in the era of JWST
Interpreting SDSS extragalactic data in the era of JWSTInterpreting SDSS extragalactic data in the era of JWST
Interpreting SDSS extragalactic data in the era of JWST
 
DETECTION OF MUTATION BY CLB METHOD.pptx
DETECTION OF MUTATION BY CLB METHOD.pptxDETECTION OF MUTATION BY CLB METHOD.pptx
DETECTION OF MUTATION BY CLB METHOD.pptx
 
TISSUE TYPING .pptx
TISSUE TYPING                       .pptxTISSUE TYPING                       .pptx
TISSUE TYPING .pptx
 
FBI Profiling - Forensic Psychology.pptx
FBI Profiling - Forensic Psychology.pptxFBI Profiling - Forensic Psychology.pptx
FBI Profiling - Forensic Psychology.pptx
 
chapter 28 Reproductive System Power Point
chapter 28 Reproductive System Power Pointchapter 28 Reproductive System Power Point
chapter 28 Reproductive System Power Point
 
SANDAL SPIKE MYCOPLASMAL DISEASE K R ppt
SANDAL SPIKE MYCOPLASMAL DISEASE K R pptSANDAL SPIKE MYCOPLASMAL DISEASE K R ppt
SANDAL SPIKE MYCOPLASMAL DISEASE K R ppt
 
Environmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptxEnvironmental Acoustics- Speech interference level, acoustics calibrator.pptx
Environmental Acoustics- Speech interference level, acoustics calibrator.pptx
 

Your PhD and You

  • 1. Your PhD and You @julian_urbano 7 Nov 2018 · UNED, Spain
  • 2. • Julián Urbano • Assistant Professor @ TU Delft, Netherlands • (Music) Information Retrieval (Evaluation) • And a few other things over the years – Information Extraction – Crowdsourcing – Software Engineering… ¯_(ツ)_/¯ • Currently – Reliability of evaluation experiments – Statistical methods for the construction of datasets – Stochastic simulation for evaluation 2
  • 4. • College is where we go to become professionals • We acquire the knowledge that is necessary to perform as such • Teachers impart that knowledge 4
  • 6. “You will not be an engineer by the time you graduate. You will just have the necessary vocabulary to understand what real engineers talk about.” —Some Professor from Córdoba 6
  • 7. • But then I went to college… • The world is much bigger, more complex, and yet more beautiful than I ever imagined • Becoming a professional is a life-long process • Teachers give fundamental knowledge and the tools to use it and become self-sufficient 7
  • 9. • Keep you motivated • Enjoy learning as opposed to dislike studying • Focus on why, not on how • Think vs. memorize 9
  • 11. • …and then I went to Grad School (twice) • Produce research, new knowledge • Rigor • Evidence-based reasoning • Scientific Method 11
  • 13. • But a lot of what we learn is useful in real life • Capability to avoid and detect – Cognitive biases – Logical fallacies – Paradoxes • How terrible we humans are at reasoning 13
  • 15. Sad Times • We live in the times of the alternative truths, where – we have loads of information around us – people don’t care about the truth, only about what support their beliefs – the media doesn’t give information but opinions – everyone knows about everything – clicking the ads is more important than veracity – people don’t want to learn, but to be entertained – you’re not allowed to disagree on certain topics – scientific facts can be disputed with mere opinions 15
  • 17. Your PhD • It’s not about the book • It’s not about the title • It’s not about choosing “Dr.” when you book an airplane ticket • It’s not really about your research It’s about you 17
  • 18. You “Learned Doctor, You now have the right to use the title of doctor. Your doctorate means that society can rely on your judgment, that you will act transparently and communicate independently about your results and the societal relevance of your work. In other words, your doctorate implies that you will uphold scientific integrity. I wish you a great deal of wisdom and prosperity with your new status. On behalf of the Board for Doctorates of Delft University of Technology, I congratulate you and your family on earning your doctoral degree.” 18
  • 19. • This talk is not be about my research • It’ll be about you, the PhD student, the person • Based on own experience and someone else’s 19
  • 21. Many things to say for the 1st time 22
  • 22. Many things to say for the 1st time 22
  • 23. Many things to say for the 1st time 22
  • 24. 23
  • 25. Outline • Tools • The fundamentals • Your message • The others • You • Life 24
  • 27. Master your toolbox • Develop your own data processing workflow ASAP – It’ll take some iterations, so don’t paralyze – Learn best practices • Use Version Control (eg. Git and Github) – Not just for code, but also data, papers, notes, reviews… – Might take some time, but saves time in the long run – Will also save you many times • Automate, learn scripting languages • Ditch MsWord. Today. Just do it. Learn LaTeX • It’s not about how many tools you know, but rather about how well you know them 26
  • 28. Be Tidy • Develop the habit of organizing everything • Write code as if you wrote it for others – Do future-yourself that favor – Learn best practices • Release code and data – Don’t be afraid, we’re not professional developers – Will force you to meet some standards – There’s never too much documentation, even for you – Ask someone to try and reproduce you • When you submit a paper, organize and clean everything as if it were already accepted 27
  • 29. Backup • Everything • Everyday • To paranoid levels • Use synchronization tools • Pair with version control for mental health 28
  • 31. Research Methods • “Everyone is entitled to their own opinions, but not their own facts” • Learn the process to reach to the facts • Learn research methods from day 1 – Not only to carry out your own research, but to assess someone else’s • Read from different disciplines • There’s never too much of it 30
  • 32. Validity and Reliability • Validity: are we measuring what we want to? – Conclusion: are conclusions supported by the data? – Internal: are observed effects due to hidden factors? – Construct: do variables reflect the concepts I want? – External: are my results generalizable? • Reliability: how much confidence do I have in my results? How likely is it to obtain the same results if I ran the study again? 31
  • 33. 18 Not Valid Reliable Valid Not Reliable Not Valid Not Reliable Valid Reliable
  • 34. Error • All your experiments are subject to error. Accept it. • Systematic error or bias (validity) – Introduced by measurement instruments, bad experimental procedure or environment – If identified, we can often eliminate it • Random error or noise (reliability) – Inherent and unpredictable fluctuations – We can neither control nor explain it, but we can reduce it Dep.Vars. = f(Ind.Vars.) + errorsystematic + errorrandom 33
  • 35. Validity & Reliability in CS • Lab experiments, typically dataset-oriented – High internal validity – Low construct and external validity – More and more reliability • Field studies, typically user-oriented – Hard to achieve high interval validity – High construct validity – Not much reliability 34
  • 36. It’s hard • You’ll hardly ever be completely sure about the correct way to carry out a study • But there are many different ways of doing it wrong • Learn statistics, data analysis. Really. • Get familiar with typical mistakes • At least get familiar with terminology • Realize that if something is published, it doesn’t mean it’s correct 35
  • 37. Same data, different conclusions 36https://fivethirtyeight.com/features/science-isnt-broken/
  • 38. Intake of Vitamin D 37https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4210929/
  • 39. Intake of Vitamin D 38https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4210929/
  • 40. Simpson’s Paradox • Eg. success of kidney stone treatments, 1986 39 Treatment A (invasive) Treatment B (non-invasive) 78% (273/350) 83% (289/350)
  • 41. Simpson’s Paradox • Eg. success of kidney stone treatments, 1986 39 Treatment A Treatment B Small Stones 93% (81/87) 87% (234/270) Large Stones 73% (192/263) 69% (55/80) Treatment A (invasive) Treatment B (non-invasive) 78% (273/350) 83% (289/350) When the less effective treatment (B) is applied more frequently to less severe cases, it can appear to be a more effective treatment.
  • 42. Inspection Paradox • Eg. the train arrives every 10m on average • How long are you expected to wait on average? 40
  • 43. Inspection Paradox • Eg. the train arrives every 10m on average • How long are you expected to wait on average? 40 Your arrival at the platform is also random, and you’re more likely to arrive at a longer interval because, well, it’s longer
  • 44. Remember • It’s not about pointing people to the flaws in their work • It’s about detecting and preventing them, mainly in your own work • It’s the kind of knowledge that those around you will look you up for • Use it to help – Learn from mistakes – Question everything – Understand results 41
  • 46. Communication • Your ideas are not as important as how well you tell the world about them • If you fail to communicate them, they don’t exist • Presentations and face-to-face chats can make the difference • Often it’s not about telling results, but stories • Communication is a two-way street • Know who you’re speaking with/to 43
  • 47. English • Learn it. Period. • It’s not fair, you’re right, but suck it up – Most of them know it’s not fair – Try to understand their position as well • People will simply forget you if you can’t speak well with them • Some will not even try, and will ignore you • Technical English ≠ everyday English 44
  • 48. Presentations • Learn the do’s and don’ts – J. Asher, “Even a geek can speak” • Give talks whenever you can • Volunteer • Practice. Practice. Practice 45
  • 49. Writing • Learn how to write technical documents – W. Zinsser, “On Writing Well: The Classic Guide to Writing Nonfiction” • Let it rest for some days and come back to it – Fresh new eyes • Find out what works best for you – Iterative or sequential – From the abstract or the conclusion – etc 46
  • 50. 3 Capital Sins • The assumption that everyone is as familiar with the topic as you, that they know all the context • The need to include every single detail to show how much effort you put in your work • The need to overcomplicate everything to show that your work is of high quality 47
  • 51. Read and Write • Read. Then read some more • Take notes of everything you read • Write summaries for yourself – Helps remembering – Helps organizing your ideas – Makes it easier to explain later • Log everything you do and think – Make sure you can search in it – Keep a notebook always at hand and write nowhere else, except the whiteboard, of course 48
  • 65. 51
  • 66. Them • Research doesn’t happen in a vacuum • Know the community, the people • Know where to read from and where to publish • Go to conferences, make friends • Create a Twitter account (for work) – You’ll know the people before going to conferences – Be active and positive, don’t just complain • Review papers – Ask your advisor 52
  • 67. Them • Don’t lose sight of the big picture • Don’t burst the bubble and make up problems that don’t exist • Show interest in the work of others • Explore other communities and other fields – Realize that STEM > nothing • Reach out to industry 53
  • 68. Them • Person ≠ idea • Burn no bridges • Learn to smell the bullshit, the charlatans • Join debates, but avoid wars. Learn from them • Surround by people who complement you • Learn by working with others – That you get along well is maybe the most important – Everyone works differently, so work around it • We all like to be acknowledged, so acknowledge • Talk to your fellow students 54
  • 69. Your Advisor • You’re on your own • Be as self-sufficient as possible • Listen and ping your advisor • Always ask for feedback – Take silence as positive feedback – Ask for hypercritical feedback • Be proactive in meetings – Set agenda – Be clear, direct – Explain what you’ve done, where you’re going, and how you want to get there 55
  • 71. Procrastination • Try to learn why you do it – Fear of failure, fear of success – Fear of attachment, fear of separation • Make it work for your own advantage – Accept that you’ll do it last minute anyway, so do those tedious things in between • Planning fallacy • It’s all about when you feel the pressure – Work in 45m time slots – Schedule time for yourself – Use a time tracker, the pressure of yourself – Set deadlines with your collaborators 57
  • 72. The Valley of Shit • You’ve always been a good student, but suddenly it feels like you can’t manage • You lose perspective, confidence and belief in yourself, and start second-guessing everything • Everyone thinks you’ll make it, but how do they really know? • You’re not the best person to judge the value of your own work, let alone while in the valley 58https://thesiswhisperer.com/2012/05/08/the-valley-of-shit/
  • 73. The Valley of Shit • The place is full of brown stuff, and nobody will be with you because it stinks • You’re alone in it, but there’s no need to be lonely • May happen once or multiple times, for long or short periods, but it will happen, rest assured • If can feel endless, but it does have and end • Just keep walking 59
  • 74. The Pit of Despair • Nothing seems to go right, it’s all slow, difficult and stinks more and ore • Where is it all going to anyway? • The smell turns into constant depression and anxiety for no reason • You stop walking through the valley and start digging. The more you dig, the deeper you are • You don’t care for anything anymore, and are incapable of enjoying what used to make you happy 60
  • 75. The Pit of Despair • It’s time to take time off, ask for help, and get well • Be kind to yourself, allow you to stand up • You’ll start caring again, even if just to hate everything, but that’s the first step to get out • It’s ok to quit, but only because you don’t like it, not because you think you’re not capable • Persistence is more important that intelligence 61
  • 76. Impostor Syndrome • You doubt of your accomplishments and fear to be exposed as a fraud • If you succeed you were just lucky and don’t deserve it – Always put extra effort because otherwise you’ll fail • They think you’re good because they’re fooled – You ignore absolutely all forms of positive feedback • You’re not the best one to judge yourself • Maybe you’re just normal :-) 62
  • 77. Dunning-Kruger Effect • The incompetent believe they know it all • The wise doubt they know anything 63 knowledge confidence Peak of Mr. Stupid Valley of despair “It’s complicated”
  • 78. Dunning-Kruger Effect • Keep learning and practicing – The more you know about a topic, the more you’ll recognize how much there is still to learn • Ask others how you’re doing – Constructive criticism • Question what you know and what you do – Don’t just have eyes to what confirms what you already know 64
  • 79. Stupidity • So far you’ve been evaluated based on your answers to questions, but in research nobody knows the answers • So why should you? • The amount of things you don’t know is, for all purposes, infinite • Rather than discouraging, it should be liberating • If you don’t feel stupid, you’re doing it wrong • You’ll fail over and over again, be confortable with it and take it as an opportunity to learn 65http://jcs.biologists.org/content/121/11/1771
  • 80. I think, therefore I’m biased • Cognitive biases are shortcuts that help us overcome certain problems – Too much information. Filter what is useful – Not enough meaning. Connect and fill in the gaps – Need to act fast. Decide and predict – What to remember. Simplify and generalize • They will mostly fail us and make us be wrong • They are everywhere. Once you know about them, you’ll see them all around 66
  • 82. Survivorship bias • The tendency to concentrate on the people or things that made it past some selection process and overlooking those that did not, typically because of their lack of visibility • You don’t see other people’s failures • Quantity ≠ quality • Success has many faces 68
  • 83. Confirmation Bias • The tendency to search for, interpret, focus on and remember information in a way that confirms one's preconceptions 69
  • 84. Anchoring Bias • The tendency to rely too heavily on one piece of information, usually the first one acquired, when making decisions 70
  • 85. Authority Bias • The tendency to attribute greater accuracy to the statement of an authority figure, regardless of the content 71https://www.youtube.com/watch?v=vGc4mg5pul4&t=1h22m
  • 86. Hindsight Bias • The tendency to see past events as being predictable at the time those events happened • Everything is obvious once you know the answer • Should you publish it? 72
  • 87. Self-Serving Bias • The tendency to give yourself credit for successes but lay the blame for failures on outside causes 73
  • 88. Self-Handicapping • The tendency to avoid efforts in the hope of keeping potential failures from hurting self- esteem, and amplify the merit of the successes • Win-win situation 74
  • 89. Backfire Effect • In the face of contradictory evidence, established beliefs do not change but actually get stronger • If you get a paper rejected, don’t read the reviews immediately • Wait until the next day, and listen 75http://theoatmeal.com/comics/believe
  • 90. You’re biased too, and that’s great • You may easily fall for the blind spot bias – Tendency to see oneself as less biased than others • Don’t kid yourself. We are all biased. Accept it • Acknowledge that there’s room for improvement • Confirmation bias will actually help you identify your own biases, everywhere • Ultimately helps you understand yourself, how you think, and how to become better at it 76
  • 92. It’s always there • “That thing that happens while doing your PhD” • Don’t take family and friends for granted • They’ll still be there for you, but it won’t be the same and you’ll have to catch up • You’ll miss many things, and you’ll regret it • Learn when you really need to keep working – Most of the times you don’t – Go out, have a beer – Disconnect 78
  • 93. It’s always there • Don’t be afraid to talk about your work – Be enthusiastic about it, you’re supposed to like it – Teach whenever you can, spread knowledge • Don’t keep a list of taboo topics – Use them to improve your skills and help others • Exercise – It’s good for your health – It’s good for your mind – You feel accomplished – More ≠ better. When is the key 79
  • 95. • A PhD is a wonderful thing • Remember why you’re doing it • There will be bad phases • It happens to everyone • There’s no point in suffering • Enjoy it, and grow as a human being 81