Professional Documents
Culture Documents
Luis M. Camarinha-Matos
cam@uninova.pt
1. BASE TERMINOLOGY
L. M. Camarinha-Matos, 2009-2012
Terms
Methodology - the study of the methods involved in some field,
endeavor, or in problem solving
Method - a (systematic ?) codified series of steps taken to complete
a certain task or to reach a certain objective
a collection of theories,
concepts or ideas
comparative study of
different approaches
critique of the individual methods
L. M. Camarinha-Matos, 2009-2012
[Wikipedia]
3
2. OVERVIEW OF
RESEARCH METHODS
L. M. Camarinha-Matos, 2009-2012
Classical phases
L. M. Camarinha-Matos, 2009-2012
Background / Observation
Formulate hypothesis
Design experiment
Publish findings
Research question /
Problem
Background /
Observation
Formulate hypothesis
An educated guess
It shall be possible to measure / test it.
It should help answer the original question.
Design experiment
Interpret / Analyze
results
Publish findings
L. M. Camarinha-Matos, 2009-2012
Other variants
Other variants
www.makeitsolar.com/science-fair-information/01-the-scientific-method.htm
L. M. Camarinha-Matos, 2009-2012
Other variants
1.
2.
3.
4.
5.
6.
7.
Observe an event.
Develop a model (or
hypothesis) which
makes a prediction.
Test the prediction.
Observe the result.
Revise the hypothesis.
Repeat as needed.
A successful
hypothesis becomes a
Scientific Theory.
[Nordgren, 2004]
L. M. Camarinha-Matos, 2009-2012
A- ask
F- form a hypothesis
T- test hypothesis
A- analyze the results
D- draw conclusions
C- community
www.gallimorelearning.com/index_files/Powerpoint%
20for%20website/Science%20PP/scientificmethod.ppt
10
Other variants
Idea
Problem and
hypotheses
Experiments/
analysis
System
(prototype)
http://www.youtube.com/watch?v=zcavPAFiG14
Theory/paper
(new knowledge)
[Mmmel, 2006]
L. M. Camarinha-Matos, 2009-2012
In practice !
L. M. Camarinha-Matos, 2009-2012
12
13
L. M. Camarinha-Matos, 2009-2012
3. STEPS OF THE
SCIENTIFIC METHOD
L. M. Camarinha-Matos, 2009-2012
14
L. M. Camarinha-Matos, 2009-2012
15
Encyclopedias
Monographs
Textbooks
reviews
Review papers
Tutorial papers
[Mmmel, 2006]
L. M. Camarinha-Matos, 2009-2012
18
19
Characteristics of a hypothesis
Should be operationalisable
... i.e. Expressed in terms that can be measured.
L. M. Camarinha-Matos, 2009-2012
20
Hypothesis example
L. M. Camarinha-Matos, 2009-2012
If skin cancer is related to ultraviolet light, then people with a high exposure to UV light will
have a higher frequency of skin cancer.
If temperature affects leaf color change, then exposing the plant to low temperatures will result
in changes in leaf color.
L. M. Camarinha-Matos, 2009-2012
22
Leonardo
da Vinci
23
L. M. Camarinha-Matos, 2009-2012
24
L. M. Camarinha-Matos, 2009-2012
L. M. Camarinha-Matos, 2009-2012
26
Consider
multiple
perspectives !
L. M. Camarinha-Matos, 2009-2012
Publish or perish !
Reviewed? Indexed?
Science Citation Index?
Web of Science?
Sponsors?
IEEE? IFIP? IFAC?
Write dissertation
L. M. Camarinha-Matos, 2009-2012
28
29
Is it a good thesis ?
How do you know if you've got a solid tentative thesis?
Try these five tests:
Does the thesis inspire a reasonable reader to ask, "How?" or Why?
Would a reasonable reader NOT respond with "Duh!" or "So what?"
or "Gee, no kidding!" or "Who cares?
Does the thesis avoid general phrasing and/or sweeping words
such as "all" or "none" or "every"?
Does the thesis lead the reader toward the topic sentences
(the subtopics needed to prove the thesis)?
Can the thesis be adequately developed in the required length of the
paper or dissertation?
http://www.sdst.org/shs/library/thesis.html
MORE:
L. M. Camarinha-Matos, 2009-2012
30
Proof of concept
Proof-of-Concept Prototype is a term that (I believe) I coined in 1984. It was used
to designate a circuit constructed along lines similar to an engineering prototype,
but one in which the intent was only to demonstrate the feasibility of a new circuit
and/or a fabrication technique, and was not intended to be an early version of a
production design.
[Carsten, 1989]
http://en.wikipedia.org/wiki/Proof_of_concept
31
Presentation languages
Is it necessary to include many formulas and equations?
Is it not scientific if not full of mathematics?
L. M. Camarinha-Matos, 2009-2012
32
Role of simulation
33
L. M. Camarinha-Matos, 2009-2012
The culture of computer science emphasizes novelty and selfcontainment, leading to a fragmentation where each research project
strives to create its own unique world.
This approach is quite distinct from experimentation as it is known in
other sciences i.e. based on observations, hypothesis testing, and
reproducibility that is based on a presupposed common world.
But there are many cases in which such experimental procedures can
lead to interesting research results even in computer science.
[Feitelson, 2006]
This situation quite frequently affects the policies of research funding agencies !
L. M. Camarinha-Matos, 2009-2012
ECS - Fallacies
[Gain, 2008]
Fallacy #1: Traditional scientific method isnt applicable Fallacy #2: Current levels of experimentation are enough
L. M. Camarinha-Matos, 2009-2012
[Gain, 2008]
Fallacy #4: Demonstration will suffice
L. M. Camarinha-Matos, 2009-2012
Use benchmarks
Apply statistical controls from
medicine and psychology
L. M. Camarinha-Matos, 2009-2012
[Gain, 2008]
Fallacy #6: Experimentation will slow progress
[Gain, 2008]
Fallacy #8: There are substitutes
Theory
Intuition
Experts
L. M. Camarinha-Matos, 2009-2012
ECS Misconceptions
[Denning, 1980]
[Denning, 1980]
ECS Misconceptions
[Denning, 1980]
L. M. Camarinha-Matos, 2009-2012
4. ENGINEERING RESEARCH
L. M. Camarinha-Matos, 2009-2012
44
Scientist vs Engineer
L. M. Camarinha-Matos, 2009-2012
45
[Hong 2005]
L. M. Camarinha-Matos, 2009-2012
46
[Muller, 2008]
http://www.gaudisite.nl/SEresearchValidationSlides.pdf
47
L. M. Camarinha-Matos, 2009-2012
48
Validation...
L. M. Camarinha-Matos, 2009-2012
49
50