The document discusses experimental and observational research methods. Experimental research involves manipulating independent variables and observing dependent variables under controlled conditions. Observational research involves watching and documenting behavior as it occurs in natural or controlled settings. Both methods have pros and cons for research conducted by the Department of Energy, such as experimental research being well-suited for nuclear facilities while observational research is appropriate for business audits and assessments. Ethical implications around informed consent and privacy also differ between the two approaches.
2. TABLE OF CONTENTS
• SLIDE 4 – EXPERIMENTATION METHOD
• SLIDE 5 – EXPERIMENTAL RESEARCH
• SLIDE 6 – OBSERVATION METHOD
• SLIDE 7 – OBSERVATIONAL RESEARCH
• SLIDE 8 – OBSERVATIONAL RESEARCH ENVIRONMENTS
• SLIDE 9 – PRO ET CONTRA: OBSERVATIONAL RESEARCH
• SLIDE 10 – OTHER OBSERVATIONAL RESEARCH FORMS
• SLIDE 11 – EFFECTIVENESS FOR DEPARTMENT OF ENERGY
July 23, 2017JoaoM.Aguiar 2
3. TABLE OF CONTENTS
• SLIDE 12 – DEPARTMENT OF ENERGY EXAMPLES
• SLIDE 13 – ETHICAL IMPLICATIONS
July 23, 2017JoaoM.Aguiar 3
4. EXPERIMENTATION METHOD
BASIC PRINCIPLES ARE:
• RESEARCHER CONTROLS THE VARIABLES (UNIVERSITY OF SOUTHERN
CALIFORNIA, N.D.)
• TWO TYPES OF VARIABLES ARE: INDEPENDENT AND DEPENDENT
(BEAMFAMILY1, 2012)
• RESEARCHER EVALUATES THE RELATIONSHIPS THAT ARE PRODUCED AS A
RESULT OF THE VARIABLES (COLUMBIA SOUTHERN UNIVERSITY, N.D.)
July 23, 2017JoaoM.Aguiar 4
5. EXPERIMENTAL RESEARCH
CONDUCTED BY EITHER:
• FIELD EXPERIMENTS OR LAB EXPERIMENTS
• DRAWBACKS INCLUDE:
• INCREASED EXPENDITURES AND SECURITY CONCERNS
(COLUMBIA SOUTHERN UNIVERSITY, N.D.)
July 23, 2017JoaoM.Aguiar 5
6. OBSERVATION METHOD
MOST DIRECT METHOD TO STUDY THE RESPONSE PROCESS (BAVDAŽ, 2009,
P. 3)
COMMONLY USED BY EDUCATIONAL RESEARCHERS, MARKET RESEARCHERS,
ENGINEERS, SOCIAL SCIENTISTS, NATURAL SCIENTISTS, AND COMPUTER
SCIENTISTS (CHAKRAVARTY, 2013)
July 23, 2017JoaoM.Aguiar 6
7. OBSERVATIONAL RESEARCH
CONDUCTED BY:
• WATCHING BEHAVIORAL ACTIONS
• DOCUMENTING OBSERVATIONS AS THE ENSUE
• OBSERVATION CAN BE PERFORMED BY EITHER HIDDEN OR VISIBLE
METHODS
(COLUMBIA SOUTHERN UNIVERSITY, N.D.)
July 23, 2017JoaoM.Aguiar 7
8. OBSERVATIONAL RESEARCH ENVIRONMENTS
THERE ARE THREE OBSERVATIONAL RESEARCH ENVIRONMENTS:
1. NATURALISTIC – NATURAL SETTING, WITHOUT AWARENESS
2. PARTICIPANT – NATURAL SETTING, WITH AWARENESS
3. LABORATORY – CONTROLLED SETTING, WITH OR WITHOUT
AWARENESS
(COLUMBIA SOUTHERN UNIVERSITY, N.D.)
July 23, 2017JoaoM.Aguiar 8
9. PRO ET CONTRA: OBSERVATIONAL RESEARCH
PROS:
• EXPEDITIOUS COLLECTION OF DATA
• ECONOMICAL
CONS:
• BIAS ERROR
• MECHANICAL ERROR (IF USED), ADDED COSTS ASSOCIATED
(COLUMBIA SOUTHERN UNIVERSITY, N.D.)
July 23, 2017JoaoM.Aguiar 9
10. OTHER OBSERVATIONAL RESEARCH FORMS
ETHNOGRAPHIC RESEARCH
• STUDIES HUMAN BEHAVIOR, REQUIRES EXTENSIVE TRAINING ON THE
RESEARCHER
ONLINE TRACKING
• BUSINESS USE, ANALYZE INTERNET BEHAVIOR AND DATA
(COLUMBIA SOUTHERN UNIVERSITY, N.D.)
July 23, 2017JoaoM.Aguiar 10
11. EFFECTIVENESS FOR DEPARTMENT OF ENERGY
EXPERIMENTATION METHOD:
• APPROPRIATE FOR NUCLEAR FACILITIES
• IN USE WITH RESEARCH & DEVELOPMENT
OBSERVATION METHOD:
• APPROPRIATE FOR BUSINESS FACILITIES
• IN USE WITH AUDITS AND ASSESSMENTS
July 23, 2017JoaoM.Aguiar 11
12. DEPARTMENT OF ENERGY EXAMPLES
SOFTWARE TRAINING & USAGE
• DETERMINE THE EFFECTIVE IMPLEMENTATION OF NEW SOFTWARE
INTERNAL AUDITS
• ASSESSORS PERFORM INTERNAL AUDITS TO DISCOVER TRENDS
July 23, 2017JoaoM.Aguiar 12
13. ETHICAL IMPLICATIONS
• ONLINE TRACKING CONCERNS
• EXPERIMENTAL & OBSERVATIONAL RESEARCH CONCERNS
• INFORMED CONSENT IN HUMAN EXPERIMENTATION
July 23, 2017JoaoM.Aguiar 13
14. REFERENCES
BAVDAŽ, M. (2009). CONDUCTING RESEARCH ON THE RESPONSE PROCESS IN BUSINESS
SURVEYS. STATISTICAL JOURNAL OF THE IAOS, 26(1/2), 1-14. DOI:10.3233/SJI-
2009-0692
BEAMFAMILY1. (2012, AUGUST 23). EXPERIMENTAL METHOD [VIDEO FILE]. RETRIEVED
FROM
HTTPS://WWW.YOUTUBE.COM/WATCH?V=AY1O8XJOMVK
CHAKRAVARTY, S. (2013, AUGUST 11). RESEARCH METHODS - OBSERVATION [VIDEO FILE].
RETRIEVED FROM HTTPS://WWW.YOUTUBE.COM/WATCH?V=ZUQ0HHHONKI
July 23, 2017JoaoM.Aguiar 14
15. REFERENCES
COLUMBIA SOUTHERN UNIVERSITY. (N.D.). MBA 5652 UNIT V LESSON. RETRIEVED JULY 16,
2017, FROM
HTTPS://ONLINE.COLUMBIASOUTHERN.EDU/CSU_CONTENT/COURSES/BUSINESS/MBA
/MBA5652/15M/UNIT_V_LESSON_PDF.PDF
UNIVERSITY OF SOUTHERN CALIFORNIA. (N.D.). RESEARCH GUIDES: ORGANIZING YOUR
SOCIAL SCIENCES RESEARCH PAPER: INDEPENDENT AND DEPENDENT VARIABLES.
RETRIEVED JULY 22, 2017, FROM
HTTP://LIBGUIDES.USC.EDU/WRITINGGUIDE/VARIABLES
VOLLMANN, J., & WINAU, R. (1996). INFORMED CONSENT IN HUMAN EXPERIMENTATION
BEFORE THE NUREMBERG CODE. BMJ: BRITISH MEDICAL JOURNAL, 313(7070), 1445.
July 23, 2017JoaoM.Aguiar 15
Editor's Notes
The experimentation method used in research can be applied to the physical, social, and behavioral sciences. As a researcher, part of the process would to to establish some controls over the variables (people, places, or phenomenon they are attempting to measure) you are attempting to contrast, compare, average, integrate, or correlate relationships between (University of Southern California, n.d.).
Independent variables are intentionally influenced to determine if it would induce a change. Dependent variables are measured at the completion of the experiment, to see what effect the independent variable had on the dependent variable (Beamfamily1, 2012).
Once the experiment has been completed, the researcher will evaluate the relationships that have been produced as a result of measuring the variables amongst themselves (Columbia Southern University, n.d.).
With the experimentation method, you have two primary types of experiments to perform: field or lab.
Field experiments are conducted in a natural environment in a controlled environment. The researcher would be attempting to provide as much of a realistic environment as possible; however, unknown variables can always present themselves.
Lab experiments are conducted in an artificial environment. The researcher has a greater control over unknown variables; however, the environment would not be realistic.
The drawbacks facing a researcher using this method are the increased expenditures required to properly conduct these experiments, and security concerns. The cost increased are partly due to establishing a controlled environment, and the security needs (Columbia Southern University, n.d.).
The most direct method to study the response process is to observe it as it is happening. One would utilize this method in a “live” environment, but would not attempt this in a laboratory setting (Bavdaž, 2009, p. 3).
A researcher would perform observational research by watching behavioral actions of people, occurrences, or objects as they are happening in their natural environment. As observations are made, the researcher will document these behavioral actions (Columbia Southern University, n.d.).
A hidden observation would be when the research subject is unaware of the observation, and no communication if made with the observed factor. Whereas a visible observation is when the subject can either see the researcher or is aware that the research is being performed (Columbia Southern University, n.d.).
There are three environments where a researcher would conduct observational research: naturalistic observations, participant observations, and laboratory observations (Columbia Southern University, n.d.).
The naturalistic observation is conducted in a natural setting, without the subject’s awareness of the observation. The participant observation is accomplished in a natural setting, with the subject’s awareness that they are being observed. The laboratory observation is produced in a controlled environment either with or without the awareness of the subject (Columbia Southern University, n.d.).
Observational Research has the advantage of being both an expeditious and economical process to collect data. The disadvantages faced are: bias error, and mechanical error. Bias error transpires when the researcher documents observations based on their own personal perspectives or views, rather than documenting the actual facts. If a researcher utilizes a mechanical method to collect data, there an added cost associated with the equipment used and the potential of mechanical error (Columbia Southern University, n.d.).
As provided by Bavdaž (2009) “Data can be collected by conducting an expert evaluation, by observing the process, or by interviewing the people involved in the process. [O]ne method cannot fully substitute for another because each has its own strengths and limitations” (p. 2.).
Ethnographic research is a conventional method to analyze human behaviors in their natural environment. This requires extensive training on the part of the researcher in order to effectively read respondents and systematically observe, analyze, and decipher the data collected (Columbia Southern University, n.d.).
Online tracking is primarily used in the business sector, and collects internet usage and attempts to exploit the data discovered. Researchers attempt to ascertain where people are visiting, and where they are spending their money. This data can be utilized in marketing and sales and can be very valuable to companies (Columbia Southern University, n.d.).
The experimental method lends itself to the nuclear facilities within the Department of Energy (DOE). Engineers can introduce different variables in a controlled environment, and evaluate the relationships that materialize. DOE Scientists utilize both field and lab experiments in their Research & Development projects.
The observational method provides a useful method to record the behavioral actions of DOE employees and contractors. This process is currently used with the conduct of various audit and assessments of our business facilities.
One example of this at the Department of Energy would be to provide one-on-one training to a specific group of auditors on the methods to properly collect and document their assessment findings in a new software program. Then other group of auditors would only be provided this new software program, and explain to the that the system is very intuitive and easy to use. Upon the conclusion of a specific time period (three, six, or nine months) you can evaluate a few relationships: How well both groups learned the program, volume of use with the program (number of assessments input), and the accuracy of the data collected.
Internal Audits are currently being performed at the Department of Energy. This process is currently being implemented by conducting various audits and assessments of our facilities. One of the primary uses is to determine if the appropriate policies, procedures, orders, and laws are being followed in both business and nuclear facilities. This is especially important with concern to the Environment, Security, Safety and Health (ESS&H) areas.
Opponents of Online Tracking have strong ethical concerns against tracking consumers without their knowledge or consent. Concerns are also raised about how the information is being used, and who has access to that information (Columbia Southern University, n.d.). Some view this as an objectionable infringement into a person’s privacy (Bavdaž, 2009, p. 3).
Experimental research performed in field experiments without the knowledge or concern of the observed party, or observational research performed with hidden observation (in either a naturalistic observation or laboratory observation) carries a negative connotation due to participants being unaware that they are being observed (Columbia Southern University, n.d.). This can be seen by some as an intrusion into one’s privacy.
Ethical concerns in human experimentation dates back to the nineteenth century. Large concerns about medical experimentations in Germany were reported during the 1930s and 1940s. This later became addressed in the Nuremberg code of 1947, which sought to address the use of crafting an ethical regulation on human experimentation without informed consent (Vollmann, & Winau, 1996, p. 1445).
The work of Vollmann & Winau (1996) provided that “[t]he introduction of scientific an experimental methodology into clinical medicine in the nineteenth century brought with it an increased demand for experimentation on human subjects, particularly in bacteriology, immunology, and physiology. This research was done mainly on patients in hospital, often without their consent, under an ‘ethos of science and medical progress’” (p. 1445).