SlideShare a Scribd company logo
1 of 5
Download to read offline
Research trends in the field of e-learning quality, 2003-2012:
A citation analysis
Chin-Hsiu Tai1
, Che-Wei Lee2
, Yender Lee3
1
Graduate School of Business and Operations Management, Chang Jung Christian University, Tainan, Taiwan,
a8646165@yahoo.com.tw
2
Department of Administration and Policy Studies, University of Pittsburgh, Pittsburgh, Pennsylvania, USA,
chl138@pitt.edu
3
Graduate School of Business and Operations Management, Chang Jung Christian University, Tainan, Taiwan,
mcgill_lee@yahoo.com
Keywords: e-learning quality, research trends, citation analysis, informetrics
Abstract - This paper applies the citation analysis to identify
research trends in the field of e-learning quality, based on the
Social Science Citation Index (SSCI) and Science Citation
Index (SCI) databases from 2003 to 2012. To do this, 35,482
citations of 1,647 documents identified from SSCI and SCI
texts were analyzed. Results showed that research trends
varied rapidly and richly in many disciplines between the two
time periods (2003-2007 and 2008-2012). This study may be
of benefit to scholars seeking to understand the literature
surrounding e-learning quality and explore promising
research questions.
1. Introduction
In the field of e-learning, although recent decades have
seen growing significance placed on learning modules, and
the suitability, practices, employment, and the impact on
various facets of today’s education [1-4], more recently
research interests have shifted to focus on quality
enhancement, relations, and perceptions of e-learning [5,6].
However, the result of these qualitatively preliminary reviews
seems to oversimplify the scope of e-learning quality within
education. Few studies [7] systematically and quantitatively
examine the research trends in the field of quality in e-
learning from 2003 to 2012. Even fewer use citation analysis
[8,9,10] to investigate the interdisciplinary development of
research into the field of e-learning quality. Here we assume
that there has been a dramatic proliferation of, and a shift in,
patterns of research on e-learning in the twenty-first century.
This article applies citation analysis to investigate the most
frequently cited authors and the references on e-learning
quality from the Social Science Citation Index (SSCI) and
Social Citation Index (SCI) databases over the past ten years
to identify research trends. It also, however, goes further, by
reviewing the cross-disciplinary status of research on e-
learning quality. In this study, research trend was defined as
having three components: (1) highly cited journals, (2) the
most frequently cited works, and (3) the most frequently cited
authors. With this new information, it is hoped that scholars
of e-learning research may rapidly, efficiently, and accurately
identify the documented classic (must-read, best-quality, and
widely-cited) texts and discover the most influential scholars
in this domain. Three primary research questions guide this
study: (1) Which journals were cited the most from 2003 to
2012? (2) Which works were the most frequently cited in
2003-2007 compared to 2008-2012? (3) Which authors were
the most frequently cited in 2003-2007 compared to 2008-
2012?
2. Methods
2.1 Research Design
The citation analysis was derived from the methodology of
informetrics—also known as bibliometrics or scientometrics
[8,9,10], and was used to identify research trends in the field
of e-learning quality. Based on our assumption that studies of
e-learning quality over the last decade had become a
dominant trend in many disciplines, the time period was set
as 2003-2012 and divided in half (2003-2007 and 2008-2012)
for comparisons of citations to determine the dynamics of
research on e-learning quality. A database relating to studies
on e-learning quality was built for citation analysis by
retrieving data from Institute for Scientific Information (ISI)
Citation Indexes databases [11,12], consisting of three sub-
databases: (1) 2003-2012 document citations; (2) 2003-2007
author and document citations; and (3) 2008-2012 author and
document citations.
2.2 Data Sources
The data were retrieved from Science Citation Index (SCI)
and Social Science Citation Index (SSCI), both published by
the Institute for Scientific Information (ISI) Citation Indexes
of Thomson Reuters. SCI and SSCI currently cover over
6,700 leading scholarly journals (3,700 from SCI, 3,000 from
SSCI), representing 150 disciplines (100 from SCI, 50 from
SSCI) [13,14]. These two databases also provided the ISI
Journal Citation Reports (JCR) [11,12], which “offers a
systematic, objective means to critically evaluate the world’s
leading journals, with quantifiable, statistical information
based on citation data” [15], for helping us to see the journals
that were the most frequently used or cited.
Proceedings of the 19th ISSAT International Conference on Reliability and Quality in Design
August 5-7, 2013 - Honolulu, Hawaii, U.S.A.
We included journal articles, books, book reviews, reviews,
conference programs and proceedings, and editorial materials
in this study. There were 23,577 document citations 2003-
2012. With 18,472 articles, there were 8,807 journals 2003-
2007 and 14,164 authors. In 2008-2012 there were 45,964
articles, 17,626 journals, and 32,799 authors.
2.3 Data Collection
We used the keyword “e-learning quality” to search the
Web of Science from Thomson Reuters’ Web of Knowledge
[16], limiting the timespan of results to 2003-2007 and 2008-
2012 respectively. Search results were refined into the
disciplinary categories of Education & Educational (SSCI);
Education, Science Disciplines (SCI); Health Care Sciences
& Services (SCI); Medicine, General & Internal (SCI);
Management (SSCI); Information Science & Library (SCI);
and Multidisciplinary Sciences (SCI). Finally, 1,647 texts—
including journal articles and books—cited in 50,826
publications were retrieved from the initial 35,482 pool of
works. Citation counts, journal information, article titles,
publication dates, authors’ names, and attributed disciplines
were tabulated using Microsoft Excel 2010, divided in the
two periods of 2003-2007 and 2008-2012, and the top 10
most highly journals, cited references, and authors were
selected.
2.4 Data Analysis
By ranking the top 10 highly cited journals, references, and
authors according to citation counts, the relationships
between publications and the impact that particular references
and authors may have had on the subsequent development of
e-learning quality research can be discovered. Journals were
ranked by how frequently they were cited journals from 2003
to 2012. Their impact factor (IF) [17] was obtained from JCR,
and serves as a measure indicator of journal quality. It is
determined based on the average number of citations of works
published by the journals. The SCI/SSCI-generated rankings
highlight the status of the specific journal in respective
subject categories. The top 10 most highly cited works were
further classified into some disciplines in terms of their
article or book titles. The current working locations, areas of
expertise of the top 10 most frequently cited authors identified
were gathered from the authors’ professional websites,
available curriculum vitae, and representative publications.
3. Results
3.1 Which journals were cited the most?
Table I shows the top 10 highly cited journals in e-learning
quality from 2003 to 2012, in frequency order. The nine
journals other than Nature were cited over 200 times in the
past decade. According to the 2011 JCR Science Edition [11]
and Social Science Edition [12], Table II shows that these
journals associated with e-learning quality can be classified
into seven subject categories, and provides the IF and the
journal’s rank within a specific category or discipline.
TABLE I. THE TOP 10 HIGHLY CITED JOURNALS, 2003-2012
Rank Journal Title Database
Publisher’s
Country
Citation
Count
1 Computers & Education SSCI UK 425
2 JAMA-Journal of the
American Medical
Association
SCI USA 362
3 Management Science SSCI USA 297
4 British Medical Journal SCI UK 268
5 Academic Medicine SCI USA 262
6 MIS Quarterly SSCI USA 243
7 Science SCI USA 223
8 New England Journal of
Medicine
SCI USA 213
9 Medical Education SCI USA 212
10 Nature SCI UK 195
TABLE II. CATEGORIES, IMPACT FACTOR, AND RANK OF THE TOP 10
HIGHLY CITED JOURNALS, 2003-2012
Category Journal Title (Abbreviation)
Impact
Factor (IF)
Ranka
Education &
Educational
(SSCI)
 Computers & Education (CE) 2.261 7/206
Education,
Science
Disciplines
(SCI)
 Academic Medicine (AM) 3.524 1/33
 Medical Education (ME) 3.176 2/33
Health Care
Sciences &
Services (SCI)
 Medical Education (ME) 3.176 8/76
Medicine, General
& Internal (SCI)
 New England Journal of
Medicine (NEJM)
53.298 1/155
 JAMA-Journal of the
American Medical
Association (JAMA)
30.026 3/155
 British Medical Journal
(BMJ)
14.093 6/155
Management
(SSCI)
 MIS Quarterly (MISQ) 4.447 6/168
 Management Science (MS) 1.733 48/168
Information
Science &
Library (SCI)
 MIS Quarterly (MISQ) 4.447 1/83
Multidisciplinary
Sciences (SCI)
 Nature (NATE) 36.280 1/56
 Science (SINE) 31.201 2/56
a. This rankings was published by SSCI/SCI databases. “/” means “out of,” for example,
7/206 = the journal was ranked 7th out of 206 journals in the specific category.
3.2 Whose texts were the most frequently cited?
Table III presents the top 10 highly cited works from 2003
to 2007. Only two of the most frequently cited works are
journal articles; the others are books. These books and journal
articles highlight the following core research topics and
disciplines that trended in the field of e-learning quality from
2003 to 2007, including (1) Machine: theory of machine
learning [18,22,24]; (2) Medicine: neural networks [20,24];
(3) Education: cognition learning, situated learning (or a
model of learning in a community of practice) [21,23,26]; and
(4) Statistics: statistical pattern recognition [19,24,25].
TABLE III. THE TOP 10 HIGHLY CITED REFERENCES, 2003-2007
Rank Reference
Citation
Count
1 Mitchell, 1997 [18] 9
1 Vapnik, 1995 [19] 9
3 Bishop, 1995 [20] 8
3 Lave and Wenger, 1991 [21] 8
3 Quinlan, 1993 [22] 8
3 Wenger, 1998 [23] 8
7 Duda, Hart, and Stork, 2001 [24] 6
7 Vapnik, 1998 [25] 6
9 Brown, Collins, and Duguid, 1989 [26] 5
9 Davis, et al., 1999 [27] 5
Table IV presents the top 10 frequently cited publications
from 2008 to 2012. Citation counts were notably higher than
the previous five year period, ranging from 15 to 25. Only
Cohen’s [31] work is a book, the other nine are journal
articles. The research trends in this period keep e-learning
quality mainly in the two fields of: (1) Statistics: structural
equation models, and statistical power analysis for behavioral
sciences [28,31]; and (2) Medicine: e-learning in medical
education [37]. However, new research directions related to e-
learning quality have emerged from these works, introducing
a focus on studies of acceptance [32,33], satisfaction [30,34],
effectiveness [36], and success [29,35] of e-learning,
computer, and information technology and systems.
TABLE IV. THE TOP 10 HIGHLY CITED REFERENCES, 2008-2012
Rank Reference
Citation
Counts
1 Fornell and Larcker, 1981 [28] 25
2 DeLone and McLean, 2003 [29] 20
2 Wang, 2003 [30] 20
4 Cohen, 1988 [31] 19
5 Davis, Bagozzi, and Warshaw, 1989 [32] 18
5 Davis, 1989 [33] 18
7 Sun, et al., 2008, [34] 17
8 DeLone and McLean, 1992 [35] 16
8 Piccoli, Ahmad, and Ives, 2001 [36] 16
10 Ruiz, Mintzer, and Leipzig, 2006 [37] 15
3.3 Who were the most frequently cited authors?
Table V shows the top 10 highly cited authors between
2003 and 2007. Five of these ten authors work in the United
States of America (USA), even though they are originally
from other countries. Others work in Canada, Germany,
India, the United Kingdom (UK), and the Netherlands. By
further examining these authors’ areas of expertise, we
discovered that work relating to e-learning quality was
integrated into the research trends of the following six
disciplines in this period: (1) Information Management; (2)
Medicine; (3) Computer Science and Electrical Engineering;
(4) Education; (5) Mechanics; and (6) Food and Water
Microbiology.
TABLE V. THE TOP 10 HIGHLY CITED AUTHORS, 2003-2007
Rank Name, Degree, & Area of Expertise
Country of
Residence
Citation
Count
1 Barker, Kathryn Chang, Ph.D. in
Educational Administration and
Policy, e-learning quality standards
and certification; strategies to
transform learning systems; future
education consulting services
Canada 19
1 Schiffman, Susan S., Ph.D. in
Education, development of
instrumentation and sensors to assess
sensory and cognitive functioning in
humans
USA 19
3 Vapnik, Vladimir N., Ph.D. in
Statistics, machine learning
algorithms; the support vector
machine
USA 17
4 Khoshgoftaar, Taghi M., Ph.D. in
Computer & Electrical Engineering
and Computer Science, software
engineering; data mining and machine
learning; computational intelligence;
USA 16
computer security & instruction
detection systems
5 Stevenson, Richard J., M.D. in
Pediatric and General Surgery
(USA/internal medicine; pediatrics)
USA 15
5 Streufert, Siegfried, Ph.D. in
Experimental (Social) Psychology,
psychology; management; medicine
and pharmacology
USA 15
7 Beg, Mirza Mohd Sufyan, Ph.D. in
Computer Technology, computer
architecture; parallel and distributed
computing; high performance data
mining; web searching; fuzzy logic
and systems; genetic algorithms;
question answering systems; natural
language processing
India 14
8 Blum, Jochen, Ph.D. in Neurosurgery,
biomechanics; intramedullary rod or
nail; trauma surgery and orthopedics
Germany 13
8 Meyer, Jan H.F., Ph.D. in Education,
threshold concept; student learning;
approaches to teaching inventory
UK 13
8 Mossel, David Alexander Antonius,
Ph.D. in Food and Water
Microbiology, microbiology of foods
The
Netherlands
13
Table VI presents the top 10 highly cited authors from 2008
to 2012. In this group, eight scholars are based in the USA
and two are in Taiwan. These authors have conducted
research on e-learning quality primarily in five disciplines:
(1) Information Systems and Management; (2) Medical
Informatics; (3) Psychology; (4) Marketing; and (5)
Economics.
TABLE VI. LIST OF THE TOP 10 HIGHLY CITED AUTHORS, 2008-2012
Rank Name, Degree, & Area of Expertise
Country of
Residence
Citation
Count
1 Cohen, Jacob, Ph.D. in Clinical
Psychology, statistical analysis in the
behavioral sciences; psychology
USA 46
1 Davis, Fred D., Ph.D. in Management,
user acceptance of information
technology; computer training and skill
acquisition; computer-assisted decision
making; managing emerging
technologies
USA 46
3 Venkatesh, Viswanath, Ph.D. in
Information Systems, diffusion of
technologies in organizations and
society; management information
science; organizational behavior and
human decision; medical informatics;
human-computer studies
USA 45
4 DeLone, William H., Ph.D. in
Computers and Information Systems,
computers and information systems
USA 40
5 Wang, Yi-Shun (王怡舜), Ph.D. in
Information Management, information
technology and organizations; e-
learning; electronic commerce;
customer relationship management;
system dynamics
Taiwan 39
6 Cook, David A., M.D. in Medical
Education, USA/educational
technologies; clinical decision making;
assessment methods
USA 36
7 Stefano, George B., Ph.D. in
Neuroscience, neuroscience; medical
science; biological sciences
USA 32
8 Fornell, Claes G., Ph.D. in Economics,
customer satisfaction measurement and
customer asset management
USA 31
9 Parasuraman, A., D.B.A. in Marketing,
services marketing; service quality
measurement and improvement;
technology’s role in marketing and
serving customers
USA 29
10 Liaw, Shu-Sheng (廖述盛), Ed.D. in
Technology Education, e-learning;
medical informatics
Taiwan 26
4. Discussion
Three of the top 10 highly cited journals from 2003 to 2012
are from the SSCI database, with the other seven from the
SCI database. E-learning quality research seems to develop
richly in the SCI disciplines, including Medicine, General &
Internal (JAMA, BMJ, and NEJM); Education, Scientific
Disciplines (AM and ME); Multidisciplinary Sciences (SINE
and NATE); and Health Care Sciences & Services (ME).
Seven publishers come from the USA and three from the UK.
SCI journals have a higher IF than those in SSCI. Except for
AM and ME, which have IFs of around 3, the other SCI
journals have IFs between 14 and 50. In contrast, all three
SSCI journals have an IF between 1 and 4. Five of seven SCI
journals were ranked in the top 3 in their respective subject
categories by JCR, while two of SSCI journals were ranked
within top 7.
As can be seen from Table III and Table IV, the authors
with highly cited works in the first five years of the decade
under study do not overlap with those of the latter five years.
This suggests that the field of e-learning quality has a rapid
turnover in author citation. From 2003 to 2007, Vladimir
Vapnik and Etienne Wenger were the only two authors with
more than one work included in the list of the top 10 highly
cited references. From 2008 to 2012, William DeLone and
Ephraim McLean co-authored two journal articles, and Fred
Davis also wrote two that were in the top 10 highly cited
references. Citation counts of the works were not affected by
the year in which the work was published. Nine works
published in the 1990s were still being highly cited in the
former five year period, whereas four works published in the
1980s were in the latter five year period.
The works included in Tables III and IV provide
researchers of e-learning quality studies with helpful
guidance in starting a literature review of how the field has
evolved over the past decade. The increase in citations more
recently suggests that interest in e-learning research is
growing. Highly ranked citations are frequently considered
field-defining titles, and become important pointers for how
the field develops. Table IV also shows that the field has
matured to the point of tackling the issues of acceptance,
satisfaction, effectiveness, and success of e-learning. This
evidence verifies the significance of our present research
focus on quality in e-learning. A comparison of Tables III and
IV reveals two patterns between the two five year periods.
First, way in which the highly cited works crossed different
disciplines in these two periods varied notably. Second, the
most frequently cited publications in the first five years had
fewer citations than those in the second five years.
There is a geographic distinction between the influential
authors in the first period and those in the second. In the first,
there are four non-Northern American scholars (from India,
Germany, the UK, and the Netherlands), whereas in the
second there are only two who are not based in North
America. American scholars thus increasingly dominated the
research directions in this field, but Taiwanese scholars’
research efforts are gaining attention and recognition.
Two major disciplines—Information Systems and
Management and Medicine—retained the dominant influence
in this field during the past decade. Nonetheless, disciplines
such as Psychology, Marketing, and Economics have more
recently gained some prominence in this field.
5. Conclusion
This study has demonstrated that research on e-learning
quality is expanding and gaining greater recognition in the
interdisciplinary literature besides education. Computers &
Education was the most cited journal from 2003 to 2012.
Mitchell’s [18] and Vapnik’s [19] works were the most
frequently cited references 2003-2007, while Fornell and
Larcker’s [28] was 2008-2012. Barker and Schiffman were
the most cited authors 2003-2007, while Cohen and Davis
rose to the top during the second period. Shifts in the
rankings of the most influential journals, works, and authors
from the first to the second five years indicate that various
topics within the field of e-learning quality develop rapidly
and from diverse fields. The highly ranked authors’
professional fields encompassed education, statistics,
computer and technology science, medicine, neuroscience,
psychology, microbiology, information management,
economics, and marketing. Although e-learning quality as a
researchable topic has been described in many divergent
disciplines to capture its multidimensionality, this study has
documented the more recent move towards the disciplines of
Psychology, Marketing, and Economics.
In this article, we have shown the emergence of e-learning
quality as a field of research, using citation count rankings to
map the relevant research trends. This paper contributes the
research trends that define the foci, topics, and historic value
of e-learning quality research. These highly cited journals,
works, and scholars have not just the greatest impact on the
evolution of e-learning quality studies, but also collectively
define the boundary of this field. The works and authors listed
here may usefully guide researchers as documented classic
texts and experts in the field.
6. References
[1]Elsabé Cloete. “Electronic Education System Model”;
Computers & Education, Vol. 36, Issue 2, 171-182, 2001.
[2]Maggie McPherson. “Developing Innovation in E-Learning:
Lessons to Be Learned”; British Journal of Educational Technology,
Vol. 36, No. 4, 585-586, July 2005.
[3]Tak-Wai Chan, Chin-Wei Hue, Chih-Yueh Chou, and Ovid
J.L. Tzeng. “Four Spaces of Network Learning Models”; Computers
& Education, Vol. 37, Issue 2, 141-161, Sep 2001.
[4]Ambjörn Naeve, Miltiadis Lytras, Wolfgang Nejdl, Nicolas
balacheff, and Joseph Hardin. “Advances of the Semantic Web for
E-Learning: Expanding Learning Frontiers”; British Journal of
Educational Technology, Vol. 37, No. 3, 321-330, May 2006.
[5]E.S.I. Ossiannilsson. “Quality Enhancement on E-Learning”;
Campus-Wide Information Systems, Vol. 29, Issue 4, 312-323,
2012.
[6]Javier Sarsa, and Rebeca Soler. “E-Learning Quality:
Relations and Perceptions”; International Journal of Information and
Communication Technology Education, Vol. 8, Issue 2, 46-60, April
2012.
[7]Meilun Shih, Jui Feng, and Chin-Chung Tsai. “Research and
Trends in the Field of E-Learning from 2001 to 2005: A Content
Analysis of Cognitive Studies in Selected Journls”; Computers &
Education, Vol. 51, Issue 2, 955-967, Sep 2008.
[8]Sean Eom. “Author Cocitation Analysis: Quantitative
Methods for Mapping the Intellectual Structure of an Academic
Discipline.” Information Science Reference, 2009.
[9]Henk F. Moed. “Citation Analysis in Research Evaluation.”
Springer, 2005.
[10] Eugene Garfield. “Citation Indexing—Its Theory and
Application in Science, Techonology, and Humanities.” John Wiley
& Sons, 1979.
[11] ISI (Institute for Scientific Information) Web of
Knowledge, Thomson Reuters. “2011 JCR (Journal Citation
Reports) Science Edition.” Accessed March 1, 2013. http://admin-
apps.webofknowledge.com/JCR/JCR?RQ= HOME.
[12] ISI Web of Knowledge, Thomson Reuters. “2011 JCR
(Journal Citation Reports) Social Science Edition.” Accessed March
1, 2013. http://admin-apps.webofknowledge.com/JCR/JCR?RQ=
HOME.
[13] Thomson Reuters. “Science Citation Index.” Accessed
March 2, 2013. http://thomsonreuters.com/
products_services/science/science_products/a-
z/science_citation_index/.
[14] Thomson Reuters. “Social Science Citation Index.”
Accessed March 2, 2013. http://thomsonreuters.com/
products_services/science/science_products/a-
z/social_sciences_citation_index/.
[15] Thomson Reuters. “Web of Knowledge Factsheet.”
Accessed March 2, 2013.
http://thomsonreuters.com/content/science/pdf/Web_of_Knowledge
_factsheet.pdf.
[16] Thomson Reuters. “Web of Knowledge: All Databases.”
Accessed March 3, 2013.
http://apps.webofknowledge.com/WOS_GeneralSearch_input.do?pr
oduct=WOS&search_mode=GeneralSearch&SID=IE@PIFHeicGEN
abj9bH&preferenceSaved=&highlighted_tab=WOS.
[17] Thomson Reuters. “The Thomson Reuters Impact Factor.”
Accessed March 7, 2013. http://thomsonreuters.com/
products_services/science/free/essays/impact_factor/.
[18] Tom M. Mitchell. “Machine Learning.” McGraw-Hill,
1997.
[19] Vladimir N. Vapnik. “The Nature of Statistical Learning
Theory.” Springer, 1995.
[20] Christopher M. Bishop. “Neural Networks for Pattern
Recognition.” Oxford University Press, 1995.
[21] Jean Lave and Etienne Wenger. “Situated Learning:
Legitimate Peripheral Participation.” Cambridge University Press,
1991.
[22] J. Ross. Quinlan. “C4.5: Programs for Machine Learning.”
Morgan Kaufmann, 1993.
[23] Etienne Wenger. “Communities of Practice: Learning,
Meaning, and Identity.” Cambridge University Press, 1998.
[24] Richard O. Duda, Peter E. Hart, and David G. Stork.
“Pattern Classification.” Wiley, 2000.
[25] Vladimir N. Vapnik. “Statistical Learning Theory.”
Wiley, 1998.
[26] John Seely Brown, Allan Collins, and Paul Duguid.
“Situated Cognition and the Culture of Learning”; Educational
Resarcher, Vol. 18, Issue 1, 32-42, Jan 1989.
[27] Dave Davis, Mary Ann Thomoson O’Brien, Nick
Freemantle, Fredric M. Wolf, Paul Mazmanian, and Anne Taylor-
Vaisey. “Impact of Formal Continuing Medical Education: Do
Conferences, Workshops, Rounds, and Other Traditional
Continuing Education Activities Change Physician Behavior or
Health Care Outcomes?”; JAMA: The Journal of the American
Medical Association, Vol. 282, Issue 9, 867-874, Sept 1999.
[28] Claes Fornell, and David F. Larcker. “Evaluating
Structural Equation Models with Unobservable Variables and
Measurement Error”; Journal of Marketing Research, Vol. 18, Issue
1, 39-50, Feb 1981.
[29] William H. DeLone, and Ephraim R. McLean. “The
DeLone and McLean Model of Information Systems Success: A
Ten-Year Update”; Journal of Management Information Systems,
Vol. 19, Issue 4, 9-30, April 2003.
[30] Yi-Shun Wang. “Assessment of Learner Satisfaction with
Asynchronous Electronic Learning Systems”; Information &
Management, Vol. 41, Issue 1, 75-86, 2003.
[31] Jacob Cohen. “Statistical Power Analysis for the
Behavioral Sciences. 2nd ed.” Erlbaum Associates, 1988.
[32] Fred D. Davis, Richard P. Bagozzi, and Paul R. Warshaw.
“User Acceptance of Computer Technology: A Comparison of Two
Theoretical Models”; Management Science, Vol. 35, No. 8, 982-
1003, Aug 1989.
[33] Fred D. Davis. “Perceived Usefulness, Perceived Ease of
Use, and User Acceptance of Information Technology”; MIS
Quarterly, Vol. 13, No. 3, 319-340, Sep 1989.
[34] Pei-Chen Sun, Ray J. Tsai, Glenn Finger, Yueh-Yang
Chen, and Dowming Yeh. “What Drives a Successful E-Learning?
An Empirical Investigation of the Critical Factors Influencing
Learner Satisfaction”; Vol. 50, Issue 4, 1183-1202, May 2008.
[35] William H. DeLone, and Ephraim R. McLean.
“Information Systems Success: The Quest for the Dependent
Variable”; Information Systems Research, Vol 3, Issue 1, 60-95,
Mar 1992.
[36] Gabriele Piccoli, Rami Ahmad, and Blake Ives. “Web-
Based Virtual Learning Environments: A Research Framework and
A Preliminary Assessment of Effectiveness in Basic IT Skills
Training”; MIS Quarterly, Vol. 25, No. 4, 401-426, Dec 2001.
[37] Jorge G. Ruiz, Michael J. Mintzer, and Rosanne M.
Leipzig. “The Impact of E-Learning in Medical Education”;
Academic Medicine: Journal of the Association of American
Medical Colleges, Vol. 81, Issue 3, 207-212, Mar 2006.

More Related Content

What's hot

Does it Matter Which Citation Tool is Used to Compare the h-index of a Group ...
Does it Matter Which Citation Tool is Used to Compare the h-index of a Group ...Does it Matter Which Citation Tool is Used to Compare the h-index of a Group ...
Does it Matter Which Citation Tool is Used to Compare the h-index of a Group ...Nader Ale Ebrahim
 
Journal Impact Factors and Citation Analysis
Journal Impact Factors and Citation AnalysisJournal Impact Factors and Citation Analysis
Journal Impact Factors and Citation Analysisrepayne
 
What is bibliometrics and how does it work?
What is bibliometrics and how does it work?What is bibliometrics and how does it work?
What is bibliometrics and how does it work?Ciarán Quinn
 
Citation analysis for research evaluation
Citation analysis for research evaluationCitation analysis for research evaluation
Citation analysis for research evaluationWouter Gerritsma
 
Bibliometrics - an overview
Bibliometrics - an overviewBibliometrics - an overview
Bibliometrics - an overviewclaudia cavicchi
 
Using Bibliometrics Tools to Increase the visibility of your publications
Using Bibliometrics Tools to Increase the visibility of your publicationsUsing Bibliometrics Tools to Increase the visibility of your publications
Using Bibliometrics Tools to Increase the visibility of your publicationsCiarán Quinn
 
Google Scholar vs. MEDLINE for Health Sciences Literature Searching
Google Scholar vs. MEDLINE for Health Sciences Literature SearchingGoogle Scholar vs. MEDLINE for Health Sciences Literature Searching
Google Scholar vs. MEDLINE for Health Sciences Literature Searchinghsls
 
Latest trends in open science and big data analytical study: a decade of scie...
Latest trends in open science and big data analytical study: a decade of scie...Latest trends in open science and big data analytical study: a decade of scie...
Latest trends in open science and big data analytical study: a decade of scie...Oluwaseyi WUSU
 
Basic Journal Terminology_2016
Basic Journal Terminology_2016Basic Journal Terminology_2016
Basic Journal Terminology_2016Atiqa khan
 
Sci期刊影响因子分析(北京)
Sci期刊影响因子分析(北京)Sci期刊影响因子分析(北京)
Sci期刊影响因子分析(北京)viv
 
Journal Citation Reports
Journal Citation ReportsJournal Citation Reports
Journal Citation ReportsLinda Galloway
 
Prof. sp singh.ph d.course work.2020-21.citation index, journal impact factor...
Prof. sp singh.ph d.course work.2020-21.citation index, journal impact factor...Prof. sp singh.ph d.course work.2020-21.citation index, journal impact factor...
Prof. sp singh.ph d.course work.2020-21.citation index, journal impact factor...Saurashtra University
 
WoS 3 Journal Citation reports
WoS 3 Journal Citation reportsWoS 3 Journal Citation reports
WoS 3 Journal Citation reportsEISLibrarian
 
Impact Factor: An Index of Research Journal
Impact Factor: An Index of Research JournalImpact Factor: An Index of Research Journal
Impact Factor: An Index of Research JournalAJAY SEMALTY
 
h index: Benchmark of productivity and impact of researcher
h index: Benchmark of productivity and impact of researcher h index: Benchmark of productivity and impact of researcher
h index: Benchmark of productivity and impact of researcher AJAY SEMALTY
 
Bibliometrics (1) JIFs and JCRs
Bibliometrics (1) JIFs and JCRsBibliometrics (1) JIFs and JCRs
Bibliometrics (1) JIFs and JCRsJamie Bisset
 
Impact factor of journals
Impact factor of journalsImpact factor of journals
Impact factor of journalsDr. Pinki Insan
 

What's hot (20)

Author Level Metrics
Author Level MetricsAuthor Level Metrics
Author Level Metrics
 
Research Methodology-02: Quality Indices
Research Methodology-02: Quality IndicesResearch Methodology-02: Quality Indices
Research Methodology-02: Quality Indices
 
Does it Matter Which Citation Tool is Used to Compare the h-index of a Group ...
Does it Matter Which Citation Tool is Used to Compare the h-index of a Group ...Does it Matter Which Citation Tool is Used to Compare the h-index of a Group ...
Does it Matter Which Citation Tool is Used to Compare the h-index of a Group ...
 
Journal Impact Factors and Citation Analysis
Journal Impact Factors and Citation AnalysisJournal Impact Factors and Citation Analysis
Journal Impact Factors and Citation Analysis
 
Citation indexing
Citation indexingCitation indexing
Citation indexing
 
What is bibliometrics and how does it work?
What is bibliometrics and how does it work?What is bibliometrics and how does it work?
What is bibliometrics and how does it work?
 
Citation analysis for research evaluation
Citation analysis for research evaluationCitation analysis for research evaluation
Citation analysis for research evaluation
 
Bibliometrics - an overview
Bibliometrics - an overviewBibliometrics - an overview
Bibliometrics - an overview
 
Using Bibliometrics Tools to Increase the visibility of your publications
Using Bibliometrics Tools to Increase the visibility of your publicationsUsing Bibliometrics Tools to Increase the visibility of your publications
Using Bibliometrics Tools to Increase the visibility of your publications
 
Google Scholar vs. MEDLINE for Health Sciences Literature Searching
Google Scholar vs. MEDLINE for Health Sciences Literature SearchingGoogle Scholar vs. MEDLINE for Health Sciences Literature Searching
Google Scholar vs. MEDLINE for Health Sciences Literature Searching
 
Latest trends in open science and big data analytical study: a decade of scie...
Latest trends in open science and big data analytical study: a decade of scie...Latest trends in open science and big data analytical study: a decade of scie...
Latest trends in open science and big data analytical study: a decade of scie...
 
Basic Journal Terminology_2016
Basic Journal Terminology_2016Basic Journal Terminology_2016
Basic Journal Terminology_2016
 
Sci期刊影响因子分析(北京)
Sci期刊影响因子分析(北京)Sci期刊影响因子分析(北京)
Sci期刊影响因子分析(北京)
 
Journal Citation Reports
Journal Citation ReportsJournal Citation Reports
Journal Citation Reports
 
Prof. sp singh.ph d.course work.2020-21.citation index, journal impact factor...
Prof. sp singh.ph d.course work.2020-21.citation index, journal impact factor...Prof. sp singh.ph d.course work.2020-21.citation index, journal impact factor...
Prof. sp singh.ph d.course work.2020-21.citation index, journal impact factor...
 
WoS 3 Journal Citation reports
WoS 3 Journal Citation reportsWoS 3 Journal Citation reports
WoS 3 Journal Citation reports
 
Impact Factor: An Index of Research Journal
Impact Factor: An Index of Research JournalImpact Factor: An Index of Research Journal
Impact Factor: An Index of Research Journal
 
h index: Benchmark of productivity and impact of researcher
h index: Benchmark of productivity and impact of researcher h index: Benchmark of productivity and impact of researcher
h index: Benchmark of productivity and impact of researcher
 
Bibliometrics (1) JIFs and JCRs
Bibliometrics (1) JIFs and JCRsBibliometrics (1) JIFs and JCRs
Bibliometrics (1) JIFs and JCRs
 
Impact factor of journals
Impact factor of journalsImpact factor of journals
Impact factor of journals
 

Viewers also liked

Viewers also liked (8)

How i use Blackboard Discussion Boards
How i use Blackboard Discussion BoardsHow i use Blackboard Discussion Boards
How i use Blackboard Discussion Boards
 
Ocean320 Learning Guide
Ocean320 Learning GuideOcean320 Learning Guide
Ocean320 Learning Guide
 
Module2(1)
Module2(1)Module2(1)
Module2(1)
 
Gran Portón S.A.
Gran Portón S.A.Gran Portón S.A.
Gran Portón S.A.
 
How to choose a book for extensive reading
How to choose a book for extensive readingHow to choose a book for extensive reading
How to choose a book for extensive reading
 
Our School - Malta
Our School - MaltaOur School - Malta
Our School - Malta
 
On the design of Urban Games - Workshop 7Scenes Waag Society
On the design of Urban Games - Workshop 7Scenes Waag SocietyOn the design of Urban Games - Workshop 7Scenes Waag Society
On the design of Urban Games - Workshop 7Scenes Waag Society
 
Phd Thesis Project
Phd Thesis ProjectPhd Thesis Project
Phd Thesis Project
 

Similar to Research Trends in the Field of e-Learning Quality, 2003-2012: A Citation Analysis

Scholarly impact metrics traditions
Scholarly impact metrics traditionsScholarly impact metrics traditions
Scholarly impact metrics traditionsntunmg
 
Bibliometric portrait of srels journal of information management for the peri...
Bibliometric portrait of srels journal of information management for the peri...Bibliometric portrait of srels journal of information management for the peri...
Bibliometric portrait of srels journal of information management for the peri...Ghouse Modin Mamdapur
 
Does Criticisms Overcome the Praises of Journal Impact Factor?
Does Criticisms Overcome the Praises of Journal Impact Factor?Does Criticisms Overcome the Praises of Journal Impact Factor?
Does Criticisms Overcome the Praises of Journal Impact Factor?Nader Ale Ebrahim
 
Web of Science and Scopus: Understanding the indexing system
Web of Science and Scopus: Understanding the indexing systemWeb of Science and Scopus: Understanding the indexing system
Web of Science and Scopus: Understanding the indexing systemDr. Sharad Chand
 
Does a Long Reference List Guarantee More Citations? Analysis of Malaysian Hi...
Does a Long Reference List Guarantee More Citations? Analysis of Malaysian Hi...Does a Long Reference List Guarantee More Citations? Analysis of Malaysian Hi...
Does a Long Reference List Guarantee More Citations? Analysis of Malaysian Hi...Nader Ale Ebrahim
 
Metrics vs peer review: Why metrics can (and should?) be applied in the Socia...
Metrics vs peer review: Why metrics can (and should?) be applied in the Socia...Metrics vs peer review: Why metrics can (and should?) be applied in the Socia...
Metrics vs peer review: Why metrics can (and should?) be applied in the Socia...Anne-Wil Harzing
 
Authorship Trend And Content Analysis
Authorship Trend And Content AnalysisAuthorship Trend And Content Analysis
Authorship Trend And Content AnalysisMartha Brown
 
ARTIFICIAL INTELLIGENCE IN HIGHER EDUCATION A BIBLIOMETRIC ANALYSIS OF RESEAR...
ARTIFICIAL INTELLIGENCE IN HIGHER EDUCATION A BIBLIOMETRIC ANALYSIS OF RESEAR...ARTIFICIAL INTELLIGENCE IN HIGHER EDUCATION A BIBLIOMETRIC ANALYSIS OF RESEAR...
ARTIFICIAL INTELLIGENCE IN HIGHER EDUCATION A BIBLIOMETRIC ANALYSIS OF RESEAR...Swarup Adhikary
 
research methodology research methodology
research methodology research methodologyresearch methodology research methodology
research methodology research methodologyYassine Maleh, Ph.D.
 
An Analytical Study On The Publication Pattern And Impact Of Top Research Pap...
An Analytical Study On The Publication Pattern And Impact Of Top Research Pap...An Analytical Study On The Publication Pattern And Impact Of Top Research Pap...
An Analytical Study On The Publication Pattern And Impact Of Top Research Pap...Sara Alvarez
 
Google Scholar and Web of Science: Similarities and Differences in Citation A...
Google Scholar and Web of Science: Similarities and Differences in Citation A...Google Scholar and Web of Science: Similarities and Differences in Citation A...
Google Scholar and Web of Science: Similarities and Differences in Citation A...Balachandar Radhakrishnan
 
Work-Life Balance: A Literature Mapping with Bibliometric Analysis Using Vosv...
Work-Life Balance: A Literature Mapping with Bibliometric Analysis Using Vosv...Work-Life Balance: A Literature Mapping with Bibliometric Analysis Using Vosv...
Work-Life Balance: A Literature Mapping with Bibliometric Analysis Using Vosv...AJHSSR Journal
 
Making an Impact: The Impact Factor's Intent, Benefits, Limitations, and Comp...
Making an Impact: The Impact Factor's Intent, Benefits, Limitations, and Comp...Making an Impact: The Impact Factor's Intent, Benefits, Limitations, and Comp...
Making an Impact: The Impact Factor's Intent, Benefits, Limitations, and Comp...Erin Owens
 
بنك المعرفة المصرى Egyptian knowledge bank
بنك المعرفة المصرى  Egyptian knowledge bankبنك المعرفة المصرى  Egyptian knowledge bank
بنك المعرفة المصرى Egyptian knowledge banksameh shalash
 
A Science Mapping Analysis Of Blood Donation Behaviour
A Science Mapping Analysis Of Blood Donation BehaviourA Science Mapping Analysis Of Blood Donation Behaviour
A Science Mapping Analysis Of Blood Donation BehaviourBria Davis
 

Similar to Research Trends in the Field of e-Learning Quality, 2003-2012: A Citation Analysis (20)

Scholarly impact metrics traditions
Scholarly impact metrics traditionsScholarly impact metrics traditions
Scholarly impact metrics traditions
 
Bibliometric portrait of srels journal of information management for the peri...
Bibliometric portrait of srels journal of information management for the peri...Bibliometric portrait of srels journal of information management for the peri...
Bibliometric portrait of srels journal of information management for the peri...
 
Does Criticisms Overcome the Praises of Journal Impact Factor?
Does Criticisms Overcome the Praises of Journal Impact Factor?Does Criticisms Overcome the Praises of Journal Impact Factor?
Does Criticisms Overcome the Praises of Journal Impact Factor?
 
A Bibliometric Analysis
A Bibliometric AnalysisA Bibliometric Analysis
A Bibliometric Analysis
 
Web of Science and Scopus: Understanding the indexing system
Web of Science and Scopus: Understanding the indexing systemWeb of Science and Scopus: Understanding the indexing system
Web of Science and Scopus: Understanding the indexing system
 
Does a Long Reference List Guarantee More Citations? Analysis of Malaysian Hi...
Does a Long Reference List Guarantee More Citations? Analysis of Malaysian Hi...Does a Long Reference List Guarantee More Citations? Analysis of Malaysian Hi...
Does a Long Reference List Guarantee More Citations? Analysis of Malaysian Hi...
 
Metrics vs peer review: Why metrics can (and should?) be applied in the Socia...
Metrics vs peer review: Why metrics can (and should?) be applied in the Socia...Metrics vs peer review: Why metrics can (and should?) be applied in the Socia...
Metrics vs peer review: Why metrics can (and should?) be applied in the Socia...
 
Authorship Trend And Content Analysis
Authorship Trend And Content AnalysisAuthorship Trend And Content Analysis
Authorship Trend And Content Analysis
 
Bang those robots’ heads together!
Bang those robots’ heads together!Bang those robots’ heads together!
Bang those robots’ heads together!
 
ARTIFICIAL INTELLIGENCE IN HIGHER EDUCATION A BIBLIOMETRIC ANALYSIS OF RESEAR...
ARTIFICIAL INTELLIGENCE IN HIGHER EDUCATION A BIBLIOMETRIC ANALYSIS OF RESEAR...ARTIFICIAL INTELLIGENCE IN HIGHER EDUCATION A BIBLIOMETRIC ANALYSIS OF RESEAR...
ARTIFICIAL INTELLIGENCE IN HIGHER EDUCATION A BIBLIOMETRIC ANALYSIS OF RESEAR...
 
Unit 6
Unit 6Unit 6
Unit 6
 
research methodology research methodology
research methodology research methodologyresearch methodology research methodology
research methodology research methodology
 
An Analytical Study On The Publication Pattern And Impact Of Top Research Pap...
An Analytical Study On The Publication Pattern And Impact Of Top Research Pap...An Analytical Study On The Publication Pattern And Impact Of Top Research Pap...
An Analytical Study On The Publication Pattern And Impact Of Top Research Pap...
 
Google Scholar and Web of Science: Similarities and Differences in Citation A...
Google Scholar and Web of Science: Similarities and Differences in Citation A...Google Scholar and Web of Science: Similarities and Differences in Citation A...
Google Scholar and Web of Science: Similarities and Differences in Citation A...
 
Work-Life Balance: A Literature Mapping with Bibliometric Analysis Using Vosv...
Work-Life Balance: A Literature Mapping with Bibliometric Analysis Using Vosv...Work-Life Balance: A Literature Mapping with Bibliometric Analysis Using Vosv...
Work-Life Balance: A Literature Mapping with Bibliometric Analysis Using Vosv...
 
dec_04.pdf
dec_04.pdfdec_04.pdf
dec_04.pdf
 
Making an Impact: The Impact Factor's Intent, Benefits, Limitations, and Comp...
Making an Impact: The Impact Factor's Intent, Benefits, Limitations, and Comp...Making an Impact: The Impact Factor's Intent, Benefits, Limitations, and Comp...
Making an Impact: The Impact Factor's Intent, Benefits, Limitations, and Comp...
 
بنك المعرفة المصرى Egyptian knowledge bank
بنك المعرفة المصرى  Egyptian knowledge bankبنك المعرفة المصرى  Egyptian knowledge bank
بنك المعرفة المصرى Egyptian knowledge bank
 
A Science Mapping Analysis Of Blood Donation Behaviour
A Science Mapping Analysis Of Blood Donation BehaviourA Science Mapping Analysis Of Blood Donation Behaviour
A Science Mapping Analysis Of Blood Donation Behaviour
 
Research in india 1
Research in india 1Research in india 1
Research in india 1
 

More from Che-Wei Lee

Policy Debates and Indigenous Education: The Trialectic of Language, Culture,...
Policy Debates and Indigenous Education: The Trialectic of Language, Culture,...Policy Debates and Indigenous Education: The Trialectic of Language, Culture,...
Policy Debates and Indigenous Education: The Trialectic of Language, Culture,...Che-Wei Lee
 
CIES Language Issues SIG Fall 2014 Newsletter
CIES Language Issues SIG Fall 2014 NewsletterCIES Language Issues SIG Fall 2014 Newsletter
CIES Language Issues SIG Fall 2014 NewsletterChe-Wei Lee
 
國境之南的原住民社區本位學校
國境之南的原住民社區本位學校國境之南的原住民社區本位學校
國境之南的原住民社區本位學校Che-Wei Lee
 
族語能力證明考試政策與學校教育中語言位階 之研究—以一所原住民完全中學為例
族語能力證明考試政策與學校教育中語言位階之研究—以一所原住民完全中學為例 族語能力證明考試政策與學校教育中語言位階之研究—以一所原住民完全中學為例
族語能力證明考試政策與學校教育中語言位階 之研究—以一所原住民完全中學為例 Che-Wei Lee
 
Aboriginal Students' Attitudes toward the Tribal Language Proficiency Test Po...
Aboriginal Students' Attitudes toward the Tribal Language Proficiency Test Po...Aboriginal Students' Attitudes toward the Tribal Language Proficiency Test Po...
Aboriginal Students' Attitudes toward the Tribal Language Proficiency Test Po...Che-Wei Lee
 
The Experience of Writing the Comprehensive Examination
The Experience of Writing the Comprehensive ExaminationThe Experience of Writing the Comprehensive Examination
The Experience of Writing the Comprehensive ExaminationChe-Wei Lee
 
What Indigenous Children Taught Me When I Was a Student Teacher at an Indigen...
What Indigenous Children Taught Me When I Was a Student Teacher at an Indigen...What Indigenous Children Taught Me When I Was a Student Teacher at an Indigen...
What Indigenous Children Taught Me When I Was a Student Teacher at an Indigen...Che-Wei Lee
 
How to Make Mathematics Education Aboriginalized?
How to Make Mathematics Education Aboriginalized?How to Make Mathematics Education Aboriginalized?
How to Make Mathematics Education Aboriginalized?Che-Wei Lee
 
Visiting the Wyoming Indian High School, USA
Visiting the Wyoming Indian High School, USAVisiting the Wyoming Indian High School, USA
Visiting the Wyoming Indian High School, USAChe-Wei Lee
 
Principal KAO Cheng-siong and Lai Yi Senior High School in the Southern Part ...
Principal KAO Cheng-siong and Lai Yi Senior High School in the Southern Part ...Principal KAO Cheng-siong and Lai Yi Senior High School in the Southern Part ...
Principal KAO Cheng-siong and Lai Yi Senior High School in the Southern Part ...Che-Wei Lee
 
A Different Voice from a Non-Aboriginal Teacher at Lai Yi Senior High School
A Different Voice from a Non-Aboriginal Teacher at Lai Yi Senior High SchoolA Different Voice from a Non-Aboriginal Teacher at Lai Yi Senior High School
A Different Voice from a Non-Aboriginal Teacher at Lai Yi Senior High SchoolChe-Wei Lee
 
Comment on “Preserving Indigenous Democracy” by Duane Champagne
Comment on “Preserving Indigenous Democracy” by Duane ChampagneComment on “Preserving Indigenous Democracy” by Duane Champagne
Comment on “Preserving Indigenous Democracy” by Duane ChampagneChe-Wei Lee
 
Comment on “Indigenous and 21st Century Nationalisms” by Duane Champagne
Comment on “Indigenous and 21st Century Nationalisms” by Duane ChampagneComment on “Indigenous and 21st Century Nationalisms” by Duane Champagne
Comment on “Indigenous and 21st Century Nationalisms” by Duane ChampagneChe-Wei Lee
 
An Organisational Analysis of the World Indigenous Nations Higher Education C...
An Organisational Analysis of the World Indigenous Nations Higher Education C...An Organisational Analysis of the World Indigenous Nations Higher Education C...
An Organisational Analysis of the World Indigenous Nations Higher Education C...Che-Wei Lee
 
Comment on “Duane Champagne's Turtle Island Tales” by Christie-Michelle Poitra
Comment on “Duane Champagne's Turtle Island Tales” by Christie-Michelle PoitraComment on “Duane Champagne's Turtle Island Tales” by Christie-Michelle Poitra
Comment on “Duane Champagne's Turtle Island Tales” by Christie-Michelle PoitraChe-Wei Lee
 
Comment on “Beyond Assimilation and Nationalism: Walking in Two Worlds Is Nec...
Comment on “Beyond Assimilation and Nationalism: Walking in Two Worlds Is Nec...Comment on “Beyond Assimilation and Nationalism: Walking in Two Worlds Is Nec...
Comment on “Beyond Assimilation and Nationalism: Walking in Two Worlds Is Nec...Che-Wei Lee
 
Comment on “Authenticity: Ethnic Indians, non-Indians and Reservation Indians...
Comment on “Authenticity: Ethnic Indians, non-Indians and Reservation Indians...Comment on “Authenticity: Ethnic Indians, non-Indians and Reservation Indians...
Comment on “Authenticity: Ethnic Indians, non-Indians and Reservation Indians...Che-Wei Lee
 
Comment on “Transnational or Indigenous?” by Duane Champagne
Comment on “Transnational or Indigenous?” by Duane ChampagneComment on “Transnational or Indigenous?” by Duane Champagne
Comment on “Transnational or Indigenous?” by Duane ChampagneChe-Wei Lee
 
Comment on “What Is Good Native Governance?” by Dina Gilio-Whitaker
Comment on “What Is Good Native Governance?” by Dina Gilio-WhitakerComment on “What Is Good Native Governance?” by Dina Gilio-Whitaker
Comment on “What Is Good Native Governance?” by Dina Gilio-WhitakerChe-Wei Lee
 
Comment on “Incommensurate Indigenous Right?” by Duane Champagne
Comment on “Incommensurate Indigenous Right?” by Duane ChampagneComment on “Incommensurate Indigenous Right?” by Duane Champagne
Comment on “Incommensurate Indigenous Right?” by Duane ChampagneChe-Wei Lee
 

More from Che-Wei Lee (20)

Policy Debates and Indigenous Education: The Trialectic of Language, Culture,...
Policy Debates and Indigenous Education: The Trialectic of Language, Culture,...Policy Debates and Indigenous Education: The Trialectic of Language, Culture,...
Policy Debates and Indigenous Education: The Trialectic of Language, Culture,...
 
CIES Language Issues SIG Fall 2014 Newsletter
CIES Language Issues SIG Fall 2014 NewsletterCIES Language Issues SIG Fall 2014 Newsletter
CIES Language Issues SIG Fall 2014 Newsletter
 
國境之南的原住民社區本位學校
國境之南的原住民社區本位學校國境之南的原住民社區本位學校
國境之南的原住民社區本位學校
 
族語能力證明考試政策與學校教育中語言位階 之研究—以一所原住民完全中學為例
族語能力證明考試政策與學校教育中語言位階之研究—以一所原住民完全中學為例 族語能力證明考試政策與學校教育中語言位階之研究—以一所原住民完全中學為例
族語能力證明考試政策與學校教育中語言位階 之研究—以一所原住民完全中學為例
 
Aboriginal Students' Attitudes toward the Tribal Language Proficiency Test Po...
Aboriginal Students' Attitudes toward the Tribal Language Proficiency Test Po...Aboriginal Students' Attitudes toward the Tribal Language Proficiency Test Po...
Aboriginal Students' Attitudes toward the Tribal Language Proficiency Test Po...
 
The Experience of Writing the Comprehensive Examination
The Experience of Writing the Comprehensive ExaminationThe Experience of Writing the Comprehensive Examination
The Experience of Writing the Comprehensive Examination
 
What Indigenous Children Taught Me When I Was a Student Teacher at an Indigen...
What Indigenous Children Taught Me When I Was a Student Teacher at an Indigen...What Indigenous Children Taught Me When I Was a Student Teacher at an Indigen...
What Indigenous Children Taught Me When I Was a Student Teacher at an Indigen...
 
How to Make Mathematics Education Aboriginalized?
How to Make Mathematics Education Aboriginalized?How to Make Mathematics Education Aboriginalized?
How to Make Mathematics Education Aboriginalized?
 
Visiting the Wyoming Indian High School, USA
Visiting the Wyoming Indian High School, USAVisiting the Wyoming Indian High School, USA
Visiting the Wyoming Indian High School, USA
 
Principal KAO Cheng-siong and Lai Yi Senior High School in the Southern Part ...
Principal KAO Cheng-siong and Lai Yi Senior High School in the Southern Part ...Principal KAO Cheng-siong and Lai Yi Senior High School in the Southern Part ...
Principal KAO Cheng-siong and Lai Yi Senior High School in the Southern Part ...
 
A Different Voice from a Non-Aboriginal Teacher at Lai Yi Senior High School
A Different Voice from a Non-Aboriginal Teacher at Lai Yi Senior High SchoolA Different Voice from a Non-Aboriginal Teacher at Lai Yi Senior High School
A Different Voice from a Non-Aboriginal Teacher at Lai Yi Senior High School
 
Comment on “Preserving Indigenous Democracy” by Duane Champagne
Comment on “Preserving Indigenous Democracy” by Duane ChampagneComment on “Preserving Indigenous Democracy” by Duane Champagne
Comment on “Preserving Indigenous Democracy” by Duane Champagne
 
Comment on “Indigenous and 21st Century Nationalisms” by Duane Champagne
Comment on “Indigenous and 21st Century Nationalisms” by Duane ChampagneComment on “Indigenous and 21st Century Nationalisms” by Duane Champagne
Comment on “Indigenous and 21st Century Nationalisms” by Duane Champagne
 
An Organisational Analysis of the World Indigenous Nations Higher Education C...
An Organisational Analysis of the World Indigenous Nations Higher Education C...An Organisational Analysis of the World Indigenous Nations Higher Education C...
An Organisational Analysis of the World Indigenous Nations Higher Education C...
 
Comment on “Duane Champagne's Turtle Island Tales” by Christie-Michelle Poitra
Comment on “Duane Champagne's Turtle Island Tales” by Christie-Michelle PoitraComment on “Duane Champagne's Turtle Island Tales” by Christie-Michelle Poitra
Comment on “Duane Champagne's Turtle Island Tales” by Christie-Michelle Poitra
 
Comment on “Beyond Assimilation and Nationalism: Walking in Two Worlds Is Nec...
Comment on “Beyond Assimilation and Nationalism: Walking in Two Worlds Is Nec...Comment on “Beyond Assimilation and Nationalism: Walking in Two Worlds Is Nec...
Comment on “Beyond Assimilation and Nationalism: Walking in Two Worlds Is Nec...
 
Comment on “Authenticity: Ethnic Indians, non-Indians and Reservation Indians...
Comment on “Authenticity: Ethnic Indians, non-Indians and Reservation Indians...Comment on “Authenticity: Ethnic Indians, non-Indians and Reservation Indians...
Comment on “Authenticity: Ethnic Indians, non-Indians and Reservation Indians...
 
Comment on “Transnational or Indigenous?” by Duane Champagne
Comment on “Transnational or Indigenous?” by Duane ChampagneComment on “Transnational or Indigenous?” by Duane Champagne
Comment on “Transnational or Indigenous?” by Duane Champagne
 
Comment on “What Is Good Native Governance?” by Dina Gilio-Whitaker
Comment on “What Is Good Native Governance?” by Dina Gilio-WhitakerComment on “What Is Good Native Governance?” by Dina Gilio-Whitaker
Comment on “What Is Good Native Governance?” by Dina Gilio-Whitaker
 
Comment on “Incommensurate Indigenous Right?” by Duane Champagne
Comment on “Incommensurate Indigenous Right?” by Duane ChampagneComment on “Incommensurate Indigenous Right?” by Duane Champagne
Comment on “Incommensurate Indigenous Right?” by Duane Champagne
 

Recently uploaded

Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxnull - The Open Security Community
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 

Recently uploaded (20)

Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 

Research Trends in the Field of e-Learning Quality, 2003-2012: A Citation Analysis

  • 1. Research trends in the field of e-learning quality, 2003-2012: A citation analysis Chin-Hsiu Tai1 , Che-Wei Lee2 , Yender Lee3 1 Graduate School of Business and Operations Management, Chang Jung Christian University, Tainan, Taiwan, a8646165@yahoo.com.tw 2 Department of Administration and Policy Studies, University of Pittsburgh, Pittsburgh, Pennsylvania, USA, chl138@pitt.edu 3 Graduate School of Business and Operations Management, Chang Jung Christian University, Tainan, Taiwan, mcgill_lee@yahoo.com Keywords: e-learning quality, research trends, citation analysis, informetrics Abstract - This paper applies the citation analysis to identify research trends in the field of e-learning quality, based on the Social Science Citation Index (SSCI) and Science Citation Index (SCI) databases from 2003 to 2012. To do this, 35,482 citations of 1,647 documents identified from SSCI and SCI texts were analyzed. Results showed that research trends varied rapidly and richly in many disciplines between the two time periods (2003-2007 and 2008-2012). This study may be of benefit to scholars seeking to understand the literature surrounding e-learning quality and explore promising research questions. 1. Introduction In the field of e-learning, although recent decades have seen growing significance placed on learning modules, and the suitability, practices, employment, and the impact on various facets of today’s education [1-4], more recently research interests have shifted to focus on quality enhancement, relations, and perceptions of e-learning [5,6]. However, the result of these qualitatively preliminary reviews seems to oversimplify the scope of e-learning quality within education. Few studies [7] systematically and quantitatively examine the research trends in the field of quality in e- learning from 2003 to 2012. Even fewer use citation analysis [8,9,10] to investigate the interdisciplinary development of research into the field of e-learning quality. Here we assume that there has been a dramatic proliferation of, and a shift in, patterns of research on e-learning in the twenty-first century. This article applies citation analysis to investigate the most frequently cited authors and the references on e-learning quality from the Social Science Citation Index (SSCI) and Social Citation Index (SCI) databases over the past ten years to identify research trends. It also, however, goes further, by reviewing the cross-disciplinary status of research on e- learning quality. In this study, research trend was defined as having three components: (1) highly cited journals, (2) the most frequently cited works, and (3) the most frequently cited authors. With this new information, it is hoped that scholars of e-learning research may rapidly, efficiently, and accurately identify the documented classic (must-read, best-quality, and widely-cited) texts and discover the most influential scholars in this domain. Three primary research questions guide this study: (1) Which journals were cited the most from 2003 to 2012? (2) Which works were the most frequently cited in 2003-2007 compared to 2008-2012? (3) Which authors were the most frequently cited in 2003-2007 compared to 2008- 2012? 2. Methods 2.1 Research Design The citation analysis was derived from the methodology of informetrics—also known as bibliometrics or scientometrics [8,9,10], and was used to identify research trends in the field of e-learning quality. Based on our assumption that studies of e-learning quality over the last decade had become a dominant trend in many disciplines, the time period was set as 2003-2012 and divided in half (2003-2007 and 2008-2012) for comparisons of citations to determine the dynamics of research on e-learning quality. A database relating to studies on e-learning quality was built for citation analysis by retrieving data from Institute for Scientific Information (ISI) Citation Indexes databases [11,12], consisting of three sub- databases: (1) 2003-2012 document citations; (2) 2003-2007 author and document citations; and (3) 2008-2012 author and document citations. 2.2 Data Sources The data were retrieved from Science Citation Index (SCI) and Social Science Citation Index (SSCI), both published by the Institute for Scientific Information (ISI) Citation Indexes of Thomson Reuters. SCI and SSCI currently cover over 6,700 leading scholarly journals (3,700 from SCI, 3,000 from SSCI), representing 150 disciplines (100 from SCI, 50 from SSCI) [13,14]. These two databases also provided the ISI Journal Citation Reports (JCR) [11,12], which “offers a systematic, objective means to critically evaluate the world’s leading journals, with quantifiable, statistical information based on citation data” [15], for helping us to see the journals that were the most frequently used or cited. Proceedings of the 19th ISSAT International Conference on Reliability and Quality in Design August 5-7, 2013 - Honolulu, Hawaii, U.S.A.
  • 2. We included journal articles, books, book reviews, reviews, conference programs and proceedings, and editorial materials in this study. There were 23,577 document citations 2003- 2012. With 18,472 articles, there were 8,807 journals 2003- 2007 and 14,164 authors. In 2008-2012 there were 45,964 articles, 17,626 journals, and 32,799 authors. 2.3 Data Collection We used the keyword “e-learning quality” to search the Web of Science from Thomson Reuters’ Web of Knowledge [16], limiting the timespan of results to 2003-2007 and 2008- 2012 respectively. Search results were refined into the disciplinary categories of Education & Educational (SSCI); Education, Science Disciplines (SCI); Health Care Sciences & Services (SCI); Medicine, General & Internal (SCI); Management (SSCI); Information Science & Library (SCI); and Multidisciplinary Sciences (SCI). Finally, 1,647 texts— including journal articles and books—cited in 50,826 publications were retrieved from the initial 35,482 pool of works. Citation counts, journal information, article titles, publication dates, authors’ names, and attributed disciplines were tabulated using Microsoft Excel 2010, divided in the two periods of 2003-2007 and 2008-2012, and the top 10 most highly journals, cited references, and authors were selected. 2.4 Data Analysis By ranking the top 10 highly cited journals, references, and authors according to citation counts, the relationships between publications and the impact that particular references and authors may have had on the subsequent development of e-learning quality research can be discovered. Journals were ranked by how frequently they were cited journals from 2003 to 2012. Their impact factor (IF) [17] was obtained from JCR, and serves as a measure indicator of journal quality. It is determined based on the average number of citations of works published by the journals. The SCI/SSCI-generated rankings highlight the status of the specific journal in respective subject categories. The top 10 most highly cited works were further classified into some disciplines in terms of their article or book titles. The current working locations, areas of expertise of the top 10 most frequently cited authors identified were gathered from the authors’ professional websites, available curriculum vitae, and representative publications. 3. Results 3.1 Which journals were cited the most? Table I shows the top 10 highly cited journals in e-learning quality from 2003 to 2012, in frequency order. The nine journals other than Nature were cited over 200 times in the past decade. According to the 2011 JCR Science Edition [11] and Social Science Edition [12], Table II shows that these journals associated with e-learning quality can be classified into seven subject categories, and provides the IF and the journal’s rank within a specific category or discipline. TABLE I. THE TOP 10 HIGHLY CITED JOURNALS, 2003-2012 Rank Journal Title Database Publisher’s Country Citation Count 1 Computers & Education SSCI UK 425 2 JAMA-Journal of the American Medical Association SCI USA 362 3 Management Science SSCI USA 297 4 British Medical Journal SCI UK 268 5 Academic Medicine SCI USA 262 6 MIS Quarterly SSCI USA 243 7 Science SCI USA 223 8 New England Journal of Medicine SCI USA 213 9 Medical Education SCI USA 212 10 Nature SCI UK 195 TABLE II. CATEGORIES, IMPACT FACTOR, AND RANK OF THE TOP 10 HIGHLY CITED JOURNALS, 2003-2012 Category Journal Title (Abbreviation) Impact Factor (IF) Ranka Education & Educational (SSCI)  Computers & Education (CE) 2.261 7/206 Education, Science Disciplines (SCI)  Academic Medicine (AM) 3.524 1/33  Medical Education (ME) 3.176 2/33 Health Care Sciences & Services (SCI)  Medical Education (ME) 3.176 8/76 Medicine, General & Internal (SCI)  New England Journal of Medicine (NEJM) 53.298 1/155  JAMA-Journal of the American Medical Association (JAMA) 30.026 3/155  British Medical Journal (BMJ) 14.093 6/155 Management (SSCI)  MIS Quarterly (MISQ) 4.447 6/168  Management Science (MS) 1.733 48/168 Information Science & Library (SCI)  MIS Quarterly (MISQ) 4.447 1/83 Multidisciplinary Sciences (SCI)  Nature (NATE) 36.280 1/56  Science (SINE) 31.201 2/56 a. This rankings was published by SSCI/SCI databases. “/” means “out of,” for example, 7/206 = the journal was ranked 7th out of 206 journals in the specific category. 3.2 Whose texts were the most frequently cited? Table III presents the top 10 highly cited works from 2003 to 2007. Only two of the most frequently cited works are journal articles; the others are books. These books and journal articles highlight the following core research topics and disciplines that trended in the field of e-learning quality from 2003 to 2007, including (1) Machine: theory of machine learning [18,22,24]; (2) Medicine: neural networks [20,24]; (3) Education: cognition learning, situated learning (or a model of learning in a community of practice) [21,23,26]; and (4) Statistics: statistical pattern recognition [19,24,25]. TABLE III. THE TOP 10 HIGHLY CITED REFERENCES, 2003-2007 Rank Reference Citation Count 1 Mitchell, 1997 [18] 9 1 Vapnik, 1995 [19] 9 3 Bishop, 1995 [20] 8 3 Lave and Wenger, 1991 [21] 8 3 Quinlan, 1993 [22] 8 3 Wenger, 1998 [23] 8 7 Duda, Hart, and Stork, 2001 [24] 6 7 Vapnik, 1998 [25] 6 9 Brown, Collins, and Duguid, 1989 [26] 5
  • 3. 9 Davis, et al., 1999 [27] 5 Table IV presents the top 10 frequently cited publications from 2008 to 2012. Citation counts were notably higher than the previous five year period, ranging from 15 to 25. Only Cohen’s [31] work is a book, the other nine are journal articles. The research trends in this period keep e-learning quality mainly in the two fields of: (1) Statistics: structural equation models, and statistical power analysis for behavioral sciences [28,31]; and (2) Medicine: e-learning in medical education [37]. However, new research directions related to e- learning quality have emerged from these works, introducing a focus on studies of acceptance [32,33], satisfaction [30,34], effectiveness [36], and success [29,35] of e-learning, computer, and information technology and systems. TABLE IV. THE TOP 10 HIGHLY CITED REFERENCES, 2008-2012 Rank Reference Citation Counts 1 Fornell and Larcker, 1981 [28] 25 2 DeLone and McLean, 2003 [29] 20 2 Wang, 2003 [30] 20 4 Cohen, 1988 [31] 19 5 Davis, Bagozzi, and Warshaw, 1989 [32] 18 5 Davis, 1989 [33] 18 7 Sun, et al., 2008, [34] 17 8 DeLone and McLean, 1992 [35] 16 8 Piccoli, Ahmad, and Ives, 2001 [36] 16 10 Ruiz, Mintzer, and Leipzig, 2006 [37] 15 3.3 Who were the most frequently cited authors? Table V shows the top 10 highly cited authors between 2003 and 2007. Five of these ten authors work in the United States of America (USA), even though they are originally from other countries. Others work in Canada, Germany, India, the United Kingdom (UK), and the Netherlands. By further examining these authors’ areas of expertise, we discovered that work relating to e-learning quality was integrated into the research trends of the following six disciplines in this period: (1) Information Management; (2) Medicine; (3) Computer Science and Electrical Engineering; (4) Education; (5) Mechanics; and (6) Food and Water Microbiology. TABLE V. THE TOP 10 HIGHLY CITED AUTHORS, 2003-2007 Rank Name, Degree, & Area of Expertise Country of Residence Citation Count 1 Barker, Kathryn Chang, Ph.D. in Educational Administration and Policy, e-learning quality standards and certification; strategies to transform learning systems; future education consulting services Canada 19 1 Schiffman, Susan S., Ph.D. in Education, development of instrumentation and sensors to assess sensory and cognitive functioning in humans USA 19 3 Vapnik, Vladimir N., Ph.D. in Statistics, machine learning algorithms; the support vector machine USA 17 4 Khoshgoftaar, Taghi M., Ph.D. in Computer & Electrical Engineering and Computer Science, software engineering; data mining and machine learning; computational intelligence; USA 16 computer security & instruction detection systems 5 Stevenson, Richard J., M.D. in Pediatric and General Surgery (USA/internal medicine; pediatrics) USA 15 5 Streufert, Siegfried, Ph.D. in Experimental (Social) Psychology, psychology; management; medicine and pharmacology USA 15 7 Beg, Mirza Mohd Sufyan, Ph.D. in Computer Technology, computer architecture; parallel and distributed computing; high performance data mining; web searching; fuzzy logic and systems; genetic algorithms; question answering systems; natural language processing India 14 8 Blum, Jochen, Ph.D. in Neurosurgery, biomechanics; intramedullary rod or nail; trauma surgery and orthopedics Germany 13 8 Meyer, Jan H.F., Ph.D. in Education, threshold concept; student learning; approaches to teaching inventory UK 13 8 Mossel, David Alexander Antonius, Ph.D. in Food and Water Microbiology, microbiology of foods The Netherlands 13 Table VI presents the top 10 highly cited authors from 2008 to 2012. In this group, eight scholars are based in the USA and two are in Taiwan. These authors have conducted research on e-learning quality primarily in five disciplines: (1) Information Systems and Management; (2) Medical Informatics; (3) Psychology; (4) Marketing; and (5) Economics. TABLE VI. LIST OF THE TOP 10 HIGHLY CITED AUTHORS, 2008-2012 Rank Name, Degree, & Area of Expertise Country of Residence Citation Count 1 Cohen, Jacob, Ph.D. in Clinical Psychology, statistical analysis in the behavioral sciences; psychology USA 46 1 Davis, Fred D., Ph.D. in Management, user acceptance of information technology; computer training and skill acquisition; computer-assisted decision making; managing emerging technologies USA 46 3 Venkatesh, Viswanath, Ph.D. in Information Systems, diffusion of technologies in organizations and society; management information science; organizational behavior and human decision; medical informatics; human-computer studies USA 45 4 DeLone, William H., Ph.D. in Computers and Information Systems, computers and information systems USA 40 5 Wang, Yi-Shun (王怡舜), Ph.D. in Information Management, information technology and organizations; e- learning; electronic commerce; customer relationship management; system dynamics Taiwan 39 6 Cook, David A., M.D. in Medical Education, USA/educational technologies; clinical decision making; assessment methods USA 36 7 Stefano, George B., Ph.D. in Neuroscience, neuroscience; medical science; biological sciences USA 32 8 Fornell, Claes G., Ph.D. in Economics, customer satisfaction measurement and customer asset management USA 31
  • 4. 9 Parasuraman, A., D.B.A. in Marketing, services marketing; service quality measurement and improvement; technology’s role in marketing and serving customers USA 29 10 Liaw, Shu-Sheng (廖述盛), Ed.D. in Technology Education, e-learning; medical informatics Taiwan 26 4. Discussion Three of the top 10 highly cited journals from 2003 to 2012 are from the SSCI database, with the other seven from the SCI database. E-learning quality research seems to develop richly in the SCI disciplines, including Medicine, General & Internal (JAMA, BMJ, and NEJM); Education, Scientific Disciplines (AM and ME); Multidisciplinary Sciences (SINE and NATE); and Health Care Sciences & Services (ME). Seven publishers come from the USA and three from the UK. SCI journals have a higher IF than those in SSCI. Except for AM and ME, which have IFs of around 3, the other SCI journals have IFs between 14 and 50. In contrast, all three SSCI journals have an IF between 1 and 4. Five of seven SCI journals were ranked in the top 3 in their respective subject categories by JCR, while two of SSCI journals were ranked within top 7. As can be seen from Table III and Table IV, the authors with highly cited works in the first five years of the decade under study do not overlap with those of the latter five years. This suggests that the field of e-learning quality has a rapid turnover in author citation. From 2003 to 2007, Vladimir Vapnik and Etienne Wenger were the only two authors with more than one work included in the list of the top 10 highly cited references. From 2008 to 2012, William DeLone and Ephraim McLean co-authored two journal articles, and Fred Davis also wrote two that were in the top 10 highly cited references. Citation counts of the works were not affected by the year in which the work was published. Nine works published in the 1990s were still being highly cited in the former five year period, whereas four works published in the 1980s were in the latter five year period. The works included in Tables III and IV provide researchers of e-learning quality studies with helpful guidance in starting a literature review of how the field has evolved over the past decade. The increase in citations more recently suggests that interest in e-learning research is growing. Highly ranked citations are frequently considered field-defining titles, and become important pointers for how the field develops. Table IV also shows that the field has matured to the point of tackling the issues of acceptance, satisfaction, effectiveness, and success of e-learning. This evidence verifies the significance of our present research focus on quality in e-learning. A comparison of Tables III and IV reveals two patterns between the two five year periods. First, way in which the highly cited works crossed different disciplines in these two periods varied notably. Second, the most frequently cited publications in the first five years had fewer citations than those in the second five years. There is a geographic distinction between the influential authors in the first period and those in the second. In the first, there are four non-Northern American scholars (from India, Germany, the UK, and the Netherlands), whereas in the second there are only two who are not based in North America. American scholars thus increasingly dominated the research directions in this field, but Taiwanese scholars’ research efforts are gaining attention and recognition. Two major disciplines—Information Systems and Management and Medicine—retained the dominant influence in this field during the past decade. Nonetheless, disciplines such as Psychology, Marketing, and Economics have more recently gained some prominence in this field. 5. Conclusion This study has demonstrated that research on e-learning quality is expanding and gaining greater recognition in the interdisciplinary literature besides education. Computers & Education was the most cited journal from 2003 to 2012. Mitchell’s [18] and Vapnik’s [19] works were the most frequently cited references 2003-2007, while Fornell and Larcker’s [28] was 2008-2012. Barker and Schiffman were the most cited authors 2003-2007, while Cohen and Davis rose to the top during the second period. Shifts in the rankings of the most influential journals, works, and authors from the first to the second five years indicate that various topics within the field of e-learning quality develop rapidly and from diverse fields. The highly ranked authors’ professional fields encompassed education, statistics, computer and technology science, medicine, neuroscience, psychology, microbiology, information management, economics, and marketing. Although e-learning quality as a researchable topic has been described in many divergent disciplines to capture its multidimensionality, this study has documented the more recent move towards the disciplines of Psychology, Marketing, and Economics. In this article, we have shown the emergence of e-learning quality as a field of research, using citation count rankings to map the relevant research trends. This paper contributes the research trends that define the foci, topics, and historic value of e-learning quality research. These highly cited journals, works, and scholars have not just the greatest impact on the evolution of e-learning quality studies, but also collectively define the boundary of this field. The works and authors listed here may usefully guide researchers as documented classic texts and experts in the field. 6. References [1]Elsabé Cloete. “Electronic Education System Model”; Computers & Education, Vol. 36, Issue 2, 171-182, 2001. [2]Maggie McPherson. “Developing Innovation in E-Learning: Lessons to Be Learned”; British Journal of Educational Technology, Vol. 36, No. 4, 585-586, July 2005. [3]Tak-Wai Chan, Chin-Wei Hue, Chih-Yueh Chou, and Ovid J.L. Tzeng. “Four Spaces of Network Learning Models”; Computers & Education, Vol. 37, Issue 2, 141-161, Sep 2001. [4]Ambjörn Naeve, Miltiadis Lytras, Wolfgang Nejdl, Nicolas balacheff, and Joseph Hardin. “Advances of the Semantic Web for
  • 5. E-Learning: Expanding Learning Frontiers”; British Journal of Educational Technology, Vol. 37, No. 3, 321-330, May 2006. [5]E.S.I. Ossiannilsson. “Quality Enhancement on E-Learning”; Campus-Wide Information Systems, Vol. 29, Issue 4, 312-323, 2012. [6]Javier Sarsa, and Rebeca Soler. “E-Learning Quality: Relations and Perceptions”; International Journal of Information and Communication Technology Education, Vol. 8, Issue 2, 46-60, April 2012. [7]Meilun Shih, Jui Feng, and Chin-Chung Tsai. “Research and Trends in the Field of E-Learning from 2001 to 2005: A Content Analysis of Cognitive Studies in Selected Journls”; Computers & Education, Vol. 51, Issue 2, 955-967, Sep 2008. [8]Sean Eom. “Author Cocitation Analysis: Quantitative Methods for Mapping the Intellectual Structure of an Academic Discipline.” Information Science Reference, 2009. [9]Henk F. Moed. “Citation Analysis in Research Evaluation.” Springer, 2005. [10] Eugene Garfield. “Citation Indexing—Its Theory and Application in Science, Techonology, and Humanities.” John Wiley & Sons, 1979. [11] ISI (Institute for Scientific Information) Web of Knowledge, Thomson Reuters. “2011 JCR (Journal Citation Reports) Science Edition.” Accessed March 1, 2013. http://admin- apps.webofknowledge.com/JCR/JCR?RQ= HOME. [12] ISI Web of Knowledge, Thomson Reuters. “2011 JCR (Journal Citation Reports) Social Science Edition.” Accessed March 1, 2013. http://admin-apps.webofknowledge.com/JCR/JCR?RQ= HOME. [13] Thomson Reuters. “Science Citation Index.” Accessed March 2, 2013. http://thomsonreuters.com/ products_services/science/science_products/a- z/science_citation_index/. [14] Thomson Reuters. “Social Science Citation Index.” Accessed March 2, 2013. http://thomsonreuters.com/ products_services/science/science_products/a- z/social_sciences_citation_index/. [15] Thomson Reuters. “Web of Knowledge Factsheet.” Accessed March 2, 2013. http://thomsonreuters.com/content/science/pdf/Web_of_Knowledge _factsheet.pdf. [16] Thomson Reuters. “Web of Knowledge: All Databases.” Accessed March 3, 2013. http://apps.webofknowledge.com/WOS_GeneralSearch_input.do?pr oduct=WOS&search_mode=GeneralSearch&SID=IE@PIFHeicGEN abj9bH&preferenceSaved=&highlighted_tab=WOS. [17] Thomson Reuters. “The Thomson Reuters Impact Factor.” Accessed March 7, 2013. http://thomsonreuters.com/ products_services/science/free/essays/impact_factor/. [18] Tom M. Mitchell. “Machine Learning.” McGraw-Hill, 1997. [19] Vladimir N. Vapnik. “The Nature of Statistical Learning Theory.” Springer, 1995. [20] Christopher M. Bishop. “Neural Networks for Pattern Recognition.” Oxford University Press, 1995. [21] Jean Lave and Etienne Wenger. “Situated Learning: Legitimate Peripheral Participation.” Cambridge University Press, 1991. [22] J. Ross. Quinlan. “C4.5: Programs for Machine Learning.” Morgan Kaufmann, 1993. [23] Etienne Wenger. “Communities of Practice: Learning, Meaning, and Identity.” Cambridge University Press, 1998. [24] Richard O. Duda, Peter E. Hart, and David G. Stork. “Pattern Classification.” Wiley, 2000. [25] Vladimir N. Vapnik. “Statistical Learning Theory.” Wiley, 1998. [26] John Seely Brown, Allan Collins, and Paul Duguid. “Situated Cognition and the Culture of Learning”; Educational Resarcher, Vol. 18, Issue 1, 32-42, Jan 1989. [27] Dave Davis, Mary Ann Thomoson O’Brien, Nick Freemantle, Fredric M. Wolf, Paul Mazmanian, and Anne Taylor- Vaisey. “Impact of Formal Continuing Medical Education: Do Conferences, Workshops, Rounds, and Other Traditional Continuing Education Activities Change Physician Behavior or Health Care Outcomes?”; JAMA: The Journal of the American Medical Association, Vol. 282, Issue 9, 867-874, Sept 1999. [28] Claes Fornell, and David F. Larcker. “Evaluating Structural Equation Models with Unobservable Variables and Measurement Error”; Journal of Marketing Research, Vol. 18, Issue 1, 39-50, Feb 1981. [29] William H. DeLone, and Ephraim R. McLean. “The DeLone and McLean Model of Information Systems Success: A Ten-Year Update”; Journal of Management Information Systems, Vol. 19, Issue 4, 9-30, April 2003. [30] Yi-Shun Wang. “Assessment of Learner Satisfaction with Asynchronous Electronic Learning Systems”; Information & Management, Vol. 41, Issue 1, 75-86, 2003. [31] Jacob Cohen. “Statistical Power Analysis for the Behavioral Sciences. 2nd ed.” Erlbaum Associates, 1988. [32] Fred D. Davis, Richard P. Bagozzi, and Paul R. Warshaw. “User Acceptance of Computer Technology: A Comparison of Two Theoretical Models”; Management Science, Vol. 35, No. 8, 982- 1003, Aug 1989. [33] Fred D. Davis. “Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology”; MIS Quarterly, Vol. 13, No. 3, 319-340, Sep 1989. [34] Pei-Chen Sun, Ray J. Tsai, Glenn Finger, Yueh-Yang Chen, and Dowming Yeh. “What Drives a Successful E-Learning? An Empirical Investigation of the Critical Factors Influencing Learner Satisfaction”; Vol. 50, Issue 4, 1183-1202, May 2008. [35] William H. DeLone, and Ephraim R. McLean. “Information Systems Success: The Quest for the Dependent Variable”; Information Systems Research, Vol 3, Issue 1, 60-95, Mar 1992. [36] Gabriele Piccoli, Rami Ahmad, and Blake Ives. “Web- Based Virtual Learning Environments: A Research Framework and A Preliminary Assessment of Effectiveness in Basic IT Skills Training”; MIS Quarterly, Vol. 25, No. 4, 401-426, Dec 2001. [37] Jorge G. Ruiz, Michael J. Mintzer, and Rosanne M. Leipzig. “The Impact of E-Learning in Medical Education”; Academic Medicine: Journal of the Association of American Medical Colleges, Vol. 81, Issue 3, 207-212, Mar 2006.