Interrater / Intercoder Reliability
(Contains 20 resources)
-
Interrater Agreement
Found in: The SAGE Encyclopedia of Social Science Research Methods
Edited by:, &Content Type: encyclopedias
Publisher: Sage Publications, Inc. (2004)
This unique multi-volume reference set offers readers an all-encompassing education in the ways of social science researchers. Written to be accessible to general readers, entries do not require any advanced knowledge or experience to understand the purposes and basic principles of any of the methods. The Encyclopedia features two major types of entries: definitions, consisting of a paragraph or two, which provide a quick explanation of a methodological term; and topical treatments or essays, discussing the nature, history, application/example and implication of using a certain method. Also included are suggested readings and references for future study. To help provide a more complete explanation than is often achieved within the scope of a single article, key terms and concepts appear in small capital letters to refer readers to related terms explained elsewhere. In addition to epistemological issues that influence the nature of research questions and assumptions, The SAGE Encyclopedia of Social Science Research Methods tackles topics not normally viewed as part of social science research methodology, from philosophical issues such as poststructuralism to advanced statistical techniques.
-
Interrater Reliability
Found in: Encyclopedia of Measurement and Statistics
Edited by:Content Type: encyclopedias
Publisher: Sage Publications, Inc. (2007)
SAGE Reference is proud to announce the Encyclopedia of Measurements and Statistics. In fields as varying as education, politics and health care, assessment and the use of measurement and statistics have become an integral part of almost every activity undertaken. These activities require the organization of ideas, the generation of hypotheses, the collection of data and the interpretation, illustration and analysis of data. No matter where we look, this critical analysis is more important than ever in an age where information - and lots of it - is readily available. The average consumer must know what a `median' is or what the connotations of the term `significant' are when intelligently reading The Times, Science News or a tabloid. Likewise, students, practitioners and researchers must grapple with sophisticated terms and techniques when conducting research, writing proposals and analyzing data. The terms themselves have proven to be anxiety-provoking. The Encyclopedia of Measurement and Statistics, in two-volumes, presents state-of-the-art information and ready-to-use facts from the fields of measurement and statistics in a non-intimidating and accessible style. The Encyclopedia is specifically written to appeal to undergraduate students as well as practitioners, researchers and consumers of information. Whilst there are reference works covering statistics and assessment in depth, none provide as comprehensive a resource in as focused and approachable a manner as this encyclopedia. Key themes include: - biographies; - charts, graphs and visual displays; - computer topics and tools; - concepts and issues in measurement; - concepts and issues in statistics; - data and data reduction techniques; - descriptive statistics; - evaluation; - experimental methods; - inferential statistics; - organizations and publications; - predictions and estimations; - probability; - qualitative methods; - samples, sampling and distribution; - statistical techniques; - statistical tests; - tests by name. Key features include: - coverage of every major facet of these two different, but highly integrated disciplines with reference to mean, mode and median; reliability, validity, significance and correlation without overwhelming the informed reader; - cross-disciplinary coverage, with contributions from and applications to the fields of: psychology; education; sociology; human development; political science; business and management; and public health; - cross-referenced terms, a list of further readings and Website URLs after each entry, as well as an extensive set of appendices and an annotated list of organizations relevant to measurement and statistics. Appendices: - Appendix A is a guide to basic statistics for those readers who require an instructional step-by-step presentation of basic concepts in statistics and measurement; - Appendix B is a table of critical values used in hypothesis testing and an important part of any reference in this area; - Appendix C represents a collection of some most important and useful measurement and statistics Websites.
-
Interrater Reliability
Found in: Encyclopedia of Research Design
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc. (2010)
Research design can be daunting for all types of researchers. At its heart it might be described as a formalized approach toward problem solving, thinking, and acquiring knowledge—the success of which depends upon clearly defined objectives and appropriate choice of statistical tools, tests, and analysis to meet a project's objectives.
Comprising more than 500 entries, the Encyclopedia of Research Design explains how to make decisions about research design, undertake research projects in an ethical manner, interpret and draw valid inferences from data, and evaluate experiment design strategies and results. Two additional features carry this encyclopedia far above other works in the field: bibliographic entries devoted to significant articles in the history of research design and reviews of contemporary tools, such as software and statistical procedures, used to analyze results.
Key Features
Covers the spectrum of research design strategies, from material presented in introductory classes to topics necessary in graduate research; Addresses cross- and multidisciplinary research needs, with many examples drawn from the social and behavioral sciences, neurosciences, and biomedical and life sciences; Provides summaries of advantages and disadvantages of often-used strategies; Uses hundreds of sample tables, figures, and equations based on real-life cases
Key Themes
Descriptive Statistics; Distributions; Graphical Displays of Data; Hypothesis Testing; Important Publications; Inferential Statistics; Item Response Theory; Mathematical Concepts; Measurement Concepts; Organizations; Publishing; Qualitative Research; Reliability of Scores; Research Design Concepts; Research Designs; Research Ethics; Research Process; Research Validity Issues; Sampling; Scaling; Software Applications; Statistical Assumptions; Statistical Concepts; Statistical Procedures; Statistical Tests; Theories, Laws, and Principles; Types of Variables; Validity of Scores
The Encyclopedia of Research Design is the perfect instrument for new learners as well as experienced researchers to explore both the original and newest branches of the field.
-
Intercoder Reliability
Found in: Encyclopedia of Survey Research Methods
Edited by:Content Type: encyclopedias
Publisher: Sage Publications, Inc. (2008)
To the uninformed, surveys appear to be an easy type of research to design and conduct, but when students and professionals delve deeper, they encounter the vast complexities that the range and practice of survey methods present. To complicate matters, technology has rapidly affected the way surveys can be conducted; today, surveys are conducted via cell phone, the Internet, email, interactive voice response, and other technology-based modes. Thus, students, researchers, and professionals need both a comprehensive understanding of these complexities and a revised set of tools to meet the challenges. In conjunction with top survey researchers around the world and with Nielsen Media Research serving as the corporate sponsor, the Encyclopedia of Survey Research Methods presents state-of-the-art information and methodological examples from the field of survey research. Although there are other 'how-to' guides and references texts on survey research, none are as comprehensive as this encyclopedia, nor do they present the material in such a focused and approachable manner. With more than 600 entries, this resource uses a Total Survey Error perspective which considers all aspects of possible survey error from a cost//benefit standpoint. Key Features Covers all major facets of survey research methodology, from selecting the sample design and the sampling frame, designing and pretesting the questionnaire, data collection, and data coding, to the thorny issues surrounding diminishing response rates, confidentiality, privacy, informed consent and other ethical issues, data weighting, and data analyses Presents a Reader s Guide to organize entries around themes or specific topics and easily guide users to areas of interest Offers cross-referenced terms, brief listing of further readings, and stable website URLs following most entries Provides appendices that include a general bibliography to build on 'Further Readings,' an annotated list of organizations relevant to survey research, and sample survey designs and actual instruments to further offer the user guidance in designing his or her own research The Encyclopedia of Survey Research Methods is specifically written to appeal to beginning, intermediate, and advanced students, practitioners, researchers, consultants, and consumers of survey-based information.
-
Best Practices in Interrater Reliability Three Common Approaches
Found in: Best Practices in Quantitative Methods
Edited by:Content Type: books
Publisher: SAGE Publications, Inc. (2008)
The contributors to Best Practices in Quantitative Methods envision quantitative methods in the 21st century, identify the best practices, and, where possible, demonstrate the superiority of their recommendations empirically. Editor Jason W. Osborne designed this book with the goal of providing readers with the most effective, evidence-based, modern quantitative methods and quantitative data analysis across the social and behavioral sciences. The text is divided into five main sections covering select best practices in Measurement, Research Design, Basics of Data Analysis, Quantitative Methods, and Advanced Quantitative Methods. Each chapter contains a current and expansive review of the literature, a case for best practices in terms of method, outcomes, inferences, etc., and broad-ranging examples along with any empirical evidence to show why certain techniques are better. Key Features: Describes important implicit knowledge to readers: The chapters in this volume explain the important details of seemingly mundane aspects of quantitative research, making them accessible to readers and demonstrating why it is important to pay attention to these details. Compares and contrasts analytic techniques: The book examines instances where there are multiple options for doing things, and make recommendations as to what is the “best” choice-or choices, as what is best often depends on the circumstances. Offers new procedures to update and explicate traditional techniques: The featured scholars present and explain new options for data analysis, discussing the advantages and disadvantages of the new procedures in depth, describing how to perform them, and demonstrating their use.
-
Building the Plane in Flight: Establishing Post Hoc Inter-Rater Reliability Coefficients in an Educational Context
By: &Content Type: cases
Publisher: SAGE Publications Ltd (2017)
The work presented in this case study results from a study conducted in 2012-2014 examining a newly created teacher evaluation system to determine the inter-rater reliability of the classroom observation instrument. The teacher evaluation system was the result of a partnership between the school district and the university in the same city designed to improve district operation, teacher quality, and student performance through various avenues of research and development. It was through this partnership that we gained entrée into the district to complete the research presented here. The system-wide professor-in-residence developed the teacher evaluation system and its various tools. The teacher evaluation system was field-tested, and the instruments, including the classroom observation instrument, went through content validity; however, this study was the first to assess the instrument’s reliability. The study included 41 principals and assistant principals who were asked to complete ratings on four videotaped classroom lessons from teachers within the district. Four videos were chosen based on several criteria, including subject matter, grade level, and teacher quality level. The data gathered enabled an assessment of inter-rater reliability and also enabled the investigation into various calculation methods to determine inter-rater reliability and their effectiveness in an educational context. This case study outlines one method to deal with what is a common occurrence in educational research; namely, investigating the effectiveness of an instrument after the instrument is in use. The challenges in designing studies post hoc are highlighted and various aspects of conducting research with educational leaders are discussed.
-
Intercoder Reliability
Found in: The SAGE Encyclopedia of Communication Research Methods
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc (2017)
Communication research is evolving and changing in a world of online journals, open-access, and new ways of obtaining data and conducting experiments via the Internet. Although there are generic encyclopedias describing basic social science research methodologies in general, until now there has been no comprehensive A-to-Z reference work exploring methods specific to communication and media studies. Our entries, authored by key figures in the field, focus on special considerations when applied specifically to communication research, accompanied by engaging examples from the literature of communication, journalism, and media studies. Entries cover every step of the research process, from the creative development of research topics and questions to literature reviews, selection of best methods (whether quantitative, qualitative, or mixed) for analyzing research results and publishing research findings, whether in traditional media or via new media outlets. In addition to expected entries covering the basics of theories and methods traditionally used in communication research, other entries discuss important trends influencing the future of that research, including contemporary practical issues students will face in communication professions, the influences of globalization on research, use of new recording technologies in fieldwork, and the challenges and opportunities related to studying online multi-media environments. Email, texting, cellphone video, and blogging are shown not only as topics of research but also as means of collecting and analyzing data. Still other entries delve into considerations of accountability, copyright, confidentiality, data ownership and security, privacy, and other aspects of conducting an ethical research program. Features: • 652 signed entries are contained in an authoritative work spanning four volumes available in choice of electronic or print formats. • Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of communication research to more easily locate directly related entries. • Back matter includes a Chronology of the development of the field of communication research; a Resource Guide to classic books, journals, and associations; a Glossary introducing the terminology of the field; and a detailed Index. • Entries conclude with References/Further Readings and Cross-References to related entries to guide students further in their research journeys. • The Index, Reader’s Guide themes, and Cross-References combine to provide robust search-and-browse in the e-version.
-
Intercoder Reliability Coefficients, Comparison of
Found in: The SAGE Encyclopedia of Communication Research Methods
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc (2017)
Communication research is evolving and changing in a world of online journals, open-access, and new ways of obtaining data and conducting experiments via the Internet. Although there are generic encyclopedias describing basic social science research methodologies in general, until now there has been no comprehensive A-to-Z reference work exploring methods specific to communication and media studies. Our entries, authored by key figures in the field, focus on special considerations when applied specifically to communication research, accompanied by engaging examples from the literature of communication, journalism, and media studies. Entries cover every step of the research process, from the creative development of research topics and questions to literature reviews, selection of best methods (whether quantitative, qualitative, or mixed) for analyzing research results and publishing research findings, whether in traditional media or via new media outlets. In addition to expected entries covering the basics of theories and methods traditionally used in communication research, other entries discuss important trends influencing the future of that research, including contemporary practical issues students will face in communication professions, the influences of globalization on research, use of new recording technologies in fieldwork, and the challenges and opportunities related to studying online multi-media environments. Email, texting, cellphone video, and blogging are shown not only as topics of research but also as means of collecting and analyzing data. Still other entries delve into considerations of accountability, copyright, confidentiality, data ownership and security, privacy, and other aspects of conducting an ethical research program. Features: • 652 signed entries are contained in an authoritative work spanning four volumes available in choice of electronic or print formats. • Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of communication research to more easily locate directly related entries. • Back matter includes a Chronology of the development of the field of communication research; a Resource Guide to classic books, journals, and associations; a Glossary introducing the terminology of the field; and a detailed Index. • Entries conclude with References/Further Readings and Cross-References to related entries to guide students further in their research journeys. • The Index, Reader’s Guide themes, and Cross-References combine to provide robust search-and-browse in the e-version.
-
Intercoder Reliability Standards: Stability
Found in: The SAGE Encyclopedia of Communication Research Methods
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc (2017)
Communication research is evolving and changing in a world of online journals, open-access, and new ways of obtaining data and conducting experiments via the Internet. Although there are generic encyclopedias describing basic social science research methodologies in general, until now there has been no comprehensive A-to-Z reference work exploring methods specific to communication and media studies. Our entries, authored by key figures in the field, focus on special considerations when applied specifically to communication research, accompanied by engaging examples from the literature of communication, journalism, and media studies. Entries cover every step of the research process, from the creative development of research topics and questions to literature reviews, selection of best methods (whether quantitative, qualitative, or mixed) for analyzing research results and publishing research findings, whether in traditional media or via new media outlets. In addition to expected entries covering the basics of theories and methods traditionally used in communication research, other entries discuss important trends influencing the future of that research, including contemporary practical issues students will face in communication professions, the influences of globalization on research, use of new recording technologies in fieldwork, and the challenges and opportunities related to studying online multi-media environments. Email, texting, cellphone video, and blogging are shown not only as topics of research but also as means of collecting and analyzing data. Still other entries delve into considerations of accountability, copyright, confidentiality, data ownership and security, privacy, and other aspects of conducting an ethical research program. Features: • 652 signed entries are contained in an authoritative work spanning four volumes available in choice of electronic or print formats. • Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of communication research to more easily locate directly related entries. • Back matter includes a Chronology of the development of the field of communication research; a Resource Guide to classic books, journals, and associations; a Glossary introducing the terminology of the field; and a detailed Index. • Entries conclude with References/Further Readings and Cross-References to related entries to guide students further in their research journeys. • The Index, Reader’s Guide themes, and Cross-References combine to provide robust search-and-browse in the e-version.
-
Intercoder Reliability Techniques: Cohen’s Kappa
Found in: The SAGE Encyclopedia of Communication Research Methods
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc (2017)
Communication research is evolving and changing in a world of online journals, open-access, and new ways of obtaining data and conducting experiments via the Internet. Although there are generic encyclopedias describing basic social science research methodologies in general, until now there has been no comprehensive A-to-Z reference work exploring methods specific to communication and media studies. Our entries, authored by key figures in the field, focus on special considerations when applied specifically to communication research, accompanied by engaging examples from the literature of communication, journalism, and media studies. Entries cover every step of the research process, from the creative development of research topics and questions to literature reviews, selection of best methods (whether quantitative, qualitative, or mixed) for analyzing research results and publishing research findings, whether in traditional media or via new media outlets. In addition to expected entries covering the basics of theories and methods traditionally used in communication research, other entries discuss important trends influencing the future of that research, including contemporary practical issues students will face in communication professions, the influences of globalization on research, use of new recording technologies in fieldwork, and the challenges and opportunities related to studying online multi-media environments. Email, texting, cellphone video, and blogging are shown not only as topics of research but also as means of collecting and analyzing data. Still other entries delve into considerations of accountability, copyright, confidentiality, data ownership and security, privacy, and other aspects of conducting an ethical research program. Features: • 652 signed entries are contained in an authoritative work spanning four volumes available in choice of electronic or print formats. • Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of communication research to more easily locate directly related entries. • Back matter includes a Chronology of the development of the field of communication research; a Resource Guide to classic books, journals, and associations; a Glossary introducing the terminology of the field; and a detailed Index. • Entries conclude with References/Further Readings and Cross-References to related entries to guide students further in their research journeys. • The Index, Reader’s Guide themes, and Cross-References combine to provide robust search-and-browse in the e-version.
-
Intercoder Reliability Techniques: Fleiss System
Found in: The SAGE Encyclopedia of Communication Research Methods
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc (2017)
Communication research is evolving and changing in a world of online journals, open-access, and new ways of obtaining data and conducting experiments via the Internet. Although there are generic encyclopedias describing basic social science research methodologies in general, until now there has been no comprehensive A-to-Z reference work exploring methods specific to communication and media studies. Our entries, authored by key figures in the field, focus on special considerations when applied specifically to communication research, accompanied by engaging examples from the literature of communication, journalism, and media studies. Entries cover every step of the research process, from the creative development of research topics and questions to literature reviews, selection of best methods (whether quantitative, qualitative, or mixed) for analyzing research results and publishing research findings, whether in traditional media or via new media outlets. In addition to expected entries covering the basics of theories and methods traditionally used in communication research, other entries discuss important trends influencing the future of that research, including contemporary practical issues students will face in communication professions, the influences of globalization on research, use of new recording technologies in fieldwork, and the challenges and opportunities related to studying online multi-media environments. Email, texting, cellphone video, and blogging are shown not only as topics of research but also as means of collecting and analyzing data. Still other entries delve into considerations of accountability, copyright, confidentiality, data ownership and security, privacy, and other aspects of conducting an ethical research program. Features: • 652 signed entries are contained in an authoritative work spanning four volumes available in choice of electronic or print formats. • Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of communication research to more easily locate directly related entries. • Back matter includes a Chronology of the development of the field of communication research; a Resource Guide to classic books, journals, and associations; a Glossary introducing the terminology of the field; and a detailed Index. • Entries conclude with References/Further Readings and Cross-References to related entries to guide students further in their research journeys. • The Index, Reader’s Guide themes, and Cross-References combine to provide robust search-and-browse in the e-version.
-
Intercoder Reliability Techniques: Holsti Method
Found in: The SAGE Encyclopedia of Communication Research Methods
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc (2017)
Communication research is evolving and changing in a world of online journals, open-access, and new ways of obtaining data and conducting experiments via the Internet. Although there are generic encyclopedias describing basic social science research methodologies in general, until now there has been no comprehensive A-to-Z reference work exploring methods specific to communication and media studies. Our entries, authored by key figures in the field, focus on special considerations when applied specifically to communication research, accompanied by engaging examples from the literature of communication, journalism, and media studies. Entries cover every step of the research process, from the creative development of research topics and questions to literature reviews, selection of best methods (whether quantitative, qualitative, or mixed) for analyzing research results and publishing research findings, whether in traditional media or via new media outlets. In addition to expected entries covering the basics of theories and methods traditionally used in communication research, other entries discuss important trends influencing the future of that research, including contemporary practical issues students will face in communication professions, the influences of globalization on research, use of new recording technologies in fieldwork, and the challenges and opportunities related to studying online multi-media environments. Email, texting, cellphone video, and blogging are shown not only as topics of research but also as means of collecting and analyzing data. Still other entries delve into considerations of accountability, copyright, confidentiality, data ownership and security, privacy, and other aspects of conducting an ethical research program. Features: • 652 signed entries are contained in an authoritative work spanning four volumes available in choice of electronic or print formats. • Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of communication research to more easily locate directly related entries. • Back matter includes a Chronology of the development of the field of communication research; a Resource Guide to classic books, journals, and associations; a Glossary introducing the terminology of the field; and a detailed Index. • Entries conclude with References/Further Readings and Cross-References to related entries to guide students further in their research journeys. • The Index, Reader’s Guide themes, and Cross-References combine to provide robust search-and-browse in the e-version.
-
Intercoder Reliability Techniques: Percent Agreement
Found in: The SAGE Encyclopedia of Communication Research Methods
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc (2017)
Communication research is evolving and changing in a world of online journals, open-access, and new ways of obtaining data and conducting experiments via the Internet. Although there are generic encyclopedias describing basic social science research methodologies in general, until now there has been no comprehensive A-to-Z reference work exploring methods specific to communication and media studies. Our entries, authored by key figures in the field, focus on special considerations when applied specifically to communication research, accompanied by engaging examples from the literature of communication, journalism, and media studies. Entries cover every step of the research process, from the creative development of research topics and questions to literature reviews, selection of best methods (whether quantitative, qualitative, or mixed) for analyzing research results and publishing research findings, whether in traditional media or via new media outlets. In addition to expected entries covering the basics of theories and methods traditionally used in communication research, other entries discuss important trends influencing the future of that research, including contemporary practical issues students will face in communication professions, the influences of globalization on research, use of new recording technologies in fieldwork, and the challenges and opportunities related to studying online multi-media environments. Email, texting, cellphone video, and blogging are shown not only as topics of research but also as means of collecting and analyzing data. Still other entries delve into considerations of accountability, copyright, confidentiality, data ownership and security, privacy, and other aspects of conducting an ethical research program. Features: • 652 signed entries are contained in an authoritative work spanning four volumes available in choice of electronic or print formats. • Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of communication research to more easily locate directly related entries. • Back matter includes a Chronology of the development of the field of communication research; a Resource Guide to classic books, journals, and associations; a Glossary introducing the terminology of the field; and a detailed Index. • Entries conclude with References/Further Readings and Cross-References to related entries to guide students further in their research journeys. • The Index, Reader’s Guide themes, and Cross-References combine to provide robust search-and-browse in the e-version.
-
Intercoder Reliability Techniques: Scott’s Pi
Found in: The SAGE Encyclopedia of Communication Research Methods
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc (2017)
Communication research is evolving and changing in a world of online journals, open-access, and new ways of obtaining data and conducting experiments via the Internet. Although there are generic encyclopedias describing basic social science research methodologies in general, until now there has been no comprehensive A-to-Z reference work exploring methods specific to communication and media studies. Our entries, authored by key figures in the field, focus on special considerations when applied specifically to communication research, accompanied by engaging examples from the literature of communication, journalism, and media studies. Entries cover every step of the research process, from the creative development of research topics and questions to literature reviews, selection of best methods (whether quantitative, qualitative, or mixed) for analyzing research results and publishing research findings, whether in traditional media or via new media outlets. In addition to expected entries covering the basics of theories and methods traditionally used in communication research, other entries discuss important trends influencing the future of that research, including contemporary practical issues students will face in communication professions, the influences of globalization on research, use of new recording technologies in fieldwork, and the challenges and opportunities related to studying online multi-media environments. Email, texting, cellphone video, and blogging are shown not only as topics of research but also as means of collecting and analyzing data. Still other entries delve into considerations of accountability, copyright, confidentiality, data ownership and security, privacy, and other aspects of conducting an ethical research program. Features: • 652 signed entries are contained in an authoritative work spanning four volumes available in choice of electronic or print formats. • Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of communication research to more easily locate directly related entries. • Back matter includes a Chronology of the development of the field of communication research; a Resource Guide to classic books, journals, and associations; a Glossary introducing the terminology of the field; and a detailed Index. • Entries conclude with References/Further Readings and Cross-References to related entries to guide students further in their research journeys. • The Index, Reader’s Guide themes, and Cross-References combine to provide robust search-and-browse in the e-version.
-
How Results Can Be Misleading: Problems With Reliability and Validity
Director:Ken Lam
Producer:Ken Lam, Sari SteinbergContent Type: videos
Publisher: SAGE Publications, Inc (2012)
Dr. Evelyn Behar and Dr. Mariann Weierich discuss reliability and validity in research. Reliability refers to the consistency of the variables, and with more reliability, more valid conclusions can be drawn. Behar and Weierich discuss types of reliability and validity, and how problems can affect research.
-
Inter-Rater Reliability
Found in: The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc. (2018)
In an era of curricular changes and experiments and high-stakes testing, educational measurement and evaluation is more important than ever. In addition to expected entries covering the basics of traditional theories and methods, other entries discuss important sociopolitical issues and trends influencing the future of that research and practice. Textbooks, handbooks, monographs and other publications focus on various aspects of educational research, measurement and evaluation, but to date, there exists no major reference guide for students new to the field. This comprehensive work fills that gap, covering traditional areas while pointing the way to future developments. Features: Nearly 700 signed entries are contained in an authoritative work spanning four volumes and available in choice of electronic and/or print formats. Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of education research, measurement, and evaluation to more easily locate directly related entries. (For instance, sample themes include Data, Evaluation, Measurement Concepts & Issues, Research, Sociopolitical Issues, Standards.) Back matter includes a Chronology of the development of the field; a Resource Guide to classic books, journals, and associations; and a detailed Index. Entries conclude with References/Further Readings and Cross References to related entries. The Index, Reader’s Guide themes, and Cross References will combine to provide robust search-and-browse in the e-version.
-
Kappa Coefficient of Agreement
Found in: The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation
Edited by:Content Type: encyclopedias
Publisher: SAGE Publications, Inc. (2018)
In an era of curricular changes and experiments and high-stakes testing, educational measurement and evaluation is more important than ever. In addition to expected entries covering the basics of traditional theories and methods, other entries discuss important sociopolitical issues and trends influencing the future of that research and practice. Textbooks, handbooks, monographs and other publications focus on various aspects of educational research, measurement and evaluation, but to date, there exists no major reference guide for students new to the field. This comprehensive work fills that gap, covering traditional areas while pointing the way to future developments. Features: Nearly 700 signed entries are contained in an authoritative work spanning four volumes and available in choice of electronic and/or print formats. Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of education research, measurement, and evaluation to more easily locate directly related entries. (For instance, sample themes include Data, Evaluation, Measurement Concepts & Issues, Research, Sociopolitical Issues, Standards.) Back matter includes a Chronology of the development of the field; a Resource Guide to classic books, journals, and associations; and a detailed Index. Entries conclude with References/Further Readings and Cross References to related entries. The Index, Reader’s Guide themes, and Cross References will combine to provide robust search-and-browse in the e-version.
-
Evaluating the Presentation of the Construct of “Race” in Medical Education Using an Inter-Rater Reliability Methodology
By:, , , &Content Type: cases
Publisher: SAGE Publications Ltd (2020)
In the United States, it is well documented that there are significant health disparities between Blacks and Whites. There is now an emerging body of research investigating why racial health disparities exist. Empirical evidence of the role of racial bias and racism as drivers of racial disparities in health and health care is growing, including the role of medical education, broadly. To date, there are only a few studies that examine the role, if any, of medical education and medical curricula on the formation of racial bias in medical students. A potential first step in evaluating the role of medical education is to understand how race is presented to and contextualized with medical students. Here, we present the results of a medical student–led analysis of the textual presentation of race, including the context within which it was presented (e.g., biological, social, or neutral), in lecture slides in a public medical school with a majority minoritized student population. In addition, we calculate inter-rater reliability of the rating method, which combined methodologies previously applied in similar analyses. In this report, we describe the implementation of the analysis, focusing on the methodology to assess reliability, as well as the feasibility and acceptability of the method, including obstacles faced in conducting the analysis. Ensuring raters understand the scope and definitions of codes before coding and having institutional allies and collaborators can improve the efficiency of a project. Next steps include applying our methodology to basic science courses and different learning modalities (e.g., podcasts). We hope to develop a more comprehensive and holistic methodology in assessing social constructs in medical education.
-
An Introduction to Content Analysis on Qualitative Data
Content Type: videos
Publisher: SAGE Publications Ltd. (2020)
Qin Sun, Assistant Professor of Marketing at California State University, Northridge, discusses and provides an example of content analysis on qualitative data.
