finding assessments tests and measures
during the life of any research project the day will come when you may need to
find a test or measure. There are literally tens of thousands of published
and unpublished tests and measures. Published tests are commercially
available for purchase, unpublished tests are not commercially available for
purchase. This is a brief guide to understanding the world of tests and
measures also known as psycho metrics. Psycho metrics is the field of study
concerned with the theory and technique of measurement of traits, abilities,
attitudes and knowledge. It deals with a construction of instruments and
procedures for measurement and the development and refinement of
theoretical approaches to measurement. Psycho metrics is applied widely in
educational and psychological assessment. Two key concepts are reliability and
validity. A reliable measure is measuring something consistently, while a valid
measure is measuring what it is supposed to measure. There are three major
categories of reliability for most instruments: test-retest, equivalent form
and internal consistency. There are also three general categories of instrument
validity: face validity, predictive and concurrent validity, and discriminant and
convergent validity. The standards for educational and psychological testing
established by the American Educational Research Association, the American
Psychological Association, and the National Council on Measurement in
Education provide a comprehensive basis for valuing tests. These terms and
standards are part of the evaluative component which we will talk about
shortly. Your first question may be "how do I find a test for my research project?"
The first place to start any search for tests and measures is at your local
library. Not only does the library own numerous print and online resources that
can help you find tests, there are also librarians who can guide you in your
search through these resources. These reference sources provide comprehensive
and useful information on tests. There are two major types of sources that you
will use to find and evaluate the appropriateness of a test or measure. The
first is a test review which describes and evaluates a specific measure.
These are outside reviews written by an expert in the field databases and books
of test reviews such as tests and print mental measurements yearbook. MMY and
test critiques are good places to start depending upon the specific resource.
There are subject indexes, title indexes, and author indexes available to help you
narrow down your search. The second resource is journal articles written by
researchers who have conducted validation studies on a specific test or
have used the specific test in their own study. These are found in journal
databases such as Pubmed, Psycinfo, Cinahl and Eric. You will need to spend some
time determining what kind of test you need. Is it a personality test? behavior
assessment? educational assessment? Who are you assessing? children? adolescents?
adults a cultural or linguistic group? Is it gender specific? The type of test for
the specific population helps determine where you will start. Who publishes the
test? In addition to listings in tests and print the MMY, tests, test critiques
and other resources, the test collection at ETS and pro ed are two of the many
test publishers. ETS offers a free brochure of major US test publishers
which is yours for the time of a phone call. All major publishers have product
catalogues either online or print that you may request for free or for a small
fee. As an individual purchaser of a test, you may be required to fill out a
purchaser qualification form to ensure that you are qualified and competent to
administer and interpret the test. What is a test review? A test review should
cover the seven areas we just discussed. Minimal information includes the authors
of the test, title, and acronym, purpose and publication date. In addition the
review should describe the population either by years of age or distinguishing
characteristics such as gender. It will also provide information on scoring, how
the test is administered, the length of time to administer, and often publisher
and price information. In the comments, the reviewer offers an interpretation of
the test which addresses at least three issues regarding the instrument. The
reviewer provides a description how it was developed
technical information on how it was validated, and the reviewers summary of
the test. At a minimum the review will include a reference to the original
article describing the test and often refer to other validation studies on the
test. Where can I find test reviews? One of the best known is Burroughs Mental
Measurements Yearbook: The MMY. The Burroughs Institute on mental
measurements at the University of nebraska-lincoln has been supporting
advancements in tests practices since 1938. The MMY is available online and in
print at the USF libraries. MMY divides the world of tests and measures into 18
test categories. In the MMY, tests are alphabetical by title. There are seven
indexes that arrange tests by title, print status (either in or out), acronym,
classified subject, publisher, name (the author and reviewer), and score. These are
useful to locate tests about which you have limited information or to access
groups of tests that fit into the same category such as which tests yield the
same score or which tests all measure depression. If you use the MMY online, it
only covers volumes 9 - the current volume which means you are missing out
on 8 other possible places where your test review may reside. Health and
psychosocial instruments (HAPI) provides access to approximately 15,000 tests and
measures in the fields of Health and psychosocial sciences. The database
started indexing tests in 1985. One very valuable feature of HAPI is that you
can limit your search to primary and secondary sources. A primary source is
the original article where the test originally was published or a resource
that contains the full-text of the test. Secondary sources do not include the
entire test. The database includes articles that describe how the test was
used, outcomes and possible sample questions. The database also allows you
to search for translations of a particular test.
The test collection of ETS is a database of more than 25,000 tests and other
measurement devices. There are basic and advanced search options, and you can
select for downloadable tests. After the fee is paid, each record includes author,
title, and acronym, first article published, major and minor descriptors,
abstract, and the security level of the test. That is whether it may be purchased.
The descriptors are based on the thesaurus of Eric descriptors, a
controlled vocabulary which is a carefully selected list of Education
related words and phrases. Since searching by keywords requires
matching the exact words found in a record, searching by descriptors allows
you to locate records indexed by subject regardless of the terminology the author
may have used. The thesaurus is available online with the USF library's databases.
Choose educational resources Information Center, that is Eric, as well as a free
internet resources. The next sources are print resources. Tests and test critiques
published by pro ed tests is a bibliographic encyclopedia containing
information on thousands of testing instruments in psychology, education and
business. It contains concise descriptions of tests, however it does
not contain evaluative critiques or data unreliability, validity, or norms. If you
have the name of the test you can find evaluative criteria and test critiques
in each of the three sections, that is psychology, education, and business. The
tests are arranged alphabetically. Tests also has seven indexes: The test title
index, author index, foreign language availability index, a publisher
distributor index, and three indexes of test suitability for special populations:
the hearing impaired, visually impaired, and physically impaired. Tests also lists
out-of-print tests and has a publishers directory. Test critiques is a companion
to tests and contains psychometric information, that is reliability, validity,
and norm development. Each test entry
includes an introduction, practical applications and uses, and technical
aspects followed by a critique. The introduction describes the test in
detail including authors, publisher, and the purpose of the test. Practical
applications and uses describes the intended population, administration,
scoring, and interpretation procedures. Technical aspects include citations from
reliability and validity studies and opinions from experts regarding the
technical adequacy of the test. Each volume contains a table of contents with
tests listed alphabetically. Each volume also contains cumulative indexes
organized by test title, tests publisher, tests author and reviewer, and subject.
There are numerous standalone books that also carry test and measurement
information.Find them in the USF library's catalog. Secondary sources such
as journal databases are also a good place to search. We recommend Psycinfo,
PubMed, Cinahl, and ERIC. Here are quick tips to ensure you pull up studies
addressing the psychometric quality of a test. Limit searches in Psycinfo using
the classification codes. Psycinfo has a predetermined limit option entitled
"tests and testing" which is 2220 in the classification codes in Pubmed. Use your
subject term and combine it with questionnaires and psycho metrics or
reproducibility of results or validation studies. Search Cinahl: the cumulative
index to nursing and allied health two ways. Select the field instrumentation
from the drop down box and search either by topic or name of tests. Also search by
topic and limit publication type to research instrument or questionnaire /
scale. To search in ERIC, select tests from the publication type limits and add
a keyword or subject. Now you have test reviews and articles on how the test was
used in studies similar to your own proposed research project. Next is the
hard part: evaluating the test. Well, how do I assess
journal articles about my test or measure? In addition to rereading test
reviews you will also be reading articles written to assess the validity
and reliability of tests as well as articles or other studies that used a
test in which you are interested. The standards mentioned earlier provide a
comprehensive basis for evaluating tests. Here are the seven areas that should be
part of any evaluation of a test or measure: Test coverage and usage. That
includes intended uses of the test scores, appropriate score interpretations,
limitations or restrictions of the interpretations, test population and
content coverage decisions, development of the item, and selection criteria. Two:
appropriate sample for test validity evidence. This includes considerations of
sampling method, size of sample and subgroups, basis for validity and for
norming, sufficient variation to distinguish participants. For example,
those with and without symptoms, and representativeness of the sample: For
example, age, geographic distribution, cultural background, and disabilities.
Three: validity. This refers to content-related evidence, exploratory or
confirmatory factor analysis, evaluation of test content and test specifics, test
item creation. It also includes relationship to other tests: Criterion
measures, score distributions, predictive accuracy, and differential prediction. And
then other forms of validity evidence for example, experimental studies using
the measure, use of a multi trait multi-method matrix, construct similarity
between different tests. Four: Reliability. That means computation of reliability
estimates and the appropriateness of statistical methods. Test-retest time
intervals, and reliability estimates provided for
all scores where interpretations are indicated. Five: Test administration. For
example, is the administration information clearly understood and are
qualification spelled out? Also the replication of test administration, that
is the same conditions under which the test was validated and normed. Six: Test
reporting. That is, how are test results reported and the appropriateness of
scales for reporting results. also other resources and materials for use in
interpretation. Seven: Tests and item bias. This area looks to minimal cultural
dependency: the explicit statement of in appropriateness of tests for specific
groups and differential validity across groups in analytical review. And lastly
language proficiency of native and non-native speakers of the majority
language. Now that that's all clear you're ready to start researching for a
test or measure for your research project. Find some possible measures,
evaluate them, and choose the perfect test. We hope this has been a good guide
to navigating the new world of tests and measures. For more tips on how to search
in specific databases, email us to set up an appointment or to talk through a
search
No comments:
Post a Comment