When staff members at PAR are developing a new test, several rounds of data are collected in order to be sure that the test is measuring what it has intended to measure and that it represents the appropriate populations accurately. Data collection occurs all across the U.S. to help us gather that information. Multiple stages of data collection are crucial to test development. Learn more about the different stages of data collection and what is entailed in each step.
Pilot
The pilot stage of data collection is when preliminary data is gathered on a proposed measure with a small sample. The goal of pilot data collection is often to make decisions about item selection, and to determine any aspects of the test that may need alteration prior to standardization. Data collectors provide valuable feedback to PAR staff during this stage regarding the administration of the test and ways it can be improved.
Standardization
Standardization involves gathering data using the proposed measure with a larger, representative sample to create norms used by clinicians to score and interpret results upon the test’s publication. PAR uses Census-based norming to ensure our samples are proportionally representative of the demographics of the United States. Each examinee is evaluated for age/grade, sex, race/ethnic group, and participant’s or parent’s educational attainment in addition to their responses to the assessment. PAR’s data collection staff monitor the data closely to ensure each geographic region of the United States is represented. The standardization stage of a project provides additional data collection opportunities to gather reliability data through interrater and test–retest cases, as well as validity data using concurrent measures.
Clinical groups
Specific clinical groups may be recruited to serve as clinical comparison samples in data collection.. These clinical cases may require additional documentation from the data collector. The clinical populations recruited vary depending on the construct the test intends to measure.
Get involved!
Interested in becoming a data collector for an upcoming project? Have access to a specific clinical group that needs more research? Learn more about how you can PARtner with PAR.
Want to learn more about data collection and standardization? PAR staff members recently addressed this topic on The Testing Psychologist podcast. Tune in here.
Ever wonder how PAR gets the information needed to standardize our tests? We rely on data collectors all across the U.S. to help us gather that information. Data collectors are crucial to test development because they help us find the clinical, standardization, and reliability samples needed to create our assessment products. If you have an interest in contributing to the field in a meaningful way, you might be just the person to help us create our next instrument!
Who can be a data collector?
Most of our data collectors are clinical psychologists, school psychologists, psychometrists, speech and language pathologists, and other clinicians. PAR follows the American Psychological Association’s (APA) Guidelines for Psychological Assessment and Evaluation, a system of qualification levels that guides decision-making about who can purchase, administer, and interpret tests (APA, 2020). Anyone administering assessments must be well trained in standardized administration protocols, ethics, and demonstrate competency in practice. For data collection, requirements differ by test. Most projects require a PAR qualification level of B or C.
What is involved in data collection?
Data collectors are responsible for finding participants and are compensated on a per-case basis that varies by project. PAR does not pay participants directly, although we can provide gift cards for your participants at your request, deducted from the total amount per case. For most projects, there is no minimum number of reservations required. However, we do set a maximum number of cases that can be accepted from any one examiner/site so that we can ensure geographic diversity in our samples.
Data collectors submit required demographic information for the participants they intend to test. It is necessary for data collectors to provide accurate demographic information. PAR uses Census-based norming, and we must ensure all demographic groups are appropriately represented. The data collection team at PAR will make a reservation for each participant based on demographics provided. Once a reservation has been made, materials will be provided to data collectors to begin testing.
Each project is slightly different, ranging from completing rating scales online to administering performance-based tests in person. The general process involves obtaining informed consent from the participant, administering the test, and submitting the data and materials to PAR.
Do data collectors receive compensation?
Yes, they do! We are incredibly grateful for our data collectors and try to demonstrate this via prompt payment. PAR offers data collectors an option for either cash payments or credit toward PAR products and have provisions for compensating examinees.
How do I get involved?
It’s easy! Simply visit our Partner with PAR page and follow the directions listed under, “How do I become a data collector for PAR?”
PARiConnect, our online assessment platform, can help you expand your reach when doing research!
Expand your geographic reach
By using PARiConnect, our digital assessment platform, you can email HIPAA compliant links directly to research participants. This enables you to complete research assessments online, expanding your geographic reach to areas you may not be able to use otherwise. This also allows you easier access to observer and collateral research data without requiring additional individuals to make the trip to your data collection site.
Reduce unused assessment costs
If you email an assessment link to a participant who decides not to complete it, PARiConnect allows you to easily revoke the link and reuse that assessment with another participant. You won’t have to pay for an unused assessment like you might with a paper form, saving you money typically lost on unused assessments.
Improve data integrity
When participants enter their own data, it reduces the time needed for data entry and reduces the possibility of data entry errors. PARiConnect offers settings to prevent skipping questions, so you can reduce the risk of missing data. Furthermore, you can review completion time to be sure your participants put forth appropriate effort. This can reduce the amount of time and energy needed to enter and check data, freeing up your financial and physical resources for other tasks.
Integrate efficiently with your work
The PARiConnect system allows you to download item-level assessment data to a CSV excel spreadsheet that is formatted to integrate with statistics software such as SPSS for ease of data processing and analyzation.
Let PARiConnect help you increase your geographic reach, expand your subject numbers, reduce attrition, lower assessment and travel costs, and decrease the burden of data collection.
Learn more about PARiConnect today!
Need assistance selecting assessments for your research? Learn more about all the ways PAR can help! Check out this video on using PAR assessments in research settings.
Learn more about PAR’s training and research discounts!
Clinicians and researchers—are you using a PAR product in your research? If you a professional who would be interested in partnering with us to advance the scope of solutions PAR provides, we would love to talk to you about it!
We are looking to gather additional data on our existing assessments with the goal of further validating our instruments, developing and identifying product enhancements, or adding features that allow our customers to better meet the needs of those they serve.
Learn more about the PAR Data Program and find out how you can take part!
Why?
Many of us are familiar with the ethics of psychological testing, including carefully choosing tests based on how they were standardized. Have you ever found yourself curious, flipping through a manual, wondering if the population you work with was adequately represented in the creation of a test? One way you can ensure this, contribute to the field, and be compensated for your time is by participating in data collection with PAR! Data collectors are essential to research and development of psychological tests and are often the first to know what products and assessments will be hitting the market.
Who can collect data?
Qualification Level: B
Qualification Level: C
What will I be asked to do?
Data collectors are responsible for finding participants and are compensated on a per-case basis that varies by project. PAR does not pay participants directly, although we can provide gift cards for your participants at your request, deducted from the total amount per case. There is no minimum number of reservations required. We are thankful for any data you can provide for us!
Data collectors submit required demographic information for the participants they intend to test. It is imperative for data collectors to provide accurate demographic information. PAR uses Census-based norming, and we must ensure all demographic groups are appropriately represented. The data collection team at PAR will make a reservation for each participant based on demographics provided. Once a reservation has been made, materials will be provided to data collectors to begin testing.
What are the types of data collection?
Clinical Groups
When do I sign up?
Now! Data collection projects are currently in process.
Where do I sign up?
Simply complete the Examiner Information Form and Nondisclosure Agreement and send the forms to Kathryn Stubleski at kstubleski@parinc.com.
We look forward to working with you!
Calling all test developers, researchers, data collectors, and potential authors—we want to work with you! We recently revamped our Partner with PAR programs and are proud to announce two new opportunities, in addition to our longstanding data collection and assessment publishing programs.
Visit parinc.com/PARtner for more information on all our programs and for details on how to get in touch with us.