PAR_BlogandSocial_4673917694_07_23.jpg

When staff members at PAR are developing a new test, several rounds of data are collected in order to be sure that the test is measuring what it has intended to measure and that it represents the appropriate populations accurately. Data collection occurs all across the U.S. to help us gather that information. Multiple stages of data collection are crucial to test development. Learn more about the different stages of data collection and what is entailed in each step. 

Pilot 

The pilot stage of data collection is when preliminary data is gathered on a proposed measure with a small sample. The goal of pilot data collection is often to make decisions about item selection, and to determine any aspects of the test that may need alteration prior to standardization. Data collectors provide valuable feedback to PAR staff during this stage regarding the administration of the test and ways it can be improved. 

Standardization 

Standardization involves gathering data using the proposed measure with a larger, representative sample to create norms used by clinicians to score and interpret results upon the test’s publication. PAR uses Census-based norming to ensure our samples are proportionally representative of the demographics of the United States. Each examinee is evaluated for age/grade, sex, race/ethnic group, and participant’s or parent’s educational attainment in addition to their responses to the assessment. PAR’s data collection staff monitor the data closely to ensure each geographic region of the United States is represented. The standardization stage of a project provides additional data collection opportunities to gather reliability data through interrater and test–retest cases, as well as validity data using concurrent measures. 

Clinical groups 

Specific clinical groups may be recruited to serve as clinical comparison samples in data collection.. These clinical cases may require additional documentation from the data collector. The clinical populations recruited vary depending on the construct the test intends to measure. 

Get involved! 

Interested in becoming a data collector for an upcoming project? Have access to a specific clinical group that needs more research? Learn more about how you can PARtner with PAR

Want to learn more about data collection and standardization? PAR staff members recently addressed this topic on The Testing Psychologist podcast. Tune in here.

what is data collection.jpg

Ever wonder how PAR gets the information needed to standardize our tests? We rely on data collectors all across the U.S. to help us gather that information. Data collectors are crucial to test development because they help us find the clinical, standardization, and reliability samples needed to create our assessment products. If you have an interest in contributing to the field in a meaningful way, you might be just the person to help us create our next instrument! 

Who can be a data collector? 

Most of our data collectors are clinical psychologists, school psychologists, psychometrists, speech and language pathologists, and other clinicians. PAR follows the American Psychological Association’s (APA) Guidelines for Psychological Assessment and Evaluation, a system of qualification levels that guides decision-making about who can purchase, administer, and interpret tests (APA, 2020). Anyone administering assessments must be well trained in standardized administration protocols, ethics, and demonstrate competency in practice. For data collection, requirements differ by test. Most projects require a PAR qualification level of B or C. 

What is involved in data collection? 

Data collectors are responsible for finding participants and are compensated on a per-case basis that varies by project. PAR does not pay participants directly, although we can provide gift cards for your participants at your request, deducted from the total amount per case. For most projects, there is no minimum number of reservations required. However, we do set a maximum number of cases that can be accepted from any one examiner/site so that we can ensure geographic diversity in our samples. 

Data collectors submit required demographic information for the participants they intend to test. It is necessary for data collectors to provide accurate demographic information. PAR uses Census-based norming, and we must ensure all demographic groups are appropriately represented. The data collection team at PAR will make a reservation for each participant based on demographics provided. Once a reservation has been made, materials will be provided to data collectors to begin testing. 

Each project is slightly different, ranging from completing rating scales online to administering performance-based tests in person. The general process involves obtaining informed consent from the participant, administering the test, and submitting the data and materials to PAR. 

Do data collectors receive compensation? 

Yes, they do! We are incredibly grateful for our data collectors and try to demonstrate this via prompt payment. PAR offers data collectors an option for either cash payments or credit toward PAR products and have provisions for compensating examinees. 

How do I get involved? 

It’s easy! Simply visit our Partner with PAR page and follow the directions listed under, “How do I become a data collector for PAR?” 

 

Want to learn more about data collection and standardization? PAR staff members recently addressed this topic on The Testing Psychologist podcast. Tune in here.

PARiConnect for research.jpg

PARiConnect, our online assessment platform, can help you expand your reach when doing research! 

Expand your geographic reach 

By using PARiConnect, our digital assessment platform, you can email HIPAA compliant links directly to research participants. This enables you to complete research assessments online, expanding your geographic reach to areas you may not be able to use otherwise. This also allows you easier access to observer and collateral research data without requiring additional individuals to make the trip to your data collection site. 

Reduce unused assessment costs 

If you email an assessment link to a participant who decides not to complete it, PARiConnect allows you to easily revoke the link and reuse that assessment with another participant. You won’t have to pay for an unused assessment like you might with a paper form, saving you money typically lost on unused assessments. 

Improve data integrity 

When participants enter their own data, it reduces the time needed for data entry and reduces the possibility of data entry errors. PARiConnect offers settings to prevent skipping questions, so you can reduce the risk of missing data. Furthermore, you can review completion time to be sure your participants put forth appropriate effort. This can reduce the amount of time and energy needed to enter and check data, freeing up your financial and physical resources for other tasks. 

Integrate efficiently with your work 

The PARiConnect system allows you to download item-level assessment data to a CSV excel spreadsheet that is formatted to integrate with statistics software such as SPSS for ease of data processing and analyzation. 

Let PARiConnect help you increase your geographic reach, expand your subject numbers, reduce attrition, lower assessment and travel costs, and decrease the burden of data collection. 

Learn more about PARiConnect today! 

 

Need assistance selecting assessments for your research? Learn more about all the ways PAR can help! Check out this video on using PAR assessments in research settings. 

Learn more about PAR’s training and research discounts!

handshake2 (1) (2).jpg

Clinicians and researchers—are you using a PAR product in your research? If you a professional who would be interested in partnering with us to advance the scope of solutions PAR provides, we would love to talk to you about it!

We are looking to gather additional data on our existing assessments with the goal of further validating our instruments, developing and identifying product enhancements, or adding features that allow our customers to better meet the needs of those they serve.

Learn more about the PAR Data Program and find out how you can take part!

handshake2 (1) (1).jpg

Why?

Many of us are familiar with the ethics of psychological testing, including carefully choosing tests based on how they were standardized. Have you ever found yourself curious, flipping through a manual, wondering if the population you work with was adequately represented in the creation of a test? One way you can ensure this, contribute to the field, and be compensated for your time is by participating in data collection with PAR! Data collectors are essential to research and development of psychological tests and are often the first to know what products and assessments will be hitting the market.

Who can collect data?

Most of our data collectors are clinical psychologists, school psychologists, psychometrists, speech and language pathologists, and other clinicians. PAR follows the American Psychological Association’s (APA) Guidelines for Psychological Assessment and Evaluation, a system of qualification levels that guides decision-making about who can purchase, administer, and interpret tests (APA, 2020). Anyone administering assessments must be well trained in standardized administration protocols, ethics, and demonstrate competency in practice. For data collection, requirements differ by test. Most projects require a PAR qualification level of B or C.

Qualification Level: B

  • A degree from an accredited 4-year college or university in psychology, counseling, speech-language pathology, or a closely related field plus satisfactory completion of coursework in test interpretation, psychometrics and measurement theory, educational statistics, or a closely related area; or license or certification from an agency that requires appropriate training and experience in the ethical and competent use of psychological tests.

Qualification Level: C

  • All qualifications for level B plus an advanced professional degree that provides appropriate training in the administration and interpretation of psychological tests, or license or certification from an agency that requires appropriate training and experience in the ethical and competent use of psychological tests.

What will I be asked to do?

Data collectors are responsible for finding participants and are compensated on a per-case basis that varies by project. PAR does not pay participants directly, although we can provide gift cards for your participants at your request, deducted from the total amount per case. There is no minimum number of reservations required. We are thankful for any data you can provide for us!

Data collectors submit required demographic information for the participants they intend to test. It is imperative for data collectors to provide accurate demographic information. PAR uses Census-based norming, and we must ensure all demographic groups are appropriately represented. The data collection team at PAR will make a reservation for each participant based on demographics provided. Once a reservation has been made, materials will be provided to data collectors to begin testing.

  • Each data collection project is slightly different, ranging from completing rating scales online to administering performance-based tests in person. The general process involves obtaining informed consent from the participant, administering the test, and submitting data and materials to PAR.
  • We are grateful for our data collectors and try to demonstrate this via prompt payment for your efforts.

What are the types of data collection?

Pilot

  • Preliminary data collection on proposed measure with a small sample to determine any concerns that need to be addressed.

Standardization

  • Gathering data using the proposed measure with entire sample to create norms; determining what is typical for the population studied.
  • PAR uses Census-based norming to ensure the sample is proportionally representative of the demographics of the United States. We ask for age/grade, sex, race/ethnic group, and participant’s or parent’s educational attainment. We monitor the data closely to ensure each region is represented.
  • The standardization stage of a project provides additional data collection opportunities to gather reliability data through interrater and test–retest cases, as well as validity data using concurrent measures.

Clinical Groups

  • Specific clinical groups may be needed for certain projects. These clinical cases may require additional documentation from the data collector and typically are compensated at a higher rate. Please let PAR know the clinical groups you have access to by completing those questions on the Examiner Information Form.

When do I sign up?

Now! Data collection projects are currently in process.

Where do I sign up?

Simply complete the Examiner Information Form and Nondisclosure Agreement and send the forms to Kathryn Stubleski at  kstubleski@parinc.com.

We look forward to working with you!

handshake2 (1).jpg

Calling all test developers, researchers, data collectors, and potential authors—we want to work with you! We recently revamped our Partner with PAR programs and are proud to announce two new opportunities, in addition to our longstanding data collection and assessment publishing programs.

  • Requests for research proposals. We invite proposals from any nonstudent investigator using PAR instruments for research, with priority given to studies validating PAR instruments, using PAR instruments for developing or validating treatments or interventions, or validating PAR instruments for use with underrepresented populations.
  • PAR Data Program. If you have collected data using one or more PAR products, we want to work with you to help develop new solutions and enhancements that will better serve society and improve the mental health of others. Our ultimate goal is to increase fairness and inclusivity in test development by increasing representation of underserved populations.
  • Data collection. We are always collecting normative, reliability, and validity data for products in development and welcome new data collectors. Bonus—data collectors earn cash payments or credit toward PAR products for the essential work they do for us!
  • Publishing. Developing new and updated assessment instruments is what keeps us going, day in and day out. Though we keep our ears close to the ground for ideas, we invite you to contact us with your proposals or ideas—and to do so as early as possible in the development process. We’d love to have the opportunity to work with you!

Visit parinc.com/PARtner for more information on all our programs and for details on how to get in touch with us.

PAR is currently collecting normative, reliability, and validity data for a number of new products in development. Data collectors are responsible for obtaining test subjects based on the specific project needs as outlined by the Data Collection Coordinator and are compensated on a "per case" basis that varies with each project. Typically, we offer examiners/data collectors an option for either cash payments or credit toward PAR products. We also have provisions for compensating examinees. PAR pays for all shipping and handling fees arising from data collection. If you are interested in collaborating with PAR as a data collector, complete the Examiner Information Form.

For more information on the data collection process, visit this page.

 
This interview is a part of an ongoing feature on the PAR blog to better acquaint Customers with PAR staff. We hope you enjoy this inside look into what goes on behind the scenes to develop, create, and deliver your most trusted assessments.

Sue Trujillo, Manager of Data Collection

How many years have you worked at PAR? 9 1/2 years

What does an average day at PAR look like to you? Read and respond to emails from data collectors, check the demographic database on projects in progress, recruit new and existing examiners to work on finding participants to fill the needed demographics, check incoming data for accuracy and log cases into my SPSS “cases needed” file, and, most recently, helping to work on new project ideas.

What is the best part of your job? Talking with psychologists all over the country.

When people ask you what you do, how do you explain your job? I have a database of examiners from all over the country who administer new or existing assessments in order to create the standardization norms.

When you aren’t at work, where can you be found? In my yard, tending to my flowers and plants, or dancing at a rock concert.

When I first started working at PAR… there wasn’t any one person who did my job. The project directors were responsible for finding authors who already had data or the project directors managed data collection themselves.

If I could switch jobs with anyone in the company for a day, I’d like to try… Being a Clinical Assessment Consultant! I’d like to sell what I’ve helped create!

Archives