IMAP Questions and Answers

IMAP Questions

1. What performance criteria are available to us to establish evidence of predictive validity? a. The oƯeror should propose performance criteria that will meet project objectives in line with their design.
2. Given the cognitive nature of the information management competency, what amount of discriminant validity evidence do you expect to see with other cognitive measures? a. Some evidence of discriminant and convergent validity should be present but should not be given precedence over evidence of predictive validity. The oƯeror should take other design factors into account like time required to complete the assessments when planning the strategy to obtain evidence of validity. 3. Is there a platform besides MARS that might be available to host more technologically involved measures (e.g., game-based assessments)?
a. Currently, assessments that are technologically involved are planned to be hosted on MARS.
4. Should we be focusing on the overall competency for the assessment or on lower-level KSAOs? Both? If the KSAO level, are there particular ones you are more interested in than others for each construct?
a. The oƯeror should ensure coverage of the competencies and KSAs under each competency to the extent feasible.
5. Can you anticipate how much time will be given for soldiers to take each assessment, either individually or in concert with other assessments (e.g., convergent measures)? a. There are generally no limits on how long Soldier participation can be requested, but as the time requested for participation increases, the likelihood of the request being supported decreases.
6. We were unable to locate the following report: Dickson, J. N. (2025). Data Governance and Information Management to Improve Operational EƯectiveness (Report No. FA8075-23F0030). Booz Allen Hamilton. Would it be possible to receive a PDF copy? a. The in-text citation “Dickinson” was a misspelling. The author’s last name is spelled the way it is in the References section, “Dickson.”
7. You noted a preference for SJTs or simulated task performance over self-report inventories. Given the logistical constraints outlined on page 4 of the solicitation, what level of fidelity and technological sophistication is expected or acceptable for the assessment platform? a. At least moderate fidelity is expected. Measures may involve a computer or be paperand-pencil based.

8. Page 4 of the solicitation references the involvement of the Soldier population. Will