Pediatric Trauma Dashboard

Usability Testing

Facilitated remote usability testing due to Covid 19 pandemic using wizard of oz strategy and a case vignette. At each step in the case, participants were asked "What information do you need to know, and can you find that on the screen?". Participants also completed a questionnaire with a modified system usability score.

Tested with 21 key stakeholders:

• 8 Emergency: 3 attendings, 2 fellows, 2 nurses, 1 pharmacist

• 6 Pediatric ICU: 3 attendings, 1 fellow, 2 nurses

• 6 Surgery: 2 attendings, 1 fellow, 2 residents, 1 nurse practitioner

• 1 Social Worker

Results

What worked well:

• Vitals timeline

• Mannequin as the "problem list"

• Primary and Secondary Surveys

  "I like the visualization of a patient and where things are. So, the IV, the ET tube, the collar, where the injuries are, I think that is helpful"

What did not work well:

• Colors and display for medication, GCS, diagnostic certainty

• Missing information for allergies and other vitals

• Hover- over features

"I think it's a little hard for something like temperature when the scale is so different that- like, I might not pick up the blood pressure and heart rate trends visually are most important. So, you're going to lose some discriminating ability with that"