College student using mixed reality and a robot to learn engineering concepts

Mixed reality is preparing students for the collaborative workforce


Case Western Reserve is using mixed reality to produce students who are trained for the collaborative workforce

Easy integration played a key role in the success instructors have seen so far. “You need little to no training in order to use this,” said Mark Griswold, IC faculty director. “We wanted something simple to use.”

So far, the IC has run 20 trials with the HoloLens in areas such as human anatomy and physics.

One trial dealt with a human breast dissection, which is traditionally challenging in cadaver dissections because the tissue tends to deteriorate rapidly, Griswold said.

One student group used the HoloLens lab for a virtual dissection, and another group went into the cadaver lab. Both groups were compared pre- and post-test. The HoloLens group’s post-test scores increased by about 8 percent compared to the cadaver lab group. Ninety-seven percent of the HoloLens group reported a positive experience, versus only 71 percent in the cadaver lab.

The two approaches could be used together, Griswold added, with students using the HoloLens lab first to avoid tissue deterioration issues, then working in the cadaver lab.

Related: Visionary: How 4 institutions are venturing into a new mixed reality

“People learn better when they’re engaged in groups,” Griswold said, noting that mixed reality approaches have shown proven enhancements in student achievement and long-term retention.

“We feel this engagement and collaboration better represent the jobs students will go into in the real world,” he added.

Another simulation revolves around emergency response training, in which students use a HoloLens to respond to a car accident and assess the surrounding environment and the victim’s injuries.

“We wanted to create a simulation that’s easy to use in classrooms and that’s scalable–something that could give us data on what students are learning,” said Sue Shick, an IC instructional designer. “This is a career and tech field, and we have to show whether students are meeting certain competencies.”

The simulation collects a surprising amount of data, such as: where students are gazing and what they’re examining; measuring movements; collecting speech data to gauge how calm they are and how engaged they are with the victim; turn-taking and collaboration with fellow students in the simulation; and knowledge assessment.

All this data is analyzed and helps faculty visualize and assess the learning taking place.

“One of the things we’re super interested in is thinking about multi-modal learning analytics and figuring out what the data said to us, and if it’s meaningful at all in terms of the 4Cs,” Shick added.

Laura Ascione

"(Required)" indicates required fields