CAPSIM SIMULATION

Pilot Background: 

The idea of using Capsim originated after performing significant research regarding methods implemented by other universities to (1) improve student learning and (2) to use as an assessment tool to collect more accurate data. In particular, Kennesaw State University’s The Coles College of Business was highlighted in AACSB’s March 2012 Spotlight publication for its strong assessment program and use of simulations. Assisted by one of the Assessment leads from the college, Dr. Hope Baker, shared valuable insight with CBE staff into the success Kennesaw has experienced using Capsim simulations and testing. This resulted in a draft proposal to the CBE Dean for approval of a Capsim pilot in Spring 2013.

The proposal was approved and the Capsim simulation was implemented in every section of MGMT 4650, the undergraduate capstone, a total of eight sections, and one MBA capstone course, MGMT 6800. Six faculty members and two HIRE Center staff members were involved in the implementation of the pilot. All fees were waived for all participating students, over 300 undergraduate students and approximately 20 graduate students. Costs of the simulation and exam were paid by the college.

The simulation required a level of HIRE Center staff support to provide assistance to faculty and students. HIRE Center staff took the lead on monitoring and assessing the pilot for effectiveness in terms of use as an education tool and use as an assessment tool. This was assessed through meetings held with participating faculty, participating students, attending a Capsim annual seminar, and speaking with key Capsim representatives at the Capsim headquarters in Chicago, Illinois.

Assessment Measurement Tool:

At the end of the quarter, students completed an individual exam developed by CAPSIM and administered online. The exam simulated certain company decisions. Students answered the questions asked following analysis of the situation presented. Questions concerned the impact of particular decisions made on different sectors of a company, using technology for data analysis, and company projections based on data interpretations. Five particular questions were identified and grouped together to measure each of the learning objectives listed above (LO1a, LO1b, and LO2b). Data from the identified/grouped questions were collected and aggregated. According to the scores, students were categorized into one of three categories: (1) below expectations (0-50), (2) meets expectations (50-80), (3) exceeds expectations (80-100).

Following consultations with assurance of learning experts at CAPSIM, percentage cutoffs set for each category was determined.

328 BSBA and 19 MBA students participated in the pilot. 

Closing the Loop:

The Spring 2013 simulation was determined a success in the two areas it was pilot testing: (1) use as an educational tool and (2) use as an assessment tool. Faculty found students improved in areas of functional integration, data-driven decision analysis, teamwork and communication. Assessment staff found the simulation provided more accurate and transparent data to measure student proficiency in key areas. As a result, the CBE Dean made the decision to continue supporting Capsim for Fall 2013 in all sections of the MGMT 4650 course, with the plan to continue in Winter and Spring 2014. A re-evaluation of the simulation program will follow at the end of the first full academic year. Fees will again be waived for all participating students and the college will cover the costs in Fall 2014. Lessons learned from feedback from participating faculty and students have provided a number of suggestions for improvement moving forward.

The following suggestions were implemented for the Fall 2013 implementation:

  • Having a Capsim representative conduct a seminar for faculty in Summer 2013 to prepare faculty for the simulation as an Instructor.
  • Developing an in-class introductory tutorial for students, to be administered by trained HIRE Center staff at the beginning of the quarter in each participating course section.
  • Providing students with computer lab support throughout the quarter.
  • Providing students with more in-person support throughout the quarter, to be provided by HIRE Center staff. 

To better assist faculty to full integrate the simulation into the capstone course, CBE invited a Capsim representative to come to campus and hold a two-day seminar for the faculty who are teaching, or who normally teach, the capstone course on September 16 & 17, 2013. The seminar was successful and helped 7 faculty better integrate the simulation into their course. HIRE Center staff also attended the seminar to gain the knowledge and understanding in order to be a source of support for students throughout the academic year. 

* The Hire Center has since been closed and assurance of learning activities have been reallocated under the Assurance of Learning Manager.

MORE INFORMATION

To read more on the Capsim initative and how CBE has modified its implementation of the simulation within the course over the years, see Closing the Loop subsections: 'Discussions' and 'Reports'.