Because ITSs offer knowledge-based instruction, ITS authoring shells can use knowledge acquisition systems to bring courseware
development within the reach of subject-matter experts unskilled in instructional design and development. The Experimental
Advanced Instructional Design Advisor (XAIDA), a simple ITS shell, was evaluated in a study of 17 Air Force medical-technician
trainers. The study examined XAIDA’s learnability, usability, and acceptability to the participants using a one-week combined
training and evaluation program. All participants were able to produce courseware using XAIDA. Measures of cognitive structure
indicated that their conception of XAIDA’s features became more similar to that of an expert as the result of training. Performance
tests, skill ratings and usability ratings indicated that XAIDA is both usable and learnable. Participant’s attitudes were
generally positive except at a point when training required a difficult cognitive shift. Attitudes remained focused througout
training on personal and low-level concerns, indicating the participants were not likely to be early adapters of the technology.
The results have implications for the deployment of ITS shells in operational environments.