Open Access Open Access  Restricted Access Subscription Access
Cover Image

eCOOL: An Expert System based Approach to Designing Effective Assessments for Course Outcomes and Learning

Muhammad Hasan Imam, Imran A Tasadduq, Muhammad Haris Khan, Abdul-Rahim Ahmad, Fahd Aldosari, Sameer V Shaikh

Abstract


Effective and objective assessments of learning outcomes is a key activity in any teaching and learning enterprise. An assessment usually comprises a set of questions designed to test the course learning outcomes. Given an available pool of such questions of various types, assessment design reduces to the selection of a set of suitable questions that satisfies instructor’s preferences. The existence of a large number of possible assessment questions for a given course as well as the multiplicity of preferences render the manual selection of suitable assessment questions not only quite cumbersome but also time-intensive exercise. This paper solves this cumbersome and time-consuming problem of decision support and automation by an appropriate design of an Expert System (ES) through a web-based cloud implementation. It also introduces the idea of a relevance score for the selected questions to help the instructor choose the best one. A case study of an undergraduate course in hydraulics is presented for demonstrating the working of the ES. The case study indicates the potential of achieving efficacy and efficiency in the process of designing assessments for learning outcomes by using such an ES.

Keywords


Assessment design; expert system; student outcomes; course learning outcomes; eCOOL; accreditation

Full Text:

PDF

References


AACSB. 2016. "AACSB Business Accreditation Standards." accessed 30 October. http://www.aacsb.edu/accreditation/standards/2013-business.

ABET. 2016. "Student Outcomes." accessed 19 April. http://www.abet.org/accreditation/accreditation-criteria/criteria-for-accrediting-engineering-programs-2016-2017/ - outcomes.

Ahmad, Abdul-Rahim. 2006. An Intelligent Expert System for Decision Analysis and Support in Multi-Attribute Layout Optimization. Canada: Library and Archives

Ahmad, Abdul-Rahim, Otman Basir, Khaled Hassanein, and Shahid Azam. 2008. "An Intelligent Expert Systems' Approach to Layout Decision Analysis and Design under Uncertainty." In Intelligent Decision Making: An AI-Based Approach, 321-364. Springer Berlin Heidelberg.

Bearman, Margaret, Phillip Dawson, David Boud, Sue Bennett, Matt Hall, and Elizabeth Molloy. 2016. "Support for assessment practice: developing the Assessment Design Decisions Framework." Teaching in Higher Education:1-12.

Bennett, Sue, Phillip Dawson, Margaret Bearman, Elizabeth Molloy, and David Boud. 2016. "How technology shapes assessment design: Findings from a study of university teachers." British Journal of Educational Technology.

Downing, Steven M, and Thomas M Haladyna. 2006. Handbook of test development: Lawrence Erlbaum Associates Publishers.

EFMD. 2016. "EQUIS Standards & Criteria 2016." accessed 1 November. http://www.efmd.org/accreditation-main/equis/equis-guides.

Ercikan, Kadriye, and Marc Julian. 2002. "Classification accuracy of assigning student performance to proficiency levels: Guidelines for assessment design." Applied Measurement in Education 15 (3):269-294.

Giarratano J. , Riley G. 2004. Expert Systems: Principles and Programming. Boston: PWS Publishing Company.

Imam, M. H., and Imran A Tasadduq. 2012. "Evaluating the satisfaction of ABET student outcomes from course learning outcomes through a software implementation." International Journal of Quality Assurance in Engineering and Technology Education (IJQAETE) 2 (3):21-33.

Imam, M. H., Imran A. Tasadduq, Abdul-Rahim Ahmad, and Fahd Aldosari. 2016. "An Expert System for Assessment of Learning Outcomes for ABET Accreditation." International Conference on Engineering Education, Singapore, January 07-08.

Jabbar, Haider Khalaf, and Rafiqul Zaman Khan. 2015. "Survey on development of expert system in the areas of Medical, Education, Automobile and Agriculture." Computing for Sustainable Global Development (INDIACom), 2015 2nd International Conference on.

Jackson, Peter. 1998. Introduction to Expert System: Addison-Wesley.

Mislevy, R, and M Riconscente. 2005. Evidence‐centered Assessment Design: Layers, Structures, and Terminology (PADI Technical Report 9). Menlo Park, CA: SRI International.

Mislevy, Robert J. 2013. "Evidence-centered design for simulation-based assessment." Military medicine 178 (10S):107-114.

Smart-Accredit. 2016. CLOSO User's Manual (smart-accredit.com).

Stefik, Mark. 2014. Introduction to knowledge systems: Morgan Kaufmann.

Umar, Muhammad Muneer, Amjad Mehmood, and Houbing Song. 2015. "A Survey on State-of-the-Art Knowledge-based System Development and Issues." SmartCR 5 (6):498-509.


Refbacks

  • There are currently no refbacks.