This section describes the evaluation plan used to evaluate the on-line modules developed by the School of Social Work at the University of Georgia (UGA). The main function of these on-line modules is to help instructors in the School of Social Work incorporate geriatric materials into their courses. This evaluation plan has been prepared by Chun-Min Wang, a graduate student in the Instructional Technology of UGA, and is supervised by the instructor of EDIT 8350 – Instructional Product Evaluation, Dr. Thomas C. Reeves. The client for this evaluation plan is Dr. Stacy Kolomer, the faculty member in the School of Social Work most involved in the development of the Geriatric modules. The background of the module, the purposes of the evaluation, the intended decisions and questions, the proposed methods and instrumentation, and the selected sample for the evaluation are included in this section.

[Background] [Purpose] [Audience] [Decisions][Methods][Sample selection]

 

 

Background
These on-line modules were funded by The John A. Hartford Foundation (JAHF), “a committed champion of health care, training, research and service system innovations that will ensure the well-being and vitality of older adults (The John A. Hartford Foundation web site, 2003)”. Following the goal of JAHF, which is to enhance and expand the training of doctors, nurses, social workers and other health professionals who care for older adults, Dr. Stacey Kolomer at the school of Social Work at UGA obtained a grant from JAHF to develop web-based modules that contain aging and life span perspective content and to infuse these modules into the required courses of the BSW (Bachelor of Social Work) and MSW (Master of Social Work) programs.
These on-line modules are categorized into four areas:

• human behaviors in social environment (Bio-psycho-social issues in aging),
• social welfare policy (current policies and programs for older adults),
• research methods (research issues for studying an aging population), and
• direct practice methods/ general practice (assessment, communication, and the intervention with the aged).

Each of the modules has the same structure, including the components of resources, case studies, activities, and assignments. Depended on the content of specific courses, the instructors can choose the related module and try to incorporate it into their curriculums.

This is the homepage that hosts these online modules. The users can choose the module they need from this page.

Next page is the main page of “Human behaviors in the social environment”. On the right side of the page is the purpose of this module, and on the left side are the materials that the users can get from this module.

The page below is the “Social Welfare Policy” main page. Basically, each category in these modules has the similar look and structure.

Top

 

Purpose
The purpose of this evaluation plan is to gather information from the faculty members who will use these online modules. This evaluation is primarily formative in that it is designed to provide the information Dr. Kolomer needs to improve these modules.

 

 

Audience
The primary audiences for this evaluation are Dr. Kolomer and the instructors in the School of Social Work who can use these online modules. Relevant secondary audiences are any instructors in other schools/universities who also teach courses in social work. In addition, students who enrolled in the social work program, either at UGA or other universities, may also be interested in the results of this evaluation.

 

Decisions and questions

• How should the content of the modules be revised?
  • How correct and up-to-date are the materials in these modules?
  • How complete are the materials in these modules?
  • What better ways could be used to present these materials in the modules?
    
• How should instructors be advised to incorporate these online modules into their courses?
  • How closely do the modules relate to the course(s) that the instructors teach?
  • What problems do instructors have in using the materials (PowerPoint slides, videos, case studies, and some assignments) in their courses?
  • How do the instructors feel about using these modules in their courses?
  • To what extent do the instructors believe the modules enhanced learning in their courses?
• How should the web site that holds these modules be enhanced?
  • How easy to use is the website navigation?
  • What problems, if any, do instructors experience in accessing the materials?
  • How do the instructors react to the look and feel of the website?
    

 

Top

 

Methods (the instrumentation can be downloaded as a Word document)
Based on the questions in this evaluation plan, three methods were applied to gather the information needed for the decision making.

• Three expert reviews were conducted to collect data about the content of the modules. First, two experts in Gerontology were recommended by the client, Dr. Kolomer. Second, an instructional design export from the Department of Instructional Technology was invited to participate in this review.
• A survey sent out to all potential users to gather information about these questions. Because not all of the instructors have been using or are currently using these modules, some of the questions were only ask the instructors’ about their anticipated use of the modules.
• Three short interviews were conducted to get more detailed information about using the modules in the instructors’ course. Each interview was audiotape recorded and lasted about thirty minutes.
  

 

Top

 

Sample Selection
There are twenty instructors in the School of Social Work who can use these modules in their course. Based on the instrument used, different sample selection process was applied.

• Expert reviews: Two faculty members from the Gerontology program and one faculty member from the department of Instructional Technology in UGA were invited to do the expert reviews. The final decision for the experts was made by contacting with the client as well as the experts.
• Survey: The survey was mailed to all twenty instructors in the School of Social Work.
• Three interviews: These three participants were selected from the instructors who are currently using these modules in their course, and each instructors’ schedule was also take into consideration.
  
  

Top