Workshop Overview
    •Part I: The State of Online 
      Learning
    •Part II. Evaluation Purposes, 
      Approaches, and Frameworks
    •Part III. Applying Kirkpatrick’s 4 
      Levels
    •Part IV. ROI and Online Learning
    •Part V. Collecting Evaluation Data 
      & Online Evaluation Tools
                           
      Sevilla & Wells (July, 2001), e-learning
     We could be very productive by ignoring 
       assessment altogether and assume 
       competence if the learner simply gets 
       through the course.
                            
                  Why Evaluate?
      • Cost-savings
         – Becoming less important reason to evaluate 
           as more people recognize that the initial 
           expense is balanced by long-term financial 
           benefits
      • Performance improvement
         – A clear place to see impact of online learning
      • Competency advancement
                                 
                 16 Evaluation Methods
       1. Formative Evaluation             9. K-Level 6 budget and stability of 
       2. Summative Evaluation                e-learning team.
       3. CIPP Model Evaluation            10. K-Level 7 whether e-learning 
                                              champion(s) are promoted
       4. Objectives-Oriented              11. Cost/Benefit Analysis (CBA)
            Evaluation                     12. Time to Competency 
       5. Marshall & Shriver's 5 Levels    13. Time to Market
            of Evaluation                  14. Return on Expectation
       6. Bonk’s 8 Part Evaluation Plan    15. AEIOU: Accountability, 
            (& the Ridiculous Model)          Effectiveness, Impact, 
                                              Organizational Context, U = 
       7.  Kirkpatrick’s 4 Levels             Unintended Consequences
       8. Return on Investment (ROI):      16. Consumer-Oriented Evaluation
                                          
    Part I. The State of Online Learning