Here is a link to my completed plan.
Evaluation Plan Draft #2. (or if that doesn't work try copying this to your browser web address bar http://docs.google.com/Doc?id=dg6w7fth_5fhbbkdff)
Monday, 12 May 2008
Completed Evaluation Plan
Subscribe to:
Post Comments (Atom)
7 comments:
Yvonne,
I see what you meant in your post in my blog about also having closely related issues to investigate. I would expect there to be a direct correlation between the two; if the e-learning stimulates the student's curiosity and creativity then that surely must help the students to meet the learning outcomes. I think that cross tabulation could well show some trends. (http://www.custominsight.com/articles/crosstab-sample.asp)
One question though. Is it actually a formal review of Moodle that you are evaluating or the content of the modules. Could any LMS, with similar functionality - and most are fairly similar, achieve the same results?
I wonder if this overlaps into a maintenance evaluation to some degree as it is examining how the technology is being integrated into the whole teaching and learning environment. Perhaps if you didn't have to limit yourself so much for the purposes of this project then the scope could have included wider considerations in line with this.
I think this will provide a valuable insight for me as we are currently trying to figure out all the potential issues with implementing an LMS in our organisation. The feedback from the students will be particularly illuminating.
Looks like a well researched and well thought out plan and I particularly like the fact that you have built in a contingency strategy in case of emergency.
Good luck.
Gordon
this is a great plan Yvonne. A good approach as so often teachers are too focused on getting "down to business" and only want to find out how something was used - not how much enjoyment or creativity the students were exposed to as a result.
I hope you manage to get the sample you would like. Good to see a mix of likert-type scales in use and open-ended questions. Are you planning to use an online survey? Survey Monkey is free and easy to use.
Are you also planning to present a shortened version of your plan?
Hi Yvonne, are you the 'Yvonne' who was in the communities course last year? How's things going with the course you're doing now?
I'm from Bristol as well, sort of. I used to live in Keynsham and my mum's family are all from Brislington. Take care & good luck with course, Sarah
Hi Sarah
Yes - same Yvonne! I've been learning about Myplick today and as I was searching around I came across a comment by you that led me back to your blog. The new module is on evaluating e-learning and it's been interesting so far - I'm busy putting together a presentation for myplick that is taking me ages :)
My first 3 years of teaching were in a large secondary school in Brislington. Small world isn't it? Keynsham is a lovely little town, but you might not recognise Bristol city centre now - it's being rebuilt - with more snazzy new shops. It's nice that some of the post-war concrete has gone!
Cheers
Yvonne
Hi Gordon
Thanks for your feedback.
The project isn't a formal review of Moodle, but more the content used by the teachers as part of their blended learning lessons. But as I'm looking at a couple of different subjects and don't know exactly what I'll be observing it's difficult to narrow it down to specific resources. So therefore I'm just using the Moodle reference for ease to relate to the use of a blended approach. Hope that makes sense.
I think you're right about the overlap with maintenance evaluation too. If this was a full evaluation project I think it would be helpful to look at how Moodle has been taken on across the whole college, compared to management expectations when it was introduced. Due to the small scale of our project though I think it's worthwhile concentrating on the student experience - and from this perspective I think the blended learning approach is still in its development stages which is why I'm describing it as formative evaluation.
Hope you have a nice trip abroad and manage to get all your data sorted before you leave!
Cheers
Yvonne
Hi Yvonne
It must have been difficult to narrow down the purpose of your project to providing just an insight into the effectiveness of the introduction of Moodle into the college curriculum. Reading the background of your plan, all sorts of summative evaluation strategies come to mind as well as the formative 'road' you have chosen to take. I know that control groups were discussed in earlier postings and I wondered if you had considered an evaluation using this method if time was not such an issue? I was thinking in particular to ST9 outlined in your plan.
Another point I found interesting was the fact that no formal evaluation has been carried out to identify the benefits of Moodle. Do those teachers who do not use Moodle believe that exam results are not enhanced using this system? It will be interesting to see how the results are interpreted by the curriculum managers. Back to more evaluation maybe?
I'm looking forward to reading more. Great project - so much scope.
Hilary
Hi Hilary
There is a lot of scope when no formal evaluation ever happens - reflection happens when teachers are asked to consider pros/cons of their courses but not a lot of time is given to this task. Also, because Moodle was introduced (I think) as a result of outside pressure to deliver some form of e-learning support, teachers tend to think they can take it or leave it as they weren't involved in the decision to have it. I think a funded evaluator with lots of time would have a field day!
I'm not really too sure about how a control group would work in an educational setting - mainly because there are so many variables. I think such a scientific approach would be tricky.
As for teachers feeling Moodle enhances exam results - well, I think most teachers feel they can get along nicely without using computers and students still get good grades. Although, I think it's more too do with a) fear of not understanding fully how to use computers to support learning and b) feeling that learning how to use the computer resources would take up too much time. Same old story. I do think that if there was strong evidence that students were benefiting and enjoyed the blended learning approach, that more teachers would give it a go. Maybe?!
Thanks for your feedback,
Cheers
Yvonne
Post a Comment