Wiki-Skills » WP8 Evaluation » Evaluation Data Collection » Wikimedia Sverige T8.2 Data Reporting

Wikimedia Sverige T8.2 Data Reporting

Last modified by Anna Bauer on 2013/07/18 11:05

1. PRE-QUESTIONNAIRE

Each partner should fill in the following table with the data collected through the pre-questionnaire.

Settings

Please describe the settings in which the questionnaire was distributed / filled in by teachers and trainers, including:

  • Online or face-to-face modality / place

  • Date

  • Context (e.g. at the beginning of the training session)

  • Type of target groups (primary-secondary school teachers, higher education teachers, professional trainers or adult trainers)

    Wikimedia Sverige has implemented three WikiSkills courses with a total of 23 unique participants. Each course consisted of three phases: a preparation, a two day long face-to-face-session and a follow-up. We chose to perform the face-to-face part in three different places from north to south in Sweden:

    • Skellefteå, 21-22 February: 7 participants, of whom all but one had previously contributed to a wiki.
    • Stockholm on 7-8 February: 9 participants, of whom one had previously contributed to a wiki.
    • Helsingborg 25-26 March: 7 participants, of whom two had previously contributed to a wiki.

    Our intentions:

    At the start of the face-to-face session, participants where asked to estimate their expectations according to the questions elaborated in the evaluation framework (deliverable 8.1).

    At the end of the second face-to-face course day, course participants were asked to complete the evaluation of the course.

    In reality: 

    Because of technical trouble to register participants to the evaluation platform the pre-questionnaire was filled out later during the first course day. At one or two of the course sessions the post-questionnaires were filled out online after the two course days. (My memory is not quite clear ...)

    Target groups: Leonardo and Comenius.

    Particpants: 

    23 unique participants whereof 

    9 hade experience of wiki before and 14 where non-experienced:

    1 entrepreneur/ free lancer
    2 educators of teachers and librarians
    1 IT-pedagogue for "Gymnasie"-teachers
    3 project leaders / process leaders within the folk high school and UR (Swedish Educational Broadcasting Company)
    2 tutors for SeniorNet
    1 communicator for a non-profit

    5 vocational teachers (sound & music, media, care & health, social media/creative writing/computer skills/leadership and management development)

    8 gymnasium teachers (general subjects, computer & IT, mathematics, natural science, arts & social studies, media, Swedish as second language)

    So in total: 15 Leonardo and 8 Comenius participants 

respondents

Please indicate the number of teachers / trainers who filled in the questionnaire

13 out of 23.

general observations

Please provide any comments or observation of interest

Many questions were not perceived as relevant by the participants. They attended the course in order to get knowledge about a tool (wikis) and to get ideas to and plan a lesson. Then, questions like, for example "Did you view failure as an opportunity to learn?" or "Did you present arguments?" didn't feel adequate. There were also way too many questions.

I added some extra questions which I considered were lacking in order to get a better understanding of the usefulness of the course. You can see the results here on the Wikimedia Sverige wiki in Swedish or here google translated into English.

It was not so easy to understand the survey system: It was tricky to register potential respondents to the system and to know if the surveys were sent out to all of the respondents. In one case, surveys were sent out double by the administrator and I had to appologize and answer questions from confused participants.

Complete report

Please provide below the complete report of the questionnaire results (table directly available from the Chamilo platform).

See attachment: survey_results_förväntningar.ods


2. POST-QUESTIONNAIRE

Each partner should fill in the following table with the data collected through the post-questionnaire.

Settings

Please describe the settings in which the questionnaire was distributed / filled in by teachers and trainers, including:

  • Online or face-to-face modality / place

  • Date

  • Context (e.g. at the end of the training session)

  • Type of target groups (primary-secondary school teachers, higher education teachers, professional trainers or adult trainers)

    See Settings, Pre-questionnaire.

Number of respondents

Please indicate the number of teachers / trainers who filled in the questionnaire

19 out of 23.

Comments and general observations

Please provide any comments or observation of interest

See Comments and general observations, Pre-questionnaire.

Complete report

Please provide below the complete report of the questionnaire results (table directly available from the Chamilo platform).

See attachement: survey_results_utvärdering 2.ods


3. IN-DEPTH INTERVIEWS

Each partner should fill in the following table with the data collected during interviews with teachers / trainers. The minimum number of interviews is 3 per partner.

Settings

Please describe the settings in which the interviews were conducted , including:

  • Place and date (phone or face-to-face modality)

    By phone: Sten Sundin (130313), Jörgen Qvartsenklint (130603), Susanne Antell (130610)

    Face-to-face: Nils Olov Ahlgren (130501), Bia Rask (130319 and 130424)

  • Context (e.g. after the implementation of scenarios, after the course)

    After the course, before the implementation: Sten, Nils, Susanne

    After the course, before and after the implementation: Bia, Jörgen

  • Name and profile of the interviewer(s)

    Sten Sundin, teacher in Sound and Music production at Dalarna Universityhigher education teacher/adult trainer

    Bia Rask, teacher of media and Swedish at JB Gymnasietsecondary school teacher / VAT

    Nils Olov Ahlgren teach Swedish as a second language for new arrivals. In addition, he calls for IT demagogue. Secondary school teacher / VAT

    Jörgen Qvartsenklint is the project leader at Glokala Folkhögskolan. There he works with flexible learning locally and nationally, as well as IT coordinator. Adult trainer / VAT

    Susanne Antell, teacher educators at Dalarna University, higher education teacher / VAT

  • Type of target groups (primary-secondary school teachers / higher education teachers / professional trainers / adult trainers)

Pictures

Please provide some pictures from the interviews:

3 out of 5 interviews were done over Skype. The only interview which I have a picture from is the one with Bia (number two below). Anyhow, these are the people I interviewed:

https://wiki.kreablo.se/x/bin/download/Wiki+skills/WikiSkills%3A+Under+och+efter+kursdagarna+-+fem+deltagares+erfarenheter/Sten%20Sundin.jpg

http://upload.wikimedia.org/wikipedia/commons/thumb/f/f4/BiaRask.jpg/320px-BiaRask.jpg?width=1071

https://wiki.kreablo.se/x/bin/download/Wiki+skills/WikiSkills%3A+Under+och+efter+kursdagarna+-+fem+deltagares+erfarenheter/Kursdeltagare%20i%20samspr%C3%A5k.jpeg

https://upload.wikimedia.org/wikipedia/commons/7/7d/Nils2.jpg?width=800

Number of interviewees

Please indicate the number of teachers / trainers interviewed

5: Sten, Bia, Nils, Jörgen, Susanne

Summary of the interviews

Please provide a summary of the interviews conducted with teachers / trainers (between 500 and 1000 words), including answers to all questions, as well as citations and relevant facts. The summary should discuss the following aspects:

  • Skills or knowledge developed by teachers / trainers during the training

  • Wiki key competences

  • Collaboration in virtual community of practices

  • Project impact:

  • Usefulness of the training sessions

  • Fulfillment of user's expectations

  • Performance / adaptation of the tools used within the project

  • Impacts on the educational communities

  • Positive factors that emerged

  • Challenges faced

  • Solutions

  • Next steps

    Sten Sundin, teacher in sound and music production at Dalarna University, participated in the course occasion in Stockholm. Sten is now looking for the right way for him to contribute to Wikipedia and Wikimedia. Perhaps by providing sound in some way. Contact:ssn@du.se.

    "The course has had a motivational and inspirational influence and made it more likely for me to write on Wikipedia. Things I did not know were the active discussions on Wikipedia. Attitude in the discussions that I've seen is not so competitive. People try to help each other. It is more fun to do voluntary work if I both learn something and can do something together with others. "

    He has deepened his knowledge about Wikipedia and he masters "skills both on how to write articles practically and technically, and also what to think about in terms of quality and what are the appropriate topics that one can write about - what is relevant. " "I look positively upon using Wikipedia as a research tool. It is of course important to have a critical approach and evaluate sources. There are constantly discussions about if you can use Wikipedia as a reference. I urge students that Wikipedia is a starting point and that you can not be satisfied to stay there. "Sten thinks that Wikipedia has gained greater acceptance among teachers and the latest five years people realize the value of Wikipedia. A good motto: Wikipedia is not perfect but fantastic.

    Sten has also got better on the markup language in MediaWiki. "It's easier to write a letter to the editor in the newspaper or update your status on Facebook than writing in MediaWiki," according to Sten. In Dalarna University "we had plans on MediaWiki but chose to retain MindTouch wiki because we evalued that some computer-inexperienced students in the nursing program would have problems with MediaWiki", Sten writes. "I'm trying to streamline the task so that students can focus on the important things, for example, to do a literature study". Sten is however tempted to allow the students to use MediaWiki because it would make it easier for students to participate in Wikipedia or other Wikimedia projects. 

    Sten's students are using a wiki to perform and present their tasks because a wiki provides good opportunities for collegial learning - "peer learning". Also – since much of Sten's teaching is done remotely, "it's valuable to have established contact with the students in a virtual community before you meet each other for the first lesson."

    One challenge is to adjust the wiki task that I let my students do today so that it comes closer to Wikipedia. But if I add an element of Wikipedia in my teaching, would I then have to remove something else? Because teaching with Wikipedia integration is more comprehensive ... Sten weighs arguments ... "Perhaps it would yet be worth the integration." "Students should be able to respond to arguments in a discussion on Wikipedia."  With my background (as a teacher in sound and music production), I could bring something to the media section to Wikimedia Commons and Wikipedia. Visualizing, sound recording in order to illustrate concepts, articles ... of routine we teachers let students report in writing and orally. I am open to allow students to a greater extent report on a wiki and maybe let them report with sounds and images.

    What are the obstacles to use wikis in education? "Some of my teaching colleagues are not so positive towards using wikis in their teaching. They want to teach in the simplest way and do as they are accustomed. They feel that it's a small threshold that requires more preparation. We have no infrastructure support for our wiki like we have for our learning platform. In the learning platform, there are others who ensures that all participants are included. On a wiki, I have to create a number of pages where students get their tasks, build a framework for the tasks and archive files from last year. In my teaching this means dozens of pages. It is about both formating the text on the pages and managing links. Managing links is not trivial. "Almost half of the students have not succeeded in creating a link back to the own article, despite instructions that Sten has tried. He really has endeavored to make instructions easily available, searchable, and easy to find and understand, where the student exist and the instructions are needed.

    Bia Rask, teacher of media and Swedish at JB Gymnasiet, did not waste any time and did a oneclick installation of MediaWiki on her school's webhotel on the first day's course in Skellefteå. During the course, she laid the foundation for her lecture sessions. Contact: bia.rask@jbgymnasiet.se

    Bia could "absolutely nothing about wiki before. All I know today comes from the course. Wikipedia content is no surprise, but how to edit and how to see what is done on the talk page and the history. I was fascinated by how it is designed from a technical point of view. "

    Bia has made a flying start and has already used the pedagogical scenario which she has been involved in developing – a lecture series that started on April 17 : "Together, you shall make a basic photography school. It shall be so clear that even a beginer understands the content. Use both text and explanatory images (own or from Wikimedia Commons)." Bia's students? They are second year students (roughly 16-20 years) of a program focusing on aesthetics and media. What is so great about Bia's scenario is that it is closely linked to the course plan. It is for exemple a course requirement to allow students to work in virtual communities.

    The lecture series was successful and they will keep the wiki for other lessons in the future. "I've never worked like this before. Students and teachers work together towards a common goal and edit each other's pages. Although the wiki is built together, it is still possible to see what is made by each student when it is going to be assessed." It is interesting to note that others besides media teachers are interested. For example, Wikipedia can be a good starting point for a social science teacher. I was invited by Bia to "talk about Wikipedia from a 'sociological' perspective (kind of democracy, gender, etc.) [[...]] bring some thoughts."

    Everything was of course not a bed of roses: "The challenge that I see directly is to get the less motivated students to develop themselves further: It is easy to start a wiki page but not to improve those already started ...' It might be about confidence. It is about being able to commend and get them to develop themselves through strength calls. They may need help to find information, how they can learn things, and show that it need not to be so fancy. "

    Overall Bia thought that "Useful things came up during the course. It felt so all the way." Bia will hold lessons where she and her students use a wiki again, and also, more specifically, use Wikimedia Commons. "The other day a student needed music for a film. I referred to Wikimedia Commons which I would never have done before."

    Jörgen Qvartsenklint is the project leader at Glokala Folkhögskolan. There he works with flexible learning locally and nationally, as well as IT coordinator. Contact: jorgen@glokala.se. 

    Jörgen is already a very experienced wiki user and initiator of Folkbildningsnätets Wikifarm (Folkbildningsnätet is administrated by The Swedish National Council of Adult Education) but still learnt some technical stuff valuable to him, such as how to generate templates with lists of all users.

    Moreover: "I took the ccourses in order to find more opportunities for collaboration. How do you encourage people to contribute, how to get people to start? I wanted to meet others for input." He thought that "the meetings between the participants were good, people got inspired and developed ideas together, everyone had their own personal ideas, it became meetings based on participants' own experiences. It was good that the process lasted for two days, so that one could land and get feedback."

    Learnings from the course will be handy when Glokala Folkhögskolan (Jörgen's workplace) is to start a wiki for their projects in the fall. "Project progress communicated in internal meetings need to be documented, communicated and disseminated". We have divided the activities into tracks / thoughts around organizational development that we will put into the wiki. Many people sit now and take notes on oh so many different sites, it becomes so widespread with Google Docs and mailboxes. We plan to start the wiki and make an effort this fall. We also consider maybe to publish a course in citizen journalism on Wikiversity to get more feedback and further development by new people. "

    The challenge is to get people to participate. As initiator of a wiki, one need to be "stubborn but not in a nagging way, encourage, find openings, needs, moments ..."

    Nils Olov Ahlgren, participant in Skellefteå: Nils teaches Swedish as a second language for newly arrived immigrants. In addition, he calls himself IT demagogue trying to spread the good word. Wiki is one of those words. Contact: noah@ahlgren.de 

    Nils thinks that the course has made him more familiar with Wikipedia and editing wikis. He can now more about markup language and linking. He has also gained a deeper insight in how to spread information and how to use a wiki. The prime he brings with him is an understanding of how to use wikis in education.

    Nils plans to start a wiki during the summer, first on his own site (which is easier than through the municipality and its IT department). The purpose of the wiki is to provide an additional dimension to the learning of the Swedish language. The wiki will work as a wordlist which is illustrated and explained by photos, illustrations, animations and videos. The wordlist is going to be built up by both teachers and students and hopefully different groups of students are going to contribute over a longer period with visual explanations to both concrete and abstract words.

    Challenges Nils can see are that the studengroup between 16-20 years old will be beginners on both Swedish and wiki. But similar challenges have been overcame earlier where beginners learned Swedish while they also learned to script, record and edit film. He hopes and believes that students who are more advanced in their language can go to the wiki to help and teach new students.

    Susanne Antell, teacher educator at Dalarna University who participated in the course in Helsingborg, will continue to work with and use her scenario Human's Anatomy and Physiology at the DU-wiki this fall. Contact: sat@du.se.

    Susanne thought it was very good that we raised the issue of free licenses (Wikipedia's third pillar): "There is material which is produced at universities but owned by companies and which is not published freely. Copyright may hinder. If instead we could have a generous attitude we can achieve so much more. However, we must have a dialogue with the students about what they think is ok to pass on. It is an ethical question. How we relate to the material is a question of democracy and might require a change of attitude. Is it mine and yours or ours? The world might be ripe for change. "

    After the Wikiskills course, Susanne has presented wikis to 10 of her colleagues. "All were inspired with the idea and we'll go further." This fall Susanne will hold a teaching session in a course aimed at teacher students. Susanne along with a teacher colleague, have decided to use a wiki: The course aims to get students to be active in working with Internet based educational resources. "We have distance students who then will continually be active on the wiki that will be available throughout the semester.We will tell the students that we are beginners. It can take twists and turns that are not anticipated, but it may well be fun!"

    Other initiatives planned by the students: a course on Wikipedia aimed at companies, a study circle on Wikipedia, a course on digital media (including Wikipedia) for union representatives, a course in digital creation in the the folk high school where the collaboration platform may be a wiki, information on Wikipedia targeting for older internet users and visitors of SeniorNet's internet cafés etc.

Comments and general observations

Please provide any comments or observation of interest


4. EXPERT EVALUATION

For each scenario, each partner should fill in the following table with the data collected (please copy-paste the table the number of times necessary).

Name of the expert

Harald Anderson

Short bio of the expert

Please describe a short bio of the expert (he / she should demonstrate a high level of experience in the use of wikis in educational contexts)

Harald Anderson is a trained teacher of Ma / NO, which has worked in the Swedish school system for 14 years, and one year in the U.S.. During this time, he was also planning and building up the science center Kreativum in Karlshamn, Blekinge, Sweden.

Harald is since February 2012 board member of Wikimedia Sverige and has since long been a frequent writer of Wikipedia.

Title of the scenario

Report on the questionnaire

Please provide a short report (between 500 and 1000 words) on the results of the evaluation. The report should include scores and comments written by the expert, regarding the following aspects:

  • Connection with the curriculum

  • Adaptation of the pedagogical objectives to the profile of the group of students

  • Integration of the wiki in the planning of the educational activity

  • Detailed planning of the pedagogical evaluation of students

  • Planning of the necessary resources to conduct the educational activity

  • Sustainability of the scenario

    TaskGood instructions that are quite clear. Writing editing comments is very important so it is good this is emphasized.

    A small instruction on how to write links might have been helpful here, or if you are linking to a page that explains linking (a help page that can be used for other courses as well). Why should you have to scroll up, lose the thread, to find the help page? Link instead directly to the help page which should be opened in a new window.

    Self AssessmentGood approach, but the heading should be more detailed. In this case they should write "Self-Assessment Photo Facts" so that it becomes easier to follow if they have more courses with self-assessments.

    References: Why don't you make a footnote to the heading "Goals and objectives" so it will be easier to see what the reference is?

    • Connection with the curriculum: Yes, it is good refers to the syllabus. Score 4

    • Adaptation of the pedagogical objectives to the profile of the group of students: see above. Score 4

    • Integration of the wiki in the planning of the educational activity: Yes, no problem, and it also make students learn Wikimedia Commons. Score 4.

    • Detailed planning of the pedagogical evaluation of students: Yes, it is clear Score 5.

      Planning of the necessary resources to conduct the educational activity: They have material themselves. Clearly written. Score 5

      Sustainability of the scenario: Yes, it is reusable and can easily be adapted or copied so that it can be used as a template for other courses. Score 4.

Comments and general observations

Please provide any comments or observation of interest.

There is another scenario which has also been evaluated: "Using Wikipedia in order to learn source criticism" (in Swedish). However, since this scenario is not tranlsated into English, I don't provide it in this report. 

Learning scenario

Please provide the learning scenario evaluated below this table: Students create wiki-guide on photography

5. STATISTICS FROM THE ON-LINE PLATFORMS (OPTIONAL)

Besides of the analysis of the Chamilo and Mediawiki platforms (data to be provided by CESGA), partners are invited to analyze wiki sites (Wikispaces, Wikia, etc.) used by teachers / trainers during the training and implementation phase. Thus, each partner should fill in the following table with the data collected. Furthermore, additional materials (e.g. screenshots form wiki sites) should be made available in Appendices.

Platform analyzed

Please indicate the name and the address of the wiki platform(s) analyzed

https://wiki.folkbildning.net/wikiskills/Huvudsida

Screenshots of the wiki platform

Please provide screenshots of the wiki platform analyzed

Screenshot WikiSkills course wiki Sweden.png

Summary of the analysis

Please provide an analysis of the platform (between 500 and 1500 words). It may include the following information:

  • Number of pages; 19 (with content), 190 (all pages)

  • Page edits; 972

  • Average edits per page; 5,12

  • Uploaded files; 26

  • Users’ activity; ?

  • Bots (list of members); 0

  • Administrators’ activity; ?

  • Etc.

Comments and general observations

Please provide any comments or observation of interest

Tags:
Created by Anna Bauer on 2013/06/30 15:55

Copyright 2004-2015 XWiki
3.4