NATIONAL REPORT ON PILOT TESTING a. INTERACTIVE COURSE FOR MIGRANT WOMEN / WOMEN FROM ETHNIC GROUPS b. ONLINE SELF-ASSESSMENT TOOL WP3 OUTCOME No 19 Compiled by EPICENTRE S.A., Greece December 2012 1 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
Introduction On their completion, the Interactive Course for Migrant Women/Women from Ethnic Groups and the Self-assessment Tool were pilot tested in Greece at the Vocational Training Organisation EPICENTRE S.A. premises on Syros island, in the South Aegean Region, within the framework of ALMA-DC 510658-LLP-1-2010-1-GR-GRUNDTVIG- GMP and in particular within the Work Package 3 of the project. The pilot test was conducted by 2 different groups of evaluators: the Interactive Course was evaluated by migrant women who live in Greece and in particular Albanians, and the selfassessment tool was evaluated by two experts who collaborate with EPICENTRE S.A. Objectives of the pilot test The objective of this task was to have the following products pilot tested with a view to finalising them: A. Interactive Course for Migrant Women/Women from Ethnic Groups The Interactive Course was to be pilot tested by the migrant women in our Focus Group which was formed at the beginning of the project implementation in Greece and who participated in the Focus Workshop in autumn 2011. The Interactive Course, which was compiled by the ALMA-DC consortium, is one of the core products of the project and was available on the project website www.alma-dc.eu mid November 2012 containing the following modules: Module 1 - CULTURE IN GREECE Module 2 - THE LABOUR MARKET IN GREECE Module 3 - SOCIAL INTEGRATION OF IMMIGRANTS / REFUGEES IN GREECE Module 4 - BASIC IT SKILLS (WORD & INTERNET) Module 5 - ADULT EDUCATION FOR MIGRANT WOMEN / WOMEN FROM ETHNIC GROUPS All modules were in their final form and available in English and in Greek. 2 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
Content of the self-assessment tool: For each of the modules we prepared 10 multiple-choice questions which were also available online in the same period in English and in Greek to enable the beneficiaries, migrant women, to assess their progress after studying the modules. The purpose of the pilot testing of the Interactive Course was to elicit feedback from the TGs - migrant women and women from ethnic groups living in Greece - regarding the content of the course in terms of: comprehension, user-friendly exercises, function, usefulness, appearance, effectiveness, quality, and relevance. B. The online self-assessment tool. This software tool was to be pilot tested by two experts in Greece. The purpose of the pilot testing of the self-assessment tool, which contains 50 multiplechoice questions in English and in Greek to be answered by the beneficiaries, was to be tested by two experts in terms of: Clarity, function, usefulness, availability, effectiveness, user-friendliness, and appearance. 3 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
Methodology of administration of the pilot testing i. Migrant women / women from ethnic groups The migrant women, who were the evaluators of the course, and who would participate in the pilot testing, were contacted by phone. Since most of them belonged to our Focus Group, they knew that at some point they would participate in the pilot test so the contact was easy and also the arrangements. The dates and times were arranged in two different groups due to different time availability of the beneficiaries. 1 st group: 7 women on 15th December 2012 2 nd group: 18 women on 22nd December 2012 The pilot test was implemented at the EPICENTRE premises on Syros island and took in total 12 hours for both groups. For each group there were two supervisors from the administration staff of the EPICENTRE. The table below outlines the schedule that was followed for each group: SESSION TASK / ACTIVITY TIME Introduction Purpose and importance of the pilot 40 min. testing (by the EPICENTRE staff) Questions / discussion The beneficiaries asked some clarifying 10-12 min questions Break 10 min. Study the modules The beneficiaries read the modules working independently online at the approx. 3 hours computer laboratory. Break 10 min. The beneficiaries did the online selfassessment test at the computer Online self-assessment test laboratory were guided to interpret approx. 1 hour the results. Evaluation of the course (printed form) Open discussion TOTAL TIME TOTAL TIME At a classroom - The beneficiaries answered the questionnaire in its Greek version to evaluate the Course. 1 * The beneficiaries made general comments on the Course 40 min. 10 min 6 hrs per group 12 Hrs for 25 beneficiaries 1 Some beneficiaries needed guidance to interpret some of the questions. 4 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
Evaluation Tool The tool that was used for the immigrant women to evaluate the pilot test of the INTERACTIVE COURSE FOR MIGRANT WOMEN / WOMEN FROM ETHNIC GROUPS was a questionnaire consisting of 22 questions designed by EPICENTRE (Lead partner of WP3). The questionnaire was developed in 4 blocks of questions ranging from two to five multiplechoice questions with one or more possible answers each and 1 block of two open questions. This structure was considered efficient to serve the purpose of the pilot testing of this outcome and collect useful data about the target group. The five blocks of questions were the following: BLOCKS PURPOSE Questions A Collect demographic data 1-2 B Collect data about the TG s educational background 3-4 C Collect feedback about the content of the modules and impact on the beneficiaries 5-15 D Collect feedback about the quality of the product 16-20 E Collect feedback about further elaboration of the content of the modules 21-22 Below is the full questionnaire in its Greek version: 5 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
Τόπος του πιλοτικού τεστ: Ημ/νία του πιλοτικού τεστ: ΔΙΑΔΡΑΣΤΙΚΗ ΣΕΙΡΑ ΜΑΘΗΜΑΤΩΝ ΓΙΑ ΜΕΤΑΝΑΣΤΡΙΕΣ / ΓΥΝΑΙΚΕΣ ΑΠΟ ΕΘΝΙΚΕΣ ΜΕΙΟΝΟΤΗΤΕΣ ΠΙΛΟΤΙΚΟ ΤΕΣΤ ΤΗΣ ΔΙΑΔΡΑΣΤΙΚΗΣ ΣΕΙΡΑΣ ΜΑΘΗΜΑΤΩΝ ΚΑΙ ΤΟΥ ΕΡΓΑΛΕΙΟΥ ΑΥΤΟ-ΑΞΙΟΛΟΓΗΣΗΣ ΕΡΩΤΗΜΑΤΟΛΟΓΙΟ ΑΞΙΟΛΟΓΗΣΗΣ από μετανάστριες ωφελούμενες A. Συλλογή δημογραφικών δεδομένων 1. Σημειώσετε την ηλικιακή σας ομάδα: 18-24 ετών 25-35 ετών 36-45 ετών 46-55 ετών +55 ετών 2. Σημειώσετε την τωρινή κατάσταση απασχόλησης σας: Πλήρως απασχολούμενη Μερικώς απασχολούμενη Αυτο-απασχολούμενη Άνεργη για λίγο διάστημα Άνεργη για μεγάλο διάστημα B. Συλλογή δεδομένων για το εκπαιδευτικό επίπεδο της ομάδας στόχου 3. Σημειώσετε το εκπαιδευτικό σας επίπεδο: Πρωτοβάθμια εκπαίδευση Δευτεροβάθμια εκπαίδευση Πτυχίο πανεπιστημίου Τεχνική εκπαίδευση Άλλο 4. Επαγγελματική κατάρτιση: Έχω παρακολουθήσει σεμινάρια επαγγελματικής κατάρτισης. Δεν έχω παρακολουθήσει σεμινάρια επαγγελματικής κατάρτισης, αλλά θα το ήθελα. Δεν έχω παρακολουθήσει σεμινάρια επαγγελματικής κατάρτισης και ούτε θα το ήθελα. 6 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
C. Ανάδραση σχετικά με το περιεχόμενο των Ενοτήτων και τον αντίκτυπο στις ωφελούμενες 5. Περιέχει η 1 η Ενότητα χρήσιμες πληροφορίες για σας; (μία απάντηση) ΝΑΙ ΟΧΙ 6. Πριν να μελετήσω την 2 η Ενότητα για την Αγορά Εργασίας στην Ελλάδα (μία απάντηση) δεν γνώριζα πολλά πράγματα για την απασχόληση στην Ελλάδα. δεν γνώριζα κάποια από αυτά τα πράγματα. δεν γνώριζα τίποτα σχετικά με τις διαδικασίες απασχόλησης στην Ελλάδα. είχα διαφορετικές πληροφορίες για την απασχόληση από τρίτους. 7. Αφού μελέτησα την 3 η Ενότητα Κοινωνική Ένταξη Μεταναστών στην Ελλάδα,... (μπορείτε να επιλέξετε περισσότερες από μία απαντήσεις) γνωρίζω τις νόμιμες διαδικασίες παραμονής σε αυτή τη χώρα. γνωρίζω για την εκπαίδευση, την απασχόληση και την κοινωνική ασφάλιση των μεταναστών σε αυτή τη χώρα. γνωρίζω τις νόμιμες διαδικασίες παραμονής και εργασίας σε αυτή τη χώρα. γνωρίζω όλες τις νόμιμες διαδικασίες που αφορούν εμένα και την οικογένεια μου. 8. Πριν να έχω πρόσβαση στην 4 η Ενότητα ΒΑΣΙΚΕΣ ΔΕΞΙΟΤΗΤΕΣ ΣΕ Η/Υ (WORD & ΔΙΑΔΙΚΤΥΟ)... μπορούσα να χρησιμοποιώ ηλεκτρονικό υπολογιστή. δεν μπορούσα να χρησιμοποιήσω ηλεκτρονικό υπολογιστή. 9. Αφού μελέτησα την 4 η Ενότητα ΒΑΣΙΚΕΣ ΔΕΞΙΟΤΗΤΕΣ ΣΕ Η/Υ (WORD & ΔΙΑΔΙΚΤΥΟ)... (μία απάντηση) μπορώ να χρησιμοποιώ ηλεκτρονικό υπολογιστή χωρίς να παρακολουθώ τον οδηγό ξανά. μπορώ να χρησιμοποιώ ηλεκτρονικό υπολογιστή ακολουθώντας τις οδηγίες στην ιστοσελίδα. δεν μπορώ να χρησιμοποιήσω ηλεκτρονικό υπολογιστή χρειάζομαι βοήθεια από τρίτους. δεν μπορώ καθόλου να χρησιμοποιήσω ηλεκτρονικό υπολογιστή. 10. Αφού μελέτησα την 5 η Ενότητα σχετικά με την Επαγγελματική Κατάρτιση Ενηλίκων (μπορείτε να επιλέξετε περισσότερες από μία απαντήσεις) θα ήθελα να συμμετέχω σε προγράμματα επαγγελματικής κατάρτισης για να βρω εργασία. θα ήθελα να συμμετέχω σε προγράμματα επαγγελματικής κατάρτισης για να μάθω τη γλώσσα. γνωρίζω για τις ευκαιρίες στην επαγγελματική κατάρτιση αλλά δεν θα ήθελα να συμμετέχω σε κανένα πρόγραμμα. θα ήθελα να μάθω περισσότερα για τις ευκαιρίες επαγγελματικής κατάρτισης. 7 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
11. Ποιά Ενότητα νομίζετε ότι είναι η πιό χρήσιμη; (μπορείτε να επιλέξετε περισσότερες από μία απαντήσεις) 1 η Ενότητα - ΤΡΟΠΟΣ ΖΩΗΣ ΣΤΗΝ ΕΛΛΑΔΑ 2η Ενότητα - Η ΑΓΟΡΑ ΕΡΓΑΣΙΑΣ ΣΤΗΝ ΕΛΛΑΔΑ 3η Ενότητα - ΚΟΙΝΩΝΙΚΗ ΕΝΤΑΞΗ ΜΕΤΑΝΑΣΤΩΝ ΣΤΗΝ ΕΛΛΑΔΑ 4 η Ενότητα - ΒΑΣΙΚΕΣ ΔΕΞΙΟΤΗΤΕΣ ΣΤΟΥΣ Η/Y (WORD & ΔΙΑΔΙΚΤΥΟ) 5 η Ενότητα ΕΚΠΑΙΔΕΥΣΗ ΕΝΗΛΙΚΩΝ ΓΙΑ ΜΕΤΑΝΑΣΤΡΙΕΣ / ΓΥΝΑΙΚΕΣ ΑΠΟ ΕΘΝΙΚΕΣ ΜΕΙΟΝΟΤΗΤΕΣ 12. Οι ασκήσεις είναι (μία απάντηση) εύκολες να γίνουν και με βοηθούν να καταλάβω τις Ενότητες καλύτερα. χρήσιμες διότι αναγκάζομαι να διαβάσω ξανά τις Ενότητες και έτσι καταλαβαίνω το περιεχόμενο καλύτερα. ενδιαφέρουσες, αλλά δεν μου χρησιμεύουν για να μάθω. συγκεχυμένες και καθόλου χρήσιμες. 13. Η ιδέα να χρησιμοποιηθεί το εργαλείο αυτο-αξιολόγησης είναι (μία απάντηση) πολύ καλή διότι με βοηθάει να μαθαίνω ανεξάρτητα. πολύ καλή διότι μπορώ να κάνω τις ασκήσεις όσες φορές θέλω και να ελέγχω το αποτέλεσμα μου. όχι πολύ χρήσιμη καθώς δεν μου αρέσει να κάνω ασκήσεις στο διαδίκτυο. καθόλου χρήσιμη. 14. Το συνολικό περιεχόμενο της Διαδραστικής Σειράς Μαθημάτων είναι... (μία απάντηση) πολύ χρήσιμο και σχετικό με την κατάσταση όλων των μεταναστριών. πολύ χρήσιμο και σχετικό με την κατάσταση των περισσοτέρων μεταναστριών. χρήσιμο αλλά όχι πολύ σχετικό με την κατάσταση μου. άσχετο με την κατάσταση μου. 15. Βρίσκετε τις συνδέσεις στις διάφορες ιστοσελίδες χρήσιμες για σας και την οικογένεια σας; ΝΑΙ ΟΧΙ Δ. Ανάδραση σχετικά με την ποιότητα του προϊόντος 16. Ποιά γνώμη έχετε για τη γλώσσα που χρησιμοποιείται στις Ενότητες; (μία απάντηση) Είναι ξεκάθαρη και κατανοητή. Είναι αρκετά ξεκάθαρη σε μένα. Είναι εύκολη στο διάβασμα και κατανοητή στα περισσότερα σημεία. Δεν μπόρεσα να κατανοήσω κάποιους όρους αλλά κατάλαβα το γενικό περιεχόμενο. 8 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
17. Ποιά γνώμη έχετε για τις απεικονίσεις που περιέχονται στη Σειρά Μαθημάτων; (μία απάντηση) Οι απεικονίσεις είναι πολύ καθαρές και χρήσιμες. Οι απεικονίσεις είναι αρκετά καθαρές για μένα. Οι απεικονίσεις είναι καθαρές, χρήσιμες και με βοηθούν να μάθω βήμα-βήμα. Οι απεικονίσεις δεν βοηθούν. 18. Ποιά γνώμη έχετε για τη δομή των Ενοτήτων; (μία απάντηση) Είναι πολύ καλά δομημένες. Είναι πολύ καλά δομημένες και σύμφωνα με τις προτεραιότητες των θεμάτων. Είναι δομημένες με τρόπο που σταδιακά μαθαίνω αυτά που χρειάζομαι. Δεν υπάρχει μεγάλη συνοχή στις Ενότητες. 19. Ποιά γνώμη έχετε για τις ασκήσεις του εργαλείου αυτο-αξιολόγησης; (μία απάντηση) Είναι πολύ καλά δομημένες, περιέχουν πολύ σημαντικά σημεία και είναι χρήσιμες. Είναι καλά δομημένες, περιέχουν σημαντικά σημεία και είναι χρήσιμες. Περιέχουν κάποια σημαντικά σημεία, αλλά μου δημιουργούν σύγχυση. Δεν τις βρίσκω πολύ σχετικές με τον τρόπο που μαθαίνω. 20. Ποιά γνώμη έχετε για το εργαλείο αυτο-αξιολόγησης; (μπορείτε να επιλέξετε περισσότερες από μία απαντήσεις) Φιλικό στον χρήστη Αρκετά γρήγορο Εύκολο στη χρήση του Λειτουργικό Αργό Μη φιλικό στον χρήστη E. Συλλογή δεδομένων για την περαιτέρω ανάπτυξη του περιεχομένου των ενοτήτων 21. Ποιές άλλες πληροφορίες θα θέλατε να περιέχει αυτή η σειρά μαθημάτων; Παρακαλούμε να εξηγήσετε τις προτάσεις σας. 9 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
22. Θα συστήνατε την ιστοσελίδα www.alma-dc.eu σε άλλες μετανάστριες / γυναίκες από εθνικές μειονότητες; Παρακαλούμε να εξηγήσετε την απάντηση σας. ΕΥΧΑΡΙΣΤΟΥΜΕ ΓΙΑ ΤΗΝ ΣΥΜΠΛΗΡΩΣΗ ΑΥΤΟΥ ΤΟΥ ΕΡΩΤΗΜΑΤΟΛΟΓΙΟΥ ΚΑΙ ΕΚΤΙΜΟΥΜΕ ΤΗΝ ΣΥΜΒΟΛΗ ΣΑΣ. Χώρα προέλευσης: Όνομα & αριθμός τηλεφώνου: (προαιρετικά): 10 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
ii. 510658-LLP-1-2010-1-GR-GRUNDTVIG-GMP Experts from Greece evaluating the self-assessment tool The two experts who collaborated with the EPICENTRE were contacted in person and they were given the evaluation forms designed for them. They accessed the self-assessment test at their own premises and after a week s time they handed in their forms with their answers and comments. 11 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
OUTCOMES THAT WERE PILOT TESTED INTERACTIVE COURSE CONTENT ONLINE SELF- ASSESSMENT TEST ONLINE SELF- ASSESSMENT TOOL 510658-LLP-1-2010-1-GR-GRUNDTVIG-GMP INDICATORS OF PILOT TESTING IN GREECE WHO FOCUS GROUP OF MIGRANT WOMEN EXPERTS FROM EPICENTRE METHOD online PLANNED INDICATORS (number) REALISED INDICATORS (number) RESULT Course: 1 1 fully accomplished Modules: 5 5 fully accomplished Interactive comprehension questions: 50 questions X 25 beneficiaries=1.250 questions 1.250 fully accomplished online Interactive software tool: 1 1 fully accomplished ACTIVITY / TASK ADMINISTRATION OF THE PILOT TESTING PILOT TESTING OF INTERACTIVE COURSE WHO IMPLEMENTED THE TASK(S) EPICENTRE FOCUS GROUP OF MIGRANT WOMEN: ALBANIAN HUMAN RESOURCES INVOLVED PLANNED INDICATORS (number) REALISED INDICATORS (number) RESULT 1 partner country 1 fully accomplished 3 people from the admin. staff 4 fully accomplished 1-2 groups 2 fully accomplished 25 migrant women 25 fully accomplished EVALUATION OF THE INTERACTIVE COURSE PILOT TESTING OF THE ONLINE SELF- ASSESSMENT TOOL FOCUS GROUP OF MIGRANT WOMEN: ALBANIAN EXPERTS FROM EPICENTRE 25 migrant women 25 fully accomplished 25 questionnaires containing 22 questions (printed paper) 2 experts 2 2 evaluations 2 25 fully accomplished fully accomplished 12 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
FEEDBACK FROM THE MIGRANT WOMEN The questionnaires which were filled in by the beneficiaries at the end of the pilot test gave useful feedback regarding the structure and the quality of the Interactive Course and the self-assessment test. Moreover, we collected important data about our TG. Below we record the results per question: INTERACTIVE COURSE A. Collect demographic data 1. Age groups 18-24 7 2 2 3 25-35 36-45 11 46-55 55 2. Employment status 7 3 Full-time employed Part-time employed 8 Self-employed 5 2 Short time unemployed Long time unemployed 13 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
B. Collect data about the TG s educational background 3. Educational background 1 5 1 9 Primary education Secondary education University degree 10 Technical education Other 4. Vocational training seminars 3 7 I have attended vocational training seminars. 15 I have not attended vocational training seminars but I would like to. I have not attended vocational training seminars and I would not like to. C. Collect feedback about the content of the modules and impact on the beneficiaries 5. Did Module 1 contain useful information for you? 3 YES NO 22 14 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
3 1 6. Before studying Module 2 about The Labour Market in Greece I did not know much about 3 18 employment in Greece. I did not know some of this information. I knew nothing about the procedures of employment in Greece. I had different information about employment from other people. 7. After studying Module 3 Social Integration of Immigrants in Greece,... (you can choose more than one answers) I know about the legal procedures to stay in this country. 25 25 25 25 I know about schooling, employment and social security for migrants in this country. I know about the legal procedures to stay and work in this country. I know about all legal procedures regarding me and my family. 8. Before accessing Module 4 Basic IT skills (WORD & INTERNET)... 9 16 I could use a PC. I could not use a PC. 15 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
9. After studying Module 4 about Basic IT Skills (WORD & INTERNET) 6 2 6 I can use a PC without watching the demo again. I can use a PC by following the instructions online. 11 I cannot use a PC I need some help from other people. I cannot use a PC at all. 10. After studying Module 5 about Adult Education... (you can choose more than one answers) I would like to participate in vocational training programmes to find a job. 4 12 17 21 I would like to participate in vocational training programmes to learn the language. I know about vocational training opportunities but I would not like to participate in any programmes. I would like to find out more about vocational training opportunities. 11. Which Module did you find most useful? (you can choose more than one answers) Module 1 - CULTURE IN GREECE Module 2 - THE LABOUR MARKET IN GREECE 25 9 25 Module 3 - SOCIAL INTEGRATION OF IMMIGRANTS IN GREECE 14 25 Module 4 - BASIC IT SKILLS (WORD & INTERNET) Module 5 - ADULT EDUCATION FOR MIGRANT WOMEN / WOMEN FROM ETHNIC GROUPS 16 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
12. The exercises are 1 1 easy to do and they help me to understand the Modules better. 10 13 useful because I have to read the Modules again and so I understand the content better. interesting, but not very useful to learn. confusing and not useful. 12 13. The idea to use the self-assessment tool is 1 1 11 great because it helps me to become an independent learner. great because I can do the exercises as many times as I like and check my score. not very useful as I don t like doing exercises online. not useful at all. 14. The overall content of the Interactive Course is 1 1 1 22 very useful and relevant to all migrant women s situation. very useful and relevant to most migrant women s situation. useful but not very relevant to my situation. not relevant to my situation. 17 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
15. Did you find the links to various sites useful for you and your family? 2 23 YES NO D. Collect feedback about the quality of the product 16. What do you think about the language used in the modules? It is very clear and comprehensible. 2 3 5 15 It is clear enough to me. It is easy to read and understand most of the points. I couldn t understand some terms but I comprehended the overall content. 17. What do you think about the graphics included in the Course? 0 6 1 The graphics are very clear and useful. The graphics are clear enough to me. 18 The graphics are clear, useful and help me step by step to learn. The graphics are not helpful. 18 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
18. What do you think of the structure of the Modules? 0 They are very well structured. 13 7 They are very well structured and according to priority of the issues. 5 They are structured in a way that I gradually learn what I need. There is not much cohesion within the modules. 12 19. What do you think of the exercises in the self-assessment tool? 1 0 12 They are very well structured, contain very important points and are very useful. They are well structured, contain important points and are useful. They contain some important points but they are confusing. I don t find them very relevant to my learning process. 20. What do you think of the online selfassessment tool? (you can choose more than one answers) user-friendly 1 fast enough 22 25 easy to use 25 17 functional slow not user-friendly 19 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
E. Collect feedback about further elaboration of the content of the modules 21. What other information would you like this course to contain? Please write your suggestion. Various suggestions were made by the migrant beneficiaries namely: I would like more information about how to apply for a job (7 participants) I would like more information about job vacancies in the Cyclades (4 participants) It would be a good idea to include some templates of job applications (2 participants) Everything is fine (12 participants) 22. Would you recommend our site www.alma-dc.eu to other migrant women / women from ethnic groups? Please explain your answer below: There was positive response to this question: sample collective answers:* 2 Yes, of course because it is very useful for Albanian women. Yes, I would, because it can help other women who need some guidance about jobs. Yes, because in your course there is information that I and other women cannot find easily elsewhere. I would recommend this site because it s difficult to find all this information in books. CONCLUSIONS FROM THE PILOT TEST OF THE INTERACTIVE COURSE (based on the results of the evaluation) Our conclusions after receiving the feedback from the target group of migrant women who pilot tested the interactive Course are as follows: A. Demographic data A high percentage of 44% of the participants were in the 36-45 age group, while 28% belonged to the 46-55 age group. The other age groups were represented by 2 or 3 participants each consequently the age group mostly represented was between 36 and 55. 2 The exact language they used has been amended to depict the meaning of their answers. 20 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
Regarding their employment status, 32% of the participants were part-time employed, 28% long-time unemployed, 20% short-time unemployed, 12% full-time employed and only a small percentage of 8% were self-employed. B. Data about the TG s educational background Regarding their educational background, 40% have attended Secondary Education, 36% have attended Primary Education, 20% have attended technical education, while only 4% of the participants are degree holders and another 4% have received other kind of education. As for vocational training seminars, 60% of the participants have not attended any seminars but they are willing to. Only 28% have attended vocational training. A small percentage of 12% have not attended any vocational training and are unwilling to attend any. C. Feedback about the content of the modules and impact on the beneficiaries The participants found the modules very useful and containing information they lacked. Module 4 (Basic IT Skills) helps them step by step learn how to use a PC. While all modules were appreciated as important, modules 2, 3, and 5 were assessed as the most useful of all by all participants. MODULES CHOSEN BY RATED MODULE 1 9/25 36% MODULE 2 25/25 100% MODULE 3 25/25 100% AVERAGE RATE: 78,4% MODULE 4 14/25 56% MODULE 5 25/25 100% The use of the self-assessment tool and the exercises contained in it were assessed as great and helpful because this way they could check their progress and be motivated enough to go back to the modules and comprehend their content better. The overall content of the course was assessed by the majority of the participants as important and relevant to the most migrant women s situation. 21 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
D. Feedback about the quality of the product The majority of the participants recognised good quality in the product: The language was found very clear and comprehensible, The graphics used in the course were assessed as clear and useful, The modules were regarded as structured in a motivational way that helps them in the learning process, The exercises were assessed as important and useful, The self-assessment tool was assessed as user-friendly, fast enough, easy to use and functional. E. Further elaboration of the content of the modules According to the feedback, the Greek partner does not feel that the modules need further development; the majority of the participants commented in favour of the course content and its development. General conclusion The Interactive Course for Migrant women / Women from Ethnic Groups meets the needs of the migrant women in terms of content, structure, and quality. 22 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
FEEDBACK FROM THE EXPERTS 510658-LLP-1-2010-1-GR-GRUNDTVIG-GMP The experts who assessed the online self-assessment tool handed in the following evaluation: ASSESSMENT OF THE ONLINE SELF-ASSESSMENT TOOL 1 st EXPERT rate from 10 [highest] to 0 ASSESSMENT OF SELF-ASSESSMENT TOOL Clarity 10 9 8 7 6 5 4 3 2 1 0 Function 10 9 8 7 6 5 4 3 2 1 0 Usefulness 10 9 8 7 6 5 4 3 2 1 0 Availability 10 9 8 7 6 5 4 3 2 1 0 Effectiveness 10 9 8 7 6 5 4 3 2 1 0 User-friendly 10 9 8 7 6 5 4 3 2 1 0 Appearance 10 9 8 7 6 5 4 3 2 1 0 Comments by the 1 st expert: The online self-assessment tool that is used in the ALMA-DC project is in general useful and simple to use so the purpose for which it was created is accomplished; the target group, most of whom are not accustomed to using the Internet and online tests, will find it easy to use especially after accessing Module 4 which instructs them how to use Word and the Internet. Additionally, the user spends a little time to do the test on each module consisting of 10 questions total 50 questions for all five modules. Consequently, its strong points are its simplicity and the little time it takes for each module to be tested. Its weak points, however, are that it appears at the bottom of the screen and for some lengthy multiple-choice answers the user has to scroll the questions/multiple-choice sentences further down to view all the possible answers. This way it becomes demotivational. Another weakness is that it is not directly linked with the modules so the users are not directly motivated to test their progress. A further point that needs attention is that the tool sometimes has to be restarted to function. If this cannot be improved from the data 23 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
base, it is suggested that the tool automatically warn the user by an automatic sentence how to start over by not losing part of the test already done. A final weak point is its appearance; it could have been constructed in colour frames and in larger font. This could be amended by providing a colour background in the area of the self-assessment test. Overall, the self-assessment tool is functional enough and meets the expectations of the consortium as these have been outlined in the ALMA-DC project that is to enable the target groups of immigrant women to do the exercises and monitor their progress independently and at their own pace. 2nd EXPERT rate from 10 [highest] to 0 ASSESSMENT OF SELF-ASSESSMENT TOOL Clarity 10 9 8 7 6 5 4 3 2 1 0 Function 10 9 8 7 6 5 4 3 2 1 0 Usefulness 10 9 8 7 6 5 4 3 2 1 0 Availability 10 9 8 7 6 5 4 3 2 1 0 Effectiveness 10 9 8 7 6 5 4 3 2 1 0 User-friendly 10 9 8 7 6 5 4 3 2 1 0 Appearance 10 9 8 7 6 5 4 3 2 1 0 Comments by the 2 nd expert: Strong points: My overall impression is that the self-assessment tool used in ALMA-DC project is very simple and functions well most of the times. Additionally, its content - that is ten questions on each module in L2 or in English - is useful for the beneficiaries to motivate them and read the Modules again more carefully in case their scores are not satisfactory; in this way it helps them understand the content to their benefit. Moreover, the endless possibility for each user to do the test as many times as they like is a very good feature. Finally, the fact that in the end it depicts the correct and incorrect answers in different colours (green for the right answers and red for the wrong answers) is helpful for the user as it marks the answers that need more careful reading so this adds to the educational issue. 24 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
Weak points: On the other hand, regarding its function, it s not always reliable as it sometimes gives blank results and it has to be started again. It has been observed that this can happen when several users access it at the same time. Moreover, its appearance is poor; the frames and the fonts used do not stand out and this can affect the users by not motivating them. Furthermore, not being directly connected with the modules of the ALMA-DC course in the same area/screen, the tool may become de-motivational for the beneficiaries to use as it seems detached from the course. Recommendations: It would be recommended: a) to improve its appearance by using colour frames, b) make each frame of questions appear higher in the screen so that even longer multiple-choice questions are visible directly, c) to link the tool directly with the modules area to remind the user of their possibility to test their progress directly after reading each module. OVERALL ASSESSMENT by 2 EXPERTS - rate from 10 [highest] to 0 FEATURES 1 st EXPERT 2 nd EXPERT AVERAGE Clarity 9 8 8,5 Function 9 8 8,5 Usefulness 10 10 10 Availability 8 7 7,5 Effectiveness 8 8 8 User-friendly 9 8 8,5 Appearance 6 5 5,5 TOTAL: 56,5/70 (80,7%) 25 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-
CONCLUSIONS (by EPICENTRE based on the evaluation by the experts) The self-assessment tool was rated at 80,7% on average by both experts, which is a very good rate for the partner who created it and the consortium who made suggestions for its development. Both experts found the self-assessment tool useful and simple in its use, consequently it is functional for the purpose it was built. Both experts, though, commented on its poor appearance (format and fonts) and it being detached from the modules which they regard as de-motivational for the user. Instead they recommended that it should be directly linked with the modules to be more functional and add to the educational aspect of the project. 26 ALMA-DC_WP3_REPORT ON PILOT TESTING OF THE INTERACTIVE COURSE & THE SELF-