Thursday 26 June 2014

Penalizing Test-takers who Exceed the Allotted Time



The following is a possible way to construct a penalty system that increases fairness and reduces arbitrariness. The specific numbers are not the key ideas of this article: the methods of arriving at them are the real focus. Because the question  “How much of this good thing is enough?” cannot be answered scientifically, the specific numbers have to be decided upon by an authority.


One way to construct a penalty system for students who exceed the allotted testing time:
  • Simplifying assumptions:
    • A typical unit exam is allotted 75 min.
    • The average score on unit exams is about 65%.
    • Unit exams are composed of four-option multiple-choice items, so even a student who purely guesses will score 25% (on average).
  • Therefore, an average student will earn (65% - 25%) / 75 min = 40% / 75 min = 0.5 % per minute.
  • Hence, in order to offset gains from exceeding the time-allotment, the penalty should be at least 0.5% per minute.
  • A penalty of 1% per minute adds a 0.5% per minute deterrent, which is easily understood, and seems fair (is not draconian).
  • A further deterrent is that if a student exceeds the time-allotment by 30 min, the exam is forfeited. After 30 min, a student should be well aware that they have exceeded their time allotment. The idea of ½ hour is easily understood and seems reasonable.
  • Students who write in the test room are given a 10 min grace period. This is justified since they need to keep track of their writing-time on their own and some mental energy is wasted while clock-watching.


Advantages of implementing a penalty system such as the one presented above:
  • A penalty, thoughtfully implemented, can act to restore fairness by equalizing student marks (to some extent). This makes students’ marks from all modes more comparable and helps the course map to function as intended.
  • Students will know that they are being treated in approximately the same manner (this increases the perception of fairness because arbitrariness is reduced).
  • Some deterrent is justified because fewer students (presumably) will try to stretch the rules hoping that no one notices. A deterrent effect is justified to the extent that the deterrent increases fairness and decreases arbitrariness.
  • This model is not punitive, i.e., does not punish for the sake of punishing as a kind of revenge on behalf of the innocent. Perhaps one could argue that a punishment can engender respect from those who disrespect a policy, but this is quite dubious.


Disadvantages of implementing a penalty system:
  • The more policies we develop, the more time we need to spend explaining them. Our student handbook starts to become a policy manual.
  • The more policies we develop, the more energy we need to spend policing the policy.
  • The police might need to be policed.
  • Policies become the first and most important thing we communicate, especially in ATOL, so students know the landscape they need to navigate. In ATOL, we do not want students to be surprised by what could be perceived as “gotchas.”
  • Sometimes any gains one hopes to achieve by implementing a system are negated by the effort required to police the system and the ill will engendered by the things police are sometimes compelled (by law) to do: confiscate and fine.


In my opinion, the advantages outweigh the disadvantages.


Regards,
Michael

Tuesday 10 June 2014

Starting with Why: An Example D2L "Template" for Math and Science Courses


"Image courtesy of phanlop88 / FreeDigitalPhotos.net".

Start with why. Students notice why we do things. And if our whys and wherefores are crystal-clear to ourselves, we can implement with purpose and the results will be as intended.


This document makes an initial attempt to justify the key components of a Math or Science D2L course based on the function each component needs to fulfill:


One reason for a functional D2L template is that ATOL and RTOL need to satisfy Essential Quality Standards 2.0 requirements from eCampusAlberta:

I’m not saying this is necessarily the only or best way of doing things: this is just one way among many. The main thing is that when the final “template” is designed, each component will have a clear, non-overlapping rationale. The final template will be determined by the curriculum leads and coordinator.

Regards,
Michael

Previous blog postings

Math - Magical and Delicious

Darcy dubbed it “The Lucky Charms meeting.” It was the last in a series of get togethers we had to discuss the learning objectives of the Prep Math 10 course. Who knew it would take us back to the childhood breakfast table and those magically delicious marshmallow-enhanced bowls of cereal? But that it did as we debated the magical properties of angles and the delicious qualities of numbers.

The task before us was to decide whether the trig objectives should stay or go, as this was the last decision to make before finalizing the list of learning objectives. Over the course of all of our meetings we had a few key questions that guided our debates over what should be included in this prep course:

- What is the purpose of this course?
- Which learners take this course?
- Was the objective covered in a previous course?
- Yes - then does it need to be covered in this course again?
- No - then should it be introduced in this course?
- How does the objective relate to the next course?
- How does the objective relate to science courses?
- Is time better spent on this objective or other objectives?
- How do most learners perform on this objective?
- How does an objective relate to other objectives in the course?
- For learners in the next course who do not take Prep Math 10, when do they get introduced to the objective?

Starting with an old list of learning objectives, there were deletions, additions, and modifications in all sections. It was all up for debate and Penny did a great job moderating the conversations and ensuring changes didn’t leave a hole in anyone’s heart. With the learning objectives in place, the hunt for a good textbook is the next component of this curriculum project.

Many thanks to all of the instructors who shaped the learning objectives for this course: Penny Marcotte, Bev Kosior, Darcy Milano, Brenda Thomas, Michael Gaschnitz, Melanie Macdonald, Alix MacDonald, Carol Johnson, Diny Woyiwada, Travis Seaman, and Kiranjit Brar.

Invisible Technology?

How can technology fit into my classroom? A question like this may entice some instructors and may send others running for the hills. Educator, Michael Cohen, helps settle the current in his article: The Invisible iPad: Ready, Set, Goals!





Friday 6 June 2014

My Trip to Aurora College, Yellowknife NT Ann Hanna

     Aurora College has 3 campuses in Yellowknife, Fort Smith and Inuvik. Although Yellowknife has a much larger population, Fort Smith is the main campus.  There are also community learning centres throughout the territory.  The college does not have on line studies.  Anyone who wants to learn on line has to go through Hay River where they use resources from Alberta.
     Yellowknife has a downtown campus and a community learning centre for First Nations students.  The community centre is self-paced and programs are connected to the workplace. When I passed by the small building, I noticed there were two doors.  One door said “Outreach Literacy” and the other said something like “Trades and Technology”.  I thought the building represented much of where we want to go in CEFL at Bow Valley College!  I wrote a letter asking to visit the Diloh First Nations community centre in Yellowknife, but unfortunately I did not get permission to go there. 

     Essential skills are integrated into the curriculum at Aurora College.  The college plans to do more work on essential skills in the future.  I visited Suzanne Robinson, a teacher in the Developmental Studies Program (same as our CEFL program) at the downtown campus.  The campus occupies three floors of a large building.  When I entered the building the first thing I saw was a small lounge.  There was a bookcase full of books for a student book exchange.  I thought this was a great idea that Bow Valley College might implement.  
     I met Suzanne at her office on the second floor.  She told me that the college had a LINC and a business department as well as the Developmental Studies department.  In the Developmental Studies department, they work at keeping good connections or ladders between levels of the academic program and the career programs.  Mostly they teach up to grade 12, but students can take nursing and teaching degrees at the college as they are affiliated with the University of Regina.  For other programs, students travel south to study at the universities that have an agreement with Aurora College.  These change from time to time.   Most of the courses taught at the downtown campus are paced with the exception of the self-paced math program for the lower levels.

In their math program,
     Math 1-10 is K-3 math
     Math 1-20 is Grade 4-6 math
     Math 1-30 is Grade 7-8 math

     I was excited to find out that they are currently working on a new math curriculum, so most of our conversation revolved around this and the materials they use for the rest of the visit.
      The students in the self-paced math program used several resources.  As in BVC, different instructors preferred different textbooks. 1.      Foundations for Success in College Math, the text we use for Basic Math 1 was also used at Aurora College.  When you order this book, you can choose the sections you need and make a personalized text.  This book was more widely used in their program than in ours.
2.            They also used a set of self-study modules that I thought would be useful for us to take a look at.   They were called Fundamental Level Math 2 and they were from the Province of British Columbia.  I looked at the whole numbers module (ISBN 077189383-3) and the fractions module.  The modules come with tests and answer keys.


Aurora College orders them from the Queens Printer Government Publication Services
250-387-6409
1-800-663-6105

They can also be ordered from Grassroots Press.

     I also investigated some other places where students can work on literacy skills in Yellowknife.
1.       Tree of Peace Friendship Centre
 I had a phone interview with this centre.  It teaches 1-10 and 1-20 courses which are the lower grades.  The students work at their own pace.  The lady I spoke to on the phone was not sure how long they could take to finish a course.  The students arrange for their own funding.  Apparently the funding is very complicated as students get funded by the federal and territorial governments, and different treaties have different funding rules.  I was told that although they use Aurora College materials, the centre is not connected to the college in any other way.  The centre uses a holistic approach and if students have social, personal or other issues, they have access to help.

2.      Native Women’s Association of the Northwest Territories
This organization has an adult learning centre as well as well as many other services.  Their mission statement is as follows.
“Provide training and educational programs for Native Women in the Western Arctic, so they can function most effectively in areas that affect our lives economically, socially, educationally, emotionally, culturally and politically.”

They provide training in English, math, and computers.  They are self-paced and run from 9-2, Monday to Friday.

     Yellowknife is a unique and interesting city to visit.  I put some photos on the P drive for anyone who would like to take a look.
P:\1 ADMINISTRATION-MISCELLANEOUS\Pictures\2014\Yellowknife April '14

Wednesday 4 June 2014

Media and Copyright

Yesterday, the curriculum team, joined by BVC media teams from various college departments, met with the college's copyright officer, Sheila Swan, to learn more about copyright and media use. Sheila addressed copyright with regards to print materials, videos and video housing, textbooks and accompanying digital assets, internet materials, and much more. When considering using media, Sheila suggested asking yourself the following:
  1. Is your audience internal (within the college) or external (outside of the college)? If your audience is external, the fair dealing guidelines do not apply.
  2. Is the project non-profit or for profit? If your project is for profit, the fair dealing guidelines do not apply.

A great deal was covered in the meeting, but here are a few tips that I found particularly useful:
  • For any media housed on a site that is based in another country, we must comply with that country's copyright laws. For example, YouTube is based in the United States, so if we produce a video and upload it to YouTube, it must comply with U.S. copyright laws. As well, users must comply with YouTube's license agreement.
  • Don't use copyright infringing material. If you find a video on YouTube, make sure that the person who posted the content is the owner of that content. For example, if a person has posted a Discovery Science video on his channel, but does not own the rights to that video, don't use it. Instead, post the video from its original source.
  • Copyright does not specify what citations must look like. The college has adopted the APA citation style, but we are not restricted to using APA. 
  • A BVC copyright statement needs to be included on any works we publish.
  • For more copyright information and resources, see: Copyright at Bow Valley College.
Thank you to Sheila for meeting with us and for helping clear the muddy water. Have copyright questions? The Fair Dealing Guidelines and the Copyright Permission Chart, provided by Sheila, are great places to start.




Over 180 curated Math videos on CEFL YouTube channel.



The Media Development Team is happy to announce that Math Video Curation project MD0002 is completed.

Please join us in thanking the Mathematics Video Curation team for their time, dedication, skills , and effort contributed to this project. 




Thank you very much for an outstanding job!

§  Brenda Thomas     §  Michael Gaschnitz
§  Bev Kosior             §  Glenna Healey
§  Darcy Milino         §  Melanie Macdonald
     §  Penny Marcotte

We started the project in December of 2013. This wonderful group of instructors worked very hard to first identify the areas of curriculum that are most in need of instructional videos, and then they curated  effective Math instructional videos and  web resources that would benefit the CEFL students.

As a result, we were able to collect over 180 Mathematics videos.  Here is a Mathematics video and website list  that was curated during the project.

The videos are currently residing on our department's YouTube channel:

                                                                                                         

Congratulations again to the project team and Thank you to all who supported us throughout the project!

Media Development Centre



Monday 2 June 2014

Adults with Disabilities Using Technology to Learn with the Speech-Assisted Reading and Writing (SARAW) Software

Published June 2, 2014

Since 1993, students with disabilities at Bow Valley College have been improving their reading, writing, and math skills using a unique and innovative computer technology called SARAW.[1] These are some of the things learners say about how SARAW has made a difference in their lives:
“At work, I can find things better because I can find the word on the package or box. My boss has noticed I can read better. When I am grocery shopping I can see the words easier.”
“Reading to my children at night, glad to be in this program and hope to be here for a long time.”
“Read stories to audience, read stories that I wrote about my brother.” (Gardner 2005a, 25-26)
At Bow Valley College, adult literacy practitioner Belle Auld has coordinated the SARAW program for the past fifteen years. Belle told me about the program’s history and development.
The SARAW software was created in the early 1990s. The Neil Squire Society in Burnaby, world renowned for designing technology for people with disabilities, collaborated with Capilano College in Vancouver, who are known for innovative literacy programming. The software is adult based and teaches reading, writing, and math skills to adults with disabilities at below grade 7 level.
IMG_20140602_102146

The SARAW software was originally designed for people with physical disabilities who are non-verbal. “However, people with intellectual as well as physical disabilities have used the program to help them strengthen their literacy skills” (Gardner 2005b, 1).  SARAW was recognized nationally by the Governor General’s Flight to Freedom Award sponsored by Canada Post in 1996. The award “honours a project showing long-term achievement, innovation, leadership and organizational excellence in literacy” (Neil Squire Society 1999, 1).

Belle explains how the technology works.
The SARAW computer has reading and writing sections and within those are reading and writing activities. The reading activities include reading authentic writing done by other people with disabilities and an accompanying workbook that builds on comprehension as well as other activities. The software also has a sounding board that I call the phonetics part of the program. It has literacy games — reading and writing activities in game format. The math portion of the program has skills starting with counting and going up to dividing. It focuses on everyday activities such as going to a restaurant, sharing the bill, figuring out taxes, going shopping and figuring out if you have enough money, writing cheques, and math games. All of this is customizable to each student. The student can choose how much the computer speaks, they can choose the voice, and they can choose the word-predict feature.
SARAW software can also be used with assistive technology.  Adults unable to operate a standard keyboard can use special adaptive equipment to operate the computer. For these learners, SARAW is the only way for them to participate in a literacy classroom.[2]

Evolution of the SARAW Program
Belle told me how the SARAW program at Bow Valley College has evolved over the years.
We’ve built a whole program around the SARAW specialty software. In addition to SARAW software [and the Companion to SARAW exercise book] , we have daily life activities and fun worksheets, crossword puzzles, menu math, an iPad with a user-friendly manual and appropriate apps, Luminosity brain training and brain games, Mavis Beacon teaching-typing software, and box cars and one-eyed Jacks (math games using cards and dice).[3] Students work one-on-one with a tutor. Tutors are either volunteers or support workers (working with community agencies). I set up a training program to train the tutors. They attend up to two hours a week in the classroom with the students. We’re open daytimes, evenings, and Saturdays.
Belle is always looking for ways to improve both the SARAW program, and services for people with disabilities. In 2003, she initiated a national research project called LaDs or the Literacy and Disabilities Study. The project had dual purposes. She wanted to explore issues in adult literacy for people with disabilities and she wanted to investigate how the SARAW software is used in different settings and delivery models. In exploring the connections between adult literacy and disabilities, the LaDs study (researched and written by Audrey Gardner) discovered some disturbing facts. For example, people with disabilities make up a disproportionate amount of the 42 percent of Canadian adults who function at the two lowest literacy levels (Movement for Canadian Literacy qtd. in Gardner 2005a, 4). Numerous studies on literacy and disabilities indicate that people with disabilities are disadvantaged when accessing programs to strengthen their literacy skills (Gardner 2005a, 4).

The study revealed more troubling information:  all national surveys on either literacy or disabilities have identified that people with disabilities are disadvantaged when accessing education, employment, housing, and other community services.
  • Fifty percent of adults with disabilities have an annual income of less than $15,000.
  • Nearly 50 percent of adults with limited literacy live in low-income households.
  • Only 56 percent of people with disabilities are employed, and most are working at low-paying jobs.

There is a serious lack of public awareness about adult literacy and disabilities. Stereotyping and assumptions about the capacity of people with disabilities to learn and to work are harsh social barriers (Bow Valley College and Neil Squire Society 2004). The LaDs study led to the development of several useful resources for adult literacy practitioners working with learners with disabilities:
  • a fact sheet on literacy and disabilities
  • a book of learner stories
  • the SARAW Survey Report documenting how SARAW and other activities and factors contribute to effective literacy learning
  • An effective practices guide (see references for more information)

This research was a catalyst for Belle’s next project: The Literacy Survey of Disability Serving Agencies. Belle began thinking about inclusion and what an ideal inclusive adult literacy program would look like.[4] She has this to say about her development process.
I knew about the focus on inclusion in the disability world and I didn’t think SARAW was exactly inclusive… Although clients are coming to the college setting, it’s one student working with one volunteer or support worker [in the SARAW classroom]. I interviewed twenty-nine agencies in Calgary about what they wanted to see in inclusive adult literacy programming for learners with disabilities… We got their input and then created it. Thanks to an anonymous donor coming forward at just the right time, we were able to create the Adult Basic Literacy Education (ABLE) inclusive classroom where people with diagnosed physical and/or developmental disabilities work alongside people without disabilities.  All the learners are working at about the grade 2 to 4 level.
An offshoot of the SARAW program, the ABLE program started in 2008 and includes the ABLE Reading and Writing class, ABLE Financial Literacy, and ABLE Computer Literacy ( to be introduced this summer). While these are positive developments, the SARAW program also has its challenges. The program has been steadily growing over the years, and currently is full to capacity with thirty-eight learner and tutor pairs. The wait-list for learners wanting to attend the program is currently fifty-eight people, the most it’s ever been. That means students are waiting an average of one-and-a-half to two years to get into the program. According to Belle,  “the challenge is trying to achieve the balance between the needs of those in the program for long slow progress — learners with low literacy and disabilities need the long slow progress — with the needs of the people waiting to get into the program.”

Belle finds that another challenge in the program is staff turnover among the community support workers who support the learners as tutors. Few tutors work with more than one learner — most work one to one (one learner with one tutor). “One student started with me and in eight weeks, he had five different support workers. So there is no continuity for the student. And it’s a huge amount of work for me to train all of them as tutors” Belle explains.

Belle has a wish list for expanding the SARAW program. “I would love to see the program doubled. If we could get the funding we could have two classrooms.” She would also like to see the program use more iPad apps complete with instructions in the current iPad user manual, which would require time for research and development.

Her biggest wish is to create what she is calling SARAW Plus. “We would use what works really well in the current SARAW software, add activities incorporating essential skills and pre-employment skills, and create it as an app that can be used on a smart device, either an android or an iPad. I see this as a joint project between Bow Valley College and the Neil Squire Society.”

In the meantime, Belle continues to grow and improve the SARAW program. She recently   finished a research project called Answers May Vary, designed to identify strategies, resources, and effective practices for adult literacy tutors working with learners with disabilities. She plans to use this information to produce a guide book and videos to be used by tutors both in the SARAW classroom, and in community agencies working with people with disabilities.

Belle photo
Belle Auld, coordinator of the SARAW program at Bow Valley College
 

References
Auld, Belle. 2007. Literacy Survey of Disability Serving Agencies. Calgary: Bow Valley College. http://centreforfoundationallearning.files.wordpress.com/2012/05/literacysurveyofdisabilityservingagencies.pdf
———. 2014. Answers May Vary: Literacy Strategies, Resources, and Effective Practices for Adult Learners with Developmental Disabilities. Calgary: Bow Valley College.
Bow Valley College and Neil Squire Society. 2004. Literacy and Disabilities (LaDs) Fact Sheet. Calgary: Authors. http://centreforfoundationallearning.files.wordpress.com/2012/05/literacyanddisabilitiesfacsheet.pdf
———. 2005. Literacy and Disabilities Study (LaDs) Learner Stories. http://centreforfoundationallearning.files.wordpress.com/2012/05/ladslearnerstories.pdf
Gardner, Audrey, 2005a. “‘It Gets in Your Brain…’ Effective Practices in Adult Literacy Using Speech Assisted Reading and Writing (SARAW) with People with Disabilities.” Calgary: Bow Valley College and Neil Squire Society. http://centreforfoundationallearning.files.wordpress.com/2012/05/ladssaraw_itgetsinyourbrain.pdf
———. 2005b. Literacy and Disabilities Study (LaDs) Survey Report. Calgary: Bow Valley College and Neil Squire Society.  http://centreforfoundationallearning.files.wordpress.com/2012/05/lads_sarawsurveyreport.pdf
Neil Squire Society. 1999. The Companion to SARAW: An Exercise Workbookhttp://en.copian.ca/library/learning/saraw/contacts.htm
______________________
[1] For our purposes, the term disabilities includes physical, intellectual, visual, psychiatric, and hearing-related disabilities.  It does not include learning disabilities, although people with disabilities may also have learning disabilities.
[3] Box cars and one-eyed jacks are math games using cards and dice. (It’s also the name of a company that develops educational games.) They are part of a selection of different books and kits available from “Shuffling into Math” for K-3, including money kits, books, and more advanced math materials. See www.boxcarsandoneeyedjacks.com
[4] “Inclusion goes beyond mere physical presence to encompass meaningful participation” (Bailey and Wagar qtd. in Auld 2007, 1).