Sunday 29 December 2019

2019 wrap up

This year I moved from the UK back to Japan (for a 4th time) and started a new job at the International University of Japan in Niigata. It's a really interesting uni, being entirely EMI by necessity as only 15% of the students are Japanese. Most of the 300 students come from East Asia, Central Asia and various parts of Africa. It is also surrounded by koshihikari rice fields, snakes and bears. 

Last year I wrote about my thoughts on twitter. This year I have tried to be it off it less but it I'm not sure I have been all that successful. Twitter is still an awful form of communication. and probably the easiest way to fall out with someone who you would probably get on with in real life (or have previously gotten on well with in real life). Perhaps 2020 will be the year when I finally kick the habit? 

This year I also wrote 10 blog posts, three book reviews and spoke at three conferences, ELTIreland, ExcitELT, and Nanzan langauge education seminarI did not attend the big conferences this year because the price would have been almost half of my entire research fund. The conferences I did go to were all relatively small and two of them were 1 day events with very low fees to attend and interesting formats. I think there is something to be said for these kinds of smaller conferences with novel formats. I certainly got the chance to meet and talk to a lot of other teachers. 

For example, I managed to finally meet people I had known for ages on twitter such as Formerly SwanDOS Rachel Fionda, Marjorie Rosenberg, Peter LahiffLou McLaughlin, Liam Tyrell, Tim HampsonPeter Brereton, Ted O'Neil,  Chris Farrell, and Darren Elliott (of lives of teaches fame). Apologies if I missed you out...I'm very forgetful! I also unfortunately missed the chance to meet Leo Selivan and Marek Kiczkowiak as I was passing through Liverpool. Maybe next year?

Here were the top 5 posts of this year by views. 

1. The authenticity trap 
2. Evidence based resources 
3. Taboo ELT
4. Mogg's Rules 
5. tooth Fairy expertise  (my personal favourite) 

the top 5 posts of all time haven't really changed. 

1. MA or DELTA?
2. Does Swearing show a lack of IQ
3. Skimming and scanning
4. left brains and right brains in TEFL 
5. Learning styles: facts and fictions



Freire-well 


This year I also had a piece published in EFL magazine on Freire that generated a little bit of controversy. The piece was my personal reaction to a book that some claims is very important to the teaching profession. 

It occurs to me, rather belatedly, that twitter has something of an amplifying and distorting effect. You can get the impression that ideas are really popular and important when really it's just a twitter thing. A political party can seem really loved or a celebrity can seem reviled when in reality it's just the impression twitter creates. I think this is probably true for critical pedagogy. In fact, the editor of one publication I sent the article to replied saying that though I made valid points the book was just not well-known or part of main stream teachers' reading lists to be of interest to readers. 

Likewise, one distinguished member of "TEFL royalty" told me, much to my surprise, that he had never heard of the book and similarly very few hands went up when J.J. Wilson reportedly asked teachers at a conference to raise their hands if they knew it. Writing about Freire then is a bit like writing about NLP. Most people will shrug but the fans will really come for you

Am I Trump in this analogy?

So I think I got sucked into spending time on something that isn't really that important to most teachers and I'm probably done with the subject but to fans of critical pedagogy I ask the same question I ask everyone else on this blog, -where is your evidence that this stuff works? 

Is blogging over?


And finally for this decade....EBEFL asks....is blogging over? Perhaps it's how little time I spent on twitter or perhaps it's who I follow or twitter's algorithm but I can't remember seeing that many new bloggers or blog posts going around this year. In contrast, everyone seems to have a podcast! So many in fact that I can no longer keep up with them all (though you can read reviews of some of them here, here and here) Is podcasting the new blogging? 


Anyway, as always, thanks for reading and have a great 2020. 








Wednesday 18 December 2019

Try this, it works! 4....3....2...


Paul Nation's 4/3/2 1 activity is often cited as an excellent way to improve a students spoken fluency. I have used it myself and incorporated it into a lot of materials. It's evidence based after all, right? 


Right? 


The other day it suddenly hit me that I'd never once bothered to check if the method itself had any evidence to support it at all. Here's what I found. 

The method 


In a paper from 1989 Nation describes the technique which originates in a 1983 paper by Maurice (if anyone has a copy I would love to read it). Ask students to prepare a talk on a given topic but don't let them make any notes. Pair the learners up and give them 4 minutes to talk about it. Their partner should not interrupt. 


Next, the speaker and listener switch and the process is repeated. After this the students switch partners and repeat the process but this time with the time reduced to 3 minutes. In the final iteration the time is reduced to 2 minutes. The point of this is to get students speaking more fluently. 

In order to test the efficacy of this method Nation recorded students doing the activity and then measured various aspects of the performance. For example her measured, the number of words per minute, the number of hesitations and the number of repetitions. Nation also measured accuracy by counting the number of errors per minute. 


Results 

  • The 432 technique seemed to lead to improvements in student fluency as measured by words per minutes (WPM), and a reduction in hesitation and repetition. 
  • There was 'some' improvement in student accuracy. 
  • Students seemed to get better at only including important information (control of content). Nation believes this shows students may get better at condensing information. 

Some thoughts



The study was N=6. That's very very small. Nation claims that despite this "the consistency of the results indicates that their gains from the activity would be typical of other learners" but with 6 advanced students can he really make these claims? 

There seems to be a lot missing from the methodology section of this paper. What was classed as a mistake? how long was a hesitation and so on. There are no transcripts to look at to see what kind of language the students produced and we get no information about whether any students finished before the allocated time and if so how that was recorded. 

Did students take it slowly on the first 4 minute round because they had some much time? would student have been able to speak at the "final" speed if they had only been given 2 minutes from the beginning? If the time wasn't changed at all would students speed up anyway? 

The "audience" students (those listening) do nothing other than listen. Whenever I do this activity I ask students to take notes to answer questions later on so they are at least paying attention. I also tend to start with a much shorter initial time. 4 minutes seems like a really really long time. The IELTS speaking test "long turn" only lasts for 2 minutes. 


Replication


I was curious if anyone had replicated the study, perhaps with a larger cohort. It turned out they had. 

Nation 


Nation himself repeated the study 2 years later with Supot Arevart, only this time with 20 intermediate level students. This time, the authors give a bit more detail about the procedure. It seems that students were grouped in fours and spoke once, listening three times (which seems a bit dull for a speaking lesson). This paper also contains transcripts of participant speech. 

Results

  • Again there was an increase in WPM (18 more words from the first to the last performance) though it is not clear if the repetition or time reduction is the cause.
  • Individual student results are listed in this paper and show that whereas some subjects made great gains (an increase of 48 WPM) others did not. One student actually got worse (though that was a student with an very high initial WPM count). 
  • Hesitations decreased by an average of around four fewer hesitations by the 3rd round. Again, the individual data shows us that the results were much more varied at an individual level with one participant going from 10 to 18 hesitation by the final round (incidentally the same student who did not make WPM gains).  

De Jong and Perfetti (changing the topics)


This paper tested 4/3/2 with a group who repeated the same topic and one that got a new topic every round. They found that even if the topics differed for each time the levels of fluency increased. This would seem to indicate that the reduction in time alone can prompt students to appear more fluent. However, the authors also found that only those who had repeated their topic showed improvement in the posttest. 

Boers (keeping the time constant)


Another two replications were carried out by Boers who is quite critical of Nation. He raises the following issues:
  • Nation claims that this is a well-researched technique (Nation and Newton 2009) when in actual fact there are very few studies into the technique. 
  • Nation research only shows improvements within the 4/3/2 activity itself. He does not show that this permanently affects a students fluency. 
  • Although Nation has claimed that 432 also improves accuracy and complexity, the actual results do not support that claim. 
  • Boers wonders if the repetition alone, without the time pressure, may have the same effect. 
Boers studies (2014, N=10 and 2015, N=20 with Thai) introduced a control group with no time reduction (3/3/3 as well as 4/3/2)

Results

  • As with nation Boers found increases in the number of words and WPM from the first to the third round. 
  • Both papers found the number of disfluencies (hesitations) decreased. 
  • They also found that in the time-constant group students improved as well, though not by as much. 
  • On striking finding was the amount of verbatim duplication in the shrinking time condition. This was notable to the authors as in some cases up to 50% of the texts were exact repetitions. 
  • "There was no compelling evidence of increased lexical sophistication and no evidence of increased syntactic complexity."

Boers found that participants seemed to repeating the same structures and this held for both replications. Although students got faster errors did not decrease significantly and in some cases they increased. Boers notes that as students were just be repeating the same thing without any getting and input on, or evaluation of their performance, this is hardly surprising. 

Take away


Most of the research shows that repeated practice will increase fluency as measured by WPM (or syll/sec). However it will probably not do much for accuracy or complexity. As Boers notes "that the 4/3/2 technique is recommendable if the sole aim of the activity is to push fluency. However, if the objective is to foster other". But it's worth noting that you will get an increase in fluency merely by reducing the time students have, even with different topics. You can also get a decent increase in fluency by having students repeat the task with no reduction in time. Simply put, rehearsing a talk and repeating it will tend to improve fluency. A modified 432 in which students get feedback on their performance (from other students or the teacher) and then repeat it may help with accuracy and complexity. But as with many things "more research is needed".