Categories
Coordination Teaching & Learning

Authentic learning, real world meaning.

Originally posted on April 28, 2019 @ 7:40 am

After reading Mary Myatt’s “The Curriculum”, I’ve been beginning to spend some time thinking about how the IBDP can provide opportunities to make the students work more purposeful via opportunities for authentic performance. In her chapter on Beautiful work she writes:

“children’s work should be honored. It should be of the highest quality and it should also have an audience.”

She goes on to quote Ron Berger “Once a pupil creates work of value for an authentic audience beyond the classroom – work that is sophisticated, accurate, important and beautiful – that student is never the same”.

So far I’m thinking about elements common to all Diploma students:

  • The Group 4 project: this is a collborative 10 hour project that student teams composed of students from different subjects work on together. The project is not assessed but is mandatory. The theme is set by the school and in four schools over 10 years this has usually involved the HOD Sci using a word like colour or survival. However there can have some real world stimulus like the UN sustainable development goals to focus the project. The students would design experiments along this theme and then present their project to the wider school community and guests.
  • CAS: Im not an expert here by any stretch and you could argue that CAS is already the most authentic part of the DP. What could be more authentic than working on projects that have direct application in the real world? but how many projects in schools around the world actually do? Is there scope here to raise the bar? the students CAS project could also center around a real world stimulus, the activity stage focussed on taking action in some way, again an exhibition to the community could be used to sum up students work in some authentic way.
  • TOK: TOK has a heavy summative assessment component with a 1600 word academic essay and ten minute presentation, I would be loathe to add to this…but, the presentations could definitely be delivered to a wider audience..school assemblies, some other exhibitions or the community could be invited to the assessment itself.
  • Extended Essay: With over 40 hrs of work and 4000 words in the making the extended essay is a beast for most students. There are issues with it and you could already argue that, as a piece of original work, it has real world application. This year we are taking the small step to publish our students TOK and Extended Essays together in a volume, a bit like a journal, with work from some of our Visual Arts students work being used as the cover pieces. But I also like the idea of having student’s undertake a more public viva, like a PhD defense. Clearly, an EE is not a PhD but can we make it so that the process is less tick boxy and more formal? I am keen to hear what other schools do.

With all these things I think about scalability. What works in a small school doesn’t necessarily work in a very large one. Ok, sit through 2 group 4 presentations but 30? So instead schools could ensure that some students present at one event and others at another, so long as each student gets some opportunity to deliver their work meaningfully in the real world.

I realise that my ideas are a little unoriginal and perhaps I am a little bit behind the times (some schools are already doing great work) focussing mostly on presentations and exhibitions, what do you think? How else could we make our student’s DP work have more real world meaning?

Categories
Coordination Teaching & Learning

Models of change and influence: reflections on NPQSL F2F3

Originally posted on March 24, 2019 @ 1:26 pm

Session 3 began with a reflection of a change project that the participants have already been involved in. We were asked to reflect on our involvement in such a project and think about what steps we had taken to ensure change occurred with impact, as well as the threats to change that existed.

Some of the steps we identified were: appropriate staff training, making time for whole team discussion and collaboration both vertically (within departments) and horizontally (between departments), covering classes for teachers so that they could get out and observe new practice, identifying key players (later in the session I identified these as “early adoptors”) who were in position to help bring about the change, space and time for leadership to reflect on options for change, timing of communicating change, and taking the time to develop relationships to build trust.

Some of the threats to change that we identified were: low energy levels and the risk of burnout, too much to do to have time to look at the big picture, general resistance to change, and teacher workload.

We discussed the need to manage our own behaviour to ensure that a project could be a success. In international schools this can have the added complication that your colleagues also take the place of your family and friends; your support network. It can be all too easy to find yourself at home of an evening with your guard down and a comment can be made in front of a friend who is also a colleague.

The most insightful part of the day came when we turned our attention to particular models of change. This is new learning for me and excitingly provides a scaffold to really help me with my own work of implementing the IBDP at my current school. We looked at Kotter’s “8 steps of change” which, to me, is a model that focusses on the stakeholders and the structure of a change project. It provides a useful scaffold for thinking about a change project and therefore aids in planning it.

We then looked at the Kubler-Ross change curve, another model but one that focusses more on the human element and therefore provides a helpful model for thinking about the impacts on stakeholders – not just teachers, but parents and students too. The model could help explain why we have the parental problems we sometimes have and how to move them forward from those issues.

The second half of the day considered leadership behvaiour for successful leadership: Commitment, Collaboration, Personal Drive, Resilience, Awareness, Integrity and Respect. It was interesting during these session to reflect on my previous experiences. I can identify a time when good leaders have catalyzed me and moved me forward in my own thinking, or even got me thinking. None of these characteristics particularly stick out, although I would agree that they are important, but also good leaders, I think, are inspiring. They excite and challenge you to be more in your thinking and behavior.

Another useful point of the day was when we considered Roger’s adoptive categories. This was really interesting. It presented a way to think about approaching the role out of a project. Thinking about the last eight months, I can definitely idenftify colleagues who were early adoptors or innovators, providing support to the changes I have been trying to bring about. Knowledge of this model, once again provides a useful scaffold but one for building relationships as we move through the change process. Here we also identified the category of laggards, and sought reasons as to why individuals may resist change and how we can overcome this.

Before the final coaching session where we were able to spend time thinking about the development of our project, we considered the different styles of leadership and when these may or may not be appropriate. It made me once again think of prior leaders and really question what they were doing. I remember being frustrated at times, when decisions needed to be made and they weren’t – I put this squarely at the feet of leaders who were using an inappropriate leadership style for the situation. On reflection, I now have some clarity about why this year is proving so challenging. Sure, I have been teaching the IBDP since 2008 and guidance counseling since 2015, and I am no stranger to challenges and setting up new programs having had some particularly trying years doing so particularly 2016-2017, where my guidance counseling hours were reduced but the class sizes remained the same. That year I was setting up a program, teaching four classes of Biology, one class of TOK and running the DofE’s International Award. It was a frustrating year where I felt unlistened to and unsupported by leaders who just didn’t seem to get it. This year is different. My leaders get it. They are supportive but the real challenge comes not from learning another new job; DP Coordination, but learning this new job and learning how to effectively lead it at the same time, in addition to learning about college counseling in Asia.

Categories
Education Teaching & Learning

Side effects in Education

Originally posted on March 22, 2019 @ 6:05 pm

Recently, in my NPQSL course we have been asked to reflect on the question “What is the moral purpose of education?” Education can be argued to have many moral purposes, and it comes down to an educators point of view; this is an opinion that I think many teachers and leaders would accept.

For example you could argue that the moral purpose of education is to allow individuals to experience a fulfilled life where they can experience and appreciate the whole of their humanity. You could also argue that education’s purpose is to serve society and better the community at large.

Where ever you stand on this spectrum, the very fact that there is a difference of opinion here makes education, as a profession, a little unique. Doctors, for example, would largely agree that the moral purpose of education is to save life.

In what works can hurt, Yong Zhao asks if educational research should be concerned with side effects in education. However appealing this analogy is misleading. In medicine there is a clear moral purpose: do no harm. This is a moral purpose that all medics subscribe too. Medics are driven by the desire to save and prolong life.

No single unifying moral principle exists in education and different schools and different teachers have different moral purposes.

Yong Zhao cites the medical profession as one that requires researchers to investigate side effects as well as the main affects of interventions. In light of calls for educational research to adopt similar methodologies to medical research and become more scientific he argues that this is an area that is overlooked.

Educational research is exclusively focussed on what works without looking at how much it hurts.

Reasons for this may be that education is universally perceived as good, although I would argue that medicine is also. I think the reasons that the education does not consider side effects so much is that the moral purpose of education is much less clear. As well as, this damage due to eduction may take a very long time to be observable and you can only measure that which can be observed – also there are huge numbers of conflating variables.

Zhao writes that education is dominated by a narrow focus on cognitive abilities derived in a small number of subjects measured by standardized tests so that scores in these tests become the measure of effectiveness. Other outcomes are rarely measured so we don’t know about any adverse effects.

More evidence is unlikely to stop the battles within education, but a consideration of side effects might. The education pendulum swings but there is really no progress. I can agree with some of this as any look at the history of the debates does see that these arguments do go on quite a way back.

A way forward to resolving the traditional/progressive debate may be the consideration of both main and side effects in education interventions.

Zhao highlights that direct instruction is effective but can stifle creativity and reduce confidence. He cites the progress of some Asian countries, where students have a lot of knowledge drilled into them but students suffer from lack of confidence, versus Western countries where students know less but have more confidence, as evidence that what works can hurt.  I wonder if this may be a relic of the Dunning-Kruger effect. Student may well be further along the knowledge curve and therefore less confident.

Many interventions that have sought to improve reading scores have reduced access to other subject areas, by eliminating subjects to make more time for reading prep. The negative effects of these interventions are now well documented: reducing access to other subjects only serves to reduce literacy scores.

I do think that by focussing only on what can be measured can lead us down the wrong path. Measurement is important and does have a place, but there are elements of human life that we don’t know how to measure or have barriers to measuring like cost and time. We shouldn’t ignore these areas.

Categories
Teaching & Learning

Developing a progression model for IBDP biology

Originally posted on November 24, 2018 @ 4:00 pm

I recently completed Daisy Christodolou’s “Making good progress?”. You can see my notes here. In the final chapters, after presenting an argument building up to this, she outlines the key aspects of what she terms a “progression model”. In this post I want to line up some ideas about what this may look like in delivering the IB DP Biology course.

In her book Christodoulou suggests, and I agree, that to effectively help students make progress we have to break down the skills required to be successful in the final assessments into sub-skills and practice these. This is a bit analogous to a football team practicing dribbling, striking or defending in order to make progress in the main game.

In the book she also stresses the difference between formative and summative assessments, what they can and can’t be used for respectively and why one assessment can’t necessarily be used for both.

A progression model for biology

A progression model would clearly map out how to get from the start to the finish of any given course, and make progress in mastering the skills and concepts associated with that domain. In order to do this we need to think carefully about:

  1. What are the key skills being assessed in the final summative tasks (don’t forget that language or maths skills might be a large component of this)?
  2. What sub-components make up these skills?
  3. What tasks can be designed to appropriately formatively assess the development of these sub-skills or, in other words, What does deliberate practice look like in biology?
  4. What would be our formative item bank?
  5. What could be our standardised assessment bank?
  6. What are appropriate summative assessment tasks throughout that would allow us to measure progress throughout the course?
  7. What could be our summative item bank?
  8. How often should progress to the final summative task be measured i.e. how often should we set summative assessments in an academic year that track progress?

Key skills in biology

This is quite a tricky concept to pin down in biology specifically and in the sciences in general. What skills exactly are kids being assessed on in those final summative IGCSE or IBDP/A Level exams. I haven’t done a thorough literature review here so currently I am not sure what previous work has been in this area.

However,  I would contend that most final written summative exams are assessing students conceptual understanding of the domain. If this is the case then the skill is really, thinking and understanding about and with the material of the domain. Students who have a deeper understanding of the links between concepts are likely to do better.

In addition, those courses with a practical component, like the IBDP group 4 internal assessment are assessing a students understanding of the scientific process. While it may seem like these components are assessing practical skills per se, they only do this indirectly, as it is the actual written report that is assessed and moderated. To do well the student is actually demonstrating an understanding of the process, regardless of where their practical skills are in terms of development.

Indeed if we look at the assessment objectives of IBDP biology we see that this is very much the case. Students are assessed on their ability to: demonstrate knowledge and understanding and apply that understanding of facts, concepts and terminology; methodologies and communication in science etc.

Sub-skills

How can we move students to a place where they can competently demonstrate knowledge and understanding, apply that understanding as well as formulate, analyse and evaluate aspects of the scientific method and communication.

The literature on the psychology of learning would suggest breaking down these skills into their subcomponents. This means we need to look at methods that develop knowledge and understanding from knowledge. Organising our units in ways that help students see the bigger concepts and connections between concepts within the domain will also help. For more on this see my previous post here. I think that understanding develops from knowledge.

I recently read that Thomas Khun claimed that expertise in science was achieved by the studying of exemplars. Scientific experts are experts because they have learned to draw the general concepts of the specific examples.

Useful sub-skills would be:

  • Fluency with the terminology of the domain
  • Ability to read graphs and data
  • Explicit knowledge of very specific examples
  • Explicit knowledge of abstract concepts illustrated by the specific examples
  • Ability to generate hypothesis and construct controlled experiments

Deliberate practice in biology

Thinking about these sub-skills, then, we can see what may constitute deliberate practice in biology and thus what would make useful formative assessments within the subject.

Fluency with the terminology can be gained through the studying of terminology decks like those available on quizlet. In addition, the work of Isabel Beck. Suggests that learning words isolated from text is not that helpful to gaining an understanding of those terms. To gain this, students need to be exposed to these words in context. Therefore there is a lot to be said for tasks and formative assessments that get students reading. Formative assessments could then consist of vocab tests and reading comprehension exercises of selected texts.

Reading and interpreting data can be improved through practice of these skills. This is an area where inquiry alone won’t help students make progress. Students need to be shown how to interpret data and read tables and graphs before making judgements. Ideally, in my opinion they should do this once they have learned the relevant factual knowledge of a related topic. Formative assessments focussing on data interpretation should therefore come a little later once students have covered a bulk of the content.

To build up conceptual understanding, students need to be exposed to specific examples related to those topics as I outlined in this post. Tests (MCQs) that assess how well students know the specific details of an example could be useful here to guide learners to which parts they know and those they don’t.

Following this we can begin to link examples together to build knowledge of a more abstract concept. Concepts can then be knitted together to develop the domain specific thinking skills: thinking like a biologist.

Formative assessments

Formative assessments could take the form of MCQs but as outlined above, vocab tests, reading comprehension activities, and other tasks may well have their place here.

Summative assessments for measuring progress

I am now thinking that to truly assess student progress against the domain, individual unit tests just won’t cut it. As Christodolou argues, summative tests exists to create shared meaning and do that need to be valid and reliable. Does scoring a 7 in a unit test on one topic of an 11 topic syllabus mean that the student is on track to score a 7? Not necessarily. Not only is the unit test not comparable to the IB 7 because it is only sampling a tiny portion of the full domain, but the construction and administration of the test may not be as rigorous as that of the actual IB papers.

Clearly it isn’t ideal to use the formative assessments described above as these are nothing like the final summative assessment of the course, plus their purpose is to guide teaching and learning, not to measure progress.

I would argue that summative assessments over the two-year course should use entire past papers. These past papers sample the entire domain of the course and performance against them is the best method of progress in the domain. A past paper could be administered right at the start of the course to establish a base line. Subsequent, infrequent, summative tests, also composed of past papers could then measure progress against this baseline.

Why should summative assessments use past papers? What not use unit tests? Unit tests, aggregated, is not the same thing as performance on a single assessment sampling the whole domain. They cannot produce the same shared meaning as an assessment that samples the entire domain. In addition the use of many single unit, high stakes tests will cause teaching to the test as well as much more student anxiety. Instead lots of formative testing and practice of recall should help to build students confidence in themselves.

Categories
Education Teaching & Learning

Remembering stuff

Originally posted on November 9, 2018 @ 9:00 am

Someone once said that the educational debate in the UK is lightyears ahead of the debate internationally. It is a shame really because you would hope that the minds engaging with educational debate from every country would add to making the debate more urgent.

The modern education system is sometimes characterised as being one where kids are mindlessly forced to rote learn and that we have to fight against this industrial factory like education. It’s anecdotal I know but I have worked in five schools and visited a few more and never seen anything like this. Where are all these schools that are battery farming their kids? Most schools are definitely more progressive in their outlook than traditional, in this sense. Although I would contend that good schools and teachers in them know when to adopt different techniques as necessary.

If you engage in debates about the aims and methods of education it is common to read thinking like this, a popular view exposed by many educators, and widely influenced by romanticism:

“The point I am making is that DI is very successful in a certain thing that we are measuring. Remembering stuff. For an education system that measures how well you can remember stuff sat at a table for two hours (of which the DP is really no different from any other offering) then I’m sure DI is highly effective…. but really why do we care? We all pretty much know that that such a metric is a) a terrible way for Unis and businesses to know that they have recruited an effective colleague b) it just isn’t they way to make it in the world past examinations. Once our smartphones can answer any knowledge based examinations (not far off from now) then DI will just about be a waste of everybody’s time. What I’m interested in is what type of instruction leads to creative, communicative, empathetic, collaborative, entrepreneurs and explorers? If DI does that then I’m interested. But first we have to develop a way of measuring these things to see if a certain practice achieves it. Any other research is basically past its sell-by-date, as I suspect are exam based remembering courses.”

Remembering stuff. It’s the practical equivalent of the old, male and stale ad-hominem stereotype trotted out in arguments in post-modernist education discussions at times. It’s uncool. It’s useless and why would anyone who cared about kids and their futures insist on paying attention to it in their classroom or school? It’s outdated. We don’t need to remember because we have google now. We don’t need knowledge because AI will take over our jobs and if we make sure kids know and remember stuff then they are doomed to be job-less, on future the scrap heap, in a world where 65% of the jobs haven’t yet been invented yet.

Why do we care about remembering stuff? 

First, let us not conflate remembering and knowing. They are not the same thing. Technically, remembering is simply the process of retrieving information from your long term memory that you know. Knowing something is having it stored there in the first place. It is possible to know something and not remember it.

This argument above mentions remembering initially but then refers to knowledge based exams and questioning the value of knowing stuff when our smartphones can do that for us later, effectively conflating the two. Both knowing stuff and being able to remember stuff are important. It’s no good knowing stuff and not being able to remember it and you can’t remember what you don’t know. So, in my view education has to help students do both of these things. Why is knowing stuff and then remembering it important and why should we care?

Well, actually, knowing stuff is still pretty important. Believe it or not. Some educator’s use Bloom’s Taxonomy to assert that remembering stuff is at the bottom of the pile, a low order skill useless on its own. However, despite the fact that this taxonomy is not informed by the cognitive psychology of how people learn and it is often presented uncritically, this interpretation is also not what Bloom intended. He put knowledge at the bottom as it is the foundation on which all else is built.

You can’t do much if you don’t know anything. And in fact the more you know, the more you can do, including learn more. The Matthew Effect is a well documented psychological phenomenon by which the rich get richer and the poor get poorer. The more you know, the easier it becomes to learn more and therefore become a life-long learner. That is one reason why we should care, especially if we want to make life-long learners.

These days it is fashionable for international educators to discount knowing  stuff because the international consensus is that 21st century skills are more important than knowledge per se. These 21st century skills are generally recognised to be the four C’s of communication, collaboration, creativity and critical thinking. The line of reasoning is, generally, that we need to teach these skills instead of knowledge.

There are a few problems with this line of thinking. Firstly these skills are not actually 21st Century in and of themselves, and there is no reason to think that they are more important this century than they were in the time of Julius Cesar. Indeed, calls for skills based curriculums go back at least a century already.

Secondly, we can’t have people skilled in these areas who aren’t also knowledgable. Most psychological research to date suggests that creativity requires knowledge and it is only possible to think critically about what you already know about. If you really think about it – to be a great communicator you actually need to know about what you are communicating about. Could you imagine the BBC Earth documentaries not only without a knowledgable David Attenborough but the teams of knowledgeable researchers who write the scripts?

Thirdly, the idea of teaching generic skills is also flawed. The generic skills method of teaching postulates that authentic tasks are ones that mimic real life i.e. science teaching that gets kids to act like scientists. Authors like Daniel Willingham and Daisy Christodoulou point out that the most effective way of teaching skills is through the deliberate practice method. Just as a football team doesn’t practice by playing games, but by breaking the skills needed to win (dribbling, passing) down to their component tasks and practicing those.

In short, knowing stuff (and remembering it) is the foundation of the skills we want to instil in our kids, it is also the foundation of understanding and the foundation of life-long learning.

We all pretty much know that that such a metric is a) a terrible way for Unis and businesses to know that they have recruited an effective colleague b) it just isn’t they way to make it in the world past examinations.

Do we? How exactly do we know this? It seems hard to make that claim as it is pretty much unmeasurable. Even if you could survey every employer and university there are too many conflating variables. We are all products of this system. This claim is made without any proof and the burden of proof lies with the one making the claim.

Once our smartphones can answer any knowledge based examinations (not far off from now) then DI will just about be a waste of everybody’s time.

Oh no. Seriously? We still honestly think this? It is right up there with the “we can google it” claim that knowledge isn’t worth having. In addition to what I have written above I should highlight here the distinction between working and long term memory.

Working memory is what you can hold in your awareness and it is limited. The environment and long term memory are accessible from working memory and long term memory is unlimited in its store.

If we rely on google and not our long term memory we will find it very hard to make sense of the world around us as our working memories will constantly be overwhelmed. We wont be able to chunk information.

Knowledge isn’t just what we think about it is what we think with. If you rely on google on your smartphone you won’t be able to think well, you certainly won’t be able to think creatively nor critically nor communicate well.

Also, google is blocked in China. Do we really want to give governments that much power over knowledge and what we know and can know?

What I’m interested in is what type of instruction leads to creative, communicative, empathetic, collaborative, entrepreneurs and explorers? If DI does that then I’m interested. But first we have to develop a way of measuring these things to see if a certain practice achieves it.

Yes, it can do. DI has been shown to effectively increase what people know and remember. If knowing and remembering is the foundation of being able to think well, collaborate well,  and create well then we shouldn’t just throw these out.

One of the problems with international education in my view is that it over emphasises inquiry learning, making ideologues get hot under the collar when DI and other guided instruction is mentioned. We are trained to think schools are battery farming kids, when to be honest, they really aren’t.  I think we need to try to find out what works in what context and focus on that. I think that there is a place for guided instruction.

Anyway, DI does not always equate with rote learning. Why make it out to be?

I am also now reminded me of this article and this tweet. They are based on similar assumptions and outlooks, and I had wanted to write something in response to these claims.

I agree with Noah Harari when he writes that we often conflate intelligence and consciousness.  I am not convinced that AI can actually know anything. I think it is intelligent and can process a lot of information quickly, but I would contend that to know anything and remember anything you need to be conscious.

If this is true what is the real risk presented by AI? Probably automation of tasks that rely on data processing in some form. Doctoring for example, requires the ability to process symptoms and match them to known illnesses. But not every job is at risk of automation because not every job relies purely on data processing. As Harari contends in his books, the highly prized human jobs of the future will be the ones that rely on human ability to relate to other humans. Therefore Doctors are at much more risk of being automated than Nurses. However, Nurses still need to know an awful lot of stuff as well as be at good at relating to other people to be able to do their jobs.

Humans need knowledge to be able to think well and to specialise in areas. If we don’t ensure that people know things they definitely will not be better placed to work with or instead of AI. The people that are replaced by AI will be the ones who don’t know much.

Additionally, the fact is knowledge rich curriculums demonstrably reduce inequality and with the way social divides are opening up in our modern society perhaps the way for international education to contribute to a peaceful world is to close those gaps? Seeing as DI has been demonstrably shown to reduce social inequality (See Why Knowledge matters by E.D. Hirsch) and as international curriculum’s like the IB is placed in many public schools in poorer areas, I find it’s focus on inquiry teaching quite worrying.

I wonder if international educators can afford to ignore this stuff because generally our kids come from educated and affluent homes?