Archive for the ‘teaching and learning’ Category

No shock – teaching in computing inadequate

December 14th, 2011 by Graham Attwell

No real surprises in this report from the UK schools inspectorate, OFSTED, as reported by the Guardian newspaper.

The Guardian says: “Schools are jeopardising the career prospects of thousands of teenagers by failing to offer compulsory classes in computing, a damning report by inspectors shows.

A three-year study by Ofsted found that in almost a fifth of secondary schools, up to half of 14- to 16-year-olds are not taught computing – known as Information and Communication Technology (ICT).

The subject is compulsory for children aged five to 16 and is seen as crucial to rebuilding of the economy.

Inspectors denounced the quality of teaching in the subject as inadequate in more than a quarter of secondary schools.

Too many ICT teachers have limited knowledge of key skills, such as computer programming, they said.

High-flying students are often not stretched and their interests in the subject are ignored, while many pupils spend computing lessons repeating tasks asked of them a year ago.”

I think the problem goes back years to the days of the European Computer Driving Licence (ECDL). The ECDL focused on the ability to use a standard PC, and despite valiant attemts to produce an open source version, the ability to use standard Microsoft applications. This has little to do with ICT or technology and nothing to do with programming. The ECDL was highly sucessful and permeated school practice, where students were taught how to make powerpoint presentations, use a spreadsheet etc.

However the criticisms of this approach and the weaknesses of teaching ICT are not new. What is interesting is that the issue has now come to the fore. I am not quite sure why, but it is very encouraging to see such a debate.

Same words – different meanings

December 11th, 2011 by Graham Attwell

Here is a fun article from the WalesOnline, reporting on the publication of a new book looking at mistranslations between English and Welsh.

Examples include "the badly translated shop sign which reads “wines and ghosts” in Welsh and "the baffling bilingual road sign that warns Welsh- speaking motorists to beware of “exploding workers”.

But there is a serious side to this. Firstly, despite recent advances in machine translation there is still a considerable way to go. And even when machines can translate language literally, it is much more difficult to translate meanings. We are confronted with this constantly in international projects where whilst the lingua franca might be English and we all think we know what we are talking about, the meanings we make of different ideas and concepts may be very different. In most European languages there is a word sounding something like competence. But our understandings of the meanings of that word vary greatly depending on culture. Secondly, in developing Technology Enhanced Learning we continue to struggle to develop common understandings between different disciplines, with educationalist and developers often seemingly talking completely different languages.

Maybe we need bi-lingual roadmaps!

Raindrops on roses

November 4th, 2011 by Angela Rees

November is Sharing Good Practice Month at the college where I lecture so I thought I’d jump on the Chalkface blog and share two of my favourite things.

I love historypin. It’s a Google Maps mashup where you can upload pictures from the past and compare them to the current street view. You can add video and audio too. There’s heaps of potential for school projects and it’s a great tool for digital storytelling. Have a look at the Beatlemania tour for inspiration!

Continuing with the maps theme, every maths teacher needs to know about the Maths Maps project.  Again using Google Maps this collaborative resource links maths questions to physical places.  For example, a pin in Real Madrid Football Stadium invites you to zoom in and calculate the area of the pitch. Further more, one map can cover many topics and colour coded pins allow for age or level differentiation. There’s more information on how to join in with the project on the edte.ch blog.

#TentCityUniversity

October 25th, 2011 by Graham Attwell

Tent City Uni teach-in outside Bank of England from Jon Cheetham on Vimeo.

The wave of protests against the failure of the world capitalist system and the banking collapse are throwing up all kinds of alternative education events and movements. The #OccupyLondon protest has set up TentCityUniversity and this video reports on one of their seminars.

The Elephant in the Classroom

October 3rd, 2011 by Graham Attwell

I am not sure that I agree with Jon Dron’s idea of  ‘soft’ and ‘hard’ technologies. But there are many ideas worth thinking about in this presentation. Terry Anderson comments “We had a bit of discussion if holist isn’t just a term for appropriate use of all three pedagogical generations, which we argue for in the paper, thus making the need for a fourth term redundant - just as modern distance education uses multiple generations of communications technologies (print, video, web etc.)”

Where is European educational research heading?

September 25th, 2011 by Graham Attwell

My promised post on the European Conference on Education Research, held earlier this month at the Freie Universitat, Berlin.

The conference attracted some 2200 delegates with hundreds of presentations spanning the different networks which comprise the European Educational Research association. the Pontydysgu team were supporting ECER in amplifying the conference through the use of different social media and through producing a series of video interviews with network conveners. On the one hand this meant my attendance at conference sessions was very limited, on the other hand the interviews with eleven different network conveners gave us perhaps a unique overview of where European educational research is heading.

A number of common themes emerged.

First was that the networks themselves seem to be evolving into quite strong communities of practice, embracing not just conference attendees but with extended networks sometimes involving hundreds of members. And although some networks are stronger n one or another country, these networks tend to suggest a European community is emerging within educational research. Indeed, this may be seen as the major outcome of European funding and programmes for education. A number of network conveners suggested that the search to develop common meaning between different educational and cultural traditions was itself a driving force in developing innovation and new ideas.

Secondly, many of the networks were particularly focused on the development of research methodologies. One of the main issues here appeared to be the development of cross domain research and how such research could be nurtured and sustained. This also applied to those considering submitting proposals to future conferences (next year’s conference is in Seville) with many of the conveners emphasizing they were keen to encourage submissions from researchers from different areas and domains and emphasizing the importance of describing both the research methodology and the outcomes of the research in abstract submissions.

There was also an awareness of the need to bring research and practice closer together, with a seeming move towards more practitioner researchers in education.

The question of the relation between research and po9licy was more complex. Despite a formal commitment by many educational authorities to research driven policy, some network conveners felt the reverse was true in reality, especially given the financial crisis, with researchers being forced to ‘follow the money’ and thus tailor their research to follow policy agendas. This was compromising the independence of research institutions and practice.

I asked each of the interviewees to briefly outline what they considered were the major trends in educational research. A surprising number pointed to a contradictory development. On the one hand policy makers are increasingly obsessed by targets and by quantitative outcomes, be it numbers of students, qualification levels or cost per student. The Pisa exercise is one example of such a development.Whilst no-one was opposed to collecting such data, there was a general scepticism of its value, on its own, in developing education policy. Such policies were also seen as part of a trend towards centralising education policy making

On the other hand, network conveners pointed to a growing bottom up backlash against this reductionist approach with researchers, parents and students concerned that educatio0n is not merely a economic function and that quality cannot be measured by targets and number crunching alone. This movement is being expressed in different ways with small scale local movements looking at alternative forms of learning, a movement also facilitated by the use of new technologies for teaching and learning.

Open Badges, assessment and Open Education

August 25th, 2011 by Graham Attwell

I have spent some time this morning thinking about the Mozilla Open Badges and assessment project, spurred on by the study group set up by Doug Belshaw to think about the potential of the scheme. And the more I think about it, the more I am convinced of its potential as perhaps one of the most significant developments in the move towards Open Education. First though a brief recap for those of you who have not already heard about the project.

The Open Badges framework, say the project developers, is designed to allow any learner to collect badges from multiple sites, tied to a single identity, and then share them out across various sites — from their personal blog or web site to social networking profiles. The infrastructure needs to be open to allow anyone to issue badges, and for each learner to carry the badges with them across the web and other contexts.

Now some of the issues. I am still concerned of attempts to establish taxonomies, be it those of hierarchy in terms of award structures or those of different forms of ability / competence / skill (pick your own terminology). Such undertakings have bedeviled attempts to introduce new forms of recognition and I worry that those coming more from the educational technology world may not realise the pitfalls of taxonomies and levels.

Secondly is the issue of credibility. There is a two fold danger here. One is that the badges will only be adopted for achievements in areas / subjects / domains presently outside ‘official’ accreditation schemes and thus will be marginalised. There is also a danger that in the desire to gain recognition, badges will be effectively benchmarked against present accreditation programmes (e.g. university modules / degrees) and thus become subject to all the existing restrictions of such accreditation.

And thirdly, as the project roils towards a full release, there may be pressures for restricting badge issuers to existing accreditation bodies, and concentrating on the technological infrastructure, rather than rethinking practices in assessment.

Lets look at some of the characteristics of any assessment system:

  • Reliability

Reliability is a measure of consistency. A robust assessment system should be reliable, that is, it should yield the same results irrespective of who is conducting it or the environmental conditions under which it is taking place. Intra-tester reliability simply means that if the same assessor is looking at your work his or her judgement should be consistent and not influenced by, for example, another assessment they might have undertaken! Inter-tester reliability means that if two different assessors were given exactly the same evidence and so on, their conclusions should also be the same. Extra-tester reliability means that the assessors conclusions should not be influenced by extraneous circumstances, which should have no bearing on the evidence.

  • Validity

Validity is a measure of ‘appropriateness’ or ‘fitness for purpose’. There are three sorts of validity. Face validity implies a match between what is being evaluated or tested and how that is being done. For example, if you are evaluating how well someone can bake a cake or drive a car, then you would probably want them to actually do it rather than write an essay about it! Content validity means that what you are testing is actually relevant, meaningful and appropriate and there is a match between what the learner is setting out to do and what is being assessed. If an assessment system has predictive validity it means that the results are still likely to hold true even under conditions that are different from the test conditions. For example, performance evaluation of airline pilots who are trained to cope with emergency situations on a simulator must be very high on predictive validity.

  • Replicability

Ideally an assessment should be carried out and documented in a way which is transparent and which allows the assessment to be replicated by others to achieve the same outcomes. Some ‘subjectivist’ approaches to evaluation would disagree, however.

  • Transferability

Although each assessment is looking at a particular set of outcomes, a good assessment system is one that could be adapted for similar outcomes or could be extended easily to new learning.  Transferability is about the shelf-life of the assessment and also about maximising its usefulness.

  • Credibility

People actually have to believe in the assessment! It needs to be authentic, honest, transparent and ethical. If people question the rigour of the assessment process, doubt the results or challenge the validity of the conclusions, the assessment loses credibility and is not worth doing.

  • Practicality

This means simply that however sophisticated and technically sound the assessment is, if it takes too much of people’s time or costs too much or is cumbersome to use or the products are inappropriate then it is not a good evaluation!

Pretty obviously there is going to be a trade off between different factors. It is possible to design extremely sophisticated assessments which have a high degree of validity. However, such assessment may be extremely time consuming and thus not practical. The introduction of multiple tests through e-learning platforms is cheap and easy to produce. However they often lack face validity, especially for vocational skills and work based learning.

Lets try to make this discussion more concrete by focusing on one of the Learning Badges pilot assessments at the School of Webcraft.

OpenStreetMapper Badge Challenge

Description: The OpenStreetMapper badge recognizes the ability of the user to edit OpenStreetMap wherever satellite imagery is available in Potlatch 2.

Assessment Type: PEER – any peer can review the work and vote. The badge will be issued with 3 YES votes.

Assessment Details:

OpenStreetMap.org is essentially a Wikipedia site for maps. OpenStreetMap benefits from real-time collaboration from thousands of global volunteers, and it is easy to join. Satellite images are available in most parts of the world.

P2PU has a basic overview of what OpenStreetMap is, and how to make edits in Potlatch 2 (Flash required). This isn’t the default editor, so please read “An OpenStretMap How-To“:

Your core tasks are:

  1. Register with OpenStreetMap and create a username. On your user page, accessible at this link , change your editor to Potlatch 2.
  2. On OpenStreetMap.org, search and find a place near you. Find an area where a restaurant, school, or gas station is unmapped, or could use more information. Click ‘Edit’ on the top of the map. You can click one of the icons, drag it onto the map, and release to make it stick.
  3. To create a new road, park, or other 2D shape, simply click to add points. Click other points on the map where there are intersections. Use the Escape to finish editing.
  4. To verify your work, go to edit your point of interest, click Advanced at the bottom of the editor to add custom tags to this point, and add the tag ‘p2pu’. Make its value be your P2PU username so we can connect the account posting on this page to the one posting on OpenStreetMap.
  5. Submit a link to your OpenStreetMap edit history. Fill in the blank in the following link with your OpenStreetMap username http://www.openstreetmap.org/user/____/edits

You can also apply for the Humanitarian Mapper badge: http://badges.p2pu.org/questions/132/humanitarian-mapper-badge-challenge

Assessment Rubric:

  1. Created OpenStreetMap username
  2. Performed point-of-interest edit
  3. Edited a road, park, or other way
  4. Added the tag p2pu and the value [username] to the point-of-interest edit
  5. Submitted link to OpenStreetMap edit history or user page to show what edits were made

NOTE for those assessing the submitted work. Please compare the work to the rubric above and vote YES if the submitted work meets the requirements (and leave a comment to justify your vote) or NO if the submitted work does not meet the rubric requirements (and leave a comment of constructive feedback on how to improve the work)

CC-BY-SA JavaScript Basic Badge used as template5.

Pretty clearly this assessment scores well on validity and also looks to be reliable. The template could easily be transferred as indeed it has in the pilot. It is also very practical. However, much of this is due to the nature of the subject being assessed – it is much easier to use computers for assessing practical tasks which involve the use of computers than it is for tasks which do not!

This leaves the issue of credibility. I have to admit  know nothing about the School of Webcraft, neither do I know who were the assessors for this pilot. But it would seem that instead of relying on external bodies in the form of examination boards and assessment agencies to provide credibility (deserved for otherwise), if the assessment process is integrated within communities of practice – and indeed assessment tasks such as the one given above could become a shared artefact of that community – then then the Badge could gain credibility. And this seems a much better way of buidli9ng credibility than trying to negotiate complicated arrangements that n number of badges at n level would be recognized as a degree or other ‘traditional’ qualification equivalent.

But lets return to some of the general issues around assessment again.

So far most of the discussions about the Badges project seem to be focused on summative assessment. But there is considerable research evidence that formative assessment is critical for learning. Formative assessment can be seen as

“all those activities undertaken by teachers, and by their students in assessing themselves, which provide information to be used as feedback to modify the teaching and learning activities in which they are engaged. Such assessment becomes ‘formative assessment’ when the evidence is actually used to adapt the teaching work to meet the needs.”

Black and Williams (1998)

And that is there the Badges project could come of age. One of the major problems with Personal Learning Environments is the difficulties learners have in scaffolding their own learning. The development of formative assessment to provide (on-line) feedback to learners could help them develop their personal learning plans and facilitate or mediate community involvement in that learning.Furthermore a series of tasks based assessments could guide learners through what Vygotsky called the Zone of Proximal Development (and incidentally in Vygotsky’s terms assessors would act as Significantly Knowledgeable Others).

In these terms the badges project has the potential not only to support learning taking place outside the classroom but to build a significant infrastructure or ecology to support learning that takes place anywhere, regardless of enrollment on traditional (face to face or distance) educational programmes.

In a second article in the next few days I will provide an example of how this could work.

UK parody of apprenticeship not a way forward

August 15th, 2011 by Graham Attwell

Having spent much time in Germany working as a researcher around vocational educatio0n and training I am a big fan of apprenticeships. True, the German dual system of apprenticeships has its weaknesses, but in general if offers a respected and high quality training to over half the age cohort. As Wikipedia explains,  there are some 342 recognized trades (Ausbildungsberufe) where an apprenticeship can be completed. They include for example doctor’s assistant, banker, dispensing optician, plumber or oven builder. The dual system means that apprentices spend about 50-70% of their time in companies and the rest in formal education. Depending on the profession, they may work for three to four days a week in the company and then spend one or two days at a vocational school (Berufsschule). This is usually the case for trade and craftspeople. For other professions, usually which require more theoretical learning, the working and school times take place blockwise e.g. in a 12–18 weeks interval.

I have also long bemoaned the poor apprenticeship system in the UK, which was largely abolished with the demise of the Training Boards in the 1970s. Many young people are forced into inappropriate university courses which provide poor training for their career and result in large personal debts. So in theory I should be happy with today’s House of Commons library research, as reported in the Guardian newspaper, which shows that the coalition exceeded its target of creating 203,200 apprenticeships for people over 19 in the 2010-11 financial year, creating 257,000 new apprentices. And I am sure that the headline will be seized on by apprenticeship advocates in Germany and other parts of the world as welcome news that the UK has indeed at last re-established a reputable apprenticeship training system.

Sadly this is not so. The research shows that the biggest increases in apprenticeships are in health and social care and retail; indeed one of the most dramatic increases was in the “cleaning and support service industry”, where 1,930 apprentices were created in the academic year 2010-11, compared with 360 in the previous academic year. In other words the majority of the apprenticeships have been created in low skills service industries.

One of the major problems for comparative researchers is how apprenticeship is defined in the UK. Apprentices are defined as paid employees who gain practical skills in the workplace as well as receiving training outside work. In other words any programme which provides external training for employees as well as some form of practical skills training can be counted as an apprentice and therefore employers are able to draw down subsidies for the training. This goes some way towards explaining why the largest increases were for ‘apprentices’ aged over 25 where numbers nearly quadrupled, from 36,300 to 121,100. And perhaps the most telling figure is in the average length of the so called apprenticeships. In Germany most apprenticeships take three years to complete. But in the UK, apprenticeships lasting longer than a year rose by under 2% while those lasting less than a year increased by over 30% on 2009-10.Overall, the proportion of apprenticeships lasting longer than a year dropped from 47% to 41%. Indeed many appear to have been shorter than 12 weeks!

Whilst any increase in work based training is welcome, the new programmes being introduced in the UK are a parody of the idea of apprenticeship. And sadly the credibility of apprenticeship training as a whole is likely to be reduced, both in the eyes of young people and from the viewpoint of employers.

The perverse effects of government policies

July 31st, 2011 by Graham Attwell
Policy initiatives often have perverse effects. Of course it is perfectly easy to argue the English government’s entire policy on education is perverse.
But the latest announcements that some English universities may choose to offer bursaries to high achieving school students show just how policies can go wrong. the government has been encouraging universities to provide support for students as part of a commitment to widening access. But given the veracity of research showing that those form higher socio economic backgrounds have higher achievement levels in schools, the impact is going to be to reduce access to students from working class backgrounds and acerbate socio economic divides rather than widen access.
The government is also promoting STEM subjects, Science, Technology, Engineering and Maths. However in the present cash strapped situation, following government finding changes, universities may well choose to reduce provision in subjects such as science which require expensive resources and instead promote courses such as management studies which are relatively cheap to offer.
Of course the article is right in stating it will be very difficult to recover loans from students in other European countries. Personally I doubt their will be a flood of incoming students. Firstly the reputation of English universities is falling fast. And secondly most European countries offer free or low fee courses. But even the previous fees regime was seen by most students as unjust and as such the avoidance of fee repayments is seen as socially justified and acceptable.
clipped from www.guardian.co.uk
The prospect of cheaper deals for high achievers was criticised by Gareth Thomas, the shadow universities minister, who said the money should be spent on widening access to students from poorer backgrounds. Nearly a third of students achieving AAB or above are from private schools and 20% of those achieving the highest grades at state sixth forms are in grammar schools.
He also said he expected to record substantial numbers of courses closing, particularly in sciences, as many universities decide they can no longer afford to run expensive, laboratory-based degrees.
He warned that universities could be faced with European Union applicants “flooding in”, because it will be virtually impossible to force them to repay their student loans once they return to their home countries.
blog it

Jam Hot! A new take on Personal Learning Environments

July 11th, 2011 by Graham Attwell

It is conference season. Today marks the start of the PLE2011 conference in London. Together with Andrew Ravenscroft, Dirk Stieglitz and David Blagborough, I am presenting a paper with the snappy name ‘‘Jam Hot!’ Personalised radio ciphers through augmented social media for the transformational learning of disadvantaged young people.’

Although the paper is very much a work in progress, there are a series of ideas here which I find interesting and will return to on this blog in the future. In the meantime any feedback very welcome.

‘Jam Hot!’ Personalised radio ciphers through augmented social media for the transformational learning of d…

  • Search Pontydysgu.org

    News Bites

    2012 Horizon report

    An advance copy of the the NMC Horizon Report 2012 K-12 Edition, due to be launched on June 14, identifies mobile devices and apps and tablet computing as technologies expected to enter mainstream use in the first horizon of one year or less. Game-based learning and personal learning environments are seen in the second horizon of two to three years; and augmented reality and natural user interfaces emerged in the third horizon of four to five years.


    OER Quality

    A new project is attempting to define quality standards  for open educational resources in higher education; this is part of the OER Quality Project, a joint research between the universities of Barcelona, Santiago de Chile and the University of London.

    The researchers for this project are lecturers and academic librarians and aim to define a set of quality standards and develop a good practices guide both for content design and for  indexing open educational resources in institutional repositories.

    They are looking for university lecturers, readers or professors (distance learning lecturers welcome too) willing to answer 2 surveys  (20 minutes each) and to evaluate a set of OERs, according to certain guidelines and criteria, which will take 30 minutes to answer. To participate, please register here.


    Hangouts on Air

    Personally I am not a great fan of Google+, although as Google increasingly integrates its different services it is hard to avoid. But, as Stephen Downes points out in the ever valuable Oldaily, citing an original blog post by David Andrade, “by far and away the best thing about Google+ is the Hangout feature, essentially a way to have a videoconference with ten of your friends. This latest upgrade allows you to broadcast your Hangouts to as large an audience as you want. “With Hangouts on Air, you will be able to broadcast yourself publicly to the entire world, see how many viewers you have, and even record and reshare your broadcast. The public recording will be uploaded to your YouTube channel and to your original Google+ post.”

    With free skype video calls limited to two people and the increasing cost of proprietary synchronous elearning platforms like Blackboard Collaborate, Hangouts could become the system of choice for open online courses.


    Gadgets and widgets

    The Dutch SURFnet have announced the ‘Edu-Socializing Seminar’, to be held in Utrecht, the Netherlands, on June 12th and 13th. They say “Gadget and widget technology is gaining momentum in the Research and Educational community. Projects like the Role Project, Apache Rave, Sakai OAE and OpenConext implement and deploy these technologies, showcasing the possibilities and benefits of such loosely coupled and distributed environments. The projects address a wide variety of needs from within the community like, among others, personalized learning environments, mashing web and social content, distributed learning and online collaborations.

    The event seeks to explore trends and foster these developments internationally, by bringing together experts from different fields into one event and joining them in a community. With interactive sessions the workshop wants to enable sharing of ideas and knowledge. At the same time the event wants to trigger new developments. With dedicated breakout sessions, common challenges can be addressed and solutions can be targeted.”

    More details on the seminar wiki page.


    ECER 2010

    The keynotes, videos, radio shows and interviews from the ECER 2010 Conference in Helsinki:

    On the ECER 2010 website.

    Taccle handbook for teachers order form

    Here you find the Taccle handbook for teachers order form.

    Twitter

    Follow Graham Attwell on Twitter Follow Cristina Costa on Twitter Follow Dirk Stieglitz on Twitter

    Other Pontydysgu Spaces

    • Pontydysgu on the Web

      blip.tv
      Watch the Pontydysgu Videos
      pbwiki
      Our Wikispace for teaching and learning
      Sounds of the Bazaar Radio LIVE
      Join our Sounds of the Bazaar Facebook goup. Just click on the logo above.

      Our next programmes will be live from the German Moodlemoot in Emsden. Full details coming soon

  • Sounds of the Bazaar AudioBoo

  • Recent Posts

  • Archives

  • Meta

  • Upcoming Events

    • Thu, May 24 – Fri, May 25:Learning through virtual environments: A challenge for the promotion of positive parenting
  • Categories