GoogleTranslate Service


Reviews, quality and the development of communities of practice in academic networks

February 27th, 2010 by Graham Attwell

I have just spent the morning reviewing proposals for the Vocational education and Training Network strand at the European Conference for Educational Research.

I have never enjoyed reviewing papers. I worry that my own knowledge of the subject is often too little, still more that I only have an abstract idea of what comprises quality.

However, as a community building process, I find it more interesting. I haver been involved with VETNET for fourteen years. In the early days nearly everything used to be accepted. But as time went on a discussion emerged over improving the quality of VETNET and a formal review procedure was developed.

VETNET remains a somewhat traditional academic conference with paper and sumposium presentations. I suspect that the community’s desire for Vocational Education and Training to be taken seriously as a part of mainstream education research has tended to make us somewhat conservative in our approaches to formats and quality.

Over time as a community we have started defining quality indicators – even though they may be contested. We have had long debates about the relation between research focused on a particular system or country and its relation to wider European agendas. We have discussed how important the quality of language (English) is in assessing a contribution? Should leeway be given to emerging researchers to encourage them to contribute to the community? How important is a clear methodology when considering a submission?

This years debate has been over work in progress. It started innocuously enough with one reviewer emailing that he was concerned that many submissions referred to research which was not yet finished. Should we only consider completed research with clear results, he suggested? This provoked a flurry of replies with major differences between the reviewers. Some agreed with the original email; others (including myself) saw presentations based on work in progress as a potentially useful contribution to the community and a means of researchers testing their ideas in front of a wider international audience. In the normal way of things this debate will be reviewed at the VETNET board meeting at this years conference and revised guidelines agreed for next years conference.

In this way I think the review process does work well. It allows community rules and standards to emerge over time.

The other big change in the review system has been the use of an electronic reviewing system ‘conftool‘. The major benefit is to support the management fo the review process. VETNET receives some 120 proposals each year. The use of the system ensures every paper receives at least two reviews. More interestingly it makes transparent where there are disagreements between reviewers, providing a view showing the overall score for each proposal and the span between reviewer’s scoring. I was allocated nine proposals to review. Four of them have already been reviewed by a second reviewer. And somewhat to my surprise the span between my score and the other reviewers was small (the highest of the four was 1.7 (however the other reviewer has recommended rejection of this proposal and I have recommended acceptance!).

I welcome that when we have finished our reviews we are able to see other reviews of the same submission. This provides for me an opportunity for reflection and learning – and strengthens the potential of the academic review  becoming part of the process of community emergence.

Comments are closed.

  • Search Pontydysgu.org

    News Bites

    Adult Education in Wales

    Learning and Work Institute is organising this year’s adult learning conference in partnership with the Adult Learning Partnership Wales. It will take place on Wednesday, 16 May 2018 at the Cardiff City Stadium.

    They say “Changing demographics and a changing economy requires us to re-think our approach to the delivery of learning and skills for adults. What works and what needs to change in terms of policy and practice?

    The conference will seek to debate how can we respond to need, grow participation, improve and measure outcomes for citizens, and revitalise community education.”


    Industry 4.0

    The UK Education Select Committee has launched an inquiry into the challenges posed and opportunities presented by the Fourth Industrial Revolution.The Committee is inviting written evidence on:

    • The interaction between the Government’s industrial, skills and digital strategies
    • The suitability of the current curriculum to prepare young people for the Fourth Industrial Revolution
    • The impact of the Fourth Industrial Revolution on the delivery of teaching and learning in schools and colleges
    • The role of lifelong learning in re-skilling the current workforce
    • Place-based strategies for education and skills provision; and
    • The challenges and opportunities of the Fourth Industrial Revolution for improving social justice and productivity

    The deadline for written submissions is Thursday 21 June 2018.


    Online Educa Berlin

    OEB Global (formerly Online Educa Berlin) has announced its Call for Proposals and the overall theme for 2018: Learning to Love Learning. The event will incorporate Learning Technologies Germany – a leading European exhibition on learning technologies in the workplace – for the first time this year. More details here.


    Barcelona to go Open Source

    The Spanish newspaper, El País, has reported that the City of Barcelona is in the process of migrating its computer system to Open Source technologies.

    According to the news report, the city plans to first replace all its user applications with alternative open source applications. This will go on until the only remaining proprietary software will be Windows where it will finally be replaced with a Linux distribution.

    To support the move, the city will employ 65 new developers to build software programs for their specific needs. they also plan the development of a digital market – an online platform – whereby small businesses will use to take part in public tenders.


    Other Pontydysgu Spaces

    • Pontydysgu on the Web

      pbwiki
      Our Wikispace for teaching and learning
      Sounds of the Bazaar Radio LIVE
      Join our Sounds of the Bazaar Facebook goup. Just click on the logo above.

      We will be at Online Educa Berlin 2015. See the info above. The stream URL to play in your application is Stream URL or go to our new stream webpage here SoB Stream Page.

  • Twitter

  • RT @NotRightRuth Zhang: Twitter is increasingly important for organising of LGBTQ clubs in Japanese universities. Majority of Twitter accounts explicitly invite interaction only from people who self-identify as LGBTQ, but others are open to allies etc. Some aren't explicit about focus. #isa18wcs

    Yesterday from Cristina Costa's Twitter via TweetDeck

  • Sounds of the Bazaar AudioBoo

  • Recent Posts

  • Archives

  • Meta

  • Upcoming Events

      There are no events.
  • Categories