Tag Archives: Research

Excellence or quality – metrics and values in scholarly communications

In June 2009, in the process of scoping a project to research ways of building capacity in African scholarly publishing, a workshop was held with a group of experts from a variety of perspectives and a variety of approaches to the question of scholarly communications. Supported by the IDRC and the Shuttleworth Foundation, this workshop turned out a very lively event and – we believe – provided seminal insights into the questions that need to be addressed in order to build African research communications capacity.
This workshop has now been captured on a website that hosts videos of the keynote speeches (ten minute presentations, so they work well this way). It also contains commentary on the speeches and discussions as well as the key findings that emerged from this discussion. The website was funded by the Shuttleworth Foundation and provides a discussion form for these ideas to be carried forward. One lesson learned, perhaps, was the value of discussion in a a small and focused group of experts from a variety of contexts and a variety of specialisations.
In yesterday’s blog I took to task the Thomson Reuters analysis of African research developments, arguing that, by focusing only on the production of journal articles and on citations in an international journal index, they were taking too narrow a view of what constituted research development. So here, from the Scholarly Communications, is the keynote address by Jean-Claude Guédon, of the University of Montreal, who gave the opening address of the workshop.

Jean-Claude Guédon – Scholarly Communication in Africa: Project Scoping Workshop from Creative R&D on Vimeo.

Guédon starts by introducing vocabulary issues that need to be clarified on order to understand the research communications environment. In particular, the difficulty in discerning the difference between ‘quality’ and ‘excellence.’ According to Jean-Claude, quality is a matter of the minimum thresholds that are needed for functionality, a matter of what skills or levels of professionalism are needed to deliver a particular function. The concept of excellence, on the other hand, is a matter of competition, with specifically defined parameters creating the rules of the game in which this competition is played out.
He continues to the topic of scholarly publishing, which has artificially constructed competition as its basis, so that it has become all about creating excellence. Jean-Claude’s advice is to disengage from this situation, by reviewing the notion of what constitutes excellence. He also says we need to look at the whole value chain of scientific communications, as well as the data that underpins research and ensure that it is preserved and made available. He also speaks about the benefits of a collaborative knowledge environment, as well as the need to reposition knowledge and society.
The message is that we need to unpack the language of excellence and competitiveness before we subscribe too blindly to the race that that involves. Developing countries cannot ignore this side of scholarly performance and it is important that they prove their ability to achieve the accepted standards of performance in what has become, for better or for worse, a dominant measure. However, this should not be expanded to be the only, or the dominant measure of performance. Rather, there should be a balanced approach, with great emphasis placed on the need to build capacity by developing the quality standards that could ensure truly professional performance.

‘I have measured out my life with coffee spoons.’ Thomson Reuters’ myopic vision of African research capacity

T S Eliot’s damning metaphor for the narrowness of social conventions came to mind when I read Thomson Reuters’ Global Research Report Africa, ostensibly a report on the state of African research, but in fact a very limited analysis based solely on the performance of African countries in the Thomson Reuters ISI journal indexes. I was alerted to this report by University World News, which has now published two totally uncritical articles on Thomson Reuters’ ‘global’ analysis of African research.
This is insidious stuff. The Global Research Report Africa is indeed measuring out the lives of African researchers in coffee spoons, basing itself on an unproblematized assumption that the number of journal articles published and citation analysis of these articles can be an adequate measure (let alone the only measure) of the state of national research systems in Africa. It uses scientific-sounding language to equate these ‘outputs’ – ISI-listed journal articles – with research capacity and then in turn equate this measure with the potential for improved global economic performance for African countries.
The intent of this this report is pretty clear. The report starts off with an explicit statement: it is designed ‘to inform policymakers and others about the landscape and dynamics of the global research base’. Although its concluding remarks have a modest disclaimer, that ‘it would be inappropriate to suggest that the preliminary analysis in this report can provide a clear direction’, nevertheless the intent is again made clear – to ‘help provide a further context to that set by the OECD’s economic reports, while also furnishing background against which to view the pertinent regional dispatches in the UNESCO Science report 2010…’ We should not forget either that the criteria and analysis for the Times Higher Education university rankings are now to be managed by Thomson Reuters. Is the company positioning itself even more strongly as the sole arbiter of scholarly excellence and the sole source of data for the measurement of research development? Continue reading

Scholarly publishing as a transformation issue in South Africa

With the Higher Education Transformation Summit taking place in Cape Town on 22 April, universities have been in a reflective phase, examining their success – or lack of it – in achieving post-apartheid transformation. The report card shows that we are achieving a great deal, but could try harder. There is still a way to go before all our students and academics feel they are in institutions that are really their home.
No-one seems to have noticed the elephant in the room. In all the discussions, I see very little attention being paid to the role that scholarly communication and publication plays in the transformation process. We talk about the demographic profiles of our universities, yet we do not seem to question the communication environment that students and staff are immersed in and the values that are reflected there.
Why is it, for example, that, as the South African Minister of Higher Education and Training , Blade Nzimande, complained at the UNESCO 29th World Conference on Higher Education that ‘there is a gender imbalance throughout higher education systems especially in leadership positions.’ in his keynote address at the Transformation Summit, he picked up on the fact that the average age of academics continues to rise and that there has been a drop in the number of staff under the age of 30? Does the publishing system that is so central in determining who is promoted and rewarded play a role in these demographics? Is this an alien environment for the young scholars that the universities want so badly to attract? Do students and researchers find their own, African, world reflected adequately in the scholarly resources that they have access to? Are the values that our researchers hold reflected in the ways in which they are supported in publishing their research? Continue reading

Why do scientists do research? Personal motivation, social impact and politics

A thoughtful and thought-provoking blog by Cameron Neylon, a bioscientist at the Rutherford Appleton Laboratory in the UK tackles the question of values and motivations in scientific research and the question of public support for science, through government and taxpayers. His major topic is why and how he does research and why there should be public support for this activity. But most tellingly he tackles cogently the dislocation that has happened in the 21st century between motivated scientists, their methods of carrying out and reporting on their research and the public policies that recognize this research effort.  The picture Neylon  paints of his own research – methodology to study complex biological structures – is of a high technology, collaborative and multinational research environment, in which scientists build on each others’ work in an open environment.

This is germane to our South African context, in which government policy on reward and recognition systems for individual researchers and universities does not seem to recognise the ways in which research has changed in the knowledge economy and how social and development impact can be delivered these days. With the IPR Act about to be enforced, this is even more of a burning issue for South African researchers. Neylon paints a picture of a post-war policy approach that treats science as a way of dealing with threats… ‘The war against cancer, the war against climate change. But evaluating his own research motivations, he identifies the need to make a positive impact on the world as his main driver. And the most effective way to do this, he argues, is by collaboration:

Because I want my work to be used as far as is possible I make as much as possible of it freely available. Again I am lucky that I live now when the internet makes this kind of publishing possible. We have services that enable us to easily publish ideas, data, media, and process and I can push a wide variety of objects onto the web for people to use if they so wish. Even better than that I can work on developing tools and systems that help other people to do this effectively. If I can have a bigger impact by enabling other peoples research then I can multiply that again by helping other people to share that research. But here we start to run into problems. Publishing is easy. But sharing is not so easy. I can push to the web, but is anyone listening? And if they are, can they understand what I am saying?


… More open research will be more effective, more efficient, and provide better value for the taxpayer’s money. But more importantly I believe it is the only credible way to negotiate a new consensus [sic] on the public funding of research. We need an honest conversation with government and the wider community about why research is valuable, what the outcomes are, and how the contribute to our society. We can’t do that if the majority cannot even see those outcomes. …

At a social level, he argues that this is a technical and legal issue, and one of interoperability: sharing through agreed formats and vocabularies and using licences that do not place barriers in the way of mutual use of data. Process interoperability is even more important: ‘If the object we publish are to be useful then they must be able to fit into the processes that researchers actually use.’

But there are challenges at the political level: what scientists do and how they do it is not evident to the public that funds research and this could lead to a failure of funding – a real risk in the South African context, where the credibility gap is probably even wider than in the UK.


We need at core a much more sophisticated conversation with the wider community about the benefits that research brings; to the economy, to health, to the environment, to education. And we need a much more rational conversation within the research community as to how those different forms of impact are and should be tensioned against each other.  We need in short a complete overhaul if not a replacement of the post-war consensus on public funding of research. My fear is that without this the current funding squeeze will turn into a long term decline. And that without some serious self-examination the current self-indulgent bleating of the research community is unlikely to increase popular support for public research funding.


In a South African university sector which is driven by recognition based on journal articles and in which there tends to be a handful of public intellectuals who convey the broader results of scientific research to the government and the public, we could do worse than engage in the way that Neylon suggests with the potential that we have in a technological age to open up the whole of the research process, making for the maximum usage of the research that is produced. This is of vital importance in  the African research environment, where failures in effective communication means that we are constantly reinventing the wheel with frighteningly scarce resources. But even if we focus only on South Africa, where the new Minster of Higher Education and Technology is asking what has happened to research for the public good in South Africa, we could do worse than heed Neylon’s words.



We need an honest conversation with government and the wider community about why research is valuable, what the outcomes are, and how the contribute to our society. We can’t do that if the majority cannot even see those outcomes. The wider community is more sophisticated that we give it credit for. And in many ways the research community is less sophisticated than we think. We are all “the public”. If we don’t trust the public to understand why and how we do research, if we don’t trust ourselves to communicate the excitement and importance of our work effectively, then I don’t see why we deserve to be trusted to spend that money.

Read the whole blog – it is  essential reading in our current political and social climate.


The Universiy of Pretoria adopts an open access mandate

The University of Pretoria has become the first university in South Africa to adopt a mandate for open access deposit of publications by all academics. The senate of the University of Pretoria has unanimously approved an open access mandate for the university, which requires all academics to deposit digital copies of their publications in an open access archive. The policy will go into effect immediately and it is likely that UP scholars will see a substantial increase in the citation of their articles as a result. Other South African Universities will need to watch this space.

The wording of  the policy:

To assist the University of Pretoria in providing open access to scholarly articles resulting from research done at the University, supported by public funding, staff and students are required to:

  • submit peer-reviewed postprints* + the metadata of their articles to UPSpace, the University’s institutional repository, AND
  • give the University permission to make the content freely available and to take necessary steps to preserve files in perpetuity.

Postprints are to be submitted immediately upon acceptance for publication.

The University of Pretoria requires its researchers to comply with the policies of research funders such as the Wellcome Trust with regard to open access archiving. Postprints of these articles are not excluded from the UP mandate and should first be submitted as described in (1). Information on funders’ policies is available at http://www.sherpa.ac.uk/juliet/.

Access to the full text of articles will be subject to publisher permissions. Access will not be provided if permission is in doubt or not available. In such cases, an abstract will be made available for external internet searches to achieve maximum research visibility. Access to the full text will be suppressed for a period if such an embargo is prescribed by the publisher or funder.

The Open Scholarship Office will take responsibility for adhering to archiving policies of publishers and research funders, and managing the system’s embargo facility to delay public visibility to meet their requirements.

The University of Pretoria strongly recommends that transfer of copyright be avoided. Researchers are encouraged to negotiate copyright terms with publishers when the publisher does not allow archiving, reuse and sharing. This can be done by adding the official UP author addendum to a publishing contract.

The University of Pretoria encourages its authors to publish their research articles in open access journals that are accredited.

Starting in 2004 with an evaluation of appropriate repository software, and going live in 2006 with UPSpace, UP has established itself as a pioneer and a leader in the development and management of scholarly repositories in South Africa. The university at that time already had a thesis and dissertations repository, UPeTD, started in 2000 and expanded in 2004 with a mandate for the online deposit of theses and dissertations. The decision to expand this intervention to create a repository of research collections followed on the success that UPeTD had in profiling PhD students’ research, contributing to their career success and providing expanded readership for UP’s research output.

The project was resourced with the creation of a repository management team to oversee the implementation and ongoing management of UPSpace. There are now 7 896 full text items online, profiling the research output and publications of departments and individual academics, who have their own profiles within the repository, which can be linked to their CVs. The online publications can range from public scholarship and media articles to research papers and formal scholarly publications. The latter are collected in a sub-space of the broader collection, called openUP.

The initial reluctance of UP scholars to embrace open access has long been overcome and with Senate’s willingness to vote a mandate for deposit, it is clear that there is now top-level support for the initiative. It will be interesting to watch the impact that this has on UP’s research profile and scholarly reputation, which is likely to be enhanced by increased access. Research shows that online open access to research publications from developing countries considerably increases impact factors by a considerable margin.

Congratulations to UP for a bold initiative that puts in in the front rank among some of the leading universities in the world.

For an account of the setting up of the UP repositories, seeMartie van Deventer and Heila Pienaar, South Arfican Repositories: Brigding the knoweldge divides. Ariadne 55 2008