Why do researchers commit research misconduct? Should you publish a paper withdrawn (maybe) from a predatory journal? Should an editor also be a researcher? Researcher and reviewer gender gaps

TRIAL REGISTRATION

Clinical trial registration and negative results

A study in BMJ tests the hypothesis that clinical trial registration should improve trial reporting and therefore increase the number of trials that do not report positive outcomes. Registered trials were slightly less likely to report positive results, particularly if they were not industry-funded. The authors did not compare the registered trial outcomes with the outcomes that were reported (they studied 1122 trials so that would have been a major undertaking). A great benefit of trial registration for editors and reviewers is  being able to determine whether outcome switching has occurred. If outcomes were switched, that could explain why trial registration was not associated with a larger reduction in positive results.
Another important observation: much of the trial reporting was poor, pointing out the importance of all authors using, and all medical journals requiring and verifying use of, CONSORT reporting (http://www.consort-statement.org).
Odutayo A, Emdin CA, Hsiao AJ. Association between trial registration and positive study findings: cross sectional study (Epidemiological Study of Randomized Trials—ESORT). BMJ 2017;356:j917. doi: https://doi.org/10.1136/bmj.j917

RESEARCH ETHICS

Why do researchers commit research misconduct? 

A case study with a chastening message for investigators (and a sobering message for editors): “He described how and why he started tampering with data. The first time it happened he had analyzed a dataset and the results were just shy of significance. Fox noticed that if he duplicated a couple of cases and deleted a couple of cases, he could shift the p-value to below .05. And so he did. Fox recognized that the system rewarded him, and his collaborators, not for interesting research questions, or sound methodology, but for significant results. When he showed his collaborators the findings they were happy with them-and happy with Fox.” What messages are investigators sending when research doesn’t turn out as hoped? “Hindsight’s a bitch:” Colleagues dissect painful retraction. Retraction Watch (blog). March 7, 2017.

Publishing a paper withdrawn from a predatory journal
What would you do if authors submitted a paper that they had unknowingly submitted to a predatory journal, then withdrew, but the predatory journal wouldn’t respond to confirm? COPE has published a case study on such an instance.
Withdrawal of accepted manuscript from predatory journal. Case Number 16-22. COPE.

 

AUTHORS 

The importance of research experience when evaluating research (blog):
“So pointing out why a study is not perfect is not enough: good criticism takes into account that research always involves a trade-off between validity and practicality… good research is always a compromise between experimental rigor, practical feasibility, and ethical considerations. To be able to appreciate this as a critic, it really helps to have been actively involved in research projects. I do not mean to say that we should become less critical, but rather that we become better constructive critics if we are able to empathize with the researcher’s goals and constraints.” The value of experience in criticizing research (Rolf Zwaag Blog)

Relationship between time to reject without review, the review process, and author satisfaction

An analysis across scientific fields, the authors find “One-third of journals take more than 2 weeks for an immediate (desk) rejection and one sixth even more than 4 weeks. This suggests that besides the time reviewers take, inefficient editorial processes also play an important role. As might be expected, shorter peer review processes and those of accepted papers are rated more positively by authors. More surprising is that peer review processes in the fields linked to long processes are rated highest and those in the fields linked to short processes lowest. Hence authors’ satisfaction is apparently influenced by their expectations regarding what is common in their field. Qualitative information provided by the authors indicates that editors can enhance author satisfaction by taking an independent position vis-à-vis reviewers and by communicating well with authors.” Huisman J, Smits J. Duration and quality of the peer review process: the author’s perspective. Scientometrics (2017). doi:10.1007/s11192-017-2310-5

RESEARCH REPORTING 

Reporting race/ethnicity in research

“An explanation of who classified individuals as to race, ethnicity, or both, the classifications used, and whether the options were defined by the investigator or the participant should be included in the Methods section. The reasons that race/ethnicity was assessed in the study also should be described in the Methods section. ” Robinson JK, McMichael AJ, Hernandez C. Transparent Reporting of Demographic Characteristics of Study ParticipantsJAMA Dermatol. 2017;153(3):263-264. doi:10.1001/jamadermatol.2016.5978

GENDER GAP 
What is happening with the researcher gender gap, in 12 countries?
A report from Elsevier (using Scopus): Gender in the Global Research Landscape . Analysis of research performance through a gender lens across 20 years, 12 geographies, and 27 subject areas. (2017)
and Scholarly Kitchen’s assessment: Alice Meadows. The Global Gender Gap: Research and Researchers Scholarly Kitchen Blog.

Is there a gender bias in selecting reviewers? 
Here we present evidence that women of all ages have fewer opportunities to take part in peer review. Using a large data set that includes the genders and ages of authors and reviewers from 2012 to 2015 for the journals of the American Geophysical Union (AGU), we show that women were used less as reviewers than expected…The bias is a result of authors and editors, especially male ones, suggesting women as reviewers less often, and a slightly higher decline rate among women in each age group when asked.
These findings underline the need for efforts to increase female scientists’ engagement in manuscript reviewing to help in the advancement and retention of women in science.” Lerback J, Hanson B. Journals invite too few women to referee. Nature | Comment, January 25, 2017.

CONFLICTS OF INTEREST 

BMJ will declare all its industry revenues, in the interest of transparency. Hear, hear! BMJ editor confirms that revenues from industry will be declared. BMJ 2015;351:h3908.

__

Newsletter #4, originally circulated March 16, 2017. Sources include Retraction Watch, COPE, LinkedIn, and Scholarly Kitchen. Providing the links and information does not imply WAME’s endorsement.

Welcome to the WAME Blog: Authors’ view of the manuscript submission process, Science’s English-language bias, Transparent research results (or not), Open access publishing in the Global South

The WAME Blog, featuring the WAME Newsletter, offers news, views, and resources of interest to medical journal editors in general and WAME members — comprising medical journal editors and scholars throughout the world — in particular. The challenges and experiences of editors at small journals and journals in low and middle income countries are of particular interest. Articles and activities are free to everyone, unless, in rare instances, otherwise indicated.

The first Newsletter was circulated via listserve on February 16, 2017 and is excerpted below. Sources of this Newsletter are Retraction Watch and the Open Science Initiative listserve. Providing the links and information does not imply WAME’s endorsement.

AUTHORS

The delights, discomforts, and downright furies of the manuscript submission process, from Learned Publishing. A discussion of issues authors face as part of the manuscript submission process, including the following list of recommendations (plus a useful appendix of items authors should have on hand when ready to submit a manuscript):

  • “Editors and reviewers should consider manuscripts in any (appropriate) format first – and publishers reset only the accepted papers.
  • There should be three or four standard formats for journals that everyone can copy. Trivial house style requirements should be abolished.
  • The layouts of tables, graphs and references also need to be standardised more. Tables and graphs, and their caption, should be placed where they fit in the text, not at the end of manuscripts.
  • A named person (with an e-mail address at the publisher’s) should be provided by the publisher who can help with the submission process if an author gets stuck.
  • Finally, when the submission process is completed successfully or otherwise, authors should be invited to send any comments/feedback on the system that they have used.”

These authors’ comments, as well as the whole system, should be reviewed, say every 3-5 years. They also note the importance of allowing authors to review their proofs.

LANGUAGE

The problems and loss of information created by the bias toward science reported in English. “Not only does the larger scientific community miss out on research published in non-English languages. But the dominance of English as science’s lingua franca makes it more difficult for researchers and policy makers speaking non-English languages to take advantage of science that might help them…Amano thinks that journals and scientific academies working to include international voices is one of the best solutions to this language gap. He suggests that all major efforts to compile reviews of research include speakers of a variety of languages so that important work isn’t overlooked. He also suggests that journals and authors should be pushed to translate summaries of their work into several languages so that it’s more easily found by people worldwide.”

How a bias toward English-language science can result in preventable crises, duplicated efforts and lost knowledge (Smithsonian Magazine)

RESEARCH REPORTING AND STATISTICS

  • Paul Glasziou describes how to present research results in a transparent way so that readers can understand the study’s implications–or not. “…presenting the results in a clear, unbiased, and understandable way is of paramount importance. Editors should insist on clear, simple presentations of the main results—preferably in graphical formats. Without that, authors and editors will continue to contribute to the considerable waste in research and the gaps between research and practice.”

How to hide trial results in plain sight (BMJ Blogs)

  • The influence of statistical noise in medical research results: “Statistically speaking, a statistical significant result obtained under highly noisy conditions is more likely to be an overestimate and can even be in the wrong direction.  In short:  a finding from a low-noise study can be informative, while the finding at the same significance level from a high-noise study is likely to be little more than . . . noise.”

Why traditional statistics are often “counterproductive to research the human sciences” (Retraction Watch blog)

ACCESS

  • OASPA hosted a Twitter Chat on Open Access Publishing in the Global South. From the OASPA website (and thank you to the OSI listserve for the heads up): “February 10, 2017 by Leyla Williams On Wednesday 22nd February 2017, OASPA will host a live Twitter chat about open access publishing in the Global South with Xin Bi (Xi’an Jiaotong-Liverpool University/DOAJ), Ina Smith (Academy of Science of South Africa), Abel Packer (SciELO), and Lars Bjørnshauge (DOAJ).”
  • OASPA has posted a Webinar on open access publishing in the Global South; free OASPA webinars are offered here: http://oaspa.org/information-resources/oaspa-webinars/