Academia Stack Exchange
Academia Stack Exchange

Questions tagged [reproducible-research]

Questions related to research in which data and/or code is made publicly available so that others may verify the findings and build upon them.

Reproducibility refers to the ability of an experiment or study to be reproduced, or by someone else working independently. It is one of the main principles of the scientific method.

See also, The Reproducibility Initiative

Note : This tag wiki has content adapted from Wikipedia, used under the CC-BY-SA 3.0 license.

92 questions
61
votes
6 answers

How to proceed when the baseline (state-of-the-art) published results claim much better performance than I can reproduce?

I am graduate student, to finish my degree I need to build methods outperform what is already there. An issue that I came across with, is that two papers reported way (I mean more than 20%) more than what resulted from my reimplementation. This…
Monii_80
  • 511
  • 1
  • 4
  • 7
32
votes
8 answers

Who is supposed to repeat experiments?

A follow up to this question. There is an issue in science with experiments not being repeated. I asked if PhDs can be done on repeating experiments and the answer is kind of mixed. Most PhDs aren't that. I don't suspect that professors repeat…
user41631
13
votes
2 answers

What is the difference between repeatability, replicability and reproducibility?

I have seen many instances where authors used the term "reproducibility" and "replicability" interchangeably in the social and behavioural sciences. Sometimes, they distinguish between the "repeatability" of experiments (same measurand/same…
non-numeric_argument
  • 1,249
  • 1
  • 11
  • 23
5
votes
2 answers

How to deal with non-reproducible research?

For context, I am a PhD student in bioinformatics, working partly in development of new statistical models and partly in applying models to data. I recently came across a paper which describes an interesting approach to clustering data. This method…
alan ocallaghan
  • 152
  • 7
3
votes
2 answers

Is it worth posting reproducibility studies

As an undergraduate interested in Academia, is it worth posting your reproducibility study of a paper on arXiv and linking to it on Google scholar? Is it useful to future graduate schools? Specifically with regards Machine Learning and Computer…
midawn98
  • 213
  • 2
  • 5
2
votes
1 answer

How do you reproduce the simulation result of paper you read?

I need to reproduce the simulation done in a research paper I read. I tried to do it by myself last 2 months, but unfortunately without success. I wrote to the first author of this paper but didn't get any reply still. I am afraid he will ignore my…
Aid22
  • 21
  • 1
2
votes
2 answers

How can I find if a certain study has been replicated or the results reproduced?

I am trying to find additional research about a certain topic. I have found one study that is specifically about this topic, and the results are very interesting. I would like to find out if any additional studies have attempted to reproduce the…
elmer007
  • 129
  • 2
2
votes
1 answer

Reproducing experimental data from published work

I am doing theoretical study of a material and in my recent work I have compared my calculated results with experimental results from another published work. During review, the reviewer has mentioned In any case, the experimental data should…
Thomas
  • 184
  • 2
  • 9
2
votes
1 answer

What can be done (by the community as a whole) to make it easy (for persons other than the authors) to reproduce numerical results in a paper?

For example see reproduced papers repository. I am restricting the scope to theory papers that have some results obtained through numerical techniques. The fields may be as diverse as physics, mathematics and the things in between. How can one make…
Tejas Shetty
  • 620
  • 1
  • 5
  • 14
0
votes
1 answer

Consent for Using Scale

I am doing research on identity status. The scale which I intend to use was developed in 1995. I have attempted every possible way to reach out to the corresponding author, but haven't received any response yet. I have messaged all the email…
Rabab Saeed
  • 1
-1
votes
1 answer

History behind reproducible research tools and literate programming

Reproducibility was talked about by Robert Boyle in 17th century. Literate Programming was invented in 1984 by Donald Knuth. Reproducible Research tools like R markdown were invented recently. My query is : After the invention of Literate…
user2338823
  • 107
  • 2
-2
votes
1 answer

Why are most article pdfs not self-reproducable?

Context In light of the perishability of external resources as illustrated here: https://xkcd.com/1909/ I was wondering if it is desirable to ensure a single PDF, including its research code, can be replicated as stand-alone. This question pertains…
a.t.
  • 115
  • 3