228

I am interested in the situation where you have a very interesting result. For instance, you have solved a very important open problem. However, you are not known in the field and do not have any remarkable publications. Your supervisor thinks the work is good and you submit the work to a high profile journal, but you get rejected.

The thing is that the contribution is very strong. It breaks what most people believe or what they have already proven: e.g., you solve the P vs. NP problem or any other well known open problem.

The reviewers strongly reject your work with no justification and they do not state why the result is wrong. Examples of reviewer comments include:

  • "The proof must be wrong."
  • "You cannot achieve such a result."
  • "You do not understand well the notion of ..."

My question is what to do in this situation? Where to go? If your advisor accepts the work, but the reviewers from the top journal reject the work without even explaining the mistakes, what should you do?

Ooker
  • 8,266
  • 6
  • 54
  • 114
Learning
  • 2,381
  • 2
  • 13
  • 8
  • 105
    In that case, the supervisee is probably wrong in their perception of their own work; detecting that is what peer review is for. But then again, maybe not; maybe the presentation is just poor, or the claim too outrageous for some hearts/minds. Upload to arXiv for the time stamp and keep improving form and submitting. Your name does not (read: should not) matter when submitting an article so being unknown is not (read: should not be) an issue. Being known for half-baked crank stuff, on the other hand, is: avoid creating that impression at all cost! – Raphael Mar 24 '14 at 23:56
  • 23
    See also here and here for more advice. And remember that Nobel prizes and centuries of fame went to people no one took serious in their (life) time. – Raphael Mar 24 '14 at 23:58
  • 5
    I should add that the "advice" I link is obviously quite opinionated and should be taken with a grain of salt. For all we know, you do have the solution for an important open problem. But you have to take the situation into account and present your attempt accordingly if you want people to take it seriously. The blog posts I link should give you an inkling of how touchy domain experts can be when they have been bombarded with (to them) obviously wrong attempts whose authors do not accept "no" -- for decades. Write for them. – Raphael Mar 25 '14 at 00:08
  • 23
    You should read this page: http://research.microsoft.com/en-us/um/people/cohn/Thoughts/advice.html – Neil Strickland Mar 25 '14 at 00:12
  • 4
  • Make sure your findings are actually correct by contacting other pioneers in the field (ask your supervisor to do this) 2)publish it in Arxiv 3) wait for the seminar invitations and the world of fame
  • – seteropere Mar 25 '14 at 02:45
  • 66
    @Raphael: I'll remind you that the Nobel Prize has only ever been awarded to living persons. I'll also point out that just because they all laughed at Einstein doesn't mean that if they're laughing at you, you're a new Einstein. Good links though -- thanks for those. – Eric Lippert Mar 25 '14 at 05:59
  • 144
    "They laughed at Columbus, they laughed at Fulton, they laughed at the Wright brothers. But they also laughed at Bozo the Clown." -Carl Sagan (http://www.c2.com/cgi/wiki?TheyLaughedAtEinstein) – JRN Mar 25 '14 at 07:14
  • 3
    @EricLippert: [Nobel:] I'm aware of that; I was thinking of some artists (and fame, not Nobel prizes) when I put the "(life)" there. [Argument inversion:] Obviously. The fact that false negatives do happen is important to keep in mind, if only so a proper amount of common curtesy is extended towards those who try (and seem to fail). – Raphael Mar 25 '14 at 08:09
  • 3
  • 15
    @JoelReyesNoche, Of course, with respect to Mr. Sagan, people didn't laugh at Columbus because he thought the Earth was round, but rather because they knew he'd drastically underestimated the Earth's diameter (resulting in an estimated 3,700km journey vs. what would h ave been an actual 19,600km journey). Columbus was only financed because he promised Queen Isabella I and King Ferdinand II trade with Asia, at a time when the pair desperately needed the income from the trade. – Brian S Mar 25 '14 at 19:26
  • 1
    @Jigg "The proof must be wrong." "You cannot achieve such result." "You do not understand well the notion of ..." – Learning Mar 25 '14 at 19:42
  • 9
    If you only believe you solved it, you should start by convincing yourself before convincing others. Only when you wrote all proofs and details down with such clarity that there is absolutely no doubt for you, and you KNOW that you proved you should start worrying about convincing other people ;).. And keep in the back of your mind that basically every researcher at some point in his career believed that he proved some Lemma/Proposition/Theorem just to realize later that he made a mistake... – Nick S Mar 25 '14 at 20:50
  • 7
    a crank is defined by wikipedia as someone who is unable to perceive they are wrong even when presented with evidence to the contrary. there is no need to do anything if you accept the conclusion of reviewers. if you do not, are you asking for reviewers who can point out the mistake? and can you accept you might be mistaken & accept evidence to contrary? stackexchange has chat forums with some experts & also suggest in your case [you dont mention computer science but its in your se profile] suggest you give [cs.se] a shot. – vzn Mar 25 '14 at 20:59
  • 1
    @Raphael Am I wrong that you cannot upload anything to arxiv if you do not have an university/research center accreditation (if you are working e.g. in the industry) ? – Thorsten S. Mar 25 '14 at 23:41
  • The root problem here is that you've made an unsubstantiated claim, to wit: that you are not a crank. Yes, there are a few cases (helicobacter, e.g.) where it took a lot of time and effort to change a paradigm, but those cases are famous in part for their rarity. – Carl Witthoft Mar 26 '14 at 00:27
  • @ThorstenS.: Sorry, too many negations for me (at this hour). – Raphael Mar 26 '14 at 01:35
  • 1
    @PristineKavalostka: I'm aware of such example, and I'm would be quite embarassed would I have participated in the reviewing process for some years. That said, the fact that it does not always work well (because of laziness, external pressure and what not) does not mean it should not, and that's what I claimed. (Arguably, (at least) conference publications are all but worthless [in CS] and "everbody knows this". But of course, nobody wants to openly acknowledge let alone act on it, because everybody involved is a stakeholder.) – Raphael Mar 26 '14 at 01:38
  • 13
    One example of a Nobel Prize winning scientist who was ridiculed is Shechtman for his discovery of quasicrystals. [1]He lost his research job and had been told to read a textbook on crystals, similar to what you've been told. It takes perseverance, convincing people 1 by 1 and finding the right journal to publish in. [1] http://www.bloomberg.com/news/2011-10-05/technion-s-shechtman-wins-chemistry-nobel-for-discovery-of-quasicrystals.html – Rinze Smits Mar 26 '14 at 03:43
  • 30
    @JoelReyesNoche : They laughed at Columbus... and they were right and Columbus was wrong. (They all knew the Earth is round, Columbus just assumed it's 4 times smaller and so can cross the ocean. He was just lucky there was some land in-between, otherwise he would have starved just as others predicted) – vsz Mar 26 '14 at 13:36
  • 4
    Maybe I'm missing something, but if the problem is just having no feedback, couldn't he just pay someone to review his work? Of course if he pays him, he have to explain to him what's wrong... – o0'. Mar 26 '14 at 13:44
  • 1
    see also analogs of P vs NP in history of math MO for some idea/analogies of how it relates to previous very difficult problems in mathematics; there are other issues raised here wrt peer review. see also area51 stem-review proposal; & also this essay Math monster has many refs on the P vs NP problem incl across stackexchange sites/questions & gives some bkg on how/why its so hard. – vzn Mar 26 '14 at 16:17
  • @Raphael - Next time you may want to consider posting your comment as an answer instead of a comment on the question. – eykanal Mar 27 '14 at 02:25
  • @eykanal: Noted. I posted the comment back on [cs.SE] and did not assume it had general merit (no restriction to CS or P/NP here). By now, there are better answers so I'll leave it at that (?). – Raphael Mar 27 '14 at 08:17
  • 16
    If your proof is actually that "P = NP", then your path forward is simple - write a program that actually solves NP problems in polynomial time. One you have demonstrated that you can break public key encryption, or calculate some unknown Ramsey numbers, people will believe you. – mbeckish Mar 27 '14 at 14:36
  • 18
    @mbeckish Neither would this necessarily work (even if the algorithm has polynomial asymtotic runtime, it may not be practical at all for common inputs) nor would this necessarily convince anyone (an algorithm may be fast on some instances, that does not mean it runs in polynomial time). – Raphael Mar 27 '14 at 15:00
  • 2
  • 1
    @mbeckish: Raphael is correct; your requirement is likely sufficient, but it's not necessary. Suppose P=NP but the fastest possible SAT solver runs in n-to-the-kajillion time; it still could be impossible to solve all large SAT problems in polynomial time. – Eric Lippert Mar 27 '14 at 15:32
  • 2
    @Raphael - I'm sure if it worked well enough on enough inputs, it would encourage people to examine his proof more carefully. – mbeckish Mar 27 '14 at 15:32
  • 1
    @EricLippert - True. Just throwing out one sufficient path forward - definitely not the only path, and possibly not even a feasible path. We have absolutely no details from the OP. – mbeckish Mar 27 '14 at 15:34
  • 12
    Just post your paper on the relevant stack exchange. It'll get shot down soon enough. – TheMathemagician Mar 27 '14 at 16:29
  • 4
    @Rinze, Shechtman had read those textbooks already, he actually had a PhD in the topic. So his example has nothing to do with when people tell those who haven't read a textbook to read one. – Kaveh Mar 28 '14 at 05:10
  • 1
    "It breaks what most people believe or what they have already proven" sounds quite impressive: What problem did you solve? – Marcus Bitzl May 13 '14 at 10:41
  • 2
    Solving P = NP would break the world. I would proceed differently solving that problem from other big problems. As an aside, if that's not obvious to you, we can safely assume you don't understand what P and NP are. –  Jan 12 '16 at 04:45
  • Another link to add to the stories already discussed, and to think about: http://www.sciencealert.com/a-purported-new-mathematics-proof-is-impenetrable-now-what – Michael Lai May 19 '16 at 23:29
  • 1
    @djechlin: Proving that P = NP would have no practical impact, because proving that there is an algorithm that solves a problem in polynomial time doesn't help you finding an algorithm that solves the problem in the lifetime of the universe. – gnasher729 Sep 13 '16 at 16:18
  • 1
    I kind of wish I could give a bounty to @E.P.'s justification for his bounty. Lovely. – Daniel R. Collins Sep 24 '16 at 16:13
  • Maybe giving some "hints" on which method you used and which open problem you settled might help the community here to tell either "well, it might be true", or "no, this is a common mistake."

    The questions is so dangling in the air, it is nearly impossible not to think that your claim is wrong.

    – padawan Nov 10 '16 at 12:32
  • 2
    We have alot of examples that reviewers do not grasp the importance of ones work. CNN that is one of the major breakthroughs in Machine learning and Computer vision related tasks, have been rejected in CVPR. or the dark knowledge paper for Jeffry Hinton, one the founding fathers of Deep Learning had also been rejected. go see how influential both of these papers were(and still are). so yeah, thats something to be expected. – Hossein Feb 13 '18 at 17:08
  • 8
    Interesting to know how did this ground-breaking research end up? – Failed Scientist Aug 03 '18 at 09:41
  • 1
    I think the question is here "should you [generic] accept what the others are telling you that it's wrong - given that they have not provided any actual reasoning and simply mere assertion - on faith, and forgo trying to understand what the objections actually are and why it's wrong?" Or alternatively, "how can you gain something more concrete about what is wrong with your paper, on the assumptions that they read at least some of it and that their rejection is based on spotting something questionable, yet that they have failed to actually communicate what that is back to you?" – The_Sympathizer Mar 16 '19 at 14:34
  • Take a step back and wonder if you are living in a La-la land. – kosmos Jul 29 '20 at 08:55
  • 1
    "It breaks what [...] they have already proven". This is technically impossible. Either they didn't prove, or it doesn't break anything. – Alessandro Della Corte Apr 07 '22 at 07:01
  • Why are this - and the closed [duiplicate] in Academia, for instance - not ideal candidates for SE Worldbuilding, if not for SE Physics. Why not for their own WWW? – Robbie Goodwin Mar 01 '23 at 15:00
  • If the paper is well-written free of mistakes and typos, then don't worry too much. – High GPA Aug 16 '23 at 10:27