Fake Paper Update: My Paper has now been disqualified

Earlier today, I wrote about the fake paper I published.

Now, at 12:26pm, I received an email informing me that my paper has been disqualified. This disqualification happened many hours after the full story broke on Mid-Day, and almost a day after Mid-Day journalists had called up the organizers asking them how they let a fake paper get published by the conference. (According to the Mid-Day report, at that time the organizers responded that, “He (Kabra) might have sent it for another journal.”)

Here is the full text of the email

From: editor@iraj.in (21 mins. ago) (inbox)
Subject: Paper Disqalified
To: riaaseth@gmail.com, baldev.thakur@yahoo.com
Date: Sun, 29 Dec 2013 23:56:10 -0700

Dear Riaa Seth,

It is to inform you that after going through the fake paper submitted by you
in the conference. we have stopped the publication. and we have not
distributed the proceedings hard copy also on the conference day. The
acceptance is mistakenly sent to you by our coordinator. You are disqualified
to attend any of the upcoming IRAJ Conference.

Thank you.
With Honor and Regards
Managing Editor
INSTITUTE OF RESEARCH AND JOURNALS(IRAJ)
Official Website: www.iraj.in
Join us Facebook/IRAJ
Mob: 91-8598978459
Mail:editor@iraj.in/Iraj.editor@gmail.com

Yesterday, the paper had appeared in the online conference proceedings in the IRAJ website. The paper has now disappeared. We were expecting this, so we had archived the relevant webpage at the Wayback Machine. The online proceedings page is here. Compare this with the current version of the page. See the difference in paper number 20? Unfortunately, the PDF of the paper cannot be archived by the Wayback Machine. But here is a long list of people who downloaded the paper form the IRAJ website, on December 29 and morning of December 30 2013, and confirmed that the paper indeed contained nonsense.

I wonder if I should ask for a refund of my Rs. 3000 that I gave them to ensure that my paper is published…

Also, I am pretty sad that I am disqualified from attending upcoming IRAJ conferences. The next one in Pune, happening just one week from now, is International Conference Academics on Computer Science and Information Technology. But, this time, I hope the organizers read the accepted papers more carefully.

How I published a fake paper, and why it is the fault of our education system

I am currently too upset to be able to do a good job of writing this article concisely and effectively, so please be patient and read the whole rambling thing. Note also: I’m not upset about the existence of one such conference – the real problem are the publish-or-perish rules in colleges/universities that are forcing the students to such conferences (of which there must be hundreds). Update: Mid-Day has done an article on this issue – you can check that out.

Consider this: http://iraj.in/Conference/2013/Pune/ICRIEST/

Seems like an impressive conference, and getting a paper published in this conference should be a big achievement on any student’s resume, right?

Wrong.

We submitted to two fake papers to this conference – one was complete gibberish auto-generated by using the online fake paper generator at SCIGen, while the other was auto-generated gibberish interspersed with completely ridiculous statements, movie dialogues, and other random things. Both these papers where accepted by this conference. We paid the conference registration fee for one of the papers, and that was published in the conference proceedings, and we did not pay the registration fee for the other paper, so that paper was not published by them. The conference fee is Rs. 6000 for M.Tech. students (but we managed to get a 50% discount just by haggling with them in the same way we haggle with vegetable vendors).

Note: the paper that actually got published is such that anyone reading past paragraph #2 of the paper will realize it is complete nonsense. You be the judge of whether a paper like this should be acceptable to any conference which claims that papers are “peer reviewed and evaluated based on originality, technical and/or research content/depth, correctness, relevance to conference, contributions, and readability”

I would recommend you read the whole paper, but even if you don’t, note the following things:

  • Paragraph #2 of the introduction, on the first page itself, says: You should read any paragraph that starts with the first 4 words in bold and italics – those have been written by the author in painstaking detail. However, if a paragraph does not start with bold and italics, feel free to skip it because it is gibberish auto-generated by the good folks at SCIGen.
  • One section of the paper consists entirely of dialogues from the movie “My Cousin Vinny.”
  • And the conclusion section of the paper actually has this: And we’ve managed to reference Hilbert, HHGTTG, Sholay, My Cousin Vinny, Jeff Naughton, the Wisconsin Database Performance Paper, Xeno’s paradox, Meeta Kabra and the wogma.com website, and we even referenced the Sokal Affair in the heading of the paper (actually in the name of the institute that the authors are from, but you get what I mean, right?) proving once and for all that nobody has read this paper.

And this paper, was not just accepted, but also published in the conference proceedings. From early morning of 29th December (IST) to 11am of 30th December (IST), the paper was listed on the conference website and you could actually download from there. As expected, a few hours after this story broke on 30th December, the paper disappeared from the conference website without a trace. We were expecting this, so here is a long list of people who downloaded the paper form the IRAJ website, on December 29 and morning of December 30 2013, and confirmed that the paper indeed contained nonsense. (Note: we tried to get the Wayback Machine to archive the paper, but due to the way the Wayback Machine works, the updated page has gotten archived.)

Is it just a case of low standards?

One science reporter suggested on twitter that maybe this is a case of a conference so desperate for papers that rejection rates are low. Someone else suggested that this might simply be a case of a conference that has no review process, so anything is published.

Not quite. The organizers are clearly claiming that there was an expert review process for acceptance into the conference. For each of the two papers we submitted, they first sent one email saying that the paper had been sent for review. Later we received an ACCEPTANCE LETTER which appeared to indicate that the paper had been accepted based on 4 review scores. Note: we never received any actual review feedback from any reviewer – this point becomes relevant below.

Just to confirm that there was no misunderstanding of the process followed by the conference, I landed up at the conference with a journalist from Pune Mid-Day, and we interviewed the organizers about the conference.

The organizers made the following claims (which I managed to audio record on my phone):

  • The conference received 130 submissions out of which only 60 were selected.
  • All the papers were reviewed by panelists from a panel of international experts using a double-blind review methodology.
  • Only high quality papers were accepted
  • All accepted papers were sent reviews from at least 3 reviewers each and the authors were then asked to update the papers based on the review comments. (No such thing happened with the 2 papers we submitted to the conference.)

Who are affected by such conferences?

When I went to the conference, I found about a dozen delegates who all had papers to present, and most of them were M.E. or M.Tech. students from various parts of the country. There were 2 students who had come all the way from Odisha to Pune just for this conference. One of them had brought his mother along for the conference too. Two students had come from Solapur. There students from local Pune colleges too. All of them had paid the conference registration fees, and the travel costs from their own pocket. All of them were publishing because it was a requirement for their degree.

I had gone to the conference with the intention of making a ridiculous presentation along the lines of my ridiculous paper, and create a scene at the conference with the reporter and photographer from Mid-Day. However, after seeing the sincere faces of all the students there, I just couldn’t make myself do it. Instead of introducing myself as an author of a paper, I introduced myself as a reporter from PuneTech.com and joined the Mid-Day reporter in interviewing the organizers. I just stayed long enough to record the statements of the organizers and left.

How did I get involved in this?

Two years ago, I was an external advisor for a B.E. Project. My students told me that the University has a requirement that all B.E. Projects must be published in an international conference. This is such a patently ridiculous requirement that I tried to convince them that they must be mistaken. However, I couldn’t convince them.

So, I tried to prepare them for failure by pointing out that an average or even above-average B.E. Project report is not of the quality that can get published in a good conference. Imagine my surprise when the paper actually got accepted. And nothing I could do could prevent my students from paying Rs. 6500 as registration fees and going all the way to Kanyakumari using their own money to present at that conference.

This convinced me that misguided policies are forcing students into paying money to get papers published in conferences with low or non-existent quality standards. And I was sure that there must be many such conferences. And I needed to do something about this issue.

Ever since that happened, I’ve been waiting for one such conference to come to Pune so that I could prove, beyond any doubt, that these conferences accept anything as long as you are willing to pay the registration fees.

Update: as far as I know, it is not a university requirement that BE Projects must be published – that was just probably a case of a few colleges misguiding students. However it either is a mandatory requirement for ME/MTech, or lots of colleges are telling the students that it is a requirement.

Is this issue important?

Is this really an issue worth getting worked up over?

As far as we understand, all M.E. and M.Tech. students in the country are required to publish at least two papers, otherwise they cannot get their degree. This results in a country full of desperate students who have no choice but to pay for getting published at conferences like this one.

The conference organizers told us that:

  • The organization which held this conference has been in operation for 3-1/2 years
  • In that period they have held over 120+ such events
  • Each event has had an average of 30 to 50 presenters
  • They operate our of 4 major centers in India – Pune, Hyderabad, Chennai, and I forgot the 4th.

This is just one organization. I’m sure there must be many more such organizations all over the country.

In the past, we have heard of some colleges who told the students that it was mandatory for undergraduate (B.E.) students to also have published their B.E. project in an international conference. On a similar note, the organizers of this conference very passionately told us that they would like this to become a mandatory requirement across all the undergraduate engineering colleges in the country. Which of course would increase the size of the problem by an order of magnitude. I’m sure some bureaucrat sitting in some office is giving this some serious thought.

What to do?

My original intention of doing this was to spread awareness amongst students about the true nature of such conferences.

But now, after having gone through the experience, I am a bit depressed. I don’t know how awareness about this issue is going to help.

  • Even if students are aware of the issues, it is still very difficult to figure out whether any given conference indeed has high quality standards and a good peer/expert review process or not.
  • Even if there was an easy method of being able to distinguish between good conferences and bad ones, what are the students expected to do? They can’t graduate without publications.

The root of all evil is this stupid rule that mandates that all M.E./M.Tech. students must have two publications. Until that is changed, this sort of a thing will continue to thrive. (Note: I don’t really know for sure whether there is indeed such a rule, and whether it is applicable to all colleges in India – I’m just repeating what I heard from the students and the organizers of that conference.)

The more I dig into our education system, the more depressed I become.

How I studied for the IIT-JEE

(I had written this as an answer to a question someone asked me to answer on Quora. I am a bit surprised by the amount of popularity and the kinds of reactions it garnered.)

I managed to get a rank of 14 in JEE (1988) in a very unconventional way.

I will first give a conventional answer about how I studied (or rather did not study), and in the latter part of the answer, I will speculate on why I think I did well.

The things I did NOT do:

  • No classes: I did not join any JEE coaching classes – for the simple reason that I lived in Nashik, and at that time, there were no JEE classes in Nashik. In fact, few people had even heard of JEE or IITs. (I did join coaching classes for 11th/12th board studies, and my performance in board exams is directly attributable to those classes. (Thank you Gadgil and Vanzari Sir.))
  • No skipping college: I attended all the lectures and all the labs and my classes in my 11th/12th.
  • No other exams: I did not appear for any entrance exams other than my 12th std board exams, and JEE.
  • No losing sleep: I used to sleep for 8 hours every day.
  • No sacrificing 12th std: I was not really expecting to clear JEE, so JEE studies were a second preference, and I studied hard for 12th std (HSC, Maharashtra) exams. I did well (2nd in Pune board merit list).
  • No Resnick and Halliday / Feynman / Irodov: I did have my own copies of the two volumes of Resnick and Halliday, but to this day, I have not read more than one page. I hadn’t even heard of Irodov or Feynman.
  • No marathon/heroic study sessions: I never studied for more than 3 hours per day (except in the last month). In the last month, I did study about 8 to 12 hours per day.
  • No JEE preparation/classes in school: I hadn’t even heard of IIT or JEE until my 10th std, so there was no question of doing any IIT-related preparation in 5th/6th/7th as kids seem to be doing these days. I started in 11th.
  • No practice exams: I did not appear for any mock tests.
  • No study buddies: As I mentioned above, I did not know anybody else in my city who was appearing for the JEE seriously. So, I did not study with someone else.

What I actually did:

  • Agrawal Correspondence Course: In those days, Agrawal classes of Bombay (which no longer exists, I believe) had a correspondence course. I signed up for that. I used to get one packet of study material, and practice questions every month. I would go through the study material, and then solve all the practice questions (by myself). Agrawal would also have practice tests, and mock exams, and other such things. I never did any of those. If you sent them your answers to their practice questions, they would send back corrected copies. I never did any of that either.
  • Board exams vs JEE: For most of my 11th std., I attended all my classes, labs, and the (non-JEE) coaching classes, and did some studies, but not a lot. I started seriously studying for JEE around the end of 11th std. From then on, for most of 12th std, I did only JEE studies, and did not bother with college studies (except attending all lectures and labs and coaching classes). About 2-3 months before the 12th board exams, I stopped JEE studies entirely, switched to studying only for the board exams. After the board exams, I had about 1 month of studying for the JEE.
  • Regular Studying – 3 hours per day: Starting from (roughly) the second half of 11th std, I studied 3 hours everyday. Regularly. This included JEE studies as well as college studies. I would start studying at 10pm, after a good dinner, and watching about an hour of TV with my family. I would study until 1am. Sometimes I would go on till 2am if the problem set I was working on had particularly difficult problems. In any case, I would sleep until 9-9:30am in the morning, and then go off to attend college (10:30 onwards), and labs (afternoons). I did not do any studying other than during those 3 hours (except in the last month before my board exams and the month before JEE, when I did not have to attend college, so I would study the whole day, roughly 5-6 hours during the day, and 3-4 hours at night.)
  • Doing everything else: I attended college during the day. In the evenings (starting around 6/7pm) I would go for a long walk. I had various friends and relatives who stayed 3-5km from home, an I would walk to their house, spend an hour with them, and walk back home. In case of friends, I would either goof off with them, or if close to college/board exams, I would help them with problems in their studies. In case of relatives, I would play with my cousins (who were babies at that time). After coming back home, I would watch TV (we had just 2 channels at that time) until 10pm.

Was it a fluke?

Since I never appeared for any mock tests, I had no idea how I would do in JEE. Only 1 guy from Nashik had made it into IIT 2 years before I did, with a rank of around 200, and he had been a state topper in the board exams. I did not believe that I was as smart as he was, so I would have been very happy if I had gotten a rank between 1000 and 1500. But, I believed that there was a very good chance that I would not get in at all.

So, I was flabbergasted when I got a rank of 14. Agrawal classes had invited the top-100 rank-holders for a 3 day celebratory trip to Bombay, and when I met and talked to the others, I quickly realized that I had not done any of the things that the others had done to crack the JEE. This feeling got even more pronounced in my first few days in IIT-Bombay. A lot of my classmates were students from Ruparel college, who used to talk about Feynman’s lectures in physics, and the difficult problems from Irodov, and some particularly arcane paradoxes involving angular momentum, and other such things. In general, they had far, far more exposure than I did, and I managed to get myself a massive inferiority complex, and would often wonder whether my JEE rank had been a mistake or fluke of some sort.

I had an unhappy couple of months until the first mid-semester exams, when I out-scored most of them and it slowly began to dawn on me that in spite of my lack of exposure to Messrs. Resnick, Halliday, Irodov, and Feynman, my JEE rank was not a fluke.

So, what was my secret?

I don’t know. But over the course of my 4 years in IIT, I realized one thing: my basics in Physics and Maths were extremely clear. (The same couldn’t be said for Chemistry, but that is another story.)

I now believe that my success was probably due to some of the books (related to Maths, Physics, and general Problem-solving) that I read (just for fun) between the ages of 5 and 15. (A list of the books is included at the end of this answer)

When I was 6, my aunt (who lived in the US) gifted two books of brain teasers (Master Mind Brain Teasers, and Master Mind Pencil Puzzles – both by Joseph and Lenore Scott) to my sister (who was 4 years older). Many of the problems were too complicated for me, but I would simply read the question, and then read the answer. I do think it helped me develop very good problem solving skills (in spite of the fact that I did not actually solve most of the problems myself). Over the next 3-4 years, I would periodically return to those books and re-read them. (Thank you, Krishna Rajadhyaksha)

When I was 9, my school gave me: Figuring the Joy of Numbers (by Shakuntala Devi). This got me started on a life-long love of numbers and maths. (Thank you, Mrs. Roy.)

When I was 11, I got books on Physics and Maths by Ya. Perelman: Algebra Can Be Fun, Figures for Fun, Physics for Fun and Entertainment, Parts 1 and 2. (I can’t find a link to these exact books on Amazon, but I believe this and this are newer editions of the same books). These books I continued to read on-and-off for the next 3-4 years.

Important point to note: these books are not text books, and were not supposed to be “study” books, and were not prescribed by any teacher or class. All of them are ‘fun’ books that I read just out of interest. In fact, my parents would (mildly) complain that I never studied. But it is because of these books that I have very strong fundamentals in Physics and Mathematics (based on intuition, and not just rules and formulas), and good problem solving skills.

I do believe that these books helped build the foundation on which I was able to crack the JEE with much less effort than it takes most other people.

Random tidbits:

  • The only reason I had even heard of IIT and JEE was that I had a classmate in school who had moved to Nashik from Bombay, and he had a brother who was an IITian. He told me that I should appear for the JEE. (Thank you Suyog Moogi). He himself did not appear for the JEE (in spite of the fact that he would get roughly the same marks as I did in school).
  • As you can see from the “So, what was my secret” section above, I did not have a strong foundation in Chemistry. This ensured that I hated studying for Chemistry for JEE, and I continued to hate it after I joined IIT. At the end of my 1st year, on the day of my Chemistry test, I literally burned my Chemistry textbooks because I knew that I would not have to study Chemistry again in my life. A note to those who are going to use this as an excuse to stop studying Chemistry: The fact that I hated Chemistry meant that I had to spend more time studying it, not less. In fact, that is the reason I hated it.
  • These days I routinely give copies of the 4 Perelman books as gifts to any school kids of my friends/family if they show an interest in Science/Maths. Sadly, many of them never read the books 🙁 but I hope there are at least one or two who are inspired by them the way I was.
  • After all the 12th std exams were over, I promised myself that I would never again give this much importance to academics (or indeed my career) again. I decided that I would take an active interest in things other than studies/work. I have largely kept that promise, and as a result, my career graph has not been as impressive as some people expect (based on my JEE rank – e.g. went to a top-10 Univ in the US, not top-5; did not become a fellow/CXO in a large company; and now struggling with a startup that I *want* to do instead of a lucrative job that I *should* be doing; etc), but I have no regrets. I have done other things that I am proud of.
  • It is important to remember that not cracking the JEE does not mean that you’re not smart enough, or that you’re not going to be successful in your career. Students will appear for JEE, or have appeared and failed, and especially parents of such students – do not give up hope just because of bad JEE scores. I have seen enough people who barely managed to get into tier 2 or even tier 3 colleges, and even there, barely managed to pass their exams, but are now running extremely successful companies in which they hire IITians and later fire (some of) them for being too lazy. I have also seen people who are clearly not as smart as some of the other people around them, but when you look at their career over a period of 10+ years, you see them outperforming the others simply through hard work. Do not make the mistake of underestimating someone (especially yourself) due to lack of academic success.

(Check out some of the comments on this answer, and other related discussion on Quora.)