Does a High-Impact Journal Guarantee a High-Impact Paper? Our Data Says No. 高IFジャーナルを目指すべきか?

on

Journal Impact Factor vs. Paper Citation Count

日本語版は下記にあります。

Based from papers from //scholar.google.com/ (Lenggoro, July 2025)

The scatter plot below illustrates that higher journal impact factors do not necessarily correspond to higher citation counts for individual papers, highlighting the variability in how papers perform of the journal’s overall prestige. 散布図は、ジャーナルのインパクトファクターが高いことが必ずしも個々の論文の引用数の増加に繋がるわけではないことを示しており、論文のパフォーマンスがジャーナル全体の権威に及ぼす影響にはばらつきがあることを強調しています。

Scatter plot of journal impact factor (in 2025) vs. citation count for “top” 10 papers

Note: The paper published in Chemical Engineering Science is a “perspective” article based on an invited talk. The Impact Factor shown (above) is the latest available for 2025, not the value at the time of the paper’s publication. 本図に示した「Chem. Eng. Sci.」誌の論文は、招待講演に基づく特別な論文です。上図は掲載時のインパクトファクターではなく、最新版(2025年)の値を使用しています。

Then, based on 100 papers //scholar.google.com/

The Impact Factors (IF) mentioned in this analysis (below) are from the year each paper was published, not the current 2025 values.

 The Impact Factors mentioned in this analysis are from the year each paper was published, not the current 2025 values.
 The Impact Factors mentioned in this analysis are from the year each paper was published, not the current 2025 values.

Does a High-Impact Journal Guarantee a High-Impact Paper? My Publication History Says No.

As researchers, we’re often conditioned to chase publications in high-impact factor (IF) journals. The logic seems simple: a top-tier journal equals greater prestige, wider visibility, and, ultimately, a higher number of citations. It’s a metric that institutions, sponsors/funders, and hiring committees have leaned on for decades. But is the journal’s IF really the ultimate measure of a single paper’s influence?

I decided to put this idea to the test using my own publication record from Google Scholar. By plotting the citation count of my papers against the impact factor of the journals they were published in, I found a surprising—or perhaps, not so surprising—result. The data clearly shows that a journal’s impact factor is not a reliable predictor of a paper’s individual citation count.

The Data Doesn’t Lie: A Scattershot Relationship

To see what I mean, let’s look at the data. I took my 100 most-cited papers and mapped their citation numbers against their journals’ 2-year impact factors at the time of publication. If a high IF always led to high citations, you’d expect to see a neat, upward-trending line. Instead, the reality looks more like a scattershot pattern.

Here are a few standout examples from my own work that dismantle this common assumption:

  • My Most-Cited Paper: My single most-cited article, “Preparation of nanoparticles via spray route,” has been cited 878 times. It was published in Chemical Engineering Science, which had a respectable but not top-tier IF of around 1.8 in 2003 (~4.3 in 2025).
  • My Highest Impact Factor Publication: On the other hand, a paper “Novel route to nanoparticle synthesis by salt‐assisted aerosol decomposition,” was published in Advanced Materials, a journal with a stellar IF of about 8.1 in 2001 (~26.8 in 2025). That paper has received 225 citations—an excellent number, but nearly four times fewer than my top-cited work in a much lower-IF journal.

This isn’t an isolated case. Here are a few more comparisons from my list:

  • A 2007 paper in Chemistry of Materials (IF ~5.1, and ~7.0 in 2025) has 465 citations.
  • A 2000 paper in Materials Research Bulletin (IF ~0.9, and ~5.7 in 2025) has 341 citations.
  • A 2006 paper in Advanced Powder Technology (IF ~0.7, and ~4.2 in 2025) has 245 citations.

A paper in a journal with an IF of less than 1.0 has out-cited another paper in a journal with an IF over 8.0! This pattern repeats itself throughout my publication history.

“What About a Journal’s Rising Impact Factor?”

It brings up a classic ‘chicken and the egg’ question: Does a rising IF make a paper successful, or do successful papers cause the IF to rise?

My view is that it’s overwhelmingly the latter. A journal doesn’t become prestigious in a vacuum. Its reputation is built, brick by brick, by the impactful research it chooses to publish.

Think of it this way: our paper in Chemistry of Materials (465 citations) didn’t just benefit from the journal’s solid reputation; it contributed to it. The high citation count of my paper, and others like it, is precisely what feeds into the calculation that later boosts that journal’s impact factor. The impactful papers come first, and the rise in IF follows.

So, a rising IF isn’t a magical force that retroactively makes a paper more valuable. Instead, it’s often a reflection—a lagging indicator—of the great science that authors are already producing. It confirms that the journal was successful in identifying and publishing work that the scientific community found important. The power still lies with the research, not the journal’s score.

What Really Drives a Paper’s Impact?

This isn’t to say that publishing in top journals isn’t a worthy goal. They offer rigorous peer review and great visibility. However, my data confirms that the long-term impact of a research paper is driven by much more than the journal’s brand.

  1. The Quality and Novelty of the Research: This is the most crucial factor. A groundbreaking study that solves a major problem, introduces a new technique, or opens up a new field of inquiry will be cited regardless of where it’s published.
  2. The Relevance of the Topic: A paper that addresses a timely and widely studied topic will naturally attract more readers and, therefore, more citations.
  3. Accessibility and “Findability”: Is the paper well-indexed? Is it accessible to a broad audience, perhaps even across disciplines? Sometimes a specialized journal, while having a lower IF, reaches the right audience more effectively than a general high-impact one.
  4. The “Slow Burn” vs. the “Flash in the Pan”: Some papers become foundational and accumulate citations steadily over many years, while others might be on a “hot topic” that generates a quick burst of citations but fades over time. The journal IF, which is typically a 2-year snapshot, can’t capture this long-term relevance.

Look Beyond the Impact Factor

My journey through my own publication data has reinforced a critical lesson: we need to look beyond the impact factor. While it’s one of many metrics, it is a flawed and often misleading proxy for the quality or influence of an individual piece of work.

For fellow researchers, especially those early in their careers, the message is to focus on doing great science. Write a paper that is clear, rigorous, and addresses an important question. That is what will ultimately earn your work the attention and citations it deserves, no matter the impact factor of the journal it ends up in. The real impact is measured by how your work influences the field, not by the number on a journal’s masthead.

高IFジャーナルを目指すのは、もうやめよう。私のデータが示す、論文の本当の価値。(2025/7)

研究者なら誰もが気にする「インパクトファクター(IF)」。IFが高いトップジャーナルに論文を載せることが、優れた研究者の証であるかのように語られます。しかし、それは本当なのでしょうか?

今回、私自身のGoogle Scholarの論文データを分析したところ、興味深い事実が明らかになりました。結論から言えば、論文一本の価値は、掲載されたジャーナルのIFとは必ずしも関係ありません。

データが語る

私の論文の中で、最も多く引用されているのは「Preparation of nanoparticles via spray route」で、引用回数は878回です。この論文が掲載された学術誌の当時(2003年)のIFは、約1.8でした。

一方で、IFが8.1もある超一流ジャーナル(2025年にIFが26.8)に掲載された別の論文「Novel route to nanoparticle synthesis by salt‐assisted aerosol decomposition」の引用数は225回です。素晴らしい数字ですが、IFが4分の1以下のジャーナルに載せた論文の引用数には遠く及びません。

この事実は、何を物語っているのでしょうか?

「掲載後にIFが上がったジャーナルはどう考えますか?」

これは、まるで「鶏が先か、卵が先か」という問いに似ています。つまり、「ジャーナルのIFが上がったから論文の価値が上がったのか」、それとも「価値ある論文が掲載されたからIFが上がったのか」という問題です。

私の答えは、圧倒的に後者です。

ジャーナルの評価は、自然に上がるわけではありません。そのジャーナルに掲載された、一つ一つの質の高い論文が評価され、引用されることによって、レンガを一つずつ積み上げるように築かれていくものです。

例えば、私の論文が掲載されたことで、そのジャーナルのIF算出に貢献したはずです。つまり、価値ある論文が先に存在し、その結果としてジャーナルの評価が後からついてきたのです。

ですから、IFの上昇は、過去の論文の価値を後から高める魔法の力ではありません。むしろ、そのジャーナルが「価値ある研究を見出す力があった」ということを証明する「後付けの指標」に過ぎないのです。

結局のところ、主役はジャーナルのスコアではなく、私たち自身の研究そのものなのです。

論文の価値を決めるのは?

論文の価値を決めるのは、掲載誌の「格」ではありません。それは、研究の「質」です。

  • その研究は、本当に新しいか?
  • その研究は、誰かの課題を解決するか?
  • その研究は、次の研究への扉を開くか?

私の論文がIFに関係なく引用されたのは、その研究が当時のコミュニティにとって「必要」とされ、「役に立った」からに他なりません。良質な研究は、たとえ掲載誌のIFが低くても、必ずや必要とする研究者の元に届き、正しく評価されます。

若手研究者の皆さんへ

インパクトファクターの数字に一喜一憂するのは、もうやめましょう。IFはあくまで指標の一つであり、あなたの研究の価値を決定づける絶対的なものではありません。

信じるべきは、ジャーナルの権威ではなく、あなた自身の研究の力です。

世界中の誰かの役に立つ、質の高い研究を追求すること。それこそが、私たち研究者にとって最も大切な使命であり、本当の「インパクト」を生み出す唯一の道なのです。