Thursday, November 9, 2017

Distribution of SNIP and SJR

My colleague Matt Dornan asked me about the distribution of the journal impact factors SNIP and SJR. Crawford School has used SNIP to compare journal rankings across disciplines. It is a journal impact factor that is normalized for the differences in citation potential in different fields. This makes it reasonable to compare Nature and the Quarterly Journal of Economics, for example. Nature looks like it has much higher impact using the simple Journal Impact Factor that just counts how many citations articles in a journal get. But taking citation potential into account, these journals look much more similar. SJR is an iterative indicator that takes into account how highly cited the journals which cite the journal of interest are. It is similar to Google's pagerank algorithm. It also can be compared across disciplines. SJR is more an indicator of journal prestige or importance rather than simple popularity. I've advocated SJR as a better measure of journal impact as some journals in my area have high citations but those are not in the really highly cited journals.

I assumed the distribution of these indicators was highly skewed with most journals having low impact. But I also assumed that the log of these indicators might be normally distributed as citations to individual papers is roughly log-normally distributed. It turns out that the log of SNIP is still a bit skewed, but not that far from normal:



On the other hand the log of SJR remains highly non-normal:


There is a small tail of high prestige journals and then a big bulk of low prestige journals and a huge spike at SJR = 0.1. It makes sense that it is harder to be prestigious rather than just popular, but still I am surprised by how extreme the skew is. The distribution appears closer to an exponential distribution than a normal distribution.

1 comment:

  1. And what's the correlation coefficient between SNIP and SJR rankings? 0.8, for a sample of ~100 recent journal papers by Crawford School colleagues.

    ReplyDelete