|
|
发表于 2016-2-27 20:44:01
|
显示全部楼层
: O; J' U' K* j/ H) k4 ?http://www.wordandphrase.info/h_dispersion.asp0 O: \# a1 v% x1 w% y9 I
Why doesn't the frequency ranking follow the absolute frequency of a word?3 R9 L+ N1 x7 H( l% @( y! `
DISPERSION AND RANKING (1,60,000)6 W0 ]3 n: S2 d& t
; m% M9 E: B: O& h/ VAs you browse through the frequency listing, you may notice that words with a lower frequency than other nearby words have a higher ranking (1-60,000). This is because the ranking is a function of two numbers: [frequency x dispersion]. Dispersion is a score (0.00-1.00) that measures how "evenly" the word is spread across the entire corpus (with 1.00 being the most even). The idea is that if a word is concentrated in just one or maybe two genres (or worse, even just a few sub-genres or texts in that genre), then the word is more specialized, and shouldn't be ranked as high in the overall list 1-60,000.
8 j4 O3 T; C0 m6 @
, j1 w0 f7 c/ q- o7 C5 x) bMost people won't need to see the dispersion score. If you do, you might consider downloading the data that contains this information. (See a sample (every seventh word, 1-60,000) with dispersion in the right column).
7 b! p0 Z$ ^- ~- B; X- U- h2 ]4 g0 x, P+ o" U
Also, please be aware that there are still some isolated "issues" with the frequency list, especially with words that occur mainly as a proper noun or in proper nouns (e.g. cook, ray, frost, savage). In most cases, these are already marked in the frequency list with parentheses, to let you know that there might be problems. But even with these issues, we believe that the frequency list here is more accurate than any other large frequency listing of English.
- U x$ Z; m* h/ h* X: W
+ W. M* i. z, Q7 \/ Ehttps://en.wikipedia.org/wiki/Statistical_dispersion+ t- Y/ a9 n5 @+ [! i9 p
$ k+ Z0 {- n# g0 h& Y. O
6 M3 |6 t" f2 \2 Y0 W6 W6 q: a2 ^; b/ b
|
|
4 _$ \9 O9 B/ I! @6 L
