Sample of UK manifesto sentences 2010 crowd-annotated for immigration
data_corpus_manifsentsUK2010sample.RdA corpus of sentences sampled from from publicly available party manifestos from the United Kingdom from the 2010 election. Each sentence has been rated in terms of its classification as pertaining to immigration or not and then on a scale of favorability or not toward open immigration policy (as the mean score of crowd coders on a scale of -1 (favours open immigration policy), 0 (neutral), or 1 (anti-immigration).
The sentences were sampled from the corpus used in Benoit et al. (2016) doi:10.1017/S0003055416000058 , which contains more information on the crowd-sourced annotation approach.
Format
A corpus object. The corpus consists of 155 sentences randomly sampled from the party manifestos, with an attempt to balance the sentencs according to their categorisation as pertaining to immigration or not, as well as by party. The corpus contains the following document-level variables:
- party
factor; abbreviation of the party that wrote the manifesto.
- partyname
factor; party that wrote the manifesto.
- year
integer; 4-digit year of the election.
- immigration_label
Factor indicating whether the majority of crowd workers labelled a sentence as referring to immigration or not. The variable has missing values (
NA) for all non-annotated manifestos.- immigration_mean
numeric; the direction of statements coded as "Immigration" based on the aggregated crowd codings. The variable is the mean of the scores assigned by workers who coded a sentence and who allocated the sentence to the "Immigration" category. The variable ranges from -1 (Favorable and open immigration policy) to +1 ("Negative and closed immigration policy").
- immigration_n
integer; the number of coders who contributed to the mean score
immigration_mean.- immigration_position
integer; a thresholded version of
immigration_meancoded as -1 (pro-immigration, mean < -0.5), 0 (neutral, -0.5 <= mean <= 0.5), or 1 (anti-immigration, mean > 0.5). Set toNAfor non-immigration sentences.
References
Benoit, K., Conway, D., Lauderdale, B.E., Laver, M., & Mikhaylov, S. (2016). Crowd-sourced Text Analysis: Reproducible and Agile Production of Political Data. American Political Science Review, 100,(2), 278–295. doi:10.1017/S0003055416000058
Examples
if (requireNamespace("quanteda", quietly = TRUE)) {
# Inspect the corpus
summary(data_corpus_manifsentsUK2010sample)
}
#> Corpus consisting of 155 documents, showing 100 documents:
#>
#> Text Types Tokens Sentences party partyname
#> BNP_2010_345 17 18 1 BNP British National Party
#> BNP_2010_278 15 15 1 BNP British National Party
#> BNP_2010_215 28 30 1 BNP British National Party
#> BNP_2010_245 17 21 3 BNP British National Party
#> BNP_2010_1086 34 37 1 BNP British National Party
#> BNP_2010_373 58 79 1 BNP British National Party
#> BNP_2010_408 24 31 1 BNP British National Party
#> BNP_2010_239 25 35 3 BNP British National Party
#> BNP_2010_223 23 24 1 BNP British National Party
#> BNP_2010_416 31 35 1 BNP British National Party
#> Coalition_2010_285 32 34 1 Coalition Coalition Agreement
#> Coalition_2010_355 26 28 1 Coalition Coalition Agreement
#> Coalition_2010_346 28 33 3 Coalition Coalition Agreement
#> Coalition_2010_284 44 51 1 Coalition Coalition Agreement
#> Coalition_2010_351 34 40 1 Coalition Coalition Agreement
#> Coalition_2010_356 17 19 1 Coalition Coalition Agreement
#> Coalition_2010_349 10 11 1 Coalition Coalition Agreement
#> Con_2010_335 16 16 1 Con Conservative Party
#> Con_2010_1154 29 31 1 Con Conservative Party
#> Con_2010_1155 25 29 1 Con Conservative Party
#> Con_2010_328 12 12 1 Con Conservative Party
#> Con_2010_330 22 28 1 Con Conservative Party
#> Con_2010_331 34 38 1 Con Conservative Party
#> Con_2010_332 13 15 1 Con Conservative Party
#> Greens_2010_854 25 30 1 Greens Green Party
#> Greens_2010_852 33 38 1 Greens Green Party
#> Greens_2010_834 25 26 1 Greens Green Party
#> Greens_2010_833 21 22 1 Greens Green Party
#> Greens_2010_848 32 40 2 Greens Green Party
#> Greens_2010_836 22 26 1 Greens Green Party
#> Greens_2010_842 39 48 1 Greens Green Party
#> Lab_2010_821 17 20 2 Lab Labour Party
#> Lab_2010_834 19 21 1 Lab Labour Party
#> Lab_2010_1319 32 38 1 Lab Labour Party
#> Lab_2010_839 31 36 1 Lab Labour Party
#> Lab_2010_841 30 40 1 Lab Labour Party
#> Lab_2010_832 17 18 1 Lab Labour Party
#> Lab_2010_730 24 24 1 Lab Labour Party
#> Lab_2010_825 27 30 1 Lab Labour Party
#> Lab_2010_742 28 32 1 Lab Labour Party
#> LD_2010_666 12 12 1 LD Liberal Demoracts
#> LD_2010_625 31 35 1 LD Liberal Demoracts
#> LD_2010_660 25 27 1 LD Liberal Demoracts
#> LD_2010_678 9 10 1 LD Liberal Demoracts
#> LD_2010_661 12 12 1 LD Liberal Demoracts
#> LD_2010_671 33 36 1 LD Liberal Demoracts
#> LD_2010_669 12 12 1 LD Liberal Demoracts
#> LD_2010_667 17 17 1 LD Liberal Demoracts
#> LD_2010_662 17 19 1 LD Liberal Demoracts
#> LD_2010_680 34 41 1 LD Liberal Demoracts
#> PC_2010_295 30 37 1 PC Plaid Cymru
#> PC_2010_294 19 21 1 PC Plaid Cymru
#> PC_2010_292 18 18 1 PC Plaid Cymru
#> PC_2010_296 22 23 1 PC Plaid Cymru
#> SNP_2010_212 35 39 1 SNP Scottish National Party
#> SNP_2010_211 25 28 1 SNP Scottish National Party
#> UKIP_2010_123 29 33 1 UKIP UK Independence Party
#> UKIP_2010_335 19 19 1 UKIP UK Independence Party
#> UKIP_2010_333 17 18 1 UKIP UK Independence Party
#> UKIP_2010_126 23 27 1 UKIP UK Independence Party
#> UKIP_2010_308 13 14 1 UKIP UK Independence Party
#> UKIP_2010_118 21 21 1 UKIP UK Independence Party
#> UKIP_2010_132 28 31 1 UKIP UK Independence Party
#> UKIP_2010_134 8 8 1 UKIP UK Independence Party
#> UKIP_2010_105 23 23 1 UKIP UK Independence Party
#> UKIP_2010_106 19 20 1 UKIP UK Independence Party
#> BNP_2010_1153 38 46 1 BNP British National Party
#> BNP_2010_720 10 10 1 BNP British National Party
#> BNP_2010_1032 19 19 1 BNP British National Party
#> BNP_2010_687 25 27 1 BNP British National Party
#> BNP_2010_241 32 35 1 BNP British National Party
#> BNP_2010_658 26 28 1 BNP British National Party
#> BNP_2010_616 14 14 1 BNP British National Party
#> BNP_2010_315 20 21 2 BNP British National Party
#> BNP_2010_662 20 21 1 BNP British National Party
#> BNP_2010_1151 36 44 2 BNP British National Party
#> Coalition_2010_453 41 46 1 Coalition Coalition Agreement
#> Coalition_2010_529 25 30 1 Coalition Coalition Agreement
#> Coalition_2010_119 14 14 1 Coalition Coalition Agreement
#> Coalition_2010_422 22 23 1 Coalition Coalition Agreement
#> Coalition_2010_562 25 27 1 Coalition Coalition Agreement
#> Coalition_2010_91 26 31 1 Coalition Coalition Agreement
#> Coalition_2010_420 25 28 1 Coalition Coalition Agreement
#> Coalition_2010_582 31 33 1 Coalition Coalition Agreement
#> Coalition_2010_240 16 16 1 Coalition Coalition Agreement
#> Coalition_2010_410 11 14 1 Coalition Coalition Agreement
#> Con_2010_467 10 10 1 Con Conservative Party
#> Con_2010_821 12 12 1 Con Conservative Party
#> Con_2010_120 19 27 3 Con Conservative Party
#> Con_2010_1081 20 20 1 Con Conservative Party
#> Con_2010_199 20 20 1 Con Conservative Party
#> Con_2010_173 29 32 1 Con Conservative Party
#> Con_2010_384 29 36 1 Con Conservative Party
#> Con_2010_681 26 27 1 Con Conservative Party
#> Con_2010_613 27 30 1 Con Conservative Party
#> Con_2010_187 14 14 1 Con Conservative Party
#> Greens_2010_264 25 28 1 Greens Green Party
#> Greens_2010_698 17 18 1 Greens Green Party
#> Greens_2010_151 16 17 1 Greens Green Party
#> Greens_2010_279 7 7 1 Greens Green Party
#> year immigration_label immigration_mean immigration_n immigration_position
#> 2010 Immigration 1.00000000 10 1
#> 2010 Immigration 0.39024390 45 0
#> 2010 Immigration 0.90476190 35 1
#> 2010 Immigration 1.00000000 6 1
#> 2010 Immigration 0.33333333 6 0
#> 2010 Immigration 0.40000000 10 0
#> 2010 Immigration 1.00000000 9 1
#> 2010 Immigration -0.83333333 9 -1
#> 2010 Immigration 0.83333333 8 1
#> 2010 Immigration 0.83333333 6 1
#> 2010 Immigration -1.00000000 9 -1
#> 2010 Immigration 0.28571429 9 0
#> 2010 Immigration -0.33333333 6 0
#> 2010 Immigration -1.00000000 11 -1
#> 2010 Immigration 0.60000000 8 1
#> 2010 Immigration -0.83333333 7 -1
#> 2010 Immigration 1.00000000 8 1
#> 2010 Immigration 1.00000000 8 1
#> 2010 Immigration -1.00000000 6 -1
#> 2010 Immigration -0.75000000 8 -1
#> 2010 Immigration 0.66666667 6 1
#> 2010 Immigration 0.50000000 7 0
#> 2010 Immigration 0.94736842 49 1
#> 2010 Immigration 0.66666667 10 1
#> 2010 Immigration -0.50000000 6 -1
#> 2010 Immigration -0.85000000 50 -1
#> 2010 Immigration -0.59459459 39 -1
#> 2010 Immigration -0.90322581 36 -1
#> 2010 Immigration 0.06976744 49 0
#> 2010 Immigration -0.20000000 9 0
#> 2010 Immigration -0.57894737 53 -1
#> 2010 Immigration 0.83333333 6 1
#> 2010 Immigration -0.33333333 6 0
#> 2010 Immigration 0.33333333 6 0
#> 2010 Immigration 0.66666667 7 1
#> 2010 Immigration 0.40000000 7 0
#> 2010 Immigration 0.83333333 8 1
#> 2010 Immigration 0.33333333 6 0
#> 2010 Immigration 0.83333333 8 1
#> 2010 Immigration 0.57142857 9 1
#> 2010 Immigration 1.00000000 8 1
#> 2010 Immigration -0.59183673 56 -1
#> 2010 Immigration 0.16666667 7 0
#> 2010 Immigration -0.83333333 7 -1
#> 2010 Immigration 0.27272727 46 0
#> 2010 Immigration -0.75862069 39 -1
#> 2010 Immigration 0.40000000 10 0
#> 2010 Immigration 0.67647059 39 1
#> 2010 Immigration -0.16666667 7 0
#> 2010 Immigration -1.00000000 6 -1
#> 2010 Immigration -0.84375000 44 -1
#> 2010 Immigration -0.83333333 42 -1
#> 2010 Immigration -0.50000000 7 -1
#> 2010 Immigration 0.00000000 7 0
#> 2010 Immigration -0.94736842 48 -1
#> 2010 Immigration -0.21621622 46 0
#> 2010 Immigration 0.66666667 45 1
#> 2010 Immigration 0.91666667 36 1
#> 2010 Immigration 0.83333333 7 1
#> 2010 Immigration 0.50000000 48 0
#> 2010 Immigration 0.25000000 7 0
#> 2010 Immigration 1.00000000 8 1
#> 2010 Immigration 1.00000000 6 1
#> 2010 Immigration 1.00000000 7 1
#> 2010 Immigration 0.83333333 7 1
#> 2010 Immigration 0.66666667 8 1
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration 1.00000000 9 1
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration 1.00000000 7 1
#> 2010 Not immigration 1.00000000 8 1
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 40 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#> 2010 Not immigration NA 6 NA
#>