5: Designing Projects and Collecting Text Data

Ashrakat Elshehawy

Research Project Advice

Components

  1. Review an Existing Text-as-Data Application (25%)

    • Any paper that uses quantitative text analysis of the type we study in the course
    • Must be from the social sciences (political science, public policy, economics, sociology, psychology, etc)
    • 1,000 words
    • Goal: Critical review of a single article

  2. Application of a Text-as-Data Method (75%)

    • Any method that we have studied on the course
    • Must be answering a social science research question
    • 2,000 words
    • Goals: Demonstrate understanding of method, and ability to apply, validate and interpret

Criteria

  1. Review an Existing Text-as-Data Application (25%)

    • Accuractely describe method and key implementation details
    • Discuss assumptions of method and whether they are met in this application
    • Assessment of strengths and weaknesses of the approach
    • Propose one alternative strategy for this application

  2. Application of a Text-as-Data Method (75%)

    • Clear and answerable research question
    • Accurate description of selected method
    • Discussion of assumptions behind the method
    • Description/Use of a dataset that we haven’t used on the course
    • Implementation of chosen method, with clear description/justification of analysis choices
    • Accurate interpretation of method output
    • Some attempt to validate chosen approach
    • Discussion of strengths and weaknesses of chosen approach
    • Some credit for originality and ambition of project

Note: Points in italics are only required for PGT students.

Questions First, Data Second

  1. Identify an interesting question

  2. Search for data that can answer that question

  3. Answer the question

Advantages:

  • Likely to lead to more interesting questions

    • A good research project answers an interesting question, and in this model you think about that first

  • Likely to lead to less time exploring different methods

    • Your question will guide you to a particular analysis
    • If you need to measure topics to answer your question, then use a topic model. If you need to measure complexity, then use a readability metric, etc.

Disadvantages:

  • Potentially large amount of time spent searching for/collecting data

    • The data you need may not exist in an easily accessible form
    • You will need to spend time and effort collecting it either by downloading it from various sources or getting it from an API or via web-scraping

  • Potential risk of finding nothing

    • The data you need may not exist at all!
    • Then you will need to find another question

Data First, Questions Second

  1. Identify an interesting dataset

  2. Explore that dataset using some of the tools we cover on the course

  3. Construct a research question that you can answer using that data

  4. Answer the question

Advantages:

  • Lower frustration

    • You will not spend lots of effort thinking about projects that have no hope!

  • Potentially faster

    • You will not spend lots of time trying to find data only to discover that it doesn’t exist

Disadvantages:

  • Potentially less interesting research question/answers

    • e.g. if the only data you can find is a BBC food archive, then you might have to write a silly paper all about the classification of curry receipes…

  • Often more limited metadata

    • The texts are themselves rarely sufficient for a compelling analysis. We often want metadata so that we can describe variation in some quantity of interest
    • Does your data include information about the authors of the documents? The dates they were produced? Etc.

Principles of Good Research Projects

  1. Be clear about the concept that you are trying to measure

    • Why is this an interesting concept?
    • Why is doing it this way an improvement on existing approaches?

  2. Discuss the assumptions behind your chosen method

    • What needs to be true in order for your measure to produce reasonable results?

  3. Provide some form of validation for your measure. E.g.

    • Hand-code a sample of documents and show that your quantitative text measure is associated with the human coding
    • Show that your measure passess basic face-validity checks (does it correlate with things in sensible ways, are the top-scoring texts sensible, etc)

  4. Demonstrate something interesting with the concept that you have measured

    • Finding some texts and implementing a method on the course is not sufficient – you need to answer some kind of social-science research question
    • Make use of metadata!
    • Show how the quantities you are estimating vary across groups/over time etc.

Where To Find Good Research Questions

“How To Build An Economic Model In Your Spare Time”, Hal R. Varian

Where To Find Good Research Questions

Existing Research

Thinking about the World

  • Read news articles

  • Discuss potential applications with classmates

  • Good starting points:

    • The Economist
    • The Financial Times
    • Podcasts

Using Existing Datasets

Dataverse

  • The Harvard Dataverse (https://dataverse.harvard.edu) is a data and code repository for many social science journals.

  • Many (though not all) papers will have links directly to a Dataverse page which you can use to find the data that was used in the paper

  • This is an excellent source of data for your projects!

  • Sometimes it can take a bit of searching through the files in each repository to figure out where the data is

Kaggle

  • Kaggle is a platform that hosts a wide variety of resources for quantitative text analysis, including a broad collection of text datasets (https://www.kaggle.com/datasets)

  • Many of these datasets are potentially interesting to social scientists, e.g.

    • New York Times Comments
    • Tweets about COVID-19
    • Corpus of Academic Papers relating to COVID19
    • Donald Trump’s Rally Speeches
    • etc

  • Many of these datasets lack full documentation, particularly on important dimensions such as where the data came from, who provided it, and so on

APIs

APIs

  • API: Application Programming Interface — a way for two pieces of software to talk to each other

  • Your software can receive (and also send) data automatically through these services

  • Data is sent by — the same way your browser does it

  • Most services have helping code (known as a wrapper) to construct http requests

  • Both the wrapper and the service itself are called APIs

  • http service also sometimes known as REST (REpresentational State Transfer)

API registration and authentication

  • APIs typically require you to register for an API key to allow access

    • Many are not free, at least for large-scale use

  • Before you commit to using a given API, check what the rate limits are on its use

    • Limits on total number of requests for a given user
    • Limits on the total number of requests in a given day/minute/hour etc

  • Make sure you register with the service in plenty of time to actually get the data!

  • Once registered, you will have access to some kind of key that will allow you to access the API

http requests

It is helpful to start paying attention to the structure of basic http requests.

For instance, let’s say we want to get some data from the TheyWorkForYou api.

A test request:

https://www.theyworkforyou.com/api/getDebates&output=xml&search=brexit&num=1000&key=XXXXX

  • Parameters to the API are encoded in the URL

    • output = Which format do you want returned?
    • search = Return speeches with which words?
    • num = number requested
    • key = access key

API Output

  • The output of an API will typically not be in csv or Rdata format

  • Often, though not always, it will be in either JSON and XML

    • XML: eXtensible Markup Language

    • JSON : JavaScript Object Notation

  • If you have a choice, you probably want JSON

  • Both types of file are easily read into R

  • json_lite and xml2 are the relevant packages

API packages

  • It’s not usually necessary to construct these kind of requests yourself

  • R, Python, and other programming languages have libraries to make it easier – but you have to find them!

  • I have provided a sample of APIs that have associated R packages on the next slide

  • The documentation for the API will describe the parameters that are available. Though normally in a way that is intensely frustrating.

Sample of APIs

There are many existing R packages that make it straightforward to retreive data from an API:

API R package Description
Twitter install.packages("rtweet") Twitter, small-scale use, no longer free!
Guardian Newspaper install.packages("guardianapi") Full Guardian archive, 1999-present
Wikipedia install.packages("WikipediR") Wikipedia data and knowledge graph
TheyWorkForYou install.packages("twfy") Speeches from the UK House of Commons and Lords
ProPublica Congress API install.packages("ProPublicaR") Data from the US Congress
Google Books Ngrams install.packages("ngramr") Ngrams in Google Books, 1500-present
Reddit install.packages("RedditExtractoR") Subreddits, users, urls, texts of posts

Warning: I have not tested all of these!

API demonstration

Reddit API

  • We will use the Reddit API to search for subreddits on UK Politics in the past year

  • For this example, we are not collecting a large amount of data

  • In general, you need to created a authenticated client id

  • Rate limits: currently 100 queries per minute (QPM) per OAuth client id

  • We will use library(RedditExtractoR)

Reddit API Application

library(RedditExtractoR) 

subred <- find_subreddits("UK politics")
glimpse(subred)
Rows: 233
Columns: 7
$ id          <chr> "483mxu", "4rfocy", "3g37x", "2r7v0", "jrrb9", "3ahdz", "6…
$ date_utc    <chr> "2021-04-08", "2021-07-15", "2016-08-30", "2009-09-23", "2…
$ timestamp   <dbl> 1617865911, 1626368162, 1472562586, 1253680171, 1527610526…
$ subreddit   <chr> "Divisive_Babble", "SteamDeck", "brandonlawson", "Academic…
$ title       <chr> "Divisive Babble", "Steam Deck", "The Search For Brandon L…
$ description <chr> "This is a forum for the discussion of politics, current a…
$ subscribers <dbl> 1164, 1034951, 5667, 58183, 91, 74, 29290, 9842, 1244195, …

Reddit API Application

Let’s clean the dataset and order those subreddits by number of subscribers.

subred <- subred %>%
  
  # selects variables you want to explore
  select(subreddit, title, description, subscribers) %>% 
  
  # creates new variables
  mutate(subscribers_million = subscribers/1000000, subscribers = NULL) %>% 
  
  # arranges data from highest subscriber count
  arrange(desc(subscribers_million)) 

head(subred[c("subreddit", "title", "subscribers_million")])
      subreddit                            title subscribers_million
2qh1i AskReddit                    Ask Reddit...           57.322329
2qh13 worldnews                       World News           46.913243
2qjpg     memes /r/Memes the original since 2008           35.533307
2qh55      food            Food Photos on Reddit           24.381233
2qh4j    europe                           Europe           11.460773
2cneq  politics                         Politics            8.966519

Reddit API Application

Many are not about UK politics!

Let’s now try to extract only those that are truly about UK politics, by searching for the terms “UK politic^” or “British politic^” in the description.

uk.subred <- subred %>%
  filter(grepl("UK politic|British politic", description, ignore.case = TRUE) |
  grepl("UK politic|British politic", title, ignore.case = TRUE))

head(uk.subred[c("subreddit", "title", "subscribers_million")])
               subreddit                    title subscribers_million
2qhcv         ukpolitics              UK Politics            0.532235
30c1v           LabourUK The British Labour Party            0.069528
tzpe1  UKPoliticalComedy      UK Political Comedy            0.059908
33geh        UK_Politics              UK Politics            0.005360
2qo8i         PoliticsUK   UK Politics Discussion            0.003332
4th4dw     AskUKPolitics            AskUKPolitics            0.000642

Reddit API Application

The two most common non-partisan subreddits on British politics are UKPoliticalComedy and ukpolitics

Let’s have a look at these two:

uk.comedy <- find_thread_urls(subreddit = 'UKPoliticalComedy', sort_by = 'top', period = 'all')
uk.politics <- find_thread_urls(subreddit = 'ukpolitics', sort_by = 'top', period = 'all')

What is in this data?

glimpse(uk.comedy) 
Rows: 248
Columns: 7
$ date_utc  <chr> "2021-11-10", "2023-01-27", "2022-10-03", "2021-03-20", "202…
$ timestamp <dbl> 1636530752, 1674848275, 1664830422, 1616259328, 1615137661, …
$ title     <chr> "New Conservatives logo", "Time to light the fire under Mr Z…
$ text      <chr> "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", …
$ subreddit <chr> "UKPoliticalComedy", "UKPoliticalComedy", "UKPoliticalComedy…
$ comments  <dbl> 3, 1, 5, 7, 6, 0, 13, 8, 1, 0, 12, 7, 1, 8, 4, 11, 36, 1, 28…
$ url       <chr> "https://www.reddit.com/r/UKPoliticalComedy/comments/qqp9c0/…
glimpse(uk.politics) 
Rows: 228
Columns: 7
$ date_utc  <chr> "2019-03-18", "2017-09-10", "2021-01-06", "2019-05-02", "201…
$ timestamp <dbl> 1552923461, 1505071469, 1609942152, 1556832034, 1575982428, …
$ title     <chr> "BREAKING: Speaker rules out the government bringing back me…
$ text      <chr> "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", …
$ subreddit <chr> "ukpolitics", "ukpolitics", "ukpolitics", "ukpolitics", "ukp…
$ comments  <dbl> 1061, 871, 354, 170, 771, 129, 640, 1648, 681, 569, 252, 575…
$ url       <chr> "https://www.reddit.com/r/ukpolitics/comments/b2k5i1/breakin…

Reddit API Application

We will work on the titles of those threads to measure sentiment with a dictionary based approach

make.dfm <- function(data){
    dfm <- data %>%
        corpus(text_field = "title") %>%
        tokens(remove_punct = TRUE,
               remove_symbols = TRUE,
               remove_url = TRUE) %>%
        dfm() %>%
        dfm_remove(stopwords("en")) %>%
        dfm_trim(min_termfreq = 3,
                 max_docfreq = .9,
                 docfreq_type = "prop") %>%
    
        # New step: Keep words of at least 3 characters
        dfm_select(pattern = "\\b\\w{3,}\\b", valuetype = "regex", selection = "keep")

  return(dfm)
}


comedy.dfm <- make.dfm(uk.comedy)
politics.dfm <- make.dfm(uk.politics)

How many features in those DFMs?

dim(comedy.dfm)
[1] 248  38
dim(politics.dfm)
[1] 228 179

Reddit API Application

Let’s measure sentiment based on the Lexicoder Sentiment Dictionary, available in quanteda as data_dictionary_LSD2015

dfm_lookup(comedy.dfm, dictionary = data_dictionary_LSD2015)%>% 
  dfm_remove(c("neg_positive", "neg_negative")) %>%
  dfm_weight(scheme = "logave")  %>%
  convert("data.frame") %>%
  mutate(doc_id=NULL, positive = trunc(positive), negative = trunc(negative)) %>% 
  mutate(neutral = positive == negative) %>% 
  colMeans(na.rm = TRUE) %>% print()
  negative   positive    neutral 
0.01209677 0.11693548 0.87096774 
dfm_lookup(politics.dfm, dictionary = data_dictionary_LSD2015)%>% 
  dfm_remove(c("neg_positive", "neg_negative")) %>%
  dfm_weight(scheme = "logave")  %>%
  convert("data.frame") %>%
  mutate(doc_id=NULL, positive = trunc(positive), negative = trunc(negative)) %>% 
  mutate(neutral = positive == negative) %>% 
  colMeans(na.rm = TRUE) %>% print()
  negative   positive    neutral 
0.08771930 0.09649123 0.82456140

Other functions

# Get thread content, for given URLs
get_thread_content()
# Get information on a particular user, for given list of users
get_user_content()

You could use those functions to explore:

  • The correlation between comment sentiment and upvotes/downvotes

  • Topics across sub-reddits

  • How conversation evolve depending on the topic

  • … and many other research questions!

Break & Q&A


If you haven’t already done so, please register now to use the Guardian Newspaper API: https://open-platform.theguardian.com

Web-scraping

Web scraping overview

Key steps in any web-scraping project:

  1. Work out how the website is structured

  2. Work out how links connect different pages

  3. Isolate the information you care about on each page

  4. Write a loop which connects 3 to 2, and saves the information you want from each page

  5. Put it all into a nice and tidy data.frame

  6. Feel like a superhero

(This is missing the steps in which you scream at your computer because you can’t figure out how to do steps 1-5.)

Web-scraping Demonstration

Web-scraping Demonstration

  • We will scrape the research interests of members of faculty in the Department of Political Science at UCL

  • The departmental website has a list of faculty members

  • Each member of the department has a unique page

  • The research interests of the faculty member are stored on their unique page

  • Let’s look at an exmple…

Source code

  • To collect the information we want, we need to see how it is stored within the html code that underpins the website

  • Webpages include much more than what is immediately visible to visitors

  • Crucially, they include code which provides structure, style and functionality (which your browser interprets)

    • HTML provides strucutre
    • css provides style
    • JavaScript provides functionality

  • To implement a web-scraper, we have to work directly with the source code

    • Identifying the information on each page that we want to extract
    • Identifying links between pages that help us to navigate the page programmatically

To see the source code, use Ctrl + U or right click and select View/Show Page Source

Load initial page

We can read the source code of any website into R using the readLines() function.

library(tidyverse)

spp_home <- "https://www.ucl.ac.uk/political-science/people/academic-teaching-and-research-staff"

spp_html <- readLines(spp_home)
spp_html[1:20]
 [1] "<!DOCTYPE html>"                                                                                 
 [2] "<html lang=\"en\" dir=\"ltr\" prefix=\"og: https://ogp.me/ns#\">"                                
 [3] "  <head>"                                                                                        
 [4] "    <meta charset=\"utf-8\" />"                                                                  
 [5] "<script>window.privacyConfig = {"                                                                
 [6] "    \"privacyPolicySection\": {"                                                                 
 [7] "        \"url\": \"https://www.ucl.ac.uk/legal-services/cookies\","                              
 [8] "        \"linkText\": \"UCL privacy policy\","                                                   
 [9] "        \"title\": \"Privacy Policy\","                                                          
[10] "        \"description\": \"Learn more about how we handle your data and protect your privacy.\","
[11] "        \"enabled\": true"                                                                       
[12] "    },"                                                                                          
[13] "    \"whitelist\": ["                                                                            
[14] "        \"https://app.geckoform.com\","                                                          
[15] "        \"https://cxppusa1formui01cdnsa01-endpoint.azureedge.net\","                             
[16] "        \"https://assets-eur.mkt.dynamics.com\","                                                
[17] "        \"https://apply5.lumessetalentlink.com\","                                               
[18] "        \"https://api.reeled.online\""                                                           
[19] "    ],"                                                                                          
[20] "    \"reclassify\": {},"                                                                         
spp_html[grep("Professor Lauge", spp_html)[1]]
[1] "<p><a href=\"https://profiles.ucl.ac.uk/44395-lauge-poulsen\" rel=\"nofollow\"><strong>Professor Lauge Poulsen</strong></a><br>Head of Department and Professor of International Relations and Law</p><p>Prof Poulsen works on the politics of international trade and investment, with a particular focus on international economic law.</p><p>&nbsp;</p>"

This is helpful, but it is awkward to navigate the source code directly.

Parse HTML

The read_html function in the rvest package allows us to read the HTML in a more structured format:

library(rvest)

spp <- read_html(spp_home)

spp
{html_document}
<html lang="en" dir="ltr" prefix="og: https://ogp.me/ns#">
[1] <head>\n<meta http-equiv="Content-Type" content="text/html; charset=UTF-8 ...
[2] <body class="colour-scheme--gordon-glow">\n        <a href="#main-content ...

Retrieve names for each member of faculty

We can then navigate through the HTML by searching for elements that have common elements (using html_elements()):

#spp_faculty_elements <- spp %>% html_elements("a[class='nav-item']") 

#head(spp_faculty_elements)

spp_faculty_elements <- spp %>% 
  html_elements("a[href^='https://profiles.ucl.ac.uk']")
head(spp_faculty_elements)
{xml_nodeset (6)}
[1] <a href="https://profiles.ucl.ac.uk/44395-lauge-poulsen" rel="nofollow">< ...
[2] <a href="https://profiles.ucl.ac.uk/9520-rod-abouharb"><strong>Dr Rodwan  ...
[3] <a href="https://profiles.ucl.ac.uk/86078-samer-anabtawi"><strong>Dr Same ...
[4] <a href="https://profiles.ucl.ac.uk/91233-phillip-ayoub"><strong>Professo ...
[5] <a href="https://profiles.ucl.ac.uk/1510-kristin-bakke"><strong>Professor ...
[6] <a href="https://profiles.ucl.ac.uk/101976-carlos-balcazar"><strong>Dr Ca ...

The names of each faculty member are stored in the text associated with these elements:

[1] "<a href=\"https://profiles.ucl.ac.uk/85613-dan-honig\"><strong>Dr Daniel Honig</strong></a>"

We can extract these names using the html_text() function:

spp_faculty_names <- spp_faculty_elements %>% html_text()
head(spp_faculty_names)
[1] "Professor Lauge Poulsen" "Dr Rodwan Abouharb"     
[3] "Dr Samer Anabtawi"       "Professor Phillip Ayoub"
[5] "Professor Kristin Bakke" "Dr Carlos Balcazar"

Retrieve URL for each member of faculty

The URL for each faculty member is stored in the href attribute of the elements:

# html_attr() retrieves the attributes associated with the elements that we extracted above
spp_urls <- spp_faculty_elements %>% html_attr("href") 

head(spp_urls)
[1] "https://profiles.ucl.ac.uk/44395-lauge-poulsen"   
[2] "https://profiles.ucl.ac.uk/9520-rod-abouharb"     
[3] "https://profiles.ucl.ac.uk/86078-samer-anabtawi"  
[4] "https://profiles.ucl.ac.uk/91233-phillip-ayoub"   
[5] "https://profiles.ucl.ac.uk/1510-kristin-bakke"    
[6] "https://profiles.ucl.ac.uk/101976-carlos-balcazar"
# paste0() joins strings together
#spp_urls <- paste0("https://www.ucl.ac.uk", spp_urls)

#head(spp_urls)

Storage

spp <- data.frame(name = spp_faculty_names, 
                  url = spp_urls, 
                  text = NA)

head(spp)
                     name                                               url
1 Professor Lauge Poulsen    https://profiles.ucl.ac.uk/44395-lauge-poulsen
2      Dr Rodwan Abouharb      https://profiles.ucl.ac.uk/9520-rod-abouharb
3       Dr Samer Anabtawi   https://profiles.ucl.ac.uk/86078-samer-anabtawi
4 Professor Phillip Ayoub    https://profiles.ucl.ac.uk/91233-phillip-ayoub
5 Professor Kristin Bakke     https://profiles.ucl.ac.uk/1510-kristin-bakke
6      Dr Carlos Balcazar https://profiles.ucl.ac.uk/101976-carlos-balcazar
  text
1   NA
2   NA
3   NA
4   NA
5   NA
6   NA

Retrieve unique page for each faculty member

jack_page <- read_html(spp$url[3]) 
jack_page
{html_document}
<html lang="en">
[1] <head>\n<meta http-equiv="Content-Type" content="text/html; charset=UTF-8 ...
[2] <body style="--logoHeight:70px;--logoVerticalMargins:7px;--homeBackground ...

Retrieve unique page for each faculty member

jack_text <- jack_page %>% 
  html_nodes(xpath='//h2[contains(text(), "Research")]/following-sibling::p[1]') %>%
  html_text()
print(jack_text)
character(0)

We have the text for one person! How do we get this for all faculty members?

for loops

  • A for loop is a control structure in programming that allows repeating a set of operations multiple times.
  • It works by iterating over a sequence of elements (such as a vector or a list) and executing a block of code for each element in the sequence.
  • In R, the syntax for a for loop is as follows:
for (variable in sequence) {
  # code to be executed for each element in the sequence
}
  • Example:
for (i in 1:10) {
  print(i)
}
[1] 1
[1] 2
[1] 3
[1] 4
[1] 5
[1] 6
[1] 7
[1] 8
[1] 9
[1] 10

for loops

We can use a for loop to loop over the elements of our url variable

for(i in 1:nrow(spp)){

  # Load page for faculty member i
  faculty_member_page <- read_html(spp$url[i]) 
  
  # Extract text from that page
  faculty_member_text <- faculty_member_page %>%
                            html_nodes(xpath='//h2[contains(text(), "Research")]/following-sibling::p[1]') %>%
                            html_text() %>%
                            paste0(collapse = " ")
  
  # Save text for faculty member i
  spp$text[i] <- faculty_member_text
  
}

Output

spp[24,]
               name
26 Dr Jack Blumenau
                                                                                                    url
26 https://www.ucl.ac.uk/political-science/people/academic-teaching-and-research-staff/dr-jack-blumenau
                                                                                                                                                                                                                                                                                                                                                                                                                                                 text
26 My research addresses questions about what voters want, how politicians act, and how these preferences and behaviours interact to affect electoral outcomes and political representation in democratic systems. In my research, I employ creative research designs in which I develop and apply state-of-the-art quantitative methods to answer important questions in the fields of legislative politics, electoral politics, and public opinion.
spp[76,]
                     name
91 Professor Lisa Vanhala
                                                                                                          url
91 https://www.ucl.ac.uk/political-science/people/academic-teaching-and-research-staff/professor-lisa-vanhala
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               text
91 I am interested in the politics of climate change and the socio-legal study of human rights and equality issues. My current, ERC-funded project, the Politics and Governance of Climate Change Loss and Damage (CCLAD), explores attempts to govern the impacts of climate change we will not be able to adapt to at a global and national level. Relying on a political ethnographic approach, the project explores the role of norms, identities and the micro-level, everyday dynamics of global environmental governance.   
spp[74,]
                       name
87 Professor Jeffrey Howard
                                                                                                            url
87 https://www.ucl.ac.uk/political-science/people/academic-teaching-and-research-staff/professor-jeffrey-howard
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        text
87 I currently direct the Digital Speech Lab, which hosts a range of research projects on the proper governance of online communications. Its purpose is to identify the fundamental principles that should guide the private and public regulation of online speech, and to trace those principles’ concrete implications in the face of difficult dilemmas about how best to respect free speech while preventing harm. The research team synthesizes expertise in political and moral philosophy, the philosophy of language, law and regulation, political science, and computer science. We engage a wide range of decisionmakers in industry, civil society, and policymaking. The Lab is funded by a UKRI Future Leaders Fellowship. 

Topic Model for Departmental Research Interests

  • Let’s use this data to estimate a topic model

  • Two questions in this application:

    • What are the topics that feature in the staff research profiles?
    • Which staff members are most highly associated with each topic?s

Topic Model for Departmental Research Interests

library(stm)

## Create dfm
spp_corpus <- spp %>% 
  corpus(text_field = "text")

spp_dfm <- spp_corpus %>%
  tokens(remove_punct = TRUE, 
         remove_symbols = TRUE, 
         remove_numbers = TRUE, 
         remove_url = TRUE) %>%
  dfm() %>%
  dfm_remove(c(stopwords("en"), "book", "journal", "professor",
               "including", "include")) %>%
  dfm_trim(min_termfreq = 5, min_docfreq = 2) %>%
  dfm_trim(max_docfreq = .7, docfreq_type = "prop") 

## Estimate STM
stmOut <- stm(
            documents = spp_dfm,
            K = 12,
            seed = 123,
            verbose = FALSE
            )
         
#save(stmOut, file = "stmOut.Rdata")

Topic Model for Departmental Research Interests

plot(stmOut,
     labeltype = "frex")

Topic Model for Departmental Research Interests

Conclusion

Summing Up

  1. Think about your research projects now!

    • Start by identifying a paper that you might review
    • Think about a substantive question you would like to answer
    • Look for data that would help you to answer the question

  2. There are several possible sources of data for these projects

    • Existing datasources
    • Data collected via an API
    • Data collected via web-scraping

  3. Data collection is a major part of any research project – it is good to practice this step!