#!pip install twarc
#!twarc2 configure38 Twitter Data Collection & Analysis
In this lesson, we’re going to learn how to analyze and explore Twitter data with the Python/command line tool twarc. We’re specifically going to work with twarc2, which is designed for version 2 of the Twitter API (released in 2020) and the Academic Research track of the Twitter API (released in 2021), which enables researchers to collect tweets from the entire Twitter archive for free.
Twarc was developed by a project called Documenting the Now. The DocNow team develops tools and ethical frameworks for social media research.
38.1 Dataset
[David Foster Wallace]…has become lit-bro shorthand…Make a passing reference to the “David Foster Wallace fanboy” and you can assume the reader knows whom you’re talking about.—Molly Fischer, “David Foster Wallace, Beloved Author of Bros”
Source: Giovanni Giovanetti, NYT
The Twitter conversation that we’re going to explore in this lesson is related to “Wallace bros” — fans of the author David Foster Wallace who are often described as “bros” or, more pointedly, “David Foster Wallace bros.”
For example, in Slate in 2015, Molly Fischer argued that David Foster Wallace’s writing — most famously his novel Infinite Jest — tended to attract a fan base of chauvinistic and misogynistic young men. But other people have defended Wallace’s fans and the author against such charges. What is a “David Foster Wallace bro”? Was DFW himself a “bro”? Who is using this phrase, how often are they using it, and why? We’re going to track this phrase and explore the varied viewpoints in this cultural conversation by analyzing tweets that mention “David Foster Wallace bro.”
38.2 Search Queries & Privacy Concerns
To collect tweets from the Twitter API, we need to make queries, or requests for specific kinds of tweets — e.g., twarc2 search *query*. The simplest kind of query is a keyword search, such as the phrase “David Foster Wallace bro,” which should return any tweet that contains all of these words in any order — twarc2 search "David Foster Wallace bro".
There are many other operators that we can add to a query, which would allow us to collect tweets only from specific Twitter users or locations, or to only collect tweets that meet certain conditions, such as containing an image or being authored by a verified Twitter user. Here’s an excerpted table of search operators taken from Twitter’s documentation about how to build a search query. There are many other operators beyond those included in this table, and I recommend reading through Twitter’s entire web page on this subject.
| Search Operator | Explanation |
|---|---|
| keyword | Matches a keyword within the body of a Tweet. so sweet and so cold |
| “exact phrase match” | Matches the exact phrase within the body of a Tweet. "so sweet and so cold" OR "plums in the icebox" |
| - | Do NOT match a keyword or operator baldwin -alec, walt whitman -bridge |
| # | Matches any Tweet containing a recognized hashtag #arthistory |
| from:, to: | Matches any Tweet from or to a specific user. from:KingJames to:KingJames |
| place: | Matches Tweets tagged with the specified location or Twitter place ID. place:"new york city" OR place:seattle |
| is:reply, is:quote | Returns only replies or quote tweets. DFW bro is:reply David Foster Wallace bro is:quote |
| is:verified | Returns only Tweets whose authors are verified by Twitter.DFW bro is:verified |
| has:media | Matches Tweets that contain a media object, such as a photo, GIF, or video, as determined by Twitter. I Think You Should Leave has:media |
| has:images, has:videos | Matches Tweets that contain a recognized URL to an image. i'm gonna tell my kinds that this was has:images |
| has:geo | Matches Tweets that have Tweet-specific geolocation data provided by the Twitter user. pyramids has:geo |
In this lesson, we will only be collecting tweets that were tweeted by verified users: "David Foster Wallace bro is:verified".
As I discussed in “Users’ Data: Legal & Ethical Considerations,” collecting publicly available tweets is legal, but it still raises a lot of privacy concerns and ethical quandaries — particularly when you re-publish user’s data, as I am in this lesson. To reduce potential harm to Twitter users when re-publishing or citing tweets, it can be helpful to ask for explicit permission from the authors or to focus on tweets that have already been reasonably exposed to the public (e.g., tweets with many retweets or tweets from verified users), such that re-publishing the content will not unduly increase risk to the user.
38.3 Install and Import Libraries
Because twarc relies on Twitter’s API, we need to apply for a Twitter developer account and create a Twitter application before we can use it. You can find instructions for the application process in “Twitter API Set Up.”
If you haven’t done so already, you need to install twarc and configure twarc with your bearer token and/or API keys.
To make an interactive plot, we’re also going to install the package plotly.
!pip install plotlyThen we’re going to import plotly as well as pandas
import plotly.express as px
import pandas as pd
pd.options.display.max_colwidth = 400
pd.options.display.max_columns = 9038.4 Get Tweet Counts
The first thing we’re going to do is retrieve “tweet counts” — that is, retrieve the number of tweets that included the phrase “David Foster Wallace bro” each day in Twitter’s history.
The tweet counts API endpoint is a convenient feature of the v2 API (first introduced in 2021) that allows us to get a sense of how many tweets will be returned for a given query before we actually collect all the tweets that match the query. We won’t get the text of the tweets or the users who tweeted the tweets or any other relevant data. We will simply get the number of tweets that match the query. This is helpful because we might be able to see that the search query “Wallace” matches too many tweets, which would encourage us to narrow our search by modifying the query.
The tweet counts API endpoint is perhaps even more useful for research projects that are primarily interested in tracking the volume of a Twitter conversation over time. In this case, tweet counts enable a researcher to retrieve this information in a way that’s faster and easier than retrieving all tweets and relevant metadata.
To get tweet counts from Twitter’s entire history with twarc2, we will use twarc2 counts followed by a search query.
We will also use the flag --csv because we want to output the data as a CSV, the flag --archive because we’re working with the Academic Research track of the Twitter API and want access to the full archive, and the flag --granularity day to get tweet counts per day (other options include hour and minute — you can see more in twarc’s documentation). Finally, we write the data to a CSV file.
!twarc2 counts "David Foster Wallace bro is:verified" --csv --archive --granularity day > twitter-data/tweet-counts.csvWe can read in this CSV file with pandas, parse the date columns, and sort from earliest to latest. The code below is largely borrowed from Ed Summers. Thanks, Ed!
Pandas
Do you need a refresher or introduction to the Python data analysis library Pandas? Be sure to check out Pandas Basics (1-3) in this textbook!
# Code borrowed from Ed Summers
# https://github.com/edsu/notebooks/blob/master/Black%20Lives%20Matter%20Counts.ipynb
# Read in CSV as DataFrame
tweet_counts_df = pd.read_csv('twitter-data/tweet-counts.csv', parse_dates=['start', 'end'])
# Sort values by earliest date
tweet_counts_df = tweet_counts_df.sort_values('start')
tweet_counts_df| start | end | day_count | |
|---|---|---|---|
| 5735 | 2006-03-21 00:00:00+00:00 | 2006-03-22 00:00:00+00:00 | 0 |
| 5736 | 2006-03-22 00:00:00+00:00 | 2006-03-23 00:00:00+00:00 | 0 |
| 5737 | 2006-03-23 00:00:00+00:00 | 2006-03-24 00:00:00+00:00 | 0 |
| 5738 | 2006-03-24 00:00:00+00:00 | 2006-03-25 00:00:00+00:00 | 0 |
| 5739 | 2006-03-25 00:00:00+00:00 | 2006-03-26 00:00:00+00:00 | 0 |
| ... | ... | ... | ... |
| 26 | 2021-12-19 00:00:00+00:00 | 2021-12-20 00:00:00+00:00 | 0 |
| 27 | 2021-12-20 00:00:00+00:00 | 2021-12-21 00:00:00+00:00 | 0 |
| 28 | 2021-12-21 00:00:00+00:00 | 2021-12-22 00:00:00+00:00 | 0 |
| 29 | 2021-12-22 00:00:00+00:00 | 2021-12-23 00:00:00+00:00 | 0 |
| 30 | 2021-12-23 00:00:00+00:00 | 2021-12-23 14:32:00+00:00 | 0 |
5757 rows × 3 columns
Then we can make a quick plot of tweets per day with plotly
# Code borrowed from Ed Summers
# https://github.com/edsu/notebooks/blob/master/Black%20Lives%20Matter%20Counts.ipynb
# Make a line plot from the DataFrame and specify x and y axes, axes titles, and plot title
figure = px.line(tweet_counts_df, x='start', y='day_count',
labels={'start': 'Time', 'day_count': 'Tweets per Day'},
title= 'DFW Bro Tweets'
)
figure.show()With a plotly line chart, we can hover over points to see more information, and we can use the tool bar in the upper right corner to zoom or pan on different parts of the graph. We can also press the camera button to download an image of the graph at any pan or zoom level.
To return to the original view, double-click on the plot.
38.5 Get Tweets (Standard Track)
To actually collect tweets and their associated metadata, we can use the command twarc2 search and insert a query.
Here we’re going to search for any tweets that mention the words “David Foster Wallace bro” and were tweeted by verified accounts in the past week. By default, twarc2 search will use the standard track of the Twitter API, which only collects tweets from the past week.
!twarc2 search "David Foster Wallace is:verified"{"data": [{"entities": {"annotations": [{"start": 40, "end": 59, "probability": 0.961, "type": "Person", "normalized_text": "David Foster Wallace"}]}, "source": "Twitter for iPhone", "conversation_id": "1473826748169175048", "text": "\u201cEvery love story is a ghost story.\u201c\u00a0\n- David Foster Wallace", "created_at": "2021-12-23T01:24:13.000Z", "lang": "en", "reply_settings": "everyone", "author_id": "90573676", "id": "1473826748169175048", "possibly_sensitive": false, "public_metrics": {"retweet_count": 13, "reply_count": 1, "like_count": 55, "quote_count": 2}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "67", "name": "Interests and Hobbies", "description": "Interests, opinions, and behaviors of individuals, groups, or cultures; like Speciality Cooking or Theme Parks"}, "entity": {"id": "1278071502840066048", "name": "Paranormal"}}]}, {"entities": {"annotations": [{"start": 32, "end": 51, "probability": 0.6432, "type": "Person", "normalized_text": "David Foster Wallace"}], "urls": [{"start": 137, "end": 160, "url": "https://t.co/uP4U30fkqv", "expanded_url": "https://www.backstage.com/magazine/article/voiceover-casting-68077/?utm_campaign=organic&utm_content=casting%2Clink%2Cstock-misc%2Ctalent%2Cvoiceover&utm_medium=social&utm_source=twitter", "display_url": "backstage.com/magazine/artic\u2026"}]}, "source": "Sprout Social", "conversation_id": "1473762018855370755", "text": "From a short film adaptation of David Foster Wallace Story to a feature film and everything in between, here\u2019s what\u2019s casting this week. https://t.co/uP4U30fkqv", "created_at": "2021-12-22T21:07:01.000Z", "lang": "en", "reply_settings": "everyone", "author_id": "19920585", "id": "1473762018855370755", "possibly_sensitive": false, "public_metrics": {"retweet_count": 0, "reply_count": 0, "like_count": 0, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}]}, {"source": "Twitter Web App", "conversation_id": "1473587774821437441", "entities": {"mentions": [{"start": 0, "end": 11, "username": "glennndiaz", "id": "917615998047367168"}]}, "text": "@glennndiaz Hahahaha di ko pa nga binabasa Wikipedia page niya. Before I read The Corrections, akala ko iisa lang sila ni David Foster Wallace hahahaha", "created_at": "2021-12-22T10:06:25.000Z", "lang": "tl", "in_reply_to_user_id": "917615998047367168", "reply_settings": "everyone", "author_id": "37662244", "id": "1473595773400981504", "possibly_sensitive": false, "referenced_tweets": [{"type": "replied_to", "id": "1473591381436162052"}], "public_metrics": {"retweet_count": 0, "reply_count": 0, "like_count": 0, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}]}, {"entities": {"annotations": [{"start": 16, "end": 35, "probability": 0.7984, "type": "Person", "normalized_text": "david foster wallace"}, {"start": 54, "end": 65, "probability": 0.9346, "type": "Person", "normalized_text": "david foster"}], "mentions": [{"start": 3, "end": 14, "username": "el_fodongo", "id": "966631615"}]}, "source": "Twitter for iPhone", "conversation_id": "1473360294898548738", "text": "RT @el_fodongo: david foster wallace's dog was called david foster gromit", "created_at": "2021-12-21T18:30:42.000Z", "lang": "en", "reply_settings": "everyone", "author_id": "86101978", "id": "1473360294898548738", "possibly_sensitive": false, "referenced_tweets": [{"type": "retweeted", "id": "1392179447051165696"}], "public_metrics": {"retweet_count": 192, "reply_count": 0, "like_count": 0, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}]}, {"entities": {"annotations": [{"start": 16, "end": 35, "probability": 0.7984, "type": "Person", "normalized_text": "david foster wallace"}, {"start": 54, "end": 65, "probability": 0.9346, "type": "Person", "normalized_text": "david foster"}], "mentions": [{"start": 3, "end": 14, "username": "el_fodongo", "id": "966631615"}]}, "source": "Twitter Web App", "conversation_id": "1473359224453623808", "text": "RT @el_fodongo: david foster wallace's dog was called david foster gromit", "created_at": "2021-12-21T18:26:27.000Z", "lang": "en", "reply_settings": "everyone", "author_id": "76718852", "id": "1473359224453623808", "possibly_sensitive": false, "referenced_tweets": [{"type": "retweeted", "id": "1392179447051165696"}], "public_metrics": {"retweet_count": 192, "reply_count": 0, "like_count": 0, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}]}, {"entities": {"annotations": [{"start": 84, "end": 103, "probability": 0.9894, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 109, "end": 124, "probability": 0.8558, "type": "Person", "normalized_text": "\u00d3scar Villasante"}], "mentions": [{"start": 3, "end": 19, "username": "Notodofilmfest_", "id": "161988497"}, {"start": 49, "end": 63, "username": "camaraabierta", "id": "52823380"}]}, "source": "Twitter for iPhone", "conversation_id": "1473292247873593345", "text": "RT @Notodofilmfest_: \u2728Premio al Mejor Documental\u2728@camaraabierta\n\"Peque\u00f1o Homenaje a David Foster Wallace\" de \u00d3scar Villasante\nhttps://t.co/\u2026", "created_at": "2021-12-21T14:00:18.000Z", "lang": "es", "reply_settings": "everyone", "author_id": "52823380", "id": "1473292247873593345", "possibly_sensitive": false, "referenced_tweets": [{"type": "retweeted", "id": "1473269378565160974"}], "public_metrics": {"retweet_count": 1, "reply_count": 0, "like_count": 0, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}]}, {"source": "Twitter for iPhone", "conversation_id": "1472984031864279045", "entities": {"mentions": [{"start": 0, "end": 14, "username": "TomA3aenssens", "id": "1189576208"}, {"start": 15, "end": 30, "username": "WimOosterlinck", "id": "53060760"}]}, "text": "@TomA3aenssens @WimOosterlinck De auteur die de doorslag zou geven, is David Foster Wallace, maar die staat bij de fictie.", "created_at": "2021-12-20T17:54:22.000Z", "lang": "nl", "in_reply_to_user_id": "1189576208", "reply_settings": "everyone", "author_id": "292945752", "id": "1472988761785049090", "possibly_sensitive": false, "referenced_tweets": [{"type": "replied_to", "id": "1472987840288116740"}], "public_metrics": {"retweet_count": 0, "reply_count": 0, "like_count": 3, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}]}, {"entities": {"annotations": [{"start": 46, "end": 57, "probability": 0.7361, "type": "Person", "normalized_text": "Bill Shankly"}, {"start": 60, "end": 79, "probability": 0.9075, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 82, "end": 97, "probability": 0.9925, "type": "Person", "normalized_text": "Marina Tsvetaeva"}, {"start": 100, "end": 105, "probability": 0.9963, "type": "Person", "normalized_text": "Eminem"}, {"start": 112, "end": 125, "probability": 0.9834, "type": "Person", "normalized_text": "Kenny Dalglish"}], "urls": [{"start": 169, "end": 192, "url": "https://t.co/rirr55pD5O", "expanded_url": "https://www.amazon.co.uk/gp/aw/d/1781724253/", "display_url": "amazon.co.uk/gp/aw/d/178172\u2026"}]}, "source": "Twitter for iPhone", "conversation_id": "1472930896223383559", "text": "Find me another book that assembles a cast of Bill Shankly, David Foster Wallace, Marina Tsvetaeva, Eminem, and Kenny Dalglish. A unique stocking filler, or so I hear.\n\nhttps://t.co/rirr55pD5O", "created_at": "2021-12-20T14:04:26.000Z", "lang": "en", "reply_settings": "everyone", "author_id": "2435437579", "id": "1472930896223383559", "possibly_sensitive": false, "public_metrics": {"retweet_count": 1, "reply_count": 0, "like_count": 1, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1095842197574844416", "name": "Kenny Dalglish"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "92", "name": "Sports Personality", "description": "A Sports Personality like 'Skip Bayless'"}, "entity": {"id": "1095842197574844416", "name": "Kenny Dalglish"}}, {"domain": {"id": "92", "name": "Sports Personality", "description": "A Sports Personality like 'Skip Bayless'"}, "entity": {"id": "1202239681422774272", "name": "Sports icons"}}, {"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "808389766676811780", "name": "Eminem", "description": "Eminem"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "808389766676811780", "name": "Eminem", "description": "Eminem"}}, {"domain": {"id": "55", "name": "Music Genre", "description": "A category for a musical style, like Pop, Rock, or Rap"}, "entity": {"id": "810937888334487552", "name": "Rap", "description": "Hip-Hop/Rap"}}]}, {"source": "Twitter for Android", "conversation_id": "1472600656787742725", "entities": {"mentions": [{"start": 0, "end": 13, "username": "george_salis", "id": "1357934563838812161"}, {"start": 14, "end": 30, "username": "TheLastSisyphus", "id": "340072715"}], "urls": [{"start": 52, "end": 75, "url": "https://t.co/nLbntaS24J", "expanded_url": "https://sites.utexas.edu/ransomcentermagazine/2016/01/29/david-foster-wallace-and-20-years-of-infinite-jest/", "display_url": "sites.utexas.edu/ransomcenterma\u2026"}]}, "text": "@george_salis @TheLastSisyphus Also something here. https://t.co/nLbntaS24J", "created_at": "2021-12-19T17:58:24.000Z", "lang": "en", "in_reply_to_user_id": "1357934563838812161", "reply_settings": "everyone", "author_id": "17853057", "id": "1472627388911538176", "possibly_sensitive": false, "referenced_tweets": [{"type": "replied_to", "id": "1472604673962037250"}], "public_metrics": {"retweet_count": 0, "reply_count": 2, "like_count": 1, "quote_count": 0}}, {"entities": {"annotations": [{"start": 33, "end": 52, "probability": 0.9895, "type": "Person", "normalized_text": "David Foster Wallace"}], "urls": [{"start": 90, "end": 113, "url": "https://t.co/poOtnWcmsc", "expanded_url": "https://twitter.com/velazquera/status/1471895454103314433", "display_url": "twitter.com/velazquera/sta\u2026"}]}, "source": "Twitter for iPhone", "conversation_id": "1471945897038729217", "text": "Estoy tan feliz: mi ensayo sobre David Foster Wallace est\u00e1 incluido en esta publicaci\u00f3n \ud83e\udd70 https://t.co/poOtnWcmsc", "created_at": "2021-12-17T20:50:23.000Z", "lang": "es", "reply_settings": "everyone", "author_id": "45840741", "id": "1471945897038729217", "possibly_sensitive": false, "referenced_tweets": [{"type": "quoted", "id": "1471895454103314433"}], "public_metrics": {"retweet_count": 1, "reply_count": 2, "like_count": 18, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "65", "name": "Interests and Hobbies Vertical", "description": "Top level interests and hobbies groupings, like Food or Travel"}, "entity": {"id": "1280550787207147521", "name": "Arts & culture"}}]}, {"entities": {"annotations": [{"start": 34, "end": 48, "probability": 0.7699, "type": "Organization", "normalized_text": "Emerson College"}, {"start": 51, "end": 70, "probability": 0.8445, "type": "Person", "normalized_text": "David Foster Wallace"}], "mentions": [{"start": 0, "end": 13, "username": "slentine2010", "id": "1681097215"}], "urls": [{"start": 88, "end": 111, "url": "https://t.co/LYHGQfxvgC", "expanded_url": "https://www.esquire.com/entertainment/movies/a15334056/paul-thomas-anderson-david-foster-wallace-reddit/", "display_url": "esquire.com/entertainment/\u2026"}]}, "source": "Twitter Web App", "conversation_id": "1471842268072095754", "text": "@slentine2010 And when he went to Emerson College, David Foster Wallace was his teacher https://t.co/LYHGQfxvgC", "created_at": "2021-12-17T18:06:28.000Z", "lang": "en", "in_reply_to_user_id": "1681097215", "reply_settings": "everyone", "author_id": "29092660", "id": "1471904645836591104", "possibly_sensitive": false, "referenced_tweets": [{"type": "replied_to", "id": "1471842268072095754"}], "public_metrics": {"retweet_count": 0, "reply_count": 1, "like_count": 1, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}]}, {"entities": {"annotations": [{"start": 56, "end": 71, "probability": 0.9829, "type": "Person", "normalized_text": "Jeffrey Lawrence"}, {"start": 76, "end": 82, "probability": 0.3995, "type": "Organization", "normalized_text": "US Open"}, {"start": 85, "end": 104, "probability": 0.9748, "type": "Person", "normalized_text": "David Foster Wallace"}], "mentions": [{"start": 29, "end": 44, "username": "Ariz_Quarterly", "id": "789573528458670080"}], "urls": [{"start": 146, "end": 169, "url": "https://t.co/iham6vILfC", "expanded_url": "https://bit.ly/3q8k8ly", "display_url": "bit.ly/3q8k8ly", "images": [{"url": "https://pbs.twimg.com/news_img/1471231338040680452/xtA_HeTF?format=jpg&name=orig", "width": 600, "height": 910}, {"url": "https://pbs.twimg.com/news_img/1471231338040680452/xtA_HeTF?format=jpg&name=150x150", "width": 150, "height": 150}], "status": 200, "title": "Article", "description": "In lieu of an abstract, here is a brief excerpt of the content: Postmodernist discourses are often exclusionary even when, having been accused of lacking concrete relevance, they call attention to and appropriate the experience of \u201cdifference\u201d and \u201cotherness\u201d in order to provide themselves with oppositional political meaning, legitimacy, and immediacy. Very few African-American intellectuals have talked or written about postmodernism. Recently at a dinner party, I talked about trying to grapple with the", "unwound_url": "https://muse.jhu.edu/article/27283?utm_source=twitter&utm_medium=social&utm_campaign=arq121721&utm_content=JHUP"}, {"start": 170, "end": 193, "url": "https://t.co/SrLkMELsYj", "expanded_url": "https://twitter.com/JHUPress/status/1471857768462176268/photo/1", "display_url": "pic.twitter.com/SrLkMELsYj"}]}, "source": "Hootsuite Inc.", "conversation_id": "1471857768462176268", "attachments": {"media_keys": ["3_1471857766570549250"]}, "text": "OUT NOW: The latest issue of @Ariz_Quarterly, including Jeffrey Lawrence's \"US Open? David Foster Wallace, Tennis and the Crisis of Meritocracy\": https://t.co/iham6vILfC https://t.co/SrLkMELsYj", "created_at": "2021-12-17T15:00:12.000Z", "lang": "en", "reply_settings": "everyone", "author_id": "29731124", "id": "1471857768462176268", "possibly_sensitive": false, "public_metrics": {"retweet_count": 0, "reply_count": 0, "like_count": 0, "quote_count": 0}, "context_annotations": [{"domain": {"id": "3", "name": "TV Shows", "description": "Television shows from around the world"}, "entity": {"id": "10044747023", "name": "US Open"}}, {"domain": {"id": "6", "name": "Sports Event"}, "entity": {"id": "1398019721518219264", "name": "U.S. Open Tennis"}}, {"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}]}, {"source": "Twitter for iPhone", "conversation_id": "1471808169630392327", "text": "\u201cLa verit\u00e0 ti render\u00e0 libero. Ma solo quando avr\u00e0 finito con te\u201d\n\nDavid Foster Wallace, Infinite Jest", "created_at": "2021-12-17T11:43:07.000Z", "lang": "it", "reply_settings": "everyone", "author_id": "1311755732782657536", "id": "1471808169630392327", "possibly_sensitive": false, "public_metrics": {"retweet_count": 5, "reply_count": 0, "like_count": 37, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}]}], "includes": {"users": [{"location": "New York City", "profile_image_url": "https://pbs.twimg.com/profile_images/797105077219639296/sIN2ZMVs_normal.jpg", "created_at": "2009-11-17T06:00:39.000Z", "pinned_tweet_id": "1239894564149891072", "verified": true, "username": "jerrysaltz", "name": "Jerry Saltz", "protected": false, "description": "Jerry Saltz: Senior Art Critic; New York Magazine. 2018 Pulitzer Prize in Criticism. Author of NYT Best Seller \u201cHow To Be an Artist.\u201d 2-time ASME award winner.", "id": "90573676", "url": "", "public_metrics": {"followers_count": 533796, "following_count": 3991, "tweet_count": 61093, "listed_count": 2343}}, {"profile_image_url": "https://pbs.twimg.com/profile_images/1230605399491043331/u_OcQ5bL_normal.png", "created_at": "2009-02-02T18:20:38.000Z", "pinned_tweet_id": "1461016382120808463", "verified": true, "username": "Backstage", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/VBU3lmc1t6", "expanded_url": "http://www.backstage.com", "display_url": "backstage.com"}]}, "description": {"hashtags": [{"start": 71, "end": 80, "tag": "IGotCast"}]}}, "name": "Backstage", "protected": false, "description": "The most trusted name in casting since 1960. Tweet us with the hashtag #IGotCast and let us know if you've been cast through Backstage!", "id": "19920585", "url": "https://t.co/VBU3lmc1t6", "public_metrics": {"followers_count": 137997, "following_count": 2780, "tweet_count": 76552, "listed_count": 1755}}, {"location": "Philippines", "profile_image_url": "https://pbs.twimg.com/profile_images/1466664667154370565/F8gd8lHJ_normal.jpg", "created_at": "2009-05-04T13:45:10.000Z", "pinned_tweet_id": "1458400249605541893", "verified": true, "username": "jodeszgavilan", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/TOWtr0cvoo", "expanded_url": "https://rappler.com/author/jodesz-gavilan", "display_url": "rappler.com/author/jodesz-\u2026"}]}, "description": {"hashtags": [{"start": 133, "end": 149, "tag": "StopTheKillings"}], "mentions": [{"start": 52, "end": 66, "username": "rapplerdotcom"}, {"start": 67, "end": 79, "username": "newsbreakph"}]}}, "name": "Jodesz Gavilan", "protected": false, "description": "Journalist covering human rights, impunity, etc for @rapplerdotcom @newsbreakph. Host, Newsbreak: Beyond the Stories. Books + OSINT. #StopTheKillings \ud83c\uddf5\ud83c\udded", "id": "37662244", "url": "https://t.co/TOWtr0cvoo", "public_metrics": {"followers_count": 2711, "following_count": 772, "tweet_count": 100313, "listed_count": 66}}, {"location": "Adelaide / Manila", "profile_image_url": "https://pbs.twimg.com/profile_images/1383967272000049156/5oRmdeoJ_normal.jpg", "created_at": "2017-10-10T05:01:17.000Z", "pinned_tweet_id": "1279417624296779776", "verified": false, "username": "glennndiaz", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/EADMN6S6RM", "expanded_url": "http://glenndiaz.ph", "display_url": "glenndiaz.ph"}]}, "description": {"mentions": [{"start": 5, "end": 17, "username": "ateneopress"}, {"start": 28, "end": 42, "username": "UniofAdelaide"}]}}, "name": "Glenn Diaz", "protected": false, "description": "TQO (@ateneopress) PhD cand @UniofAdelaide Anti-imperialist \u262d", "id": "917615998047367168", "url": "https://t.co/EADMN6S6RM", "public_metrics": {"followers_count": 3400, "following_count": 708, "tweet_count": 25599, "listed_count": 10}}, {"location": "mollie.goodfellow@gmail.com", "profile_image_url": "https://pbs.twimg.com/profile_images/1466014663808856065/CgekXjsd_normal.jpg", "created_at": "2009-10-29T16:13:14.000Z", "verified": true, "username": "hansmollman", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/qFKl4ydBYd", "expanded_url": "http://molliegoodfellow.co.uk", "display_url": "molliegoodfellow.co.uk"}]}}, "name": "Mollie Goodfellow", "protected": false, "description": "a writer for many things. cute and precariously employed. it\u2019s probably a joke. she/her.", "id": "86101978", "url": "https://t.co/qFKl4ydBYd", "public_metrics": {"followers_count": 80169, "following_count": 2992, "tweet_count": 85704, "listed_count": 379}}, {"location": "The arboreal dell. (he/him) ", "profile_image_url": "https://pbs.twimg.com/profile_images/1445524623253139462/h_BdjALu_normal.jpg", "created_at": "2012-11-23T18:41:40.000Z", "pinned_tweet_id": "1469967027158802435", "verified": false, "username": "el_fodongo", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/gAIIBvAWyR", "expanded_url": "https://ko-fi.com/timmacgabhann", "display_url": "ko-fi.com/timmacgabhann"}]}, "description": {"mentions": [{"start": 84, "end": 92, "username": "wnbooks"}]}}, "name": "tim, the chancellor of christmas and germany also", "protected": false, "description": "slime man, mulch lord and full-time mayor / wrote CALL HIM MINE & HOW TO BE NOWHERE @wnbooks / i have a v over-zealous block bot, sorry in advance", "id": "966631615", "url": "https://t.co/gAIIBvAWyR", "public_metrics": {"followers_count": 3951, "following_count": 1449, "tweet_count": 22659, "listed_count": 0}}, {"location": "Cardiff/London", "profile_image_url": "https://pbs.twimg.com/profile_images/750985536043638784/YDfIaPP3_normal.jpg", "created_at": "2009-09-23T18:38:17.000Z", "pinned_tweet_id": "1355115824076500992", "verified": true, "username": "tristandross", "entities": {"description": {"mentions": [{"start": 29, "end": 36, "username": "online"}]}}, "name": "Stan Account", "protected": false, "description": "having a laugh correspondent @online", "id": "76718852", "url": "", "public_metrics": {"followers_count": 25204, "following_count": 1067, "tweet_count": 74514, "listed_count": 100}}, {"location": "TVE", "profile_image_url": "https://pbs.twimg.com/profile_images/1342186399211130884/knZ4MAVh_normal.jpg", "created_at": "2009-07-01T19:26:59.000Z", "verified": true, "username": "camaraabierta", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/9FbNCB4LV4", "expanded_url": "http://www.rtve.es/camaraabierta", "display_url": "rtve.es/camaraabierta"}]}, "description": {"hashtags": [{"start": 143, "end": 156, "tag": "Canal24Horas"}], "mentions": [{"start": 12, "end": 17, "username": "rtve"}, {"start": 81, "end": 92, "username": "danisesena"}]}}, "name": "C\u00e1mara abierta", "protected": false, "description": "Programa de @rtve sobre internet como plataforma de creaci\u00f3n. Dirige y presenta: @danisesena. Emisi\u00f3n: S\u00e1bados 08:30h 16:45h y martes 00:45 en #Canal24Horas", "id": "52823380", "url": "https://t.co/9FbNCB4LV4", "public_metrics": {"followers_count": 20363, "following_count": 1112, "tweet_count": 4238, "listed_count": 538}}, {"location": "La red", "profile_image_url": "https://pbs.twimg.com/profile_images/1341417142487576579/tdwXlqkF_normal.jpg", "created_at": "2010-07-02T09:05:50.000Z", "pinned_tweet_id": "1473262330859429894", "verified": false, "username": "Notodofilmfest_", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/rVtgyqbvOl", "expanded_url": "https://linktr.ee/notodofilmfest", "display_url": "linktr.ee/notodofilmfest"}]}, "description": {"mentions": [{"start": 11, "end": 22, "username": "la_fabrica"}, {"start": 25, "end": 38, "username": "fesserjavier"}]}}, "name": "Notodofilmfest", "protected": false, "description": "Creado por @la_fabrica y @fesserjavier Notodofilmfest21 \ud83d\ude80 20/12 Gala de entrega de premios", "id": "161988497", "url": "https://t.co/rVtgyqbvOl", "public_metrics": {"followers_count": 10313, "following_count": 558, "tweet_count": 9429, "listed_count": 299}}, {"profile_image_url": "https://pbs.twimg.com/profile_images/1349413607403098117/Y_PkYFLR_normal.jpg", "created_at": "2011-05-04T14:10:06.000Z", "verified": true, "username": "jdceulaer", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/EjGthWzarD", "expanded_url": "http://www.demorgen.be", "display_url": "demorgen.be"}]}, "description": {"mentions": [{"start": 45, "end": 53, "username": "mboudry"}]}}, "name": "Jo\u00ebl De Ceulaer", "protected": false, "description": "Journalist / \u2018Eerste hulp bij pandemie' (met @mboudry, 2021) / \u2018De tragiek van de macht\u2019 (2020) / 'Hoera! De democratie is niet perfect' (2019)", "id": "292945752", "url": "https://t.co/EjGthWzarD", "public_metrics": {"followers_count": 56565, "following_count": 2129, "tweet_count": 72788, "listed_count": 444}}, {"location": "Antwerpen, Belgi\u00eb", "profile_image_url": "https://pbs.twimg.com/profile_images/1452300902350655488/4iukPsHy_normal.jpg", "created_at": "2013-02-17T13:46:33.000Z", "pinned_tweet_id": "1294333815255638021", "verified": false, "username": "TomA3aenssens", "entities": {"description": {"hashtags": [{"start": 67, "end": 82, "tag": "Triggerwarning"}]}}, "name": "Kerstronk Adriaenssens \ud83d\udc45\ud83e\udd1f\ud83c\udfff", "protected": false, "description": "\u2018vuilblond en proper rechts\u2019 Antwerpen, Antwaarps \u00e9n Antwerp ! \ud83d\udd34\u26aa\ufe0f #Triggerwarning !", "id": "1189576208", "url": "", "public_metrics": {"followers_count": 3160, "following_count": 1881, "tweet_count": 55698, "listed_count": 8}}, {"profile_image_url": "https://pbs.twimg.com/profile_images/1280751248006885377/v9YWpADl_normal.jpg", "created_at": "2009-07-02T13:24:22.000Z", "pinned_tweet_id": "1442908778890883072", "verified": false, "username": "WimOosterlinck", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/dvvz9avo2m", "expanded_url": "http://wimoosterlinck.be", "display_url": "wimoosterlinck.be"}]}, "description": {"hashtags": [{"start": 44, "end": 64, "tag": "ikwildegeenkinderen"}, {"start": 65, "end": 76, "tag": "drieboeken"}]}}, "name": "Wim Oosterlinck \ud83c\udf99", "protected": false, "description": "radio - podcast - film - boeken - wijs volk #ikwildegeenkinderen #drieboeken", "id": "53060760", "url": "https://t.co/dvvz9avo2m", "public_metrics": {"followers_count": 57957, "following_count": 381, "tweet_count": 16487, "listed_count": 176}}, {"location": "Sheffield, UK", "profile_image_url": "https://pbs.twimg.com/profile_images/1463200677577084931/A9XtZIPd_normal.jpg", "created_at": "2014-04-09T13:09:24.000Z", "pinned_tweet_id": "1465959871011074050", "verified": true, "username": "BenWilko85", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/UMQgu99gKl", "expanded_url": "http://theguardian.com/profile/ben-wilkinson", "display_url": "theguardian.com/profile/ben-wi\u2026"}]}, "description": {"mentions": [{"start": 83, "end": 94, "username": "SerenBooks"}, {"start": 128, "end": 140, "username": "LivUniPress"}]}}, "name": "Ben Wilkinson", "protected": false, "description": "Writer, poet, foolhardy critic. Poems: Way More Than Luck (2018), Same Difference (@SerenBooks, 2022). Criticism: Don Paterson (@LivUniPress, 2021).", "id": "2435437579", "url": "https://t.co/UMQgu99gKl", "public_metrics": {"followers_count": 2153, "following_count": 1320, "tweet_count": 5450, "listed_count": 20}}, {"location": "Sydney", "profile_image_url": "https://pbs.twimg.com/profile_images/1421821650366918656/S9sIijlN_normal.jpg", "created_at": "2008-12-03T23:35:17.000Z", "pinned_tweet_id": "1466212849865224192", "verified": true, "username": "mclayfield", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/FjTEjwA8h6", "expanded_url": "http://www.matthewclayfield.com/", "display_url": "matthewclayfield.com"}]}}, "name": "Matthew Clayfield", "protected": false, "description": "Lapsed journalist. Occasional critic and screenwriter. Would like to be a full-time novelist.", "id": "17853057", "url": "https://t.co/FjTEjwA8h6", "public_metrics": {"followers_count": 4386, "following_count": 1963, "tweet_count": 14416, "listed_count": 170}}, {"profile_image_url": "https://pbs.twimg.com/profile_images/1357934982866558979/LnmUTf3C_normal.jpg", "created_at": "2021-02-06T06:10:16.000Z", "pinned_tweet_id": "1467198887656054786", "verified": false, "username": "george_salis", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/SDAGWoFwZR", "expanded_url": "https://linktr.ee/georgesalis", "display_url": "linktr.ee/georgesalis"}]}}, "name": "George Salis", "protected": false, "description": "I'm the author of Sea Above, Sun Below. I'm currently working on a maximalist novel titled Morphological Echoes. I run The Collidescope.", "id": "1357934563838812161", "url": "https://t.co/SDAGWoFwZR", "public_metrics": {"followers_count": 473, "following_count": 106, "tweet_count": 1294, "listed_count": 4}}, {"location": "Dept. of Unspecified Services", "profile_image_url": "https://pbs.twimg.com/profile_images/1472014753103028225/33Rr7X2S_normal.jpg", "created_at": "2011-07-22T03:01:12.000Z", "pinned_tweet_id": "1460666619349409800", "verified": false, "username": "TheLastSisyphus", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/oGjVFmtx4k", "expanded_url": "https://linktr.ee/TheLastSisyphusPodcast", "display_url": "linktr.ee/TheLastSisyphu\u2026"}]}}, "name": "C.G.", "protected": false, "description": "Author of PROJECT: SLEEPLESS DREAM | Writer | Teacher | Armchair Philosopher | UFO Crackpot | Hockey coach, player, and fan", "id": "340072715", "url": "https://t.co/oGjVFmtx4k", "public_metrics": {"followers_count": 1542, "following_count": 292, "tweet_count": 5296, "listed_count": 23}}, {"profile_image_url": "https://pbs.twimg.com/profile_images/1472285559989194764/S-ErLzy0_normal.jpg", "created_at": "2009-06-09T13:54:11.000Z", "pinned_tweet_id": "680849321445597185", "verified": true, "username": "Aglaia_Berlutti", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/CnXF4UtMRb", "expanded_url": "http://www.aglaiaberlutti.com", "display_url": "aglaiaberlutti.com"}]}}, "name": "Aglaia Berlutti", "protected": false, "description": "Bruja y hereje. A veces grosera y quiz\u00e1 demente. Fot\u00f3grafa por pasi\u00f3n, amante de las palabras por convicci\u00f3n. Firme creyente en el poder del pensamiento libre.", "id": "45840741", "url": "https://t.co/CnXF4UtMRb", "public_metrics": {"followers_count": 28510, "following_count": 7146, "tweet_count": 364749, "listed_count": 333}}, {"location": "Caracas", "profile_image_url": "https://pbs.twimg.com/profile_images/1472157338656288772/aJgA76-t_normal.jpg", "created_at": "2016-11-08T14:59:11.000Z", "pinned_tweet_id": "1076067402289434624", "verified": false, "username": "velazquera", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/cGCgRnNTtp", "expanded_url": "https://anamariavelazquezanderson.blogspot.com/", "display_url": "anamariavelazquezanderson.blogspot.com"}]}}, "name": "Ana Mar\u00eda Vel\u00e1zquez Anderson", "protected": false, "description": "Profa de Literatura Universidad Metropolitana.\nGender studies\nEscritora.", "id": "796004142007324672", "url": "https://t.co/cGCgRnNTtp", "public_metrics": {"followers_count": 569, "following_count": 746, "tweet_count": 2528, "listed_count": 4}}, {"location": "Boston, Massachusetts", "profile_image_url": "https://pbs.twimg.com/profile_images/1467838713690525706/8PrRis4h_normal.jpg", "created_at": "2009-04-05T23:26:03.000Z", "pinned_tweet_id": "1470414586776072194", "verified": true, "username": "JahHills", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/m6CCXce0pr", "expanded_url": "https://linktr.ee/ryanhwalsh", "display_url": "linktr.ee/ryanhwalsh"}]}, "description": {"mentions": [{"start": 72, "end": 85, "username": "penguinpress"}]}}, "name": "Ryan H. Walsh", "protected": false, "description": "Writer/Musician \u2738 Hallelujah The Hills (the band) \u2738 Astral Weeks (2018 @penguinpress) \u2738 I'll tell you the whole story as soon as we sit down.", "id": "29092660", "url": "https://t.co/m6CCXce0pr", "public_metrics": {"followers_count": 5772, "following_count": 2554, "tweet_count": 62921, "listed_count": 135}}, {"profile_image_url": "https://pbs.twimg.com/profile_images/378800000318879657/b61db9b1fc6981d676a363d6cf0b2318_normal.jpeg", "created_at": "2013-08-18T16:10:36.000Z", "verified": false, "username": "slentine2010", "name": "Scott Lentine", "protected": false, "description": "Autism self-advocate. Poet. I love dogs, traveling, advocating for autism, playing the piano, making new friends, and the beach.", "id": "1681097215", "url": "", "public_metrics": {"followers_count": 510, "following_count": 4081, "tweet_count": 7250, "listed_count": 3}}, {"location": "Baltimore, MD", "profile_image_url": "https://pbs.twimg.com/profile_images/666258588776591360/CbjPccui_normal.jpg", "created_at": "2009-04-08T14:50:18.000Z", "verified": true, "username": "JHUPress", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/HmAC3AEXHK", "expanded_url": "http://www.press.jhu.edu/", "display_url": "press.jhu.edu"}]}, "description": {"mentions": [{"start": 135, "end": 147, "username": "ProjectMUSE"}]}}, "name": "Johns Hopkins University Press", "protected": false, "description": "Publishing cutting edge books and journals since 1878. We envision a future where knowledge enriches the life of every person. Home to @ProjectMUSE.", "id": "29731124", "url": "https://t.co/HmAC3AEXHK", "public_metrics": {"followers_count": 21464, "following_count": 1679, "tweet_count": 19287, "listed_count": 657}}, {"location": "Tucson, AZ", "profile_image_url": "https://pbs.twimg.com/profile_images/969262678043631616/pSwjVKeh_normal.jpg", "created_at": "2016-10-21T21:06:13.000Z", "verified": false, "username": "Ariz_Quarterly", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/o4sshEKfRT", "expanded_url": "https://azq.arizona.edu", "display_url": "azq.arizona.edu"}]}}, "name": "Arizona Quarterly", "protected": false, "description": "Publishing cultural, formal, & theoretical interventions in current academic conversations around American lit, broadly defined.", "id": "789573528458670080", "url": "https://t.co/o4sshEKfRT", "public_metrics": {"followers_count": 357, "following_count": 1080, "tweet_count": 519, "listed_count": 5}}, {"location": "Roma", "profile_image_url": "https://pbs.twimg.com/profile_images/1338569526871543811/metxtMMn_normal.jpg", "created_at": "2020-10-01T19:52:03.000Z", "pinned_tweet_id": "1412324780783636486", "verified": true, "username": "AndreaVenanzoni", "entities": {"url": {"urls": [{"start": 0, "end": 23, "url": "https://t.co/Ack6c8IoCd", "expanded_url": "http://www.forumnazionaleprofessioni.it", "display_url": "forumnazionaleprofessioni.it"}]}, "description": {"mentions": [{"start": 49, "end": 64, "username": "LDO_Fondazione"}, {"start": 67, "end": 80, "username": "atlanticomag"}, {"start": 82, "end": 94, "username": "ilfoglio_it"}, {"start": 96, "end": 100, "username": "tpi"}]}}, "name": "Andrea Venanzoni", "protected": false, "description": "Paleolibertarian, Centro Studi PRAXIS, scrivo su @LDO_Fondazione , @atlanticomag, @ilfoglio_it, @tpi", "id": "1311755732782657536", "url": "https://t.co/Ack6c8IoCd", "public_metrics": {"followers_count": 5200, "following_count": 1958, "tweet_count": 10805, "listed_count": 22}}], "tweets": [{"entities": {"annotations": [{"start": 37, "end": 43, "probability": 0.8885, "type": "Person", "normalized_text": "Franzen"}], "mentions": [{"start": 0, "end": 14, "username": "jodeszgavilan", "id": "37662244"}]}, "source": "Twitter for iPhone", "conversation_id": "1473587774821437441", "text": "@jodeszgavilan Congrats on coming to Franzen w/o the burden of his other shenanigans hahah.", "created_at": "2021-12-22T09:48:57.000Z", "lang": "en", "in_reply_to_user_id": "37662244", "reply_settings": "everyone", "author_id": "917615998047367168", "id": "1473591381436162052", "possibly_sensitive": false, "referenced_tweets": [{"type": "replied_to", "id": "1473590214342094848"}], "public_metrics": {"retweet_count": 0, "reply_count": 1, "like_count": 0, "quote_count": 0}}, {"entities": {"annotations": [{"start": 0, "end": 19, "probability": 0.8219, "type": "Person", "normalized_text": "david foster wallace"}, {"start": 38, "end": 49, "probability": 0.9263, "type": "Person", "normalized_text": "david foster"}]}, "source": "Twitter Web App", "conversation_id": "1392179447051165696", "text": "david foster wallace's dog was called david foster gromit", "created_at": "2021-05-11T18:07:00.000Z", "lang": "en", "reply_settings": "everyone", "author_id": "966631615", "id": "1392179447051165696", "possibly_sensitive": false, "public_metrics": {"retweet_count": 192, "reply_count": 9, "like_count": 1333, "quote_count": 2}}, {"entities": {"annotations": [{"start": 63, "end": 82, "probability": 0.9907, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 88, "end": 103, "probability": 0.8899, "type": "Person", "normalized_text": "\u00d3scar Villasante"}], "mentions": [{"start": 28, "end": 42, "username": "camaraabierta", "id": "52823380"}], "urls": [{"start": 105, "end": 128, "url": "https://t.co/758gXJJsrc", "expanded_url": "https://www.youtube.com/watch?v=U9nkvtV8MMM&t=5s", "display_url": "youtube.com/watch?v=U9nkvt\u2026", "images": [{"url": "https://pbs.twimg.com/news_img/1473269052583915531/y4dzsT2L?format=jpg&name=orig", "width": 1280, "height": 720}, {"url": "https://pbs.twimg.com/news_img/1473269052583915531/y4dzsT2L?format=jpg&name=150x150", "width": 150, "height": 150}], "status": 200, "title": "Peque\u00f1o homenaje a David Foster Wallace", "description": "Dos grupos de jubilados charlando en una playa. El primero de temas muy intelectuales, el segundo de muy banales.", "unwound_url": "https://www.youtube.com/watch?v=U9nkvtV8MMM&t=5s"}]}, "source": "Twitter Web App", "conversation_id": "1473262330859429894", "text": "\u2728Premio al Mejor Documental\u2728@camaraabierta\n\"Peque\u00f1o Homenaje a David Foster Wallace\" de \u00d3scar Villasante\nhttps://t.co/758gXJJsrc", "created_at": "2021-12-21T12:29:26.000Z", "lang": "es", "in_reply_to_user_id": "161988497", "reply_settings": "everyone", "author_id": "161988497", "id": "1473269378565160974", "possibly_sensitive": false, "referenced_tweets": [{"type": "replied_to", "id": "1473268624597168133"}], "public_metrics": {"retweet_count": 1, "reply_count": 0, "like_count": 2, "quote_count": 0}, "context_annotations": [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}]}, {"source": "Twitter for iPhone", "conversation_id": "1472984031864279045", "attachments": {"media_keys": ["3_1472987836517339136"]}, "entities": {"mentions": [{"start": 0, "end": 10, "username": "jdceulaer", "id": "292945752"}, {"start": 11, "end": 26, "username": "WimOosterlinck", "id": "53060760"}], "urls": [{"start": 49, "end": 72, "url": "https://t.co/pFDY3OjlEU", "expanded_url": "https://twitter.com/TomA3aenssens/status/1472987840288116740/photo/1", "display_url": "pic.twitter.com/pFDY3OjlEU"}]}, "text": "@jdceulaer @WimOosterlinck Ik gok op Bultinck.\n\ud83d\ude05 https://t.co/pFDY3OjlEU", "created_at": "2021-12-20T17:50:42.000Z", "lang": "nl", "in_reply_to_user_id": "292945752", "reply_settings": "everyone", "author_id": "1189576208", "id": "1472987840288116740", "possibly_sensitive": false, "referenced_tweets": [{"type": "replied_to", "id": "1472984904023658502"}], "public_metrics": {"retweet_count": 0, "reply_count": 1, "like_count": 8, "quote_count": 0}, "context_annotations": [{"domain": {"id": "3", "name": "TV Shows", "description": "Television shows from around the world"}, "entity": {"id": "10029436825", "name": "Gok : le\u00e7ons de style"}}]}, {"source": "Twitter Web App", "conversation_id": "1472600656787742725", "entities": {"mentions": [{"start": 0, "end": 16, "username": "TheLastSisyphus", "id": "340072715"}]}, "text": "@TheLastSisyphus I read this one but unfortunately not what I need. I appreciate the link though, brother \ud83d\ude4f", "created_at": "2021-12-19T16:28:08.000Z", "lang": "en", "in_reply_to_user_id": "340072715", "reply_settings": "everyone", "author_id": "1357934563838812161", "id": "1472604673962037250", "possibly_sensitive": false, "referenced_tweets": [{"type": "replied_to", "id": "1472601979729981447"}], "public_metrics": {"retweet_count": 0, "reply_count": 1, "like_count": 1, "quote_count": 0}}, {"entities": {"annotations": [{"start": 114, "end": 130, "probability": 0.9954, "type": "Person", "normalized_text": "Alfredo Rodr\u00edguez"}, {"start": 173, "end": 209, "probability": 0.7925, "type": "Person", "normalized_text": "Kelly M Grandal Ana Teresa Rodr\u00edguez"}, {"start": 214, "end": 218, "probability": 0.5481, "type": "Person", "normalized_text": "Riera"}, {"start": 260, "end": 272, "probability": 0.9384, "type": "Person", "normalized_text": "Truman Capote"}], "mentions": [{"start": 18, "end": 25, "username": "Unimet", "id": "32280530"}, {"start": 155, "end": 171, "username": "Aglaia_Berlutti", "id": "45840741"}, {"start": 222, "end": 230, "username": "yoyiahu", "id": "62674070"}], "urls": [{"start": 274, "end": 297, "url": "https://t.co/c2y1pSLJCS", "expanded_url": "https://twitter.com/velazquera/status/1471895454103314433/photo/1", "display_url": "pic.twitter.com/c2y1pSLJCS"}]}, "source": "Twitter for Android", "conversation_id": "1471895454103314433", "attachments": {"media_keys": ["3_1471895448835215364"]}, "text": "Nueva publicaci\u00f3n @Unimet en f\u00edsico con ensayos sobre Literatura norteamericana\nGracias a nuestro editor profesor Alfredo Rodr\u00edguez y a la colaboraci\u00f3n de @Aglaia_Berlutti Kelly M Grandal Ana Teresa Rodr\u00edguez de Riera y @yoyiahu \nEl m\u00edo es sobre el terrible Truman Capote https://t.co/c2y1pSLJCS", "created_at": "2021-12-17T17:29:57.000Z", "lang": "es", "reply_settings": "everyone", "author_id": "796004142007324672", "id": "1471895454103314433", "possibly_sensitive": false, "public_metrics": {"retweet_count": 10, "reply_count": 3, "like_count": 31, "quote_count": 1}, "context_annotations": [{"domain": {"id": "65", "name": "Interests and Hobbies Vertical", "description": "Top level interests and hobbies groupings, like Food or Travel"}, "entity": {"id": "1280550787207147521", "name": "Arts & culture"}}]}, {"entities": {"annotations": [{"start": 31, "end": 50, "probability": 0.9629, "type": "Person", "normalized_text": "Paul Thomas Anderson"}, {"start": 65, "end": 68, "probability": 0.962, "type": "Person", "normalized_text": "Lynn"}, {"start": 77, "end": 90, "probability": 0.9166, "type": "Person", "normalized_text": "Ernie Anderson"}, {"start": 117, "end": 119, "probability": 0.8978, "type": "Organization", "normalized_text": "ABC"}, {"start": 122, "end": 130, "probability": 0.4358, "type": "Person", "normalized_text": "Ghoulardi"}, {"start": 135, "end": 143, "probability": 0.8304, "type": "Place", "normalized_text": "Cleveland"}, {"start": 178, "end": 181, "probability": 0.6344, "type": "Organization", "normalized_text": "WCVB"}], "mentions": [{"start": 0, "end": 9, "username": "JahHills", "id": "29092660"}]}, "source": "Twitter Web App", "conversation_id": "1471842268072095754", "text": "@JahHills I love the fact that Paul Thomas Anderson\u2019s father was Lynn native Ernie Anderson, the promo announcer for ABC, Ghoulardi in Cleveland and an announcer for the news on WCVB 5.", "created_at": "2021-12-17T13:58:36.000Z", "lang": "en", "in_reply_to_user_id": "29092660", "reply_settings": "everyone", "author_id": "1681097215", "id": "1471842268072095754", "possibly_sensitive": false, "public_metrics": {"retweet_count": 0, "reply_count": 1, "like_count": 2, "quote_count": 0}, "context_annotations": [{"domain": {"id": "45", "name": "Brand Vertical", "description": "Top level entities that describe a Brands industry"}, "entity": {"id": "781974597310615553", "name": "Entertainment"}}, {"domain": {"id": "46", "name": "Brand Category", "description": "Categories within Brand Verticals that narrow down the scope of Brands"}, "entity": {"id": "781974596157181956", "name": "Online Site"}}, {"domain": {"id": "46", "name": "Brand Category", "description": "Categories within Brand Verticals that narrow down the scope of Brands"}, "entity": {"id": "781974597105094656", "name": "TV/Movies Related"}}, {"domain": {"id": "47", "name": "Brand", "description": "Brands and Companies"}, "entity": {"id": "1065650820518051840", "name": "ABC News", "description": "ABC News"}}]}], "media": [{"type": "photo", "alt_text": "A close-up of a tennis ball resting on a tennis court in front of a net. ", "height": 442, "width": 789, "url": "https://pbs.twimg.com/media/FG0W1yhWYAI-B0D.jpg", "media_key": "3_1471857766570549250"}]}, "meta": {"newest_id": "1473826748169175048", "oldest_id": "1471808169630392327", "result_count": 13}, "__twarc": {"url": "https://api.twitter.com/2/tweets/search/recent?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ctext%2Cpossibly_sensitive%2Creferenced_tweets%2Creply_settings%2Csource%2Cwithheld&user.fields=created_at%2Cdescription%2Centities%2Cid%2Clocation%2Cname%2Cpinned_tweet_id%2Cprofile_image_url%2Cprotected%2Cpublic_metrics%2Curl%2Cusername%2Cverified%2Cwithheld&media.fields=alt_text%2Cduration_ms%2Cheight%2Cmedia_key%2Cpreview_image_url%2Ctype%2Curl%2Cwidth%2Cpublic_metrics&poll.fields=duration_minutes%2Cend_datetime%2Cid%2Coptions%2Cvoting_status&place.fields=contained_within%2Ccountry%2Ccountry_code%2Cfull_name%2Cgeo%2Cid%2Cname%2Cplace_type&query=David+Foster+Wallace+is%3Averified&max_results=100", "version": "2.8.2", "retrieved_at": "2021-12-23T14:36:34+00:00"}}https://github.com/melaniewalsh/Intro-Cultural-AnalyticsThe tweets and tweet metadata above are being printed to the notebook. But we want to save this information to a file so we can work with it.
To output Twitter data to a file, we can also include a filename with the “.jsonl” file extension, which stands for JSON lines, a special kind of JSON file.
!twarc2 search "David Foster Wallace is:verified" twitter-data/dfw_last_week.jsonl100%|██████████████████| Processed 6 days/6 days [00:00<00:00, 13 tweets total ]Theoretically, a tweet with “David,” “Foster”, and “Wallace” in different places would be matched by the more general search above. If we wanted to match the words “David Foster Wallace” exactly, we would need to put “David Foster Wallace” in quotation marks and “escape” those quotation marks, so that twarc2 will know that our query shouldn’t end at the next quotation mark.
!twarc2 search "\"David Foster Wallace\" is:verified" twitter-data/dfw_exact.jsonl100%|██████████████████| Processed 6 days/6 days [00:00<00:00, 13 tweets total ]If you’re working on a Mac, you should be able to escape the quotation marks with backslashes \ before the characters, as shown in the example above. But if you’re working on a Windows computer, you may need to use triple quotations instead, for example:
twarc2 search """ "David Foster Wallace" is:verified""" twitter-data/dfw_exact.jsonl
38.6 Get Tweets (Academic Track, Full Twitter Archive)
Attention
Remember that this functionality is only available to those who have an Academic Research account.
To collect tweets from Twitter’s entire historical archive, we need to add the --archive flag.
!twarc2 search "David Foster Wallace bro is:verified" --archive twitter-data/dfw_bro.jsonl100%|██████████████| Processed 15 years/15 years [00:01<00:00, 30 tweets total ]38.7 Convert JSONL to CSV
To make our Twitter data easier to work with, we can convert our JSONL file to a CSV file with the twarc-csv plugin, which needs to be installed separately.
!pip install twarc-csvOnce installed, we can use the plug-in from twarc2 with the input filename for the JSONL and a desired output filename for the CSV file.
!twarc2 csv twitter-data/dfw_bro.jsonl twitter-data/dfw_bro.csv100%|██████████████| Processed 83.7k/83.7k of input file [00:00<00:00, 2.51MB/s]
ℹ️
Parsed 30 tweets objects from 1 lines in the input file.
Wrote 30 rows and output 74 columns in the CSV.
By default, when converting from the JSONL file, twarc-csv will only include tweets that were directly returned from the search.
If you want you can also use --inline-referenced-tweets option to make “referenced” tweets into their own rows in the CSV file. For example, if a quote tweet matched our query, the tweet being quoted would also be included in the CSV file as its own row, even if it didn’t match our query. But as of v0.5.0 of twarc-csv this is no longer the default behavior.
38.8 Read in CSV
Now we’re ready to explore the data!
To work with our tweet data, we can read in our CSV file with pandas and again parse the date column.
tweets_df = pd.read_csv('twitter-data/dfw_bro.csv',
parse_dates = ['created_at'])If we scroll through this dataset, we can see that there are only 29 tweets that matched our search query, but there is a lot of metadata associated with each tweet. Scroll to the right to see all the information. What category surprises you the most? (For me, it’s the tweet author’s pinned tweet from their own timeline. Your pinned tweet gets attached to everything else you tweet!)
tweets_df| id | conversation_id | referenced_tweets.replied_to.id | referenced_tweets.retweeted.id | referenced_tweets.quoted.id | author_id | in_reply_to_user_id | retweeted_user_id | quoted_user_id | created_at | text | lang | source | public_metrics.like_count | public_metrics.quote_count | public_metrics.reply_count | public_metrics.retweet_count | reply_settings | possibly_sensitive | withheld.scope | withheld.copyright | withheld.country_codes | entities.annotations | entities.cashtags | entities.hashtags | entities.mentions | entities.urls | context_annotations | attachments.media | attachments.media_keys | attachments.poll.duration_minutes | attachments.poll.end_datetime | attachments.poll.id | attachments.poll.options | attachments.poll.voting_status | attachments.poll_ids | author.id | author.created_at | author.username | author.name | author.description | author.entities.description.cashtags | author.entities.description.hashtags | author.entities.description.mentions | author.entities.description.urls | author.entities.url.urls | author.location | author.pinned_tweet_id | author.profile_image_url | author.protected | author.public_metrics.followers_count | author.public_metrics.following_count | author.public_metrics.listed_count | author.public_metrics.tweet_count | author.url | author.verified | author.withheld.scope | author.withheld.copyright | author.withheld.country_codes | geo.coordinates.coordinates | geo.coordinates.type | geo.country | geo.country_code | geo.full_name | geo.geo.bbox | geo.geo.type | geo.id | geo.name | geo.place_id | geo.place_type | __twarc.retrieved_at | __twarc.url | __twarc.version | Unnamed: 73 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 1465671187497840642 | 1465671183370637315 | 1.465671e+18 | NaN | NaN | 78173848 | 78173848.0 | NaN | NaN | 2021-11-30 13:16:56+00:00 | It has little to do with the gender of the author, protagonist, etc. Olga Tokarczuk is just as appealing to male readers as David Foster Wallace (who is considered 'bro lit'). It seems to be more directly related, interestingly enough, to the postmodernist divide in literature. | en | Twitter Web App | 0 | 0 | 1 | 0 | everyone | False | NaN | NaN | NaN | [{"start": 69, "end": 82, "probability": 0.9898, "type": "Person", "normalized_text": "Olga Tokarczuk"}, {"start": 124, "end": 143, "probability": 0.9596, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | NaN | [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070731935612198912", "name": "David Foster", "description": "Canadian musician, record producer, songwriter"}}, {"domain": {"id": "54", "name": "Musician", "description": "A musician in the world, like Adele or Bob Dylan"}, "entity": {"id": "1070731935612198912", "name... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 78173848 | 2009-09-29T00:58:33.000Z | TJCarpenterShow | Terry Wayne Carpenter, Jr. | Writer; shitposting. | NaN | NaN | NaN | NaN | NaN | Denver, CO | 1.263100e+18 | https://pbs.twimg.com/profile_images/1360259928091283457/REH2l3d-_normal.jpg | False | 7493 | 170 | 205 | 104059 | NaN | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 1 | 1412360883582418945 | 1412043478301880331 | 1.412361e+18 | NaN | NaN | 342644076 | 82979289.0 | NaN | NaN | 2021-07-06 10:40:49+00:00 | @TomKealy2 @aveek18 @maybeavalon Imo the great twitter literature injustice is that it is david foster wallace and not him that is smeared as the dumb bro contemporary author | en | Twitter Web App | 2 | 0 | 2 | 0 | everyone | False | NaN | NaN | NaN | [{"start": 90, "end": 109, "probability": 0.89, "type": "Person", "normalized_text": "david foster wallace"}] | NaN | NaN | [{"start": 0, "end": 10, "username": "TomKealy2", "id": "82979289", "created_at": "2009-10-16T21:36:07.000Z", "description": "Digital Writer.", "public_metrics": {"followers_count": 1519, "following_count": 1291, "tweet_count": 65190, "listed_count": 25}, "protected": false, "location": "Berlin, Germany", "name": "TomKealy 1\ufe0f\u20e34\ufe0f\u20e39\ufe0f\u20e3\ud83d\udea2", "verified": false... | NaN | [{"domain": {"id": "46", "name": "Brand Category", "description": "Categories within Brand Verticals that narrow down the scope of Brands"}, "entity": {"id": "781974596752842752", "name": "Services"}}, {"domain": {"id": "47", "name": "Brand", "description": "Brands and Companies"}, "entity": {"id": "10045225402", "name": "Twitter"}}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 342644076 | 2011-07-26T10:41:54.000Z | JeyyLowe | Josh Lowe | Policy-focused content guy. (Mostly) ex-journalist. Mediating between evidence and action at global data institute for child safety @EdinburghUni. Views mine. | NaN | NaN | [{"start": 132, "end": 145, "username": "EdinburghUni"}] | NaN | [{"start": 0, "end": 23, "url": "https://t.co/HAkzf1bnPR", "expanded_url": "https://www.ed.ac.uk/impact/research/digital-life/making-data-count-against-child-abuse", "display_url": "ed.ac.uk/impact/researc\u2026"}] | London, England | 1.461288e+18 | https://pbs.twimg.com/profile_images/1441561506634633221/qWUTnkEs_normal.jpg | False | 6190 | 3701 | 129 | 68000 | https://t.co/HAkzf1bnPR | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 2 | 1408833479304003589 | 1408773437431091202 | 1.408819e+18 | NaN | NaN | 15639774 | 4282171.0 | NaN | NaN | 2021-06-26 17:04:10+00:00 | @page88 @IngrahamAngle I heard a tech bro quote a line about cruise ship wait staff from David Foster Wallace's A Supposedly Fun Thing and said it showed how DFW really believed in great customer service. | en | TweetDeck | 11 | 0 | 1 | 0 | everyone | False | NaN | NaN | NaN | [{"start": 89, "end": 108, "probability": 0.9731, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 158, "end": 160, "probability": 0.5814, "type": "Place", "normalized_text": "DFW"}] | NaN | NaN | [{"start": 0, "end": 7, "username": "page88", "id": "4282171", "created_at": "2007-04-12T02:18:44.000Z", "description": "Columnist @WIRED & host of THIS IS CRITICAL @Stitcher. Sometimes @latimesopinion, @TheAtlantic, @nytimes. PhD fwiw. Join us at @thiscriticalpod.", "public_metrics": {"followers_count": 150610, "following_count": 4024, "tweet_count": 53115, "listed_count": 2427}, "protected"... | NaN | [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1053753085489606656", "name": "Laura Ingraham", "description": "Laura Ingraham"}}, {"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1070711281076715520", "name": "Virginia Heffernan", "descripti... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 15639774 | 2008-07-29T00:34:43.000Z | adamdavidson | Adam Davidson | Sharing the lessons I’ve learned from @ThisAmerLife @NewYorker and my baby, @planetmoney on how to make storytelling your superpower at https://t.co/QyMS00u10R | NaN | NaN | [{"start": 38, "end": 51, "username": "ThisAmerLife"}, {"start": 52, "end": 62, "username": "NewYorker"}, {"start": 76, "end": 88, "username": "planetmoney"}] | [{"start": 136, "end": 159, "url": "https://t.co/QyMS00u10R", "expanded_url": "http://www.masterfulstory.com", "display_url": "masterfulstory.com"}] | [{"start": 0, "end": 23, "url": "https://t.co/P16tJd6SDa", "expanded_url": "https://www.masterfulstory.com/", "display_url": "masterfulstory.com"}] | Charlotte, VT | 1.462433e+18 | https://pbs.twimg.com/profile_images/793622420364165120/em1s6fZT_normal.jpg | False | 118449 | 2267 | 2137 | 9323 | https://t.co/P16tJd6SDa | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 3 | 1313590839977947136 | 1313590839977947136 | NaN | 1.313523e+18 | NaN | 602060212 | NaN | 602060212.0 | NaN | 2020-10-06 21:23:56+00:00 | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 | en | Twitter Web App | 98 | 1 | 2 | 12 | everyone | False | NaN | NaN | NaN | [{"start": 216, "end": 235, "probability": 0.9361, "type": "Person", "normalized_text": "david foster wallace"}, {"start": 241, "end": 249, "probability": 0.6625, "type": "Person", "normalized_text": "hemingway"}] | NaN | NaN | NaN | [{"start": 269, "end": 292, "url": "https://t.co/QsvsVxBY15", "expanded_url": "https://twitter.com/ebruenig/status/1313522459899985922", "display_url": "twitter.com/ebruenig/statu\u2026"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 602060212 | 2012-06-07T17:38:18.000Z | ben_geier | Goy Division/Jew Order | Journalist, writer, Brooklyn trash. We’re all hypocrites, but you’re a patriot. Married to my wife, dad to a baby. | NaN | NaN | NaN | NaN | NaN | Brooklyn, NY | 7.233185e+17 | https://pbs.twimg.com/profile_images/1182430150920691712/Yt8LKrXl_normal.jpg | False | 12596 | 2981 | 128 | 47822 | NaN | False | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 4 | 1313523086424186881 | 1313523086424186881 | NaN | NaN | NaN | 602060212 | NaN | NaN | NaN | 2020-10-06 16:54:42+00:00 | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 | en | Twitter Web App | 98 | 1 | 2 | 12 | everyone | False | NaN | NaN | NaN | [{"start": 216, "end": 235, "probability": 0.9361, "type": "Person", "normalized_text": "david foster wallace"}, {"start": 241, "end": 249, "probability": 0.6625, "type": "Person", "normalized_text": "hemingway"}] | NaN | NaN | NaN | [{"start": 269, "end": 292, "url": "https://t.co/QsvsVxBY15", "expanded_url": "https://twitter.com/ebruenig/status/1313522459899985922", "display_url": "twitter.com/ebruenig/statu\u2026"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 602060212 | 2012-06-07T17:38:18.000Z | ben_geier | Goy Division/Jew Order | Journalist, writer, Brooklyn trash. We’re all hypocrites, but you’re a patriot. Married to my wife, dad to a baby. | NaN | NaN | NaN | NaN | NaN | Brooklyn, NY | 7.233185e+17 | https://pbs.twimg.com/profile_images/1182430150920691712/Yt8LKrXl_normal.jpg | False | 12596 | 2981 | 128 | 47822 | NaN | False | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 5 | 1298060678432010240 | 1298060678432010240 | NaN | 1.297936e+18 | NaN | 23314192 | NaN | 236999725.0 | NaN | 2020-08-25 00:52:37+00:00 | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) | en | Twitter Web App | 407 | 1 | 4 | 23 | everyone | False | NaN | NaN | NaN | [{"start": 0, "end": 19, "probability": 0.7756, "type": "Person", "normalized_text": "david foster wallace"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 23314192 | 2009-03-08T14:49:07.000Z | chrisdeville | Chris DeVille | Managing Editor, Stereogum // chris at stereogum dot com | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/3jEZqP2it0", "expanded_url": "http://www.stereogum.com", "display_url": "stereogum.com"}] | Columbus | 1.438875e+18 | https://pbs.twimg.com/profile_images/378800000054104895/202f3a3d00921313b1da14a88b0733c9_normal.jpeg | False | 14133 | 995 | 271 | 23755 | https://t.co/3jEZqP2it0 | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 6 | 1297973554986639360 | 1297973554986639360 | NaN | 1.297936e+18 | NaN | 386056280 | NaN | 236999725.0 | NaN | 2020-08-24 19:06:25+00:00 | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) | en | Twitter for iPhone | 407 | 1 | 4 | 23 | everyone | False | NaN | NaN | NaN | [{"start": 0, "end": 19, "probability": 0.7756, "type": "Person", "normalized_text": "david foster wallace"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 386056280 | 2011-10-06T16:00:46.000Z | MaraWilson | Mara “Get Rid of the Nazis” Wilson | On Instagram and Cameo more these days. For info or press please contact Heidi@positivejampr.com. Buy my book WHERE AM I NOW? https://t.co/olmpPDMQk3 | NaN | NaN | NaN | [{"start": 126, "end": 149, "url": "https://t.co/olmpPDMQk3", "expanded_url": "http://bit.ly/1UhjbDf", "display_url": "bit.ly/1UhjbDf"}] | [{"start": 0, "end": 23, "url": "https://t.co/56W7HESHy8", "expanded_url": "http://mara.substack.com", "display_url": "mara.substack.com"}] | L.A., mostly | 1.346261e+18 | https://pbs.twimg.com/profile_images/3379635204/9ac0e9d772744fe2fe68e852ada4fb57_normal.jpeg | False | 611442 | 6437 | 2785 | 174115 | https://t.co/56W7HESHy8 | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 7 | 1296466668898717696 | 1296458752657326081 | 1.296459e+18 | NaN | NaN | 365438535 | 365438535.0 | NaN | NaN | 2020-08-20 15:18:35+00:00 | (Gonna out myself as an insufferable millennial bro and say David Foster Wallace—his maximalism expands my sense of what's possible on the page, as does his notorious blend of academic and colloquial prose. I swear the copy of INFINITE JEST on my shelf is not a display piece.) | en | Twitter Web App | 14 | 0 | 1 | 0 | everyone | False | NaN | NaN | NaN | [{"start": 60, "end": 79, "probability": 0.8772, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 227, "end": 239, "probability": 0.4009, "type": "Product", "normalized_text": "INFINITE JEST"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 365438535 | 2011-08-31T12:57:37.000Z | ben_a_goldfarb | Ben Goldfarb | Independent journalist on the #roadecology beat. Author of EAGER, an award-winning book about beaver belief. | NaN | [{"start": 30, "end": 42, "tag": "roadecology"}] | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/nbpqLWoe9a", "expanded_url": "http://bengoldfarb.com/", "display_url": "bengoldfarb.com"}] | Spokane, WA | 1.336347e+18 | https://pbs.twimg.com/profile_images/1339242927663370240/VoFRzC_X_normal.jpg | False | 9242 | 1999 | 262 | 12967 | https://t.co/nbpqLWoe9a | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 8 | 1259920233600479233 | 1259920233600479233 | NaN | NaN | NaN | 460444548 | NaN | NaN | NaN | 2020-05-11 18:56:06+00:00 | This week for the MEL Review of Books, we had @leahrosenz talk to @adriennemiller about IN THE LAND OF MEN, a memoir of the dude snobbery she faced as the literary editor at Esquire while publishing the likes of David Foster Wallace: \nhttps://t.co/26WQYMgakO | en | Twitter Web App | 9 | 0 | 1 | 1 | everyone | False | NaN | NaN | NaN | [{"start": 18, "end": 36, "probability": 0.4401, "type": "Other", "normalized_text": "MEL Review of Books"}, {"start": 174, "end": 180, "probability": 0.9168, "type": "Organization", "normalized_text": "Esquire"}, {"start": 212, "end": 231, "probability": 0.9804, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | [{"start": 46, "end": 57, "username": "leahrosenz", "id": "734174508", "created_at": "2012-08-03T04:40:47.000Z", "description": "writer, reporter, make believe historian \u2022 words in @slate @genmag @eater @lithub @catapult. extremely freckled lady \u2022 rosenzweig dot leah@gmail", "public_metrics": {"followers_count": 514, "following_count": 1234, "tweet_count": 3690, "listed_count": 9... | [{"start": 239, "end": 262, "url": "https://t.co/26WQYMgakO", "expanded_url": "https://melmagazine.com/en-us/story/how-adrienne-miller-made-it-in-the-1990s-heyday-of-the-postmodern-lit-bro", "display_url": "melmagazine.com/en-us/story/ho\u2026"}] | [{"domain": {"id": "85", "name": "Book Genre", "description": "A genre for books, like Fiction"}, "entity": {"id": "859531094730825728", "name": "Biographies and memoirs", "description": "Biographies and memoirs"}}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 460444548 | 2012-01-10T19:27:50.000Z | MilesKlee | Miles Klee | my followers are of the highest quality | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/cHBRAqU8ZO", "expanded_url": "https://melmagazine.com/en-us/story/author/miles-klee", "display_url": "melmagazine.com/en-us/story/au\u2026"}] | LA | 1.387991e+18 | https://pbs.twimg.com/profile_images/1446285855790755846/CQJmPbBv_normal.jpg | False | 26531 | 4995 | 212 | 57004 | https://t.co/cHBRAqU8ZO | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 9 | 1109105414849921029 | 1109105414849921029 | NaN | NaN | 1.109073e+18 | 19197226 | NaN | NaN | 19197226.0 | 2019-03-22 14:51:51+00:00 | "The Great White Male is rap's Grand Inquisitor, its idiot questioner, its Alien Other no less than Reds were for McCarthy." -- David Foster Wallace, on his forays into Dorchester & Roxbury's music scenes, 1989\n\n"I know bro, but still-" -- Brendan McGuirk, reflecting on it, 2019 https://t.co/lYJV5bU7yb | en | Twitter Web Client | 1 | 0 | 1 | 0 | everyone | False | NaN | NaN | NaN | [{"start": 100, "end": 103, "probability": 0.8276, "type": "Organization", "normalized_text": "Reds"}, {"start": 114, "end": 121, "probability": 0.8741, "type": "Person", "normalized_text": "McCarthy"}, {"start": 128, "end": 147, "probability": 0.985, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 169, "end": 178, "probability": 0.6148, "type": "Place", "normalized_tex... | NaN | NaN | NaN | [{"start": 284, "end": 307, "url": "https://t.co/lYJV5bU7yb", "expanded_url": "https://twitter.com/BMcGfresh/status/1109072669025148929", "display_url": "twitter.com/BMcGfresh/stat\u2026"}] | [{"domain": {"id": "55", "name": "Music Genre", "description": "A category for a musical style, like Pop, Rock, or Rap"}, "entity": {"id": "810937888334487552", "name": "Rap", "description": "Hip-Hop/Rap"}}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 19197226 | 2009-01-19T19:23:24.000Z | BMcGfresh | Brendan McGuirk | checkpoint unlocked | NaN | NaN | NaN | NaN | NaN | “Boston”/ Somerville, Cambride | 1.431119e+18 | https://pbs.twimg.com/profile_images/1187459820825317376/uD2g6H_C_normal.jpg | False | 1268 | 2404 | 32 | 29910 | NaN | False | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 10 | 1075778924280471553 | 1075778924280471553 | NaN | NaN | 1.075615e+18 | 398088661 | NaN | NaN | 138203134.0 | 2018-12-20 15:44:17+00:00 | Is—is Alexandria Ocasio-Cortez a David Foster Wallace bro? https://t.co/OcwGRUdWMV | en | Twitter for iPhone | 54 | 3 | 3 | 4 | everyone | False | NaN | NaN | NaN | [{"start": 6, "end": 22, "probability": 0.9307, "type": "Person", "normalized_text": "Alexandria Ocasio"}, {"start": 24, "end": 29, "probability": 0.5206, "type": "Person", "normalized_text": "Cortez"}, {"start": 33, "end": 52, "probability": 0.8046, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | [{"start": 59, "end": 82, "url": "https://t.co/OcwGRUdWMV", "expanded_url": "https://twitter.com/AOC/status/1075614808853110785", "display_url": "twitter.com/AOC/status/107\u2026"}] | [{"domain": {"id": "10", "name": "Person", "description": "Named people in the world like Nelson Mandela"}, "entity": {"id": "1011963575089262593", "name": "Alexandria Ocasio-Cortez", "description": "US Representative from New York Alexandria Ocasio-Cortez"}}, {"domain": {"id": "35", "name": "Politician", "description": "Politicians in the world, like Joe Biden"}, "entity": {"id": "10119635750... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 398088661 | 2011-10-25T15:20:25.000Z | MEPFuller | Matt Fuller | Politics stuff at The Daily Beast. Take these tweets seriously but not literally. | NaN | NaN | NaN | NaN | NaN | Washington, D.C. | NaN | https://pbs.twimg.com/profile_images/1372212210521542658/g83KiBSY_normal.jpg | False | 243473 | 4243 | 3471 | 68255 | NaN | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 11 | 995487617549512704 | 995487617549512704 | NaN | NaN | NaN | 1000899020 | NaN | NaN | NaN | 2018-05-13 02:15:17+00:00 | I got kicked out of KGB Bar in the LES for arguing with a lit bro that David Foster Wallace is a better writer than Thomas Pynchon. https://t.co/iQLxduLtEN | en | Twitter for iPhone | 43 | 0 | 12 | 0 | everyone | False | NaN | NaN | NaN | [{"start": 20, "end": 26, "probability": 0.6016, "type": "Organization", "normalized_text": "KGB Bar"}, {"start": 71, "end": 90, "probability": 0.9265, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 116, "end": 129, "probability": 0.9987, "type": "Person", "normalized_text": "Thomas Pynchon"}] | NaN | NaN | NaN | [{"start": 132, "end": 155, "url": "https://t.co/iQLxduLtEN", "expanded_url": "https://twitter.com/bkerogers/status/994737256211648512", "display_url": "twitter.com/bkerogers/stat\u2026"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 1000899020 | 2012-12-10T04:28:43.000Z | nandelabra | Nandini B. | writer | copy editor | bylines: Wired, Defector, TX Observer, Pacific Standard, Slate, The Week, Ebert Voices, Lit Hub, TNR, Harper’s et al. | she/her | | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/roZvHNAj4r", "expanded_url": "https://www.harpersbazaar.com/culture/film-tv/a38539663/amrit-kaur-sex-lives-of-college-girls-interview/", "display_url": "harpersbazaar.com/culture/film-t\u2026"}] | Texas | 5.968889e+17 | https://pbs.twimg.com/profile_images/1300802944443576322/rq62G8QT_normal.jpg | False | 7506 | 1018 | 107 | 310196 | https://t.co/roZvHNAj4r | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 12 | 898246334804787202 | 898246334804787202 | NaN | 8.982432e+17 | NaN | 19608605 | NaN | 275829938.0 | NaN | 2017-08-17 18:13:09+00:00 | UPDATE: I met a "Have you read David Foster Wallace?" bro at law school. It only took four days, fam. FOUR. | en | TweetDeck | 12 | 0 | 2 | 1 | everyone | False | NaN | NaN | NaN | [{"start": 31, "end": 50, "probability": 0.9482, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 19608605 | 2009-01-27T19:01:11.000Z | thesarahkelly | sarah | Editor, mostly copy, @sinow. Diversity fellow, @APSE_sportmedia. Previously: @WaPoExpress, @SBNation, @theeagle. Lawrence native, KU grad. Trajan sucks. | NaN | NaN | [{"start": 21, "end": 27, "username": "sinow"}, {"start": 47, "end": 63, "username": "APSE_sportmedia"}, {"start": 77, "end": 89, "username": "WaPoExpress"}, {"start": 91, "end": 100, "username": "SBNation"}, {"start": 102, "end": 111, "username": "theeagle"}] | NaN | [{"start": 0, "end": 23, "url": "https://t.co/mJv97A4ukN", "expanded_url": "http://pubtbnl.com", "display_url": "pubtbnl.com"}] | District of Columbia | NaN | https://pbs.twimg.com/profile_images/1432685329262202880/GVsXHJpr_normal.jpg | False | 12456 | 3037 | 172 | 268232 | https://t.co/mJv97A4ukN | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 13 | 844552567522820096 | 844552567522820096 | NaN | NaN | NaN | 15649438 | NaN | NaN | NaN | 2017-03-22 14:13:17+00:00 | "David Foster Wallace is essentially the same as skiing and cigars now.” https://t.co/GPCbgdBL3e | en | TweetDeck | 14 | 3 | 2 | 4 | everyone | False | NaN | NaN | NaN | [{"start": 1, "end": 20, "probability": 0.9252, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | [{"start": 73, "end": 96, "url": "https://t.co/GPCbgdBL3e", "expanded_url": "https://newrepublic.com/minutes/141498/neil-gorsuch-will-first-lit-bro-supreme-court-justice", "display_url": "newrepublic.com/minutes/141498\u2026", "status": 200, "unwound_url": "https://newrepublic.com/minutes/141498/neil-gorsuch-will-first-lit-bro-supreme-court-justice"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 15649438 | 2008-07-29T18:39:26.000Z | theferocity | Saeed Jones | I’m chaotic and always right. ✨Forthcoming: ALIVE AT THE END OF THE WORLD, Fall 2022. ✨Previously: HOW WE FIGHT FOR OUR LIVES. Reps: @TuesdayAgency @SheedyLit. | NaN | NaN | [{"start": 133, "end": 147, "username": "TuesdayAgency"}, {"start": 148, "end": 158, "username": "SheedyLit"}] | NaN | [{"start": 0, "end": 23, "url": "https://t.co/ZxMTYThmyn", "expanded_url": "http://saeedjones.substack.com", "display_url": "saeedjones.substack.com"}] | Columbus, OH | 1.460278e+18 | https://pbs.twimg.com/profile_images/1463168071703707655/b2OybFGc_normal.jpg | False | 220907 | 939 | 1738 | 227013 | https://t.co/ZxMTYThmyn | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 14 | 760889024403873792 | 760889024403873792 | NaN | NaN | NaN | 193477066 | NaN | NaN | NaN | 2016-08-03 17:24:14+00:00 | New theory: Bernie Bro holdouts are exactly the same people as David Foster Wallace fanatics. Yes? | en | Twitter Web Client | 14 | 0 | 2 | 0 | everyone | False | NaN | NaN | NaN | [{"start": 12, "end": 17, "probability": 0.8566, "type": "Person", "normalized_text": "Bernie"}, {"start": 63, "end": 82, "probability": 0.958, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | NaN | [{"domain": {"id": "35", "name": "Politician", "description": "Politicians in the world, like Joe Biden"}, "entity": {"id": "10037721459", "name": "Bernie Sanders", "description": "US Senator Bernie Sanders (VT)\n"}}, {"domain": {"id": "38", "name": "Political Race", "description": ""}, "entity": {"id": "10037066629", "name": "2016 US Elections", "description": "2016 US Elections"}}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 193477066 | 2010-09-21T22:36:55.000Z | rebeccamakkai | Rebecca Makkai | Pulitzer & Nat'l Book Award finalist, winner of ALA Carnegie Medal for THE GREAT BELIEVERS. Artistic Director at @storystudio. She/her. Daughter of a refugee. | NaN | NaN | [{"start": 113, "end": 125, "username": "storystudio"}] | NaN | [{"start": 0, "end": 23, "url": "https://t.co/KuRhUDS3Ej", "expanded_url": "http://www.rebeccamakkai.com", "display_url": "rebeccamakkai.com"}] | Chicago | 1.466140e+18 | https://pbs.twimg.com/profile_images/1200639503112769536/4E9lQ4o6_normal.jpg | False | 37361 | 3104 | 421 | 25587 | https://t.co/KuRhUDS3Ej | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 15 | 733665498148294657 | 733665146216779776 | 7.336651e+17 | NaN | NaN | 398088661 | 398088661.0 | NaN | NaN | 2016-05-20 14:27:40+00:00 | Am I a David Foster Wallace bro? Very well, I'm a David Foster Wallace bro. | en | Twitter for iPhone | 2 | 0 | 1 | 1 | everyone | False | NaN | NaN | NaN | [{"start": 7, "end": 26, "probability": 0.9195, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 50, "end": 69, "probability": 0.9235, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 398088661 | 2011-10-25T15:20:25.000Z | MEPFuller | Matt Fuller | Politics stuff at The Daily Beast. Take these tweets seriously but not literally. | NaN | NaN | NaN | NaN | NaN | Washington, D.C. | NaN | https://pbs.twimg.com/profile_images/1372212210521542658/g83KiBSY_normal.jpg | False | 243473 | 4243 | 3471 | 68255 | NaN | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 16 | 694224894805032964 | 694224894805032964 | NaN | NaN | NaN | 605556917 | NaN | NaN | NaN | 2016-02-01 18:24:47+00:00 | David Foster Wallace sucks and this is a great review of interminable jest, via @Bro_Pair https://t.co/hxGFGY6D3Z | en | TweetDeck | 6 | 0 | 0 | 0 | everyone | False | NaN | NaN | NaN | [{"start": 0, "end": 19, "probability": 0.9365, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | [{"start": 80, "end": 89, "username": "Bro_Pair", "id": "56309136", "created_at": "2009-07-13T06:45:31.000Z", "description": "\"...All cats are wicked, though often useful. Who has not seen Satan in their sly faces?\"\n\nSUBSCRIBE TO MY @GHOST NEWSLETTER! https://t.co/aBXZ1krlUh", "public_metrics": {"followers_count": 53149, "following_count": 1889, "tweet_count": 3508, "listed_count": 849}, "... | [{"start": 90, "end": 113, "url": "https://t.co/hxGFGY6D3Z", "expanded_url": "http://www.cosmoetica.com/b326-des266.htm", "display_url": "cosmoetica.com/b326-des266.htm"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 605556917 | 2012-06-11T16:37:29.000Z | deep_beige | Brendan james | Co-host and producer @Blowbackpod. "The Great Vorelli" \nbjames0928@gmail.com | NaN | NaN | [{"start": 21, "end": 33, "username": "Blowbackpod"}] | NaN | [{"start": 0, "end": 23, "url": "https://t.co/43nJI3NwmR", "expanded_url": "https://open.spotify.com/artist/6T2Z3aTfHhGUSVV98su64B?si=65t1FbjRSzmpQDSIgJm5Vw&dl_branch=1", "display_url": "open.spotify.com/artist/6T2Z3aT\u2026"}] | Joe Don Baker Museum | 1.410032e+18 | https://pbs.twimg.com/profile_images/1453502026797752328/B8uZ1NsJ_normal.jpg | False | 73139 | 2382 | 635 | 52048 | https://t.co/43nJI3NwmR | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 17 | 686753187727044609 | 686753187727044609 | NaN | NaN | NaN | 56993835 | NaN | NaN | NaN | 2016-01-12 03:34:53+00:00 | "Bro stop being such a David Foster Wallace footnote" | en | Twitter for iPhone | 2 | 0 | 1 | 0 | everyone | False | NaN | NaN | NaN | [{"start": 23, "end": 42, "probability": 0.9363, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 56993835 | 2009-07-15T11:42:30.000Z | Dooezer | Mary Dooe | podcast creator. MBA. quite contrary. founder of Dooe Diligence Media. past work @marketplace @wbur @nprwest @wgbh @harvardbiz @iheartradio. https://t.co/514RH9nvyk | NaN | NaN | [{"start": 81, "end": 93, "username": "marketplace"}, {"start": 94, "end": 99, "username": "wbur"}, {"start": 100, "end": 108, "username": "nprwest"}, {"start": 109, "end": 114, "username": "wgbh"}, {"start": 115, "end": 126, "username": "harvardbiz"}, {"start": 127, "end": 139, "username": "iheartradio"}] | [{"start": 141, "end": 164, "url": "https://t.co/514RH9nvyk", "expanded_url": "http://marydooe.com", "display_url": "marydooe.com"}] | NaN | East Coast | 6.135466e+17 | https://pbs.twimg.com/profile_images/1335449532084137986/SbMbv2ZT_normal.jpg | False | 4394 | 1079 | 147 | 46178 | NaN | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 18 | 644308060937265152 | 644308060937265152 | NaN | 6.443079e+17 | NaN | 61734492 | NaN | 398088661.0 | NaN | 2015-09-17 00:33:07+00:00 | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | en | Twitter Web Client | 12 | 0 | 0 | 5 | everyone | False | NaN | NaN | NaN | [{"start": 4, "end": 16, "probability": 0.9955, "type": "Person", "normalized_text": "Carly Fiorina"}, {"start": 30, "end": 49, "probability": 0.9285, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 66, "end": 78, "probability": 0.9941, "type": "Person", "normalized_text": "Carly Fiorina"}, {"start": 82, "end": 101, "probability": 0.9103, "type": "Person", "normalized_t... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 61734492 | 2009-07-31T09:29:37.000Z | Fahrenthold | David Fahrenthold | Washington Post reporter, covering former President Trump's businesses. MSNBC contributor. If you don't want it printed, don't let it happen. | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/fJMCeIYylK", "expanded_url": "http://www.washingtonpost.com", "display_url": "washingtonpost.com"}] | Washington, DC | NaN | https://pbs.twimg.com/profile_images/1021824606087331841/_gPQBRax_normal.jpg | False | 837670 | 5583 | 9482 | 52817 | https://t.co/fJMCeIYylK | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 19 | 644307992901517312 | 644307992901517312 | NaN | 6.443079e+17 | NaN | 22330423 | NaN | 398088661.0 | NaN | 2015-09-17 00:32:50+00:00 | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | en | Twitter for iPhone | 12 | 0 | 0 | 5 | everyone | False | NaN | NaN | NaN | [{"start": 4, "end": 16, "probability": 0.9955, "type": "Person", "normalized_text": "Carly Fiorina"}, {"start": 30, "end": 49, "probability": 0.9285, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 66, "end": 78, "probability": 0.9941, "type": "Person", "normalized_text": "Carly Fiorina"}, {"start": 82, "end": 101, "probability": 0.9103, "type": "Person", "normalized_t... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 22330423 | 2009-03-01T04:12:01.000Z | ColinACurtis | Colin Curtis | Dem hack | Alum of campaigns, legislatures, & unions | BBQ enthusiast | Occasional writer | Gamer | Royals & Chiefs fan | Dotte / Kansan turned DC dweller | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/q8x9QutSUm", "expanded_url": "https://www.twitch.tv/adg913", "display_url": "twitch.tv/adg913"}] | Washington, DC | NaN | https://pbs.twimg.com/profile_images/1455343198134579201/Fy6TrHJZ_normal.jpg | False | 7506 | 1471 | 223 | 69201 | https://t.co/q8x9QutSUm | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 20 | 644307901830561793 | 644307901830561793 | NaN | NaN | NaN | 398088661 | NaN | NaN | NaN | 2015-09-17 00:32:29+00:00 | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | en | Twitter for iPhone | 12 | 0 | 0 | 5 | everyone | False | NaN | NaN | NaN | [{"start": 4, "end": 16, "probability": 0.9955, "type": "Person", "normalized_text": "Carly Fiorina"}, {"start": 30, "end": 49, "probability": 0.9285, "type": "Person", "normalized_text": "David Foster Wallace"}, {"start": 66, "end": 78, "probability": 0.9941, "type": "Person", "normalized_text": "Carly Fiorina"}, {"start": 82, "end": 101, "probability": 0.9103, "type": "Person", "normalized_t... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 398088661 | 2011-10-25T15:20:25.000Z | MEPFuller | Matt Fuller | Politics stuff at The Daily Beast. Take these tweets seriously but not literally. | NaN | NaN | NaN | NaN | NaN | Washington, D.C. | NaN | https://pbs.twimg.com/profile_images/1372212210521542658/g83KiBSY_normal.jpg | False | 243473 | 4243 | 3471 | 68255 | NaN | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 21 | 632152536636608512 | 632152536636608512 | NaN | NaN | NaN | 19816859 | NaN | NaN | NaN | 2015-08-14 11:31:24+00:00 | "David Foster Wallace was not a bro: Let’s not paint the writer with the same brush as his fans" | Salon http://t.co/t4FqgmoyVz | en | Hootsuite | 19 | 0 | 0 | 10 | everyone | False | NaN | NaN | NaN | [{"start": 1, "end": 20, "probability": 0.9133, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | [{"start": 105, "end": 127, "url": "http://t.co/t4FqgmoyVz", "expanded_url": "http://pwne.ws/1fbCjQB", "display_url": "pwne.ws/1fbCjQB", "status": 200, "unwound_url": "https://www.salon.com/2015/08/13/david_foster_wallace_was_not_a_bro_lets_not_paint_the_writer_with_the_same_brush_as_his_fans/"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 19816859 | 2009-01-31T14:38:55.000Z | PublishersWkly | Publishers Weekly | The international source for book publishing and bookselling news, reviews, and information. | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/cR5ERFihe5", "expanded_url": "http://www.publishersweekly.com/", "display_url": "publishersweekly.com"}] | New York City | NaN | https://pbs.twimg.com/profile_images/472046796202459136/7aCV2gq3_normal.jpeg | False | 806586 | 605 | 11718 | 81057 | https://t.co/cR5ERFihe5 | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 22 | 631931489769390080 | 631931489769390080 | NaN | NaN | NaN | 16955991 | NaN | NaN | NaN | 2015-08-13 20:53:02+00:00 | David Foster Wallace was *not* a bro: Don't paint the writer with the same brush as his fans http://t.co/vZvwEien22 | en | SocialFlow | 16 | 0 | 3 | 10 | everyone | False | NaN | NaN | NaN | [{"start": 0, "end": 19, "probability": 0.9181, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | [{"start": 93, "end": 115, "url": "http://t.co/vZvwEien22", "expanded_url": "http://slnm.us/QwmAbPX", "display_url": "slnm.us/QwmAbPX"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 16955991 | 2008-10-24T20:13:31.000Z | Salon | Salon | The original online source for news, politics and entertainment | Find us on Instagram & TikTok: salonofficial | Subscribe to our newsletters linked below | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/v7CORYKFyC", "expanded_url": "https://www.salon.com/newsletter", "display_url": "salon.com/newsletter"}] | NaN | 1.471924e+18 | https://pbs.twimg.com/profile_images/793144947444707328/obBB1x2a_normal.jpg | False | 965887 | 5871 | 0 | 238960 | https://t.co/v7CORYKFyC | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 23 | 631828145105162240 | 631828145105162240 | NaN | 6.318255e+17 | NaN | 89805327 | NaN | 19923638.0 | NaN | 2015-08-13 14:02:23+00:00 | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | en | Twitter for iPhone | 5 | 0 | 0 | 7 | everyone | False | NaN | NaN | NaN | [{"start": 42, "end": 61, "probability": 0.9218, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | [{"start": 64, "end": 86, "url": "http://t.co/3KfOlw2UR6", "expanded_url": "http://thecut.io/1Plvg4X", "display_url": "thecut.io/1Plvg4X"}, {"start": 87, "end": 109, "url": "http://t.co/xNI9tbF02p", "expanded_url": "https://twitter.com/TheCut/status/631825543202213889/photo/1", "display_url": "pic.twitter.com/xNI9tbF02p"}] | NaN | [{"url": "https://pbs.twimg.com/media/CMSx-8XWcAAnkK-.jpg", "type": "photo", "media_key": "3_631825542652784640", "height": 400, "width": 600}] | ["3_631825542652784640"] | NaN | NaN | NaN | NaN | NaN | NaN | 89805327 | 2009-11-13T22:07:38.000Z | Gwen_UsBeauty | Gwen Flamberg | Beauty, style and lifestyle influencer. Red Carpet beauty and style expert and makeup addict. Tweets are my own. | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/Zz45dZzxqJ", "expanded_url": "http://www.usmagazine.com/stylebeauty/beauty-trendwatch", "display_url": "usmagazine.com/stylebeauty/be\u2026"}] | Everywhere it's beautiful | NaN | https://pbs.twimg.com/profile_images/525378071/gwen_normal.jpg | False | 36087 | 2133 | 472 | 71681 | https://t.co/Zz45dZzxqJ | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 24 | 631825643441901568 | 631825643441901568 | NaN | 6.318255e+17 | NaN | 1101966512 | NaN | 19923638.0 | NaN | 2015-08-13 13:52:26+00:00 | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | en | TweetDeck | 5 | 0 | 0 | 7 | everyone | False | NaN | NaN | NaN | [{"start": 42, "end": 61, "probability": 0.9218, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | [{"start": 64, "end": 86, "url": "http://t.co/3KfOlw2UR6", "expanded_url": "http://thecut.io/1Plvg4X", "display_url": "thecut.io/1Plvg4X"}, {"start": 87, "end": 109, "url": "http://t.co/xNI9tbF02p", "expanded_url": "https://twitter.com/TheCut/status/631825543202213889/photo/1", "display_url": "pic.twitter.com/xNI9tbF02p"}] | NaN | [{"url": "https://pbs.twimg.com/media/CMSx-8XWcAAnkK-.jpg", "type": "photo", "media_key": "3_631825542652784640", "height": 400, "width": 600}] | ["3_631825542652784640"] | NaN | NaN | NaN | NaN | NaN | NaN | 1101966512 | 2013-01-18T20:40:41.000Z | Blumsteinboy | Ian Harrison | Decolonize it all. 🇬🇾 | NaN | NaN | NaN | NaN | NaN | Tiohtià:ke/Montréal | NaN | https://pbs.twimg.com/profile_images/934550443723771904/3rjskH7W_normal.jpg | False | 1631 | 1388 | 52 | 15962 | NaN | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 25 | 631825543202213889 | 631825543202213889 | NaN | NaN | NaN | 19923638 | NaN | NaN | NaN | 2015-08-13 13:52:02+00:00 | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | en | SocialFlow | 5 | 0 | 0 | 7 | everyone | False | NaN | NaN | NaN | [{"start": 42, "end": 61, "probability": 0.9218, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | [{"start": 64, "end": 86, "url": "http://t.co/3KfOlw2UR6", "expanded_url": "http://thecut.io/1Plvg4X", "display_url": "thecut.io/1Plvg4X"}, {"start": 87, "end": 109, "url": "http://t.co/xNI9tbF02p", "expanded_url": "https://twitter.com/TheCut/status/631825543202213889/photo/1", "display_url": "pic.twitter.com/xNI9tbF02p"}] | NaN | [{"url": "https://pbs.twimg.com/media/CMSx-8XWcAAnkK-.jpg", "type": "photo", "media_key": "3_631825542652784640", "height": 400, "width": 600}] | ["3_631825542652784640"] | NaN | NaN | NaN | NaN | NaN | NaN | 19923638 | 2009-02-02T19:13:01.000Z | TheCut | The Cut | Style. Self. Culture. Power.\nFind us on Instagram: @TheCut\nSubscribe to New York for more: https://t.co/1OtjTJftYM | NaN | NaN | [{"start": 51, "end": 58, "username": "TheCut"}] | [{"start": 91, "end": 114, "url": "https://t.co/1OtjTJftYM", "expanded_url": "http://nymag.com/subscribe", "display_url": "nymag.com/subscribe"}] | [{"start": 0, "end": 23, "url": "https://t.co/LXYpRGXBZm", "expanded_url": "https://thecut.com", "display_url": "thecut.com"}] | New York, NY | 1.466436e+18 | https://pbs.twimg.com/profile_images/899259308445020161/OL2Y5xmv_normal.jpg | False | 1425875 | 4307 | 10273 | 219635 | https://t.co/LXYpRGXBZm | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 26 | 631820349290774528 | 631820349290774528 | NaN | 6.318203e+17 | NaN | 24512235 | NaN | 13566872.0 | NaN | 2015-08-13 13:31:24+00:00 | All men are bad but are David Foster Wallace fans a special kind of bad? http://t.co/w5KOvJBcui http://t.co/yBhOr3aPjy | en | TweetDeck | 27 | 0 | 3 | 8 | everyone | False | NaN | NaN | NaN | [{"start": 24, "end": 43, "probability": 0.931, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | NaN | NaN | [{"start": 73, "end": 95, "url": "http://t.co/w5KOvJBcui", "expanded_url": "http://www.theawl.com/2015/08/the-bro-of-the-system", "display_url": "theawl.com/2015/08/the-br\u2026"}, {"start": 96, "end": 118, "url": "http://t.co/yBhOr3aPjy", "expanded_url": "https://twitter.com/Awl/status/631820274330136576/photo/1", "display_url": "pic.twitter.com/yBhOr3aPjy"}] | NaN | [{"url": "https://pbs.twimg.com/media/CMStMPvXAAA5a1J.jpg", "type": "photo", "media_key": "3_631820273633918976", "height": 235, "width": 278}] | ["3_631820273633918976"] | NaN | NaN | NaN | NaN | NaN | NaN | 24512235 | 2009-03-15T11:34:04.000Z | sts10 | Sam Schlinkert | Content Programming Editor at @CNNplus. Sometimes programmer. | NaN | NaN | [{"start": 30, "end": 38, "username": "CNNplus"}] | NaN | [{"start": 0, "end": 23, "url": "https://t.co/BJNkskvCIp", "expanded_url": "https://www.samschlinkert.com", "display_url": "samschlinkert.com"}] | New York, NY | NaN | https://pbs.twimg.com/profile_images/698574801842126849/Zm-Vsr3u_normal.png | False | 4118 | 1247 | 145 | 24526 | https://t.co/BJNkskvCIp | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 27 | 545020559248343040 | 545020559248343040 | NaN | NaN | NaN | 415297424 | NaN | NaN | NaN | 2014-12-17 01:00:01+00:00 | My blog bro David (@BDsCocktailHour) reacts to David Foster Wallace's teaching Gessner. With footnotes. #BillandDaves http://t.co/gU84ybdk2C | en | Twitter Web Client | 0 | 0 | 0 | 1 | everyone | False | NaN | NaN | NaN | [{"start": 12, "end": 16, "probability": 0.9019, "type": "Person", "normalized_text": "David"}, {"start": 47, "end": 66, "probability": 0.9475, "type": "Person", "normalized_text": "David Foster Wallace"}] | NaN | [{"start": 104, "end": 117, "tag": "BillandDaves"}] | NaN | [{"start": 118, "end": 140, "url": "http://t.co/gU84ybdk2C", "expanded_url": "http://billanddavescocktailhour.com/a-few-footnotes-on-david-foster-wallace-putting-me-on-his-syllabus/", "display_url": "billanddavescocktailhour.com/a-few-footnote\u2026"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 415297424 | 2011-11-18T04:44:11.000Z | billroorbach | Bill Roorbach | I'm a good writer with bad habits. Next novel is LUCKY TURTLE. Last three were THE GIRL OF THE LAKE,THE REMEDY FOR LOVE and LIFE AMONG GIANTS, all Algonquin Bks | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/Rchi3d2r2h", "expanded_url": "http://billanddavescocktailhour.com/", "display_url": "billanddavescocktailhour.com"}] | Western Maine, USA | 1.470842e+18 | https://pbs.twimg.com/profile_images/2507562193/9g6zj946bsc6xkeeon1m_normal.jpeg | False | 3107 | 1261 | 78 | 11306 | https://t.co/Rchi3d2r2h | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 28 | 270661455727165442 | 270661455727165442 | NaN | NaN | NaN | 15022464 | NaN | NaN | NaN | 2012-11-19 22:54:54+00:00 | Ayn Rand too, bro RT @SUPSLA: of couuuuuuuuurse david foster wallace is quoted. | en | TweetDeck | 0 | 0 | 0 | 0 | everyone | False | NaN | NaN | NaN | [{"start": 0, "end": 7, "probability": 0.6927, "type": "Person", "normalized_text": "Ayn Rand"}, {"start": 48, "end": 67, "probability": 0.7967, "type": "Person", "normalized_text": "david foster wallace"}] | NaN | NaN | [{"start": 21, "end": 28, "username": "supsla", "id": "42003947", "created_at": "2009-05-23T09:46:59.000Z", "description": "", "public_metrics": {"followers_count": 257, "following_count": 281, "tweet_count": 8311, "listed_count": 10}, "protected": false, "name": "in these unprecedented times", "verified": false, "url": "", "profile_image_url": "https://pbs.twimg.com/profile_images/12472297709... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 15022464 | 2008-06-05T19:46:53.000Z | stephaniemlee | Stephanie M. Lee | Science reporter, BuzzFeed News / not here right now / stephanie.lee@buzzfeed.com | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/G5wTIiUozJ", "expanded_url": "http://stephaniemlee.com", "display_url": "stephaniemlee.com"}] | San Francisco | 1.450152e+18 | https://pbs.twimg.com/profile_images/1466860232529743874/0J4IVS8E_normal.jpg | False | 22351 | 1972 | 916 | 18502 | https://t.co/G5wTIiUozJ | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
| 29 | 146330510422048768 | 146329543211368449 | 1.463295e+17 | NaN | NaN | 15644695 | 85877346.0 | NaN | NaN | 2011-12-12 20:48:07+00:00 | @MelodicRecords chillax brother, we all gud. Put another blunt on the barbie 'n' go wid th' flo bro. Dude man... http://t.co/q0RUmv12 | en | Twitter Web Client | 0 | 0 | 1 | 0 | everyone | False | NaN | NaN | NaN | NaN | NaN | NaN | [{"start": 0, "end": 15, "username": "MelodicRecords", "id": "85877346", "created_at": "2009-10-28T18:23:46.000Z", "description": "Independent Record Label - https://t.co/FxPLZYOQkn\nCheck out @MelodicEULabels for European Distribution, Press and Label Services.", "public_metrics": {"followers_count": 3644, "following_count": 2973, "tweet_count": 8403, "listed_count": 100}, "protected": false,... | [{"start": 113, "end": 133, "url": "http://t.co/q0RUmv12", "expanded_url": "http://www.nytimes.com/2011/08/21/magazine/another-thing-to-sort-of-pin-on-david-foster-wallace.html?pagewanted=all", "display_url": "nytimes.com/2011/08/21/mag\u2026"}] | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 15644695 | 2008-07-29T11:04:18.000Z | DrownedinSound | Drowned in Sound ⚓️ | Opinions On Music Since October 2000. An online community | NaN | NaN | NaN | NaN | [{"start": 0, "end": 23, "url": "https://t.co/JzYUcrN524", "expanded_url": "http://drownedinsound.com", "display_url": "drownedinsound.com"}] | London | 1.433813e+18 | https://pbs.twimg.com/profile_images/826686320881840128/Pgs_4vPo_normal.jpg | False | 101072 | 1873 | 2717 | 36341 | https://t.co/JzYUcrN524 | True | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 2021-12-23T14:37:25+00:00 | https://api.twitter.com/2/tweets/search/all?expansions=author_id%2Cin_reply_to_user_id%2Creferenced_tweets.id%2Creferenced_tweets.id.author_id%2Centities.mentions.username%2Cattachments.poll_ids%2Cattachments.media_keys%2Cgeo.place_id&tweet.fields=attachments%2Cauthor_id%2Ccontext_annotations%2Cconversation_id%2Ccreated_at%2Centities%2Cgeo%2Cid%2Cin_reply_to_user_id%2Clang%2Cpublic_metrics%2Ct... | 2.8.2 | NaN |
If we ask for a list of all the columns in the DataFrame, we can see that there are more than 90 columns here!
tweets_df.columnsIndex(['id', 'created_at', 'text', 'attachments.media',
'attachments.media_keys', 'attachments.poll.duration_minutes',
'attachments.poll.end_datetime', 'attachments.poll.id',
'attachments.poll.options', 'attachments.poll.voting_status',
'attachments.poll_ids', 'author.id', 'author.created_at',
'author.username', 'author.name', 'author.description',
'author.entities.description.cashtags',
'author.entities.description.hashtags',
'author.entities.description.mentions',
'author.entities.description.urls', 'author.entities.url.urls',
'author.location', 'author.pinned_tweet_id', 'author.profile_image_url',
'author.protected', 'author.public_metrics.followers_count',
'author.public_metrics.following_count',
'author.public_metrics.listed_count',
'author.public_metrics.tweet_count', 'author.url', 'author.verified',
'author.withheld.scope', 'author.withheld.copyright',
'author.withheld.country_codes', 'author_id', 'context_annotations',
'conversation_id', 'entities.annotations', 'entities.cashtags',
'entities.hashtags', 'entities.mentions', 'entities.urls',
'geo.coordinates.coordinates', 'geo.coordinates.type', 'geo.country',
'geo.country_code', 'geo.full_name', 'geo.geo.bbox', 'geo.geo.type',
'geo.id', 'geo.name', 'geo.place_id', 'geo.place_type',
'in_reply_to_user.id', 'in_reply_to_user.created_at',
'in_reply_to_user.username', 'in_reply_to_user.name',
'in_reply_to_user.description',
'in_reply_to_user.entities.description.cashtags',
'in_reply_to_user.entities.description.hashtags',
'in_reply_to_user.entities.description.mentions',
'in_reply_to_user.entities.description.urls',
'in_reply_to_user.entities.url.urls', 'in_reply_to_user.location',
'in_reply_to_user.pinned_tweet_id',
'in_reply_to_user.profile_image_url', 'in_reply_to_user.protected',
'in_reply_to_user.public_metrics.followers_count',
'in_reply_to_user.public_metrics.following_count',
'in_reply_to_user.public_metrics.listed_count',
'in_reply_to_user.public_metrics.tweet_count', 'in_reply_to_user.url',
'in_reply_to_user.verified', 'in_reply_to_user.withheld.scope',
'in_reply_to_user.withheld.copyright',
'in_reply_to_user.withheld.country_codes', 'in_reply_to_user_id',
'lang', 'possibly_sensitive', 'public_metrics.like_count',
'public_metrics.quote_count', 'public_metrics.reply_count',
'public_metrics.retweet_count', 'referenced_tweets', 'reply_settings',
'source', 'withheld.scope', 'withheld.copyright',
'withheld.country_codes', 'type', '__twarc.retrieved_at', '__twarc.url',
'__twarc.version', 'Unnamed: 93'],
dtype='object')As you experiment with the query syntax provided by the Twitter API you should make a habit of scanning through your collected Twitter data to ensure that your API query and subsequent manipulations are returning the data that you expect and want. If you notice tweets you don’t expect return to examine your query to see if you can explain why those tweets are turning up. If you can’t find an adequate explanation you might want to ask in the Twitter Community Forum.
38.9 Extract Tweet and Media URLs
We can make some Python functions that will create a tweet URL based on each tweet’s unique ID as well as extract an image URL if one exists.
# Make Tweet URL
def make_tweet_url(tweets):
# Get username
username = tweets[0]
# Get tweet ID
tweet_id = tweets[1]
# Make tweet URL
tweet_url = f"https://twitter.com/{username}/status/{tweet_id}"
return tweet_url
# Extract Image URL
from ast import literal_eval
def get_image_url(media):
# if not NaN or {}
if type(media) != float and media != '{}':
# Convert to an actual Python list, not just a string
media = literal_eval(media)
media = media[0]
# Extract media url if it exists
if 'url' in media.keys():
return media['url']
else:
return "No Image URL"Here we apply the above Python functions to the relevant columns to create new columns.
tweets_df['tweet_url'] = tweets_df[['author.username', 'id']].apply(make_tweet_url, axis='columns')
tweets_df['media'] = tweets_df['attachments.media'].apply(get_image_url)38.10 Rename and Select Columns
To make the data more readable, we’re going to rename a number of columns.
tweets_df.rename(columns={'created_at': 'date',
'public_metrics.retweet_count': 'retweets',
'author.username': 'username',
'author.name': 'name',
'author.verified': 'verified',
'public_metrics.like_count': 'likes',
'public_metrics.quote_count': 'quotes',
'public_metrics.reply_count': 'replies',
'author.description': 'user_bio'},
inplace=True)Then we’re only going to select the columns that we’re interested. Depending on your project and research question, you should change and customize these categories.
tweets_df = tweets_df[['date', 'username', 'name', 'verified', 'text', 'retweets',
'likes', 'replies', 'quotes', 'tweet_url', 'media', 'user_bio']]Now we can view our more focused DataFrame!
tweets_df| date | username | name | verified | text | retweets | likes | replies | quotes | tweet_url | media | user_bio | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 2021-11-30 13:16:56+00:00 | TJCarpenterShow | Terry Wayne Carpenter, Jr. | True | It has little to do with the gender of the author, protagonist, etc. Olga Tokarczuk is just as appealing to male readers as David Foster Wallace (who is considered 'bro lit'). It seems to be more directly related, interestingly enough, to the postmodernist divide in literature. | 0 | 0 | 1 | 0 | https://twitter.com/TJCarpenterShow/status/1465671187497840642 | No Image URL | Writer; shitposting. |
| 1 | 2021-07-06 10:40:49+00:00 | JeyyLowe | Josh Lowe | True | @TomKealy2 @aveek18 @maybeavalon Imo the great twitter literature injustice is that it is david foster wallace and not him that is smeared as the dumb bro contemporary author | 0 | 2 | 2 | 0 | https://twitter.com/JeyyLowe/status/1412360883582418945 | No Image URL | Policy-focused content guy. (Mostly) ex-journalist. Mediating between evidence and action at global data institute for child safety @EdinburghUni. Views mine. |
| 2 | 2021-06-26 17:04:10+00:00 | adamdavidson | Adam Davidson | True | @page88 @IngrahamAngle I heard a tech bro quote a line about cruise ship wait staff from David Foster Wallace's A Supposedly Fun Thing and said it showed how DFW really believed in great customer service. | 0 | 11 | 1 | 0 | https://twitter.com/adamdavidson/status/1408833479304003589 | No Image URL | Sharing the lessons I’ve learned from @ThisAmerLife @NewYorker and my baby, @planetmoney on how to make storytelling your superpower at https://t.co/QyMS00u10R |
| 3 | 2020-10-06 21:23:56+00:00 | ben_geier | Goy Division/Jew Order | False | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 | 12 | 98 | 2 | 1 | https://twitter.com/ben_geier/status/1313590839977947136 | No Image URL | Journalist, writer, Brooklyn trash. We’re all hypocrites, but you’re a patriot. Married to my wife, dad to a baby. |
| 4 | 2020-10-06 16:54:42+00:00 | ben_geier | Goy Division/Jew Order | False | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 | 12 | 98 | 2 | 1 | https://twitter.com/ben_geier/status/1313523086424186881 | No Image URL | Journalist, writer, Brooklyn trash. We’re all hypocrites, but you’re a patriot. Married to my wife, dad to a baby. |
| 5 | 2020-08-25 00:52:37+00:00 | chrisdeville | Chris DeVille | True | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) | 23 | 407 | 4 | 1 | https://twitter.com/chrisdeville/status/1298060678432010240 | No Image URL | Managing Editor, Stereogum // chris at stereogum dot com |
| 6 | 2020-08-24 19:06:25+00:00 | MaraWilson | Mara “Get Rid of the Nazis” Wilson | True | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) | 23 | 407 | 4 | 1 | https://twitter.com/MaraWilson/status/1297973554986639360 | No Image URL | On Instagram and Cameo more these days. For info or press please contact Heidi@positivejampr.com. Buy my book WHERE AM I NOW? https://t.co/olmpPDMQk3 |
| 7 | 2020-08-20 15:18:35+00:00 | ben_a_goldfarb | Ben Goldfarb | True | (Gonna out myself as an insufferable millennial bro and say David Foster Wallace—his maximalism expands my sense of what's possible on the page, as does his notorious blend of academic and colloquial prose. I swear the copy of INFINITE JEST on my shelf is not a display piece.) | 0 | 14 | 1 | 0 | https://twitter.com/ben_a_goldfarb/status/1296466668898717696 | No Image URL | Independent journalist on the #roadecology beat. Author of EAGER, an award-winning book about beaver belief. |
| 8 | 2020-05-11 18:56:06+00:00 | MilesKlee | Miles Klee | True | This week for the MEL Review of Books, we had @leahrosenz talk to @adriennemiller about IN THE LAND OF MEN, a memoir of the dude snobbery she faced as the literary editor at Esquire while publishing the likes of David Foster Wallace: \nhttps://t.co/26WQYMgakO | 1 | 9 | 1 | 0 | https://twitter.com/MilesKlee/status/1259920233600479233 | No Image URL | my followers are of the highest quality |
| 9 | 2019-03-22 14:51:51+00:00 | BMcGfresh | Brendan McGuirk | False | "The Great White Male is rap's Grand Inquisitor, its idiot questioner, its Alien Other no less than Reds were for McCarthy." -- David Foster Wallace, on his forays into Dorchester & Roxbury's music scenes, 1989\n\n"I know bro, but still-" -- Brendan McGuirk, reflecting on it, 2019 https://t.co/lYJV5bU7yb | 0 | 1 | 1 | 0 | https://twitter.com/BMcGfresh/status/1109105414849921029 | No Image URL | checkpoint unlocked |
| 10 | 2018-12-20 15:44:17+00:00 | MEPFuller | Matt Fuller | True | Is—is Alexandria Ocasio-Cortez a David Foster Wallace bro? https://t.co/OcwGRUdWMV | 4 | 54 | 3 | 3 | https://twitter.com/MEPFuller/status/1075778924280471553 | No Image URL | Politics stuff at The Daily Beast. Take these tweets seriously but not literally. |
| 11 | 2018-05-13 02:15:17+00:00 | nandelabra | Nandini B. | True | I got kicked out of KGB Bar in the LES for arguing with a lit bro that David Foster Wallace is a better writer than Thomas Pynchon. https://t.co/iQLxduLtEN | 0 | 43 | 12 | 0 | https://twitter.com/nandelabra/status/995487617549512704 | No Image URL | writer | copy editor | bylines: Wired, Defector, TX Observer, Pacific Standard, Slate, The Week, Ebert Voices, Lit Hub, TNR, Harper’s et al. | she/her | |
| 12 | 2017-08-17 18:13:09+00:00 | thesarahkelly | sarah | True | UPDATE: I met a "Have you read David Foster Wallace?" bro at law school. It only took four days, fam. FOUR. | 1 | 12 | 2 | 0 | https://twitter.com/thesarahkelly/status/898246334804787202 | No Image URL | Editor, mostly copy, @sinow. Diversity fellow, @APSE_sportmedia. Previously: @WaPoExpress, @SBNation, @theeagle. Lawrence native, KU grad. Trajan sucks. |
| 13 | 2017-03-22 14:13:17+00:00 | theferocity | Saeed Jones | True | "David Foster Wallace is essentially the same as skiing and cigars now.” https://t.co/GPCbgdBL3e | 4 | 14 | 2 | 3 | https://twitter.com/theferocity/status/844552567522820096 | No Image URL | I’m chaotic and always right. ✨Forthcoming: ALIVE AT THE END OF THE WORLD, Fall 2022. ✨Previously: HOW WE FIGHT FOR OUR LIVES. Reps: @TuesdayAgency @SheedyLit. |
| 14 | 2016-08-03 17:24:14+00:00 | rebeccamakkai | Rebecca Makkai | True | New theory: Bernie Bro holdouts are exactly the same people as David Foster Wallace fanatics. Yes? | 0 | 14 | 2 | 0 | https://twitter.com/rebeccamakkai/status/760889024403873792 | No Image URL | Pulitzer & Nat'l Book Award finalist, winner of ALA Carnegie Medal for THE GREAT BELIEVERS. Artistic Director at @storystudio. She/her. Daughter of a refugee. |
| 15 | 2016-05-20 14:27:40+00:00 | MEPFuller | Matt Fuller | True | Am I a David Foster Wallace bro? Very well, I'm a David Foster Wallace bro. | 1 | 2 | 1 | 0 | https://twitter.com/MEPFuller/status/733665498148294657 | No Image URL | Politics stuff at The Daily Beast. Take these tweets seriously but not literally. |
| 16 | 2016-02-01 18:24:47+00:00 | deep_beige | Brendan james | True | David Foster Wallace sucks and this is a great review of interminable jest, via @Bro_Pair https://t.co/hxGFGY6D3Z | 0 | 6 | 0 | 0 | https://twitter.com/deep_beige/status/694224894805032964 | No Image URL | Co-host and producer @Blowbackpod. "The Great Vorelli" \nbjames0928@gmail.com |
| 17 | 2016-01-12 03:34:53+00:00 | Dooezer | Mary Dooe | True | "Bro stop being such a David Foster Wallace footnote" | 0 | 2 | 1 | 0 | https://twitter.com/Dooezer/status/686753187727044609 | No Image URL | podcast creator. MBA. quite contrary. founder of Dooe Diligence Media. past work @marketplace @wbur @nprwest @wgbh @harvardbiz @iheartradio. https://t.co/514RH9nvyk |
| 18 | 2015-09-17 00:33:07+00:00 | Fahrenthold | David Fahrenthold | True | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | 5 | 12 | 0 | 0 | https://twitter.com/Fahrenthold/status/644308060937265152 | No Image URL | Washington Post reporter, covering former President Trump's businesses. MSNBC contributor. If you don't want it printed, don't let it happen. |
| 19 | 2015-09-17 00:32:50+00:00 | ColinACurtis | Colin Curtis | True | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | 5 | 12 | 0 | 0 | https://twitter.com/ColinACurtis/status/644307992901517312 | No Image URL | Dem hack | Alum of campaigns, legislatures, & unions | BBQ enthusiast | Occasional writer | Gamer | Royals & Chiefs fan | Dotte / Kansan turned DC dweller |
| 20 | 2015-09-17 00:32:29+00:00 | MEPFuller | Matt Fuller | True | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | 5 | 12 | 0 | 0 | https://twitter.com/MEPFuller/status/644307901830561793 | No Image URL | Politics stuff at The Daily Beast. Take these tweets seriously but not literally. |
| 21 | 2015-08-14 11:31:24+00:00 | PublishersWkly | Publishers Weekly | True | "David Foster Wallace was not a bro: Let’s not paint the writer with the same brush as his fans" | Salon http://t.co/t4FqgmoyVz | 10 | 19 | 0 | 0 | https://twitter.com/PublishersWkly/status/632152536636608512 | No Image URL | The international source for book publishing and bookselling news, reviews, and information. |
| 22 | 2015-08-13 20:53:02+00:00 | Salon | Salon | True | David Foster Wallace was *not* a bro: Don't paint the writer with the same brush as his fans http://t.co/vZvwEien22 | 10 | 16 | 3 | 0 | https://twitter.com/Salon/status/631931489769390080 | No Image URL | The original online source for news, politics and entertainment | Find us on Instagram & TikTok: salonofficial | Subscribe to our newsletters linked below |
| 23 | 2015-08-13 14:02:23+00:00 | Gwen_UsBeauty | Gwen Flamberg | True | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | 7 | 5 | 0 | 0 | https://twitter.com/Gwen_UsBeauty/status/631828145105162240 | https://pbs.twimg.com/media/CMSx-8XWcAAnkK-.jpg | Beauty, style and lifestyle influencer. Red Carpet beauty and style expert and makeup addict. Tweets are my own. |
| 24 | 2015-08-13 13:52:26+00:00 | Blumsteinboy | Ian Harrison | True | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | 7 | 5 | 0 | 0 | https://twitter.com/Blumsteinboy/status/631825643441901568 | https://pbs.twimg.com/media/CMSx-8XWcAAnkK-.jpg | Decolonize it all. 🇬🇾 |
| 25 | 2015-08-13 13:52:02+00:00 | TheCut | The Cut | True | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | 7 | 5 | 0 | 0 | https://twitter.com/TheCut/status/631825543202213889 | https://pbs.twimg.com/media/CMSx-8XWcAAnkK-.jpg | Style. Self. Culture. Power.\nFind us on Instagram: @TheCut\nSubscribe to New York for more: https://t.co/1OtjTJftYM |
| 26 | 2015-08-13 13:31:24+00:00 | sts10 | Sam Schlinkert | True | All men are bad but are David Foster Wallace fans a special kind of bad? http://t.co/w5KOvJBcui http://t.co/yBhOr3aPjy | 8 | 27 | 3 | 0 | https://twitter.com/sts10/status/631820349290774528 | https://pbs.twimg.com/media/CMStMPvXAAA5a1J.jpg | Content Programming Editor at @CNNplus. Sometimes programmer. |
| 27 | 2014-12-17 01:00:01+00:00 | billroorbach | Bill Roorbach | True | My blog bro David (@BDsCocktailHour) reacts to David Foster Wallace's teaching Gessner. With footnotes. #BillandDaves http://t.co/gU84ybdk2C | 1 | 0 | 0 | 0 | https://twitter.com/billroorbach/status/545020559248343040 | No Image URL | I'm a good writer with bad habits. Next novel is LUCKY TURTLE. Last three were THE GIRL OF THE LAKE,THE REMEDY FOR LOVE and LIFE AMONG GIANTS, all Algonquin Bks |
| 28 | 2012-11-19 22:54:54+00:00 | stephaniemlee | Stephanie M. Lee | True | Ayn Rand too, bro RT @SUPSLA: of couuuuuuuuurse david foster wallace is quoted. | 0 | 0 | 0 | 0 | https://twitter.com/stephaniemlee/status/270661455727165442 | No Image URL | Science reporter, BuzzFeed News / not here right now / stephanie.lee@buzzfeed.com |
| 29 | 2011-12-12 20:48:07+00:00 | DrownedinSound | Drowned in Sound ⚓️ | True | @MelodicRecords chillax brother, we all gud. Put another blunt on the barbie 'n' go wid th' flo bro. Dude man... http://t.co/q0RUmv12 | 0 | 0 | 1 | 0 | https://twitter.com/DrownedinSound/status/146330510422048768 | No Image URL | Opinions On Music Since October 2000. An online community |
38.11 Sort By Top Retweets
We can sort by number of retweets to see the most circulated tweets. Let’s examine the top 5.
tweets_df.sort_values(by='retweets', ascending=False)[:5]| date | username | name | verified | text | retweets | likes | replies | quotes | tweet_url | media | user_bio | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 5 | 2020-08-25 00:52:37+00:00 | chrisdeville | Chris DeVille | True | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) | 23 | 407 | 4 | 1 | https://twitter.com/chrisdeville/status/1298060678432010240 | No Image URL | Managing Editor, Stereogum // chris at stereogum dot com |
| 6 | 2020-08-24 19:06:25+00:00 | MaraWilson | Mara “Get Rid of the Nazis” Wilson | True | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) | 23 | 407 | 4 | 1 | https://twitter.com/MaraWilson/status/1297973554986639360 | No Image URL | On Instagram and Cameo more these days. For info or press please contact Heidi@positivejampr.com. Buy my book WHERE AM I NOW? https://t.co/olmpPDMQk3 |
| 3 | 2020-10-06 21:23:56+00:00 | ben_geier | Goy Division/Jew Order | False | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 | 12 | 98 | 2 | 1 | https://twitter.com/ben_geier/status/1313590839977947136 | No Image URL | Journalist, writer, Brooklyn trash. We’re all hypocrites, but you’re a patriot. Married to my wife, dad to a baby. |
| 4 | 2020-10-06 16:54:42+00:00 | ben_geier | Goy Division/Jew Order | False | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 | 12 | 98 | 2 | 1 | https://twitter.com/ben_geier/status/1313523086424186881 | No Image URL | Journalist, writer, Brooklyn trash. We’re all hypocrites, but you’re a patriot. Married to my wife, dad to a baby. |
| 21 | 2015-08-14 11:31:24+00:00 | PublishersWkly | Publishers Weekly | True | "David Foster Wallace was not a bro: Let’s not paint the writer with the same brush as his fans" | Salon http://t.co/t4FqgmoyVz | 10 | 19 | 0 | 0 | https://twitter.com/PublishersWkly/status/632152536636608512 | No Image URL | The international source for book publishing and bookselling news, reviews, and information. |
Here is the most retweeted tweet in this dataset:
david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya)
— David Grossman ((davidgross_man?)) August 24, 2020
38.12 Sort By Date
We can sort from the earliest tweets to the latest tweets. Let’s examine the earliest 5 tweets.
tweets_df.sort_values(by='date', ascending=True)[:5]| date | username | name | verified | text | retweets | likes | replies | quotes | tweet_url | media | user_bio | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 29 | 2011-12-12 20:48:07+00:00 | DrownedinSound | Drowned in Sound ⚓️ | True | @MelodicRecords chillax brother, we all gud. Put another blunt on the barbie 'n' go wid th' flo bro. Dude man... http://t.co/q0RUmv12 | 0 | 0 | 1 | 0 | https://twitter.com/DrownedinSound/status/146330510422048768 | No Image URL | Opinions On Music Since October 2000. An online community |
| 28 | 2012-11-19 22:54:54+00:00 | stephaniemlee | Stephanie M. Lee | True | Ayn Rand too, bro RT @SUPSLA: of couuuuuuuuurse david foster wallace is quoted. | 0 | 0 | 0 | 0 | https://twitter.com/stephaniemlee/status/270661455727165442 | No Image URL | Science reporter, BuzzFeed News / not here right now / stephanie.lee@buzzfeed.com |
| 27 | 2014-12-17 01:00:01+00:00 | billroorbach | Bill Roorbach | True | My blog bro David (@BDsCocktailHour) reacts to David Foster Wallace's teaching Gessner. With footnotes. #BillandDaves http://t.co/gU84ybdk2C | 1 | 0 | 0 | 0 | https://twitter.com/billroorbach/status/545020559248343040 | No Image URL | I'm a good writer with bad habits. Next novel is LUCKY TURTLE. Last three were THE GIRL OF THE LAKE,THE REMEDY FOR LOVE and LIFE AMONG GIANTS, all Algonquin Bks |
| 26 | 2015-08-13 13:31:24+00:00 | sts10 | Sam Schlinkert | True | All men are bad but are David Foster Wallace fans a special kind of bad? http://t.co/w5KOvJBcui http://t.co/yBhOr3aPjy | 8 | 27 | 3 | 0 | https://twitter.com/sts10/status/631820349290774528 | https://pbs.twimg.com/media/CMStMPvXAAA5a1J.jpg | Content Programming Editor at @CNNplus. Sometimes programmer. |
| 25 | 2015-08-13 13:52:02+00:00 | TheCut | The Cut | True | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | 7 | 5 | 0 | 0 | https://twitter.com/TheCut/status/631825543202213889 | https://pbs.twimg.com/media/CMSx-8XWcAAnkK-.jpg | Style. Self. Culture. Power.\nFind us on Instagram: @TheCut\nSubscribe to New York for more: https://t.co/1OtjTJftYM |
The earliest tweet in this dataset is from the music label Melodic Records:
(MelodicRecords?) chillax brother, we all gud. Put another blunt on the barbie 'n' go wid th' flo bro. Dude man… http://t.co/q0RUmv12
— Drowned in Sound ⚓️ ((DrownedinSound?)) December 12, 2011
38.13 Plot Tweets Over Time
An easy way to create a plot of tweets over time is to add a column with a 1 for every row, which we can use to count how many tweets were published per day, week, month, or year.
tweets_df = tweets_df.assign(count=1)We also need to set the date column to the index so we can do some special date manipulations.
tweets_df = tweets_df.set_index('date')
tweets_df| username | name | verified | text | retweets | likes | replies | quotes | tweet_url | media | user_bio | count | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| date | ||||||||||||
| 2021-11-30 13:16:56+00:00 | TJCarpenterShow | Terry Wayne Carpenter, Jr. | True | It has little to do with the gender of the author, protagonist, etc. Olga Tokarczuk is just as appealing to male readers as David Foster Wallace (who is considered 'bro lit'). It seems to be more directly related, interestingly enough, to the postmodernist divide in literature. | 0 | 0 | 1 | 0 | https://twitter.com/TJCarpenterShow/status/1465671187497840642 | No Image URL | Writer; shitposting. | 1 |
| 2021-07-06 10:40:49+00:00 | JeyyLowe | Josh Lowe | True | @TomKealy2 @aveek18 @maybeavalon Imo the great twitter literature injustice is that it is david foster wallace and not him that is smeared as the dumb bro contemporary author | 0 | 2 | 2 | 0 | https://twitter.com/JeyyLowe/status/1412360883582418945 | No Image URL | Policy-focused content guy. (Mostly) ex-journalist. Mediating between evidence and action at global data institute for child safety @EdinburghUni. Views mine. | 1 |
| 2021-06-26 17:04:10+00:00 | adamdavidson | Adam Davidson | True | @page88 @IngrahamAngle I heard a tech bro quote a line about cruise ship wait staff from David Foster Wallace's A Supposedly Fun Thing and said it showed how DFW really believed in great customer service. | 0 | 11 | 1 | 0 | https://twitter.com/adamdavidson/status/1408833479304003589 | No Image URL | Sharing the lessons I’ve learned from @ThisAmerLife @NewYorker and my baby, @planetmoney on how to make storytelling your superpower at https://t.co/QyMS00u10R | 1 |
| 2020-10-06 21:23:56+00:00 | ben_geier | Goy Division/Jew Order | False | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 | 12 | 98 | 2 | 1 | https://twitter.com/ben_geier/status/1313590839977947136 | No Image URL | Journalist, writer, Brooklyn trash. We’re all hypocrites, but you’re a patriot. Married to my wife, dad to a baby. | 1 |
| 2020-10-06 16:54:42+00:00 | ben_geier | Goy Division/Jew Order | False | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 | 12 | 98 | 2 | 1 | https://twitter.com/ben_geier/status/1313523086424186881 | No Image URL | Journalist, writer, Brooklyn trash. We’re all hypocrites, but you’re a patriot. Married to my wife, dad to a baby. | 1 |
| 2020-08-25 00:52:37+00:00 | chrisdeville | Chris DeVille | True | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) | 23 | 407 | 4 | 1 | https://twitter.com/chrisdeville/status/1298060678432010240 | No Image URL | Managing Editor, Stereogum // chris at stereogum dot com | 1 |
| 2020-08-24 19:06:25+00:00 | MaraWilson | Mara “Get Rid of the Nazis” Wilson | True | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) | 23 | 407 | 4 | 1 | https://twitter.com/MaraWilson/status/1297973554986639360 | No Image URL | On Instagram and Cameo more these days. For info or press please contact Heidi@positivejampr.com. Buy my book WHERE AM I NOW? https://t.co/olmpPDMQk3 | 1 |
| 2020-08-20 15:18:35+00:00 | ben_a_goldfarb | Ben Goldfarb | True | (Gonna out myself as an insufferable millennial bro and say David Foster Wallace—his maximalism expands my sense of what's possible on the page, as does his notorious blend of academic and colloquial prose. I swear the copy of INFINITE JEST on my shelf is not a display piece.) | 0 | 14 | 1 | 0 | https://twitter.com/ben_a_goldfarb/status/1296466668898717696 | No Image URL | Independent journalist on the #roadecology beat. Author of EAGER, an award-winning book about beaver belief. | 1 |
| 2020-05-11 18:56:06+00:00 | MilesKlee | Miles Klee | True | This week for the MEL Review of Books, we had @leahrosenz talk to @adriennemiller about IN THE LAND OF MEN, a memoir of the dude snobbery she faced as the literary editor at Esquire while publishing the likes of David Foster Wallace: \nhttps://t.co/26WQYMgakO | 1 | 9 | 1 | 0 | https://twitter.com/MilesKlee/status/1259920233600479233 | No Image URL | my followers are of the highest quality | 1 |
| 2019-03-22 14:51:51+00:00 | BMcGfresh | Brendan McGuirk | False | "The Great White Male is rap's Grand Inquisitor, its idiot questioner, its Alien Other no less than Reds were for McCarthy." -- David Foster Wallace, on his forays into Dorchester & Roxbury's music scenes, 1989\n\n"I know bro, but still-" -- Brendan McGuirk, reflecting on it, 2019 https://t.co/lYJV5bU7yb | 0 | 1 | 1 | 0 | https://twitter.com/BMcGfresh/status/1109105414849921029 | No Image URL | checkpoint unlocked | 1 |
| 2018-12-20 15:44:17+00:00 | MEPFuller | Matt Fuller | True | Is—is Alexandria Ocasio-Cortez a David Foster Wallace bro? https://t.co/OcwGRUdWMV | 4 | 54 | 3 | 3 | https://twitter.com/MEPFuller/status/1075778924280471553 | No Image URL | Politics stuff at The Daily Beast. Take these tweets seriously but not literally. | 1 |
| 2018-05-13 02:15:17+00:00 | nandelabra | Nandini B. | True | I got kicked out of KGB Bar in the LES for arguing with a lit bro that David Foster Wallace is a better writer than Thomas Pynchon. https://t.co/iQLxduLtEN | 0 | 43 | 12 | 0 | https://twitter.com/nandelabra/status/995487617549512704 | No Image URL | writer | copy editor | bylines: Wired, Defector, TX Observer, Pacific Standard, Slate, The Week, Ebert Voices, Lit Hub, TNR, Harper’s et al. | she/her | | 1 |
| 2017-08-17 18:13:09+00:00 | thesarahkelly | sarah | True | UPDATE: I met a "Have you read David Foster Wallace?" bro at law school. It only took four days, fam. FOUR. | 1 | 12 | 2 | 0 | https://twitter.com/thesarahkelly/status/898246334804787202 | No Image URL | Editor, mostly copy, @sinow. Diversity fellow, @APSE_sportmedia. Previously: @WaPoExpress, @SBNation, @theeagle. Lawrence native, KU grad. Trajan sucks. | 1 |
| 2017-03-22 14:13:17+00:00 | theferocity | Saeed Jones | True | "David Foster Wallace is essentially the same as skiing and cigars now.” https://t.co/GPCbgdBL3e | 4 | 14 | 2 | 3 | https://twitter.com/theferocity/status/844552567522820096 | No Image URL | I’m chaotic and always right. ✨Forthcoming: ALIVE AT THE END OF THE WORLD, Fall 2022. ✨Previously: HOW WE FIGHT FOR OUR LIVES. Reps: @TuesdayAgency @SheedyLit. | 1 |
| 2016-08-03 17:24:14+00:00 | rebeccamakkai | Rebecca Makkai | True | New theory: Bernie Bro holdouts are exactly the same people as David Foster Wallace fanatics. Yes? | 0 | 14 | 2 | 0 | https://twitter.com/rebeccamakkai/status/760889024403873792 | No Image URL | Pulitzer & Nat'l Book Award finalist, winner of ALA Carnegie Medal for THE GREAT BELIEVERS. Artistic Director at @storystudio. She/her. Daughter of a refugee. | 1 |
| 2016-05-20 14:27:40+00:00 | MEPFuller | Matt Fuller | True | Am I a David Foster Wallace bro? Very well, I'm a David Foster Wallace bro. | 1 | 2 | 1 | 0 | https://twitter.com/MEPFuller/status/733665498148294657 | No Image URL | Politics stuff at The Daily Beast. Take these tweets seriously but not literally. | 1 |
| 2016-02-01 18:24:47+00:00 | deep_beige | Brendan james | True | David Foster Wallace sucks and this is a great review of interminable jest, via @Bro_Pair https://t.co/hxGFGY6D3Z | 0 | 6 | 0 | 0 | https://twitter.com/deep_beige/status/694224894805032964 | No Image URL | Co-host and producer @Blowbackpod. "The Great Vorelli" \nbjames0928@gmail.com | 1 |
| 2016-01-12 03:34:53+00:00 | Dooezer | Mary Dooe | True | "Bro stop being such a David Foster Wallace footnote" | 0 | 2 | 1 | 0 | https://twitter.com/Dooezer/status/686753187727044609 | No Image URL | podcast creator. MBA. quite contrary. founder of Dooe Diligence Media. past work @marketplace @wbur @nprwest @wgbh @harvardbiz @iheartradio. https://t.co/514RH9nvyk | 1 |
| 2015-09-17 00:33:07+00:00 | Fahrenthold | David Fahrenthold | True | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | 5 | 12 | 0 | 0 | https://twitter.com/Fahrenthold/status/644308060937265152 | No Image URL | Washington Post reporter, covering former President Trump's businesses. MSNBC contributor. If you don't want it printed, don't let it happen. | 1 |
| 2015-09-17 00:32:50+00:00 | ColinACurtis | Colin Curtis | True | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | 5 | 12 | 0 | 0 | https://twitter.com/ColinACurtis/status/644307992901517312 | No Image URL | Dem hack | Alum of campaigns, legislatures, & unions | BBQ enthusiast | Occasional writer | Gamer | Royals & Chiefs fan | Dotte / Kansan turned DC dweller | 1 |
| 2015-09-17 00:32:29+00:00 | MEPFuller | Matt Fuller | True | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | 5 | 12 | 0 | 0 | https://twitter.com/MEPFuller/status/644307901830561793 | No Image URL | Politics stuff at The Daily Beast. Take these tweets seriously but not literally. | 1 |
| 2015-08-14 11:31:24+00:00 | PublishersWkly | Publishers Weekly | True | "David Foster Wallace was not a bro: Let’s not paint the writer with the same brush as his fans" | Salon http://t.co/t4FqgmoyVz | 10 | 19 | 0 | 0 | https://twitter.com/PublishersWkly/status/632152536636608512 | No Image URL | The international source for book publishing and bookselling news, reviews, and information. | 1 |
| 2015-08-13 20:53:02+00:00 | Salon | Salon | True | David Foster Wallace was *not* a bro: Don't paint the writer with the same brush as his fans http://t.co/vZvwEien22 | 10 | 16 | 3 | 0 | https://twitter.com/Salon/status/631931489769390080 | No Image URL | The original online source for news, politics and entertainment | Find us on Instagram & TikTok: salonofficial | Subscribe to our newsletters linked below | 1 |
| 2015-08-13 14:02:23+00:00 | Gwen_UsBeauty | Gwen Flamberg | True | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | 7 | 5 | 0 | 0 | https://twitter.com/Gwen_UsBeauty/status/631828145105162240 | https://pbs.twimg.com/media/CMSx-8XWcAAnkK-.jpg | Beauty, style and lifestyle influencer. Red Carpet beauty and style expert and makeup addict. Tweets are my own. | 1 |
| 2015-08-13 13:52:26+00:00 | Blumsteinboy | Ian Harrison | True | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | 7 | 5 | 0 | 0 | https://twitter.com/Blumsteinboy/status/631825643441901568 | https://pbs.twimg.com/media/CMSx-8XWcAAnkK-.jpg | Decolonize it all. 🇬🇾 | 1 |
| 2015-08-13 13:52:02+00:00 | TheCut | The Cut | True | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | 7 | 5 | 0 | 0 | https://twitter.com/TheCut/status/631825543202213889 | https://pbs.twimg.com/media/CMSx-8XWcAAnkK-.jpg | Style. Self. Culture. Power.\nFind us on Instagram: @TheCut\nSubscribe to New York for more: https://t.co/1OtjTJftYM | 1 |
| 2015-08-13 13:31:24+00:00 | sts10 | Sam Schlinkert | True | All men are bad but are David Foster Wallace fans a special kind of bad? http://t.co/w5KOvJBcui http://t.co/yBhOr3aPjy | 8 | 27 | 3 | 0 | https://twitter.com/sts10/status/631820349290774528 | https://pbs.twimg.com/media/CMStMPvXAAA5a1J.jpg | Content Programming Editor at @CNNplus. Sometimes programmer. | 1 |
| 2014-12-17 01:00:01+00:00 | billroorbach | Bill Roorbach | True | My blog bro David (@BDsCocktailHour) reacts to David Foster Wallace's teaching Gessner. With footnotes. #BillandDaves http://t.co/gU84ybdk2C | 1 | 0 | 0 | 0 | https://twitter.com/billroorbach/status/545020559248343040 | No Image URL | I'm a good writer with bad habits. Next novel is LUCKY TURTLE. Last three were THE GIRL OF THE LAKE,THE REMEDY FOR LOVE and LIFE AMONG GIANTS, all Algonquin Bks | 1 |
| 2012-11-19 22:54:54+00:00 | stephaniemlee | Stephanie M. Lee | True | Ayn Rand too, bro RT @SUPSLA: of couuuuuuuuurse david foster wallace is quoted. | 0 | 0 | 0 | 0 | https://twitter.com/stephaniemlee/status/270661455727165442 | No Image URL | Science reporter, BuzzFeed News / not here right now / stephanie.lee@buzzfeed.com | 1 |
| 2011-12-12 20:48:07+00:00 | DrownedinSound | Drowned in Sound ⚓️ | True | @MelodicRecords chillax brother, we all gud. Put another blunt on the barbie 'n' go wid th' flo bro. Dude man... http://t.co/q0RUmv12 | 0 | 0 | 1 | 0 | https://twitter.com/DrownedinSound/status/146330510422048768 | No Image URL | Opinions On Music Since October 2000. An online community | 1 |
Because our index is a datetime value, we can use the special Pandas method .resample() to group the tweets by month, add them up, and plot them over time.
tweets_df['count'].resample('M').sum()\
.plot(title='"David Foster Wallace Bro"\n Tweets from Verified Accounts');
38.14 Display Links and Images in Twitter Data
To display links and images in our DataFrame, we can convert the image URL into an HTML image tag, and we can display our DataFrame as an HTML object with the HTML module.
from IPython.core.display import HTML
def get_image_html(link):
# check to see if the media category has an image URL
if link != "No Image URL":
# format the image url as an HTML image
image_html = f"<a href='{link}'>'<img src='{link}' width='500px'></a> "
return image_html
else:
return "No Image URL"
# Apply the above function to the media column
tweets_df['media']= tweets_df['media'].apply(get_image_html)View images
HTML(tweets_df[['media', 'text']].sort_values(by='media').to_html(render_links=True, escape=False))| media | text | |
|---|---|---|
| date | ||
| 2015-08-13 13:31:24+00:00 | ' |
All men are bad but are David Foster Wallace fans a special kind of bad? http://t.co/w5KOvJBcui http://t.co/yBhOr3aPjy |
| 2015-08-13 13:52:02+00:00 | ' |
You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p |
| 2015-08-13 13:52:26+00:00 | ' |
You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p |
| 2015-08-13 14:02:23+00:00 | ' |
You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p |
| 2021-11-30 13:16:56+00:00 | No Image URL | It has little to do with the gender of the author, protagonist, etc. Olga Tokarczuk is just as appealing to male readers as David Foster Wallace (who is considered 'bro lit'). It seems to be more directly related, interestingly enough, to the postmodernist divide in literature. |
| 2014-12-17 01:00:01+00:00 | No Image URL | My blog bro David (@BDsCocktailHour) reacts to David Foster Wallace's teaching Gessner. With footnotes. #BillandDaves http://t.co/gU84ybdk2C |
| 2015-08-13 20:53:02+00:00 | No Image URL | David Foster Wallace was *not* a bro: Don't paint the writer with the same brush as his fans http://t.co/vZvwEien22 |
| 2015-08-14 11:31:24+00:00 | No Image URL | "David Foster Wallace was not a bro: Let’s not paint the writer with the same brush as his fans" | Salon http://t.co/t4FqgmoyVz |
| 2015-09-17 00:32:29+00:00 | No Image URL | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? |
| 2015-09-17 00:32:50+00:00 | No Image URL | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? |
| 2015-09-17 00:33:07+00:00 | No Image URL | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? |
| 2016-01-12 03:34:53+00:00 | No Image URL | "Bro stop being such a David Foster Wallace footnote" |
| 2016-02-01 18:24:47+00:00 | No Image URL | David Foster Wallace sucks and this is a great review of interminable jest, via @Bro_Pair https://t.co/hxGFGY6D3Z |
| 2016-05-20 14:27:40+00:00 | No Image URL | Am I a David Foster Wallace bro? Very well, I'm a David Foster Wallace bro. |
| 2016-08-03 17:24:14+00:00 | No Image URL | New theory: Bernie Bro holdouts are exactly the same people as David Foster Wallace fanatics. Yes? |
| 2017-03-22 14:13:17+00:00 | No Image URL | "David Foster Wallace is essentially the same as skiing and cigars now.” https://t.co/GPCbgdBL3e |
| 2017-08-17 18:13:09+00:00 | No Image URL | UPDATE: I met a "Have you read David Foster Wallace?" bro at law school. It only took four days, fam. FOUR. |
| 2018-05-13 02:15:17+00:00 | No Image URL | I got kicked out of KGB Bar in the LES for arguing with a lit bro that David Foster Wallace is a better writer than Thomas Pynchon. https://t.co/iQLxduLtEN |
| 2018-12-20 15:44:17+00:00 | No Image URL | Is—is Alexandria Ocasio-Cortez a David Foster Wallace bro? https://t.co/OcwGRUdWMV |
| 2019-03-22 14:51:51+00:00 | No Image URL | "The Great White Male is rap's Grand Inquisitor, its idiot questioner, its Alien Other no less than Reds were for McCarthy." -- David Foster Wallace, on his forays into Dorchester & Roxbury's music scenes, 1989\n\n"I know bro, but still-" -- Brendan McGuirk, reflecting on it, 2019 https://t.co/lYJV5bU7yb |
| 2020-05-11 18:56:06+00:00 | No Image URL | This week for the MEL Review of Books, we had @leahrosenz talk to @adriennemiller about IN THE LAND OF MEN, a memoir of the dude snobbery she faced as the literary editor at Esquire while publishing the likes of David Foster Wallace: \nhttps://t.co/26WQYMgakO |
| 2020-08-20 15:18:35+00:00 | No Image URL | (Gonna out myself as an insufferable millennial bro and say David Foster Wallace—his maximalism expands my sense of what's possible on the page, as does his notorious blend of academic and colloquial prose. I swear the copy of INFINITE JEST on my shelf is not a display piece.) |
| 2020-08-24 19:06:25+00:00 | No Image URL | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) |
| 2020-08-25 00:52:37+00:00 | No Image URL | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) |
| 2020-10-06 16:54:42+00:00 | No Image URL | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 |
| 2020-10-06 21:23:56+00:00 | No Image URL | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 |
| 2021-06-26 17:04:10+00:00 | No Image URL | @page88 @IngrahamAngle I heard a tech bro quote a line about cruise ship wait staff from David Foster Wallace's A Supposedly Fun Thing and said it showed how DFW really believed in great customer service. |
| 2021-07-06 10:40:49+00:00 | No Image URL | @TomKealy2 @aveek18 @maybeavalon Imo the great twitter literature injustice is that it is david foster wallace and not him that is smeared as the dumb bro contemporary author |
| 2012-11-19 22:54:54+00:00 | No Image URL | Ayn Rand too, bro RT @SUPSLA: of couuuuuuuuurse david foster wallace is quoted. |
| 2011-12-12 20:48:07+00:00 | No Image URL | @MelodicRecords chillax brother, we all gud. Put another blunt on the barbie 'n' go wid th' flo bro. Dude man... http://t.co/q0RUmv12 |
View tweet links
HTML(tweets_df[['tweet_url', 'text', 'retweets']].sort_values(by='retweets', ascending=False).to_html(render_links=True, escape=False))| tweet_url | text | retweets | |
|---|---|---|---|
| date | |||
| 2020-08-25 00:52:37+00:00 | https://twitter.com/chrisdeville/status/1298060678432010240 | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) | 23 |
| 2020-08-24 19:06:25+00:00 | https://twitter.com/MaraWilson/status/1297973554986639360 | david foster wallace bro conversation again? i feel like by this point in the discourse i need footnotes! (just a little "insider" dfw humor for ya) | 23 |
| 2020-10-06 21:23:56+00:00 | https://twitter.com/ben_geier/status/1313590839977947136 | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 | 12 |
| 2020-10-06 16:54:42+00:00 | https://twitter.com/ben_geier/status/1313523086424186881 | the guy who publicly makes a display of how much feminist literature he reads and waxes on how important bookshelf representation is at least 50% more likely to be a sexpest than the bro who just likes to vibe about david foster wallace and hemingway. this is science. https://t.co/QsvsVxBY15 | 12 |
| 2015-08-14 11:31:24+00:00 | https://twitter.com/PublishersWkly/status/632152536636608512 | "David Foster Wallace was not a bro: Let’s not paint the writer with the same brush as his fans" | Salon http://t.co/t4FqgmoyVz | 10 |
| 2015-08-13 20:53:02+00:00 | https://twitter.com/Salon/status/631931489769390080 | David Foster Wallace was *not* a bro: Don't paint the writer with the same brush as his fans http://t.co/vZvwEien22 | 10 |
| 2015-08-13 13:31:24+00:00 | https://twitter.com/sts10/status/631820349290774528 | All men are bad but are David Foster Wallace fans a special kind of bad? http://t.co/w5KOvJBcui http://t.co/yBhOr3aPjy | 8 |
| 2015-08-13 13:52:26+00:00 | https://twitter.com/Blumsteinboy/status/631825643441901568 | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | 7 |
| 2015-08-13 13:52:02+00:00 | https://twitter.com/TheCut/status/631825543202213889 | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | 7 |
| 2015-08-13 14:02:23+00:00 | https://twitter.com/Gwen_UsBeauty/status/631828145105162240 | You probably know a bro who says he loves David Foster Wallace: http://t.co/3KfOlw2UR6 http://t.co/xNI9tbF02p | 7 |
| 2015-09-17 00:32:50+00:00 | https://twitter.com/ColinACurtis/status/644307992901517312 | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | 5 |
| 2015-09-17 00:33:07+00:00 | https://twitter.com/Fahrenthold/status/644308060937265152 | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | 5 |
| 2015-09-17 00:32:29+00:00 | https://twitter.com/MEPFuller/status/644307901830561793 | Did Carly Fiorina just make a David Foster Wallace reference?\n\nIs Carly Fiorina a David Foster Wallace bro?? | 5 |
| 2018-12-20 15:44:17+00:00 | https://twitter.com/MEPFuller/status/1075778924280471553 | Is—is Alexandria Ocasio-Cortez a David Foster Wallace bro? https://t.co/OcwGRUdWMV | 4 |
| 2017-03-22 14:13:17+00:00 | https://twitter.com/theferocity/status/844552567522820096 | "David Foster Wallace is essentially the same as skiing and cigars now.” https://t.co/GPCbgdBL3e | 4 |
| 2017-08-17 18:13:09+00:00 | https://twitter.com/thesarahkelly/status/898246334804787202 | UPDATE: I met a "Have you read David Foster Wallace?" bro at law school. It only took four days, fam. FOUR. | 1 |
| 2020-05-11 18:56:06+00:00 | https://twitter.com/MilesKlee/status/1259920233600479233 | This week for the MEL Review of Books, we had @leahrosenz talk to @adriennemiller about IN THE LAND OF MEN, a memoir of the dude snobbery she faced as the literary editor at Esquire while publishing the likes of David Foster Wallace: \nhttps://t.co/26WQYMgakO | 1 |
| 2014-12-17 01:00:01+00:00 | https://twitter.com/billroorbach/status/545020559248343040 | My blog bro David (@BDsCocktailHour) reacts to David Foster Wallace's teaching Gessner. With footnotes. #BillandDaves http://t.co/gU84ybdk2C | 1 |
| 2016-05-20 14:27:40+00:00 | https://twitter.com/MEPFuller/status/733665498148294657 | Am I a David Foster Wallace bro? Very well, I'm a David Foster Wallace bro. | 1 |
| 2012-11-19 22:54:54+00:00 | https://twitter.com/stephaniemlee/status/270661455727165442 | Ayn Rand too, bro RT @SUPSLA: of couuuuuuuuurse david foster wallace is quoted. | 0 |
| 2021-11-30 13:16:56+00:00 | https://twitter.com/TJCarpenterShow/status/1465671187497840642 | It has little to do with the gender of the author, protagonist, etc. Olga Tokarczuk is just as appealing to male readers as David Foster Wallace (who is considered 'bro lit'). It seems to be more directly related, interestingly enough, to the postmodernist divide in literature. | 0 |
| 2016-01-12 03:34:53+00:00 | https://twitter.com/Dooezer/status/686753187727044609 | "Bro stop being such a David Foster Wallace footnote" | 0 |
| 2016-02-01 18:24:47+00:00 | https://twitter.com/deep_beige/status/694224894805032964 | David Foster Wallace sucks and this is a great review of interminable jest, via @Bro_Pair https://t.co/hxGFGY6D3Z | 0 |
| 2021-07-06 10:40:49+00:00 | https://twitter.com/JeyyLowe/status/1412360883582418945 | @TomKealy2 @aveek18 @maybeavalon Imo the great twitter literature injustice is that it is david foster wallace and not him that is smeared as the dumb bro contemporary author | 0 |
| 2016-08-03 17:24:14+00:00 | https://twitter.com/rebeccamakkai/status/760889024403873792 | New theory: Bernie Bro holdouts are exactly the same people as David Foster Wallace fanatics. Yes? | 0 |
| 2018-05-13 02:15:17+00:00 | https://twitter.com/nandelabra/status/995487617549512704 | I got kicked out of KGB Bar in the LES for arguing with a lit bro that David Foster Wallace is a better writer than Thomas Pynchon. https://t.co/iQLxduLtEN | 0 |
| 2019-03-22 14:51:51+00:00 | https://twitter.com/BMcGfresh/status/1109105414849921029 | "The Great White Male is rap's Grand Inquisitor, its idiot questioner, its Alien Other no less than Reds were for McCarthy." -- David Foster Wallace, on his forays into Dorchester & Roxbury's music scenes, 1989\n\n"I know bro, but still-" -- Brendan McGuirk, reflecting on it, 2019 https://t.co/lYJV5bU7yb | 0 |
| 2020-08-20 15:18:35+00:00 | https://twitter.com/ben_a_goldfarb/status/1296466668898717696 | (Gonna out myself as an insufferable millennial bro and say David Foster Wallace—his maximalism expands my sense of what's possible on the page, as does his notorious blend of academic and colloquial prose. I swear the copy of INFINITE JEST on my shelf is not a display piece.) | 0 |
| 2021-06-26 17:04:10+00:00 | https://twitter.com/adamdavidson/status/1408833479304003589 | @page88 @IngrahamAngle I heard a tech bro quote a line about cruise ship wait staff from David Foster Wallace's A Supposedly Fun Thing and said it showed how DFW really believed in great customer service. | 0 |
| 2011-12-12 20:48:07+00:00 | https://twitter.com/DrownedinSound/status/146330510422048768 | @MelodicRecords chillax brother, we all gud. Put another blunt on the barbie 'n' go wid th' flo bro. Dude man... http://t.co/q0RUmv12 | 0 |
38.15 Top Hashtags
To analyze hashtags in a tweet dataset, we can use the plugin twarc2 hashtags, which requires a separate installation.
!pip install twarc-hashtagsThen we can create a CSV digest of the top hashtags from our JSONL data with twarc2 hashtags. (To get more hashtag data, we are using a JSONL file that contains a full archive search of “David Foster Wallace” rather than “David Foster Wallace bro”).
!twarc2 hashtags twitter-data/dfw.jsonl twitter-data/dfw_hashtags.csv100%|██████████████| Processed 56.9M/56.9M of input file [00:01<00:00, 35.0MB/s]pd.read_csv('twitter-data/dfw_hashtags.csv')| hashtag | tweets | |
|---|---|---|
| 0 | dfw | 202 |
| 1 | writing | 154 |
| 2 | davidfosterwallace | 122 |
| 3 | amwriting | 114 |
| 4 | longreads | 103 |
| ... | ... | ... |
| 1428 | 24hourbookclub | 1 |
| 1429 | 21février | 1 |
| 1430 | 1980s | 1 |
| 1431 | 12sep2008 | 1 |
| 1432 | 100novelas | 1 |
1433 rows × 2 columns
We can also use the flag --group to group the hashtags by their frequency per time period and the flag --limit to limit the hashtags to only the top n number of hashtags per grouping.
!twarc2 hashtags --group year --limit 10 twitter-data/dfw.jsonl twitter-data/dfw_hashtags_year.csv100%|██████████████| Processed 56.9M/56.9M of input file [00:01<00:00, 34.9MB/s]hashtags_df = pd.read_csv('twitter-data/dfw_hashtags_year.csv')
hashtags_df | hashtag | time | tweets | |
|---|---|---|---|
| 0 | quote | 2021 | 7 |
| 1 | writing | 2021 | 6 |
| 2 | amwriting | 2021 | 5 |
| 3 | writingcommunity | 2021 | 2 |
| 4 | writetip | 2021 | 2 |
| ... | ... | ... | ... |
| 150 | dfw | 2009 | 2 |
| 151 | archive | 2009 | 2 |
| 152 | wallace | 2009 | 1 |
| 153 | swf | 2009 | 1 |
| 154 | reading | 2009 | 1 |
155 rows × 3 columns
To plot the frequency of hashtags over time, we can set the DataFrame index to the “time” column.
hashtags_df = hashtags_df.set_index('time')Then we can filter for a specific hashtag and plot its frequency.
hashtags_df[hashtags_df['hashtag'] == 'writing'].plot(y='tweets', label='#writing', title='DFW Hashtags');
We can also plot multiple hashtags on the same plot by assigning the first plot to the variable main_axis and then directing the next plots to be plotted on the same axis ax=main_axis.
main_axis = hashtags_df[hashtags_df['hashtag'] == 'writing'].plot(y='tweets', label='#writing', title='DFW Hashtags')
hashtags_df[hashtags_df['hashtag'] == 'dfw'].plot(ax=main_axis, y='tweets', label='#dfw')
hashtags_df[hashtags_df['hashtag'] == 'infinitejest'].plot(ax=main_axis, y='tweets', label='#infinitejest');
38.16 Sentiment Analysis
See an example of running the English-language sentiment analysis tool VADER on Donald Trump’s tweets.
38.17 Topic Modeling Tweets
See an example of using topic modeling on Donald Trump’s tweets.