[
  {
    "path": "Episode_1_Text_to_Vectors.ipynb",
    "content": "{\n \"cells\": [\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {\n    \"slideshow\": {\n     \"slide_type\": \"slide\"\n    }\n   },\n   \"source\": [\n    \"# Modern Practical Natural Language Processing\\n\",\n    \"\\n\",\n    \"This course will cover how you can use NLP to do stuff. \\n\",\n    \"\\n\",\n    \"We envision four videos.\\n\",\n    \"1. Overview and Converting Text to Vectors (this one)\\n\",\n    \"  * For finding similar documents\\n\",\n    \"  * \\\"I have this document or text, what others talk about the same stuff?\\\"\\n\",\n    \"2. Learning with Vectors and Classification\\n\",\n    \"  * For classifying documents\\n\",\n    \"  * \\\"I need to put these documents into buckets.\\\"\\n\",\n    \"3. Sequence Generation \\n\",\n    \"  * For translation and document summarization\\n\",\n    \"  * \\\"I need to create quick summaries of these documents, maybe in Urdu.\\\"\\n\",\n    \"4. Extracting Pieces of Information from Text\\n\",\n    \"  * For pulling out sentences and documents that talk about specific things\\n\",\n    \"  * \\\"I need every mention of a street address or business in Garland, Texas.\\\"\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Additional Details\\n\",\n    \"\\n\",\n    \"The idea is we make short videos that focus on the aspects of NLP that currently work well and are useful.\\n\",\n    \"\\n\",\n    \"Speech-to-text now works pretty well, so these methods will also be useful for the audio portions of videos.\\n\",\n    \"\\n\",\n    \"All code will be available on GitHub here https://github.com/jmugan/modern_practical_nlp\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# About Me, Jonathan Mugan\\n\",\n    \"* PhD in Computer Science in 2010 from UT Austin\\n\",\n    \"* Thesis work was about how a robot could wake up in the world and figure out what is going on\\n\",\n    \"* Work at [DeUmbra](https://deumbra.com/) where we build AI for the DoD\\n\",\n    \"  * We also work in healthcare, which I can talk about. A future video (not in this series) will cover how we use graph neural networks to identify who is at risk for opioid overdose\\n\",\n    \"* Wrote *The Curiosity Cycle: Preparing Your Child for the Ongoing Technological Explosion* http://www.jonathanmugan.com/CuriosityCycle/\\n\",\n    \"* Also do independent consulting work\\n\",\n    \"* Can find me here jonathanwilliammugan@gmail.com or on Twitter at [@jmugan](https://twitter.com/jmugan)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# The Limits of NLP\\n\",\n    \"## Computers can't read\\n\",\n    \"* Reading requires mapping language to internal concepts grounded in behaving in the same general environment as the writer.\\n\",\n    \"  * Computers don’t have those concepts.\\n\",\n    \"  * Example: “I pulled the wagon.” Computers don’t know that wagons can carry things or that pulling exerts a gentle tension to the arm and leg muscles as one walks.\\n\",\n    \"  \\n\",\n    \"## Computers can't write\\n\",\n    \"* Writing requires mapping internal concepts grounded in behaving in the same general environment as the expected reader.\\n\",\n    \"  * Computers don’t have those concepts\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Additional Information on NLP, AI, and Their Limits and Promise\\n\",\n    \"* [Generating Natural-Language Text with Neural Networks](https://medium.com/@jmugan/generating-natural-language-text-with-neural-networks-e983bb48caad)\\n\",\n    \"* [Why Is There Life? and What Does It Have to Do with AI?](https://towardsdatascience.com/why-is-there-life-and-what-does-it-have-to-do-with-ai-2195ac91532f)\\n\",\n    \"* [Chatbots: Theory and Practice](https://medium.com/intuitionmachine/chatbots-theory-and-practice-3274f7e6d648)\\n\",\n    \"* [You and Your Bot: A New Kind of Lifelong Relationship](https://chatbotsmagazine.com/you-and-your-bot-a-new-kind-of-lifelong-relationship-6a9649feeb71)\\n\",\n    \"* [Computers Could Understand Natural Language Using Simulated Physics](https://chatbotslife.com/computers-could-understand-natural-language-using-simulated-physics-26e9706013da)\\n\",\n    \"* [The Two Paths from Natural Language Processing to Artificial Intelligence](https://medium.com/intuitionmachine/the-two-paths-from-natural-language-processing-to-artificial-intelligence-d5384ddbfc18)\\n\",\n    \"* [DeepGrammar: Grammar Checking Using Deep Learning](https://www.linkedin.com/pulse/deep-grammar-checking-using-learning-jonathan-mugan)\\n\",\n    \"* [Deep Learning for Natural Language Processing](https://www.linkedin.com/pulse/deep-learning-natural-language-processing-jonathan-mugan)\\n\",\n    \"* [What Deep Learning Really Means](https://www.linkedin.com/pulse/20141114065942-42285562-what-deep-learning-really-means)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"## NLP Works Around Computers Not Having the Experience or Conceptual Framework to Read and Write\\n\",\n    \"* NLP is about how to make natural language amenable to computation even though computers can’t read or write.\\n\",\n    \"* Representing text as *vectors* has transformed NLP in the last 10 years.\\n\",\n    \"* There are also *symbolic methods* that are practically useful; we will cover those too.\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Now the Meat of Video 1: Generating Vectors from Text\\n\",\n    \"* By converting a sentence, paragraph, or document to a vector, we can measure its distance to the vectors of other texts.\\n\",\n    \"  * We can find similar texts this way.\\n\",\n    \"* Similar to how computer vision is done. We can say there is a cat in an image, and we can say that this image is similar to this other image, but we don't really have a human-understandable representation of what exactly is going on.\\n\",\n    \"* But it is still useful.\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Tools to make vectors from text\\n\",\n    \"* PyTorch https://pytorch.org/\\n\",\n    \"  * Like TensorFlow, does automatic differentiation\\n\",\n    \"* HuggingFace Transformer library https://huggingface.co/transformers/index.html\\n\",\n    \"  * Built on top of PyTorch\\n\",\n    \"* spaCy https://spacy.io/\\n\",\n    \"  * Most common tool for NLP practitioners\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"Get some Python going, if you have Anaconda, you can do from the command line:\\n\",\n    \"\\n\",\n    \"`conda create -n nlp_videos python=3.8`\\n\",\n    \"\\n\",\n    \"`conda activate nlp_videos`\\n\",\n    \"\\n\",\n    \"\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"Install PyTorch from the command line\\n\",\n    \"\\n\",\n    \"`pip install torch torchvision`\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"Install HuggingFace Transformers from the command line\\n\",\n    \"\\n\",\n    \"`pip install transformers`\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 1,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"# import a bunch of stuff\\n\",\n    \"from typing import List, Tuple\\n\",\n    \"import scipy\\n\",\n    \"import numpy as np\\n\",\n    \"import os.path\\n\",\n    \"from pathlib import Path\\n\",\n    \"import pickle\\n\",\n    \"\\n\",\n    \"import torch  # PyTorch\\n\",\n    \"\\n\",\n    \"from transformers import BertModel, BertTokenizer, BertConfig\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Import the model\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 2,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"# https://huggingface.co/transformers/pretrained_models.html\\n\",\n    \"model_name = 'bert-base-uncased'\\n\",\n    \"\\n\",\n    \"# Need to use the same tokenizer that was used to train the model so that it breaks \\n\",\n    \"# up words into tokens the same way.\\n\",\n    \"tokenizer = BertTokenizer.from_pretrained(model_name)\\n\",\n    \"\\n\",\n    \"# This model is huge!!!!!!!!\\n\",\n    \"model = BertModel.from_pretrained(model_name)\\n\",\n    \"\\n\",\n    \"# Parameters used by the pre-trained model\\n\",\n    \"config = BertConfig.from_pretrained(model_name)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"## Define a function to convert text to tokens\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 3,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"def get_tokens(text: str,\\n\",\n    \"               tokenizer: BertTokenizer,\\n\",\n    \"               config: BertConfig) -> List[str]:\\n\",\n    \"    \\n\",\n    \"    tokens = tokenizer.tokenize(text)\\n\",\n    \"    \\n\",\n    \"    # make sure it isn't too long\\n\",\n    \"    max_length = config.max_position_embeddings\\n\",\n    \"    tokens = tokens[:max_length-1] # Will add special begin token\\n\",\n    \"    \\n\",\n    \"    # cls token to hold vector \\n\",\n    \"    # https://huggingface.co/transformers/main_classes/tokenizer.html\\n\",\n    \"    tokens = [tokenizer.cls_token] + tokens\\n\",\n    \"    \\n\",\n    \"    return tokens\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 4,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"['[CLS]', 'i', 'went', 'to', 'the', 'store', '.']\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"text = \\\"I went to the store.\\\"\\n\",\n    \"tokens = get_tokens(text, tokenizer, config)\\n\",\n    \"print(tokens)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Convert tokens into integer ids\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 5,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"[101, 1045, 2253, 2000, 1996, 3573, 1012]\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"token_ids: List[int] = tokenizer.convert_tokens_to_ids(tokens)\\n\",\n    \"print(token_ids)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Convert the input into a Torch tensor\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 6,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"torch.Size([7]) tensor([ 101, 1045, 2253, 2000, 1996, 3573, 1012])\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"token_ids_tensor = torch.tensor(token_ids)\\n\",\n    \"print(token_ids_tensor.shape, token_ids_tensor)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Make it shape `(1 x num_tokens)`\\n\",\n    \"\\n\",\n    \"In real applications, we would send a bunch of sentences in at once.\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 7,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"torch.Size([1, 7]) tensor([[ 101, 1045, 2253, 2000, 1996, 3573, 1012]])\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"token_ids_tensor = torch.unsqueeze(token_ids_tensor, 0)\\n\",\n    \"print(token_ids_tensor.shape, token_ids_tensor)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Let's convert it into a vector\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 8,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"<class 'torch.Tensor'> tensor([[-6.8463e-01, -2.8959e-01, -2.9154e-01,  6.7127e-01,  3.9507e-01,\\n\",\n      \"         -2.1678e-01,  6.2011e-01,  1.9677e-01, -2.8793e-02, -9.4984e-01,\\n\",\n      \"          6.5669e-02,  4.6028e-01,  9.6631e-01, -2.3616e-01,  9.4689e-01,\\n\",\n      \"         -6.0630e-01, -4.7309e-01, -4.3481e-01,  2.0222e-01, -3.4150e-01,\\n\",\n      \"          8.3457e-01,  9.8431e-01,  2.2365e-01,  3.2114e-01,  4.1334e-01,\\n\",\n      \"          2.7076e-01, -3.6277e-01,  9.4006e-01,  8.4959e-01,  6.9592e-01,\\n\",\n      \"         -6.7077e-01, -7.6625e-02, -9.8442e-01, -1.7111e-01, -7.3174e-01,\\n\",\n      \"         -9.3164e-01,  7.5510e-02, -3.6217e-01, -1.8402e-02,  2.4065e-01,\\n\",\n      \"         -8.9202e-01,  2.1222e-01,  9.8343e-01, -7.1324e-01,  6.2176e-01,\\n\",\n      \"         -1.2014e-01, -9.9812e-01,  7.7176e-02, -8.9065e-01, -4.3335e-01,\\n\",\n      \"          2.4937e-01,  1.9725e-01, -1.0021e-02,  2.5571e-01,  2.0711e-01,\\n\",\n      \"         -4.4047e-01, -1.4055e-01,  1.4745e-01, -4.4538e-02, -2.2215e-01,\\n\",\n      \"         -5.2094e-01,  3.4585e-01, -5.1174e-01, -7.0657e-01, -1.8190e-01,\\n\",\n      \"         -1.1501e-01, -1.8398e-01, -4.6214e-02,  7.4689e-02, -1.3377e-01,\\n\",\n      \"          6.5313e-01,  4.1187e-01,  4.7467e-01, -8.5554e-01, -4.7246e-01,\\n\",\n      \"          2.6163e-01, -5.9148e-01,  9.9996e-01, -2.2857e-01, -9.7987e-01,\\n\",\n      \"          7.7000e-01, -3.0872e-01,  6.1258e-01,  5.1875e-01, -5.7974e-01,\\n\",\n      \"         -9.9979e-01,  3.0398e-01, -2.2005e-01, -9.7479e-01, -1.5614e-01,\\n\",\n      \"          5.7737e-01, -1.0548e-01,  4.3095e-01,  5.8140e-01, -3.3167e-01,\\n\",\n      \"         -5.9095e-01, -6.8403e-02, -3.7091e-01, -1.2306e-01, -3.5265e-01,\\n\",\n      \"          2.0860e-01,  3.8559e-02, -2.1643e-01, -7.3485e-02,  1.6054e-01,\\n\",\n      \"         -1.7230e-01, -6.1174e-01, -3.2474e-01,  2.1762e-01,  4.0952e-01,\\n\",\n      \"          4.8370e-01, -6.3214e-02,  2.3135e-01, -8.5628e-01,  5.7745e-02,\\n\",\n      \"         -6.2461e-02, -9.6422e-01, -5.9186e-01, -9.7909e-01,  6.3998e-01,\\n\",\n      \"         -3.9063e-01, -3.8640e-01,  9.2037e-01, -2.2520e-01,  9.6262e-03,\\n\",\n      \"         -2.1822e-01,  1.9589e-01, -9.9999e-01, -1.9221e-01, -5.8043e-01,\\n\",\n      \"          4.0236e-01, -2.3272e-01, -9.5746e-01, -9.5151e-01,  3.5794e-01,\\n\",\n      \"          8.5313e-01,  6.6643e-03,  9.4455e-01, -1.5654e-01,  9.3562e-01,\\n\",\n      \"          4.7287e-01, -3.5763e-01, -1.6274e-01, -4.1491e-01,  5.4784e-01,\\n\",\n      \"          1.2096e-01, -4.5101e-01,  1.7629e-01, -2.0530e-01, -2.0993e-01,\\n\",\n      \"         -6.8818e-01, -1.1124e-02, -2.3549e-01, -8.2398e-01, -2.2184e-01,\\n\",\n      \"          9.6111e-01, -2.9530e-01,  1.3862e-01,  4.2531e-01, -3.6020e-02,\\n\",\n      \"         -4.8034e-01,  6.0736e-01,  7.4829e-01,  1.3367e-01, -1.7527e-01,\\n\",\n      \"          4.8676e-02, -5.9256e-01,  1.1316e-01, -6.5533e-01,  4.6883e-01,\\n\",\n      \"          2.5188e-01, -1.1483e-01, -2.0792e-01, -9.8412e-01, -6.5169e-02,\\n\",\n      \"         -4.1505e-02,  9.7155e-01,  4.7783e-01,  8.8895e-02, -1.8174e-01,\\n\",\n      \"         -2.0750e-01,  3.6108e-01, -9.0281e-01,  9.6643e-01,  6.3364e-02,\\n\",\n      \"          8.6277e-02, -4.3666e-01, -2.8309e-01, -8.4300e-01, -1.6856e-01,\\n\",\n      \"          6.5029e-01, -4.9486e-02, -5.9637e-01, -2.2820e-02, -3.2272e-01,\\n\",\n      \"         -8.1942e-02, -4.9286e-01,  3.8231e-01, -1.7478e-01, -2.7009e-01,\\n\",\n      \"         -2.5142e-01,  8.7474e-01,  7.1716e-01,  4.4309e-01, -1.8028e-01,\\n\",\n      \"          4.2791e-01, -7.5773e-01, -7.4819e-01, -6.1290e-02, -4.7889e-02,\\n\",\n      \"          1.3942e-01,  9.7752e-01, -7.6803e-01,  1.9361e-02, -8.3478e-01,\\n\",\n      \"         -9.6340e-01,  3.9162e-02, -8.5415e-01, -2.0570e-01, -2.8596e-01,\\n\",\n      \"          3.7838e-01, -5.4226e-01, -6.4749e-01,  2.5859e-01, -8.8820e-01,\\n\",\n      \"         -8.6905e-01,  3.0495e-01, -3.1694e-01,  1.6252e-01, -2.7408e-01,\\n\",\n      \"          9.7091e-01,  3.1627e-01, -5.9503e-01,  6.9102e-01,  9.5153e-01,\\n\",\n      \"         -7.0397e-01, -8.3993e-01,  7.9146e-01, -1.3707e-01,  4.1921e-01,\\n\",\n      \"         -3.4158e-01,  8.4210e-01,  2.3320e-01,  5.9743e-01, -8.6541e-01,\\n\",\n      \"         -3.4436e-01, -5.8305e-01,  4.6551e-01, -1.8610e-01, -6.8970e-01,\\n\",\n      \"         -3.6817e-01,  5.6169e-01,  1.1734e-01,  6.1270e-01, -2.4431e-01,\\n\",\n      \"          7.2129e-01, -9.6205e-01, -9.4983e-01, -7.1281e-01,  2.9124e-01,\\n\",\n      \"         -9.8616e-01,  5.0502e-01,  1.4242e-01,  5.0880e-01, -3.0191e-01,\\n\",\n      \"         -1.2370e-01, -9.5590e-01,  4.8255e-01,  6.0764e-02,  7.7390e-01,\\n\",\n      \"         -5.6401e-01, -7.3786e-01, -1.0773e-01, -9.2285e-01,  9.0839e-02,\\n\",\n      \"         -1.4504e-01,  4.3344e-01, -1.2290e-01, -8.5779e-01,  2.1065e-01,\\n\",\n      \"          5.7555e-01,  3.3000e-01,  4.6564e-01,  9.3778e-01,  9.9824e-01,\\n\",\n      \"          9.6806e-01,  8.2033e-01,  2.1980e-01, -9.8223e-01, -1.2467e-01,\\n\",\n      \"          9.7780e-01, -6.0067e-01, -9.9982e-01, -9.1369e-01, -5.2972e-01,\\n\",\n      \"          2.0041e-01, -9.9999e-01, -2.2998e-01,  9.7607e-02, -7.3847e-01,\\n\",\n      \"         -2.2182e-02,  9.4859e-01,  8.6662e-01, -9.9995e-01,  1.9446e-01,\\n\",\n      \"          8.8456e-01, -6.6574e-01,  5.5210e-02, -3.6430e-01,  9.6708e-01,\\n\",\n      \"          5.0735e-01,  6.0674e-01, -3.9902e-02,  3.6633e-01, -6.4363e-01,\\n\",\n      \"         -6.3040e-01, -3.0765e-02, -5.7105e-01,  8.8454e-01,  1.2028e-01,\\n\",\n      \"         -5.3834e-01, -8.3262e-01,  4.8732e-01, -2.1228e-01,  3.4476e-01,\\n\",\n      \"         -9.5176e-01, -9.8953e-02,  7.2055e-02,  5.6133e-01,  1.4952e-01,\\n\",\n      \"         -7.6354e-02, -3.9572e-01,  6.6977e-02,  1.5441e-01,  1.9891e-01,\\n\",\n      \"          6.4225e-01, -6.3491e-01, -2.4015e-01,  5.0210e-01, -4.3184e-01,\\n\",\n      \"          6.9309e-03, -9.7179e-01,  9.3479e-01, -4.3015e-02, -3.3167e-01,\\n\",\n      \"          9.9997e-01,  2.3615e-01, -7.1675e-01,  2.3047e-01,  1.0895e-01,\\n\",\n      \"         -7.4958e-01,  9.9992e-01,  1.8075e-01, -9.7035e-01, -4.9875e-01,\\n\",\n      \"          1.1086e-02, -3.2893e-01, -6.0028e-01,  9.4290e-01, -3.8645e-02,\\n\",\n      \"          1.1772e-01, -4.4417e-01,  9.8164e-01, -9.8379e-01,  8.6616e-01,\\n\",\n      \"         -5.3697e-01, -9.5878e-01,  8.9757e-01,  9.3980e-01, -6.7731e-01,\\n\",\n      \"          1.1224e-01,  3.0228e-02,  5.3302e-02,  1.1718e-01, -7.3350e-01,\\n\",\n      \"          4.5478e-01,  6.6144e-01, -9.1131e-02,  8.7689e-01, -1.1498e-01,\\n\",\n      \"         -5.7983e-01, -1.8680e-01, -2.0697e-01,  5.5213e-01,  6.4853e-01,\\n\",\n      \"          1.8649e-01, -1.2323e-01, -1.1785e-01, -9.6719e-02, -8.3518e-01,\\n\",\n      \"         -8.9681e-01,  6.8071e-01,  9.9997e-01,  9.6424e-02,  6.6242e-01,\\n\",\n      \"          3.5163e-01,  1.3645e-03,  2.0233e-02,  1.7773e-01,  3.2743e-01,\\n\",\n      \"          3.2634e-02, -1.9178e-01,  4.0169e-01, -8.7595e-01, -9.8522e-01,\\n\",\n      \"          7.1714e-01,  1.4060e-01, -1.2248e-01,  9.9393e-01,  2.6829e-01,\\n\",\n      \"         -2.1408e-01, -3.9473e-02,  2.3414e-01,  4.1849e-02,  1.5338e-01,\\n\",\n      \"         -2.7583e-01,  9.4316e-01, -1.2325e-01,  5.8779e-01,  6.0759e-01,\\n\",\n      \"          2.3006e-01, -5.1844e-01, -3.6375e-01, -5.5054e-02, -9.2117e-01,\\n\",\n      \"         -1.7819e-01, -9.1414e-01,  9.4992e-01, -4.7370e-01,  1.2210e-01,\\n\",\n      \"          1.0127e-01,  5.8619e-01,  9.9996e-01, -7.7297e-01,  6.3918e-01,\\n\",\n      \"         -1.6503e-02,  8.5887e-01, -9.6903e-01, -6.5689e-01, -4.2514e-01,\\n\",\n      \"          1.8557e-01,  2.8983e-01, -6.4668e-02,  1.5650e-01, -8.9022e-01,\\n\",\n      \"         -3.9330e-01,  1.0839e-01, -8.7953e-01, -9.7536e-01,  1.5899e-01,\\n\",\n      \"          6.0560e-01,  1.2089e-01, -8.8287e-01, -4.4234e-01, -4.5809e-01,\\n\",\n      \"          1.5670e-01, -1.6881e-01, -9.1873e-01,  5.8025e-01, -3.0912e-01,\\n\",\n      \"          2.1214e-01, -2.0353e-01,  5.6712e-01,  7.5314e-02,  7.2038e-01,\\n\",\n      \"         -2.5369e-01, -4.3001e-01, -1.8585e-01, -7.0050e-01,  7.6715e-01,\\n\",\n      \"         -6.0295e-01, -3.1446e-01, -2.9695e-02,  9.9997e-01, -3.1701e-01,\\n\",\n      \"          5.6117e-01,  5.0637e-01,  7.0757e-01, -2.9232e-02,  2.3940e-01,\\n\",\n      \"          3.9347e-01,  2.4624e-01,  2.8964e-01,  1.3107e-01, -2.5525e-01,\\n\",\n      \"         -1.2822e-01,  5.5914e-01,  6.6970e-01, -4.9123e-02,  7.8410e-01,\\n\",\n      \"         -1.6722e-01,  1.1560e-01,  1.6259e-01,  1.9482e-01,  8.9179e-01,\\n\",\n      \"         -1.2318e-01, -2.1431e-01, -1.5294e-01, -2.1595e-01, -2.7673e-01,\\n\",\n      \"         -3.6827e-01,  9.9985e-01,  9.1469e-02,  2.9056e-01, -9.7954e-01,\\n\",\n      \"         -4.0206e-01, -4.9129e-01,  9.9745e-01,  8.4380e-01, -1.4853e-01,\\n\",\n      \"          3.7771e-01,  1.8318e-01, -2.6459e-02,  4.7974e-01, -5.4117e-03,\\n\",\n      \"          4.3701e-03, -2.4330e-03,  9.8072e-02,  9.3859e-01, -4.5234e-01,\\n\",\n      \"         -9.7426e-01, -6.5835e-01,  2.5815e-02, -9.3973e-01,  9.8055e-01,\\n\",\n      \"         -1.9610e-01, -5.1893e-02, -1.7175e-02, -8.7915e-02,  4.1474e-01,\\n\",\n      \"          5.4786e-02, -9.6506e-01,  1.0456e-01,  1.0606e-01,  9.6423e-01,\\n\",\n      \"         -3.3901e-02, -6.2046e-01, -9.4383e-01, -2.5289e-01,  5.9409e-01,\\n\",\n      \"         -6.7694e-02, -8.1933e-01,  9.5689e-01, -9.3558e-01,  3.6238e-01,\\n\",\n      \"          9.9938e-01,  2.2634e-01, -6.6810e-01,  6.0785e-03, -3.5088e-01,\\n\",\n      \"          1.8301e-01, -1.5569e-01,  5.9032e-01, -9.3563e-01, -3.5780e-01,\\n\",\n      \"         -1.0177e-01,  1.1414e-01, -1.2837e-01, -2.0000e-01,  4.0425e-01,\\n\",\n      \"          8.2765e-02, -5.8469e-01, -2.9229e-01,  4.9537e-03,  3.8927e-01,\\n\",\n      \"          6.6923e-01, -1.7641e-01, -1.2864e-01,  5.8341e-02, -9.9779e-02,\\n\",\n      \"         -9.1635e-01, -2.5509e-01, -2.5024e-01, -9.9048e-01,  5.4205e-01,\\n\",\n      \"         -9.9997e-01,  1.9936e-01, -6.2746e-01, -3.1429e-01,  8.8385e-01,\\n\",\n      \"          6.0793e-01,  4.4053e-01, -6.6756e-01,  2.4216e-01,  8.5366e-01,\\n\",\n      \"          5.4879e-01, -2.7448e-01,  5.0527e-01, -6.2542e-01,  1.3795e-01,\\n\",\n      \"         -1.2833e-01,  1.9358e-01,  7.6996e-02,  3.8815e-01, -2.4976e-01,\\n\",\n      \"          9.9998e-01,  1.1730e-01, -6.5224e-01, -7.9764e-01,  7.6038e-02,\\n\",\n      \"         -1.9107e-01,  9.9939e-01, -6.3015e-01, -9.5948e-01,  2.4225e-01,\\n\",\n      \"         -6.0806e-01, -8.4127e-01,  2.9755e-01,  2.6237e-01, -5.3159e-01,\\n\",\n      \"         -6.0424e-01,  9.1510e-01,  7.9815e-01, -6.3712e-01,  7.8975e-01,\\n\",\n      \"         -2.2756e-01, -4.5958e-01,  8.4606e-04,  6.4294e-02,  9.7041e-01,\\n\",\n      \"          5.4821e-01,  7.7400e-01, -2.0310e-01, -6.1499e-01,  9.6664e-01,\\n\",\n      \"          2.8915e-01,  1.8473e-01, -1.9784e-01,  9.9980e-01,  3.2068e-01,\\n\",\n      \"         -8.8019e-01, -7.7237e-02, -9.0901e-01, -1.9813e-01, -8.8418e-01,\\n\",\n      \"          8.1715e-02,  2.2635e-01,  9.2042e-01, -1.0348e-01,  9.3367e-01,\\n\",\n      \"         -2.8730e-01, -2.4075e-03, -2.3414e-01,  4.7300e-01,  3.0885e-01,\\n\",\n      \"         -9.0943e-01, -9.7602e-01, -9.7999e-01,  1.5841e-01, -1.4602e-01,\\n\",\n      \"         -1.3396e-01,  1.1578e-01, -4.0504e-02, -1.6110e-01, -9.2639e-02,\\n\",\n      \"         -9.9980e-01,  9.1276e-01,  3.0597e-01, -1.8919e-01,  9.4640e-01,\\n\",\n      \"          3.2521e-01,  5.2297e-01,  1.3397e-01, -9.6512e-01, -8.7257e-01,\\n\",\n      \"         -1.5825e-01, -1.4047e-01,  6.4015e-01,  3.1501e-01,  8.4411e-01,\\n\",\n      \"         -7.6320e-02, -3.5128e-01, -5.6055e-01, -6.5825e-01, -8.2077e-01,\\n\",\n      \"         -9.8028e-01,  2.9467e-01,  5.9930e-01, -7.7228e-01,  9.2316e-01,\\n\",\n      \"         -6.5145e-01, -1.7735e-01,  5.6600e-01, -2.6573e-01,  3.6191e-01,\\n\",\n      \"          3.2193e-01,  1.0799e-01, -2.6561e-02,  6.1199e-01,  8.2953e-01,\\n\",\n      \"          8.0335e-01,  9.7372e-01,  6.5444e-02,  4.5875e-01,  4.3933e-01,\\n\",\n      \"          3.4857e-01,  9.1538e-01, -8.5089e-01,  8.6904e-02,  5.5658e-01,\\n\",\n      \"         -4.8172e-01,  2.4070e-01, -2.1773e-01, -6.0461e-01,  4.1906e-01,\\n\",\n      \"         -3.5208e-01,  2.9005e-01, -2.7767e-01,  8.3306e-02, -1.6652e-01,\\n\",\n      \"         -3.5441e-01, -3.2011e-01, -3.0685e-01,  6.5583e-01,  5.1440e-01,\\n\",\n      \"          9.0891e-01,  6.0811e-01,  5.7899e-02, -5.3289e-01,  9.7129e-02,\\n\",\n      \"          2.5882e-01, -8.9232e-01,  5.0798e-01,  1.1261e-02,  5.6267e-01,\\n\",\n      \"          6.5232e-01,  2.9266e-02,  8.6119e-01, -2.6809e-01, -1.5990e-01,\\n\",\n      \"         -6.9884e-02, -4.5516e-01,  4.8223e-01, -6.4390e-01, -4.1659e-01,\\n\",\n      \"         -4.6073e-01,  4.8635e-02,  1.9580e-01,  9.9074e-01, -3.5556e-01,\\n\",\n      \"          2.8231e-01, -4.0274e-01, -2.1153e-01,  1.2159e-01, -3.8889e-01,\\n\",\n      \"         -9.9987e-01,  1.1610e-01,  4.5443e-01,  1.9631e-02, -4.8330e-01,\\n\",\n      \"          5.9117e-01,  1.7777e-01, -9.2548e-01, -2.7403e-01,  6.1358e-01,\\n\",\n      \"          1.9727e-01, -2.7212e-01, -1.0140e-01,  5.6724e-01,  8.6259e-01,\\n\",\n      \"          3.6661e-01,  7.1262e-01, -3.1770e-01,  5.2326e-01,  6.4676e-01,\\n\",\n      \"         -5.8528e-01, -4.9630e-01,  8.7960e-01]], grad_fn=<TanhBackward>)\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"last_hidden_state, pooler_output = model(token_ids_tensor)\\n\",\n    \"\\n\",\n    \"# pooler output is the last layer hidden state of the first token.\\n\",\n    \"# Since this uses attention, it takes the whole sequence into account.\\n\",\n    \"vector = pooler_output\\n\",\n    \"\\n\",\n    \"print(type(vector), vector)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Let's convert it into Numpy and make it one-dimensional\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 9,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"<class 'numpy.ndarray'> [-6.84628487e-01 -2.89591521e-01 -2.91541070e-01  6.71265423e-01\\n\",\n      \"  3.95071477e-01 -2.16784209e-01  6.20105147e-01  1.96766943e-01\\n\",\n      \" -2.87933350e-02 -9.49840426e-01  6.56687692e-02  4.60277617e-01\\n\",\n      \"  9.66312706e-01 -2.36155078e-01  9.46891129e-01 -6.06303632e-01\\n\",\n      \" -4.73092347e-01 -4.34805721e-01  2.02217102e-01 -3.41503441e-01\\n\",\n      \"  8.34570289e-01  9.84307647e-01  2.23645478e-01  3.21142077e-01\\n\",\n      \"  4.13339913e-01  2.70759493e-01 -3.62768382e-01  9.40062046e-01\\n\",\n      \"  8.49591494e-01  6.95917845e-01 -6.70773387e-01 -7.66250417e-02\\n\",\n      \" -9.84417677e-01 -1.71114579e-01 -7.31735408e-01 -9.31641102e-01\\n\",\n      \"  7.55103827e-02 -3.62168103e-01 -1.84017215e-02  2.40652755e-01\\n\",\n      \" -8.92024696e-01  2.12224603e-01  9.83429790e-01 -7.13237345e-01\\n\",\n      \"  6.21758878e-01 -1.20137155e-01 -9.98118401e-01  7.71760195e-02\\n\",\n      \" -8.90646696e-01 -4.33352202e-01  2.49371767e-01  1.97246686e-01\\n\",\n      \" -1.00208428e-02  2.55708367e-01  2.07114801e-01 -4.40470636e-01\\n\",\n      \" -1.40554667e-01  1.47446528e-01 -4.45383005e-02 -2.22154856e-01\\n\",\n      \" -5.20936608e-01  3.45849454e-01 -5.11738360e-01 -7.06572950e-01\\n\",\n      \" -1.81898311e-01 -1.15012474e-01 -1.83977082e-01 -4.62138429e-02\\n\",\n      \"  7.46894032e-02 -1.33774593e-01  6.53133094e-01  4.11871672e-01\\n\",\n      \"  4.74670112e-01 -8.55535150e-01 -4.72458601e-01  2.61630505e-01\\n\",\n      \" -5.91484666e-01  9.99962032e-01 -2.28569582e-01 -9.79867816e-01\\n\",\n      \"  7.69997954e-01 -3.08717132e-01  6.12579882e-01  5.18750727e-01\\n\",\n      \" -5.79740167e-01 -9.99791801e-01  3.03983480e-01 -2.20049590e-01\\n\",\n      \" -9.74786937e-01 -1.56140268e-01  5.77371418e-01 -1.05475947e-01\\n\",\n      \"  4.30951089e-01  5.81398845e-01 -3.31668705e-01 -5.90946019e-01\\n\",\n      \" -6.84028342e-02 -3.70905131e-01 -1.23055927e-01 -3.52654070e-01\\n\",\n      \"  2.08595157e-01  3.85590382e-02 -2.16434225e-01 -7.34849498e-02\\n\",\n      \"  1.60537064e-01 -1.72299922e-01 -6.11736298e-01 -3.24742407e-01\\n\",\n      \"  2.17623830e-01  4.09515023e-01  4.83697861e-01 -6.32140711e-02\\n\",\n      \"  2.31352299e-01 -8.56281161e-01  5.77445626e-02 -6.24606647e-02\\n\",\n      \" -9.64218497e-01 -5.91862440e-01 -9.79088306e-01  6.39976859e-01\\n\",\n      \" -3.90627444e-01 -3.86396587e-01  9.20367837e-01 -2.25204900e-01\\n\",\n      \"  9.62616783e-03 -2.18224168e-01  1.95887834e-01 -9.99987602e-01\\n\",\n      \" -1.92212701e-01 -5.80429733e-01  4.02364343e-01 -2.32717037e-01\\n\",\n      \" -9.57460582e-01 -9.51511085e-01  3.57939929e-01  8.53128493e-01\\n\",\n      \"  6.66428730e-03  9.44551826e-01 -1.56540543e-01  9.35615659e-01\\n\",\n      \"  4.72874522e-01 -3.57629716e-01 -1.62744746e-01 -4.14905965e-01\\n\",\n      \"  5.47836840e-01  1.20960295e-01 -4.51014608e-01  1.76286623e-01\\n\",\n      \" -2.05302909e-01 -2.09933981e-01 -6.88180745e-01 -1.11242337e-02\\n\",\n      \" -2.35485718e-01 -8.23984623e-01 -2.21838370e-01  9.61110651e-01\\n\",\n      \" -2.95296848e-01  1.38620794e-01  4.25305992e-01 -3.60202454e-02\\n\",\n      \" -4.80337173e-01  6.07358575e-01  7.48292267e-01  1.33673429e-01\\n\",\n      \" -1.75273851e-01  4.86755706e-02 -5.92557430e-01  1.13160603e-01\\n\",\n      \" -6.55327499e-01  4.68833297e-01  2.51879752e-01 -1.14830986e-01\\n\",\n      \" -2.07915619e-01 -9.84116793e-01 -6.51691183e-02 -4.15052399e-02\\n\",\n      \"  9.71545279e-01  4.77825493e-01  8.88953581e-02 -1.81736618e-01\\n\",\n      \" -2.07501307e-01  3.61075282e-01 -9.02807891e-01  9.66431141e-01\\n\",\n      \"  6.33644387e-02  8.62771571e-02 -4.36664551e-01 -2.83090413e-01\\n\",\n      \" -8.42999756e-01 -1.68564975e-01  6.50294781e-01 -4.94863689e-02\\n\",\n      \" -5.96365750e-01 -2.28201989e-02 -3.22715014e-01 -8.19422379e-02\\n\",\n      \" -4.92862284e-01  3.82305920e-01 -1.74775273e-01 -2.70093858e-01\\n\",\n      \" -2.51422495e-01  8.74737144e-01  7.17155099e-01  4.43087578e-01\\n\",\n      \" -1.80278927e-01  4.27908182e-01 -7.57730663e-01 -7.48189867e-01\\n\",\n      \" -6.12897873e-02 -4.78890687e-02  1.39420003e-01  9.77522969e-01\\n\",\n      \" -7.68028498e-01  1.93608403e-02 -8.34781587e-01 -9.63399231e-01\\n\",\n      \"  3.91616747e-02 -8.54150474e-01 -2.05695122e-01 -2.85961628e-01\\n\",\n      \"  3.78379524e-01 -5.42263269e-01 -6.47491515e-01  2.58589417e-01\\n\",\n      \" -8.88202250e-01 -8.69045138e-01  3.04953486e-01 -3.16939861e-01\\n\",\n      \"  1.62522838e-01 -2.74077952e-01  9.70908046e-01  3.16269398e-01\\n\",\n      \" -5.95034599e-01  6.91015005e-01  9.51529503e-01 -7.03967214e-01\\n\",\n      \" -8.39933217e-01  7.91463673e-01 -1.37074366e-01  4.19213355e-01\\n\",\n      \" -3.41576040e-01  8.42101932e-01  2.33200401e-01  5.97429276e-01\\n\",\n      \" -8.65413129e-01 -3.44361335e-01 -5.83049357e-01  4.65510070e-01\\n\",\n      \" -1.86100230e-01 -6.89699054e-01 -3.68169695e-01  5.61690569e-01\\n\",\n      \"  1.17335021e-01  6.12698376e-01 -2.44306251e-01  7.21290469e-01\\n\",\n      \" -9.62048054e-01 -9.49831903e-01 -7.12814510e-01  2.91243792e-01\\n\",\n      \" -9.86161709e-01  5.05021393e-01  1.42423317e-01  5.08802593e-01\\n\",\n      \" -3.01911443e-01 -1.23704679e-01 -9.55899835e-01  4.82549012e-01\\n\",\n      \"  6.07642196e-02  7.73899198e-01 -5.64008772e-01 -7.37863898e-01\\n\",\n      \" -1.07733138e-01 -9.22845125e-01  9.08392072e-02 -1.45039484e-01\\n\",\n      \"  4.33436275e-01 -1.22899801e-01 -8.57792377e-01  2.10649326e-01\\n\",\n      \"  5.75548708e-01  3.30001593e-01  4.65644717e-01  9.37779844e-01\\n\",\n      \"  9.98240054e-01  9.68057632e-01  8.20330799e-01  2.19797492e-01\\n\",\n      \" -9.82231200e-01 -1.24674484e-01  9.77800369e-01 -6.00667715e-01\\n\",\n      \" -9.99817908e-01 -9.13691044e-01 -5.29718995e-01  2.00410217e-01\\n\",\n      \" -9.99987125e-01 -2.29984701e-01  9.76074189e-02 -7.38466859e-01\\n\",\n      \" -2.21821181e-02  9.48592246e-01  8.66617620e-01 -9.99952793e-01\\n\",\n      \"  1.94457278e-01  8.84555161e-01 -6.65743113e-01  5.52103221e-02\\n\",\n      \" -3.64303052e-01  9.67083454e-01  5.07346332e-01  6.06739342e-01\\n\",\n      \" -3.99024002e-02  3.66331011e-01 -6.43628657e-01 -6.30395293e-01\\n\",\n      \" -3.07651833e-02 -5.71051121e-01  8.84538949e-01  1.20282300e-01\\n\",\n      \" -5.38344979e-01 -8.32620263e-01  4.87318933e-01 -2.12279305e-01\\n\",\n      \"  3.44758391e-01 -9.51757252e-01 -9.89525095e-02  7.20545277e-02\\n\",\n      \"  5.61325371e-01  1.49524227e-01 -7.63539076e-02 -3.95724148e-01\\n\",\n      \"  6.69770613e-02  1.54408976e-01  1.98911846e-01  6.42251253e-01\\n\",\n      \" -6.34914577e-01 -2.40154058e-01  5.02099752e-01 -4.31837559e-01\\n\",\n      \"  6.93090353e-03 -9.71793175e-01  9.34785664e-01 -4.30152826e-02\\n\",\n      \" -3.31673473e-01  9.99972880e-01  2.36150980e-01 -7.16750324e-01\\n\",\n      \"  2.30471417e-01  1.08951956e-01 -7.49580443e-01  9.99923050e-01\\n\",\n      \"  1.80747479e-01 -9.70346451e-01 -4.98750210e-01  1.10859834e-02\\n\",\n      \" -3.28933179e-01 -6.00282550e-01  9.42904294e-01 -3.86454463e-02\\n\",\n      \"  1.17722236e-01 -4.44166392e-01  9.81641889e-01 -9.83789444e-01\\n\",\n      \"  8.66157413e-01 -5.36971211e-01 -9.58775699e-01  8.97572100e-01\\n\",\n      \"  9.39799368e-01 -6.77313149e-01  1.12242155e-01  3.02283894e-02\\n\",\n      \"  5.33015206e-02  1.17180012e-01 -7.33501196e-01  4.54784691e-01\\n\",\n      \"  6.61437333e-01 -9.11309123e-02  8.76886487e-01 -1.14977278e-01\\n\",\n      \" -5.79825401e-01 -1.86798289e-01 -2.06969395e-01  5.52134931e-01\\n\",\n      \"  6.48525834e-01  1.86487138e-01 -1.23227246e-01 -1.17850266e-01\\n\",\n      \" -9.67185870e-02 -8.35179389e-01 -8.96809399e-01  6.80714130e-01\\n\",\n      \"  9.99968231e-01  9.64235067e-02  6.62416458e-01  3.51625174e-01\\n\",\n      \"  1.36445567e-03  2.02326421e-02  1.77731991e-01  3.27429146e-01\\n\",\n      \"  3.26343887e-02 -1.91776007e-01  4.01694953e-01 -8.75952363e-01\\n\",\n      \" -9.85216916e-01  7.17136025e-01  1.40597507e-01 -1.22481257e-01\\n\",\n      \"  9.93934870e-01  2.68285513e-01 -2.14082897e-01 -3.94734740e-02\\n\",\n      \"  2.34138295e-01  4.18490544e-02  1.53384566e-01 -2.75834113e-01\\n\",\n      \"  9.43155348e-01 -1.23246826e-01  5.87794423e-01  6.07589424e-01\\n\",\n      \"  2.30061203e-01 -5.18435419e-01 -3.63748938e-01 -5.50540388e-02\\n\",\n      \" -9.21173453e-01 -1.78191528e-01 -9.14138138e-01  9.49922621e-01\\n\",\n      \" -4.73696887e-01  1.22101106e-01  1.01273373e-01  5.86193085e-01\\n\",\n      \"  9.99960899e-01 -7.72973001e-01  6.39182568e-01 -1.65028721e-02\\n\",\n      \"  8.58873606e-01 -9.69030261e-01 -6.56886160e-01 -4.25135881e-01\\n\",\n      \"  1.85572311e-01  2.89826870e-01 -6.46679550e-02  1.56500235e-01\\n\",\n      \" -8.90223265e-01 -3.93299162e-01  1.08385630e-01 -8.79534364e-01\\n\",\n      \" -9.75355566e-01  1.58991352e-01  6.05597854e-01  1.20888151e-01\\n\",\n      \" -8.82865548e-01 -4.42339748e-01 -4.58085924e-01  1.56696096e-01\\n\",\n      \" -1.68813601e-01 -9.18732047e-01  5.80247581e-01 -3.09122860e-01\\n\",\n      \"  2.12144047e-01 -2.03534871e-01  5.67118585e-01  7.53136873e-02\\n\",\n      \"  7.20383346e-01 -2.53689378e-01 -4.30007577e-01 -1.85849831e-01\\n\",\n      \" -7.00501502e-01  7.67153025e-01 -6.02951407e-01 -3.14460278e-01\\n\",\n      \" -2.96945479e-02  9.99970555e-01 -3.17008764e-01  5.61168790e-01\\n\",\n      \"  5.06368399e-01  7.07565308e-01 -2.92320810e-02  2.39395663e-01\\n\",\n      \"  3.93467486e-01  2.46238425e-01  2.89643347e-01  1.31072745e-01\\n\",\n      \" -2.55250186e-01 -1.28223553e-01  5.59136808e-01  6.69703603e-01\\n\",\n      \" -4.91230711e-02  7.84098208e-01 -1.67220399e-01  1.15600668e-01\\n\",\n      \"  1.62588030e-01  1.94819525e-01  8.91793966e-01 -1.23181760e-01\\n\",\n      \" -2.14313745e-01 -1.52940795e-01 -2.15952396e-01 -2.76730835e-01\\n\",\n      \" -3.68270665e-01  9.99846220e-01  9.14686546e-02  2.90558368e-01\\n\",\n      \" -9.79540884e-01 -4.02055115e-01 -4.91288841e-01  9.97451246e-01\\n\",\n      \"  8.43795240e-01 -1.48530632e-01  3.77714396e-01  1.83181688e-01\\n\",\n      \" -2.64594313e-02  4.79741544e-01 -5.41166356e-03  4.37006261e-03\\n\",\n      \" -2.43297848e-03  9.80723873e-02  9.38587427e-01 -4.52343583e-01\\n\",\n      \" -9.74259734e-01 -6.58348322e-01  2.58153658e-02 -9.39729035e-01\\n\",\n      \"  9.80549276e-01 -1.96101218e-01 -5.18931895e-02 -1.71751007e-02\\n\",\n      \" -8.79152864e-02  4.14739043e-01  5.47859445e-02 -9.65056896e-01\\n\",\n      \"  1.04558483e-01  1.06062792e-01  9.64227557e-01 -3.39010209e-02\\n\",\n      \" -6.20462656e-01 -9.43826437e-01 -2.52888769e-01  5.94085097e-01\\n\",\n      \" -6.76936656e-02 -8.19332540e-01  9.56893861e-01 -9.35577273e-01\\n\",\n      \"  3.62383097e-01  9.99376357e-01  2.26340652e-01 -6.68098807e-01\\n\",\n      \"  6.07851427e-03 -3.50878119e-01  1.83013320e-01 -1.55687496e-01\\n\",\n      \"  5.90323150e-01 -9.35633540e-01 -3.57800782e-01 -1.01766042e-01\\n\",\n      \"  1.14137232e-01 -1.28365502e-01 -1.99995205e-01  4.04254109e-01\\n\",\n      \"  8.27645883e-02 -5.84692597e-01 -2.92294472e-01  4.95370431e-03\\n\",\n      \"  3.89271051e-01  6.69233680e-01 -1.76408023e-01 -1.28644943e-01\\n\",\n      \"  5.83405569e-02 -9.97789875e-02 -9.16350901e-01 -2.55089194e-01\\n\",\n      \" -2.50243396e-01 -9.90482867e-01  5.42046785e-01 -9.99969125e-01\\n\",\n      \"  1.99364290e-01 -6.27459228e-01 -3.14289927e-01  8.83848667e-01\\n\",\n      \"  6.07934117e-01  4.40531135e-01 -6.67558134e-01  2.42158934e-01\\n\",\n      \"  8.53662610e-01  5.48789859e-01 -2.74479300e-01  5.05267262e-01\\n\",\n      \" -6.25422180e-01  1.37953520e-01 -1.28331512e-01  1.93576068e-01\\n\",\n      \"  7.69957006e-02  3.88148278e-01 -2.49758705e-01  9.99982476e-01\\n\",\n      \"  1.17298804e-01 -6.52236521e-01 -7.97644317e-01  7.60384873e-02\\n\",\n      \" -1.91071138e-01  9.99392867e-01 -6.30147219e-01 -9.59475875e-01\\n\",\n      \"  2.42252082e-01 -6.08055294e-01 -8.41268301e-01  2.97548950e-01\\n\",\n      \"  2.62366086e-01 -5.31587303e-01 -6.04243040e-01  9.15102124e-01\\n\",\n      \"  7.98154771e-01 -6.37118876e-01  7.89745927e-01 -2.27564409e-01\\n\",\n      \" -4.59584385e-01  8.46059818e-04  6.42944351e-02  9.70409095e-01\\n\",\n      \"  5.48211753e-01  7.73996472e-01 -2.03097641e-01 -6.14989102e-01\\n\",\n      \"  9.66643095e-01  2.89150745e-01  1.84731692e-01 -1.97842211e-01\\n\",\n      \"  9.99799073e-01  3.20680529e-01 -8.80194962e-01 -7.72371590e-02\\n\",\n      \" -9.09011543e-01 -1.98125198e-01 -8.84180903e-01  8.17148089e-02\\n\",\n      \"  2.26351470e-01  9.20415580e-01 -1.03479266e-01  9.33674216e-01\\n\",\n      \" -2.87304580e-01 -2.40752520e-03 -2.34143049e-01  4.72999781e-01\\n\",\n      \"  3.08846265e-01 -9.09434378e-01 -9.76023614e-01 -9.79994416e-01\\n\",\n      \"  1.58407822e-01 -1.46016181e-01 -1.33959278e-01  1.15776278e-01\\n\",\n      \" -4.05044630e-02 -1.61096469e-01 -9.26388875e-02 -9.99804139e-01\\n\",\n      \"  9.12760854e-01  3.05970848e-01 -1.89190030e-01  9.46398735e-01\\n\",\n      \"  3.25214028e-01  5.22969782e-01  1.33965105e-01 -9.65115786e-01\\n\",\n      \" -8.72572541e-01 -1.58247799e-01 -1.40467674e-01  6.40147448e-01\\n\",\n      \"  3.15005809e-01  8.44109178e-01 -7.63198659e-02 -3.51275116e-01\\n\",\n      \" -5.60550869e-01 -6.58248484e-01 -8.20772350e-01 -9.80284035e-01\\n\",\n      \"  2.94667512e-01  5.99301040e-01 -7.72279859e-01  9.23164725e-01\\n\",\n      \" -6.51449859e-01 -1.77346095e-01  5.66000819e-01 -2.65734702e-01\\n\",\n      \"  3.61909896e-01  3.21929604e-01  1.07993722e-01 -2.65614409e-02\\n\",\n      \"  6.11993313e-01  8.29534948e-01  8.03346157e-01  9.73720789e-01\\n\",\n      \"  6.54435307e-02  4.58745241e-01  4.39331889e-01  3.48565638e-01\\n\",\n      \"  9.15383101e-01 -8.50885570e-01  8.69044736e-02  5.56581616e-01\\n\",\n      \" -4.81716871e-01  2.40704149e-01 -2.17731923e-01 -6.04605138e-01\\n\",\n      \"  4.19061750e-01 -3.52084994e-01  2.90052563e-01 -2.77674407e-01\\n\",\n      \"  8.33056569e-02 -1.66522965e-01 -3.54407400e-01 -3.20105851e-01\\n\",\n      \" -3.06851268e-01  6.55826509e-01  5.14403284e-01  9.08911705e-01\\n\",\n      \"  6.08110785e-01  5.78991361e-02 -5.32887876e-01  9.71290991e-02\\n\",\n      \"  2.58820146e-01 -8.92317355e-01  5.07979870e-01  1.12613374e-02\\n\",\n      \"  5.62671065e-01  6.52322888e-01  2.92660873e-02  8.61185431e-01\\n\",\n      \" -2.68088043e-01 -1.59904942e-01 -6.98840916e-02 -4.55157697e-01\\n\",\n      \"  4.82234299e-01 -6.43897057e-01 -4.16591495e-01 -4.60731089e-01\\n\",\n      \"  4.86354046e-02  1.95800930e-01  9.90741372e-01 -3.55561614e-01\\n\",\n      \"  2.82314390e-01 -4.02741760e-01 -2.11525574e-01  1.21593408e-01\\n\",\n      \" -3.88887376e-01 -9.99871790e-01  1.16095670e-01  4.54431295e-01\\n\",\n      \"  1.96306035e-02 -4.83297318e-01  5.91171026e-01  1.77768096e-01\\n\",\n      \" -9.25477743e-01 -2.74028271e-01  6.13578856e-01  1.97269052e-01\\n\",\n      \" -2.72115350e-01 -1.01401471e-01  5.67236960e-01  8.62587094e-01\\n\",\n      \"  3.66609961e-01  7.12623894e-01 -3.17700714e-01  5.23258626e-01\\n\",\n      \"  6.46758616e-01 -5.85283220e-01 -4.96297508e-01  8.79601717e-01]\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"np_vector = vector.detach().numpy()\\n\",\n    \"\\n\",\n    \"# make it one-dimensional\\n\",\n    \"np_vector = np_vector.squeeze()\\n\",\n    \"\\n\",\n    \"print(type(np_vector), np_vector)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Let's make it a nice function\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 10,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"def make_vector(text: str) -> np.ndarray:\\n\",\n    \"    tokens = get_tokens(text, tokenizer, config)\\n\",\n    \"    token_ids: List[int] = tokenizer.convert_tokens_to_ids(tokens)\\n\",\n    \"    token_ids_tensor = torch.tensor(token_ids)\\n\",\n    \"    token_ids_tensor = torch.unsqueeze(token_ids_tensor, 0)\\n\",\n    \"    last_hidden_state, pooler_output = model(token_ids_tensor)\\n\",\n    \"    vector = pooler_output\\n\",\n    \"    #vector = last_hidden_state.mean(dim=1)  # Can do this too\\n\",\n    \"    np_vector = vector.detach().numpy()\\n\",\n    \"    np_vector = np_vector.squeeze()\\n\",\n    \"    return np_vector\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# This uses the transformer model and takes the sequence of words into account\\n\",\n    \"\\n\",\n    \"* The transformer model is graph neural network with a lot of layers. One way it is trained is that for each token position, it looks around at all of the neighboring tokens to decide what that token should be. \\n\",\n    \"  * Great explanation of transformers http://nlp.seas.harvard.edu/2018/04/03/attention.html\\n\",\n    \"  * Bert builds on transformers https://arxiv.org/pdf/1810.04805.pdf\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Using word order is the hard way\\n\",\n    \"* The easy way is to learn a vector for each word and then make the vector for the sentence the average of the word vectors.\\n\",\n    \"* Let's try that with spaCy.\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Install spaCy\\n\",\n    \"\\n\",\n    \"`pip install -U spacy`\\n\",\n    \"\\n\",\n    \"The large model has good word vectors.\\n\",\n    \"\\n\",\n    \"`python -m spacy download en_vectors_web_lg`\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 11,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"dog [-5.71195185e-02  5.26851341e-02  3.02558858e-03 -4.85166162e-02\\n\",\n      \"  7.04297796e-03  4.18558009e-02 -2.47040205e-02 -3.97829153e-02\\n\",\n      \"  9.61403828e-03  3.08416426e-01 -8.91298205e-02  4.13809419e-02\\n\",\n      \" -9.56399292e-02  3.31533775e-02 -4.87142392e-02  2.60333400e-02\\n\",\n      \"  7.14079365e-02  1.51968971e-01  2.08966229e-02 -6.43049553e-02\\n\",\n      \" -5.94667979e-02 -2.27007996e-02  3.80284972e-02 -6.94757923e-02\\n\",\n      \"  5.18392026e-02 -6.17074501e-03 -3.47954780e-02 -5.93601651e-02\\n\",\n      \"  1.26659293e-02 -3.63281034e-02 -7.91833773e-02  1.74062699e-02\\n\",\n      \" -1.18751619e-02  7.83303455e-02  5.17652743e-02  2.18392313e-02\\n\",\n      \"  7.92445242e-02 -1.28953964e-01 -6.98042149e-03  5.48504330e-02\\n\",\n      \"  5.40258288e-02  2.05084905e-02 -3.87009755e-02 -5.26268445e-02\\n\",\n      \" -1.83460359e-02 -2.14468315e-02 -5.41338809e-02  7.04937521e-03\\n\",\n      \"  1.81341972e-02 -1.17702372e-02  2.03862209e-02  4.62589078e-02\\n\",\n      \"  3.87080871e-02  6.20330237e-02 -4.51670177e-02  1.12892650e-01\\n\",\n      \"  3.77171375e-02  1.44092571e-02 -4.73138280e-02  6.13008291e-02\\n\",\n      \"  2.37244479e-02  1.52537664e-02  1.27128465e-02  4.07113060e-02\\n\",\n      \"  5.70356324e-02 -5.57631850e-02  6.42864779e-02  1.92232449e-02\\n\",\n      \" -4.10567857e-02 -3.24425101e-03 -4.97250892e-02 -3.26941572e-02\\n\",\n      \"  2.87531149e-02 -3.01080253e-02  3.86483744e-02  1.30377114e-02\\n\",\n      \" -2.93019041e-02 -9.34902802e-02  2.69404072e-02 -3.80398706e-02\\n\",\n      \"  1.31707862e-02  6.15837574e-02 -6.94772154e-02 -5.44651411e-02\\n\",\n      \" -3.11501548e-02 -6.28164038e-02  1.39392331e-01  9.58574563e-02\\n\",\n      \"  1.19429782e-01 -2.58314554e-02  2.47168168e-02  5.94966561e-02\\n\",\n      \"  2.28870474e-02 -1.49139725e-02 -5.96629940e-02 -5.06989732e-02\\n\",\n      \" -2.39377059e-02 -9.02202949e-02  5.46258017e-02 -4.98217680e-02\\n\",\n      \"  2.48604119e-02  7.61024877e-02  2.86379531e-02  5.38509572e-03\\n\",\n      \"  6.69707060e-02 -6.30453005e-02  2.39419732e-02 -2.37216037e-02\\n\",\n      \" -3.41528542e-02 -1.43267959e-02  4.31268290e-02  6.07506223e-02\\n\",\n      \"  4.80588190e-02 -6.18183464e-02  1.61267109e-02  8.80876929e-03\\n\",\n      \"  8.78744386e-03 -1.99142061e-02  1.16607649e-02 -5.56323864e-03\\n\",\n      \"  7.31367571e-03  4.08392623e-02  8.24960247e-02 -8.19500759e-02\\n\",\n      \" -4.92658690e-02  1.44049916e-02  2.05625147e-02  1.64480216e-03\\n\",\n      \" -4.79138009e-02 -2.50025857e-02 -5.07899635e-02 -3.04577723e-02\\n\",\n      \"  1.62489782e-03  6.77384362e-02 -5.32623567e-03 -4.19240445e-02\\n\",\n      \" -2.48305555e-02  4.30145115e-02  8.57546255e-02 -9.49575007e-03\\n\",\n      \" -3.84578586e-01 -9.99591574e-02  5.76484017e-02  8.93900022e-02\\n\",\n      \"  8.96828771e-02 -7.75028989e-02 -1.36757852e-03  3.77228223e-02\\n\",\n      \"  3.32557410e-02 -7.37680029e-03 -9.34916956e-04  2.64058332e-03\\n\",\n      \" -6.49632215e-02 -1.00020291e-02 -4.35348675e-02 -1.99298444e-03\\n\",\n      \" -2.90147141e-02  5.27462699e-02 -4.59987298e-02 -1.20343953e-01\\n\",\n      \"  3.85175757e-02 -1.70053411e-02 -1.35883493e-02 -8.59636292e-02\\n\",\n      \"  6.02942472e-03  3.50542329e-02  5.46584977e-03 -3.62072582e-03\\n\",\n      \" -1.32090310e-02 -3.03625148e-02  5.13529740e-02  2.71735713e-03\\n\",\n      \"  8.92009027e-03 -1.86005253e-02 -2.15335574e-04  8.27988461e-02\\n\",\n      \" -2.69503575e-02  1.11044407e-01  1.48954894e-03  1.55366912e-01\\n\",\n      \"  1.44163659e-02 -5.15349545e-02 -1.70067623e-02 -4.89957370e-02\\n\",\n      \" -7.91961774e-02  3.66764292e-02  4.74233031e-02  4.71929833e-02\\n\",\n      \" -4.44973782e-02 -1.07407607e-01 -1.07042231e-01 -1.32323466e-02\\n\",\n      \" -1.58850159e-02 -8.13955963e-02  2.36562043e-02  9.03923213e-02\\n\",\n      \"  3.41301076e-02 -4.15302217e-02  1.28214672e-01  1.76650248e-02\\n\",\n      \" -8.21064636e-02  6.82232482e-03 -6.07762150e-02  3.47556695e-02\\n\",\n      \"  6.71512587e-03  5.07473126e-02  6.28988594e-02 -3.27780396e-02\\n\",\n      \"  9.38869342e-02 -1.05184026e-03 -5.38225211e-02  3.23572084e-02\\n\",\n      \" -5.28002940e-02  4.41518985e-02 -1.02514010e-02 -3.48182246e-02\\n\",\n      \" -5.65294968e-03  7.62759373e-02 -5.89706115e-02  2.35481523e-02\\n\",\n      \"  4.79223318e-02  1.55253168e-02  5.29154539e-02 -7.92288780e-02\\n\",\n      \" -1.10980429e-01  2.02611070e-02 -5.09378277e-02  5.91980889e-02\\n\",\n      \"  3.04904711e-02  2.61740927e-02 -6.78223222e-02 -3.12852184e-03\\n\",\n      \" -3.36012244e-02 -3.24723683e-02  4.93653901e-02  3.36481407e-02\\n\",\n      \"  1.05562201e-02 -1.25703886e-02  4.06871364e-02 -6.67389631e-02\\n\",\n      \" -6.24339506e-02 -3.76389399e-02 -4.36329655e-02 -2.16956362e-02\\n\",\n      \" -1.20662432e-02  4.03914154e-02 -2.62750350e-02 -3.14515643e-02\\n\",\n      \" -1.58793293e-02 -3.58859473e-03  6.53541926e-03  5.02482848e-03\\n\",\n      \"  3.19420621e-02  7.32988268e-02 -9.26073772e-05  1.41546251e-02\\n\",\n      \" -2.02099252e-02  2.86280029e-02  4.02833670e-02 -4.09060828e-02\\n\",\n      \"  5.36931399e-03 -5.34685105e-02 -1.66072566e-02 -9.52844992e-02\\n\",\n      \" -6.57764450e-03  5.51404655e-02 -4.59148455e-03 -7.71872653e-03\\n\",\n      \" -6.45238981e-02  2.77977102e-02 -4.18984517e-02  1.20860048e-01\\n\",\n      \"  1.47078205e-02  1.37922252e-02  1.61210243e-02  5.61612695e-02\\n\",\n      \"  8.39433447e-03  3.12468316e-02  2.67925449e-02 -2.25927494e-02\\n\",\n      \" -1.46452645e-02  4.71503325e-02  8.74038413e-03 -4.24358696e-02\\n\",\n      \"  6.32813126e-02  6.72891736e-02  3.74086201e-02 -2.62949392e-02\\n\",\n      \"  2.08312236e-02 -4.47987858e-03  3.25690443e-03 -3.68641019e-02\\n\",\n      \" -4.38775048e-02  2.49442935e-04 -2.69588884e-02  7.78952986e-02\\n\",\n      \"  4.43495214e-02  3.51068377e-02  4.25510295e-02 -1.06432298e-02]\\n\",\n      \"cat [-0.02255263 -0.00366243 -0.03497775 -0.03499272 -0.02751459  0.04896256\\n\",\n      \" -0.03305583 -0.04307406  0.01909796  0.17446963 -0.09604063 -0.01473697\\n\",\n      \" -0.09339724  0.00156134 -0.03839799  0.04759746  0.00565485  0.17818175\\n\",\n      \" -0.02651471 -0.03884254 -0.04709154  0.00581141 -0.02351957 -0.02018316\\n\",\n      \"  0.05528664 -0.04574589 -0.06079944 -0.05832369  0.05517288  0.00209001\\n\",\n      \" -0.10320591  0.00060861 -0.02046156  0.04874253  0.03695355 -0.02097198\\n\",\n      \"  0.08066227 -0.1204059  -0.02659854 -0.01934194  0.0244027   0.0223281\\n\",\n      \" -0.01024261 -0.05077522  0.02768373 -0.01235537 -0.070189    0.05924574\\n\",\n      \" -0.02056934 -0.05258637  0.03326389 -0.02155424 -0.00722771  0.05057764\\n\",\n      \" -0.04777259  0.03072378  0.01476226 -0.03573963  0.00678629  0.06577188\\n\",\n      \"  0.0045481  -0.00206876 -0.01396131 -0.02720924  0.02909524 -0.05660983\\n\",\n      \"  0.10499312  0.02430241  0.00088479  0.00372679 -0.02037625 -0.0171012\\n\",\n      \" -0.0472966  -0.02126835  0.00422014  0.08111281 -0.06348474 -0.08965967\\n\",\n      \"  0.03738464 -0.0404187   0.02239845  0.04383744 -0.04682211  0.02476194\\n\",\n      \" -0.03150063 -0.06597994  0.18222317  0.0766912   0.0841349   0.0211516\\n\",\n      \"  0.0138477   0.10686714 -0.00315096 -0.05044891 -0.03034808 -0.05415654\\n\",\n      \"  0.03301242 -0.03841595  0.04254718 -0.02539808  0.00868591  0.0915786\\n\",\n      \"  0.04726367 -0.01185259  0.05319408 -0.0766912   0.06339043 -0.04495407\\n\",\n      \" -0.0334929   0.02278613 -0.00722846  0.03522323  0.06961273 -0.10115378\\n\",\n      \" -0.04925295  0.01264216 -0.03311421 -0.00678555  0.051585   -0.02177877\\n\",\n      \" -0.02701316 -0.02677367  0.14501068 -0.15010136 -0.07086407  0.04272231\\n\",\n      \"  0.08439385 -0.04971097 -0.05729089 -0.04114765 -0.03435956 -0.0363204\\n\",\n      \" -0.05641375  0.03715413  0.05529412  0.02192995 -0.05667569  0.04660207\\n\",\n      \" -0.0425831   0.0553046  -0.42171478 -0.05735675 -0.00334884  0.08438487\\n\",\n      \"  0.06006899 -0.06306263 -0.01693056 -0.02592048  0.02112017 -0.01974908\\n\",\n      \"  0.02768224  0.01462276 -0.01457022 -0.03590428  0.02489366 -0.04274327\\n\",\n      \"  0.00057858  0.07976867 -0.04844766 -0.05799289  0.04043068 -0.05116289\\n\",\n      \" -0.04146498 -0.10070472 -0.01612228 -0.00930859 -0.03709576 -0.01061008\\n\",\n      \" -0.0312806   0.00934077  0.00334869  0.0200694   0.01953354 -0.0292569\\n\",\n      \" -0.07012464  0.11634952 -0.00658273  0.0572834  -0.03498973  0.15652274\\n\",\n      \" -0.02151084 -0.05336173 -0.0120813  -0.04647185 -0.08654927 -0.04201132\\n\",\n      \" -0.01042956  0.01031745 -0.02428894 -0.09569785 -0.09302603  0.01679734\\n\",\n      \" -0.02539958 -0.0817819   0.07433371  0.06969954  0.01321604 -0.0725899\\n\",\n      \"  0.10367442 -0.01032463 -0.08039284  0.0311369  -0.06434391 -0.01784362\\n\",\n      \"  0.0175727  -0.0276059   0.06555634 -0.01850073  0.05399039 -0.0293497\\n\",\n      \" -0.05293662  0.02815224 -0.07575419  0.02163657 -0.00364746 -0.01612377\\n\",\n      \" -0.00172135  0.0877647  -0.00815185  0.00114487 -0.00842666  0.0407031\\n\",\n      \"  0.03457061 -0.04385091 -0.03641021  0.01544272 -0.01498918  0.10610975\\n\",\n      \"  0.02604771 -0.00056144 -0.06930887  0.01767149 -0.02463321 -0.05779082\\n\",\n      \"  0.02173985  0.01468712 -0.01848875 -0.01567173  0.05844643 -0.04584768\\n\",\n      \" -0.09785478 -0.00066231 -0.00507064  0.00555531 -0.04112071  0.00079552\\n\",\n      \"  0.04600784  0.01875219 -0.02922845 -0.0246392   0.01309989 -0.00764981\\n\",\n      \" -0.02443263  0.07798446  0.01619861 -0.00903767 -0.10737457 -0.00962861\\n\",\n      \"  0.0554468  -0.06145056 -0.04083332 -0.04522949  0.00236064 -0.06444719\\n\",\n      \"  0.05335723  0.02572739 -0.08172352 -0.03224305 -0.00671909 -0.01586183\\n\",\n      \" -0.08141368  0.08069071  0.01061816  0.01464476  0.01465509  0.02665093\\n\",\n      \"  0.02843215  0.07478425 -0.02773462  0.00766882  0.00292988  0.03712868\\n\",\n      \"  0.0470601  -0.04386289  0.08118017  0.06985971  0.03894284 -0.06691545\\n\",\n      \"  0.04234062 -0.00499115 -0.04966607 -0.01631836 -0.00349119  0.03152308\\n\",\n      \" -0.04435534  0.12200002  0.00576636  0.06885982  0.02572589 -0.0446113 ]\\n\",\n      \"banana [ 2.0228e-01 -7.6618e-02  3.7032e-01  3.2845e-02 -4.1957e-01  7.2069e-02\\n\",\n      \" -3.7476e-01  5.7460e-02 -1.2401e-02  5.2949e-01 -5.2380e-01 -1.9771e-01\\n\",\n      \" -3.4147e-01  5.3317e-01 -2.5331e-02  1.7380e-01  1.6772e-01  8.3984e-01\\n\",\n      \"  5.5107e-02  1.0547e-01  3.7872e-01  2.4275e-01  1.4745e-02  5.5951e-01\\n\",\n      \"  1.2521e-01 -6.7596e-01  3.5842e-01 -4.0028e-02  9.5949e-02 -5.0690e-01\\n\",\n      \" -8.5318e-02  1.7980e-01  3.3867e-01  1.3230e-01  3.1021e-01  2.1878e-01\\n\",\n      \"  1.6853e-01  1.9874e-01 -5.7385e-01 -1.0649e-01  2.6669e-01  1.2838e-01\\n\",\n      \" -1.2803e-01 -1.3284e-01  1.2657e-01  8.6723e-01  9.6721e-02  4.8306e-01\\n\",\n      \"  2.1271e-01 -5.4990e-02 -8.2425e-02  2.2408e-01  2.3975e-01 -6.2260e-02\\n\",\n      \"  6.2194e-01 -5.9900e-01  4.3201e-01  2.8143e-01  3.3842e-02 -4.8815e-01\\n\",\n      \" -2.1359e-01  2.7401e-01  2.4095e-01  4.5950e-01 -1.8605e-01 -1.0497e+00\\n\",\n      \" -9.7305e-02 -1.8908e-01 -7.0929e-01  4.0195e-01 -1.8768e-01  5.1687e-01\\n\",\n      \"  1.2520e-01  8.4150e-01  1.2097e-01  8.8239e-02 -2.9196e-02  1.2151e-03\\n\",\n      \"  5.6825e-02 -2.7421e-01  2.5564e-01  6.9793e-02 -2.2258e-01 -3.6006e-01\\n\",\n      \" -2.2402e-01 -5.3699e-02  1.2022e+00  5.4535e-01 -5.7998e-01  1.0905e-01\\n\",\n      \"  4.2167e-01  2.0662e-01  1.2936e-01 -4.1457e-02 -6.6777e-01  4.0467e-01\\n\",\n      \" -1.5218e-02 -2.7640e-01 -1.5611e-01 -7.9198e-02  4.0037e-02 -1.2944e-01\\n\",\n      \" -2.4090e-04 -2.6785e-01 -3.8115e-01 -9.7245e-01  3.1726e-01 -4.3951e-01\\n\",\n      \"  4.1934e-01  1.8353e-01 -1.5260e-01 -1.0808e-01 -1.0358e+00  7.6217e-02\\n\",\n      \"  1.6519e-01  2.6526e-04  1.6616e-01 -1.5281e-01  1.8123e-01  7.0274e-01\\n\",\n      \"  5.7956e-03  5.1664e-02 -5.9745e-02 -2.7551e-01 -3.9049e-01  6.1132e-02\\n\",\n      \"  5.5430e-01 -8.7997e-02 -4.1681e-01  3.2826e-01 -5.2549e-01 -4.4288e-01\\n\",\n      \"  8.2183e-03  2.4486e-01 -2.2982e-01 -3.4981e-01  2.6894e-01  3.9166e-01\\n\",\n      \" -4.1904e-01  1.6191e-01 -2.6263e+00  6.4134e-01  3.9743e-01 -1.2868e-01\\n\",\n      \" -3.1946e-01 -2.5633e-01 -1.2220e-01  3.2275e-01 -7.9933e-02 -1.5348e-01\\n\",\n      \"  3.1505e-01  3.0591e-01  2.6012e-01  1.8553e-01 -2.4043e-01  4.2886e-02\\n\",\n      \"  4.0622e-01 -2.4256e-01  6.3870e-01  6.9983e-01 -1.4043e-01  2.5209e-01\\n\",\n      \"  4.8984e-01 -6.1067e-02 -3.6766e-01 -5.5089e-01 -3.8265e-01 -2.0843e-01\\n\",\n      \"  2.2832e-01  5.1218e-01  2.7868e-01  4.7652e-01  4.7951e-02 -3.4008e-01\\n\",\n      \" -3.2873e-01 -4.1967e-01 -7.5499e-02 -3.8954e-01 -2.9622e-02 -3.4070e-01\\n\",\n      \"  2.2170e-01 -6.2856e-02 -5.1903e-01 -3.7774e-01 -4.3477e-03 -5.8301e-01\\n\",\n      \" -8.7546e-02 -2.3929e-01 -2.4711e-01 -2.5887e-01 -2.9894e-01  1.3715e-01\\n\",\n      \"  2.9892e-02  3.6544e-02 -4.9665e-01 -1.8160e-01  5.2939e-01  2.1992e-01\\n\",\n      \" -4.4514e-01  3.7798e-01 -5.7062e-01 -4.6946e-02  8.1806e-02  1.9279e-02\\n\",\n      \"  3.3246e-01 -1.4620e-01  1.7156e-01  3.9981e-01  3.6217e-01  1.2816e-01\\n\",\n      \"  3.1644e-01  3.7569e-01 -7.4690e-02 -4.8480e-02 -3.1401e-01 -1.9286e-01\\n\",\n      \" -3.1294e-01 -1.7553e-02 -1.7514e-01 -2.7587e-02 -1.0000e+00  1.8387e-01\\n\",\n      \"  8.1434e-01 -1.8913e-01  5.0999e-01 -9.1960e-03 -1.9295e-03  2.8189e-01\\n\",\n      \"  2.7247e-02  4.3409e-01 -5.4967e-01 -9.7426e-02 -2.4540e-01 -1.7203e-01\\n\",\n      \" -8.8650e-02 -3.0298e-01 -1.3591e-01 -2.7765e-01  3.1286e-03  2.0556e-01\\n\",\n      \" -1.5772e-01 -5.2308e-01 -6.4701e-01 -3.7014e-01  6.9393e-02  1.1401e-01\\n\",\n      \"  2.7594e-01 -1.3875e-01 -2.7268e-01  6.6891e-01 -5.6454e-02  2.4017e-01\\n\",\n      \" -2.6730e-01  2.9860e-01  1.0083e-01  5.5592e-01  3.2849e-01  7.6858e-02\\n\",\n      \"  1.5528e-01  2.5636e-01 -1.0772e-01 -1.2359e-01  1.1827e-01 -9.9029e-02\\n\",\n      \" -3.4328e-01  1.1502e-01 -3.7808e-01 -3.9012e-02 -3.4593e-01 -1.9404e-01\\n\",\n      \" -3.3580e-01 -6.2334e-02  2.8919e-01  2.8032e-01 -5.3741e-01  6.2794e-01\\n\",\n      \"  5.6955e-02  6.2147e-01 -2.5282e-01  4.1670e-01 -1.0108e-02 -2.5434e-01\\n\",\n      \"  4.0003e-01  4.2432e-01  2.2672e-01  1.7553e-01  2.3049e-01  2.8323e-01\\n\",\n      \"  1.3882e-01  3.1218e-03  1.7057e-01  3.6685e-01  2.5247e-03 -6.4009e-01\\n\",\n      \" -2.9765e-01  7.8943e-01  3.3168e-01 -1.1966e+00 -4.7156e-02  5.3175e-01]\\n\",\n      \"afskfsd [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.\\n\",\n      \" 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"import spacy\\n\",\n    \"nlp = spacy.load(\\\"en_vectors_web_lg\\\")\\n\",\n    \"tokens = nlp(\\\"dog cat banana afskfsd\\\")\\n\",\n    \"for token in tokens:\\n\",\n    \"    print(token, token.vector)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Let's make a function to get the average vector\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 12,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"def get_average_vector_for_text(text: str) -> np.ndarray:\\n\",\n    \"    tokens = nlp(text)\\n\",\n    \"    vectors = []\\n\",\n    \"    for token in tokens:\\n\",\n    \"        vectors.append(token.vector)\\n\",\n    \"    all_vecs = np.array(vectors)\\n\",\n    \"    #print(\\\"shape: \\\", all_vecs.shape)\\n\",\n    \"    vec = np.mean(all_vecs, axis=0)\\n\",\n    \"    return vec\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Let's compare the average vector method with the transfomer method\\n\",\n    \"* We will compare them on the task of finding similar tweets.\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Load Tweets\\n\",\n    \"Can be found at with the code at https://github.com/jmugan/modern_practical_nlp\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 13,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"all_tweets: List[str] = []\\n\",\n    \"with open('jmugan_tweets.txt', 'r') as f:\\n\",\n    \"    for tweet in f:\\n\",\n    \"        tweet = tweet.strip()  # remove newline\\n\",\n    \"        all_tweets.append(tweet)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Generate the Vectors\\n\",\n    \"* Save them after that because it is a bit slow\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 14,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Data directory:  /Users/jmugan/temp\\n\",\n      \"Loading saved transformer vecs.\\n\",\n      \"Generating average vecs.\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"home = str(Path.home())\\n\",\n    \"data_dir = os.path.join(home, 'temp')\\n\",\n    \"print(\\\"Data directory: \\\", data_dir)\\n\",\n    \"\\n\",\n    \"transformer_vec_pickle_file = os.path.join(data_dir, 'transformer_vecs.pkl')\\n\",\n    \"average_vec_pickle_file = os.path.join(data_dir, 'average_vecs.pkl')\\n\",\n    \"\\n\",\n    \"if os.path.isfile(transformer_vec_pickle_file):\\n\",\n    \"    print(\\\"Loading saved transformer vecs.\\\")\\n\",\n    \"    with open(transformer_vec_pickle_file, 'rb') as f:\\n\",\n    \"        all_transformer_vecs = pickle.load(f)\\n\",\n    \"else:\\n\",\n    \"    print(\\\"Generating transformer vecs.\\\")\\n\",\n    \"    all_transformer_vecs: List[np.ndarray] = []\\n\",\n    \"    for tweet in all_tweets:\\n\",\n    \"        vector = make_vector(tweet)\\n\",\n    \"        all_transformer_vecs.append(vector)\\n\",\n    \"    with open(transformer_vec_pickle_file, 'wb') as f:\\n\",\n    \"        pickle.dump(all_transformer_vecs, f)\\n\",\n    \"\\n\",\n    \"if os.path.isfile(average_vec_pickle_file):\\n\",\n    \"    print(\\\"Loading saved average vecs.\\\")\\n\",\n    \"    with open(average_vec_pickle_file, 'rb') as f:\\n\",\n    \"        all_average_vecs = pickle.load(f)\\n\",\n    \"else:\\n\",\n    \"    print(\\\"Generating average vecs.\\\")\\n\",\n    \"    all_average_vecs: List[np.ndarray] = []\\n\",\n    \"    for tweet in all_tweets:\\n\",\n    \"        vector = get_average_vector_for_text(tweet)\\n\",\n    \"        all_average_vecs.append(vector)\\n\",\n    \"    with open(average_vec_pickle_file, 'wb') as f:\\n\",\n    \"        pickle.dump(all_average_vecs, f)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Code to Find Most Similar\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 15,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"def get_most_similar_vector(text_vec: np.ndarray, vectors: List[np.ndarray]\\n\",\n    \"                           ) -> Tuple[float, str]:\\n\",\n    \"    \\\"\\\"\\\"\\n\",\n    \"    This is simple and slow. In reality you want to use something like \\n\",\n    \"    Faiss to find the closest vector\\n\",\n    \"    https://engineering.fb.com/data-infrastructure/faiss-a-library-for-efficient-similarity-search/\\n\",\n    \"    \\\"\\\"\\\"\\n\",\n    \"    closest_index = None\\n\",\n    \"    smallest_distance = 10000\\n\",\n    \"    for i, vector in enumerate(vectors):\\n\",\n    \"        #dist = np.linalg.norm(vector - text_vec)  # fancy people use cosine distance\\n\",\n    \"        dist = scipy.spatial.distance.cosine(vector, text_vec)\\n\",\n    \"        if dist < smallest_distance:\\n\",\n    \"            smallest_distance = dist\\n\",\n    \"            closest_index = i\\n\",\n    \"    return smallest_distance, all_tweets[closest_index]\\n\",\n    \"\\n\",\n    \"\\n\",\n    \"def get_most_similar_tweet_transformer(text: str) -> Tuple[float, str]:\\n\",\n    \"    text_vec = make_vector(text)\\n\",\n    \"    return get_most_similar_vector(text_vec, all_transformer_vecs)\\n\",\n    \"\\n\",\n    \"def get_most_similar_tweet_average(text: str) -> Tuple[float, str]:\\n\",\n    \"    text_vec = get_average_vector_for_text(text)\\n\",\n    \"    return get_most_similar_vector(text_vec, all_average_vecs)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Try it Out\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 16,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"orig:  Cats don't like to wrestle.\\n\",\n      \"Transformer (0.00): Cats don't like to wrestle.\\n\",\n      \"Average (0.00): Cats don't like to wrestle.\\n\",\n      \"\\n\",\n      \"orig:  This transformer vector approach doesn't work well on tweets because it was trained on other data.\\n\",\n      \"Transformer (0.04): Children used to build either glue or snap-on models. Now, Legos are so detailed that kids build with those instead.\\n\",\n      \"Average (0.07): Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\n\",\n      \"\\n\",\n      \"orig:  I like to watch movies.\\n\",\n      \"Transformer (0.03): I just watched 127 Hours with the special lady. Felt kind of bad sitting there with my microwave popcorn and big glass of cold water.\\n\",\n      \"Average (0.10): I like a lot of kids movies, but I just can't get into these Ice Age films.\\n\",\n      \"\\n\",\n      \"orig:  My children like to climb trees, drink water, and read about aardvarks.\\n\",\n      \"Transformer (0.02): It's funny how, in a group, the result of hoarding is more hoarding.\\n\",\n      \"Average (0.11): Amazing how kids practice actions. At age 2, my boy would go up the step, down the step. Repeat. He loved it, drove me nuts.\\n\",\n      \"\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"orig = \\\"Cats don't like to wrestle.\\\"\\n\",\n    \"tweet_1 = (\\\"This transformer vector approach doesn't work well on tweets because\\\" +\\n\",\n    \"          \\\" it was trained on other data.\\\")\\n\",\n    \"tweet_2 = \\\"I like to watch movies.\\\"  \\n\",\n    \"tweet_3 = \\\"My children like to climb trees, drink water, and read about aardvarks.\\\"\\n\",\n    \"\\n\",\n    \"new_tweets = [orig, tweet_1, tweet_2, tweet_3]\\n\",\n    \"\\n\",\n    \"for tweet in new_tweets:\\n\",\n    \"    print(\\\"orig: \\\",tweet)\\n\",\n    \"    dist, closest = get_most_similar_tweet_transformer(tweet)\\n\",\n    \"    print(f\\\"Transformer ({dist:.2f}): {closest}\\\")\\n\",\n    \"    dist, closest = get_most_similar_tweet_average(tweet)\\n\",\n    \"    print(f\\\"Average ({dist:.2f}): {closest}\\\")\\n\",\n    \"    print()\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Tweets are Weird\\n\",\n    \"* Bert would work better if we used it for data other than tweets. Tweets are weird.\\n\",\n    \"* You can fine-tune Bert on your data for finding similar documents, but it is a little more involved. Here's a place to get you started. https://colab.research.google.com/github/huggingface/blog/blob/master/notebooks/01_how_to_train.ipynb\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Conclusion\\n\",\n    \"* We have seen that we can convert natural language into vectors, which is a representation amenable to computation and automation.\\n\",\n    \"* In the next video, we'll look at fine-tuning these vectors for classification so that we can put documents into buckets.\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": null,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": []\n  }\n ],\n \"metadata\": {\n  \"kernelspec\": {\n   \"display_name\": \"Python 3.7.4 64-bit ('base': conda)\",\n   \"language\": \"python\",\n   \"name\": \"python37464bitbaseconda6a86cbe610af4db3860115ffdb24f1cc\"\n  },\n  \"language_info\": {\n   \"codemirror_mode\": {\n    \"name\": \"ipython\",\n    \"version\": 3\n   },\n   \"file_extension\": \".py\",\n   \"mimetype\": \"text/x-python\",\n   \"name\": \"python\",\n   \"nbconvert_exporter\": \"python\",\n   \"pygments_lexer\": \"ipython3\",\n   \"version\": \"3.7.4\"\n  }\n },\n \"nbformat\": 4,\n \"nbformat_minor\": 2\n}\n"
  },
  {
    "path": "Episode_2_Classifying_with_Vectors.ipynb",
    "content": "{\n \"cells\": [\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"## Classifying Text with Vectors\\n\",\n    \"\\n\",\n    \"* Last episode we converted text to vectors and used those vectors to find similar documents. \\n\",\n    \"* This episode we are going to use those vectors for classification.\\n\",\n    \"* We are also going to use machine learning to make the vectors align with our classification goal.\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 1,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"from typing import List, Tuple\\n\",\n    \"import os.path\\n\",\n    \"from pathlib import Path\\n\",\n    \"import random\\n\",\n    \"\\n\",\n    \"import torch\\n\",\n    \"import torch.nn.functional as F\\n\",\n    \"from transformers import BertModel, BertTokenizer, BertConfig\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Install TensorBoard\\n\",\n    \"\\n\",\n    \"We are going to use it to graph our results.\\n\",\n    \"\\n\",\n    \"`pip install tensorboard`\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 3,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"from torch.utils.tensorboard import SummaryWriter\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Let's get the data\\n\",\n    \"\\n\",\n    \"* We are going to take my tweets and classify whether they are about movies or not.\\n\",\n    \"* Since most tweets aren't about movies, we have to down sample. Imbalanced classes are a whole topic that we can cover another time.\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 4,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Data directory:  /Users/jmugan/temp\\n\",\n      \"Downsampled dataset: 45 positive tweets out of 101\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"home = str(Path.home())\\n\",\n    \"data_dir = os.path.join(home, 'temp')\\n\",\n    \"print(\\\"Data directory: \\\", data_dir)\\n\",\n    \"\\n\",\n    \"all_tweets: List[str] = []\\n\",\n    \"with open('jmugan_tweets.txt', 'r') as f:\\n\",\n    \"    for tweet in f:\\n\",\n    \"        tweet = tweet.strip()  # remove newline\\n\",\n    \"        all_tweets.append(tweet)\\n\",\n    \"\\n\",\n    \"def is_movie_tweet(tweet: str) -> bool:\\n\",\n    \"    return 'movie' in tweet.lower()\\n\",\n    \"\\n\",\n    \"def down_sample(all_tweets: List[str]) -> List[str]:\\n\",\n    \"    down_sampled = []\\n\",\n    \"    num_pos = 0\\n\",\n    \"    for tweet in all_tweets:\\n\",\n    \"        if is_movie_tweet(tweet):\\n\",\n    \"            num_pos += 1\\n\",\n    \"            down_sampled.append(tweet)\\n\",\n    \"        elif random.random() > .95:  # let in 80% of others\\n\",\n    \"            down_sampled.append(tweet)\\n\",\n    \"    print(f\\\"Downsampled dataset: {num_pos} positive tweets out of {len(down_sampled)}\\\")\\n\",\n    \"    return down_sampled\\n\",\n    \"\\n\",\n    \"# Normally, we would break the data into train, valid, and test, \\n\",\n    \"# but this is just a quick video\\n\",\n    \"training_tweets = down_sample(all_tweets)\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# We need to `Dataset` to represent our data set\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 5,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"from torch.utils.data import Dataset\\n\",\n    \"\\n\",\n    \"# https://pytorch.org/docs/stable/data.html\\n\",\n    \"# You don't have to load the whole data into memory\\n\",\n    \"class TweetDataset(torch.utils.data.Dataset):\\n\",\n    \"\\n\",\n    \"    def __init__(self, tweets: List[str]):\\n\",\n    \"        self.tweets = tweets\\n\",\n    \"\\n\",\n    \"    def __len__(self):\\n\",\n    \"        return len(self.tweets)\\n\",\n    \"\\n\",\n    \"    def __getitem__(self, index: int):\\n\",\n    \"        return self.tweets[index]\\n\",\n    \"\\n\",\n    \"    #def __iter__(self):\\n\",\n    \"    #    # you could be pulling these from a file instead so the whole thing\\n\",\n    \"    #    # doesn't have to sit in memory, see torch.utils.data.IterableDataset\\n\",\n    \"    #    for tweet in self.tweets:\\n\",\n    \"    #        yield tweet\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# We need a `DataLoader` to batch and preprocess our data and pass it to the learner\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 6,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"# recall from last time\\n\",\n    \"def get_tokens(text: str,\\n\",\n    \"               tokenizer: BertTokenizer,\\n\",\n    \"               config: BertConfig) -> List[str]:\\n\",\n    \"    tokens = tokenizer.tokenize(text)\\n\",\n    \"    # make sure it isn't too long\\n\",\n    \"    max_length = config.max_position_embeddings\\n\",\n    \"    tokens = tokens[:max_length-1] # Will add special begin token\\n\",\n    \"    # cls token to hold vector https://huggingface.co/transformers/main_classes/tokenizer.html\\n\",\n    \"    tokens = [tokenizer.cls_token] + tokens\\n\",\n    \"    return tokens\\n\",\n    \"\\n\",\n    \"\\n\",\n    \"\\n\",\n    \"def get_labels(batch: List[str]) -> List[int]:\\n\",\n    \"    \\\"\\\"\\\"\\n\",\n    \"    Normally you have the labeled data from somewhere, maybe somebody hand labeled it.\\n\",\n    \"    Here, we will just use a simple-stupid function\\n\",\n    \"    \\\"\\\"\\\"\\n\",\n    \"    labels: List[int] = []\\n\",\n    \"    for tweet in batch:\\n\",\n    \"        if is_movie_tweet(tweet):\\n\",\n    \"            labels.append(1)\\n\",\n    \"        else:\\n\",\n    \"            labels.append(0)\\n\",\n    \"    return labels\\n\",\n    \"\\n\",\n    \"\\n\",\n    \"# We need a function that puts masks on because the tweets have different lengths\\n\",\n    \"def preprocess_batch(batch: List[str]\\n\",\n    \"    ) -> Tuple[torch.Tensor, torch.Tensor, torch.Tensor, List[str]]:\\n\",\n    \"    \\\"\\\"\\\"\\n\",\n    \"    We get a list of batch-size in and we have to convert it to ids and make a mask\\n\",\n    \"    \\\"\\\"\\\"\\n\",\n    \"\\n\",\n    \"    # First tokenize\\n\",\n    \"    tokenized_tweets: List[List[str]] = [get_tokens(tweet, tokenizer, config) \\n\",\n    \"                                         for tweet in batch]\\n\",\n    \"\\n\",\n    \"    # find the max length\\n\",\n    \"    lengths = [len(tokenized_tweet) for tokenized_tweet in tokenized_tweets]\\n\",\n    \"    max_length = max(lengths)\\n\",\n    \"\\n\",\n    \"    # get batch size\\n\",\n    \"    batch_size = len(batch)\\n\",\n    \"\\n\",\n    \"    # let's make it tensors\\n\",\n    \"    input_data = torch.zeros(batch_size, max_length, dtype=torch.long)\\n\",\n    \"    mask_data = torch.zeros(batch_size, max_length, dtype=torch.long)\\n\",\n    \"\\n\",\n    \"    for i, tokenized_tweet in enumerate(tokenized_tweets):\\n\",\n    \"        token_ids = tokenizer.convert_tokens_to_ids(tokenized_tweet)\\n\",\n    \"        tensor = torch.tensor(token_ids)\\n\",\n    \"        input_data[i,:len(token_ids)] = tensor\\n\",\n    \"        mask_data[i,:len(token_ids)] = 1\\n\",\n    \"\\n\",\n    \"    # get labels\\n\",\n    \"    labels = get_labels(batch)\\n\",\n    \"    labels_tensor = torch.tensor(labels, dtype=torch.long)\\n\",\n    \"\\n\",\n    \"    return input_data, mask_data, labels_tensor, batch\\n\",\n    \"\\n\",\n    \"\\n\",\n    \"from torch.utils.data import DataLoader\\n\",\n    \"\\n\",\n    \"BATCH_SIZE = 20\\n\",\n    \"train_data_loader = DataLoader(\\n\",\n    \"    TweetDataset(training_tweets),\\n\",\n    \"    batch_size = BATCH_SIZE,\\n\",\n    \"    shuffle = True,\\n\",\n    \"    collate_fn=preprocess_batch\\n\",\n    \")\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Now let's define our classifier as a PyTorch module\\n\",\n    \"* It takes a Bert model as the encoder and declares a matrix of size `hidden_size x 2` to map the Bert vector down to two dimensions (tweet about movies or not)\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 7,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"class Classifier(torch.nn.Module):\\n\",\n    \"    def __init__(self, encoder: BertModel):\\n\",\n    \"        \\\"\\\"\\\"\\n\",\n    \"        The init function of a module specifies the model parameters\\n\",\n    \"        \\\"\\\"\\\"\\n\",\n    \"        super().__init__()\\n\",\n    \"        self.encoder = encoder\\n\",\n    \"        # We have two classes, about movies and not about movies\\n\",\n    \"        self.classes = torch.nn.Linear(encoder.config.hidden_size, 2)\\n\",\n    \"\\n\",\n    \"    def forward(self, input_data: torch.Tensor,\\n\",\n    \"                mask_data: torch.Tensor) -> Tuple[torch.Tensor, torch.Tensor]:\\n\",\n    \"        \\\"\\\"\\\"\\n\",\n    \"        Forward is called when you call the model instance\\n\",\n    \"        \\\"\\\"\\\"\\n\",\n    \"\\n\",\n    \"        # The mask is so it doesn't pay attention to any tokens that are just \\n\",\n    \"        # filling up space. You need this because the input tensor is of shape \\n\",\n    \"        # batch_size x max_len where max_len is the longest tweet in that batch.\\n\",\n    \"        _last_hidden_state, pooler_output = self.encoder(input_data, \\n\",\n    \"                                                         attention_mask = mask_data)\\n\",\n    \"\\n\",\n    \"        # shape batch_size x encoder.config.hidden_size\\n\",\n    \"        vectors = pooler_output\\n\",\n    \"\\n\",\n    \"        # shape batch_size x 2\\n\",\n    \"        logits = self.classes(vectors)\\n\",\n    \"\\n\",\n    \"        # shape batch_size x 2; do softmax and log to pass \\n\",\n    \"        # into negative log likelihood later\\n\",\n    \"        log_softmax = F.log_softmax(logits, dim=1)\\n\",\n    \"\\n\",\n    \"        # We will use the vectors in the next video\\n\",\n    \"        return log_softmax, vectors\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Let's pull up our Bert model like we did before\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 8,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"model_name = 'bert-base-uncased'\\n\",\n    \"# Need to use the same tokenizer that was used to train the model so that it breaks up words\\n\",\n    \"# into tokens the same way.\\n\",\n    \"tokenizer = BertTokenizer.from_pretrained(model_name)\\n\",\n    \"\\n\",\n    \"# This model is huge!!!!!!!!\\n\",\n    \"model = BertModel.from_pretrained(model_name)\\n\",\n    \"\\n\",\n    \"# What do I use this for?\\n\",\n    \"config = BertConfig.from_pretrained(model_name)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# We can now instantiate our classifier\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 10,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"data\": {\n      \"text/plain\": [\n       \"Classifier(\\n\",\n       \"  (encoder): BertModel(\\n\",\n       \"    (embeddings): BertEmbeddings(\\n\",\n       \"      (word_embeddings): Embedding(30522, 768, padding_idx=0)\\n\",\n       \"      (position_embeddings): Embedding(512, 768)\\n\",\n       \"      (token_type_embeddings): Embedding(2, 768)\\n\",\n       \"      (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"      (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"    )\\n\",\n       \"    (encoder): BertEncoder(\\n\",\n       \"      (layer): ModuleList(\\n\",\n       \"        (0): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (1): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (2): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (3): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (4): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (5): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (6): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (7): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (8): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (9): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (10): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"        (11): BertLayer(\\n\",\n       \"          (attention): BertAttention(\\n\",\n       \"            (self): BertSelfAttention(\\n\",\n       \"              (query): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (key): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (value): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"            (output): BertSelfOutput(\\n\",\n       \"              (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"              (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"            )\\n\",\n       \"          )\\n\",\n       \"          (intermediate): BertIntermediate(\\n\",\n       \"            (dense): Linear(in_features=768, out_features=3072, bias=True)\\n\",\n       \"          )\\n\",\n       \"          (output): BertOutput(\\n\",\n       \"            (dense): Linear(in_features=3072, out_features=768, bias=True)\\n\",\n       \"            (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\\n\",\n       \"            (dropout): Dropout(p=0.1, inplace=False)\\n\",\n       \"          )\\n\",\n       \"        )\\n\",\n       \"      )\\n\",\n       \"    )\\n\",\n       \"    (pooler): BertPooler(\\n\",\n       \"      (dense): Linear(in_features=768, out_features=768, bias=True)\\n\",\n       \"      (activation): Tanh()\\n\",\n       \"    )\\n\",\n       \"  )\\n\",\n       \"  (classes): Linear(in_features=768, out_features=2, bias=True)\\n\",\n       \")\"\n      ]\n     },\n     \"execution_count\": 10,\n     \"metadata\": {},\n     \"output_type\": \"execute_result\"\n    }\n   ],\n   \"source\": [\n    \"classifier = Classifier(model)\\n\",\n    \"classifier.train()\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Set up our optimizers\\n\",\n    \"Slower learning rate for Bert so we don't change it so much\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 11,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"bert_optimizer = torch.optim.Adam(classifier.encoder.parameters(), lr=0.000005)\\n\",\n    \"head_optimizer = torch.optim.Adam(classifier.classes.parameters(), lr=0.001)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Time to train the model\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 13,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"STARTING EPOCH:  0\\n\",\n      \"Loss: 0.72\\n\",\n      \"Predictions: [0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0], Labels: [1 1 0 0 1 1 0 0 0 1 0 0 0 0 1 1 1 0 0 0], Accuracy: 0.6\\n\",\n      \"['Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?', 'Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.', 'Amazing how black socks change to blue when you take them out of the dresser drawer.', 'My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.', \\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\", 'Recently watched the movie The Bay. Anyone want to go for a swim?', 'Coat hangers are very poorly behaved objects.', 'My inbox now has 0 messages. It feels good to get organized.', \\\"I wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\\\", 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.', \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\", 'It would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.', 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.', \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\", \\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\", 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.', 'Someday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.', 'Sugar is the enemy. Sugar gives me life. #Productivity', 'Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.', 'Wrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.']\\n\",\n      \"Loss: 0.74\\n\",\n      \"Predictions: [0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0], Labels: [1 0 0 1 1 0 0 0 0 0 1 0 0 1 1 1 0 1 0 1], Accuracy: 0.55\\n\",\n      \"['Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.', 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing', \\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\", 'Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.', 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?', \\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\", 'I learned a new word yesterday. aliteracy: people who can read but choose not to.', 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.', 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.', 'Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.', \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\", 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.', \\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\", 'One of my superpowers is the ability to abandon a book or movie halfway through.', \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\", 'HT @TheOnion: 5-Year-Old Critics Agree: Movie \\\"Cars\\\" Only Gets Better After 40th Viewing', \\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\", \\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\", 'I love the smell of coffee in the morning. It smells like victory.', \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\"]\\n\",\n      \"Loss: 0.68\\n\",\n      \"Predictions: [0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0], Labels: [0 1 0 0 0 0 0 1 1 1 1 1 0 0 1 1 0 0 0 0], Accuracy: 0.6\\n\",\n      \"['I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary', 'Went to Costco for the first time not too long ago. That place is a disaster movie.', 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.', 'I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"', 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.', \\\"It's amazing how much joy in life comes from making and executing plans.\\\", 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"', 'I wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people', 'It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!', 'When they show scientists in movies, they never show them making PowerPoint slides.', \\\"Why can't we get good disaster movies?\\\", 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage', 'I keep buying pyrite but I must be doing something wrong.', \\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\", \\\"It's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\\\", \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\", 'Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?', 'Fame and fortune await the first person to develop a robot that powers itself by eating fire ants.', 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.', \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\"]\\n\",\n      \"Loss: 0.68\\n\",\n      \"Predictions: [0 1 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0], Labels: [1 1 0 0 1 0 1 1 0 0 0 1 1 1 1 1 0 1 0 0], Accuracy: 0.55\\n\",\n      \"['Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.', \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\", \\\"Just got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\\\", \\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\", 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.', \\\"According to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\\\", \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\", 'Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp', 'Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.', 'There is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.', 'Good comedy consists of statements that are both true and absurd.', 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.', \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\", \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\", 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit', 'Movies should bring back quicksand. We all need to be reminded of the dangers.', 'I coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.', \\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\", 'Want evidence of intelligent machines? Captchas are now too hard for me.', \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\"]\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.73\\n\",\n      \"Predictions: [1 1 1 0 1 0 0 1 0 0 0 0 1 1 1 0 1 0 0 1], Labels: [0 1 0 1 0 1 0 0 1 1 0 1 1 0 0 0 0 0 0 1], Accuracy: 0.4\\n\",\n      \"[\\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\", \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\", 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.', 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.', \\\"My son (7) wants to know why he can't have a credit card.\\\", \\\"I bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\\\", 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.', \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\", 'I love it when movies about ghosts are \\\"based on a true story.\\\"', 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.', 'I love how a good book becomes part of your mental life forever.', 'Just saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.', \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\", \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\", 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"', \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\", \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\", 'I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.', 'I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?', 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.']\\n\",\n      \"Loss: 0.70\\n\",\n      \"Predictions: [0], Labels: [1], Accuracy: 0.0\\n\",\n      \"['Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.']\\n\",\n      \"STARTING EPOCH:  1\\n\",\n      \"Loss: 0.74\\n\",\n      \"Predictions: [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1], Labels: [1 0 0 0 0 1 1 1 1 1 0 0 0 1 0 0 0 1 1 0], Accuracy: 0.45\\n\",\n      \"['Movies should bring back quicksand. We all need to be reminded of the dangers.', \\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\", \\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\", 'Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.', \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\", 'One of my superpowers is the ability to abandon a book or movie halfway through.', \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\", \\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\", \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\", \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\", 'It would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.', 'I coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.', 'Coat hangers are very poorly behaved objects.', \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\", \\\"It's amazing how much joy in life comes from making and executing plans.\\\", 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"', 'Wrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.', 'Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp', 'HT @TheOnion: 5-Year-Old Critics Agree: Movie \\\"Cars\\\" Only Gets Better After 40th Viewing', 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.']\\n\",\n      \"Loss: 0.64\\n\",\n      \"Predictions: [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1], Labels: [1 0 1 1 1 1 1 0 1 0 1 0 0 1 1 1 0 1 0 1], Accuracy: 0.65\\n\",\n      \"['Just saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.', \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\", 'Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.', \\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\", 'When they show scientists in movies, they never show them making PowerPoint slides.', 'Recently watched the movie The Bay. Anyone want to go for a swim?', \\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\", \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\", 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.', \\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\", 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.', 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"', 'Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.', 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?', \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\", 'Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?', 'Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.', \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\", 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.', 'Someday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.']\\n\",\n      \"Loss: 0.84\\n\",\n      \"Predictions: [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1], Labels: [0 1 1 0 0 0 1 0 0 1 0 0 0 1 0 1 0 0 0 1], Accuracy: 0.35\\n\",\n      \"[\\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\", 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.', 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.', \\\"Just got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\\\", 'I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?', 'I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary', 'Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.', 'My inbox now has 0 messages. It feels good to get organized.', 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.', 'Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.', 'I learned a new word yesterday. aliteracy: people who can read but choose not to.', 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.', 'Sugar is the enemy. Sugar gives me life. #Productivity', 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage', 'Good comedy consists of statements that are both true and absurd.', 'It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!', 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.', 'I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.', 'My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.', 'I wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people']\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.78\\n\",\n      \"Predictions: [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1], Labels: [0 0 0 1 0 0 0 0 0 0 0 1 0 1 1 1 1 0 1 1], Accuracy: 0.4\\n\",\n      \"[\\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\", 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing', \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\", \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\", \\\"According to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\\\", \\\"My son (7) wants to know why he can't have a credit card.\\\", 'Amazing how black socks change to blue when you take them out of the dresser drawer.', \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\", 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.', 'Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?', 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.', 'Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.', 'I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"', 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit', 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.', \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\", 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.', \\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\", \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\", \\\"It's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\\\"]\\n\",\n      \"Loss: 0.71\\n\",\n      \"Predictions: [0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1], Labels: [0 1 1 0 0 1 0 1 0 1 1 0 0 1 0 1 0 0 0 0], Accuracy: 0.45\\n\",\n      \"['I love the smell of coffee in the morning. It smells like victory.', \\\"Why can't we get good disaster movies?\\\", 'Went to Costco for the first time not too long ago. That place is a disaster movie.', \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\", \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\", 'Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.', 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.', 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.', 'There is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.', 'I love it when movies about ghosts are \\\"based on a true story.\\\"', \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\", 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.', 'Want evidence of intelligent machines? Captchas are now too hard for me.', \\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\", 'I love how a good book becomes part of your mental life forever.', \\\"I bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\\\", 'I keep buying pyrite but I must be doing something wrong.', \\\"I wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\\\", \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\", 'Fame and fortune await the first person to develop a robot that powers itself by eating fire ants.']\\n\",\n      \"Loss: 0.90\\n\",\n      \"Predictions: [1], Labels: [0], Accuracy: 0.0\\n\",\n      \"[\\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\"]\\n\",\n      \"STARTING EPOCH:  2\\n\",\n      \"Loss: 0.69\\n\",\n      \"Predictions: [1 1 0 0 0 0 1 0 0 0 0 0 0 0 0 1 0 0 0 0], Labels: [0 1 0 0 0 1 1 0 1 0 1 1 0 1 0 1 0 0 1 0], Accuracy: 0.65\\n\",\n      \"['I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.', 'Someday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.', 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.', \\\"My son (7) wants to know why he can't have a credit card.\\\", \\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\", 'Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.', 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.', 'There is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.', \\\"I bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\\\", \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\", \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\", \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\", 'Coat hangers are very poorly behaved objects.', \\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\", 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing', 'Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.', \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\", 'I love how a good book becomes part of your mental life forever.', 'Movies should bring back quicksand. We all need to be reminded of the dangers.', 'Fame and fortune await the first person to develop a robot that powers itself by eating fire ants.']\\n\",\n      \"Loss: 0.61\\n\",\n      \"Predictions: [0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0], Labels: [1 0 0 0 0 0 1 0 1 0 0 0 0 1 1 0 0 1 1 0], Accuracy: 0.7\\n\",\n      \"['Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.', 'My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.', 'I coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.', 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"', 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.', 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.', 'Just saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.', 'I love the smell of coffee in the morning. It smells like victory.', \\\"Why can't we get good disaster movies?\\\", 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"', 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.', \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\", 'I keep buying pyrite but I must be doing something wrong.', \\\"It's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\\\", 'Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?', 'Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.', 'I learned a new word yesterday. aliteracy: people who can read but choose not to.', \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\", 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.', \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\"]\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.68\\n\",\n      \"Predictions: [0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0], Labels: [0 1 1 0 1 0 1 0 1 1 0 1 0 0 0 0 0 1 1 0], Accuracy: 0.6\\n\",\n      \"[\\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\", \\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\", \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\", \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\", \\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\", 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.', 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage', \\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\", 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.', \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\", 'I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary', 'When they show scientists in movies, they never show them making PowerPoint slides.', 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.', \\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\", 'I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"', \\\"It's amazing how much joy in life comes from making and executing plans.\\\", 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.', \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\", 'Recently watched the movie The Bay. Anyone want to go for a swim?', 'Wrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.']\\n\",\n      \"Loss: 0.77\\n\",\n      \"Predictions: [0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0], Labels: [1 1 0 0 1 1 1 0 1 0 0 0 0 1 1 1 0 1 0 1], Accuracy: 0.45\\n\",\n      \"['Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp', 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.', \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\", \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\", 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.', \\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\", 'HT @TheOnion: 5-Year-Old Critics Agree: Movie \\\"Cars\\\" Only Gets Better After 40th Viewing', 'Sugar is the enemy. Sugar gives me life. #Productivity', \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\", 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.', \\\"I wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\\\", 'Want evidence of intelligent machines? Captchas are now too hard for me.', 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.', \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\", 'One of my superpowers is the ability to abandon a book or movie halfway through.', \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\", \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\", 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit', \\\"According to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\\\", 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.']\\n\",\n      \"Loss: 0.74\\n\",\n      \"Predictions: [0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0], Labels: [1 1 0 0 0 0 0 1 0 1 1 1 0 1 1 0 0 0 0 1], Accuracy: 0.55\\n\",\n      \"['Went to Costco for the first time not too long ago. That place is a disaster movie.', 'I love it when movies about ghosts are \\\"based on a true story.\\\"', \\\"Just got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\\\", \\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\", \\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\", 'I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?', 'My inbox now has 0 messages. It feels good to get organized.', 'Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.', 'Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.', 'I wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people', 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?', 'It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!', \\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\", \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\", 'Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.', 'It would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.', 'Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.', 'Amazing how black socks change to blue when you take them out of the dresser drawer.', 'Good comedy consists of statements that are both true and absurd.', 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.']\\n\",\n      \"Loss: 0.18\\n\",\n      \"Predictions: [0], Labels: [0], Accuracy: 1.0\\n\",\n      \"['Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?']\\n\",\n      \"STARTING EPOCH:  3\\n\",\n      \"Loss: 0.78\\n\",\n      \"Predictions: [0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0], Labels: [0 1 0 0 1 0 0 1 0 1 0 1 1 1 0 1 0 0 1 0], Accuracy: 0.5\\n\",\n      \"[\\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\", \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\", \\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\", 'Want evidence of intelligent machines? Captchas are now too hard for me.', 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.', \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\", 'Coat hangers are very poorly behaved objects.', \\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\", 'My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.', \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\", \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\", \\\"I bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\\\", \\\"Why can't we get good disaster movies?\\\", \\\"It's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\\\", 'Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?', 'When they show scientists in movies, they never show them making PowerPoint slides.', 'I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.', 'I learned a new word yesterday. aliteracy: people who can read but choose not to.', 'Someday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.', \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\"]\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.76\\n\",\n      \"Predictions: [0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1], Labels: [0 0 1 0 1 0 1 1 0 0 0 0 0 1 1 0 1 1 1 0], Accuracy: 0.55\\n\",\n      \"['I love the smell of coffee in the morning. It smells like victory.', 'My inbox now has 0 messages. It feels good to get organized.', \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\", 'I love how a good book becomes part of your mental life forever.', 'Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?', \\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\", 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit', \\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\", \\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\", \\\"Just got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\\\", \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\", 'I keep buying pyrite but I must be doing something wrong.', \\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\", 'It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!', 'Went to Costco for the first time not too long ago. That place is a disaster movie.', 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.', 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage', 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.', 'Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.', 'Fame and fortune await the first person to develop a robot that powers itself by eating fire ants.']\\n\",\n      \"Loss: 0.57\\n\",\n      \"Predictions: [0 0 1 0 0 0 0 1 0 0 0 0 0 0 0 0 1 0 0 0], Labels: [0 0 1 1 1 0 0 1 0 1 0 0 0 0 1 1 1 0 0 0], Accuracy: 0.75\\n\",\n      \"['Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.', \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\", 'Just saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.', \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\", 'One of my superpowers is the ability to abandon a book or movie halfway through.', 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.', 'I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"', \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\", 'Sugar is the enemy. Sugar gives me life. #Productivity', 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.', 'Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.', 'It would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.', 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"', 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.', 'I love it when movies about ghosts are \\\"based on a true story.\\\"', 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.', 'Recently watched the movie The Bay. Anyone want to go for a swim?', 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.', 'I coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.', 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing']\\n\",\n      \"Loss: 0.64\\n\",\n      \"Predictions: [0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0], Labels: [0 0 0 0 1 0 1 0 1 0 0 0 1 0 1 1 1 0 1 0], Accuracy: 0.6\\n\",\n      \"['I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary', \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\", \\\"I wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\\\", 'Amazing how black socks change to blue when you take them out of the dresser drawer.', 'I wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people', 'Wrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.', \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\", \\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\", \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\", 'Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.', 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.', \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\", 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.', 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.', 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.', 'Movies should bring back quicksand. We all need to be reminded of the dangers.', 'Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.', 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"', 'Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.', \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\"]\\n\",\n      \"Loss: 0.79\\n\",\n      \"Predictions: [0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0], Labels: [1 0 1 0 0 0 1 0 1 1 1 0 0 1 0 1 1 0 0 1], Accuracy: 0.4\\n\",\n      \"[\\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\", \\\"My son (7) wants to know why he can't have a credit card.\\\", \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\", \\\"According to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\\\", 'I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?', 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.', 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?', \\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\", 'Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp', \\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\", \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\", 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.', 'There is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.', \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\", 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.', 'Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.', 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.', \\\"It's amazing how much joy in life comes from making and executing plans.\\\", 'Good comedy consists of statements that are both true and absurd.', 'HT @TheOnion: 5-Year-Old Critics Agree: Movie \\\"Cars\\\" Only Gets Better After 40th Viewing']\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.79\\n\",\n      \"Predictions: [0], Labels: [1], Accuracy: 0.0\\n\",\n      \"['Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.']\\n\",\n      \"STARTING EPOCH:  4\\n\",\n      \"Loss: 0.58\\n\",\n      \"Predictions: [1 0 0 1 0 0 0 0 0 0 1 0 0 1 0 0 0 1 0 0], Labels: [1 0 0 0 1 1 1 1 0 0 1 1 1 1 0 0 0 1 0 0], Accuracy: 0.65\\n\",\n      \"['Recently watched the movie The Bay. Anyone want to go for a swim?', 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.', 'Fame and fortune await the first person to develop a robot that powers itself by eating fire ants.', 'Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.', 'Someday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.', \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\", 'Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.', \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\", 'I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?', 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.', 'Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.', 'It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!', \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\", 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage', 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.', \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\", 'There is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.', 'Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.', \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\", \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\"]\\n\",\n      \"Loss: 0.60\\n\",\n      \"Predictions: [0 0 1 0 0 1 0 0 0 1 1 1 0 0 0 0 1 0 1 0], Labels: [1 0 1 0 0 1 0 1 0 1 1 1 0 0 0 1 1 1 0 0], Accuracy: 0.75\\n\",\n      \"[\\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\", \\\"According to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\\\", \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\", 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.', \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\", \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\", \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\", 'One of my superpowers is the ability to abandon a book or movie halfway through.', 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"', \\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\", 'Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.', 'Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.', 'I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"', 'I keep buying pyrite but I must be doing something wrong.', \\\"My son (7) wants to know why he can't have a credit card.\\\", \\\"I bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\\\", 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.', 'Movies should bring back quicksand. We all need to be reminded of the dangers.', 'Coat hangers are very poorly behaved objects.', 'Good comedy consists of statements that are both true and absurd.']\\n\",\n      \"Loss: 0.51\\n\",\n      \"Predictions: [0 0 1 0 1 1 0 1 0 0 1 0 0 0 0 1 1 0 0 0], Labels: [0 0 1 0 1 1 0 1 0 0 1 1 0 0 0 1 0 0 0 0], Accuracy: 0.9\\n\",\n      \"[\\\"It's amazing how much joy in life comes from making and executing plans.\\\", \\\"I wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\\\", \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\", 'I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary', 'When they show scientists in movies, they never show them making PowerPoint slides.', 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.', 'My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.', 'Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?', 'I love how a good book becomes part of your mental life forever.', \\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\", 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit', 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.', \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\", 'Wrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.', 'My inbox now has 0 messages. It feels good to get organized.', \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\", 'Want evidence of intelligent machines? Captchas are now too hard for me.', \\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\", 'I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.', \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\"]\\n\",\n      \"Loss: 0.56\\n\",\n      \"Predictions: [0 0 1 1 1 0 0 1 1 1 1 0 1 1 0 1 1 0 0 1], Labels: [1 0 0 0 1 0 0 1 1 0 1 0 1 1 0 0 0 0 0 1], Accuracy: 0.7\\n\",\n      \"['Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp', \\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\", 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.', 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.', 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.', 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"', 'Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?', 'Just saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.', 'Went to Costco for the first time not too long ago. That place is a disaster movie.', \\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\", \\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\", 'Sugar is the enemy. Sugar gives me life. #Productivity', 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.', \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\", 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.', \\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\", \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\", 'Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.', \\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\", 'HT @TheOnion: 5-Year-Old Critics Agree: Movie \\\"Cars\\\" Only Gets Better After 40th Viewing']\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.63\\n\",\n      \"Predictions: [0 1 1 1 1 1 0 0 1 0 1 0 1 1 1 0 1 0 0 1], Labels: [0 0 1 1 0 0 0 1 0 0 1 0 1 0 1 1 1 0 0 1], Accuracy: 0.65\\n\",\n      \"['Amazing how black socks change to blue when you take them out of the dresser drawer.', 'I coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.', \\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\", \\\"It's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\\\", 'I learned a new word yesterday. aliteracy: people who can read but choose not to.', 'Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.', 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.', \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\", 'It would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.', \\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\", \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\", 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.', \\\"Why can't we get good disaster movies?\\\", \\\"Just got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\\\", 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.', 'I love it when movies about ghosts are \\\"based on a true story.\\\"', 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.', 'I love the smell of coffee in the morning. It smells like victory.', 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing', 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?']\\n\",\n      \"Loss: 0.38\\n\",\n      \"Predictions: [1], Labels: [1], Accuracy: 1.0\\n\",\n      \"['I wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people']\\n\",\n      \"STARTING EPOCH:  5\\n\",\n      \"Loss: 0.58\\n\",\n      \"Predictions: [1 1 0 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1], Labels: [0 1 0 0 0 0 0 1 1 0 1 1 1 1 1 0 1 0 0 0], Accuracy: 0.6\\n\",\n      \"['I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.', \\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\", \\\"I wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\\\", \\\"Just got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\\\", \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\", \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\", \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\", 'It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!', \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\", \\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\", 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.', 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.', \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\", \\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\", 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.', 'Amazing how black socks change to blue when you take them out of the dresser drawer.', \\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\", 'Want evidence of intelligent machines? Captchas are now too hard for me.', \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\", 'Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.']\\n\",\n      \"Loss: 0.47\\n\",\n      \"Predictions: [1 1 1 0 1 1 1 1 1 0 1 0 0 1 1 1 1 1 1 1], Labels: [1 1 1 0 1 1 0 0 1 0 1 0 0 0 1 1 1 1 1 0], Accuracy: 0.8\\n\",\n      \"['When they show scientists in movies, they never show them making PowerPoint slides.', 'I love it when movies about ghosts are \\\"based on a true story.\\\"', 'Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.', 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"', 'Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp', \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\", 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.', 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing', 'Just saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.', 'Sugar is the enemy. Sugar gives me life. #Productivity', 'One of my superpowers is the ability to abandon a book or movie halfway through.', 'Fame and fortune await the first person to develop a robot that powers itself by eating fire ants.', 'I love how a good book becomes part of your mental life forever.', \\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\", 'Someday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.', \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\", 'Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.', 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage', 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.', 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.']\\n\",\n      \"Loss: 0.64\\n\",\n      \"Predictions: [0 1 1 1 0 1 1 0 1 1 1 0 0 0 1 1 1 1 1 0], Labels: [0 0 0 0 0 1 0 0 0 1 1 1 0 0 0 1 1 0 0 0], Accuracy: 0.55\\n\",\n      \"[\\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\", 'I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary', 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.', 'It would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.', 'Wrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.', \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\", 'Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.', 'I keep buying pyrite but I must be doing something wrong.', \\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\", 'Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.', \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\", 'Movies should bring back quicksand. We all need to be reminded of the dangers.', 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.', 'There is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.', \\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\", 'Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.', 'Went to Costco for the first time not too long ago. That place is a disaster movie.', \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\", 'My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.', 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.']\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.61\\n\",\n      \"Predictions: [1 1 0 0 1 1 1 1 1 1 1 0 1 0 1 1 1 1 0 1], Labels: [0 0 0 0 1 0 0 0 1 1 1 0 1 0 1 0 1 0 1 1], Accuracy: 0.6\\n\",\n      \"['I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?', 'I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"', 'Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?', 'I love the smell of coffee in the morning. It smells like victory.', 'Recently watched the movie The Bay. Anyone want to go for a swim?', 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.', 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"', 'I learned a new word yesterday. aliteracy: people who can read but choose not to.', 'Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?', \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\", 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?', 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.', 'Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.', 'Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.', \\\"Why can't we get good disaster movies?\\\", 'My inbox now has 0 messages. It feels good to get organized.', 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit', 'Good comedy consists of statements that are both true and absurd.', \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\", 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.']\\n\",\n      \"Loss: 0.71\\n\",\n      \"Predictions: [0 0 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1], Labels: [0 0 1 0 0 0 0 0 0 0 1 0 1 0 1 0 1 1 1 1], Accuracy: 0.5\\n\",\n      \"['I coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.', \\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\", 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.', \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\", 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.', \\\"According to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\\\", 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.', \\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\", \\\"It's amazing how much joy in life comes from making and executing plans.\\\", \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\", 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.', 'Coat hangers are very poorly behaved objects.', \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\", \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\", \\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\", \\\"My son (7) wants to know why he can't have a credit card.\\\", \\\"It's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\\\", \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\", 'I wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people', 'HT @TheOnion: 5-Year-Old Critics Agree: Movie \\\"Cars\\\" Only Gets Better After 40th Viewing']\\n\",\n      \"Loss: 0.93\\n\",\n      \"Predictions: [0], Labels: [1], Accuracy: 0.0\\n\",\n      \"[\\\"I bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\\\"]\\n\",\n      \"STARTING EPOCH:  6\\n\",\n      \"Loss: 0.56\\n\",\n      \"Predictions: [0 1 1 0 0 0 1 1 1 0 0 1 1 0 0 0 0 0 1 1], Labels: [0 0 1 0 0 0 0 1 1 0 0 1 1 0 0 0 0 0 0 0], Accuracy: 0.8\\n\",\n      \"[\\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\", 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"', 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.', 'Wrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.', 'It would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.', 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.', \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\", \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\", 'One of my superpowers is the ability to abandon a book or movie halfway through.', \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\", 'I love the smell of coffee in the morning. It smells like victory.', \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\", 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit', 'Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.', 'Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.', 'My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.', \\\"I wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\\\", 'I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"', 'Sugar is the enemy. Sugar gives me life. #Productivity', 'Good comedy consists of statements that are both true and absurd.']\\n\",\n      \"Loss: 0.48\\n\",\n      \"Predictions: [0 1 0 1 0 0 0 1 0 0 0 0 1 1 0 1 0 0 0 1], Labels: [0 1 0 1 0 0 0 1 0 0 0 1 0 0 0 1 0 0 0 1], Accuracy: 0.85\\n\",\n      \"[\\\"My son (7) wants to know why he can't have a credit card.\\\", 'Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.', 'Want evidence of intelligent machines? Captchas are now too hard for me.', \\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\", 'I love how a good book becomes part of your mental life forever.', 'Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.', 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.', 'Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?', \\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\", \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\", 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.', 'Movies should bring back quicksand. We all need to be reminded of the dangers.', \\\"Just got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\\\", 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.', \\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\", \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\", 'I coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.', \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\", 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.', 'Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp']\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.42\\n\",\n      \"Predictions: [0 0 1 0 1 1 1 0 1 0 0 1 0 1 1 1 1 0 1 0], Labels: [0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 0 1 0 1 0], Accuracy: 0.9\\n\",\n      \"['Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?', 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.', 'Went to Costco for the first time not too long ago. That place is a disaster movie.', 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing', \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\", \\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\", 'I love it when movies about ghosts are \\\"based on a true story.\\\"', \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\", 'Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.', \\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\", \\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\", 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.', 'I learned a new word yesterday. aliteracy: people who can read but choose not to.', \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\", \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\", 'I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?', 'When they show scientists in movies, they never show them making PowerPoint slides.', 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.', \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\", 'I keep buying pyrite but I must be doing something wrong.']\\n\",\n      \"Loss: 0.43\\n\",\n      \"Predictions: [1 1 0 0 1 0 0 1 1 0 0 0 1 0 1 1 1 0 1 1], Labels: [1 1 0 0 0 0 0 1 1 0 0 0 1 1 1 1 0 0 1 1], Accuracy: 0.85\\n\",\n      \"[\\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\", 'Just saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.', \\\"It's amazing how much joy in life comes from making and executing plans.\\\", \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\", \\\"According to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\\\", 'I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary', 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.', 'Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.', 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.', \\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\", 'Coat hangers are very poorly behaved objects.', 'I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.', \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\", 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?', 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.', 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.', 'Amazing how black socks change to blue when you take them out of the dresser drawer.', \\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\", 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.', \\\"It's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\\\"]\\n\",\n      \"Loss: 0.45\\n\",\n      \"Predictions: [1 1 1 1 0 1 0 1 1 1 1 0 1 0 0 0 0 0 1 0], Labels: [1 1 1 1 0 1 0 0 1 1 1 0 1 0 1 1 0 1 1 1], Accuracy: 0.75\\n\",\n      \"['It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!', 'Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.', \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\", 'Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.', 'There is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.', \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\", 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"', 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.', 'Someday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.', 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.', 'I wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people', 'My inbox now has 0 messages. It feels good to get organized.', 'HT @TheOnion: 5-Year-Old Critics Agree: Movie \\\"Cars\\\" Only Gets Better After 40th Viewing', \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\", 'Recently watched the movie The Bay. Anyone want to go for a swim?', \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\", 'Fame and fortune await the first person to develop a robot that powers itself by eating fire ants.', \\\"I bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\\\", 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage', \\\"Why can't we get good disaster movies?\\\"]\\n\",\n      \"Loss: 0.20\\n\",\n      \"Predictions: [1], Labels: [1], Accuracy: 1.0\\n\",\n      \"[\\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\"]\\n\",\n      \"STARTING EPOCH:  7\\n\",\n      \"Loss: 0.40\\n\",\n      \"Predictions: [0 1 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 0 0 0], Labels: [0 1 0 1 1 0 1 0 0 0 0 0 0 1 0 0 1 0 0 1], Accuracy: 0.8\\n\",\n      \"['My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.', 'Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.', 'I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"', 'Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.', 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.', 'Wrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.', \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\", \\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\", 'Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.', 'I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary', 'I learned a new word yesterday. aliteracy: people who can read but choose not to.', \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\", 'Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?', 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.', \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\", 'I love how a good book becomes part of your mental life forever.', 'Went to Costco for the first time not too long ago. That place is a disaster movie.', 'Fame and fortune await the first person to develop a robot that powers itself by eating fire ants.', \\\"It's amazing how much joy in life comes from making and executing plans.\\\", 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?']\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.43\\n\",\n      \"Predictions: [1 1 1 1 1 0 0 0 0 0 0 0 1 1 0 0 0 0 0 1], Labels: [1 1 1 0 1 0 1 0 0 0 0 0 1 0 0 0 0 0 0 1], Accuracy: 0.85\\n\",\n      \"['I wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people', 'Just saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.', \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\", 'I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?', 'One of my superpowers is the ability to abandon a book or movie halfway through.', 'Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.', 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.', 'Coat hangers are very poorly behaved objects.', 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.', 'My inbox now has 0 messages. It feels good to get organized.', \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\", 'Good comedy consists of statements that are both true and absurd.', \\\"It's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\\\", \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\", 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing', 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.', \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\", \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\", \\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\", \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\"]\\n\",\n      \"Loss: 0.44\\n\",\n      \"Predictions: [1 1 0 1 1 1 0 0 1 1 0 1 0 0 0 0 0 0 0 1], Labels: [1 1 0 1 1 1 0 0 1 1 1 1 1 0 1 0 1 0 0 0], Accuracy: 0.75\\n\",\n      \"['Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.', 'Someday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.', 'Want evidence of intelligent machines? Captchas are now too hard for me.', 'Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp', 'When they show scientists in movies, they never show them making PowerPoint slides.', \\\"Why can't we get good disaster movies?\\\", \\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\", 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.', 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.', \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\", 'I love it when movies about ghosts are \\\"based on a true story.\\\"', 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit', 'It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!', 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.', 'Movies should bring back quicksand. We all need to be reminded of the dangers.', 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.', 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.', 'I love the smell of coffee in the morning. It smells like victory.', \\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\", \\\"Just got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\\\"]\\n\",\n      \"Loss: 0.33\\n\",\n      \"Predictions: [0 0 1 1 1 1 0 1 1 0 0 0 1 1 1 0 0 1 1 1], Labels: [0 0 1 1 1 1 0 0 1 0 0 0 1 1 1 0 0 1 1 1], Accuracy: 0.95\\n\",\n      \"[\\\"My son (7) wants to know why he can't have a credit card.\\\", 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.', 'Recently watched the movie The Bay. Anyone want to go for a swim?', \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\", 'Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.', 'HT @TheOnion: 5-Year-Old Critics Agree: Movie \\\"Cars\\\" Only Gets Better After 40th Viewing', 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"', 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.', 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.', 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.', \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\", 'I coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.', \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\", \\\"I bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\\\", \\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\", \\\"According to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\\\", \\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\", \\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\", 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage', 'Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.']\\n\",\n      \"Loss: 0.26\\n\",\n      \"Predictions: [0 0 1 1 0 1 0 0 0 0 0 0 0 0 0 1 0 1 0 1], Labels: [0 0 1 1 0 1 0 0 0 0 0 0 1 0 0 1 0 1 0 1], Accuracy: 0.95\\n\",\n      \"['Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.', \\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\", \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\", \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\", 'There is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.', \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\", 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.', 'Sugar is the enemy. Sugar gives me life. #Productivity', 'Amazing how black socks change to blue when you take them out of the dresser drawer.', 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"', 'I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.', 'It would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.', \\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\", 'I keep buying pyrite but I must be doing something wrong.', \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\", \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\", \\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\", 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.', \\\"I wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\\\", 'Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?']\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.17\\n\",\n      \"Predictions: [1], Labels: [1], Accuracy: 1.0\\n\",\n      \"[\\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\"]\\n\",\n      \"STARTING EPOCH:  8\\n\",\n      \"Loss: 0.28\\n\",\n      \"Predictions: [1 0 1 1 0 1 0 1 0 0 0 0 0 1 0 1 0 1 0 1], Labels: [1 0 0 1 0 0 0 1 0 0 0 0 0 1 0 1 0 1 0 1], Accuracy: 0.9\\n\",\n      \"[\\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\", \\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\", 'Wrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.', 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.', \\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\", \\\"It's amazing how much joy in life comes from making and executing plans.\\\", 'Fame and fortune await the first person to develop a robot that powers itself by eating fire ants.', 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.', 'Coat hangers are very poorly behaved objects.', \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\", \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\", \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\", \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\", \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\", \\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\", \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\", 'Good comedy consists of statements that are both true and absurd.', 'Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?', \\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\", \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\"]\\n\",\n      \"Loss: 0.22\\n\",\n      \"Predictions: [0 0 0 1 0 0 0 1 1 0 0 1 1 0 0 1 0 0 0 1], Labels: [0 0 0 1 0 0 0 1 1 1 0 1 1 0 0 1 0 0 0 1], Accuracy: 0.95\\n\",\n      \"['Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.', \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\", 'I coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.', 'It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!', 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.', 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.', 'I keep buying pyrite but I must be doing something wrong.', 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit', 'Someday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.', \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\", 'I love how a good book becomes part of your mental life forever.', 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.', \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\", 'Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.', 'I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary', \\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\", 'Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?', 'Sugar is the enemy. Sugar gives me life. #Productivity', 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.', 'When they show scientists in movies, they never show them making PowerPoint slides.']\\n\",\n      \"Loss: 0.45\\n\",\n      \"Predictions: [0 1 0 0 1 1 1 0 0 0 0 0 0 0 1 1 1 1 0 1], Labels: [0 0 0 0 1 1 1 0 1 1 0 0 0 0 1 1 1 0 0 1], Accuracy: 0.8\\n\",\n      \"[\\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\", 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.', \\\"Just got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\\\", \\\"I wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\\\", 'Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.', \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\", \\\"I bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\\\", \\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\", \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\", 'Movies should bring back quicksand. We all need to be reminded of the dangers.', 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"', 'I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?', \\\"My son (7) wants to know why he can't have a credit card.\\\", 'I learned a new word yesterday. aliteracy: people who can read but choose not to.', \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\", \\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\", 'Went to Costco for the first time not too long ago. That place is a disaster movie.', 'My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.', 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing', 'I love it when movies about ghosts are \\\"based on a true story.\\\"']\\n\",\n      \"Loss: 0.34\\n\",\n      \"Predictions: [0 1 1 1 0 1 0 0 1 0 1 1 1 0 0 1 1 0 1 1], Labels: [0 1 1 1 0 0 0 1 1 0 1 1 1 0 0 1 1 0 1 0], Accuracy: 0.85\\n\",\n      \"['My inbox now has 0 messages. It feels good to get organized.', 'Just saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.', 'HT @TheOnion: 5-Year-Old Critics Agree: Movie \\\"Cars\\\" Only Gets Better After 40th Viewing', \\\"It's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\\\", \\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\", 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.', 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"', 'Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.', 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.', 'I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.', \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\", 'Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.', \\\"Why can't we get good disaster movies?\\\", \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\", 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.', 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.', 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage', 'I love the smell of coffee in the morning. It smells like victory.', \\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\", 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.']\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.28\\n\",\n      \"Predictions: [0 1 1 1 0 0 0 0 1 0 0 1 1 0 0 0 1 0 0 1], Labels: [0 1 1 1 0 1 1 0 1 0 0 1 1 0 0 0 1 0 0 1], Accuracy: 0.9\\n\",\n      \"['I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"', 'I wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people', 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.', 'One of my superpowers is the ability to abandon a book or movie halfway through.', 'Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.', 'Recently watched the movie The Bay. Anyone want to go for a swim?', 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?', \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\", 'Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.', 'It would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.', 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.', 'Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.', 'Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp', \\\"According to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\\\", 'Want evidence of intelligent machines? Captchas are now too hard for me.', \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\", \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\", 'There is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.', 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.', 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.']\\n\",\n      \"Loss: 0.08\\n\",\n      \"Predictions: [0], Labels: [0], Accuracy: 1.0\\n\",\n      \"['Amazing how black socks change to blue when you take them out of the dresser drawer.']\\n\",\n      \"STARTING EPOCH:  9\\n\",\n      \"Loss: 0.18\\n\",\n      \"Predictions: [0 1 1 1 1 0 0 0 0 1 0 0 0 1 1 0 1 0 0 0], Labels: [0 1 1 1 1 0 0 0 0 1 0 0 0 0 1 0 1 0 0 0], Accuracy: 0.95\\n\",\n      \"[\\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\", \\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\", 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.', 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.', \\\"I bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\\\", \\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\", \\\"It's amazing how much joy in life comes from making and executing plans.\\\", 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.', 'Want evidence of intelligent machines? Captchas are now too hard for me.', 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.', 'I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?', 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"', 'Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.', \\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\", 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.', 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.', 'It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!', \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\", 'It would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.', 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.']\\n\",\n      \"Loss: 0.25\\n\",\n      \"Predictions: [1 1 0 0 1 0 0 1 0 0 1 0 0 1 1 0 0 0 0 0], Labels: [1 1 0 0 1 0 0 1 0 0 1 0 1 1 1 0 0 0 1 0], Accuracy: 0.9\\n\",\n      \"[\\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\", 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit', 'Wrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.', 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"', \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\", 'My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.', 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.', 'I wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people', 'Good comedy consists of statements that are both true and absurd.', \\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\", 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.', 'Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.', \\\"Why can't we get good disaster movies?\\\", 'Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.', 'Recently watched the movie The Bay. Anyone want to go for a swim?', 'I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"', 'I learned a new word yesterday. aliteracy: people who can read but choose not to.', 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.', 'I love it when movies about ghosts are \\\"based on a true story.\\\"', \\\"I wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\\\"]\\n\",\n      \"Loss: 0.27\\n\",\n      \"Predictions: [1 0 0 0 0 0 0 0 0 1 1 0 1 0 1 0 1 0 0 1], Labels: [1 0 0 0 1 0 0 1 0 1 1 0 1 1 1 0 1 1 0 0], Accuracy: 0.75\\n\",\n      \"['Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.', 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing', 'Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?', 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.', 'Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.', 'I love the smell of coffee in the morning. It smells like victory.', 'I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.', 'Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?', 'Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.', \\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\", \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\", \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\", \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\", 'Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp', \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\", \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\", \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\", \\\"It's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\\\", \\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\", \\\"Just got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\\\"]\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Loss: 0.20\\n\",\n      \"Predictions: [0 0 1 0 0 1 1 0 1 1 0 1 1 0 0 0 0 1 1 0], Labels: [0 1 1 1 0 1 1 0 1 1 0 1 1 0 0 0 0 1 1 0], Accuracy: 0.9\\n\",\n      \"[\\\"My son (7) wants to know why he can't have a credit card.\\\", \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\", 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.', 'When they show scientists in movies, they never show them making PowerPoint slides.', 'I love how a good book becomes part of your mental life forever.', \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\", 'HT @TheOnion: 5-Year-Old Critics Agree: Movie \\\"Cars\\\" Only Gets Better After 40th Viewing', \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\", 'Went to Costco for the first time not too long ago. That place is a disaster movie.', 'Someday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.', 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.', 'Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.', 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.', \\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\", 'There is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.', \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\", 'I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary', 'One of my superpowers is the ability to abandon a book or movie halfway through.', \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\", 'I keep buying pyrite but I must be doing something wrong.']\\n\",\n      \"Loss: 0.30\\n\",\n      \"Predictions: [1 0 1 0 1 0 0 0 0 1 0 0 1 0 1 0 1 1 0 0], Labels: [1 0 1 0 0 0 0 0 0 1 0 0 1 0 0 1 1 1 0 0], Accuracy: 0.85\\n\",\n      \"['Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.', 'My inbox now has 0 messages. It feels good to get organized.', \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\", \\\"According to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\\\", \\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\", \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\", 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.', 'Amazing how black socks change to blue when you take them out of the dresser drawer.', 'Fame and fortune await the first person to develop a robot that powers itself by eating fire ants.', \\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\", 'Coat hangers are very poorly behaved objects.', 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.', 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage', 'Sugar is the enemy. Sugar gives me life. #Productivity', \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\", 'Movies should bring back quicksand. We all need to be reminded of the dangers.', \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\", 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?', 'I coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.', \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\"]\\n\",\n      \"Loss: 0.01\\n\",\n      \"Predictions: [1], Labels: [1], Accuracy: 1.0\\n\",\n      \"['Just saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.']\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"# For writing to TensorBoard\\n\",\n    \"summary = SummaryWriter(data_dir)\\n\",\n    \"\\n\",\n    \"global_step = 0\\n\",\n    \"\\n\",\n    \"for epoch in range(10):\\n\",\n    \"\\n\",\n    \"    print(\\\"STARTING EPOCH: \\\",epoch)\\n\",\n    \"\\n\",\n    \"    for input_tuple in train_data_loader:\\n\",\n    \"\\n\",\n    \"        global_step += 1\\n\",\n    \"        input_data, mask_data, labels, tweets = input_tuple\\n\",\n    \"        log_softmax, _vectors = classifier(input_data, mask_data)\\n\",\n    \"        loss = F.nll_loss(log_softmax, labels)\\n\",\n    \"\\n\",\n    \"        # Gradients accumulate and you have to clear them out ever time\\n\",\n    \"        bert_optimizer.zero_grad()\\n\",\n    \"        head_optimizer.zero_grad()\\n\",\n    \"\\n\",\n    \"        # Get the gradients with respect to the parameters\\n\",\n    \"        loss.backward()\\n\",\n    \"\\n\",\n    \"        # Update the parameters\\n\",\n    \"        bert_optimizer.step()\\n\",\n    \"        head_optimizer.step()\\n\",\n    \"\\n\",\n    \"        print(f\\\"Loss: {loss:.2f}\\\")\\n\",\n    \"\\n\",\n    \"        preds = log_softmax.argmax(1)\\n\",\n    \"\\n\",\n    \"        preds_np = preds.detach().numpy()\\n\",\n    \"        labels_np = labels.detach().numpy()\\n\",\n    \"\\n\",\n    \"        batch_size = labels_np.shape[0]\\n\",\n    \"\\n\",\n    \"        # noinspection PyTypeChecker\\n\",\n    \"        accuracy = sum(labels_np == preds_np) / batch_size\\n\",\n    \"\\n\",\n    \"        print(f\\\"Predictions: {preds_np}, Labels: {labels_np}, Accuracy: {accuracy}\\\")\\n\",\n    \"        print(tweets)\\n\",\n    \"\\n\",\n    \"        summary.add_scalar('loss_train', loss, global_step=global_step)\\n\",\n    \"        summary.add_scalar('accuracy', accuracy, global_step=global_step)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Save the model and print out the parameters\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 14,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"odict_keys(['encoder.embeddings.word_embeddings.weight', 'encoder.embeddings.position_embeddings.weight', 'encoder.embeddings.token_type_embeddings.weight', 'encoder.embeddings.LayerNorm.weight', 'encoder.embeddings.LayerNorm.bias', 'encoder.encoder.layer.0.attention.self.query.weight', 'encoder.encoder.layer.0.attention.self.query.bias', 'encoder.encoder.layer.0.attention.self.key.weight', 'encoder.encoder.layer.0.attention.self.key.bias', 'encoder.encoder.layer.0.attention.self.value.weight', 'encoder.encoder.layer.0.attention.self.value.bias', 'encoder.encoder.layer.0.attention.output.dense.weight', 'encoder.encoder.layer.0.attention.output.dense.bias', 'encoder.encoder.layer.0.attention.output.LayerNorm.weight', 'encoder.encoder.layer.0.attention.output.LayerNorm.bias', 'encoder.encoder.layer.0.intermediate.dense.weight', 'encoder.encoder.layer.0.intermediate.dense.bias', 'encoder.encoder.layer.0.output.dense.weight', 'encoder.encoder.layer.0.output.dense.bias', 'encoder.encoder.layer.0.output.LayerNorm.weight', 'encoder.encoder.layer.0.output.LayerNorm.bias', 'encoder.encoder.layer.1.attention.self.query.weight', 'encoder.encoder.layer.1.attention.self.query.bias', 'encoder.encoder.layer.1.attention.self.key.weight', 'encoder.encoder.layer.1.attention.self.key.bias', 'encoder.encoder.layer.1.attention.self.value.weight', 'encoder.encoder.layer.1.attention.self.value.bias', 'encoder.encoder.layer.1.attention.output.dense.weight', 'encoder.encoder.layer.1.attention.output.dense.bias', 'encoder.encoder.layer.1.attention.output.LayerNorm.weight', 'encoder.encoder.layer.1.attention.output.LayerNorm.bias', 'encoder.encoder.layer.1.intermediate.dense.weight', 'encoder.encoder.layer.1.intermediate.dense.bias', 'encoder.encoder.layer.1.output.dense.weight', 'encoder.encoder.layer.1.output.dense.bias', 'encoder.encoder.layer.1.output.LayerNorm.weight', 'encoder.encoder.layer.1.output.LayerNorm.bias', 'encoder.encoder.layer.2.attention.self.query.weight', 'encoder.encoder.layer.2.attention.self.query.bias', 'encoder.encoder.layer.2.attention.self.key.weight', 'encoder.encoder.layer.2.attention.self.key.bias', 'encoder.encoder.layer.2.attention.self.value.weight', 'encoder.encoder.layer.2.attention.self.value.bias', 'encoder.encoder.layer.2.attention.output.dense.weight', 'encoder.encoder.layer.2.attention.output.dense.bias', 'encoder.encoder.layer.2.attention.output.LayerNorm.weight', 'encoder.encoder.layer.2.attention.output.LayerNorm.bias', 'encoder.encoder.layer.2.intermediate.dense.weight', 'encoder.encoder.layer.2.intermediate.dense.bias', 'encoder.encoder.layer.2.output.dense.weight', 'encoder.encoder.layer.2.output.dense.bias', 'encoder.encoder.layer.2.output.LayerNorm.weight', 'encoder.encoder.layer.2.output.LayerNorm.bias', 'encoder.encoder.layer.3.attention.self.query.weight', 'encoder.encoder.layer.3.attention.self.query.bias', 'encoder.encoder.layer.3.attention.self.key.weight', 'encoder.encoder.layer.3.attention.self.key.bias', 'encoder.encoder.layer.3.attention.self.value.weight', 'encoder.encoder.layer.3.attention.self.value.bias', 'encoder.encoder.layer.3.attention.output.dense.weight', 'encoder.encoder.layer.3.attention.output.dense.bias', 'encoder.encoder.layer.3.attention.output.LayerNorm.weight', 'encoder.encoder.layer.3.attention.output.LayerNorm.bias', 'encoder.encoder.layer.3.intermediate.dense.weight', 'encoder.encoder.layer.3.intermediate.dense.bias', 'encoder.encoder.layer.3.output.dense.weight', 'encoder.encoder.layer.3.output.dense.bias', 'encoder.encoder.layer.3.output.LayerNorm.weight', 'encoder.encoder.layer.3.output.LayerNorm.bias', 'encoder.encoder.layer.4.attention.self.query.weight', 'encoder.encoder.layer.4.attention.self.query.bias', 'encoder.encoder.layer.4.attention.self.key.weight', 'encoder.encoder.layer.4.attention.self.key.bias', 'encoder.encoder.layer.4.attention.self.value.weight', 'encoder.encoder.layer.4.attention.self.value.bias', 'encoder.encoder.layer.4.attention.output.dense.weight', 'encoder.encoder.layer.4.attention.output.dense.bias', 'encoder.encoder.layer.4.attention.output.LayerNorm.weight', 'encoder.encoder.layer.4.attention.output.LayerNorm.bias', 'encoder.encoder.layer.4.intermediate.dense.weight', 'encoder.encoder.layer.4.intermediate.dense.bias', 'encoder.encoder.layer.4.output.dense.weight', 'encoder.encoder.layer.4.output.dense.bias', 'encoder.encoder.layer.4.output.LayerNorm.weight', 'encoder.encoder.layer.4.output.LayerNorm.bias', 'encoder.encoder.layer.5.attention.self.query.weight', 'encoder.encoder.layer.5.attention.self.query.bias', 'encoder.encoder.layer.5.attention.self.key.weight', 'encoder.encoder.layer.5.attention.self.key.bias', 'encoder.encoder.layer.5.attention.self.value.weight', 'encoder.encoder.layer.5.attention.self.value.bias', 'encoder.encoder.layer.5.attention.output.dense.weight', 'encoder.encoder.layer.5.attention.output.dense.bias', 'encoder.encoder.layer.5.attention.output.LayerNorm.weight', 'encoder.encoder.layer.5.attention.output.LayerNorm.bias', 'encoder.encoder.layer.5.intermediate.dense.weight', 'encoder.encoder.layer.5.intermediate.dense.bias', 'encoder.encoder.layer.5.output.dense.weight', 'encoder.encoder.layer.5.output.dense.bias', 'encoder.encoder.layer.5.output.LayerNorm.weight', 'encoder.encoder.layer.5.output.LayerNorm.bias', 'encoder.encoder.layer.6.attention.self.query.weight', 'encoder.encoder.layer.6.attention.self.query.bias', 'encoder.encoder.layer.6.attention.self.key.weight', 'encoder.encoder.layer.6.attention.self.key.bias', 'encoder.encoder.layer.6.attention.self.value.weight', 'encoder.encoder.layer.6.attention.self.value.bias', 'encoder.encoder.layer.6.attention.output.dense.weight', 'encoder.encoder.layer.6.attention.output.dense.bias', 'encoder.encoder.layer.6.attention.output.LayerNorm.weight', 'encoder.encoder.layer.6.attention.output.LayerNorm.bias', 'encoder.encoder.layer.6.intermediate.dense.weight', 'encoder.encoder.layer.6.intermediate.dense.bias', 'encoder.encoder.layer.6.output.dense.weight', 'encoder.encoder.layer.6.output.dense.bias', 'encoder.encoder.layer.6.output.LayerNorm.weight', 'encoder.encoder.layer.6.output.LayerNorm.bias', 'encoder.encoder.layer.7.attention.self.query.weight', 'encoder.encoder.layer.7.attention.self.query.bias', 'encoder.encoder.layer.7.attention.self.key.weight', 'encoder.encoder.layer.7.attention.self.key.bias', 'encoder.encoder.layer.7.attention.self.value.weight', 'encoder.encoder.layer.7.attention.self.value.bias', 'encoder.encoder.layer.7.attention.output.dense.weight', 'encoder.encoder.layer.7.attention.output.dense.bias', 'encoder.encoder.layer.7.attention.output.LayerNorm.weight', 'encoder.encoder.layer.7.attention.output.LayerNorm.bias', 'encoder.encoder.layer.7.intermediate.dense.weight', 'encoder.encoder.layer.7.intermediate.dense.bias', 'encoder.encoder.layer.7.output.dense.weight', 'encoder.encoder.layer.7.output.dense.bias', 'encoder.encoder.layer.7.output.LayerNorm.weight', 'encoder.encoder.layer.7.output.LayerNorm.bias', 'encoder.encoder.layer.8.attention.self.query.weight', 'encoder.encoder.layer.8.attention.self.query.bias', 'encoder.encoder.layer.8.attention.self.key.weight', 'encoder.encoder.layer.8.attention.self.key.bias', 'encoder.encoder.layer.8.attention.self.value.weight', 'encoder.encoder.layer.8.attention.self.value.bias', 'encoder.encoder.layer.8.attention.output.dense.weight', 'encoder.encoder.layer.8.attention.output.dense.bias', 'encoder.encoder.layer.8.attention.output.LayerNorm.weight', 'encoder.encoder.layer.8.attention.output.LayerNorm.bias', 'encoder.encoder.layer.8.intermediate.dense.weight', 'encoder.encoder.layer.8.intermediate.dense.bias', 'encoder.encoder.layer.8.output.dense.weight', 'encoder.encoder.layer.8.output.dense.bias', 'encoder.encoder.layer.8.output.LayerNorm.weight', 'encoder.encoder.layer.8.output.LayerNorm.bias', 'encoder.encoder.layer.9.attention.self.query.weight', 'encoder.encoder.layer.9.attention.self.query.bias', 'encoder.encoder.layer.9.attention.self.key.weight', 'encoder.encoder.layer.9.attention.self.key.bias', 'encoder.encoder.layer.9.attention.self.value.weight', 'encoder.encoder.layer.9.attention.self.value.bias', 'encoder.encoder.layer.9.attention.output.dense.weight', 'encoder.encoder.layer.9.attention.output.dense.bias', 'encoder.encoder.layer.9.attention.output.LayerNorm.weight', 'encoder.encoder.layer.9.attention.output.LayerNorm.bias', 'encoder.encoder.layer.9.intermediate.dense.weight', 'encoder.encoder.layer.9.intermediate.dense.bias', 'encoder.encoder.layer.9.output.dense.weight', 'encoder.encoder.layer.9.output.dense.bias', 'encoder.encoder.layer.9.output.LayerNorm.weight', 'encoder.encoder.layer.9.output.LayerNorm.bias', 'encoder.encoder.layer.10.attention.self.query.weight', 'encoder.encoder.layer.10.attention.self.query.bias', 'encoder.encoder.layer.10.attention.self.key.weight', 'encoder.encoder.layer.10.attention.self.key.bias', 'encoder.encoder.layer.10.attention.self.value.weight', 'encoder.encoder.layer.10.attention.self.value.bias', 'encoder.encoder.layer.10.attention.output.dense.weight', 'encoder.encoder.layer.10.attention.output.dense.bias', 'encoder.encoder.layer.10.attention.output.LayerNorm.weight', 'encoder.encoder.layer.10.attention.output.LayerNorm.bias', 'encoder.encoder.layer.10.intermediate.dense.weight', 'encoder.encoder.layer.10.intermediate.dense.bias', 'encoder.encoder.layer.10.output.dense.weight', 'encoder.encoder.layer.10.output.dense.bias', 'encoder.encoder.layer.10.output.LayerNorm.weight', 'encoder.encoder.layer.10.output.LayerNorm.bias', 'encoder.encoder.layer.11.attention.self.query.weight', 'encoder.encoder.layer.11.attention.self.query.bias', 'encoder.encoder.layer.11.attention.self.key.weight', 'encoder.encoder.layer.11.attention.self.key.bias', 'encoder.encoder.layer.11.attention.self.value.weight', 'encoder.encoder.layer.11.attention.self.value.bias', 'encoder.encoder.layer.11.attention.output.dense.weight', 'encoder.encoder.layer.11.attention.output.dense.bias', 'encoder.encoder.layer.11.attention.output.LayerNorm.weight', 'encoder.encoder.layer.11.attention.output.LayerNorm.bias', 'encoder.encoder.layer.11.intermediate.dense.weight', 'encoder.encoder.layer.11.intermediate.dense.bias', 'encoder.encoder.layer.11.output.dense.weight', 'encoder.encoder.layer.11.output.dense.bias', 'encoder.encoder.layer.11.output.LayerNorm.weight', 'encoder.encoder.layer.11.output.LayerNorm.bias', 'encoder.pooler.dense.weight', 'encoder.pooler.dense.bias', 'classes.weight', 'classes.bias'])\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"# Let's save the model (we'll use it in the next video)\\n\",\n    \"torch.save(classifier.state_dict(), os.path.join(data_dir,'classifier_model.pt'))\\n\",\n    \"\\n\",\n    \"# Let's print out the state dict\\n\",\n    \"print(classifier.state_dict().keys())\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Look at the curves in TensorBoard\\n\",\n    \"\\n\",\n    \"`tensorboard --logdir=./`\\n\",\n    \"\\n\",\n    \"then go to http://localhost:6006/\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"You should see graphs that look like this\\n\",\n    \"![Tensorboard graphs](./tensorboard.png)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# In the next video, we'll look at these vectors in 3D space in TensorBoard and compare them with the vectors created in episode 1\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 17,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"(101, 768)\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"import numpy as np\\n\",\n    \"import pickle\\n\",\n    \"\\n\",\n    \"classifier.eval()  # needed when the model uses things like dropout\\n\",\n    \"\\n\",\n    \"\\n\",\n    \"all_vectors_np = []\\n\",\n    \"all_tweets = []\\n\",\n    \"for input_tuple in train_data_loader:\\n\",\n    \"\\n\",\n    \"        input_data, mask_data, labels, tweets = input_tuple\\n\",\n    \"        _log_softmax, vectors = classifier(input_data, mask_data)\\n\",\n    \"        \\n\",\n    \"        vectors_np = vectors.detach().numpy()\\n\",\n    \"        all_vectors_np.append(vectors_np)\\n\",\n    \"        all_tweets.extend(tweets)\\n\",\n    \"\\n\",\n    \"all_vecs = np.concatenate(all_vectors_np, axis=0)\\n\",\n    \"print(all_vecs.shape)\\n\",\n    \"\\n\",\n    \"\\n\",\n    \"custom_data = {'tweets':all_tweets, 'vecs':all_vecs}\\n\",\n    \"\\n\",\n    \"custom_vec_pickle_file = os.path.join(data_dir, 'custom_vecs.pkl')\\n\",\n    \"with open(custom_vec_pickle_file, 'wb') as f:\\n\",\n    \"        pickle.dump(custom_data, f)\\n\",\n    \"\\n\"\n   ]\n  }\n ],\n \"metadata\": {\n  \"kernelspec\": {\n   \"display_name\": \"Python 3.7.4 64-bit ('base': conda)\",\n   \"language\": \"python\",\n   \"name\": \"python37464bitbaseconda6a86cbe610af4db3860115ffdb24f1cc\"\n  },\n  \"language_info\": {\n   \"codemirror_mode\": {\n    \"name\": \"ipython\",\n    \"version\": 3\n   },\n   \"file_extension\": \".py\",\n   \"mimetype\": \"text/x-python\",\n   \"name\": \"python\",\n   \"nbconvert_exporter\": \"python\",\n   \"pygments_lexer\": \"ipython3\",\n   \"version\": \"3.7.4\"\n  }\n },\n \"nbformat\": 4,\n \"nbformat_minor\": 2\n}\n"
  },
  {
    "path": "Episode_3_Visualizing_Vectors.ipynb",
    "content": "{\n \"cells\": [\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {\n    \"slideshow\": {\n     \"slide_type\": \"slide\"\n    }\n   },\n   \"source\": [\n    \"# Visualizing Vectors with TensorBoard\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Recall\\n\",\n    \"* You need to do `pip install tensorboard`\\n\",\n    \"* Documentation on using TensorBoard in PyTorch https://pytorch.org/docs/stable/tensorboard.html\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 2,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"# import a bunch of stuff\\n\",\n    \"from typing import List, Tuple\\n\",\n    \"import scipy\\n\",\n    \"import numpy as np\\n\",\n    \"import os.path\\n\",\n    \"from pathlib import Path\\n\",\n    \"import pickle\\n\",\n    \"\\n\",\n    \"import torch  # PyTorch\\n\",\n    \"\\n\",\n    \"from transformers import BertModel, BertTokenizer, BertConfig\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Import the model\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 3,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"# https://huggingface.co/transformers/pretrained_models.html\\n\",\n    \"model_name = 'bert-base-uncased'\\n\",\n    \"\\n\",\n    \"# Need to use the same tokenizer that was used to train the model so that it breaks \\n\",\n    \"# up words into tokens the same way.\\n\",\n    \"tokenizer = BertTokenizer.from_pretrained(model_name)\\n\",\n    \"\\n\",\n    \"# This model is huge!!!!!!!!\\n\",\n    \"model = BertModel.from_pretrained(model_name)\\n\",\n    \"\\n\",\n    \"# Parameters used by the pre-trained model\\n\",\n    \"config = BertConfig.from_pretrained(model_name)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Recall our nice function to make the vectors.\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 4,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"def make_vector(text: str) -> np.ndarray:\\n\",\n    \"    tokens = get_tokens(text, tokenizer, config)\\n\",\n    \"    token_ids: List[int] = tokenizer.convert_tokens_to_ids(tokens)\\n\",\n    \"    token_ids_tensor = torch.tensor(token_ids)\\n\",\n    \"    token_ids_tensor = torch.unsqueeze(token_ids_tensor, 0)\\n\",\n    \"    last_hidden_state, pooler_output = model(token_ids_tensor)\\n\",\n    \"    vector = pooler_output\\n\",\n    \"    #vector = last_hidden_state.mean(dim=1)  # Can do this too\\n\",\n    \"    np_vector = vector.detach().numpy()\\n\",\n    \"    np_vector = np_vector.squeeze()\\n\",\n    \"    return np_vector\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Load Tweets\\n\",\n    \"Can be found at with the code at https://github.com/jmugan/modern_practical_nlp\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 5,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"all_tweets: List[str] = []\\n\",\n    \"with open('jmugan_tweets.txt', 'r') as f:\\n\",\n    \"    for tweet in f:\\n\",\n    \"        tweet = tweet.strip()  # remove newline\\n\",\n    \"        all_tweets.append(tweet)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Pull up the vectors from episode 1\\n\",\n    \"* You should already have them saved from episode 1, but this will generate them if not.\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 6,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Data directory:  /Users/jmugan/temp\\n\",\n      \"Loading saved transformer vecs.\\n\",\n      \"Loading saved average vecs.\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"home = str(Path.home())\\n\",\n    \"data_dir = os.path.join(home, 'temp')\\n\",\n    \"print(\\\"Data directory: \\\", data_dir)\\n\",\n    \"\\n\",\n    \"transformer_vec_pickle_file = os.path.join(data_dir, 'transformer_vecs.pkl')\\n\",\n    \"average_vec_pickle_file = os.path.join(data_dir, 'average_vecs.pkl')\\n\",\n    \"\\n\",\n    \"if os.path.isfile(transformer_vec_pickle_file):\\n\",\n    \"    print(\\\"Loading saved transformer vecs.\\\")\\n\",\n    \"    with open(transformer_vec_pickle_file, 'rb') as f:\\n\",\n    \"        all_transformer_vecs = pickle.load(f)\\n\",\n    \"else:\\n\",\n    \"    print(\\\"Generating transformer vecs.\\\")\\n\",\n    \"    all_transformer_vecs: List[np.ndarray] = []\\n\",\n    \"    for tweet in all_tweets:\\n\",\n    \"        vector = make_vector(tweet)\\n\",\n    \"        all_transformer_vecs.append(vector)\\n\",\n    \"    with open(transformer_vec_pickle_file, 'wb') as f:\\n\",\n    \"        pickle.dump(all_transformer_vecs, f)\\n\",\n    \"\\n\",\n    \"if os.path.isfile(average_vec_pickle_file):\\n\",\n    \"    print(\\\"Loading saved average vecs.\\\")\\n\",\n    \"    with open(average_vec_pickle_file, 'rb') as f:\\n\",\n    \"        all_average_vecs = pickle.load(f)\\n\",\n    \"else:\\n\",\n    \"    print(\\\"Generating average vecs.\\\")\\n\",\n    \"    all_average_vecs: List[np.ndarray] = []\\n\",\n    \"    for tweet in all_tweets:\\n\",\n    \"        vector = get_average_vector_for_text(tweet)\\n\",\n    \"        all_average_vecs.append(vector)\\n\",\n    \"    with open(average_vec_pickle_file, 'wb') as f:\\n\",\n    \"        pickle.dump(all_average_vecs, f)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Let's also pull up the vectors in the model from episode 2 where we trained the model to classify as about movies or not\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 7,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": [\n    \"custom_vec_pickle_file = os.path.join(data_dir, 'custom_vecs.pkl')\\n\",\n    \"with open(custom_vec_pickle_file, 'rb') as f:\\n\",\n    \"        custom_vecs = pickle.load(f)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Format the data to show\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 11,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"data\": {\n      \"text/plain\": [\n       \"[\\\"Cats don't like to wrestle.\\\",\\n\",\n       \" 'It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.',\\n\",\n       \" \\\"Amazing how worthless I would be if you sent me back in time 10,000 years. I could describe amazing technology but couldn't build any of it.\\\",\\n\",\n       \" \\\"I can't believe we still have pennies. They aren't even worth picking up off the ground.\\\",\\n\",\n       \" \\\"Sometimes you wake and wish the adventure dream you were having didn't have to end. I want video games with that much excitement and realism\\\",\\n\",\n       \" \\\"Why isn't there an app that lets me share photos with all my social media sites? Facebook, G+, Twitter. Oh yeah, #NoProfitInFreedom\\\",\\n\",\n       \" 'This weekend, I was able to convince my youngest son, age 7, to branch beyond chicken nuggets to Orange Chicken. #CulinaryVictory',\\n\",\n       \" \\\"I've found that being a fair-weather sports fan is a real time saver.\\\",\\n\",\n       \" 'My son, age 7, was playing \\\"restaurant,\\\" and the first thing he did was set up security cameras. #ModernWorld',\\n\",\n       \" \\\"I don't know why, but refactoring code is a lot of fun. #OddlySatisfying\\\",\\n\",\n       \" 'Happiness is working on your projects.',\\n\",\n       \" \\\"I can't tell if cats really enjoy the laser pointer, or if they find it profoundly frustrating.\\\",\\n\",\n       \" \\\"Remember when you could burn information? Dump out the files and set them on fire? Now, everything's backed up in 20 databases.\\\",\\n\",\n       \" 'Multiple background voices can be soothing for concentration, but trying to ignore a single conversation is a hell that hath no comparison.',\\n\",\n       \" 'I hate when I look up a concept on Wikipedia and the first sentence is incomprehensible. #Macrophage',\\n\",\n       \" 'I estimate that my youngest son has spent 20% of his waking life looking for misplaced objects.',\\n\",\n       \" \\\"As a computer scientist, DNA troubles me. I want it to be the source code for a person, but it's not that simple.\\\",\\n\",\n       \" \\\"My son, age 7, was frustrated that he couldn't open a package of scissors. I told him to get some scissors. He was not amused.\\\",\\n\",\n       \" \\\"I once heard that squirrels don't remember where they bury nuts. Instead, to find nuts, they look in good places to bury nuts. Anyone know?\\\",\\n\",\n       \" 'Sad how patents morphed from *how* to do things to *what* to do. Today, Eli Whitney could patent \\\"a machine to separate cotton from seeds.\\\"',\\n\",\n       \" 'I like that term \\\"robot smog\\\" by Illah Nourbakhsh. I love the idea of flying robots, but I dread the possibility of more noise pollution.',\\n\",\n       \" 'I love the sound of rain.',\\n\",\n       \" \\\"It's hard to travel right. You go from one homogeneous hotel to the next. I want to see real lives.\\\",\\n\",\n       \" 'Imagine being Rick Astley. Every time you walk into a room unexpectedly, you rickroll everyone there.',\\n\",\n       \" '\\\"No? I thought you were the king of all things old?\\\"   --My 25-year-old co-worker asking me if I\\\\'d ever heard of a card game named Magic.',\\n\",\n       \" 'Depositing checks has really changed in my lifetime. 1. Goto bank. 2. Goto ATM w/ form & envelope. 3. Goto ATM put them in. 4. Take picture.',\\n\",\n       \" 'The term \\\"happily married\\\" probably needs to be retired ... Oh, you\\\\'re HAPPILY married; why didn\\\\'t you say so?',\\n\",\n       \" 'I love crazy expressions. \\\"There\\\\'s more than one way to skin a cat.\\\" Why on earth would you want to do that?',\\n\",\n       \" \\\"I wonder what the brain's equivalent of a log file is.\\\",\\n\",\n       \" 'Sugar is the enemy. Sugar gives me life. #Productivity',\\n\",\n       \" 'You wake up to some dreams that feel so real. It feels like you should be able to talk to the other people in them about the experience.',\\n\",\n       \" 'Sometimes, you can make a boring task fun by automating part of it. Sometimes, getting organized helps. Other times, well ...',\\n\",\n       \" \\\"Spelling bees are profoundly boring until your kid gets up there; then they're terrifying.\\\",\\n\",\n       \" 'Popular culture celebrates sticking to your guns in an argument, I wish it celebrated being open minded with the same vigor',\\n\",\n       \" \\\"Remember all the hype in the 1990s about hydrogen powered cars? It looks like we'll have self-driving cars first. I would not have guessed.\\\",\\n\",\n       \" \\\"Next time I get to name a band or soccer team, it's gonna be called java.lang.NoClassDefFoundError.\\\",\\n\",\n       \" 'Dreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.',\\n\",\n       \" 'Java is the stubborn mule of programming languages. #ClassNotFoundException',\\n\",\n       \" 'Sometimes, I could swear that Java is being deliberately obtuse when it comes to finding classes. #Stubborn',\\n\",\n       \" 'Amazing how you can read something and think, \\\"OK, I got it,\\\" and then start doing it and realize that you don\\\\'t got it. #HiddenDetails',\\n\",\n       \" \\\"So I'm at the grocery store, and suddenly this guy is looking at me all weird. Turns out, I was putting my stuff in his basket. #Oops\\\",\\n\",\n       \" \\\"Yeah, so what happened to the famous London fog? I've never seen it. I guess it was air pollution that finally got cleaned up.\\\",\\n\",\n       \" 'My blog has 113,350 comments awaiting moderation---all of them spam.',\\n\",\n       \" 'Companies who send me mail seem to be unclear on the meaning of the word \\\"important.\\\" #ImportantInformationEnclosed',\\n\",\n       \" \\\"In games, someone else has done the interesting work of defining the world. You just wander within the confines of the designer's mind.\\\",\\n\",\n       \" 'I pity those who make hot chocolate with water instead of coffee.',\\n\",\n       \" \\\"It's always weird to me when a pen runs out of ink. I generally lose them before we get to that point.\\\",\\n\",\n       \" \\\"Watched The East. Pretty disappointed. Cliche after cliche. And it didn't even do a good job of laying out the issues.\\\",\\n\",\n       \" '\\\"Do you remember before the internet?\\\" I love that question. It points to a divide. My kids will wonder how we found people or ordered pizza',\\n\",\n       \" 'Baking a pie seems like a reasonable thing to do, but if you buy the ingredients at Whole Foods, that treat will cost you just south of $50.',\\n\",\n       \" 'When I was younger, I used to sit around and wonder all day why we were here. Now, I just go to meetings.',\\n\",\n       \" \\\"I wish that there were a BuzzFeed for middle-aged people who don't care about celebrities.\\\",\\n\",\n       \" \\\"Someday, it's going to seem barbaric that we drove our own cars. Especially since we frequently drove them into trees.\\\",\\n\",\n       \" 'I want to be pulled by the day instead of being pushed through by the things I have to do.',\\n\",\n       \" \\\"I can't make myself go workout. But I can make myself drive to the gym. Then, I can make myself go inside. Once inside I'm too lazy to leave\\\",\\n\",\n       \" 'Brought my own olive oil to work for salads. Getting fancy, but they forced my hand. \\\"Olive oil dressing\\\" is mostly sunflower oil.',\\n\",\n       \" 'One time, people broke into my apartment to vacuum. I came home and the carpet looked great. Weirdest thing.',\\n\",\n       \" \\\"It's funny how we all think that rapidly changing weather is unique to our own locale.\\\",\\n\",\n       \" \\\"Alright. I've read pretty much the whole internet. Time to get back to work.\\\",\\n\",\n       \" 'I discovered something profound today. You can treat cauliflower like squash and put lots of pepper on it. That vastly improves things.',\\n\",\n       \" 'I just used the adjective \\\"googleable.\\\" I win.',\\n\",\n       \" '\\\"The user name or password entered is incorrect. Or maybe our service is down or our servers aren\\\\'t synced. Or, anything really. Go away.\\\"',\\n\",\n       \" \\\"Went to sell my car once. Guy asked if I took care of it. I said yes. He opened the hood and found a bird's nest in the engine compartment.\\\",\\n\",\n       \" 'My first Google search was \\\"Eiffel Tower.\\\" The next search was \\\"Walmart,\\\" and the fourth result was how to buy Eiffel Towers at Walmart.',\\n\",\n       \" \\\"Going to a seminar on leadership seems to be a bit of an oxymoron. Leadership isn't a thing--it's a byproduct of implementing change.\\\",\\n\",\n       \" 'That song \\\"Tequila Makes Her Clothes Fall Off\\\" is interesting. It is so sweet. You wouldn\\\\'t expect that from the title.',\\n\",\n       \" \\\"Dreamed about the apocalypse last night. The warlord would throw rocks at you if you wouldn't join his clan. I really needed a machine gun.\\\",\\n\",\n       \" 'I made the mistake of feeding the cats once. Now, they think that I do things, and they hassle me to no end.',\\n\",\n       \" 'As a Python programmer, I find the keyword \\\"new\\\" in Java to be confusing because it is superfluous.',\\n\",\n       \" \\\"You don't hear much about bazookas anymore. Why is that?\\\",\\n\",\n       \" 'Remember when TV stations used to stop broadcasting late each night? There was literally nothing on except bars of color.',\\n\",\n       \" 'I love how Microsoft Word respects your decision to ignore a grammar mistake, at least until you change any word in any part of the document',\\n\",\n       \" '\\\"What does your garage door say about you?\\\" --TV',\\n\",\n       \" 'I feel like a sucker saving for retirement when medical bills from a heart attack could wipe me out. Or there could be a robot apocalypse.',\\n\",\n       \" 'I was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.',\\n\",\n       \" \\\"I've got a bad case of hiccups. It's 2017, and a paper bag is our most advanced hiccup-related technology.\\\",\\n\",\n       \" \\\"I've read about 20% of Confederacy of Dunces, and I haven't decided if I will finish it. It is pretty darn funny, but it's no Catch-22.\\\",\\n\",\n       \" \\\"It's funny how, in a group, the result of hoarding is more hoarding.\\\",\\n\",\n       \" 'Who remembers TQM?  (Total Quality Management) It was all the rage back in the 90s, but I never could get anytime to tell me what it was.',\\n\",\n       \" \\\"I never understood what writer's block was until today, when I wrote well and realized that writer's block to me was like water to a fish.\\\",\\n\",\n       \" 'My son, age 7, got a letter from our health insurance company. It begins, \\\"Please read this letter for important information about your ...\\\"',\\n\",\n       \" \\\"You people who don't eat much, does your body not tell you that you are hungry? Or do you suffer suffering better than the rest of us?\\\",\\n\",\n       \" 'Neighbors got a new scary dog. I decided to go over and meet him so I could get on his list of people not to murder.',\\n\",\n       \" \\\"Wife complains I can't find anything in the pantry. I tell her scientists say the eyes dart around and only see small bits. #NotImpressed\\\",\\n\",\n       \" \\\"Google is huge in our lives, but you can't call them. Easiest way to get customer service is to get a PhD and wait for a recruiter to call.\\\",\\n\",\n       \" \\\"Who versus whom. I can be pretentious, or I can be correct. But I can't win.\\\",\\n\",\n       \" 'Recently watched Mud. I got to say, I think it was overrated. But I did like the juxtaposition of old and new environments at the very end.',\\n\",\n       \" \\\"Sudafed makes me feel both tired and wired at the same time. But hey, at least I don't have a runny nose.\\\",\\n\",\n       \" 'It\\\\'s funny. In sports, it is a good thing to be \\\"on fire.\\\" That is not true in real life.',\\n\",\n       \" 'I sometimes wonder if our entire lives and thoughts are shaped by a few dozen random events. Those that make us go: \\\"From now on ...\\\"',\\n\",\n       \" 'Remember using quarters to save your place in line for an arcade game? Somehow, the next quarter always belonged to the biggest kid.',\\n\",\n       \" 'My wife wants me to take my smartphone with me when I go for walks, but having the internet with me kind of defeats the point of the walk.',\\n\",\n       \" 'Funny how the big moments of our lives only feel big in retrospect. At the time, they just feel like life.',\\n\",\n       \" \\\"They say that we have an inborn fear of snakes. If so, why don't dogs have it? If they do, why do they get bit so often?\\\",\\n\",\n       \" 'I love those quotes that say you shouldn\\\\'t care what anyone thinks. There\\\\'s a name for people like that: \\\"psychopath.\\\"',\\n\",\n       \" \\\"It's amazing how much we talk with our hands. That old joke about doing an interpretive dance isn't that far off.\\\",\\n\",\n       \" 'Now, if Google and Facebook paid you when they used your face in an ad, that would be different. I know, free service and all that, but',\\n\",\n       \" 'Youth soccer. Funny, when your kids scores a goal, you feel more relief than joy.',\\n\",\n       \" \\\"I'm trying to teach my kids the Zen perspective. When the noise in our head gets too loud, the here-and-now is a great thing to fall back on\\\",\\n\",\n       \" \\\"Adults see possible danger as probable, but adolescents equate low probably with zero probability. We've seen more rolls of the dice.\\\",\\n\",\n       \" \\\"Each new generation is more fit for the modern world and less fit for the natural one. I'm a caveman compared with my kids.\\\",\\n\",\n       \" \\\"I'd rather have cold coffee than burned coffee.\\\",\\n\",\n       \" 'cantaloupe or muskmelon?',\\n\",\n       \" 'Worries are just like a stack of plates. Only one is visible at once, and when you remove it, the next one immediately appears.',\\n\",\n       \" 'According to Facebook, my friends spend most of their time hanging out with famous people.',\\n\",\n       \" 'Recently watched Cloud Atlas. I have no idea what that was all about, but I applaud the effort of making something different.',\\n\",\n       \" 'Once sent our robot off to be repaired, and my son, age 7, asked when he was going to \\\"come back home.\\\" Like he was a person.',\\n\",\n       \" 'Imagine how many hours we waste every year as a society filling up our rental cars with two gallons of gas before returning them.',\\n\",\n       \" \\\"Hate when I can't find my mouse pointer. Even worse with two screens.\\\",\\n\",\n       \" 'If you survived the apocalypse and were the only person left, for how long would you continue to use your turn signal?',\\n\",\n       \" 'Weird that scientists and religious folk are at odds. They share the same beautiful trait of caring about something bigger than themselves.',\\n\",\n       \" \\\"Recently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\\\",\\n\",\n       \" 'Took my son, age 7, to a pond. He said, \\\"Wow, it was neat to get up close. Like seeing it in HD.\\\" #ModernKids',\\n\",\n       \" \\\"It's amazing how busy I've been the last few days doing nothing.\\\",\\n\",\n       \" \\\"I've come to love configuration files. #NotSomethingYouHearEveryDay They are beautiful in their own way, they harbor no secrets.\\\",\\n\",\n       \" 'You know that point you get during debugging where you no longer trust anything? Like, is the printf library function corrupted? Yep.',\\n\",\n       \" 'In college, we registered for classes on a computer, but we had to call that computer on a telephone. 67552# for History 101 at 8am.',\\n\",\n       \" \\\"Saw a graphing calculator at the store. Why do people still use those? Aren't there apps with better graphics and better calculating?\\\",\\n\",\n       \" \\\"On my walk, a snake dropped out of a tree and fell in the path right in front of me. It didn't even offer me an apple. #Texas\\\",\\n\",\n       \" \\\"I'm trying to understand the purpose of figurative language. It's like a shortcut that's longer than the direct route. Any ideas?\\\",\\n\",\n       \" 'Recently watched Oblivion, and I got to say, it was pretty darn good.',\\n\",\n       \" 'Gomer Pyle rocks. He is above all of our silly madness.',\\n\",\n       \" 'After the apocalypse, it would be weird to see all the solar yard lights pointing at empty houses. #TheMoreYouKnow',\\n\",\n       \" \\\"It's funny how deep questions and ignorant questions look alike. E.g., what is science?\\\",\\n\",\n       \" \\\"It's amazing how small other stores seem after spending time in Costco. Whole Foods feels like a 7-11.\\\",\\n\",\n       \" 'Abbreviations are from the devil.',\\n\",\n       \" \\\"My wife hates to send me to the grocery store because I return home with all kinds of crazy stuff that isn't on the list.\\\",\\n\",\n       \" 'I just put a package in the microwave that promises to \\\"expand my culinary horizons.\\\" That\\\\'s big talk for a frozen dinner.',\\n\",\n       \" 'I want some Doritos to fill that little hole in my soul.',\\n\",\n       \" \\\"I'm catching up on classic literature, but only those works I can understand with a single reading. The rest must wait until I retire.\\\",\\n\",\n       \" 'What does a lobbyist do, exactly? Why would anyone in power listen to someone who was paid to have an opinion?',\\n\",\n       \" 'The world is run by early risers. These people must be stopped.',\\n\",\n       \" 'I once called the front desk and asked the guy if he could tell me the checkout time. He said, \\\"No.\\\" I said, \\\"Ok.\\\" He hung up.',\\n\",\n       \" 'I wish that hotels allowed you to open the windows.',\\n\",\n       \" 'I love how hotels still have telephones. They now serve as glorified CBs to talk to the front desk. Hey there bellhop, you got your ears on?',\\n\",\n       \" \\\"I like a lot of kids movies, but I just can't get into these Ice Age films.\\\",\\n\",\n       \" 'I always feel like Elmer Fudd when I say the word \\\"specificity.\\\"',\\n\",\n       \" 'This Pope Francis seems like a surprisingly reasonable guy.',\\n\",\n       \" 'I can never remember if the word \\\"accuracy\\\" has two \\\\'c\\\\'s or two \\\\'r\\\\'s.',\\n\",\n       \" \\\"Potato chips are the worst. Simple carbs and high calories, AND WE CAN'T STOP EATING THEM. We're like insects to a diabetes bug zapper.\\\",\\n\",\n       \" 'My guess is that, in 30 years, military superiority will come down to which nation has the most powerful artificial intelligence.',\\n\",\n       \" \\\"It's funny, sometimes you try to do one task, and you just can't get into it--but you switch tasks and suddenly your body and mind perk up.\\\",\\n\",\n       \" \\\"Computer work isn't like heavy lifting. A strong person can carry twice as much as a weaker one, but a good technologist can outwork a group\\\",\\n\",\n       \" 'I find the constantly changing diet advice to be frustrating. Avoid fat! No, avoid carbs! Drink water! Never mind. Eat breakfast! Skip it.',\\n\",\n       \" 'Burned my finger boiling vegetables. They are not as healthful as claimed.',\\n\",\n       \" 'Today stats: 2 followers, 8 unfollowers, 16 followers offended, ignored by 5789, 14 followers annoyed, 3 followers asked about my house cat.',\\n\",\n       \" \\\"I can't believe that I'm middle aged. I try to grab life as it goes by, but it's slippery.\\\",\\n\",\n       \" \\\"John Denver says you are a poor man if you've never seen an eagle fly. Well, I have seen plenty of turkey vultures.\\\",\\n\",\n       \" 'Funny how little we change over the years. In high school, I used to go for runs in the middle of the night. Now, 25 years later, I still do',\\n\",\n       \" 'Funny how you immediately become thirsty the moment you run out of water.',\\n\",\n       \" 'I love the smell of coffee in the morning. It smells like victory.',\\n\",\n       \" 'Pandora lets me finally read the lyrics to all those songs I heard ad nauseam in car during the 1980s. Some were surprisingly good.',\\n\",\n       \" \\\"Dreamed that Jon Bon Jovi gave me a ride across campus in an old Cadillac. I guess he's not such a bad guy after all.\\\",\\n\",\n       \" \\\"Free money often costs more than it's worth.\\\",\\n\",\n       \" 'I feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary',\\n\",\n       \" 'I just wrote the word \\\"print\\\" and Google Docs flagged it as misspelled. It wanted me to write \\\"printf\\\". How cool is that?',\\n\",\n       \" \\\"The movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\\\",\\n\",\n       \" 'I actually like the idea of a homeowners association, but the implementation is flawed. Only the conscientious are punished. Others ignore.',\\n\",\n       \" 'We judge ourselves by the best examples of our work, but our competitors and adversaries judge us by our worst examples.',\\n\",\n       \" 'Why is slapstick funny? Does anyone know?',\\n\",\n       \" 'Litter offends the beauty of nature. We could build litter-cleaning robots, but then people would just throw more. #RobotsGetNoRespect',\\n\",\n       \" 'Told my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage',\\n\",\n       \" 'Going to the bookstore is the old-fashioned version of surfing the web.',\\n\",\n       \" \\\"I want to get rid of my old CDs, but I don't want to get rid of all those pointers to my old memories.\\\",\\n\",\n       \" 'Security measures like door locks and antivirus programs sadden me. Protecting ourselves from ourselves makes life unnecessarily complex.',\\n\",\n       \" 'A tweet said a marijuana book was an \\\"easy read.\\\" I suspect that there are few successful books on marijuana that are challenging reads.',\\n\",\n       \" 'My daughter, age 4, was angry the other day and said that she was going to put on her \\\"mad shoes.\\\"',\\n\",\n       \" \\\"I'd feel more reassured that philosophers aren't just making stuff up if they pointed more to concrete ideas and less to other philosophers.\\\",\\n\",\n       \" \\\"Told Mom about my latest get-rich-quick scheme. Just what every mom wants to hear. This one isn't even quick, and it won't make much money.\\\",\\n\",\n       \" 'Health insurance companies have come up with an uncountable number different kinds of deductible. They put the Hilbert Hotel to shame.',\\n\",\n       \" \\\"Pop songs like to proclaim that it is better to feel pain than nothing at all. I'm not so sure. Comfortably numb is pretty good.\\\",\\n\",\n       \" \\\"Finally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\\\",\\n\",\n       \" \\\"I'm having one of those brief moments where I feel 20 years younger. Know what I mean? Uh, yes, I am blaring Steve Winwood. What of it?\\\",\\n\",\n       \" 'I just cited David Attenborough in a cyber security document.',\\n\",\n       \" \\\"Finally reading The Kite Runner. I had put it off because I thought it would be cheesy and happy. I didn't expect Deliverance.\\\",\\n\",\n       \" \\\"I love how sports give us something pleasant to worry about. I'd rather ruminate about the home team than the future of my children.\\\",\\n\",\n       \" 'Being conscious slows life down. As we get older, we do more on autopilot, and that is probably why time seems to speed up.',\\n\",\n       \" \\\"(Someday, I'm going to write a whole chapter as a parenthetical.)\\\",\\n\",\n       \" \\\"Recently watched Lincoln. I wish that soundtrack would play every time I spoke in a meeting. I think I'll bring a tape player to work.\\\",\\n\",\n       \" \\\"Letter from SiriusXM says that if I sign up there are no cancellation fees. They should also tout that they won't punch me in the face.\\\",\\n\",\n       \" 'Paying bills is one of those rare activities that is both tedious and depressing.',\\n\",\n       \" \\\"It's amazing how many times I have to rewrite my work before it is decent.\\\",\\n\",\n       \" 'In college, beer was the sacred drink. There were rituals and incantations. In adulthood, the sacred drink is coffee.',\\n\",\n       \" \\\"Kids don't get out in nature enough. To fix this, I'm building an app so that they can virtually visit a forest! #UnclearOnTheConcept\\\",\\n\",\n       \" \\\"My coworkers didn't know what a radio button was. The knew about the kind on a computer screen, but about an actual radio button you push in\\\",\\n\",\n       \" '\\\"In response to warnings that its toilets could be hacked, INAX said it issued a security update for its toilets this month.\\\" #FutureIsHere',\\n\",\n       \" 'I recently learned about the \\\"Year 2038 Problem\\\" where the 32-bit date variables will overflow. I still have the bunker I dug for Y2K.',\\n\",\n       \" 'I wish there were a word processing program that Microsoft Excel could play nice with. You could paste rows, all sorts of stuff!',\\n\",\n       \" 'Should the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.',\\n\",\n       \" \\\"The boy said my name's Johnny, and it might be a sin, but I'll take your bet, and you're gonna regret, because I'm the best that's ever been\\\",\\n\",\n       \" 'One of my superpowers is the ability to abandon a book or movie halfway through.',\\n\",\n       \" 'I love that term, \\\"evidence-based medicine.\\\" You immediately wonder, \\\"What were they doing before?\\\"',\\n\",\n       \" 'Love it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.',\\n\",\n       \" \\\"Went to a retro arcade place for a child's b-day party. They had an Atari! I played Combat! That kid's mom didn't have a chance.\\\",\\n\",\n       \" 'Dreamed I went to a fancy restaurant without wearing a shirt. Clearly, I need to start wearing shirts to bed.',\\n\",\n       \" 'They say that you shouldn\\\\'t worry when coach yells at you--you should worry when coach *stops* yelling at you.\\\" #BroadlyApplicable',\\n\",\n       \" 'My son is playing minecraft again. I tell myself it is good for his education.',\\n\",\n       \" 'One of my favorite games is to take an absurd position in an argument and see how long I can defend it. #ReasonsWhyIHaveNoFriends',\\n\",\n       \" \\\"I wonder if plans are the root of unhappiness. Without plans, you can't be late.\\\",\\n\",\n       \" 'So the alarm clock at my hotel was quite polite. Instead of waking me with a jarring noise, it flashed an unobtrusive light at 7:00 AM.',\\n\",\n       \" \\\"It's so quaint when clocks aren't connected to the internet and don't know exactly what time it is.\\\",\\n\",\n       \" 'Wife says that driving around my hometown with me reminds her of riding with her grandma. \\\"Played baseball here, got beaten up over there...',\\n\",\n       \" 'I want to be man of leisure in the French countryside.',\\n\",\n       \" \\\"It's been years, and you still don't know me Pandora? This must be how my old girlfriends felt.\\\",\\n\",\n       \" \\\"I think a lot of conflicts arise between men and women because women underestimate men's ignorance of social cues.\\\",\\n\",\n       \" 'I was showing the kids my breakdancing moves, and my wife said it looked like I had a neurological condition.',\\n\",\n       \" 'It would be cool if science advanced to the point where we could predict the cost of renting a car before doing so.',\\n\",\n       \" 'Protip: When making a flight to Baltimore, the airport code is BWI. BAL will take you to Turkey.',\\n\",\n       \" \\\"Weird thing about getting older is you have outdated knowledge. I used to know a lot about Mexico, but I haven't been there since 1997.\\\",\\n\",\n       \" 'I want to live in the Hundred Acre Wood.',\\n\",\n       \" 'My son (age 10) while watching Indiana Jones said, \\\"I keep expecting to see a Wookie somewhere.\\\"',\\n\",\n       \" 'Sprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing',\\n\",\n       \" 'Is that driver texting, or is he just drunk? #RoadtripGames',\\n\",\n       \" 'My car is at that stage where you can\\\\'t let someone else drive it without detailed instructions. E.g., one does not simply \\\"close the door.\\\"',\\n\",\n       \" 'My son has been talking with his friends, and wants to know why some kids get more from the tooth fairy than others. #LifeIsRough',\\n\",\n       \" 'We had a cat that used to eat cantaloupe guts and plant the seeds in the flower beds. #FreshProduce #OrganicFarming',\\n\",\n       \" 'My cat seems to not understand the concept of \\\"working from home.\\\"',\\n\",\n       \" 'A great question to ask during a technical interview is \\\"What is your dream technology?\\\" Allows you to see both values and scope of thought.',\\n\",\n       \" 'My co-worker said she had an old monitor. I asked if her screen was amber or green. She had no idea what I was talking about. #GetOffMyLawn',\\n\",\n       \" 'Recently read \\\"Ready Player One.\\\" My kids are digital natives, but their kids will be virtual reality natives.',\\n\",\n       \" \\\"With hard decisions, you should flip a coin, and what you want will be revealed while it's in the air. Should I go to the gym or eat pizza?\\\",\\n\",\n       \" 'Son asked about why they built the Great Wall of China. I told him it was to keep the Mongolians out. Learned that from Southpark.',\\n\",\n       \" \\\"Recently saw Biutiful. Who are these crazy people who didn't like it? Sad and depressing, sure, but it was real (except for the ghosts).\\\",\\n\",\n       \" \\\"My son is 10, and I always wonder how he and my ten-year-old self would get along. Internet? Dude, let's play baseball.\\\",\\n\",\n       \" 'I propose time-to-coffee (TTC) as a quantitative measure of airline service. E.g., TTC in first class: 16 minutes. TTC in coach: 43 minutes.',\\n\",\n       \" 'Introductions must be more than summaries of the material---they must grab the reader by both teaching and raising questions. #amwriting',\\n\",\n       \" \\\"I don't understand why anyone eats Freebird's burritos. They're basically rice wrapped in a tortilla. #CarbsAllTheWayDown\\\",\\n\",\n       \" 'A good 20% of my Google searches begin with \\\"difference between ...\\\"',\\n\",\n       \" 'Me: \\\"You don\\\\'t really believe in leprechauns, do you?\\\" My son, age 7: \\\"No. But I believe in hillbilly leprechauns.\\\"',\\n\",\n       \" 'My daughter, when she was 3, used to refer to her older brothers as \\\"the prisoners\\\" during her tea parties.',\\n\",\n       \" \\\"I tell my wife that she needs to get on Twitter so she can know what's going on in my life.\\\",\\n\",\n       \" 'Soup stays too hot forever. We need to leverage this property into some kind of broth-based energy infrastructure.',\\n\",\n       \" 'Cab driver asked if I had cash for a $50 fare. What am I, a cocaine dealer?',\\n\",\n       \" \\\"Hemingway says that you should write drunk and edit sober. Unfortunately, I've got a lot of editing to do.\\\",\\n\",\n       \" 'Be aware: once you draw a line in Microsoft Word, it is there for the lifetime of your document. This is not a reversible operation.',\\n\",\n       \" \\\"Recently read The Reluctant Fundamentalist. I'll summarize it for you: My girlfriend doesn't want me; blame America.\\\",\\n\",\n       \" \\\"I've noticed that the attention my tweets receive is inversely proportional to how profound I think they are.\\\",\\n\",\n       \" 'I awake and wonder when I am going to get out of bed. I realize I\\\\'m moving toward the edge and think, \\\"Oh, I guess it\\\\'s now.\\\" #FreeWill',\\n\",\n       \" 'Whenever I fill out an expense report, I always want to put \\\"High tea with a Mr. Newman\\\" as the reason for travel. #Seinfeld',\\n\",\n       \" 'Have you ever suddenly woken up and realized you were a stranger in your own life? No? Me neither.',\\n\",\n       \" 'Italian soda should be called old soda or original soda or custom soda or anything besides Italian soda. Sounds so pretentious, and false.',\\n\",\n       \" 'Stephen King got the following advice on editing when he was first starting out: second draft = first draft - 10% #amediting',\\n\",\n       \" \\\"With a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\\\",\\n\",\n       \" \\\"Time leaves a sequence of small transformations. We'd love to go back in time, if only to be jolted by the sum of those changes all at once.\\\",\\n\",\n       \" 'Me: \\\"Won\\\\'t it be fun to build robots someday with Mommy and Daddy?\\\" My daughter, age 4: \\\"No. They will attack us.\\\"',\\n\",\n       \" 'Loved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp',\\n\",\n       \" 'Quote about never giving up: drink! Quote by Gandhi: drink! #TwitterQuoteDrinkingGame',\\n\",\n       \" 'Love that word \\\"arguably.\\\" You can arguably use it to make any claim you want.',\\n\",\n       \" \\\"Like the gambler's ruin, the business model of insurance companies is to outlast you. One can only call so many times before going insane.\\\",\\n\",\n       \" 'I got an email at work today to which I wanted to reply, \\\"Only a Sith deals in absolutes.\\\" #BeenWatchingTooMuchStarWars',\\n\",\n       \" '8-Year-Old Boy Surprises Marine Dad During Firefight In Afghanistan, HT @TheOnion',\\n\",\n       \" 'I heard my wife yell from downstairs that she was divorcing me. Turns out I misheard. She was \\\"endorsing\\\" me on LinkedIn.',\\n\",\n       \" 'Being professional means being a part in a machine; you suppress your humanity so that you are reliable and can work well with others.',\\n\",\n       \" \\\"HelloFax actually works pretty well for faxing. I can't believe that people still fax. Might as well have a footman deliver the message.\\\",\\n\",\n       \" 'Remember that game Myst? You just wander around and randomly try things to figure out a pointless riddle. I hated that game.',\\n\",\n       \" 'If you Google \\\"taco\\\" you find out they they have exactly 156 calories. Don\\\\'t know if all tacos are the same or if Google knows my next taco.',\\n\",\n       \" 'I could go for a free lunch right about now.',\\n\",\n       \" 'I immediately become suspicious of any line of code that says something like \\\"i = 74\\\"',\\n\",\n       \" 'From the mailbox: \\\"Congratulations. Your journey with Honda Financial Services has just begun.\\\" I love that. 60 months of congratulations.',\\n\",\n       \" 'I realized this morning that in most situations, the word \\\"puzzled\\\" is a much better choice than \\\"confused.\\\"',\\n\",\n       \" 'Funny how when you thank someone in an email, you have to use an exclamation point. Otherwise, it sounds sarcastic. Thanks.',\\n\",\n       \" '\\\"You just talked to someone on the phone, and that doesn\\\\'t count.\\\" UnitedHealthcare responding to their earlier promise to cover a test.',\\n\",\n       \" 'I love how \\\"sea salt\\\" is a fancy and socially acceptable way of labeling a product as having \\\"big loads of salt.\\\"',\\n\",\n       \" \\\"It's amazing how small your big ideas seem when you write them down.\\\",\\n\",\n       \" 'There are few things more frustrating in life than not being able to find a misplaced object.',\\n\",\n       \" 'My health insurance company can be be counted on to do the right thing...after they have exhausted all other possibilities. #Churchill',\\n\",\n       \" 'You know you\\\\'ve been reading too much Victorian-era literature when you use the phrase \\\"made an enquiry\\\" when emailing a customer.',\\n\",\n       \" '\\\"Jar Jar? You don\\\\'t like Jar Jar?\\\" My son, age 10.',\\n\",\n       \" 'I got my first real email from my son today (age 10). Neat to see his writing style and to communicate with him in writing.',\\n\",\n       \" 'Recently watched the movie The Bay. Anyone want to go for a swim?',\\n\",\n       \" 'Love it when colleagues without kids refer to my weekend plans as \\\"relaxing.\\\" My weekends are many things, but relaxing is not one of them.',\\n\",\n       \" \\\"I wish that going to sleep wasn't so much work.\\\",\\n\",\n       \" \\\"Recently saw 227 on TV. I haven't seen that show in over 25 years, but I still recognize the faces. The human brain is amazing.\\\",\\n\",\n       \" \\\"Spelling is a lost cause. There's far many more ways to misspell a word than to spell it correctly.\\\",\\n\",\n       \" \\\"Do they really think that I'm ambitious enough to take my frozen dinner out of the microwave, stir, AND put it back in for two more minutes?\\\",\\n\",\n       \" 'Every time I give my email address to any organization for any reason, I end up on their mailing list. #LawOfNature #UnsubscribeFatigue',\\n\",\n       \" 'The old man the boats. #TakeThatGrammarChecker',\\n\",\n       \" 'It feels like I could quit my job and live on all these random class-action-lawsuit checks I get. Well, maybe not. Each one is for like $4.',\\n\",\n       \" \\\"It's amazing how cats can change your screen formatting just by walking across the keyboard. They must have some instinct for shortcut keys.\\\",\\n\",\n       \" 'Finally watched Glengarry Glen Ross. Coffee is for closers only.',\\n\",\n       \" 'Just read an article about people wanting wider streets. They changed their mind when told they would have less yard. #InabilityToReason',\\n\",\n       \" \\\"The thing about cats is they don't care at all when you come back from a long trip. They sniff your bags, and that's about it.\\\",\\n\",\n       \" 'I got nothing to say to you people.',\\n\",\n       \" \\\"People don't protest much on weekends. Civil unrest happens during the week. HT Scott Miller.\\\",\\n\",\n       \" \\\"When people interact with others, they act more randomly. When they don't interact, their lives are more regular. HT Daniel Garcia.\\\",\\n\",\n       \" 'It would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!',\\n\",\n       \" 'Love it when you pet cats and they look at your other hand like, \\\"What\\\\'s wrong with that one?\\\"',\\n\",\n       \" 'You would think there would be a finite number of ways VPN could fail to work. You would be wrong.',\\n\",\n       \" \\\"I love it when I benefit, but I don't understand why first class gets priority going through security. Seems so ... un-American.\\\",\\n\",\n       \" \\\"I'm a late-night guy living in a early morning world.\\\",\\n\",\n       \" 'Is that song really playing? I recently watched Silver Linings Playbook. That was pretty good.',\\n\",\n       \" 'Went to Costco for the first time not too long ago. That place is a disaster movie.',\\n\",\n       \" 'In books, characters fall into \\\"a dreamless sleep.\\\" I always seem to fall into a mad, anxiety-ridden, psychedelic unconsciousness.',\\n\",\n       \" 'Old memories are best when they sneak up on you, like when you hear a lost Gloria Estefan song from the 1980s.',\\n\",\n       \" \\\"It's surprising how poor the book recommendation engine in Goodreads is. They just give you books with no indication why you might like them\\\",\\n\",\n       \" 'Everyone was excited about our new minivan except my daughter (age 3). She was afraid that lions will be able to get in through the sunroof.',\\n\",\n       \" 'Once mentioned I was shopping for a new car at a company party. One of my coworkers said, \\\"You seem like a used car kind of guy.\\\"',\\n\",\n       \" 'Also dreamed I met The Most Interesting Man in the World at a party, and he recommended that I not wear khaki shorts to meet Queen Elizabeth',\\n\",\n       \" 'Dreamed I played pickup soccer with a new group of people, and the losing team had its eyes sewn shut. Would have tried harder had I known.',\\n\",\n       \" 'Recently watched Star Wars with kids. On VHS. #IThinkTheTrackingIsOff',\\n\",\n       \" 'I love how the fire ant killer I bought comes with a safety seal. You know, to keep people from poisoning it.',\\n\",\n       \" \\\"I know the difference between it's and its, but my hands don't.\\\",\\n\",\n       \" 'My daughter, age 4, calls a computer a \\\"perchuter.\\\" But she gets mad if you call it a perchuter. She says, \\\"No! It\\\\'s a perchuter!\\\"',\\n\",\n       \" 'We old people have something special. Talked to some girls from Ann Richards high school---they have no memory of a time before the internet',\\n\",\n       \" 'Just moved my yearly physical out two months in the future. Because I am always less busy in the future than I am now.',\\n\",\n       \" \\\"During last night's sleep I was simultaneously too cold AND too hot. Not alternating; at the same time. Never experienced that before. #sick\\\",\\n\",\n       \" \\\"I wrote down a guy's name so I wouldn't forget it. But now I can't remember where I put that piece of paper.\\\",\\n\",\n       \" 'A kid, age 8, at soccer practice said he would give me all the money he will make in his entire life if I scored a goal on him. GOALLLLL!!!!',\\n\",\n       \" 'Both the world and our role within it continuously change, so being open to learning new things is probably more important than being smart',\\n\",\n       \" \\\"When I was younger and had a cold, playing soccer actually made me feel better. That no longer works now that I'm 41.\\\",\\n\",\n       \" \\\"They say it's no use crying over spilled milk, but when the spilled item is homemade mac-and-cheese, and it's your only lunch, it can't hurt\\\",\\n\",\n       \" 'They say to watch out for the \\\"terrible twos,\\\" but at our house, it\\\\'s always been the \\\"mad threes\\\" that get you. My daughter is now there.',\\n\",\n       \" \\\"Man, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\\\",\\n\",\n       \" \\\"I've set up a standing desk at home, but now I'm faced with the problem of how to eat cereal and relax. I'll ask my son how to work the TV.\\\",\\n\",\n       \" 'What do you do when you are too tired to be productive or even to have fun?',\\n\",\n       \" 'Babies and toddlers must be profoundly confused when they wake from dreams. What happened to that giant lollipop I had?',\\n\",\n       \" 'They say that we all have the same DNA and are fundamentally the same, but some people tweet that they forget to eat. #ProofByContradiction',\\n\",\n       \" \\\"A lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\\\",\\n\",\n       \" \\\"Why can't we get good disaster movies?\\\",\\n\",\n       \" 'Happiness is executing your plans.',\\n\",\n       \" 'My kids are worried about poisonous snakes and spiders. I tell them that what they should really be afraid of is cars.',\\n\",\n       \" 'The next salesman insisted we sit down before looking at cars. He said you talk to the doctor before he prescribes you medicine. We left.',\\n\",\n       \" 'Went looking for a minivan, and the salesperson laughed in my face when I said we wanted an orange one. Hey man, we can still be hip.',\\n\",\n       \" 'Conference announcement: \\\"Do not leave items unattended.\\\" I think we can all agree that that phrase needs to banished from the language.',\\n\",\n       \" \\\"We all take our rules seriously even when it's silly. I once got yelled at in China for choosing sweet potatoes as my second lunch vegetable\\\",\\n\",\n       \" 'I dislike advertisements because they are trying to hack me. They are trying to control me. Even worse, they are wasting my time.',\\n\",\n       \" 'The beauty of open source is that the machine is laid bare. I always want to understand; too bad my brain capacity is limited.',\\n\",\n       \" 'If you write \\\"Jane Austin\\\", Google Docs recommends a correction to \\\"Austen\\\". If you write \\\"Austin, Texas\\\", it doesn\\\\'t. Nice.',\\n\",\n       \" \\\"If I tweet that I'm going to eat at Fogo de Chao, is my health insurance company listening? Asking for a friend.\\\",\\n\",\n       \" 'Amazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.',\\n\",\n       \" \\\"It's suboptimal that income tax rates for productive work (like being a teacher) and destructive work (like dirtying the air) are the same.\\\",\\n\",\n       \" \\\"Love it when your plane gets to an airport and you have to circle around. Like they didn't know you were coming.\\\",\\n\",\n       \" \\\"I like to wear my tweed sport coat to conferences because it makes me feel accomplished, but now it has a hole in the sleeve. That's funny.\\\",\\n\",\n       \" 'I love how Microsoft accuses me of being a \\\"victim of software counterfeiting\\\" every time I wake up my laptop. I\\\\'m a victim alright.',\\n\",\n       \" 'People say \\\"by Bob and myself\\\" or \\\"by Bob and I\\\" when I think it really should be \\\"by Bob and me.\\\" You wouldn\\\\'t say \\\"by we.\\\" Right?',\\n\",\n       \" 'I love it when movies about ghosts are \\\"based on a true story.\\\"',\\n\",\n       \" 'Friend had a 40th birthday party at a cowboy bar. I wore boots. My kids said they understood that b/c they went to a ninja party last week.',\\n\",\n       \" 'The first challenge to publishing conference papers is to do good science. The second challenge is to correctly embed fonts in the PDF.',\\n\",\n       \" 'I have that fingernail injury you get from peeling too many grapefruit. Eating healthy is hard.',\\n\",\n       \" 'I wonder if there is such a thing as patent troll insurance. If not, there should be.',\\n\",\n       \" 'Imagine if scientific papers were written like patent applications. Shudder to think.',\\n\",\n       \" 'Isn\\\\'t it weird that an actor is \\\"in\\\" a movie but \\\"on\\\" a TV show?',\\n\",\n       \" \\\"Star Wars came up, and my son's teacher didn't know what a Wookie was. Is there some sort of accreditation board I can report her to?\\\",\\n\",\n       \" 'I propose a radical energy saving device. You know those huge monitors/TVs you see everywhere? What if we converted those to static \\\"signs\\\"?',\\n\",\n       \" 'Joke by my son (age 10): Why did the chicken cross to the left side of the road? Answer: Because Daddy was telling stories on the right.',\\n\",\n       \" \\\"Just watched The Master. That made no sense. I don't care what you fancy people say.\\\",\\n\",\n       \" \\\"My mental model is that it takes 5 min to shower, but it's 10 min. Error has persisted for years. Skinner's pigeons learn faster than I do.\\\",\\n\",\n       \" 'The AT&T wireless customer service person kept complaining that I was cutting out. Now, that is funny.',\\n\",\n       \" 'I get money from about 10 class action lawsuits a year. Thank you for that $2.47.',\\n\",\n       \" \\\"The apocalypse allows us to finally relax and enjoy that vacation we've been meaning to take but couldn't because of our obligations at work\\\",\\n\",\n       \" 'Loved 11/22/63 by Stephen King, but living a dual life in 1958 and 2017 was exhausting.',\\n\",\n       \" 'Cake has no optimal serving size. If I eat a little, I feel bad because I want more. If I eat a lot, I feel bad because I ate a lot.',\\n\",\n       \" \\\"My wife says I shouldn't walk around the neighborhood while eating a pot full of vegetables.\\\",\\n\",\n       \" 'Interesting how the idea of Klout on topics (I was most influential in \\\"lemonade\\\") has moved from Klout to \\\"endorsements\\\" on LinkedIn.',\\n\",\n       \" 'Tired of conferences in big cities. We need more gatherings at venues only accessible by donkey.',\\n\",\n       \" 'Actually, scratch that. Days where nothing truly bad happens are great days. They allow a new dawn to be a clean reset.',\\n\",\n       \" 'There are days when nothing truly bad happens but everything is unnecessarily difficult. That was yesterday. Today is new dawn.',\\n\",\n       \" 'It should be illegal to have a stupid conversation when you are sitting in front of me on an airplane.',\\n\",\n       \" \\\"Me: I hate having to check in *exactly* 24 hours in advance on Southwest. My friend: Is that why I'm always last to get on the plane?\\\",\\n\",\n       \" \\\"We've learned to trust no one. Is this email really a tracking notification for a FedEx package? I'm still waiting on my Nigerian fortune.\\\",\\n\",\n       \" 'Evil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.',\\n\",\n       \" '\\\"I hate when zombies get in my house.\\\" My son, age 10, playing Minecraft.',\\n\",\n       \" \\\"Got a notice saying I need new license plates. I don't understand. Do they wear out?\\\",\\n\",\n       \" 'Love how \\\"bimonthly\\\" can mean both every other month and twice a month. The whole point of the word is to communicate frequency. #worthless',\\n\",\n       \" 'I wonder if the companionship of pets was even more important in the time before TV. Although, with no YouTube, no one would ever know.',\\n\",\n       \" 'Humans are an emergent property of cells.',\\n\",\n       \" 'I love thunderstorms.',\\n\",\n       \" 'Love those \\\"increasing your productivity\\\" articles. I always expect the first recommendation to be \\\"Get off the internet and get to work.\\\"',\\n\",\n       \" \\\"Do you guys hide Easter baskets? To me, hiding those baskets is the natural thing to do. But my wife says I'm crazy. So we don't.\\\",\\n\",\n       \" 'The family was once discussing what to put on my birthday cake, and my son (age 6) said, \\\"Just put a guy asleep on there. Daddy loves naps.\\\"',\\n\",\n       \" 'Someday, people will long for the natural simplicity of 2017.',\\n\",\n       \" \\\"You know it's a great audiobook when you can't wait to get back in your car to go to work.\\\",\\n\",\n       \" 'I start typing \\\"self aw\\\" into the search bar, and Google comes up with \\\"self aware roomba.\\\" The anxieties of our age.',\\n\",\n       \" 'Does anyone know how the amount of complexity of a computer operating system compares with that of a biological cell?',\\n\",\n       \" \\\"It's funny how you can't really proofread an email until after you send it.\\\",\\n\",\n       \" \\\"I'm headed to Whole Paycheck ... I mean Whole Foods. Anybody need anything?\\\",\\n\",\n       \" 'I love how \\\"Can I help you?\\\" is a polite way of asking \\\"What the hell are you doing here?\\\"',\\n\",\n       \" \\\"I hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\\\",\\n\",\n       \" 'I should start answering the phone by saying \\\"Ahoy!\\\" Not that I answer the phone anymore. I hate that thing.',\\n\",\n       \" 'Volkswagens go through car batteries like meth addicts go through Mountain Dew.',\\n\",\n       \" 'We appear to be approaching peak socks in my house. The scarcity cuts deeper every week.',\\n\",\n       \" \\\"I used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\\\",\\n\",\n       \" \\\"It's funny how a document with no spelling errors looks exactly the same as one with the spell check turned off.\\\",\\n\",\n       \" 'I wish there were one day a week when motorized vehicles were banned. Imagine the peace and quiet.',\\n\",\n       \" \\\"I worry that I don't work hard enough. I also worry that I don't relax enough. And, of course, I worry that I worry too much.\\\",\\n\",\n       \" 'Mud hole? Slimy? My home this is.',\\n\",\n       \" 'I love reading the reviews for kids movies. \\\"... the archetypes do not resonate as one would expect given the ...\\\" Kids want burp jokes.',\\n\",\n       \" \\\"There's a raccoon eating acorns in my front yard.\\\",\\n\",\n       \" 'Because of DM spam, I now have no way to tell you that I actually saw a crazy video that you were in.',\\n\",\n       \" 'Me: \\\". . . because I\\\\'m the grownup.\\\" My daughter (age 3): \\\"No, Mommy is the grownup.\\\"',\\n\",\n       \" 'I received a cold call today from a company offering \\\"black hat facilitation\\\" for government contracts. Do they blackmail decision makers?',\\n\",\n       \" 'Just got an invitation to submit a paper to a conference on \\\"Science and Information.\\\" That seems a tad broad.',\\n\",\n       \" 'Read Madame Bovary recently. I miss her shenanigans.',\\n\",\n       \" \\\"I don't see how people fast. It's only been a few hours for me and its like I'm standing in an office building with the fire alarm going off\\\",\\n\",\n       \" 'You know you are getting old when you see buying a car as a big pain instead of a fun and exciting event.',\\n\",\n       \" '\\\"Tell my mother, tell my father that I\\\\'ve done the best I can.\\\" Funny thing about getting old. I\\\\'m now the \\\"father\\\" in pop songs.',\\n\",\n       \" 'I draw the line at internet-connected toothbrushes.',\\n\",\n       \" \\\"It's pretty crazy when you think about it. Cyber security in a large corporation hinges on each individual not clicking on a bad link.\\\",\\n\",\n       \" 'I can see Daniel to Dan, but what is up with John to Jack? Jack Kennedy? John Kennedy?',\\n\",\n       \" 'I need to learn to take life one day at a time. That would be a great name for a TV show. You could have a single mom, a maintenance guy',\\n\",\n       \" 'You can rate Wikipedia pages as Trustworthy, Objective, Complete, and Well-Written. But the most important aspect is missing: Comprehensible',\\n\",\n       \" 'I wonder if it is a general property of great books that you start out hating them, but they grow on you over time.',\\n\",\n       \" 'Just plugged in a laptop, not because I needed it, but because I felt sorry for it. That little sad blinking low-battery light tugged at me.',\\n\",\n       \" \\\"I have a sudden urge to say something profound in Latin. But I don't have anything to say, and I don't know Latin.\\\",\\n\",\n       \" \\\"Scientific papers don't always mention Kim Kardashian, but when they do, they are about social media.\\\",\\n\",\n       \" 'Thought I was doing the right thing buying \\\"olive oil\\\" salad dressing, but those marketing charlatans outsmarted me again. #CanolaOilSucker',\\n\",\n       \" 'I got a noticeable cut on my forehead, and I have no idea where it came from. Maybe I was drugged? The CIA? Aliens? Could have been a cat.',\\n\",\n       \" 'Our printer has evidently discovered that it can do its part to save the planet by randomly deleting print jobs. #RobotConsciousness',\\n\",\n       \" \\\"I've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\\\",\\n\",\n       \" 'At some point, we passed the threshold of there being more pictures of cats on the Internet than cats in the actual world.',\\n\",\n       \" 'Internal reviewer said she didn\\\\'t understand my use of the phrase \\\"[xx I name it thus?]\\\" in a technical paper. #IShouldProofreadFirst',\\n\",\n       \" 'Dude was tailgating me in heavy traffic. I pull aside. He speeds by and is immediately pulled over. #sometimesTheManIsOnYourSide',\\n\",\n       \" 'Told my son, age 10, that he can be both athletic and smart. I brought up the idea of a warrior-poet.',\\n\",\n       \" 'Remember that kid\\\\'s movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \\\"I love safety.\\\" I want that.',\\n\",\n       \" 'My wife just asked me if I know how to read Chinese. Clearly, we need to talk more.',\\n\",\n       \" 'The other night my kids stayed up late. They wanted to watch The Lorax instead of going outside to see the stars. #irony',\\n\",\n       \" 'ALWAYS BE SCARED. This message brought to you by your nightly local news.',\\n\",\n       \" \\\"Warm milk, instant coffee, and hot chocolate mix. That's the stuff.\\\",\\n\",\n       \" \\\"Like Odysseus being tied to his mast to resist the Siren's songs, I sometimes brush my teeth early so that I will stop eating for the day.\\\",\\n\",\n       \" 'Talking to people is exhausting.',\\n\",\n       \" \\\"I asked the university not to send me any more 'informational' emails, and I think that they are actually now sending me more out of spite.\\\",\\n\",\n       \" 'Crickets are now my third favorite sound--right behind my kids laughing and wind blowing through the trees.',\\n\",\n       \" 'I love the email complimentary close \\\\'v/r\\\\'. It says, \\\"I very respectfully end this letter, but not enough to write it out.\\\"',\\n\",\n       \" \\\"I don't wanna work. I just want to bang on the drums all day.\\\",\\n\",\n       \" \\\"I hate when I have something on my mind and I can't think on anything else.\\\",\\n\",\n       \" \\\"Redbox does not let you cancel if you change your mind. It's only a dollar, but they don't seem to understand that little things can be big.\\\",\\n\",\n       \" 'I find signs of security, such as guards and fences, very depressing, and people always want more of it.',\\n\",\n       \" 'Took my son to a high school basketball game. The lady looked at me like I was crazy when I tried to pay with a credit card. #Still1991',\\n\",\n       \" \\\"Recently watched Looper. I guess the fits that my kids throw aren't so bad after all.\\\",\\n\",\n       \" 'Seems like as soon as one monkey climbs off your back, the next one is standing right there in line.',\\n\",\n       \" \\\"I see in the rear-view mirror that I'm being tailgated by a huge pickup truck, which, in turn, is tailgated by an even bigger one. #Texas\\\",\\n\",\n       \" 'Some people enjoy parentheticals (their thinking is scattered and they like to make novel associations), and others want a linear story.',\\n\",\n       \" 'Relatedly, I like to take a person I know well and think back to my first impression. Amazing how different they can be.',\\n\",\n       \" \\\"Photos do a surprisingly bad job at conveying a person's essence. When you meet, you realize the photo points to a person that doesn't exist\\\",\\n\",\n       \" 'I love how my wife refers to Siri as \\\"the lady.\\\"',\\n\",\n       \" \\\"My computer is all confused and needs to be restarted. But I don't want to have to reopen all of these programs.\\\",\\n\",\n       \" \\\"Love how I have exactly one dollar in my wallet. Not zero, not twenty, one. I never use cash, so it's been that way for a while.\\\",\\n\",\n       \" 'I wish I could find a social media client that had a platitude filter. I will keep looking. You should never let go of your dreams.',\\n\",\n       \" 'The Microsoft Word designer must have been thinking, \\\"You know, if someone copies a sentence, I bet they want to copy the doc header too.\\\"',\\n\",\n       \" \\\"It's funny, no matter how late you get home, you can't just go right to bed. You have to wind down first.\\\",\\n\",\n       \" 'I love being an American, but I hate having to put the period inside of the quotation marks when a sentence ends with a single quoted word.',\\n\",\n       \" 'I went to get gas today, and there was a TV attached to the pump blaring CNN. We get a little closer to Idiocracy every day.',\\n\",\n       \" 'Music now in the break room. Two kinds of people: those that crave more stimulation, and those that wish somebody would turn life down.',\\n\",\n       \" 'I love how in Windows if you want to rename a directory you have to restart your computer so it will release the locks.',\\n\",\n       \" \\\"On Return of the Jedi, the guys destroying the energy shield can't communicate with they guys fighting the Death Star. #Anachronism\\\",\\n\",\n       \" 'The new accessory for full-sized pickup trucks is an extra-wide, chrome tailpipe. It says, \\\"More pollution than can fit in a regular pipe.\\\"',\\n\",\n       \" \\\"Toothpaste is inexhaustible. There's always one more little tube from the dentist or a travel kit around somewhere.\\\",\\n\",\n       \" 'Walking in the woods behind my office and was stopped by a tall fence. Fences kill the spirit. I felt like Truman trying to go to Fiji.',\\n\",\n       \" \\\"In response to missing files, Dropbox says people should always have a second backup. That's like the police telling me to lock my doors.\\\",\\n\",\n       \" 'Chocolate chip cookie dough ice cream may not be good for my health, but it sure is good for my productivity. At least for 27 minutes or so.',\\n\",\n       \" \\\"My son just asked, do you think that some cats would see better with glasses? I've always wondered what we humans did before glasses.\\\",\\n\",\n       \" 'The problem with the gamification of something is that you have to pay attention to the game. My brain is full.',\\n\",\n       \" \\\"We've lived in this house for seven years, and we still haven't settled on unambiguous names for the rooms. Which one is the living room?\\\",\\n\",\n       \" 'I want a light tablet with a screen that is 8.5 x 11 inches. Then we could replace some paper around here.',\\n\",\n       \" \\\"It's amazing how much work it is to relax. You can't just suddenly relax. It takes time.\\\",\\n\",\n       \" 'Work makes life go by too fast.',\\n\",\n       \" \\\"Someday, future archaeologists will uncover countless credit card offers. For me, it's about one in every five pieces of mail.\\\",\\n\",\n       \" 'Was going to pull up Google Maps, but my son handed me a globe instead. Nice and round and all, but there was no zoom!',\\n\",\n       \" 'How is it that I can intend to type the word \\\"both\\\", think I typed the word \\\"both\\\", and later see that I actually typed the word \\\"book\\\"?',\\n\",\n       \" \\\"I don't like receipts, so SEARS gave me 4 of them. 1 receipt and 3 coupons with so many exceptions that reading them is out of the question.\\\",\\n\",\n       \" 'It bugs me that fortune cookies no longer contain fortunes. They should be renamed to \\\"life-coach cookies.\\\"',\\n\",\n       \" 'The food madness comes to an end tomorrow.',\\n\",\n       \" \\\"Twitter is an oasis. If you comment on the open web, people reply as if you're an idiot, without reflecting on the irony of the assumption.\\\",\\n\",\n       \" 'If it\\\\'s \\\"not necessary to dial a 1 when calling this number\\\" can\\\\'t the phone company just figure it out? Google has spoiled us all.',\\n\",\n       \" 'I once saw an ad from BMW urging people to consume less and to buy a new car. I guess words no longer have meaning.',\\n\",\n       \" '\\\"Wait until your kids move back home from college.\\\" Tide laundry detergent commercial. Wow, this recession thing is real.',\\n\",\n       \" 'Went to get a new tube for my mountain bike. Guy asked which size. Which size? Evidently, a lot has changed since 1992.',\\n\",\n       \" 'Dreamed I was playing Little League Baseball and had drove to the game in a garbage truck. Then I said \\\"wait I\\\\'m 41, what am I doing here?\\\"',\\n\",\n       \" 'Am I the only one bothered by noise pollution? It makes me so angry I want to scream. And maybe bang some pots.',\\n\",\n       \" 'With the current ubiquity of tablets and smartphones, kids born today might never learn how to use an old-fashioned OS like Windows 7. Crazy',\\n\",\n       \" \\\"I'm amazed that we are still held hostage to text messaging fees. Either iMessage on iPhone, or pay big monthly fees, or pay per utterance.\\\",\\n\",\n       \" 'I used to think that lying to my kids about Santa would needlessly confuse them. Now I see it as a valuable lesson in the shades of truth.',\\n\",\n       \" 'I just ate a big chunk of bad, frozen lasagna. The worst of all possible choices.',\\n\",\n       \" 'Funny when you need to email an old acquaintance, and you try to come up with a subject line that will keep it out of their spam filters.',\\n\",\n       \" 'The weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit',\\n\",\n       \" 'Got a letter outlining retirement plan options. The Singularity is my retirement plan. Barring that, my plan is to work until I drop.',\\n\",\n       \" 'When they show scientists in movies, they never show them making PowerPoint slides.',\\n\",\n       \" 'Trying to re-frame the experience of lifting weights so it will seem fun. New framing: \\\"working out is Zen meditation.\\\" Worked last night.',\\n\",\n       \" 'My son, age 10, got up and was dazedly walking around. Sleepwalking? I approached, and he punched me in the stomach and went back to bed.',\\n\",\n       \" \\\"Nothing good comes in the mail; let's do away with it.\\\",\\n\",\n       \" '\\\"encryption unsuccessful\\\" is the Android version of the blue screen of death, except you lose everything.',\\n\",\n       \" 'I went to the kitchen to get a salad and came back with turtle cheesecake.',\\n\",\n       \" 'I wonder if it\\\\'s about time to retire the \\\"out-of-office\\\" automatic replies. That really doesn\\\\'t happen anymore.',\\n\",\n       \" \\\"My youngest son asked me to show him a cursive 'G' in uppercase. I don't remember how to write one.\\\",\\n\",\n       \" \\\"It's funny, as you get older, it really is better to give than to receive. You get all excited about the presents you buy people.\\\",\\n\",\n       \" \\\"I love how I use '1/0' to stop my program if it goes down a bad branch. #CodingLikeABoss\\\",\\n\",\n       \" \\\"I sympathize with his views, but I've had trouble trusting Michael Moore ever since he blamed Dick Clark for the death of that little boy.\\\",\\n\",\n       \" \\\"Funny. It's always better to have permission than to not have permission, but it's not always better to ask permission than to not.\\\",\\n\",\n       \" 'I remember how Windows XP used to always be so worried about unused desktop icons. It was so cute.',\\n\",\n       \" 'I hate it when explanations are organized around people. I much prefer organizations around ideas. #LookingAtYouPhilosophy #NotAmericanIdol',\\n\",\n       \" 'I want some cake, so I ate a small kettle of green beans under the belief that they are anti-cake.',\\n\",\n       \" 'How cool is that? Some dude in Malaysia googles, \\\"children are curious about their environment\\\" and The Curiosity Cycle comes up #3.',\\n\",\n       \" 'Airline rewards and grocery store rewards are opposites. Airline rewards are rewards (free flights). Grocery store rewards are punishments.',\\n\",\n       \" \\\"They say that Siddhartha could think, fast, and wait. I'm not much for waiting, and I can't think if I'm hungry. #LongWayToGo\\\",\\n\",\n       \" 'At the time it just seemed normal, but when I hear it now, the grunge music of the early-mid 1990s sounds so dark. No wonder I was moody.',\\n\",\n       \" 'Nice to see that cars are coming out in colors now; blues and oranges. For ten years, they were just shades of gray.',\\n\",\n       \" 'There isn\\\\'t a word for the kind of packing you do in a hotel to go home. It isn\\\\'t quite \\\"packing,\\\" and it isn\\\\'t \\\"unpacking\\\" either.',\\n\",\n       \" 'I\\\\'m often trapped because I can\\\\'t bring myself to use a buzzword like \\\"situational awareness,\\\" but I also can\\\\'t think of an alternative.',\\n\",\n       \" 'Writing is like solving a jigsaw puzzle where you first have to determine what the pieces are.',\\n\",\n       \" \\\"It's funny. Why is being sad unenjoyable? It's not like physical pain, which is more direct.\\\",\\n\",\n       \" 'I gotta say, The Looney Tunes Show on Cartoon Network is pretty funny. The suburban-dwelling Yosemite Sam is particularly well done.',\\n\",\n       \" 'My toolbox is such that you need a screwdriver to get it open.',\\n\",\n       \" 'Me: \\\"Where\\\\'s that music coming from?\\\" Son: \\\"My toothbrush.\\\" Ah, the modern world.',\\n\",\n       \" 'It seems that the quality of a television show is inversely proportional to the attractiveness of the actors.',\\n\",\n       \" \\\"It's amazing how much better I understand a scientific paper when I take notes on the meaning of notation as I read.\\\",\\n\",\n       \" \\\"Took a bite of a deep-fried taco shell from Chuy's. I learned exactly how Frodo felt in The Lord of The Rings as I took it to the trash can.\\\",\\n\",\n       \" 'I should probably read the news *before* I get on social media in the morning. Things would make a lot more sense.',\\n\",\n       \" \\\"This internet thing is just a fad. Someday, we'll look back and laugh.\\\",\\n\",\n       \" \\\"Teaching my son, age 7, to program in Python. He gets confused between strings and variable names. You can write x = 'bob' but not x = bob.\\\",\\n\",\n       \" \\\"I can eat canned soup as long as I add enough pepper so I can't taste the canned soup.\\\",\\n\",\n       \" 'Air travel would be less stressful if it were socially acceptable to do Tai Chi while waiting to board the plane.',\\n\",\n       \" 'Coat hangers are very poorly behaved objects.',\\n\",\n       \" 'If you find yourself at DFW, the Pappadeaux at A24 is a veritable oasis from the barbarous activity in the main terminal.',\\n\",\n       \" 'Pro tip: if you want me to use your service by allowing me to sign in with my FB or Twitter account, do not threaten to spam my friends.',\\n\",\n       \" 'I find Red Delicious to be the least delicious of all apples. They are, however, red.',\\n\",\n       \" \\\"When concerned with trivialities, I often have to remind myself that these are the problems you have when you don't have any problems.\\\",\\n\",\n       \" 'The problem with software you have to buy is that you also have to pay to upgrade. So I end up using Word 2003.',\\n\",\n       \" \\\"One thing I've learned as a kinder soccer coach is that cold weather makes kids' shoes come untied. #TheMoreYouKnow\\\",\\n\",\n       \" '\\\"What if an attacker takes over the washing machine and uses it as a platform to launch distributed denial-of service (DoS) attacks?\\\"',\\n\",\n       \" 'The world needs to stop making things that beep at me.',\\n\",\n       \" 'Sometimes the word \\\"busy\\\" means \\\"swamped at the moment,\\\" but sometimes it means \\\"I\\\\'m more important than you.\\\"',\\n\",\n       \" 'My son responding to a request to end his computer game: \\\"I barely got anything done!\\\" It\\\\'s funny how artificial goals can become real goals',\\n\",\n       \" 'There is often a very large distance between almost done and done.',\\n\",\n       \" 'Weird to me that people compare Google+ with Facebook. I see Google+ as a version of Twitter without the 140 character limit.',\\n\",\n       \" \\\"Last one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\\\",\\n\",\n       \" \\\"It's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\\\",\\n\",\n       \" \\\"I love how being in the middle of reading a good book adds another dimension to my consciousness, even when I'm not reading.\\\",\\n\",\n       \" \\\"I haven't had nearly enough Chinese food lately.\\\",\\n\",\n       \" 'I like pictures on slides, but they have to convey information. The presentation appears fluffy if they only set up context or look pretty.',\\n\",\n       \" \\\"Healthcare in the US is inexplicably expensive. Maybe I don't want Walmart to run a hospital, but I'd go to one run by IKEA.\\\",\\n\",\n       \" \\\"Cats don't dance.\\\",\\n\",\n       \" \\\"Hate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\\\",\\n\",\n       \" 'Just got a message that said \\\"Jonathan, I\\\\'m returning your call about the yellow camper on the highway.\\\" I didn\\\\'t call about a yellow camper',\\n\",\n       \" 'It\\\\'s funny how you can be \\\"present\\\" in a Zen sense, or you can be \\\"productive\\\" in a work sense, but you can\\\\'t be both.',\\n\",\n       \" 'Network programming is somehow very satisfying. All of these happy little computers talking to each other.',\\n\",\n       \" \\\"I generally prefer the quiet sound of crumbling infrastructure to the noise of construction, but I'm told that's not a viable approach.\\\",\\n\",\n       \" 'I can understand nightmares--they teach your brain with simulated danger. But annoying dreams? I was running barefoot on a road with pebbles',\\n\",\n       \" 'I just spent 30 minutes reconstructing a stapler from its component parts after my son dropped it down the stairs. #ReadyForTheApocalypse',\\n\",\n       \" \\\"After it was too late to fix, I saw a comma splice in my scientific proposal. Now, if it gets rejected, I'll know why.\\\",\\n\",\n       \" 'I just ate a bowl of granola cereal, which, in the absurd universe of calorie consumption, is equivalent to about five chocolate cakes.',\\n\",\n       \" 'Instructions for paper abstracts said that they should be 250 words. I thought this was funny: exactly 250 words? But my first draft had 250',\\n\",\n       \" 'My boys decided to settle a question of fact, whether item x was made of metal or plastic, with a ball throwing contest #UnclearOnTheConcept',\\n\",\n       \" \\\"I successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\\\",\\n\",\n       \" 'My daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.',\\n\",\n       \" 'Just watched a few minutes of that show Revolution. This is bad TV. Cliche after cliche. And did the disaster only kill ugly people?',\\n\",\n       \" 'It\\\\'s confusing that the word \\\"oversight\\\" means both an error and the activity of watching something so as to prevent an error.',\\n\",\n       \" 'Need to go to the library but left my wallet at home. I wonder if I can direct the librarian to my Twitter page as a valid form of photo ID.',\\n\",\n       \" \\\"Often, there's only ten or so decisions that need to be made to finish a document. But you can't seem to hop in, and you sit there in a fog.\\\",\\n\",\n       \" 'I think \\\"Guns and Religion\\\" would be a great name for my son\\\\'s kinder soccer team. But my wife and city officials probably wouldn\\\\'t agree.',\\n\",\n       \" \\\"It's amazing that air travel is so exhausting. You are, after all, just sitting there.\\\",\\n\",\n       \" \\\"This coffee at this place tastes like tea. I can't tell if it is too fancy for me, or if I am too fancy for it.\\\",\\n\",\n       \" 'Resurrected my wife\\\\'s old Windows Vista laptop. \\\"Installing update 1 of 77 ...\\\"',\\n\",\n       \" '30 minutes before my bedtime last night, I decided to install Ubuntu. I am not a smart man. #insomnia #FeelTerribleToday',\\n\",\n       \" 'New game at work: figure out who is walking down the hall by the sound of their footsteps.',\\n\",\n       \" \\\"Companies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\\\",\\n\",\n       \" 'My wife always argues with the cats. The cat followed her into the bathroom, and I heard, \\\"Do you want a bath or what? What\\\\'s your problem?\\\"',\\n\",\n       \" 'Surprising how infrequently I can reuse my previous (unpublished) writing. I always seem to want to rewrite ideas when used in a new context',\\n\",\n       \" 'Just saw a guy jogging down our street in a bulletproof vest. Evidently, this neighborhood is more dangerous than I thought.',\\n\",\n       \" '\\\"I bet in the future, we won\\\\'t have to waste our time fixing toilets.\\\" Me, in 1995.',\\n\",\n       \" \\\"When tweets are too long to read, it's time to go to bed.\\\",\\n\",\n       \" 'Some days feel squishy: your current work is too small to be useful, and your big ideas are too ill-formed to be practical.',\\n\",\n       \" 'The kitchen at work is currently closed. Luckily, I have a strategic coffee reserve in my office.',\\n\",\n       \" 'Pleasant surprise this morning: I tightened my belt to the next belt hole.',\\n\",\n       \" 'My wife to me: \\\"You are always on that computer. You and that computer should be morphed together.\\\" Not a bad idea.',\\n\",\n       \" 'There are 16 digits in my Country Inns & Suites reward ID number. They seem to be preparing for intergalactic expansion. #ThinkBig',\\n\",\n       \" 'Time to regroup as a civilization. We should stop all new development for 6 months and focus on fixing bugs in existing systems.',\\n\",\n       \" 'Just said to my wife, \\\"Yeah, I don\\\\'t want to watch it either, but it won best picture.\\\" We are about to watch The Artist. This is middle age',\\n\",\n       \" 'I just used VPN to access the virtual machine on my remote desktop. It is indeed turtles all the way down.',\\n\",\n       \" 'It\\\\'s funny that we have words in our language like \\\"art\\\" that nobody can define.',\\n\",\n       \" \\\"It's amazing how much joy in life comes from making and executing plans.\\\",\\n\",\n       \" 'Just saw a joke image about cats on my timeline. My brain actually generated the idea that I should show the cats the picture. Ah, humans.',\\n\",\n       \" 'I had no idea that buying a mattress would be so far beyond my complexity horizon. The price was fluid and the options were dizzying.',\\n\",\n       \" 'Dreamed I won a bronze medal for swimming. Next dream: walked barefoot through a bad part of town looking for water. First dream preferred.',\\n\",\n       \" 'Overheard at my house, \\\"You two give her those chickens!\\\"',\\n\",\n       \" \\\"It's amazing how blind we can be with our own work. I needed to cut slides but they all seemed critical. Outside council found some.\\\",\\n\",\n       \" \\\"Pulled up XEmacs for old time's sake. Used it for 6 years. After two years, it appears I have already forgotten everything.\\\",\\n\",\n       \" \\\"As I get older, I increasingly find myself identifying with John Goodman's character from The Big Lebowski. I did not see that coming.\\\",\\n\",\n       \" 'Off to a nature walk. My work is right by this park, Emma Long, where the only human-made sounds you hear come from an occasional airplane.',\\n\",\n       \" 'Getting your vocabulary straight is a huge part of getting your thinking straight. Correctness is less important than consistency.',\\n\",\n       \" 'Please conserve bits. If your answer to a question is to \\\"reinstall the software,\\\" your suggestion can be safely omitted.',\\n\",\n       \" 'I\\\\'m thinking that good writing avoids sentences with distracting, garden-path interpretations such as \\\"The old man the boats.\\\"',\\n\",\n       \" 'Always surprised people keep those email ad signatures, such as \\\"Sent from my iPhone.\\\" Consider changing to \\\"Sent from my subconscious.\\\"',\\n\",\n       \" '\\\"rhythm\\\" is a long word not to have a real vowel.',\\n\",\n       \" 'Took the kids to the NASA Johnson Space Center in Houston. Actually, kind of depressing. All about the past, not much about the future.',\\n\",\n       \" 'Good comedy consists of statements that are both true and absurd.',\\n\",\n       \" 'Just found a giant oatmeal walnut brown sugar cranberry cookie in the break room. It was like Trainspotting.',\\n\",\n       \" 'The world is its own best documentation.',\\n\",\n       \" \\\"We got a new cat, and he drank my wife's coffee two days in a row. Now, he's just like the rest of us.\\\",\\n\",\n       \" 'Do people actually sit through 30-second commercials to watch 2-minute news videos? I want to see the bobcat kittens, but there are limits.',\\n\",\n       \" 'Just watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.',\\n\",\n       \" 'We often write down incomplete thoughts so they are not forgotten. But seeing them on paper makes them seem complete, so we leave them.',\\n\",\n       \" \\\"Amazing that malls haven't changed in 30 years. Did you know that Bag n' Baggage still exists?\\\",\\n\",\n       \" \\\"My son, age 7, asked me how computers work. Not sure if I should start with Turing Machines or Maxwell's equations.\\\",\\n\",\n       \" \\\"Why do peanuts sometimes taste like a baby's dirty diaper smells?\\\",\\n\",\n       \" 'This cloud thing is great, but my writing is spread out all over the place. Now, where did I put that thought again? Twitter? FB? blog?',\\n\",\n       \" 'Interesting. 10-page report is 414 KB, 1-page letter with image of my signature is 1,288 KB. The continuous world is large and rich.',\\n\",\n       \" 'I hate it when you think you have one problem, you solve it, and in doing so discover that there were two problems.',\\n\",\n       \" \\\"Kickin' it 1970s style. I am desk checking my computer program.\\\",\\n\",\n       \" 'If you Google \\\"cast magic spells\\\" you get a bunch of results as if it were, you know, real --- just like \\\"make layer cake.\\\"',\\n\",\n       \" \\\"I'm hungry, so I eat a bag of carrots. Then I have two problems: I'm hungry and I have a stomach ache.\\\",\\n\",\n       \" 'I\\\\'m used to \\\"twenty years ago\\\" meaning the 1970s, but that was twenty years ago.',\\n\",\n       \" \\\"Just saw a commercial for a McDonald's sugary coffee drink that distinctly reminded me of the heroin injection scenes from Trainspotting.\\\",\\n\",\n       \" \\\"Scientists are working on curing diseases and understanding the cosmos, but what we need is a guacamole that doesn't turn that ugly color.\\\",\\n\",\n       \" 'Every time I open the refrigerator, I hear this pat pat pat of little feet come running over.',\\n\",\n       \" \\\"Statistics is a mess. You can't follow recipes because assumptions are never satisfied, and you can't use principles because there are none.\\\",\\n\",\n       \" '\\\"Page number\\\" is no longer meaningful. We have \\\"page ordinal,\\\" 1,2,3,... And we have \\\"page label,\\\" i, ..., iv, ...,1,2,3, ..., a1, a2, ...',\\n\",\n       \" 'Whenever I hear that song \\\"Before He Cheats\\\" I think how funny it would be if it was all just a big misunderstanding.',\\n\",\n       \" 'So the siren lights on top of cop cars are now flat. This appeared to happen overnight.',\\n\",\n       \" \\\"Just examined my computer's memory using FTK Imager. I found Portuguese text in there. I do not speak Portuguese.\\\",\\n\",\n       \" \\\"After ten years of printing my letters, I've suddenly started writing in cursive again. Weird.\\\",\\n\",\n       \" \\\"Just watched Young Adult. I loved that it didn't end up where you thought it would.\\\",\\n\",\n       \" 'Sometimes when you are writing and trying to articulate ideas, everything just seems like mush.',\\n\",\n       \" 'I hate controlled areas. I should be able to hang on the ropes at public swimming pools, and my bags are fine by themselves at airports.',\\n\",\n       \" \\\"Wish the whole world were on UTC time. I'd rather eat lunch at 3am than have to figure out what time that conference call is.\\\",\\n\",\n       \" \\\"So a guy flashes his headlights at me to warn me of a speed trap up ahead. Funny, who's side are we on? Us bandits vs. the system?\\\",\\n\",\n       \" \\\"As a rule, I don't read any document that is double spaced.\\\",\\n\",\n       \" 'I hate the mental gymnastics involved in reading scientific notation. If your number is that big, please use a different unit.',\\n\",\n       \" 'Half-inflated mylar balloons always float around the house. I see one out of the corner of my eye and think, \\\"WHAT THE HELL IS THAT?\\\"',\\n\",\n       \" \\\"Darn shame when we run out of skim milk and I have to use the kids' whole milk for my cereal. Darn shame.\\\",\\n\",\n       \" \\\"Love how Advil is sugar coated. It's like eating Skittles.\\\",\\n\",\n       \" \\\"Camping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\\\",\\n\",\n       \" 'Do kids have imaginary friends anymore? Or does that require the kind of solitude that no longer exists in our wired society?',\\n\",\n       \" \\\"I'm such a digital immigrant. I think using pen and paper, and then I turn to my computer and type the ideas into a document.\\\",\\n\",\n       \" 'Finally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.',\\n\",\n       \" 'Funny how in a dream you can be multiple characters at once. And it is first person but also third person.',\\n\",\n       \" \\\"Love that old aphorism: you know you've hit middle age when the phone rings on a Saturday night, and you hope it's not for you.\\\",\\n\",\n       \" 'Having coffee with the kids running around reminds me of that line from The Big Lebowski, \\\"Hey, careful, man, there\\\\'s a beverage here!\\\"',\\n\",\n       \" \\\"I've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\\\",\\n\",\n       \" 'My kids saw a typewriter today and were blown away. \\\"What IS that thing?\\\" Like it was from an alien world.',\\n\",\n       \" 'Based on my empirical observations of social networks, I conclude that provocative clothing causes young women to send spam follow requests.',\\n\",\n       \" 'The sun burns time.',\\n\",\n       \" 'Only way to stay trim in modern society is to be a fanatic about diet and working out. \\\"Eating right and exercising\\\" seem to be insufficient',\\n\",\n       \" 'Funny, so many songs I heard ad nauseam in the 1980s. They come on Pandora now and I actually listen, and think, \\\"hey, that\\\\'s pretty good.\\\"',\\n\",\n       \" 'Finally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.',\\n\",\n       \" \\\"Didn't lift my leg high enough and hit my shin on the bed. As I fell on the bed in pain, my leg cramped and I let out a scream. #soccer\\\",\\n\",\n       \" 'Using websites and apps is such a mine field these days. One false move and you unknowingly spam all of your friends.',\\n\",\n       \" 'Darn shame about that coming zombie apocalypse. Good thing I still have the bunker I dug for Y2K.',\\n\",\n       \" \\\"I finally get the purpose of scribd, but the ads are too distracting and the Facebook login doesn't work today. Clean and simple.\\\",\\n\",\n       \" 'Obtaining signatures wounds the soul.',\\n\",\n       \" 'Just saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.',\\n\",\n       \" 'My son (age 10) read part of a proposal I wrote. He asked, \\\"Did you write this?\\\" and then said \\\"Wow, you\\\\'re more boring than I thought.\\\"',\\n\",\n       \" \\\"Now that I'm older, I can look back on youth culture and see it as a thing. When I was younger, I thought it was life.\\\",\\n\",\n       \" 'In Texas, we have scorpions falling from the air vents. #GoodTimes',\\n\",\n       \" \\\"It's amazing how loud professional carpet cleaning trucks are. I think I'd prefer it if the neighbors were starting a rock band.\\\",\\n\",\n       \" 'Best quote: As they were leaving the house, my daughter (then 2) said to my youngest son (then 5), \\\"Get your shoes on, boy.\\\"',\\n\",\n       \" \\\"Companies think the cheapest way to handle customer service is offshoring and menu hell. Doesn't occur to them to make their products usable\\\",\\n\",\n       \" \\\"Microsoft help assumes everything is working fine and you are just ignorant. I don't need help unless something is broken or unintuitive.\\\",\\n\",\n       \" \\\"I'm not particularly unhappy with my appearance, but I find looking in the mirror a little unsettling. Who is that guy?\\\",\\n\",\n       \" 'Amazing how ignorant we are in medical diagnosis. We need a big database of symptoms, tests performed, results, and eventual diagnosis.',\\n\",\n       \" 'Can we all just agree that everyone knows the correlation does not equal causation, and just get on with our lives?',\\n\",\n       \" 'Just saw Take Shelter. Pretty good. I loved the slow, deliberate pacing.',\\n\",\n       \" \\\"So weird to hear talk about Gen X'ers relating to middle-age stuff. We're supposed to be busy slacking off, not worried about life insurance\\\",\\n\",\n       \" 'I have to be selective about the keyboard shortcuts I learn. My brain has a limited memory for that kind of thing.',\\n\",\n       \" 'Just watched Valhalla Rising. Interesting to see what the world may have looked like before there were so many people.',\\n\",\n       \" 'I just uncircled someone on Google+ for sharing Love Shack by The B-52s. We all need to set minimal standards.',\\n\",\n       \" 'I know that I have been working too hard when I find myself looking forward to mowing the lawn.',\\n\",\n       \" 'I wonder if you can schedule a flash mob through Microsoft Outlook.',\\n\",\n       \" 'My hotel room was like a museum from 1992. Everything was perfect. Even down to the wake up call that never came.',\\n\",\n       \" \\\"My hotel has the Ramada Inn flag waving out front. Love that. Like we're going to band together and attack the Holiday Inn across the street\\\",\\n\",\n       \" 'I dreamed last night that the US had a nuclear war with China, but China bombed Guatemala instead.',\\n\",\n       \" \\\"It's funny, I love AI, and I'm excited about the self-driving cars from Google, but I'm not comfortable using cruise control.\\\",\\n\",\n       \" \\\"It's pretty obvious I have kids. On my desk at work are notes about protocol-based network protection, written in crayon.\\\",\\n\",\n       \" 'Everything in the world should snap together like Legos.',\\n\",\n       \" 'Such a shock going from the digital world of computer science to the analog world of home repair. Nothing fits.',\\n\",\n       \" \\\"Hate those bags that have to be fastened before you pick them up. Stuff flying everywhere. Skinner's pigeons learn faster than I do.\\\",\\n\",\n       \" 'Reading The Black Swan by Nassim Taleb. Love the discussion of silent evidence. Would be better if the self-aggrandizing fluff was removed.',\\n\",\n       \" \\\"We live our lives in confining bubbles of homogeneity. I wish my job took me to random people's houses in remote small towns.\\\",\\n\",\n       \" 'You pull weeds in the yard, then later in the shower, you see the weeds when you close your eyes. Just me? Never mind.',\\n\",\n       \" \\\"They make me change my password so often that I find it's best to tweet it. That way I can at least ask my friends if I forget it.\\\",\\n\",\n       \" 'Yogi Berra would have rocked Twitter.',\\n\",\n       \" 'Having artificial plants is like drinking decaf coffee, it misses the whole point.',\\n\",\n       \" 'Funny how we change but stay the same. In high school I liked midnight bike rides with my walkman, now I like midnight walks with wine.',\\n\",\n       \" 'City keeps sending me these paper surveys on transportation, parks, etc. Results will be biased towards those who remember what stamps are.',\\n\",\n       \" \\\"Was about to walk to this guy's office and ask him to make a couple of graphs, then I realized I had a coffee cup in my hand. #OfficeSpace\\\",\\n\",\n       \" 'Overheard in my house: \\\"Hey! I thought I said no reading!\\\" Followed shortly thereafter by \\\"I don\\\\'t want blood in my hair!\\\" Good times.',\\n\",\n       \" 'Young people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?',\\n\",\n       \" 'I\\\\'m old. To me, the phrase \\\"turn of the century\\\" still means horse and buggy, not dotcom boom.',\\n\",\n       \" 'Restaurant food tastes better the next day. When out, you compare with other menu items, but at home you compare against a cold sandwich.',\\n\",\n       \" 'I walk downstairs to get a class of water, and I end up eating a piece of cake. So hard to judge short-term enjoyment verses long-term cost.',\\n\",\n       \" 'Was about to respond to an email from my wife when I realized it would probably just be easier to walk downstairs.',\\n\",\n       \" 'Compared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.',\\n\",\n       \" \\\"I know I've been working too hard when I get this constant, low-grade headache that spikes every time I try to cram more info into my brain.\\\",\\n\",\n       \" 'Savoring the bouquet of a wine by opening your mouth to let in oxygen is fine, but do the same thing with a mouth full of Doritos ...',\\n\",\n       \" 'Just saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.',\\n\",\n       \" 'I love how you can take just about anything, put pineapple on it, and call it Hawaiian.',\\n\",\n       \" \\\"There seem to be a lot of motivational speakers in the world. Clearly, it isn't working.\\\",\\n\",\n       \" 'Kid to speak tomorrow in front of 500. Not trying to teach him not to be scared, trying to teach him to do what needs to be done regardless.',\\n\",\n       \" 'The cat is on a hunger strike again. He does that when he gets tired of his food.',\\n\",\n       \" \\\"I just remembered a restaurant from high school that I haven't thought about for years. Amazing when that happens.\\\",\\n\",\n       \" 'Somehow, my fingers type \\\"defiantly\\\" when my brain thinks \\\"definitely.\\\" Confusion at work; e.g. \\\"I will defiantly complete this task.\\\"',\\n\",\n       \" 'Nothing feels better than getting that monkey off your back. At least for the 5 minutes until you notice the next monkey smiling up at you.',\\n\",\n       \" 'We hear warnings about the dangers of heart disease, car accidents, and cancer. But nobody talks about cats on stairs.',\\n\",\n       \" \\\"MS Outlook doesn't autocorrect (spell check) the subject line. The most important part. Like they have a monopoly in business email clients.\\\",\\n\",\n       \" 'I was roughhousing with the boys, my wife called my mom and said, \\\"I don\\\\'t think my kids should play with your kids. Your boy is too wild.\\\"',\\n\",\n       \" \\\"I keep trying to come up with novel applications for robots, and I keep getting stuck. Anyway, I'm off to pull weeds outside.\\\",\\n\",\n       \" \\\"Somehow, places seem more exciting when you don't have a map.\\\",\\n\",\n       \" 'Cool title for book about cognitive biases, \\\"Mistakes Were Made (But Not By Me)\\\". I hear the actual content of the book is good too.',\\n\",\n       \" 'Those Starbucks bottled frappuccinos are like drinking a bottle of Coffee-mate creamer.',\\n\",\n       \" \\\"A girl in a bikini asked me if I would like to get sexy summer abs in response to my last tweet. I'm glad that somebody is listening.\\\",\\n\",\n       \" \\\"I'm no Steve Jobs, but I hate when the arms of the chair are too high for the chair to fit under the desk. Hotels are notorious offenders.\\\",\\n\",\n       \" 'Trail mix is amazing stuff. You can consume 14,000 calories and still be hungry.',\\n\",\n       \" 'On the airplane I noticed that I, the computer scientist, was the only one reading from actual dead-tree paper.',\\n\",\n       \" \\\"You don't realize how much liquid is in a cup of coffee until you spill it on your desk.\\\",\\n\",\n       \" 'Just watched Midnight in Paris. That happened to me once.',\\n\",\n       \" \\\"Given how important hiding and seeking was for our ancestors, you'd think that my kids would be better at it. 1. No giggling. 2. No peeking.\\\",\\n\",\n       \" 'My son has started using the phrase \\\"it\\\\'s a win-win.\\\" Evidently, the second grade curriculum has changed since my day.',\\n\",\n       \" 'Funny how at work \\\"cleaning up\\\" your desk and \\\"cleaning out\\\" our desk mean very different things.',\\n\",\n       \" 'When discussing a difficulty, my adviser once said, \\\"if you can only do one thing, then do that.\\\" I\\\\'m going to bed.',\\n\",\n       \" 'When I hear the line \\\" I got debts that no honest man can pay\\\" by Bruce Springsteen, I always assume he is talking about student loans.',\\n\",\n       \" \\\"I've been moody this week. Reminds me of being a teenager. Not as fun as I remember.\\\",\\n\",\n       \" 'I\\\\'d love to be able to say \\\"Pandora, I\\\\'m angry at \\\\'the system.\\\\' Hook me up.\\\"',\\n\",\n       \" 'We should require that all inspirational quotes consider opportunity costs. E.g., \\\"You miss 100% of shots you don\\\\'t take.\\\" You could pass.',\\n\",\n       \" 'Son (age 8) just woke up terrified of werewolves he saw on the History Channel. Spent 20 min trying to explain why TV lies to get viewers.',\\n\",\n       \" 'Amazing how our social connections now largely determine what information we see online.',\\n\",\n       \" 'Making phone calls is now outside my complexity horizon. Do I dial a 1? The area code? Who knows.',\\n\",\n       \" \\\"I'm not hungry, why am I making a sandwich?\\\",\\n\",\n       \" 'I love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.',\\n\",\n       \" 'Now that I have a little girl, I really understand the sugar-and-spice-and-everything-nice description. So different from the boys.',\\n\",\n       \" 'When you cut and paste in MS Word, the text gets copied. But so does a lot of mystery formatting, headers, tabs, indentions, lost souls ...',\\n\",\n       \" 'I wish there were a succinct way to tell someone a post made you laugh out loud. The meanings of such phrases always drift.',\\n\",\n       \" \\\"I don't know why stormtroopers are so funny. But they sure are.\\\",\\n\",\n       \" 'I always get \\\"philanderer\\\" and \\\"philanthropist\\\" confused. Makes for an interesting reading of the news.',\\n\",\n       \" \\\"I would be a terrible gangster. I don't even know if, how, and under what circumstances once should tip a plumber.\\\",\\n\",\n       \" 'Weird how foods that normally taste good can taste bad in particular ways. Peanuts sometimes taste like dirty diapers smell.',\\n\",\n       \" \\\"It's the worrying about doing it exactly right that makes taxes so onerous. Simply filling in boxes per my best judgement would be a breeze.\\\",\\n\",\n       \" \\\"I keep expecting to earn interest in my frequent flyer miles. But it doesn't seem to work that way.\\\",\\n\",\n       \" \\\"Watched Gangster's Paradise and Animal Kingdom in the same day. That's a lot of crime for one day.\\\",\\n\",\n       \" 'OH \\\"I think people would be surprised to learn that there are bigfoots here in Indiana.\\\"',\\n\",\n       \" \\\"Mom telling story about a cow attacked by a bear. Cow lived. She made a bet with her brother that he couldn't ride the cow out of the barn.\\\",\\n\",\n       \" 'Love it when gmail says \\\"This conversation has been moved to the trash.\\\" It always seems like a value judgment.',\\n\",\n       \" \\\"I don't like marshmallows. And knowing that everyone else does has always made me feel vaguely uncomfortable.\\\",\\n\",\n       \" 'Amazing that we are starting to get smart cars, but we still have dumb traffic lights.',\\n\",\n       \" \\\"We Americans need to stop putting commas inside the quotation marks. But I'm too chicken to go against the rules. You are our only hope.\\\",\\n\",\n       \" \\\"Amazing how no one writes in cursive anymore. I'm even starting to forget how.\\\",\\n\",\n       \" 'I have trouble with working lunches. Eating and thinking are mutually exclusive activities.',\\n\",\n       \" 'Motto for the future of information: \\\"If it\\\\'s not relevant, get it out of my way.\\\"',\\n\",\n       \" \\\"When surfing the web, I might click on an interesting short video. But it can't start with a commercial. That breaks the flow. I move on.\\\",\\n\",\n       \" 'The word \\\"segue\\\" is so weird that if you don\\\\'t know how to spell it, even Google can\\\\'t help you.',\\n\",\n       \" '\\\"Broken Dreams\\\" would be a great name for a breakfast cereal. The hipsters would be all over it.',\\n\",\n       \" \\\"Watched Through the Wormhole with my son (age 8). Now, instead of monsters in the closet, he's afraid of a tear in the fabric of space.\\\",\\n\",\n       \" 'Saw Ides of March the other day. Pretty good. I loved the quote \\\"You didn\\\\'t make a mistake---you made a choice.\\\"',\\n\",\n       \" \\\"Similac sent us a box of baby formula samples. Apparently, they know something that I don't.\\\",\\n\",\n       \" \\\"Felt like a truck ran over me after the soccer game the other day. I'm starting to doubt if I will ever play in the World Cup.\\\",\\n\",\n       \" 'As we move from PCs to tablets and server farms, is it possible that total global computing power could actually go down?',\\n\",\n       \" 'They say that most dreams are bad, and mine are usually stressful, but I do have some amazing dreams about traveling to distant planets.',\\n\",\n       \" 'The word \\\"thing\\\" sounds too colloquial and imprecise, but \\\"ontological entity\\\" sounds like a bit much. You can\\\\'t win.',\\n\",\n       \" \\\"Thought about going to work out, then I decided that life's too short to spend time doing things you don't want to do.\\\",\\n\",\n       \" 'The IRS has an online application form, but the online form is only available during certain hours. #UnclearOnTheConcept',\\n\",\n       \" \\\"Getting annoyed filling out all of these tax forms. Then I think of the wisdom of the immortal Bryan Adams. Ain't no use in complaining when\\\",\\n\",\n       \" \\\"Went with my daughter to Toys R Us for the first time today. Turns out there's a whole part of the store I'd never seen before.\\\",\\n\",\n       \" \\\"Annoyed by the car alarm going off outside. Funny how it doesn't even occur to me that it might be, you know, a car in distress.\\\",\\n\",\n       \" 'My computer just made a weird beep. Did I win some sort of prize?',\\n\",\n       \" 'Just created a slide with the title \\\"More data is qualitatively more complex (mo data mo problems).\\\"',\\n\",\n       \" 'Science moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?',\\n\",\n       \" \\\"Wow, printers are stubborn. Trust me man, you don't have a paper jam.\\\",\\n\",\n       \" 'Reading American Gods. The characters have such amazing dreams. I dreamed I was followed around the grocery store by a chain-smoking gorilla',\\n\",\n       \" \\\"Now that's how you get things done! Toss and turn in bed, then jump up and sit down and do it. Too bad I'll feel terrible tomorrow.\\\",\\n\",\n       \" 'Wikipedia should have a flag for \\\"this article is technically correct but useless because it doesn\\\\'t explain what the thing actually is.\\\"',\\n\",\n       \" 'Funny how the squeaky wheel either gets grease or gets nailed down, depending on which culture you are in.',\\n\",\n       \" 'I just watched Mulholland Drive. No comprendo.',\\n\",\n       \" \\\"Wish me luck. I'm going to try for the fourth time to buy something from Verizon.  It's less work to get a Cambodian tourist visa.\\\",\\n\",\n       \" 'I make my own fun.',\\n\",\n       \" 'When people say they \\\"have no regrets,\\\" I always wonder if it\\\\'s because they are deluding themselves or they just aren\\\\'t paying attention.',\\n\",\n       \" \\\"Surprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\\\",\\n\",\n       \" 'I\\\\'ve been in the workforce for 15 years, and I still can\\\\'t get in the habit of saying \\\"good morning\\\" instead of \\\"hey\\\" or \\\"what\\\\'s up?\\\"',\\n\",\n       \" 'My wife just sent me an email with the subject \\\"dead bird.\\\"',\\n\",\n       \" 'Do you ever make one sandwich and then immediately realize that you should have made two?',\\n\",\n       \" 'I hate when I click on a simple thing in Windows, and it acts like I asked it to solve the halting problem.',\\n\",\n       \" 'Somehow, my wife lives in a world that is 40 degrees colder than the one I live in.',\\n\",\n       \" 'My kid asked me if magic was real. I said no, that magicians just did illusions. He said, \\\"What about Santa?\\\" Oh, yeah, well, there\\\\'s that.',\\n\",\n       \" \\\"After having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\\\",\\n\",\n       \" 'It appears that my book has been banned in China. (The Amazon link is blocked, but it sounds cooler to say it was \\\"banned.\\\")',\\n\",\n       \" \\\"Some say we shouldn't have kids for the sake of the planet, but imagine the result if the most conscientious people didn't have children.\\\",\\n\",\n       \" 'On Amazon, my book is available new from $12.99 and used from $42.45. Ah, decisions.',\\n\",\n       \" \\\"Doesn't it drive you nuts when your fingers won't type? They hit keys, but all the wrong ones.\\\",\\n\",\n       \" 'I always like Twitter, but reading tweets is even more fun when I have something else I am supposed to be doing.',\\n\",\n       \" \\\"Explained to the cat that I can't open the window because it's allergy season. He was unsympathetic. Window is now open.\\\",\\n\",\n       \" 'My son, age 8, was stuck in his video game, so he googled it to find the solution. Welcome to the adult world, my boy.',\\n\",\n       \" \\\"Finally saw Up in the Air. So glad they didn't go for the feel-good ending.\\\",\\n\",\n       \" 'I wonder when wigs for men are going to come back in style.',\\n\",\n       \" 'Que pasa with the weird spacing between letters in Microsoft Word? Do I need to go into autoexec.bat and set BUGS=OFF?',\\n\",\n       \" 'Very depressing when you are looking for a quick way to do something and you find that it is the subject of an entire book.',\\n\",\n       \" \\\"I hate when I write a note to myself but then later don't remember what the note refers to.\\\",\\n\",\n       \" 'Either someone has come into my office and adjusted my chair, or my muscle memory for how I sit has changed overnight.',\\n\",\n       \" \\\"I eat soup because it's low carb. But I have to add a lot of crackers to make it enjoyable.\\\",\\n\",\n       \" 'Tricky to find the right level of office gossip to engage in. Contrary to oft-repeated advice, it is not 0; you come off as cold and snooty.',\\n\",\n       \" 'All my kids\\\\' toys seem to talk. I just stepped on a car, and it literally said, \\\"Ouch! Not the face!\\\"',\\n\",\n       \" 'Bought a TV at Walmart. They asked if I needed help \\\"out to my truck.\\\"  I love how they just assume everyone owns a truck. #Texas',\\n\",\n       \" 'When coding, elegance is beauty, and beauty is good. But sometimes, elegant code is opaque code, and opaque code is bad.',\\n\",\n       \" 'Remember the scene in Disclosure where Michael Douglass was late to work? Just like that today, except my wife wanted the litter box cleaned',\\n\",\n       \" \\\"Why yes, I do want to be my own boss. I can't believe you just found me out of the blue. You must be my guardian angel.\\\",\\n\",\n       \" 'Timestamps come from actual stamps with clocks on them. Long ago, when you started and ended a call, they stamped a piece of paper #FloCon',\\n\",\n       \" 'I now need a username and password to schedule a haircut appointment.',\\n\",\n       \" \\\"My milk looks kind of blue. That can't be good, right?\\\",\\n\",\n       \" \\\"Rules for my son's science fair: no plants or animals, no food, no liquids, no glass, no dirt or soil or gravel or rocks.\\\",\\n\",\n       \" \\\"No matter how I put a fitted sheet on, it's the wrong way.\\\",\\n\",\n       \" 'Talking about the 6 Star Wars movies with my kids. Terms like \\\"first one\\\" and \\\"last one\\\" result in limitless confusion.',\\n\",\n       \" 'I was feeling a little down, so I had a giant bar of dark chocolate and a cup of coffee of the same color. #FeelingBetterNow',\\n\",\n       \" 'To file a 1099-MISC: 1. IRS mails you form. 2. You mail to recipient. 3. You both mail back to IRS. Might as well put tokens in a clay jar.',\\n\",\n       \" \\\"I can't decide if this green drink from Jamba Juice is really good or terrible.\\\",\\n\",\n       \" \\\"Just spent the last hour rebuilding my son's Lego police-state prison-industrial complex headquarters. That set has a lot of pieces.\\\",\\n\",\n       \" \\\"Weird that German chocolate cake has coconut. Because when I think of Germany, coconuts don't come readily to mind.\\\",\\n\",\n       \" 'Now that I rarely make phone calls, I realize how complicated it is. Dial a 1? Area code? Depends on where you (and the receiver) are.',\\n\",\n       \" \\\"Weird that Anon doesn't have a Wikipedia entry. I see her quotes everywhere.\\\",\\n\",\n       \" 'Reading The Jungle. Reminds me of when I worked at a peanut butter factory. If a jar came by without a label, my job was to put it aside.',\\n\",\n       \" 'They should make an emoticon for \\\"egg on my face.\\\" Something like . . .  (o)--> :(',\\n\",\n       \" \\\"Machine learning dilemma: the datasets with ground truth are not interesting, and the interesting datasets don't have ground truth.\\\",\\n\",\n       \" 'I love the initial euphoria of having a great new idea. Funny how the joy fades over time as the idea and reality get to know each other.',\\n\",\n       \" \\\"For picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\\\",\\n\",\n       \" \\\"My stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\\\",\\n\",\n       \" 'Companies outsource to save money on customer service. A better solution would be to not send ambiguous, error-ridden letters to customers.',\\n\",\n       \" \\\"If a person makes lasagna and freezes it, it tastes great. If a company does it, it tastes terrible. What gives? Ingredients? I'd pay more.\\\",\\n\",\n       \" 'Our ancestors were wise. Coffee and donuts truly are a great combination.',\\n\",\n       \" \\\"I think I'd be uncomfortable having servants, but if I did, I'd like them to peel that white stuff off my orange slices.\\\",\\n\",\n       \" 'I play soccer for my health, but every time I do, I feel like I have been run over by a truck.',\\n\",\n       \" \\\"Good thing ATMs make those loud beeping noises. That way, thieves can relax in the distance and don't have to trouble themselves to be close\\\",\\n\",\n       \" 'Love it when police put the onus on you to not get robbed. The local police here recommended that we \\\"shop in groups.\\\"',\\n\",\n       \" 'Wow! I just got a notice that Ford wants to buy back my car to \\\"fill specific needs\\\" in their inventory. Must be my lucky day.',\\n\",\n       \" 'Hate when companies send vague forms with lots of questions because they are too lazy to customize it to get only the information they need.',\\n\",\n       \" \\\"Sometimes, even when it is cold and rainy, it's nice to get out of the office and be reminded of the real world out there.\\\",\\n\",\n       \" 'I wish I had a set of books that started from the precise perimeter of my current knowledge.',\\n\",\n       \" 'Seems that the key to teaching someone something is knowing what he or she already knows. That way, you can explain things in familiar terms',\\n\",\n       \" 'When I see lists like \\\"Ten steps to be more productive,\\\" I always think the first item should be \\\"Don\\\\'t waste your time with stupid lists.\\\"',\\n\",\n       \" \\\"It's hard to google how to fix the internet when the internet is down.\\\",\\n\",\n       \" \\\"Computer programming is like mowing the lawn. I enjoy both activities, but I don't do either unless I have to.\\\",\\n\",\n       \" 'Got spam about getting a medical billing degree. A degree in billing you for a trip to the doctor. There has got to be a better system.',\\n\",\n       \" 'Movies should bring back quicksand. We all need to be reminded of the dangers.',\\n\",\n       \" 'Weird how you use vinegar to clean cat poop off the carpet and also to flavor your salad.',\\n\",\n       \" \\\"Went to our hometown carnival today. Just like the opening scene from The Notebook. Except we had kids, and I didn't climb on anything.\\\",\\n\",\n       \" \\\"Some movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\\\",\\n\",\n       \" 'Three incorrect passwords, and they lock your account. Clearly, they overestimate us.',\\n\",\n       \" 'In high school, I was lazy when we had to lift weights for soccer. After school, I would go to the gym for real. #stupid.',\\n\",\n       \" 'We need another Manhattan project to develop food packaging that can actually be opened.',\\n\",\n       \" 'It is almost impossible to find Anna Karenina if you have it spelled incorrectly. It is masked by a certain pretty, blond tennis player.',\\n\",\n       \" 'I just had $9-worth of microwave pot roast. \\\"Eat. Not too much. Mostly plants.\\\"',\\n\",\n       \" 'Beef pot roast says: \\\"Serving Per Container Varied.\\\" Is it 2? 11? 45? Also, each serving has exactly 150 calories.',\\n\",\n       \" 'Going to the store. Anyone need anything?',\\n\",\n       \" 'Just got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.',\\n\",\n       \" 'Sleepy in the mid afternoon. Alert when it is time to go to bed. I wish we had  direct control over the arousal level of our nervous system.',\\n\",\n       \" \\\"Funny, no matter what time you get home from work, you just can't go right to bed. You need to spend a couple of hours piddling around.\\\",\\n\",\n       \" \\\"Weird that humans have 4 blood types. It's like getting parts for a car. Seems like there should either be one blood type or a million.\\\",\\n\",\n       \" 'It breaks your heart when you have to take the cat to the vet. The unnatural sounds that come from that carrier ...',\\n\",\n       \" 'I always wonder if fashion/design goes forward or is more of a random walk. If it goes forward, why not just jump ahead 30 years?',\\n\",\n       \" 'If you could take a graphic design like a modern cereal box back in time 30 years, what would people think of it?',\\n\",\n       \" 'What do you do when you are too tired to watch TV?',\\n\",\n       \" \\\"Microsoft Word is always trying to think one step ahead and seamlessly adapt to your needs. That would be great if it wasn't so stupid.\\\",\\n\",\n       \" 'Been playing Mario Kart with my kids. My brain is limited. Wonder which part has been siphoned off to store the dynamics of flying mushrooms',\\n\",\n       \" \\\"Wow. You can get a lot done when you don't have to go to work.\\\",\\n\",\n       \" 'Just got done cleaning out my sock drawer. (1) Feels good to get organized. (2) Who says people only post trivial things on Twitter?',\\n\",\n       \" 'OH one cleaning guy saying to another, \\\"I keep throwing up blood.\\\" #zombies',\\n\",\n       \" \\\"Hate it when I'm in bed about to fall asleep and my mind starts chewing on some perceived injustice in the world. Now I'm back on Twitter.\\\",\\n\",\n       \" 'Hate it when you make a good-natured-but-smart-alec comment on a Facebook post and everyone else gets all deep and sentimental.',\\n\",\n       \" 'Love it when a program crashes and Windows brings up the debugger. Yeah, like I want to debug TweetDeck in my spare time.',\\n\",\n       \" 'When a commentator writes something stupid, you want to publicly ridicule the opinion. Ah, but mentioning their name rewards bad behavior.',\\n\",\n       \" \\\"Always a little hesitant to open the car's sunroof. I have this vague fear that it won't close again.\\\",\\n\",\n       \" 'I love how cats crouch down in the lawn when you walk by. Like it makes them invisible.',\\n\",\n       \" 'If the cloud loses your data, whom do you call? Does Mr. Google have a phone number?',\\n\",\n       \" 'My reversible belt purchased at a New Jersey Walmart 6 years ago is looking pretty ragged.  #LivingTheDream',\\n\",\n       \" \\\"I'll admit, I have no idea what Wordless Wednesday means.\\\",\\n\",\n       \" \\\"Anyone know how to graphically make a quote in PowerPoint look like it was torn from a newspaper? I've seen it done with Mac software.\\\",\\n\",\n       \" 'Funny how websites about making your PowerPoint presentations look professional look so amateurish.',\\n\",\n       \" 'Why do people use slideshare? The page is sluggish and cluttered with ads. And they want you to log in to download a document.',\\n\",\n       \" 'gotta go, I have to fix my son\\\\'s Lego \\\"skull crusher\\\" machine before work. #parenting',\\n\",\n       \" \\\"Spent Saturday night installing a water softener. I'm living the dream.\\\",\\n\",\n       \" 'My son asked us to get him a \\\"nonfiction\\\" book about Bigfoot at the library.',\\n\",\n       \" 'I always get Oscar de la Hoya and Oscar de la Renta confused. I assume that they are one in the same and they made my sweater.',\\n\",\n       \" 'I love how we have technology beyond our dreams, yet we still seal envelopes with human saliva.',\\n\",\n       \" 'Stratego is great for teaching kids the value of information. You must move to win, but each move also reveals information to the opponent.',\\n\",\n       \" 'I always get Siri confused with Suri.',\\n\",\n       \" \\\"I'm not a fan of the black, gold, silver, and metal colors for winter clothes. Nothing wrong with a little bright green in January.\\\",\\n\",\n       \" 'Went to the mall today. Weird place with pictures of pretty people everywhere.  It used to be so familiar.',\\n\",\n       \" \\\"Hate it when you pour milk in the cereal and it hits the spoon and comes flying out.  It happens just infrequently enough so I don't learn.\\\",\\n\",\n       \" 'Well, I explained the concept of \\\"might work, but not worth the risk.\\\" One dog chewed the ball and now owns it.',\\n\",\n       \" 'Playing with kids and ball went into neighbors yard with mean dogs. Their plan: throw youngest child over while the rest of us distract them',\\n\",\n       \" \\\"Aren't we all tired of seeing smiling people in stock photographs in cheap publications? I'd rather see realistic pictures by amateurs.\\\",\\n\",\n       \" 'Why do dogs howl at sirens? The neighborhood dogs go nuts every time a fire truck goes by.',\\n\",\n       \" 'Once you start with the bagels, you got to keep going. Otherwise you crash.',\\n\",\n       \" 'Does CNN really believe that people will sit through a 30 second commercial to watch a 70 second video?',\\n\",\n       \" 'Apparently, by international law, every song written in Spanish must contain at least one use of the word \\\"corazon.\\\"',\\n\",\n       \" 'I love how reading a good book colors everyday life experience during the time you are reading it. Right now: Super Sad True Love Story.',\\n\",\n       \" 'Wow. Loud. The fire alarm in this building is the audio equivalent of tear gas. I guess I best be moseying on.',\\n\",\n       \" '\\\"This sentence is false.\\\" Is it true or false? Anyone asking that kind of question should be punched in the face.',\\n\",\n       \" 'Just walked .002 miles in 2.1 minutes and burned 1.7 calories on my way to the fridge.',\\n\",\n       \" 'Was off the grid once in China. You might think being offline would clear my mind and enhance creativity, but I just felt numb and lazy.',\\n\",\n       \" 'There is no excuse for printers to be only black and white. People say color is more expensive. Poppycock. So are color TVs.',\\n\",\n       \" 'I used to wonder how to make food-service employees at airports more friendly. Apparently, the solution was to replace them with kiosks.',\\n\",\n       \" 'Please watch your step as you exit the moving walk.',\\n\",\n       \" 'My son: \\\"Daddy, why won\\\\'t the window close?\\\" Me: \\\"That\\\\'s just a little gift from Microsoft.\\\"',\\n\",\n       \" '\\\"Time on your hands.\\\" When you think about it, the saying makes no sense at all. Is time, like, some kind of rash?',\\n\",\n       \" 'Maybe vacations are so relaxing because our brains must process the new sights and so they have less time to turn over the usual worries.',\\n\",\n       \" 'It always seemed weird to me that a smile is a signal of goodwill. You are, after all, bearing your teeth.',\\n\",\n       \" 'For some reason, Pandora is really trying to get me into Indian music.',\\n\",\n       \" \\\"Mute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\\\",\\n\",\n       \" \\\"I really hate negativity. It is everywhere, I hear it all day. It's terrible. Nothing can fix it. Just give up.\\\",\\n\",\n       \" 'Constant computer clash: you want to close windows to get the clutter out of the way, but will be work to reopen later. Metaphor in there.',\\n\",\n       \" 'Just finished reading On China by Henry Kissinger. Great book if you are interested in China and/or international diplomacy.',\\n\",\n       \" 'Breaks your heart. The little brother idolizes the older brother, but the older brother is too young to appreciate it.',\\n\",\n       \" \\\"It's amazing how fast time goes by when you read good fiction.\\\",\\n\",\n       \" 'Whoa, deja vu. I have a theory that deja vu comes from having a forgotten similar memory that gets triggered by the current moment.',\\n\",\n       \" 'I wish there was a way to make brushing my teeth more fun.',\\n\",\n       \" 'I love reading articles on the web about innovation stagnation that were recommended to me by robots.',\\n\",\n       \" 'Ever get a small piece of carrot stuck in your throat? It appears that my current best option is self-surgery.',\\n\",\n       \" 'Peanut butter and jelly sandwiches are terrible. But peanut butter and jelly sandwiches with toasted bread are awesome.',\\n\",\n       \" \\\"Was just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\\\",\\n\",\n       \" 'We each remember all the events that we remember, so we all think that our memory is pretty good.',\\n\",\n       \" 'My son: \\\"Daddy, what\\\\'s the point of soccer?\\\" Me: \\\"To score goals.\\\" Him: \\\"But why?\\\" There\\\\'s no why boy, practice your dribbling.',\\n\",\n       \" \\\"Amazing how you can just pick kids up when they're sleeping. I'd probably wake up if somebody lifted me over their shoulder at 2 am.\\\",\\n\",\n       \" \\\"I've noticed that my peanut consumption has increased substantially since I took a job that offers free peanuts.\\\",\\n\",\n       \" 'I am continually surprised at how unhelpful a thesaurus is. Anyone have a good explanation?',\\n\",\n       \" 'The form says, \\\"Employee Name (type):\\\" and I am tempted to put \\\"string\\\" #TooMuchComputers',\\n\",\n       \" 'My wife says I should be careful with my facial expressions out in public. I tell her that reading my face invades my privacy.',\\n\",\n       \" 'In the 1980s, you used to hear stories about lost cats traveling alone across the country to find their owners. Do they not do that anymore?',\\n\",\n       \" \\\"The cat just knocked a coffee cup off the table. Aren't they supposed to be graceful?\\\",\\n\",\n       \" \\\"For the longest time, I couldn't figure out how to stop Excel from reading text aloud. Finally did, now I miss it.\\\",\\n\",\n       \" 'Customers need a secure way to communicate with companies without having to log into each individual website. Such a pain.',\\n\",\n       \" 'In Austin, there is some kind of black-hole vortex where Mopac, 290, 71, 360, and Lamar all come together. I get lost every time.',\\n\",\n       \" \\\"You know, one cool thing about Twitter is that the interface doesn't change more often than it rains.\\\",\\n\",\n       \" \\\"Microsoft still doesn't get it. I don't want to have to manually add folders to libraries. I want search to just work.\\\",\\n\",\n       \" 'I love chocolate milk.',\\n\",\n       \" 'Went on the \\\"teacup ride\\\" at Austin\\\\'s Park. Do not be fooled by the innocent-sounding name. Been over 4 hours, and I still don\\\\'t feel right.',\\n\",\n       \" \\\"I just had a chatbot tell me I was boring. Man, those things are stupid. My mom says that I'm fascinating and handsome.\\\",\\n\",\n       \" \\\"Seems like lately I've been in the situation of having more hammers than problems, which is a problem.\\\",\\n\",\n       \" 'Oh Microsoft Word, I am powerless against your invisible formatting. Curse you.',\\n\",\n       \" 'It breaks your heart when you see your own flaws in your children.',\\n\",\n       \" 'Some schools ban cupcakes for birthdays. Other schools pimp their students to sell cookie dough door-to-door to raise funds.',\\n\",\n       \" \\\"New cities are ugly. It's the deep texture created by continual rebuilding that makes them beautiful. [K. Kelly, What Technology Wants]\\\",\\n\",\n       \" \\\"There must be a special place in hell for the people who decided you can't skip movie previews on DVD.\\\",\\n\",\n       \" 'Did my mom really send me an email \\\"108 Casseroles, Crockpot Dishes, and Desserts Perfect for Fall\\\" or was her account hacked? Modern life.',\\n\",\n       \" 'My two boys have reached the \\\"Mom, he\\\\'s repeating me\\\" stage of cognitive development. Not sure where Piaget would put that one.',\\n\",\n       \" 'Fixed 3 leaky faucets today. I have three kids and a job. I guess this is what being an adult feels like.',\\n\",\n       \" 'Remember when a long-distance phone call was kind of a big deal?',\\n\",\n       \" \\\"As a knowledge worker, I've never understood why people do crossword puzzles. It's like a tow-truck driver towing his own car on the weekend\\\",\\n\",\n       \" 'Which is more complex, a jet airplane or a cucumber? ... [What Technology Wants, Kevin Kelly]',\\n\",\n       \" 'Amazing how black socks change to blue when you take them out of the dresser drawer.',\\n\",\n       \" 'I wish the post office would raise their bulk mailing prices. They could fix their budget problems and I would get fewer credit card offers.',\\n\",\n       \" \\\"Went shopping at the mall tonight for the first time in years.  Amazing, malls haven't changed at all since I was a teenager.\\\",\\n\",\n       \" 'Office is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.',\\n\",\n       \" \\\"There are some thoughts that I can't express in 140 characters. So I don't.  300 chars might be better. Or 10000 characters a month.\\\",\\n\",\n       \" \\\"Love modern conveniences. Got an email from my bank saying they need me to enter in my acct and ssn. Nice, I don't need to drive down there.\\\",\\n\",\n       \" 'When younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.',\\n\",\n       \" 'Just saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.',\\n\",\n       \" \\\"The toddler is crying because we won't let her eat a tub of butter.\\\",\\n\",\n       \" 'There are funny consequences to giving your pets human names. My wife told a group of people, \\\"Jimbob threw up everywhere and ran away.\\\"',\\n\",\n       \" 'I feel like a horse whenever I eat Cheerios.',\\n\",\n       \" \\\"Being hungry before going to bed is good b/c it means I didn't eat too much during the day. But it's bad because I'm hungry.\\\",\\n\",\n       \" 'Wow, full-page ad in USA Today indistinguishable from real article. Depressing.',\\n\",\n       \" \\\"One bummer about getting older is that I've already seen every new movie that comes out.\\\",\\n\",\n       \" 'I have to admit, I have no idea what they mean when people refer to something as \\\"cynical.\\\" I\\\\'m starting to doubt that they do either.',\\n\",\n       \" 'Pandora just played a song called \\\"For Jonathan.\\\" Whoah.',\\n\",\n       \" 'They are putting up a tent outside with a people-lifting machine that goes BEEP BEEP BEEP. A tent. Safety is important, but so is sanity.',\\n\",\n       \" 'Funny how trash TV continues to pollute your mind even after you watch it. You find yourself thinking about the characters and stories.',\\n\",\n       \" 'Speaking of signs, I was completely baffled by \\\"Ped Xing\\\" as a kid. I had no idea what a \\\"ped\\\" was and even less how one would \\\"X.\\\"',\\n\",\n       \" 'I love those road signs that tell you to obey road signs.',\\n\",\n       \" 'My sister asked me on the phone last night if I speak Mandarin. Clearly, we need to get together more often.',\\n\",\n       \" \\\"I haven't seen a cherry tomato in years. It's always those inferior grape tomatoes.\\\",\\n\",\n       \" 'Funny. There is a sound a person is supposed to make if they almost run into someone else. It\\\\'s a barely audible \\\"wup.\\\"',\\n\",\n       \" 'I wish I were as tired at bedtime as I am in the middle of the afternoon.',\\n\",\n       \" 'Soup in the microwave undergoes a phase change. At 1:23 it is ice cold, but it turns to scalding hot at some point before the click of 1:24.',\\n\",\n       \" \\\"I've decided that age 4 is the golden age for quotes. The kid is old enough to articulate ideas but too young to have reasonable ones.\\\",\\n\",\n       \" \\\"I love Bailey's and coffee. But I can't drink liquor during the day, and I can't drink coffee at night.\\\",\\n\",\n       \" 'In the world of online banking, it seems kind of meaningless to get an email about a \\\"monthly statement.\\\" Oh, I can check my account now!',\\n\",\n       \" 'Wife: \\\"I\\\\'m sorry, that was my fault.\\\" Son: \\\"I didn\\\\'t know anything was ever your fault.\\\" Mommies are infallible. Like the pope.',\\n\",\n       \" 'My shirt today has a more flared collar than normal. Not sure if \\\"Business Disco\\\" is how you dress for success these days, but I like it.',\\n\",\n       \" 'I just asked my son (age 7) what he was going to do today. He said, \\\"I don\\\\'t know.\\\" How great would it be to live like that again?',\\n\",\n       \" \\\"When is the last time you called time and temperature? I just tried it, but it didn't work.\\\",\\n\",\n       \" \\\"Some days, I can only skim the surface and can't seem to dive in and read individual tweets.\\\",\\n\",\n       \" 'I wonder if computers will ever define an ontology that is useful to them but completely alien to us.',\\n\",\n       \" 'Computer understanding: 1. Humans define buckets. 2. Computers process tons of online data and put things in buckets. Shallow, but useful.',\\n\",\n       \" 'online chat with the bank. You wait forever, and then they respond with a stupid question or \\\"thank you for confirming that information.\\\"',\\n\",\n       \" 'It reminds me of that time people broke into my apartment, but all they did was vacuum.',\\n\",\n       \" 'While I was out, someone put a copy of \\\"Working Mother\\\" magazine on my desk with a note that read, \\\"Want this?\\\" I am baffled.',\\n\",\n       \" 'Was outside pruning the trees. I felt like a Zen master.',\\n\",\n       \" 'They say that the best place to store coffee is in the body.',\\n\",\n       \" 'Funny how quickly a new place can feel like home. Probably comes from our hunter-gatherer days.',\\n\",\n       \" 'Ever get a headache from trying to cram too much into your head at once? It\\\\'s like my brain is saying, \\\"OK. Enough. Let me get organized.\\\"',\\n\",\n       \" \\\"Is it me, or is Bill O'Reilly starting to look like Hugh Hefner?\\\",\\n\",\n       \" \\\"Ever worry that your brain is going to run out of space? I love learning, but I don't want to overwrite previous lessons.\\\",\\n\",\n       \" 'Intelligence is complicated and deep. Our AI systems are simple and shallow. We have a long way to go.',\\n\",\n       \" 'kevin kelly: we realized only recently (200 years) that technology is a thing in itself, building on itself. Before, it was individual art.',\\n\",\n       \" 'I keep buying pyrite but I must be doing something wrong.',\\n\",\n       \" 'I just stepped on a Froot Loop. #LifeWithKids',\\n\",\n       \" \\\"I hate when my spelling is so bad that spell check doesn't even put the intended word in its list of suggestions.\\\",\\n\",\n       \" 'Making a sandwich, I was reminded of how my grandfather once had a job putting holes in swiss cheese.',\\n\",\n       \" 'So if you really expect the unexpected, then the expected becomes the unexpected, and that makes it expected again. Repeat.',\\n\",\n       \" \\\"I don't understand why anyone uses scribd. There are so many ads that it makes whatever you have done look ugly.\\\",\\n\",\n       \" 'There should be a tablet PowerPoint where you create slides by drawing with your finger and writing with your pen.',\\n\",\n       \" 'Really do need to clean out my sock drawer. Now I know the predicament of all those girls who turned me down for dates in my younger years.',\\n\",\n       \" 'It appears that there are more days in the work week than I have nice pants. Time to go shopping.',\\n\",\n       \" \\\"Watched a video on how to fix my lawn mower ... livin' la vida loca.\\\",\\n\",\n       \" 'Ever notice that it is never a good time to run out of staples?',\\n\",\n       \" 'Apparently, ariel images are not the same as aerial images.',\\n\",\n       \" \\\"A benefit from thinking about the world from a design perspective is that nothing is your fault. Can't work a device? Bad design.\\\",\\n\",\n       \" 'If I had a nickle for every mortgage refinance \\\"opportunity\\\" I received from my mortgage company, I could pay off my mortgage.',\\n\",\n       \" \\\"Was feeling positive until I started reading the news. I can't tell if things are really going down hill, or if bad news just sells better.\\\",\\n\",\n       \" '\\\"iTunes. All your Music. All in one place.\\\" My brain first read that as \\\"iTunes. All your music belong to us.\\\"',\\n\",\n       \" \\\"I started eating a lot more fruits and vegetables. I don't know if it shows in my waistline, but it sure shows in my credit card bill.\\\",\\n\",\n       \" 'We change with time yet stay the same. I still enjoy a bowl of cereal after soccer. Except now I eat Shredded Wheat instead of Cookie Crisp.',\\n\",\n       \" 'Hays CISD says anyone who wishes to step on any school field at any time must fill out facility usage form. The world has gone mad.',\\n\",\n       \" 'Ever have one of those days where every little thing seems to annoy you? Ah, the fun of being human.',\\n\",\n       \" 'When I was a boy and saw Cool Hand Luke, I thought it was funny. Later, seeing it again as an adult, I thought it was sad.',\\n\",\n       \" ...]\"\n      ]\n     },\n     \"execution_count\": 11,\n     \"metadata\": {},\n     \"output_type\": \"execute_result\"\n    }\n   ],\n   \"source\": [\n    \"all_tweets\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 23,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"1219\\n\",\n      \"(1219, 768)\\n\",\n      \"1219\\n\",\n      \"warning: Embedding dir exists, did you set global_step for add_embedding()?\\n\",\n      \"warning: Embedding dir exists, did you set global_step for add_embedding()?\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"from torch.utils.tensorboard import SummaryWriter\\n\",\n    \"summary = SummaryWriter(data_dir)\\n\",\n    \"\\n\",\n    \"is_annoying_error = True\\n\",\n    \"if is_annoying_error: # if you get this error, do this, I think it only\\n\",\n    \"    # happens if you already have tensorflow installed\\n\",\n    \"    # \\\"AttributeError: module 'tensorflow_core._api.v2.io.gfile' \\n\",\n    \"    # has no attribute 'get_filesystem'\\\"\\n\",\n    \"    # https://github.com/pytorch/pytorch/issues/30966\\n\",\n    \"    import tensorflow as tf\\n\",\n    \"    import tensorboard as tb\\n\",\n    \"    tf.io.gfile = tb.compat.tensorflow_stub.io.gfile\\n\",\n    \"\\n\",\n    \"all_transformer_np = np.array(all_transformer_vecs)\\n\",\n    \"all_average_np = np.array(all_average_vecs)\\n\",\n    \"\\n\",\n    \"print(len(all_transformer_vecs))\\n\",\n    \"print(all_transformer_np.shape)\\n\",\n    \"print(len(all_tweets))\\n\",\n    \"\\n\",\n    \"summary.add_embedding(all_transformer_np, \\n\",\n    \"                       metadata=all_tweets, \\n\",\n    \"                       tag='transformer_vecs')\\n\",\n    \"\\n\",\n    \"summary.add_embedding(all_average_np, \\n\",\n    \"                       metadata=all_tweets, \\n\",\n    \"                       tag='average_vecs')\\n\",\n    \"\\n\",\n    \"summary.add_embedding(custom_vecs['vecs'], \\n\",\n    \"                       metadata=custom_vecs['tweets'], \\n\",\n    \"                       tag='custom_vecs')\\n\",\n    \"\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Look at the vectors in TensorBoard\\n\",\n    \"\\n\",\n    \"`tensorboard --logdir=./`\\n\",\n    \"\\n\",\n    \"then go to http://localhost:6006/\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": null,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": []\n  }\n ],\n \"metadata\": {\n  \"kernelspec\": {\n   \"display_name\": \"Python 3.7.4 64-bit ('base': conda)\",\n   \"language\": \"python\",\n   \"name\": \"python37464bitbaseconda6a86cbe610af4db3860115ffdb24f1cc\"\n  },\n  \"language_info\": {\n   \"codemirror_mode\": {\n    \"name\": \"ipython\",\n    \"version\": 3\n   },\n   \"file_extension\": \".py\",\n   \"mimetype\": \"text/x-python\",\n   \"name\": \"python\",\n   \"nbconvert_exporter\": \"python\",\n   \"pygments_lexer\": \"ipython3\",\n   \"version\": \"3.7.4\"\n  }\n },\n \"nbformat\": 4,\n \"nbformat_minor\": 2\n}\n"
  },
  {
    "path": "Episode_4_Generating_Text_and_Extracting_Info.ipynb",
    "content": "{\n \"cells\": [\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Overview\\n\",\n    \"* In the first three lessons we did a decent amount of custom work.\\n\",\n    \"* In this last and final lesson, we first go over the parts of HuggingFace that might be most useful.\\n\",\n    \"  * We will be working from here https://huggingface.co/transformers/usage.html\\n\",\n    \"* We will then look at named entity recognition in spaCy.\\n\",\n    \"* And finally we will have a couple of concluding thoughts.\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# HuggingFace Pipelines\\n\",\n    \"* They have these pipelines that allow you do things quickly\\n\",\n    \"* See https://huggingface.co/transformers/main_classes/pipelines.html#the-task-specific-pipelines for more information\\n\",\n    \"* The horse's mouth to see the pipelines available https://github.com/huggingface/transformers/blob/master/src/transformers/pipelines.py\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"## Text Generation Pipeline\\n\",\n    \"You can create text from a prompt\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 1,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stderr\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Downloading: 100%|██████████| 230/230 [00:00<00:00, 73.4kB/s]\\n\",\n      \"Setting `pad_token_id` to 50256 (first `eos_token_id`) to generate sequence\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"[{'generated_text': 'The space aliens came to me to talk about their own race to whom they had come to enslave. Because they were aliens, they were more like friends, the only beings of intelligence that humans came to know. I knew that for much but it just so happened that at least one of them was a human. And not even that one could live in my life, only by way of the Force, at least not to have any sort of sense of morality or morality or self. I was also'}]\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"from transformers import pipeline\\n\",\n    \"\\n\",\n    \"text_generator = pipeline(\\\"text-generation\\\")\\n\",\n    \"print(text_generator(\\\"The space aliens came to me to talk about\\\", \\n\",\n    \"                     max_length=100))\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"## Summarization Pipeline\\n\",\n    \"* Works best on news articles. Many models were trained on the Daily Mail bullets.\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 8,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stderr\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Downloading: 100%|██████████| 899k/899k [00:08<00:00, 110kB/s] \\n\",\n      \"Downloading: 100%|██████████| 456k/456k [00:04<00:00, 106kB/s]  \\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"[{'summary_text': \\\"This weekend, I was able to convince my youngest son, age 7, to branch beyond chicken nuggets to Orange Chicken. I don't know why, but refactoring code is a lot of fun. #OddlyS\\\"}]\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"from transformers import pipeline\\n\",\n    \"\\n\",\n    \"# Contrary to instructions, you need to do as below as illustrated\\n\",\n    \"# https://github.com/huggingface/transformers/issues/4504\\n\",\n    \"#summarizer = pipeline(\\\"summarization\\\")\\n\",\n    \"summarizer = pipeline('summarization',\\n\",\n    \"                      model='bart-large-cnn', \\n\",\n    \"                      tokenizer='bart-large-cnn')\\n\",\n    \"\\n\",\n    \"text = \\\"\\\"\\\"\\n\",\n    \"Cats don't like to wrestle.\\n\",\n    \"It would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.\\n\",\n    \"Amazing how worthless I would be if you sent me back in time 10,000 years. I could describe amazing technology but couldn't build any of it.\\n\",\n    \"I can't believe we still have pennies. They aren't even worth picking up off the ground.\\n\",\n    \"Sometimes you wake and wish the adventure dream you were having didn't have to end. I want video games with that much excitement and realism\\n\",\n    \"Why isn't there an app that lets me share photos with all my social media sites? Facebook, G+, Twitter. Oh yeah, #NoProfitInFreedom\\n\",\n    \"This weekend, I was able to convince my youngest son, age 7, to branch beyond chicken nuggets to Orange Chicken. #CulinaryVictory\\n\",\n    \"I've found that being a fair-weather sports fan is a real time saver.\\n\",\n    \"My son, age 7, was playing \\\"restaurant,\\\" and the first thing he did was set up security cameras. #ModernWorld\\n\",\n    \"I don't know why, but refactoring code is a lot of fun. #OddlySatisfying\\n\",\n    \"Happiness is working on your projects.\\n\",\n    \"\\\"\\\"\\\"\\n\",\n    \"\\n\",\n    \"print(summarizer(text, max_length=50, min_length=30))\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"## Translation Pipeline\\n\",\n    \"* It only has a few languages set up at the moment.\\n\",\n    \"* Google translate gives \\\"Les chats n'aiment pas lutter.\\\"\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 11,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stderr\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Downloading: 100%|██████████| 230/230 [00:00<00:00, 49.3kB/s]\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"[{'translation_text': \\\"Les chats n'aiment pas se battre.\\\"}]\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"from transformers import pipeline\\n\",\n    \"\\n\",\n    \"translator = pipeline(\\\"translation_en_to_fr\\\")\\n\",\n    \"print(translator(\\\"Cats don't like to wrestle.\\\", max_length=40))\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"## Named Entity Recognition Pipeline\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 21,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stderr\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"Downloading: 100%|██████████| 230/230 [00:00<00:00, 64.0kB/s]\\n\"\n     ]\n    },\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"[{'entity': 'I-MISC', 'index': 5, 'score': 0.8857880234718323, 'word': 'Jane'},\\n\",\n      \" {'entity': 'I-MISC', 'index': 6, 'score': 0.957772970199585, 'word': 'Austin'},\\n\",\n      \" {'entity': 'I-ORG', 'index': 9, 'score': 0.9754951000213623, 'word': 'Google'},\\n\",\n      \" {'entity': 'I-ORG', 'index': 10, 'score': 0.6128684878349304, 'word': 'Doc'},\\n\",\n      \" {'entity': 'I-ORG', 'index': 11, 'score': 0.8213635683059692, 'word': '##s'},\\n\",\n      \" {'entity': 'I-MISC',\\n\",\n      \"  'index': 20,\\n\",\n      \"  'score': 0.9108381867408752,\\n\",\n      \"  'word': 'Austen'},\\n\",\n      \" {'entity': 'I-LOC',\\n\",\n      \"  'index': 27,\\n\",\n      \"  'score': 0.9868152737617493,\\n\",\n      \"  'word': 'Austin'},\\n\",\n      \" {'entity': 'I-LOC', 'index': 29, 'score': 0.9850055575370789, 'word': 'Texas'}]\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"from transformers import pipeline\\n\",\n    \"\\n\",\n    \"nlp = pipeline(\\\"ner\\\")\\n\",\n    \"\\n\",\n    \"tweet = \\\"\\\"\\\"If you write \\\"Jane Austin\\\", Google Docs recommends a correction' \\\\\\n\",\n    \"        'to \\\"Austen\\\". If you write \\\"Austin, Texas\\\", it doesn't. Nice.\\\"\\\"\\\"\\n\",\n    \"\\n\",\n    \"ners = nlp(tweet)\\n\",\n    \"import pprint\\n\",\n    \"pprint.pprint(ners)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# spaCy Named Entity Recognition\\n\",\n    \"on tokens \\n\",\n    \"https://spacy.io/api/token\\n\",\n    \"and at doc level\\n\",\n    \"https://spacy.io/usage/linguistic-features#named-entities\\n\"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": 22,\n   \"metadata\": {},\n   \"outputs\": [\n    {\n     \"name\": \"stdout\",\n     \"output_type\": \"stream\",\n     \"text\": [\n      \"If O \\n\",\n      \"you O \\n\",\n      \"write O \\n\",\n      \"\\\" O \\n\",\n      \"Jane B PERSON\\n\",\n      \"Austin I PERSON\\n\",\n      \"\\\" O \\n\",\n      \", O \\n\",\n      \"Google B PERSON\\n\",\n      \"Docs I PERSON\\n\",\n      \"recommends O \\n\",\n      \"a O \\n\",\n      \"correction O \\n\",\n      \"' O \\n\",\n      \"         O \\n\",\n      \"' O \\n\",\n      \"to O \\n\",\n      \"\\\" O \\n\",\n      \"Austen B WORK_OF_ART\\n\",\n      \"\\\" O \\n\",\n      \". O \\n\",\n      \"If O \\n\",\n      \"you O \\n\",\n      \"write O \\n\",\n      \"\\\" O \\n\",\n      \"Austin B PERSON\\n\",\n      \", O \\n\",\n      \"Texas B GPE\\n\",\n      \"\\\" O \\n\",\n      \", O \\n\",\n      \"it O \\n\",\n      \"does O \\n\",\n      \"n't O \\n\",\n      \". O \\n\",\n      \"Nice O \\n\",\n      \". O \\n\",\n      \"****** start document entities *******\\n\",\n      \"Jane Austin 14 25 PERSON\\n\",\n      \"Google Docs 28 39 PERSON\\n\",\n      \"Austen 78 84 WORK_OF_ART\\n\",\n      \"Austin 101 107 PERSON\\n\",\n      \"Texas 109 114 GPE\\n\"\n     ]\n    }\n   ],\n   \"source\": [\n    \"import spacy\\n\",\n    \"tweet = \\\"\\\"\\\"If you write \\\"Jane Austin\\\", Google Docs recommends a correction' \\\\\\n\",\n    \"        'to \\\"Austen\\\". If you write \\\"Austin, Texas\\\", it doesn't. Nice.\\\"\\\"\\\"\\n\",\n    \"nlp = spacy.load(\\\"en_core_web_sm\\\")  # note not vector model of before\\n\",\n    \"tokens = nlp(tweet)\\n\",\n    \"for token in tokens:\\n\",\n    \"    print(token, token.ent_iob_, token.ent_type_)\\n\",\n    \"    \\n\",\n    \"print(\\\"****** start document entities *******\\\")\\n\",\n    \"\\n\",\n    \"doc = nlp(tweet)\\n\",\n    \"\\n\",\n    \"for ent in doc.ents:\\n\",\n    \"    print(ent.text, ent.start_char, ent.end_char, ent.label_)\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"## Training your own named entity recognizer in spaCy\\n\",\n    \"* You might want to train your own named entity recognizer for your domain-specific entities. You can see how to do that here\\n\",\n    \"https://spacy.io/usage/training\"\n   ]\n  },\n  {\n   \"cell_type\": \"markdown\",\n   \"metadata\": {},\n   \"source\": [\n    \"# Conclusion\\n\",\n    \"\\n\",\n    \"## Three main ways to get practical value from NLP now:\\n\",\n    \"* Find similar documents with vectors\\n\",\n    \"* Classification by converting documents to vectors\\n\",\n    \"* Extracting named entities of interest\\n\",\n    \"\\n\",\n    \"## Other Tools\\n\",\n    \"We ended up covering HuggingFace and spaCy. Other tools you might want to look at\\n\",\n    \"* OpenNMT: good for translations and summarization https://opennmt.net/\\n\",\n    \"* AllenNLP: more research oriented https://allennlp.org/\\n\",\n    \"* Stanford NLP: (in Java) if you need to do constituency parsing (make parsing trees) https://nlp.stanford.edu/software/\\n\",\n    \"* fast.ai: I haven't used it but I've heard good things. See https://www.fast.ai/ and https://towardsdatascience.com/fastai-with-transformers-bert-roberta-xlnet-xlm-distilbert-4f41ee18ecb2 \"\n   ]\n  },\n  {\n   \"cell_type\": \"code\",\n   \"execution_count\": null,\n   \"metadata\": {},\n   \"outputs\": [],\n   \"source\": []\n  }\n ],\n \"metadata\": {\n  \"kernelspec\": {\n   \"display_name\": \"Python 3.7.4 64-bit ('base': conda)\",\n   \"language\": \"python\",\n   \"name\": \"python37464bitbaseconda6a86cbe610af4db3860115ffdb24f1cc\"\n  },\n  \"language_info\": {\n   \"codemirror_mode\": {\n    \"name\": \"ipython\",\n    \"version\": 3\n   },\n   \"file_extension\": \".py\",\n   \"mimetype\": \"text/x-python\",\n   \"name\": \"python\",\n   \"nbconvert_exporter\": \"python\",\n   \"pygments_lexer\": \"ipython3\",\n   \"version\": \"3.7.4\"\n  }\n },\n \"nbformat\": 4,\n \"nbformat_minor\": 2\n}\n"
  },
  {
    "path": "README.md",
    "content": "# Modern Practical Natural Language Processing\n\nThis course will cover how you can use NLP to do stuff.\n\nThere are four videos\n1. Overview and Converting Text to Vectors\n  * For finding similar documents\n  * \"I have this document or text, what others talk about the same stuff?\"\n  * [Video](https://www.youtube.com/watch?v=aiHB7Ap9wF4)\n2. Learning with Vectors and Classification\n  * For classifying documents\n  * \"I need to put these documents into buckets.\"\n  * [Video](https://www.youtube.com/watch?v=fb4L_1QuIo0&fbclid)\n3. Visualizing\n  * For seeing what document vectors look like in 3D space\n  * \"I need to quickly see what looks similar to what.\"\n  * [Video](https://www.youtube.com/watch?v=o8Ea-5CjOgg&ab_channel=GlobalDataGeeks)\n4. Sequence Generation and Extracting Pieces of Information from Text\n  * For translation and document summarization, and for pulling out sentences and documents that talk about specific things\n  * \"I need every mention of a street address or business in Garland, Texas; and I need each document translated to Urdu.\"\n  * [Video](https://www.youtube.com/watch?v=yrPu072D4h4&ab_channel=GlobalDataGeeks)\n\n\n# Additional Details\n\nThe idea is we make short videos that focus on the aspects of NLP that currently work well and are useful.\n\nSpeech-to-text now works pretty well, so these methods will also be useful for the audio portions of videos.\n\nAll code will be available on GitHub here https://github.com/jmugan/modern_practical_nlp\n\n# About Me, Jonathan Mugan\n* PhD in Computer Science in 2010 from UT Austin\n* Thesis work was about how a robot could wake up in the world and figure out what is going on\n* Work at [DeUmbra](https://deumbra.com/) where we build AI for the DoD\n  * We also work in healthcare, which I can talk about. A future video (not in this series) will cover how we use graph neural networks to identify who is at risk for opioid overdose\n  * Hands-on technical advisor at our sister company [Pulselight](https://www.pulselight.com/)\n* Wrote [*The Curiosity Cycle: Preparing Your Child for the Ongoing Technological Explosion*](http://www.jonathanmugan.com/CuriosityCycle/)\n* Advisor at [KUNGFU.AI](https://www.kungfu.ai/)\n* Also do independent consulting work\n* Can find me here jonathanwilliammugan@gmail.com or on Twitter at [@jmugan](https://twitter.com/jmugan)\n\n# The Limits of NLP\n## Computers can't read\n* Reading requires mapping language to internal concepts grounded in behaving in the same general environment as the writer.\n  * Computers don’t have those concepts.\n  * Example: “I pulled the wagon.” Computers don’t know that wagons can carry things or that pulling exerts a gentle tension to the arm and leg muscles as one walks.\n\n## Computers can't write\n* Writing requires mapping internal concepts grounded in behaving in the same general environment as the expected reader.\n  * Computers don’t have those concepts\n\n## NLP Works Around Computers Not Having the Experience or Conceptual Framework to Read and Write\n* NLP is about how to make natural language amenable to computation even though computers can’t read or write.\n* Representing text as *vectors* has transformed NLP in the last 10 years.\n* There are also *symbolic methods* that are practically useful; we will cover those too.\n\n# Additional Information on NLP, AI, and Their Limits and Promise\n* [Microsoft Flight Simulator 2020 is an inflection point for virtual worlds and our own](https://deumbra.com/2020/09/microsoft-flight-simulator-2020-is-an-inflection-point-for-virtual-worlds-and-our-own/)\n* [Generating Natural-Language Text with Neural Networks](https://medium.com/@jmugan/generating-natural-language-text-with-neural-networks-e983bb48caad)\n* [Why Is There Life? and What Does It Have to Do with AI?](https://towardsdatascience.com/why-is-there-life-and-what-does-it-have-to-do-with-ai-2195ac91532f)\n* [Chatbots: Theory and Practice](https://medium.com/intuitionmachine/chatbots-theory-and-practice-3274f7e6d648)\n* [You and Your Bot: A New Kind of Lifelong Relationship](https://chatbotsmagazine.com/you-and-your-bot-a-new-kind-of-lifelong-relationship-6a9649feeb71)\n* [Computers Could Understand Natural Language Using Simulated Physics](https://chatbotslife.com/computers-could-understand-natural-language-using-simulated-physics-26e9706013da)\n* [The Two Paths from Natural Language Processing to Artificial Intelligence](https://medium.com/intuitionmachine/the-two-paths-from-natural-language-processing-to-artificial-intelligence-d5384ddbfc18)\n* [DeepGrammar: Grammar Checking Using Deep Learning](https://www.linkedin.com/pulse/deep-grammar-checking-using-learning-jonathan-mugan)\n* [Deep Learning for Natural Language Processing](https://www.linkedin.com/pulse/deep-learning-natural-language-processing-jonathan-mugan)\n* [What Deep Learning Really Means](https://www.linkedin.com/pulse/20141114065942-42285562-what-deep-learning-really-means)\n* My O'Reilly course on NLP: [Natural Language Text Processing with Python](http://shop.oreilly.com/product/0636920061007.do)\n"
  },
  {
    "path": "jmugan_tweets.txt",
    "content": "Cats don't like to wrestle.\nIt would be nice if we could abandon all of this inane talk about celebrities and go back to gossiping about people that we actually know.\nAmazing how worthless I would be if you sent me back in time 10,000 years. I could describe amazing technology but couldn't build any of it.\nI can't believe we still have pennies. They aren't even worth picking up off the ground.\nSometimes you wake and wish the adventure dream you were having didn't have to end. I want video games with that much excitement and realism\nWhy isn't there an app that lets me share photos with all my social media sites? Facebook, G+, Twitter. Oh yeah, #NoProfitInFreedom\nThis weekend, I was able to convince my youngest son, age 7, to branch beyond chicken nuggets to Orange Chicken. #CulinaryVictory\nI've found that being a fair-weather sports fan is a real time saver.\nMy son, age 7, was playing \"restaurant,\" and the first thing he did was set up security cameras. #ModernWorld\nI don't know why, but refactoring code is a lot of fun. #OddlySatisfying\nHappiness is working on your projects.\nI can't tell if cats really enjoy the laser pointer, or if they find it profoundly frustrating.\nRemember when you could burn information? Dump out the files and set them on fire? Now, everything's backed up in 20 databases.\nMultiple background voices can be soothing for concentration, but trying to ignore a single conversation is a hell that hath no comparison.\nI hate when I look up a concept on Wikipedia and the first sentence is incomprehensible. #Macrophage\nI estimate that my youngest son has spent 20% of his waking life looking for misplaced objects.\nAs a computer scientist, DNA troubles me. I want it to be the source code for a person, but it's not that simple.\nMy son, age 7, was frustrated that he couldn't open a package of scissors. I told him to get some scissors. He was not amused.\nI once heard that squirrels don't remember where they bury nuts. Instead, to find nuts, they look in good places to bury nuts. Anyone know?\nSad how patents morphed from *how* to do things to *what* to do. Today, Eli Whitney could patent \"a machine to separate cotton from seeds.\"\nI like that term \"robot smog\" by Illah Nourbakhsh. I love the idea of flying robots, but I dread the possibility of more noise pollution.\nI love the sound of rain.\nIt's hard to travel right. You go from one homogeneous hotel to the next. I want to see real lives.\nImagine being Rick Astley. Every time you walk into a room unexpectedly, you rickroll everyone there.\n\"No? I thought you were the king of all things old?\"   --My 25-year-old co-worker asking me if I'd ever heard of a card game named Magic.\nDepositing checks has really changed in my lifetime. 1. Goto bank. 2. Goto ATM w/ form & envelope. 3. Goto ATM put them in. 4. Take picture.\nThe term \"happily married\" probably needs to be retired ... Oh, you're HAPPILY married; why didn't you say so?\nI love crazy expressions. \"There's more than one way to skin a cat.\" Why on earth would you want to do that?\nI wonder what the brain's equivalent of a log file is.\nSugar is the enemy. Sugar gives me life. #Productivity\nYou wake up to some dreams that feel so real. It feels like you should be able to talk to the other people in them about the experience.\nSometimes, you can make a boring task fun by automating part of it. Sometimes, getting organized helps. Other times, well ...\nSpelling bees are profoundly boring until your kid gets up there; then they're terrifying.\nPopular culture celebrates sticking to your guns in an argument, I wish it celebrated being open minded with the same vigor\nRemember all the hype in the 1990s about hydrogen powered cars? It looks like we'll have self-driving cars first. I would not have guessed.\nNext time I get to name a band or soccer team, it's gonna be called java.lang.NoClassDefFoundError.\nDreamed I played basketball with a giant strawberry for a ball. And there were South American soccer players camped out outside my window.\nJava is the stubborn mule of programming languages. #ClassNotFoundException\nSometimes, I could swear that Java is being deliberately obtuse when it comes to finding classes. #Stubborn\nAmazing how you can read something and think, \"OK, I got it,\" and then start doing it and realize that you don't got it. #HiddenDetails\nSo I'm at the grocery store, and suddenly this guy is looking at me all weird. Turns out, I was putting my stuff in his basket. #Oops\nYeah, so what happened to the famous London fog? I've never seen it. I guess it was air pollution that finally got cleaned up.\nMy blog has 113,350 comments awaiting moderation---all of them spam.\nCompanies who send me mail seem to be unclear on the meaning of the word \"important.\" #ImportantInformationEnclosed\nIn games, someone else has done the interesting work of defining the world. You just wander within the confines of the designer's mind.\nI pity those who make hot chocolate with water instead of coffee.\nIt's always weird to me when a pen runs out of ink. I generally lose them before we get to that point.\nWatched The East. Pretty disappointed. Cliche after cliche. And it didn't even do a good job of laying out the issues.\n\"Do you remember before the internet?\" I love that question. It points to a divide. My kids will wonder how we found people or ordered pizza\nBaking a pie seems like a reasonable thing to do, but if you buy the ingredients at Whole Foods, that treat will cost you just south of $50.\nWhen I was younger, I used to sit around and wonder all day why we were here. Now, I just go to meetings.\nI wish that there were a BuzzFeed for middle-aged people who don't care about celebrities.\nSomeday, it's going to seem barbaric that we drove our own cars. Especially since we frequently drove them into trees.\nI want to be pulled by the day instead of being pushed through by the things I have to do.\nI can't make myself go workout. But I can make myself drive to the gym. Then, I can make myself go inside. Once inside I'm too lazy to leave\nBrought my own olive oil to work for salads. Getting fancy, but they forced my hand. \"Olive oil dressing\" is mostly sunflower oil.\nOne time, people broke into my apartment to vacuum. I came home and the carpet looked great. Weirdest thing.\nIt's funny how we all think that rapidly changing weather is unique to our own locale.\nAlright. I've read pretty much the whole internet. Time to get back to work.\nI discovered something profound today. You can treat cauliflower like squash and put lots of pepper on it. That vastly improves things.\nI just used the adjective \"googleable.\" I win.\n\"The user name or password entered is incorrect. Or maybe our service is down or our servers aren't synced. Or, anything really. Go away.\"\nWent to sell my car once. Guy asked if I took care of it. I said yes. He opened the hood and found a bird's nest in the engine compartment.\nMy first Google search was \"Eiffel Tower.\" The next search was \"Walmart,\" and the fourth result was how to buy Eiffel Towers at Walmart.\nGoing to a seminar on leadership seems to be a bit of an oxymoron. Leadership isn't a thing--it's a byproduct of implementing change.\nThat song \"Tequila Makes Her Clothes Fall Off\" is interesting. It is so sweet. You wouldn't expect that from the title.\nDreamed about the apocalypse last night. The warlord would throw rocks at you if you wouldn't join his clan. I really needed a machine gun.\nI made the mistake of feeding the cats once. Now, they think that I do things, and they hassle me to no end.\nAs a Python programmer, I find the keyword \"new\" in Java to be confusing because it is superfluous.\nYou don't hear much about bazookas anymore. Why is that?\nRemember when TV stations used to stop broadcasting late each night? There was literally nothing on except bars of color.\nI love how Microsoft Word respects your decision to ignore a grammar mistake, at least until you change any word in any part of the document\n\"What does your garage door say about you?\" --TV\nI feel like a sucker saving for retirement when medical bills from a heart attack could wipe me out. Or there could be a robot apocalypse.\nI was once at a party where someone spilled red wine, and they used white wine to clean it up. I wonder if the opposite would work.\nI've got a bad case of hiccups. It's 2017, and a paper bag is our most advanced hiccup-related technology.\nI've read about 20% of Confederacy of Dunces, and I haven't decided if I will finish it. It is pretty darn funny, but it's no Catch-22.\nIt's funny how, in a group, the result of hoarding is more hoarding.\nWho remembers TQM?  (Total Quality Management) It was all the rage back in the 90s, but I never could get anytime to tell me what it was.\nI never understood what writer's block was until today, when I wrote well and realized that writer's block to me was like water to a fish.\nMy son, age 7, got a letter from our health insurance company. It begins, \"Please read this letter for important information about your ...\"\nYou people who don't eat much, does your body not tell you that you are hungry? Or do you suffer suffering better than the rest of us?\nNeighbors got a new scary dog. I decided to go over and meet him so I could get on his list of people not to murder.\nWife complains I can't find anything in the pantry. I tell her scientists say the eyes dart around and only see small bits. #NotImpressed\nGoogle is huge in our lives, but you can't call them. Easiest way to get customer service is to get a PhD and wait for a recruiter to call.\nWho versus whom. I can be pretentious, or I can be correct. But I can't win.\nRecently watched Mud. I got to say, I think it was overrated. But I did like the juxtaposition of old and new environments at the very end.\nSudafed makes me feel both tired and wired at the same time. But hey, at least I don't have a runny nose.\nIt's funny. In sports, it is a good thing to be \"on fire.\" That is not true in real life.\nI sometimes wonder if our entire lives and thoughts are shaped by a few dozen random events. Those that make us go: \"From now on ...\"\nRemember using quarters to save your place in line for an arcade game? Somehow, the next quarter always belonged to the biggest kid.\nMy wife wants me to take my smartphone with me when I go for walks, but having the internet with me kind of defeats the point of the walk.\nFunny how the big moments of our lives only feel big in retrospect. At the time, they just feel like life.\nThey say that we have an inborn fear of snakes. If so, why don't dogs have it? If they do, why do they get bit so often?\nI love those quotes that say you shouldn't care what anyone thinks. There's a name for people like that: \"psychopath.\"\nIt's amazing how much we talk with our hands. That old joke about doing an interpretive dance isn't that far off.\nNow, if Google and Facebook paid you when they used your face in an ad, that would be different. I know, free service and all that, but\nYouth soccer. Funny, when your kids scores a goal, you feel more relief than joy.\nI'm trying to teach my kids the Zen perspective. When the noise in our head gets too loud, the here-and-now is a great thing to fall back on\nAdults see possible danger as probable, but adolescents equate low probably with zero probability. We've seen more rolls of the dice.\nEach new generation is more fit for the modern world and less fit for the natural one. I'm a caveman compared with my kids.\nI'd rather have cold coffee than burned coffee.\ncantaloupe or muskmelon?\nWorries are just like a stack of plates. Only one is visible at once, and when you remove it, the next one immediately appears.\nAccording to Facebook, my friends spend most of their time hanging out with famous people.\nRecently watched Cloud Atlas. I have no idea what that was all about, but I applaud the effort of making something different.\nOnce sent our robot off to be repaired, and my son, age 7, asked when he was going to \"come back home.\" Like he was a person.\nImagine how many hours we waste every year as a society filling up our rental cars with two gallons of gas before returning them.\nHate when I can't find my mouse pointer. Even worse with two screens.\nIf you survived the apocalypse and were the only person left, for how long would you continue to use your turn signal?\nWeird that scientists and religious folk are at odds. They share the same beautiful trait of caring about something bigger than themselves.\nRecently watched Anna Karenina. That movie would make no sense at all if I hadn't read the book.\nTook my son, age 7, to a pond. He said, \"Wow, it was neat to get up close. Like seeing it in HD.\" #ModernKids\nIt's amazing how busy I've been the last few days doing nothing.\nI've come to love configuration files. #NotSomethingYouHearEveryDay They are beautiful in their own way, they harbor no secrets.\nYou know that point you get during debugging where you no longer trust anything? Like, is the printf library function corrupted? Yep.\nIn college, we registered for classes on a computer, but we had to call that computer on a telephone. 67552# for History 101 at 8am.\nSaw a graphing calculator at the store. Why do people still use those? Aren't there apps with better graphics and better calculating?\nOn my walk, a snake dropped out of a tree and fell in the path right in front of me. It didn't even offer me an apple. #Texas\nI'm trying to understand the purpose of figurative language. It's like a shortcut that's longer than the direct route. Any ideas?\nRecently watched Oblivion, and I got to say, it was pretty darn good.\nGomer Pyle rocks. He is above all of our silly madness.\nAfter the apocalypse, it would be weird to see all the solar yard lights pointing at empty houses. #TheMoreYouKnow\nIt's funny how deep questions and ignorant questions look alike. E.g., what is science?\nIt's amazing how small other stores seem after spending time in Costco. Whole Foods feels like a 7-11.\nAbbreviations are from the devil.\nMy wife hates to send me to the grocery store because I return home with all kinds of crazy stuff that isn't on the list.\nI just put a package in the microwave that promises to \"expand my culinary horizons.\" That's big talk for a frozen dinner.\nI want some Doritos to fill that little hole in my soul.\nI'm catching up on classic literature, but only those works I can understand with a single reading. The rest must wait until I retire.\nWhat does a lobbyist do, exactly? Why would anyone in power listen to someone who was paid to have an opinion?\nThe world is run by early risers. These people must be stopped.\nI once called the front desk and asked the guy if he could tell me the checkout time. He said, \"No.\" I said, \"Ok.\" He hung up.\nI wish that hotels allowed you to open the windows.\nI love how hotels still have telephones. They now serve as glorified CBs to talk to the front desk. Hey there bellhop, you got your ears on?\nI like a lot of kids movies, but I just can't get into these Ice Age films.\nI always feel like Elmer Fudd when I say the word \"specificity.\"\nThis Pope Francis seems like a surprisingly reasonable guy.\nI can never remember if the word \"accuracy\" has two 'c's or two 'r's.\nPotato chips are the worst. Simple carbs and high calories, AND WE CAN'T STOP EATING THEM. We're like insects to a diabetes bug zapper.\nMy guess is that, in 30 years, military superiority will come down to which nation has the most powerful artificial intelligence.\nIt's funny, sometimes you try to do one task, and you just can't get into it--but you switch tasks and suddenly your body and mind perk up.\nComputer work isn't like heavy lifting. A strong person can carry twice as much as a weaker one, but a good technologist can outwork a group\nI find the constantly changing diet advice to be frustrating. Avoid fat! No, avoid carbs! Drink water! Never mind. Eat breakfast! Skip it.\nBurned my finger boiling vegetables. They are not as healthful as claimed.\nToday stats: 2 followers, 8 unfollowers, 16 followers offended, ignored by 5789, 14 followers annoyed, 3 followers asked about my house cat.\nI can't believe that I'm middle aged. I try to grab life as it goes by, but it's slippery.\nJohn Denver says you are a poor man if you've never seen an eagle fly. Well, I have seen plenty of turkey vultures.\nFunny how little we change over the years. In high school, I used to go for runs in the middle of the night. Now, 25 years later, I still do\nFunny how you immediately become thirsty the moment you run out of water.\nI love the smell of coffee in the morning. It smells like victory.\nPandora lets me finally read the lyrics to all those songs I heard ad nauseam in car during the 1980s. Some were surprisingly good.\nDreamed that Jon Bon Jovi gave me a ride across campus in an old Cadillac. I guess he's not such a bad guy after all.\nFree money often costs more than it's worth.\nI feel lucky to have a job where I learn every day. The world changes so fast--you have to run to keep up. #scary\nI just wrote the word \"print\" and Google Docs flagged it as misspelled. It wanted me to write \"printf\". How cool is that?\nThe movie I watched about a tire that comes to life and starts killing people wasn't as good as I had hoped it would be.\nI actually like the idea of a homeowners association, but the implementation is flawed. Only the conscientious are punished. Others ignore.\nWe judge ourselves by the best examples of our work, but our competitors and adversaries judge us by our worst examples.\nWhy is slapstick funny? Does anyone know?\nLitter offends the beauty of nature. We could build litter-cleaning robots, but then people would just throw more. #RobotsGetNoRespect\nTold my wife I rented a movie about an automobile tire that comes to life and murders people. She just walked out of the room. #Marriage\nGoing to the bookstore is the old-fashioned version of surfing the web.\nI want to get rid of my old CDs, but I don't want to get rid of all those pointers to my old memories.\nSecurity measures like door locks and antivirus programs sadden me. Protecting ourselves from ourselves makes life unnecessarily complex.\nA tweet said a marijuana book was an \"easy read.\" I suspect that there are few successful books on marijuana that are challenging reads.\nMy daughter, age 4, was angry the other day and said that she was going to put on her \"mad shoes.\"\nI'd feel more reassured that philosophers aren't just making stuff up if they pointed more to concrete ideas and less to other philosophers.\nTold Mom about my latest get-rich-quick scheme. Just what every mom wants to hear. This one isn't even quick, and it won't make much money.\nHealth insurance companies have come up with an uncountable number different kinds of deductible. They put the Hilbert Hotel to shame.\nPop songs like to proclaim that it is better to feel pain than nothing at all. I'm not so sure. Comfortably numb is pretty good.\nFinally saw Sleep Dealer (Traficante de Suenos). If you like dystopian movies about migrant works and drones, this one's for you. I loved it\nI'm having one of those brief moments where I feel 20 years younger. Know what I mean? Uh, yes, I am blaring Steve Winwood. What of it?\nI just cited David Attenborough in a cyber security document.\nFinally reading The Kite Runner. I had put it off because I thought it would be cheesy and happy. I didn't expect Deliverance.\nI love how sports give us something pleasant to worry about. I'd rather ruminate about the home team than the future of my children.\nBeing conscious slows life down. As we get older, we do more on autopilot, and that is probably why time seems to speed up.\n(Someday, I'm going to write a whole chapter as a parenthetical.)\nRecently watched Lincoln. I wish that soundtrack would play every time I spoke in a meeting. I think I'll bring a tape player to work.\nLetter from SiriusXM says that if I sign up there are no cancellation fees. They should also tout that they won't punch me in the face.\nPaying bills is one of those rare activities that is both tedious and depressing.\nIt's amazing how many times I have to rewrite my work before it is decent.\nIn college, beer was the sacred drink. There were rituals and incantations. In adulthood, the sacred drink is coffee.\nKids don't get out in nature enough. To fix this, I'm building an app so that they can virtually visit a forest! #UnclearOnTheConcept\nMy coworkers didn't know what a radio button was. The knew about the kind on a computer screen, but about an actual radio button you push in\n\"In response to warnings that its toilets could be hacked, INAX said it issued a security update for its toilets this month.\" #FutureIsHere\nI recently learned about the \"Year 2038 Problem\" where the 32-bit date variables will overflow. I still have the bunker I dug for Y2K.\nI wish there were a word processing program that Microsoft Excel could play nice with. You could paste rows, all sorts of stuff!\nShould the streets be widened to help emergency vehicles? Of course. Should my yard be shortened to widen the street? Get off my property.\nThe boy said my name's Johnny, and it might be a sin, but I'll take your bet, and you're gonna regret, because I'm the best that's ever been\nOne of my superpowers is the ability to abandon a book or movie halfway through.\nI love that term, \"evidence-based medicine.\" You immediately wonder, \"What were they doing before?\"\nLove it when movies show you what it would be like to be someone else. Saw Last Train Home. Great movie about migrant workers in China.\nWent to a retro arcade place for a child's b-day party. They had an Atari! I played Combat! That kid's mom didn't have a chance.\nDreamed I went to a fancy restaurant without wearing a shirt. Clearly, I need to start wearing shirts to bed.\nThey say that you shouldn't worry when coach yells at you--you should worry when coach *stops* yelling at you.\" #BroadlyApplicable\nMy son is playing minecraft again. I tell myself it is good for his education.\nOne of my favorite games is to take an absurd position in an argument and see how long I can defend it. #ReasonsWhyIHaveNoFriends\nI wonder if plans are the root of unhappiness. Without plans, you can't be late.\nSo the alarm clock at my hotel was quite polite. Instead of waking me with a jarring noise, it flashed an unobtrusive light at 7:00 AM.\nIt's so quaint when clocks aren't connected to the internet and don't know exactly what time it is.\nWife says that driving around my hometown with me reminds her of riding with her grandma. \"Played baseball here, got beaten up over there...\nI want to be man of leisure in the French countryside.\nIt's been years, and you still don't know me Pandora? This must be how my old girlfriends felt.\nI think a lot of conflicts arise between men and women because women underestimate men's ignorance of social cues.\nI was showing the kids my breakdancing moves, and my wife said it looked like I had a neurological condition.\nIt would be cool if science advanced to the point where we could predict the cost of renting a car before doing so.\nProtip: When making a flight to Baltimore, the airport code is BWI. BAL will take you to Turkey.\nWeird thing about getting older is you have outdated knowledge. I used to know a lot about Mexico, but I haven't been there since 1997.\nI want to live in the Hundred Acre Wood.\nMy son (age 10) while watching Indiana Jones said, \"I keep expecting to see a Wookie somewhere.\"\nSprinkling unexpected words into your prose can keep it fresh but can also distract the reader. #Trade-offs #Writing\nIs that driver texting, or is he just drunk? #RoadtripGames\nMy car is at that stage where you can't let someone else drive it without detailed instructions. E.g., one does not simply \"close the door.\"\nMy son has been talking with his friends, and wants to know why some kids get more from the tooth fairy than others. #LifeIsRough\nWe had a cat that used to eat cantaloupe guts and plant the seeds in the flower beds. #FreshProduce #OrganicFarming\nMy cat seems to not understand the concept of \"working from home.\"\nA great question to ask during a technical interview is \"What is your dream technology?\" Allows you to see both values and scope of thought.\nMy co-worker said she had an old monitor. I asked if her screen was amber or green. She had no idea what I was talking about. #GetOffMyLawn\nRecently read \"Ready Player One.\" My kids are digital natives, but their kids will be virtual reality natives.\nWith hard decisions, you should flip a coin, and what you want will be revealed while it's in the air. Should I go to the gym or eat pizza?\nSon asked about why they built the Great Wall of China. I told him it was to keep the Mongolians out. Learned that from Southpark.\nRecently saw Biutiful. Who are these crazy people who didn't like it? Sad and depressing, sure, but it was real (except for the ghosts).\nMy son is 10, and I always wonder how he and my ten-year-old self would get along. Internet? Dude, let's play baseball.\nI propose time-to-coffee (TTC) as a quantitative measure of airline service. E.g., TTC in first class: 16 minutes. TTC in coach: 43 minutes.\nIntroductions must be more than summaries of the material---they must grab the reader by both teaching and raising questions. #amwriting\nI don't understand why anyone eats Freebird's burritos. They're basically rice wrapped in a tortilla. #CarbsAllTheWayDown\nA good 20% of my Google searches begin with \"difference between ...\"\nMe: \"You don't really believe in leprechauns, do you?\" My son, age 7: \"No. But I believe in hillbilly leprechauns.\"\nMy daughter, when she was 3, used to refer to her older brothers as \"the prisoners\" during her tea parties.\nI tell my wife that she needs to get on Twitter so she can know what's going on in my life.\nSoup stays too hot forever. We need to leverage this property into some kind of broth-based energy infrastructure.\nCab driver asked if I had cash for a $50 fare. What am I, a cocaine dealer?\nHemingway says that you should write drunk and edit sober. Unfortunately, I've got a lot of editing to do.\nBe aware: once you draw a line in Microsoft Word, it is there for the lifetime of your document. This is not a reversible operation.\nRecently read The Reluctant Fundamentalist. I'll summarize it for you: My girlfriend doesn't want me; blame America.\nI've noticed that the attention my tweets receive is inversely proportional to how profound I think they are.\nI awake and wonder when I am going to get out of bed. I realize I'm moving toward the edge and think, \"Oh, I guess it's now.\" #FreeWill\nWhenever I fill out an expense report, I always want to put \"High tea with a Mr. Newman\" as the reason for travel. #Seinfeld\nHave you ever suddenly woken up and realized you were a stranger in your own life? No? Me neither.\nItalian soda should be called old soda or original soda or custom soda or anything besides Italian soda. Sounds so pretentious, and false.\nStephen King got the following advice on editing when he was first starting out: second draft = first draft - 10% #amediting\nWith a big bucket of popcorn, it doesn't matter what the movie is. You're happy.\nTime leaves a sequence of small transformations. We'd love to go back in time, if only to be jolted by the sum of those changes all at once.\nMe: \"Won't it be fun to build robots someday with Mommy and Daddy?\" My daughter, age 4: \"No. They will attack us.\"\nLoved that movie Argo. It felt good to feel good about America, Hollywood, and Canada. #TwoThumbsUp\nQuote about never giving up: drink! Quote by Gandhi: drink! #TwitterQuoteDrinkingGame\nLove that word \"arguably.\" You can arguably use it to make any claim you want.\nLike the gambler's ruin, the business model of insurance companies is to outlast you. One can only call so many times before going insane.\nI got an email at work today to which I wanted to reply, \"Only a Sith deals in absolutes.\" #BeenWatchingTooMuchStarWars\n8-Year-Old Boy Surprises Marine Dad During Firefight In Afghanistan, HT @TheOnion\nI heard my wife yell from downstairs that she was divorcing me. Turns out I misheard. She was \"endorsing\" me on LinkedIn.\nBeing professional means being a part in a machine; you suppress your humanity so that you are reliable and can work well with others.\nHelloFax actually works pretty well for faxing. I can't believe that people still fax. Might as well have a footman deliver the message.\nRemember that game Myst? You just wander around and randomly try things to figure out a pointless riddle. I hated that game.\nIf you Google \"taco\" you find out they they have exactly 156 calories. Don't know if all tacos are the same or if Google knows my next taco.\nI could go for a free lunch right about now.\nI immediately become suspicious of any line of code that says something like \"i = 74\"\nFrom the mailbox: \"Congratulations. Your journey with Honda Financial Services has just begun.\" I love that. 60 months of congratulations.\nI realized this morning that in most situations, the word \"puzzled\" is a much better choice than \"confused.\"\nFunny how when you thank someone in an email, you have to use an exclamation point. Otherwise, it sounds sarcastic. Thanks.\n\"You just talked to someone on the phone, and that doesn't count.\" UnitedHealthcare responding to their earlier promise to cover a test.\nI love how \"sea salt\" is a fancy and socially acceptable way of labeling a product as having \"big loads of salt.\"\nIt's amazing how small your big ideas seem when you write them down.\nThere are few things more frustrating in life than not being able to find a misplaced object.\nMy health insurance company can be be counted on to do the right thing...after they have exhausted all other possibilities. #Churchill\nYou know you've been reading too much Victorian-era literature when you use the phrase \"made an enquiry\" when emailing a customer.\n\"Jar Jar? You don't like Jar Jar?\" My son, age 10.\nI got my first real email from my son today (age 10). Neat to see his writing style and to communicate with him in writing.\nRecently watched the movie The Bay. Anyone want to go for a swim?\nLove it when colleagues without kids refer to my weekend plans as \"relaxing.\" My weekends are many things, but relaxing is not one of them.\nI wish that going to sleep wasn't so much work.\nRecently saw 227 on TV. I haven't seen that show in over 25 years, but I still recognize the faces. The human brain is amazing.\nSpelling is a lost cause. There's far many more ways to misspell a word than to spell it correctly.\nDo they really think that I'm ambitious enough to take my frozen dinner out of the microwave, stir, AND put it back in for two more minutes?\nEvery time I give my email address to any organization for any reason, I end up on their mailing list. #LawOfNature #UnsubscribeFatigue\nThe old man the boats. #TakeThatGrammarChecker\nIt feels like I could quit my job and live on all these random class-action-lawsuit checks I get. Well, maybe not. Each one is for like $4.\nIt's amazing how cats can change your screen formatting just by walking across the keyboard. They must have some instinct for shortcut keys.\nFinally watched Glengarry Glen Ross. Coffee is for closers only.\nJust read an article about people wanting wider streets. They changed their mind when told they would have less yard. #InabilityToReason\nThe thing about cats is they don't care at all when you come back from a long trip. They sniff your bags, and that's about it.\nI got nothing to say to you people.\nPeople don't protest much on weekends. Civil unrest happens during the week. HT Scott Miller.\nWhen people interact with others, they act more randomly. When they don't interact, their lives are more regular. HT Daniel Garcia.\nIt would be funny to make a movie where characters argue using only maxims. Early bird gets the worm! Second mouse gets the cheese!\nLove it when you pet cats and they look at your other hand like, \"What's wrong with that one?\"\nYou would think there would be a finite number of ways VPN could fail to work. You would be wrong.\nI love it when I benefit, but I don't understand why first class gets priority going through security. Seems so ... un-American.\nI'm a late-night guy living in a early morning world.\nIs that song really playing? I recently watched Silver Linings Playbook. That was pretty good.\nWent to Costco for the first time not too long ago. That place is a disaster movie.\nIn books, characters fall into \"a dreamless sleep.\" I always seem to fall into a mad, anxiety-ridden, psychedelic unconsciousness.\nOld memories are best when they sneak up on you, like when you hear a lost Gloria Estefan song from the 1980s.\nIt's surprising how poor the book recommendation engine in Goodreads is. They just give you books with no indication why you might like them\nEveryone was excited about our new minivan except my daughter (age 3). She was afraid that lions will be able to get in through the sunroof.\nOnce mentioned I was shopping for a new car at a company party. One of my coworkers said, \"You seem like a used car kind of guy.\"\nAlso dreamed I met The Most Interesting Man in the World at a party, and he recommended that I not wear khaki shorts to meet Queen Elizabeth\nDreamed I played pickup soccer with a new group of people, and the losing team had its eyes sewn shut. Would have tried harder had I known.\nRecently watched Star Wars with kids. On VHS. #IThinkTheTrackingIsOff\nI love how the fire ant killer I bought comes with a safety seal. You know, to keep people from poisoning it.\nI know the difference between it's and its, but my hands don't.\nMy daughter, age 4, calls a computer a \"perchuter.\" But she gets mad if you call it a perchuter. She says, \"No! It's a perchuter!\"\nWe old people have something special. Talked to some girls from Ann Richards high school---they have no memory of a time before the internet\nJust moved my yearly physical out two months in the future. Because I am always less busy in the future than I am now.\nDuring last night's sleep I was simultaneously too cold AND too hot. Not alternating; at the same time. Never experienced that before. #sick\nI wrote down a guy's name so I wouldn't forget it. But now I can't remember where I put that piece of paper.\nA kid, age 8, at soccer practice said he would give me all the money he will make in his entire life if I scored a goal on him. GOALLLLL!!!!\nBoth the world and our role within it continuously change, so being open to learning new things is probably more important than being smart\nWhen I was younger and had a cold, playing soccer actually made me feel better. That no longer works now that I'm 41.\nThey say it's no use crying over spilled milk, but when the spilled item is homemade mac-and-cheese, and it's your only lunch, it can't hurt\nThey say to watch out for the \"terrible twos,\" but at our house, it's always been the \"mad threes\" that get you. My daughter is now there.\nMan, how do people watch TV? You're sitting there all happy, and then suddenly someone tries to sell you something. Over, and over again.\nI've set up a standing desk at home, but now I'm faced with the problem of how to eat cereal and relax. I'll ask my son how to work the TV.\nWhat do you do when you are too tired to be productive or even to have fun? \nBabies and toddlers must be profoundly confused when they wake from dreams. What happened to that giant lollipop I had?\nThey say that we all have the same DNA and are fundamentally the same, but some people tweet that they forget to eat. #ProofByContradiction\nA lot of my recurring dreams are like old movies that I don't quite remember. I know how they end, but I don't know how they'll get there.\nWhy can't we get good disaster movies?\nHappiness is executing your plans.\nMy kids are worried about poisonous snakes and spiders. I tell them that what they should really be afraid of is cars.\nThe next salesman insisted we sit down before looking at cars. He said you talk to the doctor before he prescribes you medicine. We left.\nWent looking for a minivan, and the salesperson laughed in my face when I said we wanted an orange one. Hey man, we can still be hip.\nConference announcement: \"Do not leave items unattended.\" I think we can all agree that that phrase needs to banished from the language.\nWe all take our rules seriously even when it's silly. I once got yelled at in China for choosing sweet potatoes as my second lunch vegetable\nI dislike advertisements because they are trying to hack me. They are trying to control me. Even worse, they are wasting my time.\nThe beauty of open source is that the machine is laid bare. I always want to understand; too bad my brain capacity is limited.\nIf you write \"Jane Austin\", Google Docs recommends a correction to \"Austen\". If you write \"Austin, Texas\", it doesn't. Nice.\nIf I tweet that I'm going to eat at Fogo de Chao, is my health insurance company listening? Asking for a friend.\nAmazing how much of our time we spend in fantasy---movies, books, and TV. We live multiple simultaneous narratives.\nIt's suboptimal that income tax rates for productive work (like being a teacher) and destructive work (like dirtying the air) are the same.\nLove it when your plane gets to an airport and you have to circle around. Like they didn't know you were coming.\nI like to wear my tweed sport coat to conferences because it makes me feel accomplished, but now it has a hole in the sleeve. That's funny.\nI love how Microsoft accuses me of being a \"victim of software counterfeiting\" every time I wake up my laptop. I'm a victim alright.\nPeople say \"by Bob and myself\" or \"by Bob and I\" when I think it really should be \"by Bob and me.\" You wouldn't say \"by we.\" Right?\nI love it when movies about ghosts are \"based on a true story.\"\nFriend had a 40th birthday party at a cowboy bar. I wore boots. My kids said they understood that b/c they went to a ninja party last week.\nThe first challenge to publishing conference papers is to do good science. The second challenge is to correctly embed fonts in the PDF.\nI have that fingernail injury you get from peeling too many grapefruit. Eating healthy is hard.\nI wonder if there is such a thing as patent troll insurance. If not, there should be.\nImagine if scientific papers were written like patent applications. Shudder to think.\nIsn't it weird that an actor is \"in\" a movie but \"on\" a TV show?\nStar Wars came up, and my son's teacher didn't know what a Wookie was. Is there some sort of accreditation board I can report her to?\nI propose a radical energy saving device. You know those huge monitors/TVs you see everywhere? What if we converted those to static \"signs\"?\nJoke by my son (age 10): Why did the chicken cross to the left side of the road? Answer: Because Daddy was telling stories on the right.\nJust watched The Master. That made no sense. I don't care what you fancy people say.\nMy mental model is that it takes 5 min to shower, but it's 10 min. Error has persisted for years. Skinner's pigeons learn faster than I do.\nThe AT&T wireless customer service person kept complaining that I was cutting out. Now, that is funny.\nI get money from about 10 class action lawsuits a year. Thank you for that $2.47.\nThe apocalypse allows us to finally relax and enjoy that vacation we've been meaning to take but couldn't because of our obligations at work\nLoved 11/22/63 by Stephen King, but living a dual life in 1958 and 2017 was exhausting.\nCake has no optimal serving size. If I eat a little, I feel bad because I want more. If I eat a lot, I feel bad because I ate a lot.\nMy wife says I shouldn't walk around the neighborhood while eating a pot full of vegetables.\nInteresting how the idea of Klout on topics (I was most influential in \"lemonade\") has moved from Klout to \"endorsements\" on LinkedIn.\nTired of conferences in big cities. We need more gatherings at venues only accessible by donkey.\nActually, scratch that. Days where nothing truly bad happens are great days. They allow a new dawn to be a clean reset.\nThere are days when nothing truly bad happens but everything is unnecessarily difficult. That was yesterday. Today is new dawn.\nIt should be illegal to have a stupid conversation when you are sitting in front of me on an airplane.\nMe: I hate having to check in *exactly* 24 hours in advance on Southwest. My friend: Is that why I'm always last to get on the plane?\nWe've learned to trust no one. Is this email really a tracking notification for a FedEx package? I'm still waiting on my Nigerian fortune.\nEvil Dead was last horror movie I saw. Never seen that kind of movie before. The brain is not meant to process that kind of sensory input.\n\"I hate when zombies get in my house.\" My son, age 10, playing Minecraft.\nGot a notice saying I need new license plates. I don't understand. Do they wear out?\nLove how \"bimonthly\" can mean both every other month and twice a month. The whole point of the word is to communicate frequency. #worthless\nI wonder if the companionship of pets was even more important in the time before TV. Although, with no YouTube, no one would ever know.\nHumans are an emergent property of cells.\nI love thunderstorms.\nLove those \"increasing your productivity\" articles. I always expect the first recommendation to be \"Get off the internet and get to work.\"\nDo you guys hide Easter baskets? To me, hiding those baskets is the natural thing to do. But my wife says I'm crazy. So we don't.\nThe family was once discussing what to put on my birthday cake, and my son (age 6) said, \"Just put a guy asleep on there. Daddy loves naps.\"\nSomeday, people will long for the natural simplicity of 2017.\nYou know it's a great audiobook when you can't wait to get back in your car to go to work.\nI start typing \"self aw\" into the search bar, and Google comes up with \"self aware roomba.\" The anxieties of our age.\nDoes anyone know how the amount of complexity of a computer operating system compares with that of a biological cell?\nIt's funny how you can't really proofread an email until after you send it.\nI'm headed to Whole Paycheck ... I mean Whole Foods. Anybody need anything?\nI love how \"Can I help you?\" is a polite way of asking \"What the hell are you doing here?\"\nI hate when I have to get up early. That's enough, but my body will often get me up even earlier than that for no good reason.\nI should start answering the phone by saying \"Ahoy!\" Not that I answer the phone anymore. I hate that thing.\nVolkswagens go through car batteries like meth addicts go through Mountain Dew.\nWe appear to be approaching peak socks in my house. The scarcity cuts deeper every week.\nI used to go one way to work. But lately, I've been asking Google Maps, and it sends me another way. I'm starting to see its wisdom.\nIt's funny how a document with no spelling errors looks exactly the same as one with the spell check turned off.\nI wish there were one day a week when motorized vehicles were banned. Imagine the peace and quiet.\nI worry that I don't work hard enough. I also worry that I don't relax enough. And, of course, I worry that I worry too much.\nMud hole? Slimy? My home this is.\nI love reading the reviews for kids movies. \"... the archetypes do not resonate as one would expect given the ...\" Kids want burp jokes.\nThere's a raccoon eating acorns in my front yard.\nBecause of DM spam, I now have no way to tell you that I actually saw a crazy video that you were in.\nMe: \". . . because I'm the grownup.\" My daughter (age 3): \"No, Mommy is the grownup.\"\nI received a cold call today from a company offering \"black hat facilitation\" for government contracts. Do they blackmail decision makers?\nJust got an invitation to submit a paper to a conference on \"Science and Information.\" That seems a tad broad.\nRead Madame Bovary recently. I miss her shenanigans.\nI don't see how people fast. It's only been a few hours for me and its like I'm standing in an office building with the fire alarm going off\nYou know you are getting old when you see buying a car as a big pain instead of a fun and exciting event.\n\"Tell my mother, tell my father that I've done the best I can.\" Funny thing about getting old. I'm now the \"father\" in pop songs.\nI draw the line at internet-connected toothbrushes.\nIt's pretty crazy when you think about it. Cyber security in a large corporation hinges on each individual not clicking on a bad link.\nI can see Daniel to Dan, but what is up with John to Jack? Jack Kennedy? John Kennedy?\nI need to learn to take life one day at a time. That would be a great name for a TV show. You could have a single mom, a maintenance guy\nYou can rate Wikipedia pages as Trustworthy, Objective, Complete, and Well-Written. But the most important aspect is missing: Comprehensible\nI wonder if it is a general property of great books that you start out hating them, but they grow on you over time.\nJust plugged in a laptop, not because I needed it, but because I felt sorry for it. That little sad blinking low-battery light tugged at me.\nI have a sudden urge to say something profound in Latin. But I don't have anything to say, and I don't know Latin.\nScientific papers don't always mention Kim Kardashian, but when they do, they are about social media.\nThought I was doing the right thing buying \"olive oil\" salad dressing, but those marketing charlatans outsmarted me again. #CanolaOilSucker\nI got a noticeable cut on my forehead, and I have no idea where it came from. Maybe I was drugged? The CIA? Aliens? Could have been a cat.\nOur printer has evidently discovered that it can do its part to save the planet by randomly deleting print jobs. #RobotConsciousness\nI've never been one to see symbolism in books or movies. I like to take fictional stories at face value, as if they were my own experience.\nAt some point, we passed the threshold of there being more pictures of cats on the Internet than cats in the actual world.\nInternal reviewer said she didn't understand my use of the phrase \"[xx I name it thus?]\" in a technical paper. #IShouldProofreadFirst\nDude was tailgating me in heavy traffic. I pull aside. He speeds by and is immediately pulled over. #sometimesTheManIsOnYourSide\nTold my son, age 10, that he can be both athletic and smart. I brought up the idea of a warrior-poet. \nRemember that kid's movie Escape from Planet Earth? One character had the coolest coffee cup ever. It said, \"I love safety.\" I want that.\nMy wife just asked me if I know how to read Chinese. Clearly, we need to talk more.\nThe other night my kids stayed up late. They wanted to watch The Lorax instead of going outside to see the stars. #irony\nALWAYS BE SCARED. This message brought to you by your nightly local news.\nWarm milk, instant coffee, and hot chocolate mix. That's the stuff.\nLike Odysseus being tied to his mast to resist the Siren's songs, I sometimes brush my teeth early so that I will stop eating for the day.\nTalking to people is exhausting.\nI asked the university not to send me any more 'informational' emails, and I think that they are actually now sending me more out of spite.\nCrickets are now my third favorite sound--right behind my kids laughing and wind blowing through the trees.\nI love the email complimentary close 'v/r'. It says, \"I very respectfully end this letter, but not enough to write it out.\"\nI don't wanna work. I just want to bang on the drums all day.\nI hate when I have something on my mind and I can't think on anything else.\nRedbox does not let you cancel if you change your mind. It's only a dollar, but they don't seem to understand that little things can be big.\nI find signs of security, such as guards and fences, very depressing, and people always want more of it.\nTook my son to a high school basketball game. The lady looked at me like I was crazy when I tried to pay with a credit card. #Still1991\nRecently watched Looper. I guess the fits that my kids throw aren't so bad after all.\nSeems like as soon as one monkey climbs off your back, the next one is standing right there in line.\nI see in the rear-view mirror that I'm being tailgated by a huge pickup truck, which, in turn, is tailgated by an even bigger one. #Texas\nSome people enjoy parentheticals (their thinking is scattered and they like to make novel associations), and others want a linear story.\nRelatedly, I like to take a person I know well and think back to my first impression. Amazing how different they can be.\nPhotos do a surprisingly bad job at conveying a person's essence. When you meet, you realize the photo points to a person that doesn't exist\nI love how my wife refers to Siri as \"the lady.\"\nMy computer is all confused and needs to be restarted. But I don't want to have to reopen all of these programs.\nLove how I have exactly one dollar in my wallet. Not zero, not twenty, one. I never use cash, so it's been that way for a while.\nI wish I could find a social media client that had a platitude filter. I will keep looking. You should never let go of your dreams.\nThe Microsoft Word designer must have been thinking, \"You know, if someone copies a sentence, I bet they want to copy the doc header too.\"\nIt's funny, no matter how late you get home, you can't just go right to bed. You have to wind down first.\nI love being an American, but I hate having to put the period inside of the quotation marks when a sentence ends with a single quoted word.\nI went to get gas today, and there was a TV attached to the pump blaring CNN. We get a little closer to Idiocracy every day.\nMusic now in the break room. Two kinds of people: those that crave more stimulation, and those that wish somebody would turn life down.\nI love how in Windows if you want to rename a directory you have to restart your computer so it will release the locks.\nOn Return of the Jedi, the guys destroying the energy shield can't communicate with they guys fighting the Death Star. #Anachronism\nThe new accessory for full-sized pickup trucks is an extra-wide, chrome tailpipe. It says, \"More pollution than can fit in a regular pipe.\"\nToothpaste is inexhaustible. There's always one more little tube from the dentist or a travel kit around somewhere.\nWalking in the woods behind my office and was stopped by a tall fence. Fences kill the spirit. I felt like Truman trying to go to Fiji.\nIn response to missing files, Dropbox says people should always have a second backup. That's like the police telling me to lock my doors.\nChocolate chip cookie dough ice cream may not be good for my health, but it sure is good for my productivity. At least for 27 minutes or so.\nMy son just asked, do you think that some cats would see better with glasses? I've always wondered what we humans did before glasses.\nThe problem with the gamification of something is that you have to pay attention to the game. My brain is full.\nWe've lived in this house for seven years, and we still haven't settled on unambiguous names for the rooms. Which one is the living room?\nI want a light tablet with a screen that is 8.5 x 11 inches. Then we could replace some paper around here.\nIt's amazing how much work it is to relax. You can't just suddenly relax. It takes time.\nWork makes life go by too fast.\nSomeday, future archaeologists will uncover countless credit card offers. For me, it's about one in every five pieces of mail.\nWas going to pull up Google Maps, but my son handed me a globe instead. Nice and round and all, but there was no zoom!\nHow is it that I can intend to type the word \"both\", think I typed the word \"both\", and later see that I actually typed the word \"book\"?\nI don't like receipts, so SEARS gave me 4 of them. 1 receipt and 3 coupons with so many exceptions that reading them is out of the question.\nIt bugs me that fortune cookies no longer contain fortunes. They should be renamed to \"life-coach cookies.\"\nThe food madness comes to an end tomorrow.\nTwitter is an oasis. If you comment on the open web, people reply as if you're an idiot, without reflecting on the irony of the assumption.\nIf it's \"not necessary to dial a 1 when calling this number\" can't the phone company just figure it out? Google has spoiled us all.\nI once saw an ad from BMW urging people to consume less and to buy a new car. I guess words no longer have meaning.\n\"Wait until your kids move back home from college.\" Tide laundry detergent commercial. Wow, this recession thing is real.\nWent to get a new tube for my mountain bike. Guy asked which size. Which size? Evidently, a lot has changed since 1992.\nDreamed I was playing Little League Baseball and had drove to the game in a garbage truck. Then I said \"wait I'm 41, what am I doing here?\"\nAm I the only one bothered by noise pollution? It makes me so angry I want to scream. And maybe bang some pots.\nWith the current ubiquity of tablets and smartphones, kids born today might never learn how to use an old-fashioned OS like Windows 7. Crazy\nI'm amazed that we are still held hostage to text messaging fees. Either iMessage on iPhone, or pay big monthly fees, or pay per utterance.\nI used to think that lying to my kids about Santa would needlessly confuse them. Now I see it as a valuable lesson in the shades of truth.\nI just ate a big chunk of bad, frozen lasagna. The worst of all possible choices.\nFunny when you need to email an old acquaintance, and you try to come up with a subject line that will keep it out of their spam filters.\nThe weird thing about the Lord of the Rings movies is that they all seem to just end. Like they ran out of film or something. #TheHobbit\nGot a letter outlining retirement plan options. The Singularity is my retirement plan. Barring that, my plan is to work until I drop.\nWhen they show scientists in movies, they never show them making PowerPoint slides.\nTrying to re-frame the experience of lifting weights so it will seem fun. New framing: \"working out is Zen meditation.\" Worked last night.\nMy son, age 10, got up and was dazedly walking around. Sleepwalking? I approached, and he punched me in the stomach and went back to bed.\nNothing good comes in the mail; let's do away with it.\n\"encryption unsuccessful\" is the Android version of the blue screen of death, except you lose everything.\nI went to the kitchen to get a salad and came back with turtle cheesecake.\nI wonder if it's about time to retire the \"out-of-office\" automatic replies. That really doesn't happen anymore.\nMy youngest son asked me to show him a cursive 'G' in uppercase. I don't remember how to write one.\nIt's funny, as you get older, it really is better to give than to receive. You get all excited about the presents you buy people.\nI love how I use '1/0' to stop my program if it goes down a bad branch. #CodingLikeABoss\nI sympathize with his views, but I've had trouble trusting Michael Moore ever since he blamed Dick Clark for the death of that little boy.\nFunny. It's always better to have permission than to not have permission, but it's not always better to ask permission than to not.\nI remember how Windows XP used to always be so worried about unused desktop icons. It was so cute.\nI hate it when explanations are organized around people. I much prefer organizations around ideas. #LookingAtYouPhilosophy #NotAmericanIdol\nI want some cake, so I ate a small kettle of green beans under the belief that they are anti-cake.\nHow cool is that? Some dude in Malaysia googles, \"children are curious about their environment\" and The Curiosity Cycle comes up #3.\nAirline rewards and grocery store rewards are opposites. Airline rewards are rewards (free flights). Grocery store rewards are punishments.\nThey say that Siddhartha could think, fast, and wait. I'm not much for waiting, and I can't think if I'm hungry. #LongWayToGo\nAt the time it just seemed normal, but when I hear it now, the grunge music of the early-mid 1990s sounds so dark. No wonder I was moody.\nNice to see that cars are coming out in colors now; blues and oranges. For ten years, they were just shades of gray.\nThere isn't a word for the kind of packing you do in a hotel to go home. It isn't quite \"packing,\" and it isn't \"unpacking\" either.\nI'm often trapped because I can't bring myself to use a buzzword like \"situational awareness,\" but I also can't think of an alternative.\nWriting is like solving a jigsaw puzzle where you first have to determine what the pieces are.\nIt's funny. Why is being sad unenjoyable? It's not like physical pain, which is more direct.\nI gotta say, The Looney Tunes Show on Cartoon Network is pretty funny. The suburban-dwelling Yosemite Sam is particularly well done.\nMy toolbox is such that you need a screwdriver to get it open.\nMe: \"Where's that music coming from?\" Son: \"My toothbrush.\" Ah, the modern world.\nIt seems that the quality of a television show is inversely proportional to the attractiveness of the actors.\nIt's amazing how much better I understand a scientific paper when I take notes on the meaning of notation as I read.\nTook a bite of a deep-fried taco shell from Chuy's. I learned exactly how Frodo felt in The Lord of The Rings as I took it to the trash can.\nI should probably read the news *before* I get on social media in the morning. Things would make a lot more sense.\nThis internet thing is just a fad. Someday, we'll look back and laugh.\nTeaching my son, age 7, to program in Python. He gets confused between strings and variable names. You can write x = 'bob' but not x = bob.\nI can eat canned soup as long as I add enough pepper so I can't taste the canned soup.\nAir travel would be less stressful if it were socially acceptable to do Tai Chi while waiting to board the plane.\nCoat hangers are very poorly behaved objects.\nIf you find yourself at DFW, the Pappadeaux at A24 is a veritable oasis from the barbarous activity in the main terminal.\nPro tip: if you want me to use your service by allowing me to sign in with my FB or Twitter account, do not threaten to spam my friends.\nI find Red Delicious to be the least delicious of all apples. They are, however, red.\nWhen concerned with trivialities, I often have to remind myself that these are the problems you have when you don't have any problems.\nThe problem with software you have to buy is that you also have to pay to upgrade. So I end up using Word 2003.\nOne thing I've learned as a kinder soccer coach is that cold weather makes kids' shoes come untied. #TheMoreYouKnow\n\"What if an attacker takes over the washing machine and uses it as a platform to launch distributed denial-of service (DoS) attacks?\"\nThe world needs to stop making things that beep at me.\nSometimes the word \"busy\" means \"swamped at the moment,\" but sometimes it means \"I'm more important than you.\"\nMy son responding to a request to end his computer game: \"I barely got anything done!\" It's funny how artificial goals can become real goals\nThere is often a very large distance between almost done and done.\nWeird to me that people compare Google+ with Facebook. I see Google+ as a version of Twitter without the 140 character limit.\nLast one in the office. I'm riding a scooter down an empty hall, and I'm suddenly reminded of the Big Wheel scene from The Shining.\nIt's funny. In negotiations, the first person to specify a number loses, but the first person to establish a number as an anchor wins.\nI love how being in the middle of reading a good book adds another dimension to my consciousness, even when I'm not reading.\nI haven't had nearly enough Chinese food lately.\nI like pictures on slides, but they have to convey information. The presentation appears fluffy if they only set up context or look pretty.\nHealthcare in the US is inexplicably expensive. Maybe I don't want Walmart to run a hospital, but I'd go to one run by IKEA.\nCats don't dance.\nHate wearing a belt, but I need to dress fancy for work. I'm waiting for elastic belts to come back in fashion.\nJust got a message that said \"Jonathan, I'm returning your call about the yellow camper on the highway.\" I didn't call about a yellow camper\nIt's funny how you can be \"present\" in a Zen sense, or you can be \"productive\" in a work sense, but you can't be both.\nNetwork programming is somehow very satisfying. All of these happy little computers talking to each other.\nI generally prefer the quiet sound of crumbling infrastructure to the noise of construction, but I'm told that's not a viable approach.\nI can understand nightmares--they teach your brain with simulated danger. But annoying dreams? I was running barefoot on a road with pebbles\nI just spent 30 minutes reconstructing a stapler from its component parts after my son dropped it down the stairs. #ReadyForTheApocalypse\nAfter it was too late to fix, I saw a comma splice in my scientific proposal. Now, if it gets rejected, I'll know why.\nI just ate a bowl of granola cereal, which, in the absurd universe of calorie consumption, is equivalent to about five chocolate cakes.\nInstructions for paper abstracts said that they should be 250 words. I thought this was funny: exactly 250 words? But my first draft had 250\nMy boys decided to settle a question of fact, whether item x was made of metal or plastic, with a ball throwing contest #UnclearOnTheConcept\nI successfully resurrected my wife's old laptop by installing Ubuntu. My work here is done.\nMy daughter, age 3, kept asking me what time it was today. I guess she had somewhere to be.\nJust watched a few minutes of that show Revolution. This is bad TV. Cliche after cliche. And did the disaster only kill ugly people?\nIt's confusing that the word \"oversight\" means both an error and the activity of watching something so as to prevent an error.\nNeed to go to the library but left my wallet at home. I wonder if I can direct the librarian to my Twitter page as a valid form of photo ID.\nOften, there's only ten or so decisions that need to be made to finish a document. But you can't seem to hop in, and you sit there in a fog.\nI think \"Guns and Religion\" would be a great name for my son's kinder soccer team. But my wife and city officials probably wouldn't agree.\nIt's amazing that air travel is so exhausting. You are, after all, just sitting there.\nThis coffee at this place tastes like tea. I can't tell if it is too fancy for me, or if I am too fancy for it.\nResurrected my wife's old Windows Vista laptop. \"Installing update 1 of 77 ...\"\n30 minutes before my bedtime last night, I decided to install Ubuntu. I am not a smart man. #insomnia #FeelTerribleToday\nNew game at work: figure out who is walking down the hall by the sound of their footsteps.\nCompanies should realize that surveys must be short. I'm not going to click on  25 ovals, I just want to say the hotel carpet was dirty.\nMy wife always argues with the cats. The cat followed her into the bathroom, and I heard, \"Do you want a bath or what? What's your problem?\"\nSurprising how infrequently I can reuse my previous (unpublished) writing. I always seem to want to rewrite ideas when used in a new context\nJust saw a guy jogging down our street in a bulletproof vest. Evidently, this neighborhood is more dangerous than I thought.\n\"I bet in the future, we won't have to waste our time fixing toilets.\" Me, in 1995.\nWhen tweets are too long to read, it's time to go to bed.\nSome days feel squishy: your current work is too small to be useful, and your big ideas are too ill-formed to be practical.\nThe kitchen at work is currently closed. Luckily, I have a strategic coffee reserve in my office.\nPleasant surprise this morning: I tightened my belt to the next belt hole.\nMy wife to me: \"You are always on that computer. You and that computer should be morphed together.\" Not a bad idea.\nThere are 16 digits in my Country Inns & Suites reward ID number. They seem to be preparing for intergalactic expansion. #ThinkBig\nTime to regroup as a civilization. We should stop all new development for 6 months and focus on fixing bugs in existing systems.\nJust said to my wife, \"Yeah, I don't want to watch it either, but it won best picture.\" We are about to watch The Artist. This is middle age\nI just used VPN to access the virtual machine on my remote desktop. It is indeed turtles all the way down.\nIt's funny that we have words in our language like \"art\" that nobody can define.\nIt's amazing how much joy in life comes from making and executing plans.\nJust saw a joke image about cats on my timeline. My brain actually generated the idea that I should show the cats the picture. Ah, humans.\nI had no idea that buying a mattress would be so far beyond my complexity horizon. The price was fluid and the options were dizzying.\nDreamed I won a bronze medal for swimming. Next dream: walked barefoot through a bad part of town looking for water. First dream preferred.\nOverheard at my house, \"You two give her those chickens!\"\nIt's amazing how blind we can be with our own work. I needed to cut slides but they all seemed critical. Outside council found some.\nPulled up XEmacs for old time's sake. Used it for 6 years. After two years, it appears I have already forgotten everything.\nAs I get older, I increasingly find myself identifying with John Goodman's character from The Big Lebowski. I did not see that coming.\nOff to a nature walk. My work is right by this park, Emma Long, where the only human-made sounds you hear come from an occasional airplane.\nGetting your vocabulary straight is a huge part of getting your thinking straight. Correctness is less important than consistency.\nPlease conserve bits. If your answer to a question is to \"reinstall the software,\" your suggestion can be safely omitted.\nI'm thinking that good writing avoids sentences with distracting, garden-path interpretations such as \"The old man the boats.\"\nAlways surprised people keep those email ad signatures, such as \"Sent from my iPhone.\" Consider changing to \"Sent from my subconscious.\"\n\"rhythm\" is a long word not to have a real vowel.\nTook the kids to the NASA Johnson Space Center in Houston. Actually, kind of depressing. All about the past, not much about the future.\nGood comedy consists of statements that are both true and absurd.\nJust found a giant oatmeal walnut brown sugar cranberry cookie in the break room. It was like Trainspotting.\nThe world is its own best documentation.\nWe got a new cat, and he drank my wife's coffee two days in a row. Now, he's just like the rest of us.\nDo people actually sit through 30-second commercials to watch 2-minute news videos? I want to see the bobcat kittens, but there are limits.\nJust watched Tyrannosaur. That movie breaks your heart over and over again. Fewer dinosaurs than I expected.\nWe often write down incomplete thoughts so they are not forgotten. But seeing them on paper makes them seem complete, so we leave them.\nAmazing that malls haven't changed in 30 years. Did you know that Bag n' Baggage still exists?\nMy son, age 7, asked me how computers work. Not sure if I should start with Turing Machines or Maxwell's equations.\nWhy do peanuts sometimes taste like a baby's dirty diaper smells?\nThis cloud thing is great, but my writing is spread out all over the place. Now, where did I put that thought again? Twitter? FB? blog?\nInteresting. 10-page report is 414 KB, 1-page letter with image of my signature is 1,288 KB. The continuous world is large and rich.\nI hate it when you think you have one problem, you solve it, and in doing so discover that there were two problems.\nKickin' it 1970s style. I am desk checking my computer program.\nIf you Google \"cast magic spells\" you get a bunch of results as if it were, you know, real --- just like \"make layer cake.\"\nI'm hungry, so I eat a bag of carrots. Then I have two problems: I'm hungry and I have a stomach ache.\nI'm used to \"twenty years ago\" meaning the 1970s, but that was twenty years ago.\nJust saw a commercial for a McDonald's sugary coffee drink that distinctly reminded me of the heroin injection scenes from Trainspotting.\nScientists are working on curing diseases and understanding the cosmos, but what we need is a guacamole that doesn't turn that ugly color.\nEvery time I open the refrigerator, I hear this pat pat pat of little feet come running over.\nStatistics is a mess. You can't follow recipes because assumptions are never satisfied, and you can't use principles because there are none.\n\"Page number\" is no longer meaningful. We have \"page ordinal,\" 1,2,3,... And we have \"page label,\" i, ..., iv, ...,1,2,3, ..., a1, a2, ...\nWhenever I hear that song \"Before He Cheats\" I think how funny it would be if it was all just a big misunderstanding.\nSo the siren lights on top of cop cars are now flat. This appeared to happen overnight.\nJust examined my computer's memory using FTK Imager. I found Portuguese text in there. I do not speak Portuguese.\nAfter ten years of printing my letters, I've suddenly started writing in cursive again. Weird.\nJust watched Young Adult. I loved that it didn't end up where you thought it would.\nSometimes when you are writing and trying to articulate ideas, everything just seems like mush.\nI hate controlled areas. I should be able to hang on the ropes at public swimming pools, and my bags are fine by themselves at airports.\nWish the whole world were on UTC time. I'd rather eat lunch at 3am than have to figure out what time that conference call is.\nSo a guy flashes his headlights at me to warn me of a speed trap up ahead. Funny, who's side are we on? Us bandits vs. the system?\nAs a rule, I don't read any document that is double spaced.\nI hate the mental gymnastics involved in reading scientific notation. If your number is that big, please use a different unit.\nHalf-inflated mylar balloons always float around the house. I see one out of the corner of my eye and think, \"WHAT THE HELL IS THAT?\"\nDarn shame when we run out of skim milk and I have to use the kids' whole milk for my cereal. Darn shame.\nLove how Advil is sugar coated. It's like eating Skittles.\nCamping in the living room eating S'mores and watching a movie. It's surprising that they don't have more safety railings on the Death Star.\nDo kids have imaginary friends anymore? Or does that require the kind of solitude that no longer exists in our wired society?\nI'm such a digital immigrant. I think using pen and paper, and then I turn to my computer and type the ideas into a document.\nFinally saw Napoleon Dynamite. Love how you can always hear the birds chirping in the background. And the steaks.\nFunny how in a dream you can be multiple characters at once. And it is first person but also third person.\nLove that old aphorism: you know you've hit middle age when the phone rings on a Saturday night, and you hope it's not for you.\nHaving coffee with the kids running around reminds me of that line from The Big Lebowski, \"Hey, careful, man, there's a beverage here!\"\nI've largely cut sugar from my diet this week. Remember that Paul Giamatti movie Cold Souls? Me too.\nMy kids saw a typewriter today and were blown away. \"What IS that thing?\" Like it was from an alien world.\nBased on my empirical observations of social networks, I conclude that provocative clothing causes young women to send spam follow requests.\nThe sun burns time.\nOnly way to stay trim in modern society is to be a fanatic about diet and working out. \"Eating right and exercising\" seem to be insufficient\nFunny, so many songs I heard ad nauseam in the 1980s. They come on Pandora now and I actually listen, and think, \"hey, that's pretty good.\"\nFinally watched Dr. Strangelove. Great movie, but the last scene with the character Dr. Strangelove was ... stupid.\nDidn't lift my leg high enough and hit my shin on the bed. As I fell on the bed in pain, my leg cramped and I let out a scream. #soccer\nUsing websites and apps is such a mine field these days. One false move and you unknowingly spam all of your friends.\nDarn shame about that coming zombie apocalypse. Good thing I still have the bunker I dug for Y2K.\nI finally get the purpose of scribd, but the ads are too distracting and the Facebook login doesn't work today. Clean and simple.\nObtaining signatures wounds the soul.\nJust saw Contagion. I thought it was pretty good. I like that it stayed with the big picture. Not as sappy as most disaster movies.\nMy son (age 10) read part of a proposal I wrote. He asked, \"Did you write this?\" and then said \"Wow, you're more boring than I thought.\"\nNow that I'm older, I can look back on youth culture and see it as a thing. When I was younger, I thought it was life.\nIn Texas, we have scorpions falling from the air vents. #GoodTimes\nIt's amazing how loud professional carpet cleaning trucks are. I think I'd prefer it if the neighbors were starting a rock band.\nBest quote: As they were leaving the house, my daughter (then 2) said to my youngest son (then 5), \"Get your shoes on, boy.\"\nCompanies think the cheapest way to handle customer service is offshoring and menu hell. Doesn't occur to them to make their products usable\nMicrosoft help assumes everything is working fine and you are just ignorant. I don't need help unless something is broken or unintuitive.\nI'm not particularly unhappy with my appearance, but I find looking in the mirror a little unsettling. Who is that guy?\nAmazing how ignorant we are in medical diagnosis. We need a big database of symptoms, tests performed, results, and eventual diagnosis.\nCan we all just agree that everyone knows the correlation does not equal causation, and just get on with our lives?\nJust saw Take Shelter. Pretty good. I loved the slow, deliberate pacing.\nSo weird to hear talk about Gen X'ers relating to middle-age stuff. We're supposed to be busy slacking off, not worried about life insurance\nI have to be selective about the keyboard shortcuts I learn. My brain has a limited memory for that kind of thing.\nJust watched Valhalla Rising. Interesting to see what the world may have looked like before there were so many people.\nI just uncircled someone on Google+ for sharing Love Shack by The B-52s. We all need to set minimal standards.\nI know that I have been working too hard when I find myself looking forward to mowing the lawn.\nI wonder if you can schedule a flash mob through Microsoft Outlook.\nMy hotel room was like a museum from 1992. Everything was perfect. Even down to the wake up call that never came.\nMy hotel has the Ramada Inn flag waving out front. Love that. Like we're going to band together and attack the Holiday Inn across the street\nI dreamed last night that the US had a nuclear war with China, but China bombed Guatemala instead.\nIt's funny, I love AI, and I'm excited about the self-driving cars from Google, but I'm not comfortable using cruise control.\nIt's pretty obvious I have kids. On my desk at work are notes about protocol-based network protection, written in crayon.\nEverything in the world should snap together like Legos.\nSuch a shock going from the digital world of computer science to the analog world of home repair. Nothing fits.\nHate those bags that have to be fastened before you pick them up. Stuff flying everywhere. Skinner's pigeons learn faster than I do.\nReading The Black Swan by Nassim Taleb. Love the discussion of silent evidence. Would be better if the self-aggrandizing fluff was removed.\nWe live our lives in confining bubbles of homogeneity. I wish my job took me to random people's houses in remote small towns.\nYou pull weeds in the yard, then later in the shower, you see the weeds when you close your eyes. Just me? Never mind.\nThey make me change my password so often that I find it's best to tweet it. That way I can at least ask my friends if I forget it.\nYogi Berra would have rocked Twitter.\nHaving artificial plants is like drinking decaf coffee, it misses the whole point.\nFunny how we change but stay the same. In high school I liked midnight bike rides with my walkman, now I like midnight walks with wine.\nCity keeps sending me these paper surveys on transportation, parks, etc. Results will be biased towards those who remember what stamps are.\nWas about to walk to this guy's office and ask him to make a couple of graphs, then I realized I had a coffee cup in my hand. #OfficeSpace\nOverheard in my house: \"Hey! I thought I said no reading!\" Followed shortly thereafter by \"I don't want blood in my hair!\" Good times.\nYoung people sometimes read the same books and watch the same movies multiple times. When we get older we stop doing that. Why?\nI'm old. To me, the phrase \"turn of the century\" still means horse and buggy, not dotcom boom.\nRestaurant food tastes better the next day. When out, you compare with other menu items, but at home you compare against a cold sandwich.\nI walk downstairs to get a class of water, and I end up eating a piece of cake. So hard to judge short-term enjoyment verses long-term cost.\nWas about to respond to an email from my wife when I realized it would probably just be easier to walk downstairs.\nCompared to the cold and hungry existence lived by our ancestors, our society is almost perfect. I tell myself that when I buy printer ink.\nI know I've been working too hard when I get this constant, low-grade headache that spikes every time I try to cram more info into my brain.\nSavoring the bouquet of a wine by opening your mouth to let in oxygen is fine, but do the same thing with a mouth full of Doritos ...\nJust saw The Muppets. Interesting movie about a small fringe group fighting to keep America dependent on foreign oil.\nI love how you can take just about anything, put pineapple on it, and call it Hawaiian.\nThere seem to be a lot of motivational speakers in the world. Clearly, it isn't working.\nKid to speak tomorrow in front of 500. Not trying to teach him not to be scared, trying to teach him to do what needs to be done regardless.\nThe cat is on a hunger strike again. He does that when he gets tired of his food.\nI just remembered a restaurant from high school that I haven't thought about for years. Amazing when that happens.\nSomehow, my fingers type \"defiantly\" when my brain thinks \"definitely.\" Confusion at work; e.g. \"I will defiantly complete this task.\"\nNothing feels better than getting that monkey off your back. At least for the 5 minutes until you notice the next monkey smiling up at you.\nWe hear warnings about the dangers of heart disease, car accidents, and cancer. But nobody talks about cats on stairs.\nMS Outlook doesn't autocorrect (spell check) the subject line. The most important part. Like they have a monopoly in business email clients.\nI was roughhousing with the boys, my wife called my mom and said, \"I don't think my kids should play with your kids. Your boy is too wild.\"\nI keep trying to come up with novel applications for robots, and I keep getting stuck. Anyway, I'm off to pull weeds outside.\nSomehow, places seem more exciting when you don't have a map.\nCool title for book about cognitive biases, \"Mistakes Were Made (But Not By Me)\". I hear the actual content of the book is good too.\nThose Starbucks bottled frappuccinos are like drinking a bottle of Coffee-mate creamer.\nA girl in a bikini asked me if I would like to get sexy summer abs in response to my last tweet. I'm glad that somebody is listening.\nI'm no Steve Jobs, but I hate when the arms of the chair are too high for the chair to fit under the desk. Hotels are notorious offenders.\nTrail mix is amazing stuff. You can consume 14,000 calories and still be hungry.\nOn the airplane I noticed that I, the computer scientist, was the only one reading from actual dead-tree paper.\nYou don't realize how much liquid is in a cup of coffee until you spill it on your desk.\nJust watched Midnight in Paris. That happened to me once.\nGiven how important hiding and seeking was for our ancestors, you'd think that my kids would be better at it. 1. No giggling. 2. No peeking.\nMy son has started using the phrase \"it's a win-win.\" Evidently, the second grade curriculum has changed since my day.\nFunny how at work \"cleaning up\" your desk and \"cleaning out\" our desk mean very different things.\nWhen discussing a difficulty, my adviser once said, \"if you can only do one thing, then do that.\" I'm going to bed.\nWhen I hear the line \" I got debts that no honest man can pay\" by Bruce Springsteen, I always assume he is talking about student loans.\nI've been moody this week. Reminds me of being a teenager. Not as fun as I remember.\nI'd love to be able to say \"Pandora, I'm angry at 'the system.' Hook me up.\"\nWe should require that all inspirational quotes consider opportunity costs. E.g., \"You miss 100% of shots you don't take.\" You could pass.\nSon (age 8) just woke up terrified of werewolves he saw on the History Channel. Spent 20 min trying to explain why TV lies to get viewers.\nAmazing how our social connections now largely determine what information we see online.\nMaking phone calls is now outside my complexity horizon. Do I dial a 1? The area code? Who knows.\nI'm not hungry, why am I making a sandwich?\nI love getting reminders from Microsoft Outlook telling me that I am 23 hours late for a meeting.\nNow that I have a little girl, I really understand the sugar-and-spice-and-everything-nice description. So different from the boys.\nWhen you cut and paste in MS Word, the text gets copied. But so does a lot of mystery formatting, headers, tabs, indentions, lost souls ...\nI wish there were a succinct way to tell someone a post made you laugh out loud. The meanings of such phrases always drift.\nI don't know why stormtroopers are so funny. But they sure are.\nI always get \"philanderer\" and \"philanthropist\" confused. Makes for an interesting reading of the news.\nI would be a terrible gangster. I don't even know if, how, and under what circumstances once should tip a plumber.\nWeird how foods that normally taste good can taste bad in particular ways. Peanuts sometimes taste like dirty diapers smell.\nIt's the worrying about doing it exactly right that makes taxes so onerous. Simply filling in boxes per my best judgement would be a breeze.\nI keep expecting to earn interest in my frequent flyer miles. But it doesn't seem to work that way.\nWatched Gangster's Paradise and Animal Kingdom in the same day. That's a lot of crime for one day.\nOH \"I think people would be surprised to learn that there are bigfoots here in Indiana.\"\nMom telling story about a cow attacked by a bear. Cow lived. She made a bet with her brother that he couldn't ride the cow out of the barn.\nLove it when gmail says \"This conversation has been moved to the trash.\" It always seems like a value judgment.\nI don't like marshmallows. And knowing that everyone else does has always made me feel vaguely uncomfortable.\nAmazing that we are starting to get smart cars, but we still have dumb traffic lights.\nWe Americans need to stop putting commas inside the quotation marks. But I'm too chicken to go against the rules. You are our only hope.\nAmazing how no one writes in cursive anymore. I'm even starting to forget how.\nI have trouble with working lunches. Eating and thinking are mutually exclusive activities.\nMotto for the future of information: \"If it's not relevant, get it out of my way.\"\nWhen surfing the web, I might click on an interesting short video. But it can't start with a commercial. That breaks the flow. I move on.\nThe word \"segue\" is so weird that if you don't know how to spell it, even Google can't help you.\n\"Broken Dreams\" would be a great name for a breakfast cereal. The hipsters would be all over it.\nWatched Through the Wormhole with my son (age 8). Now, instead of monsters in the closet, he's afraid of a tear in the fabric of space.\nSaw Ides of March the other day. Pretty good. I loved the quote \"You didn't make a mistake---you made a choice.\"\nSimilac sent us a box of baby formula samples. Apparently, they know something that I don't.\nFelt like a truck ran over me after the soccer game the other day. I'm starting to doubt if I will ever play in the World Cup.\nAs we move from PCs to tablets and server farms, is it possible that total global computing power could actually go down?\nThey say that most dreams are bad, and mine are usually stressful, but I do have some amazing dreams about traveling to distant planets.\nThe word \"thing\" sounds too colloquial and imprecise, but \"ontological entity\" sounds like a bit much. You can't win.\nThought about going to work out, then I decided that life's too short to spend time doing things you don't want to do.\nThe IRS has an online application form, but the online form is only available during certain hours. #UnclearOnTheConcept\nGetting annoyed filling out all of these tax forms. Then I think of the wisdom of the immortal Bryan Adams. Ain't no use in complaining when\nWent with my daughter to Toys R Us for the first time today. Turns out there's a whole part of the store I'd never seen before.\nAnnoyed by the car alarm going off outside. Funny how it doesn't even occur to me that it might be, you know, a car in distress.\nMy computer just made a weird beep. Did I win some sort of prize?\nJust created a slide with the title \"More data is qualitatively more complex (mo data mo problems).\"\nScience moves forward by more accurate predictions. Math by new theorems. How does philosophy move forward?\nWow, printers are stubborn. Trust me man, you don't have a paper jam.\nReading American Gods. The characters have such amazing dreams. I dreamed I was followed around the grocery store by a chain-smoking gorilla\nNow that's how you get things done! Toss and turn in bed, then jump up and sit down and do it. Too bad I'll feel terrible tomorrow.\nWikipedia should have a flag for \"this article is technically correct but useless because it doesn't explain what the thing actually is.\"\nFunny how the squeaky wheel either gets grease or gets nailed down, depending on which culture you are in.\nI just watched Mulholland Drive. No comprendo.\nWish me luck. I'm going to try for the fourth time to buy something from Verizon.  It's less work to get a Cambodian tourist visa.\nI make my own fun.\nWhen people say they \"have no regrets,\" I always wonder if it's because they are deluding themselves or they just aren't paying attention.\nSurprisingly, the search feature on Google docs doesn't work very well. If only they had access to search experts.\nI've been in the workforce for 15 years, and I still can't get in the habit of saying \"good morning\" instead of \"hey\" or \"what's up?\"\nMy wife just sent me an email with the subject \"dead bird.\"\nDo you ever make one sandwich and then immediately realize that you should have made two?\nI hate when I click on a simple thing in Windows, and it acts like I asked it to solve the halting problem.\nSomehow, my wife lives in a world that is 40 degrees colder than the one I live in.\nMy kid asked me if magic was real. I said no, that magicians just did illusions. He said, \"What about Santa?\" Oh, yeah, well, there's that.\nAfter having watched many Stars Wars movies with my kids lately, I've decided that R2-D2 is the unsung hero. The AI is strong in him.\nIt appears that my book has been banned in China. (The Amazon link is blocked, but it sounds cooler to say it was \"banned.\")\nSome say we shouldn't have kids for the sake of the planet, but imagine the result if the most conscientious people didn't have children.\nOn Amazon, my book is available new from $12.99 and used from $42.45. Ah, decisions.\nDoesn't it drive you nuts when your fingers won't type? They hit keys, but all the wrong ones.\nI always like Twitter, but reading tweets is even more fun when I have something else I am supposed to be doing.\nExplained to the cat that I can't open the window because it's allergy season. He was unsympathetic. Window is now open.\nMy son, age 8, was stuck in his video game, so he googled it to find the solution. Welcome to the adult world, my boy.\nFinally saw Up in the Air. So glad they didn't go for the feel-good ending.\nI wonder when wigs for men are going to come back in style.\nQue pasa with the weird spacing between letters in Microsoft Word? Do I need to go into autoexec.bat and set BUGS=OFF?\nVery depressing when you are looking for a quick way to do something and you find that it is the subject of an entire book.\nI hate when I write a note to myself but then later don't remember what the note refers to.\nEither someone has come into my office and adjusted my chair, or my muscle memory for how I sit has changed overnight.\nI eat soup because it's low carb. But I have to add a lot of crackers to make it enjoyable.\nTricky to find the right level of office gossip to engage in. Contrary to oft-repeated advice, it is not 0; you come off as cold and snooty.\nAll my kids' toys seem to talk. I just stepped on a car, and it literally said, \"Ouch! Not the face!\"\nBought a TV at Walmart. They asked if I needed help \"out to my truck.\"  I love how they just assume everyone owns a truck. #Texas\nWhen coding, elegance is beauty, and beauty is good. But sometimes, elegant code is opaque code, and opaque code is bad.\nRemember the scene in Disclosure where Michael Douglass was late to work? Just like that today, except my wife wanted the litter box cleaned\nWhy yes, I do want to be my own boss. I can't believe you just found me out of the blue. You must be my guardian angel.\nTimestamps come from actual stamps with clocks on them. Long ago, when you started and ended a call, they stamped a piece of paper #FloCon\nI now need a username and password to schedule a haircut appointment.\nMy milk looks kind of blue. That can't be good, right?\nRules for my son's science fair: no plants or animals, no food, no liquids, no glass, no dirt or soil or gravel or rocks.\nNo matter how I put a fitted sheet on, it's the wrong way.\nTalking about the 6 Star Wars movies with my kids. Terms like \"first one\" and \"last one\" result in limitless confusion.\nI was feeling a little down, so I had a giant bar of dark chocolate and a cup of coffee of the same color. #FeelingBetterNow\nTo file a 1099-MISC: 1. IRS mails you form. 2. You mail to recipient. 3. You both mail back to IRS. Might as well put tokens in a clay jar.\nI can't decide if this green drink from Jamba Juice is really good or terrible.\nJust spent the last hour rebuilding my son's Lego police-state prison-industrial complex headquarters. That set has a lot of pieces.\nWeird that German chocolate cake has coconut. Because when I think of Germany, coconuts don't come readily to mind.\nNow that I rarely make phone calls, I realize how complicated it is. Dial a 1? Area code? Depends on where you (and the receiver) are.\nWeird that Anon doesn't have a Wikipedia entry. I see her quotes everywhere.\nReading The Jungle. Reminds me of when I worked at a peanut butter factory. If a jar came by without a label, my job was to put it aside.\nThey should make an emoticon for \"egg on my face.\" Something like . . .  (o)--> :(\nMachine learning dilemma: the datasets with ground truth are not interesting, and the interesting datasets don't have ground truth.\nI love the initial euphoria of having a great new idea. Funny how the joy fades over time as the idea and reality get to know each other.\nFor picking movies, I've learned that not only must I enjoy it for 2 hours, but I must also enjoy having it in my head for days after.\nMy stomach is uncomfortably full, but I am still distracted by hunger. What's that story about the guy pushing the rock up the hill?\nCompanies outsource to save money on customer service. A better solution would be to not send ambiguous, error-ridden letters to customers.\nIf a person makes lasagna and freezes it, it tastes great. If a company does it, it tastes terrible. What gives? Ingredients? I'd pay more.\nOur ancestors were wise. Coffee and donuts truly are a great combination.\nI think I'd be uncomfortable having servants, but if I did, I'd like them to peel that white stuff off my orange slices.\nI play soccer for my health, but every time I do, I feel like I have been run over by a truck.\nGood thing ATMs make those loud beeping noises. That way, thieves can relax in the distance and don't have to trouble themselves to be close\nLove it when police put the onus on you to not get robbed. The local police here recommended that we \"shop in groups.\"\nWow! I just got a notice that Ford wants to buy back my car to \"fill specific needs\" in their inventory. Must be my lucky day.\nHate when companies send vague forms with lots of questions because they are too lazy to customize it to get only the information they need.\nSometimes, even when it is cold and rainy, it's nice to get out of the office and be reminded of the real world out there.\nI wish I had a set of books that started from the precise perimeter of my current knowledge.\nSeems that the key to teaching someone something is knowing what he or she already knows. That way, you can explain things in familiar terms\nWhen I see lists like \"Ten steps to be more productive,\" I always think the first item should be \"Don't waste your time with stupid lists.\"\nIt's hard to google how to fix the internet when the internet is down.\nComputer programming is like mowing the lawn. I enjoy both activities, but I don't do either unless I have to.\nGot spam about getting a medical billing degree. A degree in billing you for a trip to the doctor. There has got to be a better system.\nMovies should bring back quicksand. We all need to be reminded of the dangers.\nWeird how you use vinegar to clean cat poop off the carpet and also to flavor your salad.\nWent to our hometown carnival today. Just like the opening scene from The Notebook. Except we had kids, and I didn't climb on anything.\nSome movies don't seem to have enough material to fill up the trailer. Don't know what they do for the other 1 hour and 28 minutes.\nThree incorrect passwords, and they lock your account. Clearly, they overestimate us.\nIn high school, I was lazy when we had to lift weights for soccer. After school, I would go to the gym for real. #stupid.\nWe need another Manhattan project to develop food packaging that can actually be opened.\nIt is almost impossible to find Anna Karenina if you have it spelled incorrectly. It is masked by a certain pretty, blond tennis player.\nI just had $9-worth of microwave pot roast. \"Eat. Not too much. Mostly plants.\"\nBeef pot roast says: \"Serving Per Container Varied.\" Is it 2? 11? 45? Also, each serving has exactly 150 calories.\nGoing to the store. Anyone need anything?\nJust got a wrong-number-call asking for a girl named Shirley. Always reminds me of that old movie Ruthless People.\nSleepy in the mid afternoon. Alert when it is time to go to bed. I wish we had  direct control over the arousal level of our nervous system.\nFunny, no matter what time you get home from work, you just can't go right to bed. You need to spend a couple of hours piddling around.\nWeird that humans have 4 blood types. It's like getting parts for a car. Seems like there should either be one blood type or a million.\nIt breaks your heart when you have to take the cat to the vet. The unnatural sounds that come from that carrier ...\nI always wonder if fashion/design goes forward or is more of a random walk. If it goes forward, why not just jump ahead 30 years?\nIf you could take a graphic design like a modern cereal box back in time 30 years, what would people think of it?\nWhat do you do when you are too tired to watch TV?\nMicrosoft Word is always trying to think one step ahead and seamlessly adapt to your needs. That would be great if it wasn't so stupid.\nBeen playing Mario Kart with my kids. My brain is limited. Wonder which part has been siphoned off to store the dynamics of flying mushrooms\nWow. You can get a lot done when you don't have to go to work.\nJust got done cleaning out my sock drawer. (1) Feels good to get organized. (2) Who says people only post trivial things on Twitter?\nOH one cleaning guy saying to another, \"I keep throwing up blood.\" #zombies\nHate it when I'm in bed about to fall asleep and my mind starts chewing on some perceived injustice in the world. Now I'm back on Twitter.\nHate it when you make a good-natured-but-smart-alec comment on a Facebook post and everyone else gets all deep and sentimental.\nLove it when a program crashes and Windows brings up the debugger. Yeah, like I want to debug TweetDeck in my spare time.\nWhen a commentator writes something stupid, you want to publicly ridicule the opinion. Ah, but mentioning their name rewards bad behavior.\nAlways a little hesitant to open the car's sunroof. I have this vague fear that it won't close again.\nI love how cats crouch down in the lawn when you walk by. Like it makes them invisible.\nIf the cloud loses your data, whom do you call? Does Mr. Google have a phone number?\nMy reversible belt purchased at a New Jersey Walmart 6 years ago is looking pretty ragged.  #LivingTheDream\nI'll admit, I have no idea what Wordless Wednesday means.\nAnyone know how to graphically make a quote in PowerPoint look like it was torn from a newspaper? I've seen it done with Mac software.\nFunny how websites about making your PowerPoint presentations look professional look so amateurish.\nWhy do people use slideshare? The page is sluggish and cluttered with ads. And they want you to log in to download a document.\ngotta go, I have to fix my son's Lego \"skull crusher\" machine before work. #parenting\nSpent Saturday night installing a water softener. I'm living the dream.\nMy son asked us to get him a \"nonfiction\" book about Bigfoot at the library.\nI always get Oscar de la Hoya and Oscar de la Renta confused. I assume that they are one in the same and they made my sweater.\nI love how we have technology beyond our dreams, yet we still seal envelopes with human saliva.\nStratego is great for teaching kids the value of information. You must move to win, but each move also reveals information to the opponent.\nI always get Siri confused with Suri.\nI'm not a fan of the black, gold, silver, and metal colors for winter clothes. Nothing wrong with a little bright green in January.\nWent to the mall today. Weird place with pictures of pretty people everywhere.  It used to be so familiar.\nHate it when you pour milk in the cereal and it hits the spoon and comes flying out.  It happens just infrequently enough so I don't learn.\nWell, I explained the concept of \"might work, but not worth the risk.\" One dog chewed the ball and now owns it.\nPlaying with kids and ball went into neighbors yard with mean dogs. Their plan: throw youngest child over while the rest of us distract them\nAren't we all tired of seeing smiling people in stock photographs in cheap publications? I'd rather see realistic pictures by amateurs.\nWhy do dogs howl at sirens? The neighborhood dogs go nuts every time a fire truck goes by.\nOnce you start with the bagels, you got to keep going. Otherwise you crash.\nDoes CNN really believe that people will sit through a 30 second commercial to watch a 70 second video?\nApparently, by international law, every song written in Spanish must contain at least one use of the word \"corazon.\"\nI love how reading a good book colors everyday life experience during the time you are reading it. Right now: Super Sad True Love Story.\nWow. Loud. The fire alarm in this building is the audio equivalent of tear gas. I guess I best be moseying on.\n\"This sentence is false.\" Is it true or false? Anyone asking that kind of question should be punched in the face.\nJust walked .002 miles in 2.1 minutes and burned 1.7 calories on my way to the fridge.\nWas off the grid once in China. You might think being offline would clear my mind and enhance creativity, but I just felt numb and lazy.\nThere is no excuse for printers to be only black and white. People say color is more expensive. Poppycock. So are color TVs.\nI used to wonder how to make food-service employees at airports more friendly. Apparently, the solution was to replace them with kiosks.\nPlease watch your step as you exit the moving walk.\nMy son: \"Daddy, why won't the window close?\" Me: \"That's just a little gift from Microsoft.\"\n\"Time on your hands.\" When you think about it, the saying makes no sense at all. Is time, like, some kind of rash?\nMaybe vacations are so relaxing because our brains must process the new sights and so they have less time to turn over the usual worries.\nIt always seemed weird to me that a smile is a signal of goodwill. You are, after all, bearing your teeth.\nFor some reason, Pandora is really trying to get me into Indian music.\nMute button didn't work on the box loudly squawking ads at the gas pump. Is the world not noisy enough? Those things are evil.\nI really hate negativity. It is everywhere, I hear it all day. It's terrible. Nothing can fix it. Just give up.\nConstant computer clash: you want to close windows to get the clutter out of the way, but will be work to reopen later. Metaphor in there.\nJust finished reading On China by Henry Kissinger. Great book if you are interested in China and/or international diplomacy.\nBreaks your heart. The little brother idolizes the older brother, but the older brother is too young to appreciate it.\nIt's amazing how fast time goes by when you read good fiction.\nWhoa, deja vu. I have a theory that deja vu comes from having a forgotten similar memory that gets triggered by the current moment.\nI wish there was a way to make brushing my teeth more fun.\nI love reading articles on the web about innovation stagnation that were recommended to me by robots.\nEver get a small piece of carrot stuck in your throat? It appears that my current best option is self-surgery.\nPeanut butter and jelly sandwiches are terrible. But peanut butter and jelly sandwiches with toasted bread are awesome.\nWas just explaining @klout and how a person's influence is measured relative to the max of 100 held by Justin Bieber. This is our society.\nWe each remember all the events that we remember, so we all think that our memory is pretty good.\nMy son: \"Daddy, what's the point of soccer?\" Me: \"To score goals.\" Him: \"But why?\" There's no why boy, practice your dribbling.\nAmazing how you can just pick kids up when they're sleeping. I'd probably wake up if somebody lifted me over their shoulder at 2 am.\nI've noticed that my peanut consumption has increased substantially since I took a job that offers free peanuts.\nI am continually surprised at how unhelpful a thesaurus is. Anyone have a good explanation?\nThe form says, \"Employee Name (type):\" and I am tempted to put \"string\" #TooMuchComputers\nMy wife says I should be careful with my facial expressions out in public. I tell her that reading my face invades my privacy.\nIn the 1980s, you used to hear stories about lost cats traveling alone across the country to find their owners. Do they not do that anymore?\nThe cat just knocked a coffee cup off the table. Aren't they supposed to be graceful?\nFor the longest time, I couldn't figure out how to stop Excel from reading text aloud. Finally did, now I miss it.\nCustomers need a secure way to communicate with companies without having to log into each individual website. Such a pain.\nIn Austin, there is some kind of black-hole vortex where Mopac, 290, 71, 360, and Lamar all come together. I get lost every time.\nYou know, one cool thing about Twitter is that the interface doesn't change more often than it rains.\nMicrosoft still doesn't get it. I don't want to have to manually add folders to libraries. I want search to just work.\nI love chocolate milk.\nWent on the \"teacup ride\" at Austin's Park. Do not be fooled by the innocent-sounding name. Been over 4 hours, and I still don't feel right.\nI just had a chatbot tell me I was boring. Man, those things are stupid. My mom says that I'm fascinating and handsome.\nSeems like lately I've been in the situation of having more hammers than problems, which is a problem.\nOh Microsoft Word, I am powerless against your invisible formatting. Curse you.\nIt breaks your heart when you see your own flaws in your children.\nSome schools ban cupcakes for birthdays. Other schools pimp their students to sell cookie dough door-to-door to raise funds.\nNew cities are ugly. It's the deep texture created by continual rebuilding that makes them beautiful. [K. Kelly, What Technology Wants]\nThere must be a special place in hell for the people who decided you can't skip movie previews on DVD.\nDid my mom really send me an email \"108 Casseroles, Crockpot Dishes, and Desserts Perfect for Fall\" or was her account hacked? Modern life.\nMy two boys have reached the \"Mom, he's repeating me\" stage of cognitive development. Not sure where Piaget would put that one.\nFixed 3 leaky faucets today. I have three kids and a job. I guess this is what being an adult feels like.\nRemember when a long-distance phone call was kind of a big deal?\nAs a knowledge worker, I've never understood why people do crossword puzzles. It's like a tow-truck driver towing his own car on the weekend\nWhich is more complex, a jet airplane or a cucumber? ... [What Technology Wants, Kevin Kelly]\nAmazing how black socks change to blue when you take them out of the dresser drawer.\nI wish the post office would raise their bulk mailing prices. They could fix their budget problems and I would get fewer credit card offers.\nWent shopping at the mall tonight for the first time in years.  Amazing, malls haven't changed at all since I was a teenager.\nOffice is out of coffee. Luckily, I have emergency backup. Kind of like the strategic petroleum reserve.\nThere are some thoughts that I can't express in 140 characters. So I don't.  300 chars might be better. Or 10000 characters a month.\nLove modern conveniences. Got an email from my bank saying they need me to enter in my acct and ssn. Nice, I don't need to drive down there.\nWhen younger, the soreness in my muscles after playing soccer was kind of cool. It meant I had worked hard. Now the soreness just hurts.\nJust saw Limitless. Great movie. But he said doubling your money every day was too slow. Clearly, even with NZT, he was still limited.\nThe toddler is crying because we won't let her eat a tub of butter.\nThere are funny consequences to giving your pets human names. My wife told a group of people, \"Jimbob threw up everywhere and ran away.\"\nI feel like a horse whenever I eat Cheerios.\nBeing hungry before going to bed is good b/c it means I didn't eat too much during the day. But it's bad because I'm hungry.\nWow, full-page ad in USA Today indistinguishable from real article. Depressing.\nOne bummer about getting older is that I've already seen every new movie that comes out.\nI have to admit, I have no idea what they mean when people refer to something as \"cynical.\" I'm starting to doubt that they do either.\nPandora just played a song called \"For Jonathan.\" Whoah.\nThey are putting up a tent outside with a people-lifting machine that goes BEEP BEEP BEEP. A tent. Safety is important, but so is sanity.\nFunny how trash TV continues to pollute your mind even after you watch it. You find yourself thinking about the characters and stories.\nSpeaking of signs, I was completely baffled by \"Ped Xing\" as a kid. I had no idea what a \"ped\" was and even less how one would \"X.\"\nI love those road signs that tell you to obey road signs.\nMy sister asked me on the phone last night if I speak Mandarin. Clearly, we need to get together more often.\nI haven't seen a cherry tomato in years. It's always those inferior grape tomatoes.\nFunny. There is a sound a person is supposed to make if they almost run into someone else. It's a barely audible \"wup.\"\nI wish I were as tired at bedtime as I am in the middle of the afternoon.\nSoup in the microwave undergoes a phase change. At 1:23 it is ice cold, but it turns to scalding hot at some point before the click of 1:24.\nI've decided that age 4 is the golden age for quotes. The kid is old enough to articulate ideas but too young to have reasonable ones.\nI love Bailey's and coffee. But I can't drink liquor during the day, and I can't drink coffee at night.\nIn the world of online banking, it seems kind of meaningless to get an email about a \"monthly statement.\" Oh, I can check my account now!\nWife: \"I'm sorry, that was my fault.\" Son: \"I didn't know anything was ever your fault.\" Mommies are infallible. Like the pope.\nMy shirt today has a more flared collar than normal. Not sure if \"Business Disco\" is how you dress for success these days, but I like it.\nI just asked my son (age 7) what he was going to do today. He said, \"I don't know.\" How great would it be to live like that again?\nWhen is the last time you called time and temperature? I just tried it, but it didn't work.\nSome days, I can only skim the surface and can't seem to dive in and read individual tweets.\nI wonder if computers will ever define an ontology that is useful to them but completely alien to us.\nComputer understanding: 1. Humans define buckets. 2. Computers process tons of online data and put things in buckets. Shallow, but useful.\nonline chat with the bank. You wait forever, and then they respond with a stupid question or \"thank you for confirming that information.\"\nIt reminds me of that time people broke into my apartment, but all they did was vacuum.\nWhile I was out, someone put a copy of \"Working Mother\" magazine on my desk with a note that read, \"Want this?\" I am baffled.\nWas outside pruning the trees. I felt like a Zen master.\nThey say that the best place to store coffee is in the body.\nFunny how quickly a new place can feel like home. Probably comes from our hunter-gatherer days.\nEver get a headache from trying to cram too much into your head at once? It's like my brain is saying, \"OK. Enough. Let me get organized.\"\nIs it me, or is Bill O'Reilly starting to look like Hugh Hefner?\nEver worry that your brain is going to run out of space? I love learning, but I don't want to overwrite previous lessons.\nIntelligence is complicated and deep. Our AI systems are simple and shallow. We have a long way to go.\nkevin kelly: we realized only recently (200 years) that technology is a thing in itself, building on itself. Before, it was individual art.\nI keep buying pyrite but I must be doing something wrong.\nI just stepped on a Froot Loop. #LifeWithKids\nI hate when my spelling is so bad that spell check doesn't even put the intended word in its list of suggestions.\nMaking a sandwich, I was reminded of how my grandfather once had a job putting holes in swiss cheese.\nSo if you really expect the unexpected, then the expected becomes the unexpected, and that makes it expected again. Repeat.\nI don't understand why anyone uses scribd. There are so many ads that it makes whatever you have done look ugly.\nThere should be a tablet PowerPoint where you create slides by drawing with your finger and writing with your pen.\nReally do need to clean out my sock drawer. Now I know the predicament of all those girls who turned me down for dates in my younger years.\nIt appears that there are more days in the work week than I have nice pants. Time to go shopping.\nWatched a video on how to fix my lawn mower ... livin' la vida loca.\nEver notice that it is never a good time to run out of staples?\nApparently, ariel images are not the same as aerial images.\nA benefit from thinking about the world from a design perspective is that nothing is your fault. Can't work a device? Bad design.\nIf I had a nickle for every mortgage refinance \"opportunity\" I received from my mortgage company, I could pay off my mortgage.\nWas feeling positive until I started reading the news. I can't tell if things are really going down hill, or if bad news just sells better.\n\"iTunes. All your Music. All in one place.\" My brain first read that as \"iTunes. All your music belong to us.\"\nI started eating a lot more fruits and vegetables. I don't know if it shows in my waistline, but it sure shows in my credit card bill.\nWe change with time yet stay the same. I still enjoy a bowl of cereal after soccer. Except now I eat Shredded Wheat instead of Cookie Crisp.\nHays CISD says anyone who wishes to step on any school field at any time must fill out facility usage form. The world has gone mad.\nEver have one of those days where every little thing seems to annoy you? Ah, the fun of being human.\nWhen I was a boy and saw Cool Hand Luke, I thought it was funny. Later, seeing it again as an adult, I thought it was sad.\nJust read an article about fire doors. It says they will not alert you to a fire or extinguish a fire. I wonder if they make coffee.\nI love when it is so quiet I can hear my footsteps.\nI wonder if there is a way I can leverage the power of social media to mow my lawn. Will have to think on that one.\nGoing to take it slow today. I have a lot of work to do, but I am going to do it slowly, mindfully, and systematically.\nI was stressed and so I restarted my computer. It's like I washed my brain clean with meditation. It feels great.\nCompared w/ processed food, the taste and quality of fruit is inconsistent. Now, I see that as a plus. Each piece is unique.\nPet peeve: author says he/she wrote about X in year Y, and now we see that it is more true than ever (or that people finally realize it).\nGoing through old papers. Hard to decide what to keep and what to throw away. There's probably a metaphor in there somewhere.\nSomeday, we are going to look back and be embarrassed about the number of comic book movies made during this time period.\nTwitter and Facebook are just too positive. There should be a social network you can complain too when in low spirits..\nSomehow, downloading a book on audible.com costs more than getting the same book on CD at amazon. I don't like shenanigans.\nClimbing the stairmaster while watching sporting events is a great combo. Gives me a way to channel nervous energy.\nFunny how we love a competition. News articles: 35% iPhone vs. Android, 43% Facebook vs. Google+, 18% Kardashian related, 4% other.\nDusk is definitely my favorite time of day.\nWhen I was a kid it was funny how my mom would buy Nestle Quick but not Strawberry Quick. Strawberry milk offended her sense of decency.\nI wish more places were landscaped in the style \"apocalypse chic.\" Keep roadways and sidewalks clear, but let nature go nuts.\nI bought the no-sugar-added shredded wheat in my cold, rational state at the store. In my hot, hungry state I add sugar.\nThey say that exercise makes you feel good, but it sure causes walking around the office to be tiring and painful.\nGood thing about getting older is you learn to control your thoughts. You don't waste so much time on useless topics.\nDreamed I was trying to explain Bayesian inference to my children. Then there was a big fire, and then I turned into a mouse.\nA spider is attacking a silverfish in my bathtub. Evidently, the spider thinks the tub is his territory. Organic pest control fail.\nI remember when my girl first saw the baby toy isle at Target. She couldn't believe it, dolls for as far as the eye could see.\nCan't use the word \"irony\" anymore. As soon as you do, everyone starts checking if it is used correctly, and your original message is lost.\nWatching my boys throw themselves around, I hope we have robots drive cars before they turn 16.\nI used to wonder what I would do if I were raised in radically different circumstances. But the question made no sense, I wouldn't be \"me.\"\nYou never realize how much of human language is sexual innuendo until you learn a foreign one and constantly say dirty things on accident.\nWife makes fun of me b/c I can't find things in pantry. I say our eyes saccade---amazing I can find anything. She rolls her eyes.\n\"Word has lost data due to a bad network connection or a missing floppy.\" A missing floppy? Somebody needs to update their error messages.\nCheese is weird. When cold, it looks like a health food. But melt it, and it becomes junk food.\nWhat are we going to do when the bots no longer just send you a link, but can give context based on your last few tweets?\nFat-free salad dressing always seems to be missing a core ingredient that I can't quite put my finger on.\nI used to go to news sites looking for interesting articles. Now I just go where you guys point me.\nPlayed basketball with the college kids today. Picked up right where I left off 20 years ago. Actually, I didn't play that bad.\nI don't wanna work, I just want to bang on the drum all day ...\nDreamed that Rick Perry accidentally knocked down my fence with his pickup. He fixed it but also enclosed my backyard in a concrete dome.\nThey clean out the office fridge once a month. I swear it feels like every other day. #TimeFliesLikeAnArrow\nI know I'm starting to fall asleep when I see random images and think nonsensical thoughts. The problem is noticing those wakes me up.\nMy boys love the GEICO commercials. GEICO evidently wants a piece of the lucrative tricycle and teddy bear insurance market.\nGEICO seems to spend more on TV ads than other insurers. And they say they are 15% cheaper. Where are they cutting?\nJust got done working in the yard. We could solve the world's energy problems if we could somehow harness the power of cords to get tangled.\nWrestling with my boys. Good to have a little cave-man time before I go back to work tomorrow.\nI just watched 127 Hours with the special lady. Felt kind of bad sitting there with my microwave popcorn and big glass of cold water.\nJust saw a commercial for Wipeout. I remember when we used to chuckle with smug superiority at how stupid Japanese games shows were.\nThis coffee ain't got no taste. Someone is going to get a stern talking-to. ... Okay, I'll just get up and make some more.\nThere's a fly in my office. He wants to go out the window, but it won't open. I wish I could help. Or squash him.\nI wish that cereal manufacturers would spend the extra 4 cents and make the bag openable in a reasonable way.\nThe car outside my window is blasting smooth jazz on the stereo.  Que?\nKids' chins seem to bust open a lot. Somebody needs to do something about that. #parenting\nProducts were once only made by anonymous employees at large corporations. But computation brings us back to the age of the artisan.\nI wish there were some kind of airport buddy system so you could get up and go get a cup of coffee without having to pack up all your stuff.\nI wish my financial/retirement companies would stop sending me mail. With all these unnecessary words, I'm likely to miss important ones.\nI need a pen, but there are none on my desk. There is, however, a tree branch. Ah, life with kids.\nEver have one of those days where you want to talk but you don't have anything to say, so you ask some kind of vague question?\nI hate reading my own writing. You can't learn anything, and the old things you can find are mistakes.\nIdeas are a funny thing. After they form from the fragments in your mind, they seem obvious. Before they form, they don't exist.\nAh, tall glass of ice water. Amazing how we take clean water for granted. You can drink the water you wash your car with.\nThe great thing about my sister being a physician is that everything she says is \"doctor recommended.\"\nOnline shopping infinite loop: forget a field and hit \"buy\", error saying you forgot a field (also randomly clears another field), repeat.\nMy mom just told me about dandelion wine. She says it tastes terrible and gives you an awful hangover. I'll have to try that sometime.\nFame and fortune await the first person to develop a robot that powers itself by eating fire ants.\nI'd rather have cold coffee than burnt coffee.\nFor change, I just got a nickel from 1946. Think of everywhere that nickel has been.\nFunny how nobody tells jokes anymore.\nChildren used to build either glue or snap-on models. Now, Legos are so detailed that kids build with those instead.\nEach child was only one of the millions of possible children on the night of conception. Imagine knowing them all.\nI learned a new word yesterday. aliteracy: people who can read but choose not to.\nThunder Road has been playing in my head for the last few days.\nYou played computer games stored on audio cassette. #vintagegeek\nI've always thought that playing slow-pitch softball was like watching TV outside.\nRemoving malware off my wife's laptop. This feels so old fashioned.\nI feel like a member of the secret service when I unload the kids from the car in a parking lot. All clear, Mr. Toddler.\nNoticed at a birthday party yesterday that the outside playhouse had a functional A/C unit. I don't even have one in my apartment.\nEggs that aren't fried in bacon grease lack a certain je ne sais quoi.\nOnce a printer decides that it has a paper jam, it is impossible to convince it otherwise.\nI don't normally drink soda, and I'm going to regret this when I go to bed, but for some reason my body really really wants Mountain Dew.\nWhen my kids tease each other, I tell them that we have enough food and they don't have to fight for dominance. They just look at me funny.\nIf you are awake and hungry, is it okay to eat breakfast six hours early?\nWhen they say that you should make lemonade if life gives you lemons, they never point out that life would also have to give you sugar.\nThere is a tension in writing. You want to keep going to maintain momentum, but you also need to stop periodically to gain perspective.\nWeird that we don't have a national ID card, but to get good prices you have to submit your credentials at the grocery store.\nBlacksmiths were the app developers of the middle ages.\nYou know you've gotten older when someone says something like \"think of the history of this place,\" and you actually do.\nAnyone who tells you that you don't need air conditioning in Pittsburgh is a liar.  And, most likely, their pants are on fire.\nI like the convenience of getting weather information online, but I miss the hype and context you get by watching your local weather person.\nIn Pennsylvania, sunscreen is in the \"Seasonal\" section. In Texas, it's a regular staple just like butter, milk, or tacos.\nDreamed I was a mobster. Spent the whole dream thinking about how to transition to post-mobster life.\nI always assumed that my mood and productivity were positively correlated, but I'm starting to suspect that it might not be so.\nBought a pair of shoes at Walgreens last night. The label said they were \"more than shoes.\" I'm still waiting to see what else they do.\nIt's funny when people talk about a \"computer error.\" Like it added wrong or something.\nLove that old cartoon. Husband sees his wife in the living room and says, \"There you are, I've been looking for you all over the internet.\"\nOne thing about the new email notifications is that you are more exposed to people's real names instead of just the userid and photo.\nImagine how cool a lightsaber would be for someone with a tree trimming service. You would probably need special safety gear.\nWe live in a hyper-convenient, throwaway society. Yet, somehow, flour and sugar still come packaged ready to be taken on the Chisholm Trail.\nStarted my day with the Google search \"safe to eat moldy bread?\"\nI bet that primitive people used to just sit around and tell stories about monsters. Anyway, I'm off to the movies.\nWhole world is wrong. To me, \"fish or cut bait\" means to do something directly productive (e.g. fish) or prepare for later (e.g. cut bait).\nJust went for a workout, and, wow, that's exactly what I needed. Now trying to remember why I care about all these symbols on my screen.\nWorries are just like a stack of plates. Only one is visible at once, and when you remove it, the next one immediately appears.\nWhen it comes to apocalypses, I prefer those with a more technical flavor, like the singularity or peak oil.\nJust saw Black Swan. Man, that was stressful. I need to relax, maybe watch a movie or something.\nI remember the first time I got a spam email in 1999. I was so angry I replied back with a stern lecture that such things were unacceptable.\nSeems that shorter papers would be easier to read, but when math is involved it's the opposite. Too many unexplained jumps.\nI like how before my kids learn to read, I can refer to them as \"illiterate.\"\nOne thing about researching artificial intelligence is that it gives you a deep appreciation for how smart humans are.\nMy inbox now has 0 messages. It feels good to get organized.\nA child's ability to resist eating a cookie for 15 min so he or she can later receive a greater reward is correlated with life success.\nPeople in private planes or helicopters should have to pay me $5 every time they fly over while I'm enjoying nature.\nIt's weird how music makes everything more exciting like movies, tech videos, parties. It must tap into some deep, social part of the brain.\nI wonder why we raise our kids on movies with clear good guys and bad guys, when for the most part, the real world is just people\nFunny how the saying \"kill two birds with one stone\" suddenly seems cruel if you replace \"stone\" with \"rock.\"\nNo need to figure out how to monetize a web startup business model when Microsoft is out there with all that extra cash.\nWhy is pi in the normal distribution? Google stumbles on a question like this.\nIt's funny how everyone on the internet just assumes that everyone else is ignorant until they prove otherwise.\nCrazy how traffic lights can now know if you disobey their orders and automatically give you a ticket.\nWe always think we know it all. When my son was 3, my wife taught him something. My son paused and said, \"Okay, do I know everything now?\"\nAmazing that people used to carry around a severed foot of a rabbit for \"good luck.\" Clearly, it didn't do the rabbit much good.\nI wonder, does Twitter use go down in the summer when it is nice outside?\nVideo games are designed to exploit our psychological desire for \"Flow.\"  You feel like you are actually achieving something.\nSeems trivial websites often have the most onerous security protocols. Email me password, change it, change it monthly ...\nFacebook suggested that I be friends with someone who recently died. Weird.\nLike the 140 char limit, but it sure is hard to have a meaningful conversation, especially when people don't already know how you think.\nAmazing how bad library searches are. Can't easily sort by type, thrown by the word \"The,\" and a monkey could give better keyword results.\nEmail, chat, tweets, FB, all these things can be integrated seamlessly into our day.   But a phone call is like a fire alarm.\nI love how a good book becomes part of your mental life forever.\nWhen you proofread your own writing, it is unsatisfying, it no longer seems novel. You have to fall back on the memory to see it through.\nThey say that Mom and Pop stores are great, but when I arrived neither Mom nor Pop was there, so I went to Giant Eagle.\nHas anyone else noticed that automatic language translation finally seems to work?  Crazy.\nUnfair: when young, you must take a nap and you can't buy candy. When older, you can't take a nap and you can afford candy but can't eat it.\nI don't understand why, as a society, we put up with leaf blowers.  I'll take peace and quiet over tidiness any day.\nAdvertising on websites is necessary. But don't they understand that ads with distracting movement make the site unusable?\nAmazing how friends dress alike. There are two people wearing all neon in this airport. They are traveling together.\nNeeded: a rule book for statistics in science. If case x, run program a, b, or c with parameters i, j, and k. Report l, m, and n.\nSeems counterproductive to comment on how wrong something is and then retweet it. No need to propagate useless messages further.\nAccording to toddlers, a cat's tail was made for pulling. The perfect Gibsonian affordance.\nGas costs about $3 a gallon. Starbucks coffee costs about $50 a gallon.\nConfusion is ignorance leaving the brain.  -- Kate Nowak\nI want to read a prequel to The Road. What happened between the time the man filled the bathtub and he and the boy set out.\nPeople talk about the Terrible Twos. But it's the Mad Threes that get you. Also, the Barbarian Fours and the Savage Fives.\nThe default for \"paste\" should be to match the style of the surrounding text in the document.\nRemember remembering: I no longer recall the actual event, but I have a memory of recalling it, and that memory now serves as the original.\nMemory is funny. I have old memories that I no longer remember, but that I remember remembering.\nThe studios should make all individual scenes (e.g. < 2 min) linkable so we can use them to make good/funny points.  Perfect advertising.\nIf you were wondering at what age boys stop using the term \"play date\" and instead call it \"hanging out,\" it's 7.\nFunny how we can't actively enjoy the absence of pain. It only seems like we will when we are in pain.\nAmazing how kids practice actions. At age 2, my boy would go up the step, down the step. Repeat. He loved it, drove me nuts.\nHotmail has this huge ad of someone jumping up and down. Crazy annoying. A popup says you can get rid of it by `\"upgrading.\" #extortion\nIt amazes me that all these websites want my mailing address. Do they plan on sending me correspondence? Dear Sir, ...\nWith location tracking on your phone, you can't go to McDonald's if your wife wants you to eat better. And you can't turn it off.\nI wasn't going to eat those fried noodles, but if you put them in front of me. The dude abides.\nGomer Pyle rocks. He is above our silly madness.\nDreamed I was annoyed with the world. Woke up and was still annoyed. Took me a while to realize it was a dream and the day will be good.\nPhilosophy would be more relevant if we talked less about the people behind the ideas and more about the ideas themselves.\nIf you were to ask people in 1991 to guess a topic big in the news 20 years later, they probably wouldn't say \"pirate attacks\"\nI just saw a spam comment at the bottom of an article about reCaptchas (those codes you have to type in to prove you are human).\nAh human brain. I have to do things in the order in which I am likely to forget them, not in the most convenient order.\nWhen I sit down and articulate a sequence of ideas, I find that I can replace whole paragraphs that now just seem like stuff.\nThere are only a finite number of possible digital images. Each iPhone picture you take is one of (256 * 256 * 256)^5,000,000\nLife tip: turns out your phone only charges if the charger is actually plugged in.\nI wonder when we are going to reverse this trend of not being able to open windows in offices. It's hot in here and the heat is on.\nFam friend to son (3): Want to come to my house by yourself sometime and play with Payton? Son: No. Friend: Why not? Son: I can't drive.\nOH: kids were driving me crazy arguing about the size of the Easter bunny, I said she's big, they said how do u know, I said cause it is me\nWith cuts in public schools, I worry that concerned parents will take their children out, and schools will suffer even more.\nInteresting, I just read a study that argues that more opportunity in life leads to more regret.  Always kind of felt this was true.\nWeird how people drink ginger ale on airplanes but seemingly nowhere else.\nMy son playing a video game in a battle he couldn't win. I told him to run away. He yelled \"never give up!\" He was killed. #lifelesson\nIt's funny. For humans, the day starts when we get up in the morning. But for computers, the day starts at 12am.\nWrestling with my children makes me feel like a caveman. It taps into some kind of primal joy.\nMy son at age 4: \"This orange juice doesn't taste organic.\" Ah, the modern world.\nIf cars drove themselves, we wouldn't need loud sirens on police cars and fire engines. Just send out a WiFi for your car to move.\nWhen did the price of a box of breakfast cereal jump to $7? Wow.\nI coach kindergarten soccer. My standard April fools day joke is to email the parents about having two-a-day practices.\nHT @TheOnion: 5-Year-Old Critics Agree: Movie \"Cars\" Only Gets Better After 40th Viewing\nI need to attend some kind of coffee pouring tutorial. It always runs down the side of the pot.\nAmazing that anyone still puts up with commercials on the radio. At least TV commercials have pretty things to look at.\nMemory is funny. I have old memories that I no longer remember, but that I remember remembering.\nTrying to get back to work. It's hard now that the machine we use for work and the machine we use for fun are the same machine.\nOnce told my 3-year-old son that flowers are our friends. My son: no they're not. Flowers don't have faces.\nAmazing that traffic lights are still dumb. You sit there when no one is coming. Think of all the oil we could save.\nThe mind is a mad monkey.  And Twitter doesn't help.\nMy son's new car seat has a cup holder.  We get a little closer to WALL-E every year.\nIt has always bothered me that we need keys to unlock doors. It seems like all doors should always be open.\nPeople don't tell jokes anymore. Amazing what can go in and out of fashion.\nWhen writing, I am constantly trying to make what I say more specific. More information per line, more real.\nForgot to bring my lunch. Solution: RFID on lunch, RFID on bag, reader on door. Alarm if lunch not in bag at door.\nWant evidence of intelligent machines? Captchas are now too hard for me.\nRugby makes no sense to me. I suspect that there actually are no rules, that it is all just an elaborate hoax.\nNo red underline means the word is spelled correctly, or the text box has no spell checker, or you wrote the wrong word.\nIf I were rich, I'd write this book in a coffee shop drinking cappuccino instead of at home drinking Folgers.\nThe recommended age for rear-facing seats is increasing faster than my children are aging.\nFunny how a new place makes you more in the moment.  Your mind processes the new sights and has fewer cycles for normal silliness.\nWhy do babies always want the new and exciting things they are not supposed to have?\nBaby algorithm: 1. Acquire new object  2. Can I eat it?  3. GOTO 1\nMe: \"Look at those beautiful, new green leaves.\"  My son (7): \"Yeah, blah, blah.\"\nSuggested to the boys that we go leprechaun hunting tomorrow. But they claim not to believe in their existence. Ah, the ignorance of youth.\nAfter spending time on Twitter, Facebook seems so static and slow. Status update from 20min ago--you call that recent?\nDreams are for learning from simulated experience. Dreams show us new places. But why do our dreams also alter familiar places?\nFunny, pictures of nature don't substitute for real nature, they just make me a little sad that I'm not there.\nIt would be nice to be able to cite videos in some permanent place.  Things disappear on YouTube.\nWhen writing, you accumulate frayed ends, realize a big idea is missing, articulate the idea and all frayed ends are cleaned up.  Continue.\nMy son (7) wants to go to my future brother-in-law's bachelor party.  He said to my wife \"But Mom, I'm not married.\"  #unclearontheconcept\nI don't like the idea of flying cars.  We have enough noise and eyesores on the ground.  Why can't it just be all quiet?\nPretty funny when Domino's Pizza in Colorado started following me.  But now they are gone.  Was I not stimulating enough? #timetorethink\nInception, Eternal Sunshine of the Spotless Mind, What Dreams May Come, all feel similar.  All good.\nPattern: 1. good, profitable product. 2. over time, cut corners to up profit. 3. no longer good, profitable product.  E.g. Dell, Dominos\nThe iTunes terms and conditions is 56 pages on the iPhone. Do you agree?\nWhen you arrive at a place you hadn't been to in a long time, your memories are of when you first got there, not when you last left.\nYou want to set mini-deadlines to maintain productivity, but when you do that you end up just doing shoddy work to make the deadline.\nMathematicians drive me nuts.  They publish a whole book on something like category theory, but never say what it's for.\nNobody?  I thought for sure gsexylove would know.\nWho said that the best way to understand a person's experience different from your own is to read a story narrated from that point of view?\nWith augmented reality, we could get rid of most signs altogether. Situationally aware glasses could tell you everything you need to know.\nI sewed up my pants, and they are now good as new.\nMy son (7) wants to know why he can't have a credit card.\nThe greeter at Walmart said \"good job\" because all of my loose items were accounted for. Who says you never get positive feedback anymore?\nMy son now wants a robot that can fly.  He wants it to be able to swoop down from the air and pick up the cat.\nMy son and I are building Lego robots.  He wants a robot to chase the cat up the stairs.  I'll have to manage his expectations.\nAte at Chili's the other day.  Only in America would we consider hamburgers to be a possible appetizer.\nI've read that I should start digging a bunker for the coming of peak oil, but since I'm lazy I'll probably just use the one I dug for Y2K.\nWaiting for my experiments to finish.\n"
  }
]