Json_Module_ParseJSON_API.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# `Python Json Module & Parsing example`\n",
    "\n",
    "# <font color=red>Mr Fugu Data Science</font>\n",
    "\n",
    "# (◕‿◕✿)\n",
    "\n",
    "# Purpose & Outcome:\n",
    "\n",
    "+ `Part 01`: Get an Idea how to use basics of Json Module\n",
    "    + Understand how to open a file, using `with vs with open`\n",
    "    + dealing with json files and strings\n",
    "    + load and dump files\n",
    "\n",
    "+ `Part 02`: parse some news from an API with JSON data\n",
    "    + Connect to a news API form google news\n",
    "        + parse data\n",
    "            + date time and 1 nested column to handle"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "import json\n",
    "import pandas as pd\n",
    "from collections import defaultdict\n",
    "import requests\n",
    "import datetime"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "https://www.nytimes.com/2020/09/03/us/michael-reinoehl-arrest-portland-shooting.html\n",
      "https://www.nytimes.com/2020/08/28/movies/chadwick-boseman-dead.html\n",
      "https://www.nytimes.com/2020/08/30/us/portland-trump-rally-shooting.html\n",
      "https://www.nytimes.com/2020/08/29/health/coronavirus-testing.html\n",
      "https://www.nytimes.com/2020/08/28/nyregion/nyc-tenants-rnc-video-trump.html\n",
      "https://www.nytimes.com/2020/09/03/nyregion/daniel-prude-police-rochester.html\n",
      "https://www.nytimes.com/2020/08/27/us/kyle-rittenhouse-kenosha-shooting-video.html\n",
      "https://www.nytimes.com/2020/08/28/world/europe/greece-girl-unicorn-rescue.html\n",
      "https://www.nytimes.com/2020/08/30/nyregion/nyc-suburbs-housing-demand.html\n",
      "https://www.nytimes.com/2020/09/04/us/after-6-murder-trials-and-nearly-24-years-charges-dropped-against-curtis-flowers.html\n",
      "https://www.nytimes.com/2020/09/02/health/covid-19-vaccine-cdc-plans.html\n",
      "https://www.nytimes.com/2020/08/31/world/europe/coronavirus-covid-spain-second-wave.html\n",
      "https://www.nytimes.com/es/2020/08/27/espanol/opinion/vuelta-cole-espana.html\n",
      "https://www.nytimes.com/2020/09/02/world/europe/navalny-poison-novichok.html\n",
      "https://www.nytimes.com/2020/08/28/books/review/melania-and-me-stephanie-winston-wolkoff.html\n",
      "https://www.nytimes.com/2020/08/28/opinion/coronavirus-schools-tradeoffs.html\n",
      "https://www.nytimes.com/2020/09/01/us/american-airlines-jet-pack-LAX.html\n",
      "https://www.nytimes.com/2020/09/02/business/media/harry-meghan-netflix.html\n",
      "https://www.nytimes.com/2020/08/29/health/colon-cancer-chadwick-boseman.html\n",
      "https://www.nytimes.com/2020/08/27/technology/what-if-facebook-is-the-real-silent-majority.html\n"
     ]
    }
   ],
   "source": [
    "\n",
    "with open('nytimes_api.json','r') as js:\n",
    "    k=json.load(js)\n",
    "\n",
    "pd.DataFrame(k)\n",
    "# \n",
    "for i in k:\n",
    "    print(i['url'])\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Difference between `with` and `with open`\n",
    "\n",
    "When you use:\n",
    "\n",
    "`file_to_open = open('some file','r')\n",
    "read_file = file_to_open.read()\n",
    "Now you do some task type type have fun.. \n",
    "file_to_open.close()`\n",
    "\n",
    "Notice that you have to close the file when you are done doing your function stuff like calculations or whatever.\n",
    "\n",
    "Now, if you use this next method it will close automatically and you don't have to remember. This is good for most people because like me, we are lazy or forgretful.\n",
    "\n",
    "`with open('some fun fancy file here','r') as myfile:\n",
    "    file_to_read = myfile.read()\n",
    "    then do some stuff with your file now\n",
    "`"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# We can specify the parameters we want for the file when we call it in:\n",
    "\n",
    "think of it like this: **open(*file*,*mode*)**\n",
    "\n",
    "we have different *modes/parameters to put here*\n",
    "\n",
    "`Read`: `r`\n",
    "\n",
    "`Write`: `w`\n",
    "\n",
    "`Append`: `a`\n",
    "\n",
    "`Create`: `x`\n",
    "    \n",
    "`Binary`: `b`\n",
    "\n",
    "These are the basics, there are variations of course: \n",
    "\n",
    "`Read binary`: `rb`\n",
    "\n",
    "`Write binary`: `wb`\n",
    "\n",
    "`Reading & Writing`: `+`\n",
    "\n",
    "have fun with your hearts content to mix and match for your needs.\n",
    "\n",
    "`----------------------------------`"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# json.dump vs json.dump`s`\n",
    "\n",
    "We should use a term called `Serialization` where we are *encoding* or taking an object or data structure and storing it in a format that can be used for later. \n",
    "\n",
    "+ `json.dump`: method without the `'s'`; is used to store as a file\n",
    "\n",
    "Whereas; \n",
    "\n",
    "+ `json.dumps`: is used to convert 'encode' any Python object into a python string.\n",
    "\n",
    "`-------------------------------`\n",
    "\n",
    "Btw, we all know that this dump is very similar to the funny english term 💩 Muahahah.\n",
    "Just as funny is the database term shard which reminds us of ... Yes, I know computer science can have some humor once in a while"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "`Conversion Table`: for encoding/decoding json type equivalents of Python objects\n",
    "    \n",
    "| Json   \t| Python                                 \t|\n",
    "|--------\t|----------------------------------------\t|\n",
    "| Object \t| dict()                                 \t|\n",
    "| Array  \t| list,tuple                             \t|\n",
    "| String \t| str                                    \t|\n",
    "| number \t| int, float, int &  float \t|\n",
    "| true   \t| True                                   \t|\n",
    "| false  \t| False                                  \t|\n",
    "| null   \t| None                                   \t|\n",
    "\n",
    "\n",
    "`-----------------------------------------------`"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# `json.load & json.loads`: your decoding part 'deserialization'\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Can take your python dictionary and convert to json"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {},
   "outputs": [],
   "source": [
    "ny_times_dta=open('nytimes_api.json')\n",
    "\n",
    "# Decode the JSON data and read into DF\n",
    "pp=pd.DataFrame(json.load(ny_times_dta))\n",
    "\n",
    "# closed file after we read it in\n",
    "ny_times_dta.close()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# `DF conversion is another way instead of open/with open method`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 203,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>uri</th>\n",
       "      <th>url</th>\n",
       "      <th>id</th>\n",
       "      <th>asset_id</th>\n",
       "      <th>source</th>\n",
       "      <th>published_date</th>\n",
       "      <th>updated</th>\n",
       "      <th>section</th>\n",
       "      <th>subsection</th>\n",
       "      <th>nytdsection</th>\n",
       "      <th>...</th>\n",
       "      <th>byline</th>\n",
       "      <th>type</th>\n",
       "      <th>title</th>\n",
       "      <th>abstract</th>\n",
       "      <th>des_facet</th>\n",
       "      <th>org_facet</th>\n",
       "      <th>per_facet</th>\n",
       "      <th>geo_facet</th>\n",
       "      <th>media</th>\n",
       "      <th>eta_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>nyt://article/f0510da8-1ef8-5442-a909-8af53b7d...</td>\n",
       "      <td>https://www.nytimes.com/2020/09/03/us/michael-...</td>\n",
       "      <td>100000007321101</td>\n",
       "      <td>100000007321101</td>\n",
       "      <td>New York Times</td>\n",
       "      <td>2020-09-03</td>\n",
       "      <td>2020-09-05 10:04:00</td>\n",
       "      <td>U.S.</td>\n",
       "      <td></td>\n",
       "      <td>u.s.</td>\n",
       "      <td>...</td>\n",
       "      <td>By Hallie Golden, Mike Baker and Adam Goldman</td>\n",
       "      <td>Article</td>\n",
       "      <td>Suspect in Fatal Portland Shooting Is Killed b...</td>\n",
       "      <td>Law enforcement agents killed Michael Forest R...</td>\n",
       "      <td>[Murders, Attempted Murders and Homicides, Ant...</td>\n",
       "      <td>[Patriot Prayer]</td>\n",
       "      <td>[Reinoehl, Michael (1972-2020), Danielson, Aar...</td>\n",
       "      <td>[Portland (Ore)]</td>\n",
       "      <td>[{'type': 'image', 'subtype': 'photo', 'captio...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>nyt://article/607123ea-14ba-5f9c-ab43-7d8b6c7a...</td>\n",
       "      <td>https://www.nytimes.com/2020/08/28/movies/chad...</td>\n",
       "      <td>100000007314593</td>\n",
       "      <td>100000007314593</td>\n",
       "      <td>New York Times</td>\n",
       "      <td>2020-08-28</td>\n",
       "      <td>2020-08-31 10:07:14</td>\n",
       "      <td>Movies</td>\n",
       "      <td></td>\n",
       "      <td>movies</td>\n",
       "      <td>...</td>\n",
       "      <td>By Reggie Ugwu and Michael Levenson</td>\n",
       "      <td>Article</td>\n",
       "      <td>‘Black Panther’ Star Chadwick Boseman Dies of ...</td>\n",
       "      <td>The actor also played groundbreaking figures l...</td>\n",
       "      <td>[Deaths (Obituaries), Movies, Actors and Actre...</td>\n",
       "      <td>[]</td>\n",
       "      <td>[Boseman, Chadwick]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[{'type': 'image', 'subtype': 'photo', 'captio...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>nyt://article/6bff4972-07cc-5b20-bd16-39f9cf19...</td>\n",
       "      <td>https://www.nytimes.com/2020/08/30/us/portland...</td>\n",
       "      <td>100000007315198</td>\n",
       "      <td>100000007315198</td>\n",
       "      <td>New York Times</td>\n",
       "      <td>2020-08-30</td>\n",
       "      <td>2020-09-05 10:05:01</td>\n",
       "      <td>U.S.</td>\n",
       "      <td></td>\n",
       "      <td>u.s.</td>\n",
       "      <td>...</td>\n",
       "      <td>By Mike Baker</td>\n",
       "      <td>Article</td>\n",
       "      <td>One Person Dead in Portland After Clashes Betw...</td>\n",
       "      <td>A man affiliated with a right-wing group was s...</td>\n",
       "      <td>[George Floyd Protests (2020), Demonstrations,...</td>\n",
       "      <td>[Patriot Prayer]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[Portland (Ore), Oregon]</td>\n",
       "      <td>[{'type': 'image', 'subtype': 'photo', 'captio...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>nyt://article/0487a919-ec10-5bf5-8f65-449c7a78...</td>\n",
       "      <td>https://www.nytimes.com/2020/08/29/health/coro...</td>\n",
       "      <td>100000007294406</td>\n",
       "      <td>100000007294406</td>\n",
       "      <td>New York Times</td>\n",
       "      <td>2020-08-29</td>\n",
       "      <td>2020-09-01 21:09:22</td>\n",
       "      <td>Health</td>\n",
       "      <td></td>\n",
       "      <td>health</td>\n",
       "      <td>...</td>\n",
       "      <td>By Apoorva Mandavilli</td>\n",
       "      <td>Article</td>\n",
       "      <td>Your Coronavirus Test Is Positive. Maybe It Sh...</td>\n",
       "      <td>The usual diagnostic tests may simply be too s...</td>\n",
       "      <td>[Coronavirus (2019-nCoV), Tests (Medical), Con...</td>\n",
       "      <td>[Centers for Disease Control and Prevention, F...</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[{'type': 'image', 'subtype': 'photo', 'captio...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>nyt://article/7e66f291-6167-5d78-b942-4937278f...</td>\n",
       "      <td>https://www.nytimes.com/2020/08/28/nyregion/ny...</td>\n",
       "      <td>100000007313944</td>\n",
       "      <td>100000007313944</td>\n",
       "      <td>New York Times</td>\n",
       "      <td>2020-08-28</td>\n",
       "      <td>2020-09-03 11:03:02</td>\n",
       "      <td>New York</td>\n",
       "      <td></td>\n",
       "      <td>new york</td>\n",
       "      <td>...</td>\n",
       "      <td>By Matthew Haag</td>\n",
       "      <td>Article</td>\n",
       "      <td>N.Y.C. Tenants Say They Were Tricked Into Appe...</td>\n",
       "      <td>“I am not a Trump supporter,” one of the tenan...</td>\n",
       "      <td>[Public and Subsidized Housing, Republican Nat...</td>\n",
       "      <td>[Housing Authority (NYC), Housing and Urban De...</td>\n",
       "      <td>[Patton, Lynne M, de Blasio, Bill, Trump, Dona...</td>\n",
       "      <td>[New York City]</td>\n",
       "      <td>[{'type': 'image', 'subtype': 'photo', 'captio...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 22 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                 uri  \\\n",
       "0  nyt://article/f0510da8-1ef8-5442-a909-8af53b7d...   \n",
       "1  nyt://article/607123ea-14ba-5f9c-ab43-7d8b6c7a...   \n",
       "2  nyt://article/6bff4972-07cc-5b20-bd16-39f9cf19...   \n",
       "3  nyt://article/0487a919-ec10-5bf5-8f65-449c7a78...   \n",
       "4  nyt://article/7e66f291-6167-5d78-b942-4937278f...   \n",
       "\n",
       "                                                 url               id  \\\n",
       "0  https://www.nytimes.com/2020/09/03/us/michael-...  100000007321101   \n",
       "1  https://www.nytimes.com/2020/08/28/movies/chad...  100000007314593   \n",
       "2  https://www.nytimes.com/2020/08/30/us/portland...  100000007315198   \n",
       "3  https://www.nytimes.com/2020/08/29/health/coro...  100000007294406   \n",
       "4  https://www.nytimes.com/2020/08/28/nyregion/ny...  100000007313944   \n",
       "\n",
       "          asset_id          source published_date              updated  \\\n",
       "0  100000007321101  New York Times     2020-09-03  2020-09-05 10:04:00   \n",
       "1  100000007314593  New York Times     2020-08-28  2020-08-31 10:07:14   \n",
       "2  100000007315198  New York Times     2020-08-30  2020-09-05 10:05:01   \n",
       "3  100000007294406  New York Times     2020-08-29  2020-09-01 21:09:22   \n",
       "4  100000007313944  New York Times     2020-08-28  2020-09-03 11:03:02   \n",
       "\n",
       "    section subsection nytdsection  ...  \\\n",
       "0      U.S.                   u.s.  ...   \n",
       "1    Movies                 movies  ...   \n",
       "2      U.S.                   u.s.  ...   \n",
       "3    Health                 health  ...   \n",
       "4  New York               new york  ...   \n",
       "\n",
       "                                          byline     type  \\\n",
       "0  By Hallie Golden, Mike Baker and Adam Goldman  Article   \n",
       "1            By Reggie Ugwu and Michael Levenson  Article   \n",
       "2                                  By Mike Baker  Article   \n",
       "3                          By Apoorva Mandavilli  Article   \n",
       "4                                By Matthew Haag  Article   \n",
       "\n",
       "                                               title  \\\n",
       "0  Suspect in Fatal Portland Shooting Is Killed b...   \n",
       "1  ‘Black Panther’ Star Chadwick Boseman Dies of ...   \n",
       "2  One Person Dead in Portland After Clashes Betw...   \n",
       "3  Your Coronavirus Test Is Positive. Maybe It Sh...   \n",
       "4  N.Y.C. Tenants Say They Were Tricked Into Appe...   \n",
       "\n",
       "                                            abstract  \\\n",
       "0  Law enforcement agents killed Michael Forest R...   \n",
       "1  The actor also played groundbreaking figures l...   \n",
       "2  A man affiliated with a right-wing group was s...   \n",
       "3  The usual diagnostic tests may simply be too s...   \n",
       "4  “I am not a Trump supporter,” one of the tenan...   \n",
       "\n",
       "                                           des_facet  \\\n",
       "0  [Murders, Attempted Murders and Homicides, Ant...   \n",
       "1  [Deaths (Obituaries), Movies, Actors and Actre...   \n",
       "2  [George Floyd Protests (2020), Demonstrations,...   \n",
       "3  [Coronavirus (2019-nCoV), Tests (Medical), Con...   \n",
       "4  [Public and Subsidized Housing, Republican Nat...   \n",
       "\n",
       "                                           org_facet  \\\n",
       "0                                   [Patriot Prayer]   \n",
       "1                                                 []   \n",
       "2                                   [Patriot Prayer]   \n",
       "3  [Centers for Disease Control and Prevention, F...   \n",
       "4  [Housing Authority (NYC), Housing and Urban De...   \n",
       "\n",
       "                                           per_facet  \\\n",
       "0  [Reinoehl, Michael (1972-2020), Danielson, Aar...   \n",
       "1                                [Boseman, Chadwick]   \n",
       "2                                                 []   \n",
       "3                                                 []   \n",
       "4  [Patton, Lynne M, de Blasio, Bill, Trump, Dona...   \n",
       "\n",
       "                  geo_facet  \\\n",
       "0          [Portland (Ore)]   \n",
       "1                        []   \n",
       "2  [Portland (Ore), Oregon]   \n",
       "3                        []   \n",
       "4           [New York City]   \n",
       "\n",
       "                                               media eta_id  \n",
       "0  [{'type': 'image', 'subtype': 'photo', 'captio...      0  \n",
       "1  [{'type': 'image', 'subtype': 'photo', 'captio...      0  \n",
       "2  [{'type': 'image', 'subtype': 'photo', 'captio...      0  \n",
       "3  [{'type': 'image', 'subtype': 'photo', 'captio...      0  \n",
       "4  [{'type': 'image', 'subtype': 'photo', 'captio...      0  \n",
       "\n",
       "[5 rows x 22 columns]"
      ]
     },
     "execution_count": 203,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ny_df=pd.DataFrame(k)\n",
    "\n",
    "# Convert to json if you want\n",
    "cc=ny_df.to_json(orient='records')\n",
    "\n",
    "# Reading the json if it was in json format\n",
    "pd.read_json(cc).head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Part 02: `Google News Api`\n",
    "\n",
    "This is what I used today:  https://newsapi.org/s/google-news-api\n",
    "\n",
    "Then the parameters you can use are here: just scroll down page to see\n",
    "\n",
    "https://newsapi.org/docs/endpoints/top-headlines\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 137,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'status': 'ok',\n",
       " 'totalResults': 97294,\n",
       " 'articles': [{'source': {'id': None, 'name': 'Lifehacker.com'},\n",
       "   'author': 'Joel Cunningham',\n",
       "   'title': \"How to Turn Off Alexa's Creepy 'Whisper Mode'\",\n",
       "   'description': 'I love my smart speaker—as much as one can ever love a piece of privacy-stealing technology that only exists to gather information about you, I suppose—but that doesn’t mean I don’t find many things about it creepy, in a dystopian sort of way. And one of the …',\n",
       "   'url': 'https://lifehacker.com/how-to-turn-off-alexas-creepy-whisper-mode-1844908094',\n",
       "   'urlToImage': 'https://i.kinja-img.com/gawker-media/image/upload/c_fill,f_auto,fl_progressive,g_center,h_675,pg_1,q_80,w_1200/xnejlf6wytytpdfjhlxc.jpg',\n",
       "   'publishedAt': '2020-08-31T20:30:00Z',\n",
       "   'content': 'I love my smart speakeras much as one can ever love a piece of privacy-stealing technology that only exists to gather information about you, I supposebut that doesnt mean I dont find many things abou… [+1722 chars]'},\n",
       "  {'source': {'id': None, 'name': 'Lifehacker.com'},\n",
       "   'author': 'Elizabeth Yuko',\n",
       "   'title': 'How to Avoid Getting a Last-Minute Booking Blocked by Airbnb',\n",
       "   'description': 'Airbnb is cracking down on parties. They are now basically the equivalent of your parents when you were in high school. Even if you refer to it as a “small gathering,” there is still the possibility of making a mess or other types of property damage. So to av…',\n",
       "   'url': 'https://lifehacker.com/how-to-avoid-getting-a-last-minute-booking-blocked-by-a-1844967058',\n",
       "   'urlToImage': 'https://i.kinja-img.com/gawker-media/image/upload/c_fill,f_auto,fl_progressive,g_center,h_675,pg_1,q_80,w_1200/pggh6tysd4jonlzkuadi.jpg',\n",
       "   'publishedAt': '2020-09-06T14:00:00Z',\n",
       "   'content': 'Airbnb is cracking down on parties. They are now basically the equivalent of your parents when you were in high school. Even if you refer to it as a small gathering, there is still the possibility of… [+1587 chars]'},\n",
       "  {'source': {'id': None, 'name': 'Lifehacker.com'},\n",
       "   'author': 'Beth Skwarecki on Vitals, shared by Beth Skwarecki to Lifehacker',\n",
       "   'title': 'Tackle a Hill Head-On',\n",
       "   'description': 'Did you find a new trail to run or hike for last week’s challenge? This week is another trail-compatible one, and I encourage you to find someplace fun to do it. But we’re going to take it up a notch, because I want you to specifically find a scary hill. And …',\n",
       "   'url': 'https://vitals.lifehacker.com/tackle-a-hill-head-on-1845026700',\n",
       "   'urlToImage': 'https://i.kinja-img.com/gawker-media/image/upload/c_fill,f_auto,fl_progressive,g_center,h_675,pg_1,q_80,w_1200/es2nldvq7q1eetobcqfe.jpg',\n",
       "   'publishedAt': '2020-09-11T16:30:00Z',\n",
       "   'content': 'Did you find a new trail to run or hike for last weeks challenge? This week is another trail-compatible one, and I encourage you to find someplace fun to do it. But were going to take it up a notch, … [+2662 chars]'},\n",
       "  {'source': {'id': None, 'name': 'Lifehacker.com'},\n",
       "   'author': 'David Murphy',\n",
       "   'title': 'How Do I Share a Hard Drive on My Home Network?',\n",
       "   'description': 'I will never fault someone for asking a tech question that feels “basic,” because we all had to get our start somewhere. Few of us popped out of the womb knowing how to access a network share in Windows, what a workgroup was, or how to map a network drive.Rea…',\n",
       "   'url': 'https://lifehacker.com/how-do-i-share-a-hard-drive-on-my-home-network-1844791711',\n",
       "   'urlToImage': 'https://i.kinja-img.com/gawker-media/image/upload/c_fill,f_auto,fl_progressive,g_center,h_675,pg_1,q_80,w_1200/c5inf1gt9vog7jtub1iv.jpg',\n",
       "   'publishedAt': '2020-08-21T13:00:00Z',\n",
       "   'content': 'I will never fault someone for asking a tech question that feels basic, because we all had to get our start somewhere. Few of us popped out of the womb knowing how to access a network share in Window… [+9062 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Richard Lawler',\n",
       "   'title': \"Watch Elon Musk's Neuralink reveal live at 6PM ET\",\n",
       "   'description': 'Last year Neuralink launched with lofty promises of developing chips and technology that will connect human brains to computers, and now the company is ready to show off its progress. Elon Musk said the webcast will include a look at a working Neuralink devic…',\n",
       "   'url': 'https://www.engadget.com/neuralink-bmi-livestream-214856853.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F0beead00-e978-11ea-89ff-16d5c28bcfdb&client=amp-blogside-v2&signature=1688bf1caa73538af8f2c0ca8eab87a7f9c0f8cd',\n",
       "   'publishedAt': '2020-08-28T21:48:56Z',\n",
       "   'content': 'Last year Neuralink launched with lofty promises of developing chips and technology that will connect human brains to computers, and now the company is ready to show off its progress. Elon Musk said … [+171 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Steve Dent',\n",
       "   'title': \"Xiaomi's under-display camera tech is coming to phones next year\",\n",
       "   'description': 'Under-display cameras do a neat trick, allowing manufacturers to build all-screen phones without complex pop-up selfie cameras. Now, Xiaomi has unveiled its third-generation of under-display cameras and promised that the technology will be coming to the mass …',\n",
       "   'url': 'https://www.engadget.com/xiaomis-under-display-camera-tech-is-coming-to-phones-next-year-130012911.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F91e25a50-e91f-11ea-9f6c-bbfe604c8b07&client=amp-blogside-v2&signature=df0e807f9612a45abdb84c3b1ae7fb3bb0801b86',\n",
       "   'publishedAt': '2020-08-28T13:00:12Z',\n",
       "   'content': 'Xiaomi developed its own pixel grid arrangement that allows light to pass through the gap area of sub-pixels. At the same time, each single pixel has a complete RGB subpixel layout with no sacrifice … [+724 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Mariella Moon',\n",
       "   'title': 'Google rolls out captions for audio and video messages on Duo',\n",
       "   'description': 'Google has started rolling out a new Duo feature that’ll make it easier to check video and voice messages even in a noisy place. In a tweet, the Made by Google account has revealed that captions have started going live for messages sent on the application. No…',\n",
       "   'url': 'https://www.engadget.com/google-duo-captions-083552425.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F54c237b0-e2af-11ea-bfbe-8b0cb61f5233&client=amp-blogside-v2&signature=084492b17237f51c7f506c45827af87bf83e6b6f',\n",
       "   'publishedAt': '2020-08-20T08:35:52Z',\n",
       "   'content': 'Google has started rolling out a new Duo feature that’ll make it easier to check video and voice messages even in a noisy place. In a tweet, the Made by Google account has revealed that captions have… [+881 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Steve Dent',\n",
       "   'title': 'Pentagon says Microsoft still deserves $10 billion JEDI cloud contract',\n",
       "   'description': 'After an internal investigation, the US Department of Defense (DoD) announced that is standing by its decision to award the $10 billion JEDI cloud computing contract to Microsoft and not Amazon. The probe was triggered after Amazon complained that the integri…',\n",
       "   'url': 'https://www.engadget.com/pentagon-microsoft-dod-jedi-defense-094536689.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2Fad4472f0-f0e6-11ea-bdf5-79e54a6abe6f&client=amp-blogside-v2&signature=df79ed3cdb187ba44d0f9289558cfa995e8f840c',\n",
       "   'publishedAt': '2020-09-07T09:45:36Z',\n",
       "   'content': 'The DoD has said that the cloud contract, which will provide storage, AI processing, machine learning and more is essential to modernizing the US military. Oracle and IBM bid along with Microsoft and… [+1253 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Christine Fisher',\n",
       "   'title': 'Skullcandy’s Crusher Evo headphones are even better at rattling your brain',\n",
       "   'description': 'Skullcandy says its new Crusher Evo wireless headphones are more brain rattling than ever. The Crusher line has been using haptics to create \"an ultra-realistic sensory bass experience\" since 2013, but Skullcandy says the Crusher Evo cans offer “more multi-di…',\n",
       "   'url': 'https://www.engadget.com/skullcandy-crusher-evo-headphones-151354665.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2F0bd96b30-edf5-11ea-aacc-ee8653355bef&client=amp-blogside-v2&signature=855f6c2ec50e7a30bdd1a492d829b8fef2b2d376',\n",
       "   'publishedAt': '2020-09-03T15:13:54Z',\n",
       "   'content': 'The Evo promise 40 hours of battery life, plus rapid charging technology that delivers a four-hour boost with a 10-minute charge. Touch controls let users take calls, change tracks, adjust volume and… [+249 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Steve Dent',\n",
       "   'title': \"Elon Musk teases 'working Neuralink device' reveal on August 28th\",\n",
       "   'description': 'Elon Musk has revealed more details about a promised development update for Neuralink, the brain-computer interface designed to help folks with severe brain injuries. Musk said the company will show a “working Neuralink device” during a live webcast on Friday…',\n",
       "   'url': 'https://www.engadget.com/working-neuralink-device-on-august-28th-at-3-pm-et-081007843.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F5565ae00-e76d-11ea-a79e-831cc99d5d03&client=amp-blogside-v2&signature=8960fc53eae16889c219815642e2bd8f8278ee66',\n",
       "   'publishedAt': '2020-08-26T08:10:07Z',\n",
       "   'content': 'Neuralink said it first aims to help amputees, or restore the ability to see, talk and listen. While the company hasn’t announced any human testing, it has been tried on primates, with Musk saying “a… [+421 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Engadget',\n",
       "   'title': \"The Morning After: Microsoft isn't buying TikTok\",\n",
       "   'description': 'Weekends are usually a quiet couple of days for tech news. Not this time, TMA reader. Firstly, Microsoft isn’t buying Tiktok, but a similarly senior tech company — Oracle — is now the most likely (if not the only possible) buyer. Then we have NVIDIA buying AR…',\n",
       "   'url': 'https://www.engadget.com/the-morning-after-microsoft-isnt-buying-tik-tok-112523426.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2F97968bd1-f66f-11ea-bfc7-c4571cd1635c&client=amp-blogside-v2&signature=53e0a8be893053202371a76b6a480af4a480db64',\n",
       "   'publishedAt': '2020-09-14T11:25:45Z',\n",
       "   'content': 'Weekends are usually a quiet couple of days for tech news. Not this time, TMA reader. Firstly, Microsoft isn’t buying Tiktok, but a similarly senior tech company — Oracle — is now the most likely (if… [+2605 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Christine Fisher',\n",
       "   'title': 'Neato’s robotic D10 vacuum uses LIDAR-based navigation',\n",
       "   'description': 'Neato’s newest robotic vacuum, the Neato D10, uses LIDAR-based technology and a HEPA filter that captures virtually 100 percent of allergens, the company says. It offers a runtime of 150 minutes, the widest brush and largest dirt bin on the market, supposedly…',\n",
       "   'url': 'https://www.engadget.com/neato-d10-robotic-vacuum-lidar-hepa-151909764.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2Fad3e2730-eebe-11ea-bebf-96fabf77839f&client=amp-blogside-v2&signature=d82dcec9b3f5427b99c26f37f346a1d78f26cfd3',\n",
       "   'publishedAt': '2020-09-04T15:19:09Z',\n",
       "   'content': 'Thanks to the upgraded app, users will be able to set up their Neato D10 in just six steps. As promised, Neato vacuums now work with Siri Shortcuts, as well as Alexa and Google Assistant. You can map… [+736 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Jon Fingas',\n",
       "   'title': 'SoftBank is reportedly close to selling ARM to NVIDIA',\n",
       "   'description': 'SoftBank might be close to finding a buyer for ARM, and it won’t surprise you who the bidder might be. Wall Street Journal sources say SoftBank is close to a deal to sell ARM Holdings to NVIDIA for “more than” $40 billion. The two have reportedly been in excl…',\n",
       "   'url': 'https://www.engadget.com/softbank-near-selling-arm-to-nvidia-190823916.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2F477f82d0-f527-11ea-aff5-5ea05774eaae&client=amp-blogside-v2&signature=e0e36c1765c9789d6701d955eb45e89726e4d1db',\n",
       "   'publishedAt': '2020-09-12T19:08:23Z',\n",
       "   'content': 'NVIDIA declined to comment to Engadget. We’ve also asked SoftBank and ARM for comment.\\r\\nIf a deal goes through, it could represents one of the largest semiconductor buyouts in history. It potentially… [+694 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Jessica Conditt',\n",
       "   'title': \"Alphabet's Verily begins offering stop-loss health insurance\",\n",
       "   'description': 'Verily, Alphabet’s healthcare business, is overseeing a new subsidiary that will offer stop-loss insurance to employers. Coefficient Insurance Company is backed by insurance megacorp Swiss Re, and relies on data analytics to predict and reduce risk.Stop-loss …',\n",
       "   'url': 'https://www.engadget.com/alphabet-verily-health-inscurance-coefficient-212604107.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F85cd1c10-e716-11ea-affd-7cff564067af&client=amp-blogside-v2&signature=4406726e30119753e82b776084dedc3e13feb660',\n",
       "   'publishedAt': '2020-08-25T21:26:04Z',\n",
       "   'content': 'Verily is bringing the hardware, software and data science to Coefficient, while Swiss Re has the distribution network and practical knowledge in the $20 billion stop-loss market. Swiss Re made a min… [+840 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Karissa Bell',\n",
       "   'title': 'How TikTok got caught in the middle of a trade war with China',\n",
       "   'description': 'Less than three years after merging with Musical.ly, TikTok looked like it might just achieve something many have tried but few have accomplished: becoming an actual competitor with Facebook and Instagram.Then Donald Trump stepped in.\\xa0\\nAfter weeks of threats,…',\n",
       "   'url': 'https://www.engadget.com/how-tiktok-got-caught-in-middle-trade-war-with-china-223010428.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F5cb0a910-ebde-11ea-b7b7-faee78bf78d0&client=amp-blogside-v2&signature=61056613af4b1ff860b5b9478bc70b0d6400dff6',\n",
       "   'publishedAt': '2020-09-04T22:30:10Z',\n",
       "   'content': 'After weeks of threats, the president delivered an ultimatum to TikTok and its owner ByteDance: sell the app’s US operations to an American company or it would be banned. He gave the company little m… [+1296 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Devindra Hardawar',\n",
       "   'title': \"Intel unveils Tiger Lake CPUs, rebrands Project Athena as 'Intel Evo'\",\n",
       "   'description': 'Intel gave us a deep look at its upcoming 11th generation”Tiger Lake” CPUs last month — now, it’s officially unveiling the chips we can expect in thin and light laptops later this year. And that’s not all: the company also announced “Intel Evo,” the second it…',\n",
       "   'url': 'https://www.engadget.com/intel-tiger-lake-launch-evo-project-athena-164502057.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2F22a5b540-ed3b-11ea-bbe5-d747f07606d0&client=amp-blogside-v2&signature=f8d962e999fb02e26685546b3676884d43e42851',\n",
       "   'publishedAt': '2020-09-02T16:45:02Z',\n",
       "   'content': 'Intel is offering Tiger Lake chips in two packages: One with a 12 to 28-watt thermal profile and other reaching 7 to 14 watts. That gives PC makers the flexibility to use the CPUs in a variety of har… [+774 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Mariella Moon',\n",
       "   'title': 'FDA approves first automated insulin system for kids',\n",
       "   'description': 'Testing blood sugar frequently and administering insulin as needed throughout the day isn’t easy, especially if the individual with diabetes is a young child who can’t do it on their own yet. Now, there’s an FDA-sanctioned device that could make things easier…',\n",
       "   'url': 'https://www.engadget.com/fda-approves-automated-insulin-system-for-kids-090120022.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2F1e7c5bc0-ec1b-11ea-bbfc-eb6664f0b660&client=amp-blogside-v2&signature=770c4754a29035b9bc4def3df40cca660353200e',\n",
       "   'publishedAt': '2020-09-01T09:01:20Z',\n",
       "   'content': 'The device’s sensor that’s attached to the patient’s body can measure glucose levels under the skin every five minutes. It also comes with a pump and an infusion patch connected to the pump with a ca… [+1064 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Christine Fisher',\n",
       "   'title': 'Google makes it easier to find local news through Podcasts and Assistant',\n",
       "   'description': 'While news podcasts are increasingly popular, most focus on national and global news. It tends to be harder to find local news, especially in an on-demand, audio format. Google wants to change this. Today, it announced plans to bring Your News Update to Googl…',\n",
       "   'url': 'https://www.engadget.com/google-local-news-podcasts-app-assistant-145951020.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-images%2F2020-04%2F6b281450-7f88-11ea-8fef-3fdb50d1a398&client=amp-blogside-v2&signature=7bd274bcbc5ecd5bf994ddb80db9490b6dab8f90',\n",
       "   'publishedAt': '2020-09-02T14:59:51Z',\n",
       "   'content': 'You’ll also be able to find local news through Google Assistant. When you ask a Google Nest smart speaker to “play local news” or “play news about [your city],” you’ll hear local news stories in both… [+1014 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Mariella Moon',\n",
       "   'title': 'Portland officials pass strict ban on facial recognition systems',\n",
       "   'description': 'Portland, Oregon officials have passed what could be the strictest municipal ban on facial recognition in the country. It’s not just local government units, such as the police, that can no longer use facial recognition under the city’s new regulations — priva…',\n",
       "   'url': 'https://www.engadget.com/portland-facial-recognition-ban-035952590.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2F7e29be80-f311-11ea-b3ce-7a6e647c658b&client=amp-blogside-v2&signature=7a3bb6eaa1bb0112d00229fc3bde099ddf728a81',\n",
       "   'publishedAt': '2020-09-10T03:59:52Z',\n",
       "   'content': 'Portland’s officials first revealed that they were working on the bill back in November 2019, and that if the bill passes, it will be the first to prohibit private businesses from deploying facial re… [+1364 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Nick Summers',\n",
       "   'title': 'Google Docs update makes it easier for visually impaired users to navigate',\n",
       "   'description': 'Google is making it easier for visually impaired people to use its Microsoft Office alternatives. The biggest change is a new shortcut — Ctrl+Alt+H on Windows, and CMD+Option+H on Mac — to instantly toggle Braille support in Docs, Sheets and Slides. Navigatio…',\n",
       "   'url': 'https://www.engadget.com/google-docs-update-braille-support-shortcuts-navigation-verbalized-133049191.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2Fcc15eff0-ec50-11ea-b7d3-029b47c353b8&client=amp-blogside-v2&signature=5e8c432f5f7533a6dcab34a90aa95ce5cffcaa8b',\n",
       "   'publishedAt': '2020-09-01T13:30:49Z',\n",
       "   'content': 'Google is making it easier for visually impaired people to use its Microsoft Office alternatives. The biggest change is a new shortcut — Ctrl+Alt+H on Windows, and CMD+Option+H on Mac — to instantly … [+1081 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Igor Bonifacic',\n",
       "   'title': \"Uber will require some riders to verify they're wearing masks\",\n",
       "   'description': \"As an Uber passenger, you already have to verify that you've washed or sanitized your hands and that you're wearing a mask before getting into a ride. But the company will soon require users who show disregard or ignorance of those rules to submit to addition…\",\n",
       "   'url': 'https://www.engadget.com/uber-rider-mask-selfie-verification-140016317.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2Fb792cee0-ebd3-11ea-ad9b-dcd4bc8cf093&client=amp-blogside-v2&signature=0b7f484c675f50548d185f0df1f30a909f932dac',\n",
       "   'publishedAt': '2020-09-01T12:00:16Z',\n",
       "   'content': \"As an Uber passenger, you already have to verify that you've washed or sanitized your hands and that you're wearing a mask before getting into a ride. But the company will soon require users who show… [+1008 chars]\"},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Valentina Palladino',\n",
       "   'title': \"Segway's ES2 electric scooter is nearly 50 percent off at Amazon\",\n",
       "   'description': 'If you’re looking for a fun and convenient way to travel short distances, an electric scooter can do the trick. Most can be pretty expensive, but one of Segway’s scooters is deeply discounted right now. Amazon has the Segway Ninebot ES2 electric scooter for $…',\n",
       "   'url': 'https://www.engadget.com/segway-ninebot-es2-electric-scooter-sale-coupon-amazon-141044227.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-07%2F728aeaa0-cddb-11ea-93fc-ff1eb51e6c38&client=amp-blogside-v2&signature=2f6694ff6a48110ec8e9da891db56a60fe97ec29',\n",
       "   'publishedAt': '2020-09-04T14:10:44Z',\n",
       "   'content': 'The previous low for this scooter was $469, so this is an excellent deal. It’s unclear how long the additional $90 coupon will be available, but it remains a good deal even if you only get it for the… [+1352 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Chris Ip',\n",
       "   'title': \"What’s the tech industry's place in a racial justice movement?\",\n",
       "   'description': \"What connects Amazon's facial recognition software, the log flume ride at Disney World and a common ice cream truck jingle?This summer, they've all been drawn into what experts are calling the largest protest movement in American history. The ripple effects o…\",\n",
       "   'url': 'https://www.engadget.com/silicon-valley-technology-race-reckoning-163023023.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2Fdef71520-e22a-11ea-b9b9-b48a1ca05354&client=amp-blogside-v2&signature=30cfbae6e50642913d4b72e29eea33f0b2cd4d83',\n",
       "   'publishedAt': '2020-08-19T16:30:23Z',\n",
       "   'content': 'A blunt explanation for why technology corporations — consumer facing ones, at least — are taking an unusually bold stand on racism is simply that they are following the public.\\xa0\\r\\nPublic interest law… [+2781 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Valentina Palladino',\n",
       "   'title': 'Fitbit’s $329 Sense smartwatch tracks ECG and your body’s stress response',\n",
       "   'description': 'While Fitbit focused on fitness trackers earlier this year with the launch of the Charge 4, the fall is all about new smartwatches. The latest timepiece from the company is the $329 Fitbit Sense, an “advanced health” wearable that includes new hardware like a…',\n",
       "   'url': 'https://www.engadget.com/fitbit-sense-smartwatch-versa-3-inspire-2-price-specs-availability-130050204.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F7b865a90-e631-11ea-bded-80cc10c26115&client=amp-blogside-v2&signature=60bc584f33d7cc77d4ae90aafca0b2f128d4da07',\n",
       "   'publishedAt': '2020-08-25T13:01:32Z',\n",
       "   'content': 'This feeds into Fitbit’s renewed focus on helping users track and manage stress, which now goes beyond the guided breathing exercises already available on most of its wearables. The EDA sensor record… [+4146 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Billy Steele',\n",
       "   'title': \"Qualcomm's adaptive ANC adjusts to changes in earbud fit\",\n",
       "   'description': 'Active Noise Cancellation (ANC) has been a standard feature on true wireless earbuds for quite some time. Due to the nature of the earbud design, noise cancellation has to account for ambient noise differently than traditional over-ear headphones. Instead of …',\n",
       "   'url': 'https://www.engadget.com/qualcomm-adaptive-active-noise-cancellation-true-wireless-earbuds-073005979.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2Ffd9ce2d0-ed2d-11ea-bbf7-acfcaaba8072&client=amp-blogside-v2&signature=82b049b44e93a7263a38461a36e708b545e89145',\n",
       "   'publishedAt': '2020-09-03T07:30:05Z',\n",
       "   'content': 'Qualcomm says its adaptive noise cancellation system can also account for changes to fit during activities like running. And when the noise level of your environment gets louder or softer, it can inc… [+1892 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Chris Velazco',\n",
       "   'title': 'Facebook launches Campus to keep college kids connected (again)',\n",
       "   'description': \"When you see Mark Zuckerberg being grilled by Congress or listening to people discuss his company's role in presidential elections, it can be easy to forget Facebook's roots as a college-only social network. Now, with a new school year upon us, Facebook is em…\",\n",
       "   'url': 'https://www.engadget.com/facebook-campus-college-only-social-network-again-150534405.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2F717b9870-f375-11ea-a67f-a1edc596e968&client=amp-blogside-v2&signature=3f04f67cca19a2b203d991a236fd7dc235135618',\n",
       "   'publishedAt': '2020-09-10T15:05:34Z',\n",
       "   'content': \"When you see Mark Zuckerberg being grilled by Congress or listening to people discuss his company's role in presidential elections, it can be easy to forget Facebook's roots as a college-only social … [+2186 chars]\"},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Devindra Hardawar',\n",
       "   'title': \"How 'Coraline' studio Laiki uses Intel's AI to perfect stop motion films\",\n",
       "   'description': \"Laika, the stop motion animation studio behind films like Coraline and Kubo and the Two Strings, isn't afraid to embrace new technology. We chronicled how it used 3D printing to add a whole new level of detail to 2012 film Paranorman. Now, the studio has its …\",\n",
       "   'url': 'https://www.engadget.com/laika-intel-machine-learning-stop-motion-134526313.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F7171a041-ebc8-11ea-b9bc-248c0540db59&client=amp-blogside-v2&signature=18a0f50799cd24540a9cecc77b93ff7e7b85c3bc',\n",
       "   'publishedAt': '2020-09-01T13:45:26Z',\n",
       "   'content': 'At one point, the studio even considered leaving those artifacts in the films to add a bit of character to the scene. It could have been a way to remind audiences that everything they’re watching is … [+1276 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Jon Fingas',\n",
       "   'title': \"US considers blocking deals with China's largest chip maker\",\n",
       "   'description': 'The US’ trade bans on Chinese companies like Huawei and ZTE might have been just the beginning. The Defense Department has confirmed to the Wall Street Journal that agencies are discussing whether or not they’ll add China’s Semiconductor Manufacturing Interna…',\n",
       "   'url': 'https://www.engadget.com/us-may-blacklist-china-chip-maker-smic-192314617.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2Fd62f7f90-efa9-11ea-bfb7-e29aa598ae84&client=amp-blogside-v2&signature=027edd30b05e01709d1e9c82e903298b1095f947',\n",
       "   'publishedAt': '2020-09-05T19:23:14Z',\n",
       "   'content': 'SMIC rejected the alleged defense connection in a statement. It insisted that it offers chips and services “solely” for civilian uses, and that it had “no relationship with the Chinese military.” SOS… [+705 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Nicole Lee',\n",
       "   'title': \"Vue Lite smart glasses aren't that smart\",\n",
       "   'description': 'In 2016, Vue debuted its first pair of smart glasses on Kickstarter, where it raised over $2 million. But unlike AR glasses such as North’s Focals, the Vue Pro ($299) were regular frames with built-in speakers. It featured bone conduction technology, the abil…',\n",
       "   'url': 'https://www.engadget.com/vue-lite-smart-glasses-hands-on-150048078.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2Fa0b2cfe0-e665-11ea-a9bd-5770ab72188f&client=amp-blogside-v2&signature=c64476abb3319aee9950a3d9b905515fb9365a40',\n",
       "   'publishedAt': '2020-08-25T15:00:48Z',\n",
       "   'content': 'In a lot of ways, the Vue Lite is akin to Amazon’s Echo Frames (which haven’t officially launched yet) as well as the Bose Frames (albeit without the latter’s AR and gesture elements). But after tryi… [+6508 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Nicole Lee',\n",
       "   'title': 'Facebook Portal adds Zoom support and other work-from-home features',\n",
       "   'description': 'Facebook is introducing several new features to its line of Portal video chat devices today, most of which have a work-from-home bent. The most significant announcement: all Portal devices will now support the Zoom video conferencing platform.Seeing as Zoom h…',\n",
       "   'url': 'https://www.engadget.com/facebook-portal-zoom-workplace-140020249.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F0fc2e680-e225-11ea-bdf0-b1cd7f73b5cd&client=amp-blogside-v2&signature=90171193f214e20cad7dc13ac0aed962aa741f8c',\n",
       "   'publishedAt': '2020-08-19T14:00:38Z',\n",
       "   'content': 'According to Facebook, each app will have a consistent design language that will feel familiar to existing users of those systems. So the Zoom interface will be familiar to Zoom users and so forth. Y… [+2738 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Nicole Lee',\n",
       "   'title': \"Tile's new service will offer up to $1,000 if it can't find your stuff\",\n",
       "   'description': 'One of the defining features of Tile’s Bluetooth trackers is the ability to tap into a crowdsourced network to help you find your things. Any users’ Tile app, not just your own, can ping the whereabouts of your tracker, allowing you to locate your stuff even …',\n",
       "   'url': 'https://www.engadget.com/tile-premium-protect-150028951.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2Ff8c863d0-f271-11ea-b7fb-8bacbe24c5b6&client=amp-blogside-v2&signature=9b8124ba98d242a71d405481e6f4fc78c9a91d90',\n",
       "   'publishedAt': '2020-09-09T15:00:28Z',\n",
       "   'content': 'The Premium Protect service will cover not just Tile trackers but also Tile-enabled partner products like SkullCandy earbuds and the HP Elite Dragonfly laptop. The service warranty is provided in par… [+2598 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Devindra Hardawar',\n",
       "   'title': 'NVIDIA RTX 3080 review: A huge leap for 4K gaming with raytracing',\n",
       "   'description': 'NVIDIA spent the past two years selling the idea of real-time ray tracing. And I mean, really selling it. There was the slick Star Wars demo that showed where the technology could lead. There were partnerships with EA to bring it to games like Battlefield V. …',\n",
       "   'url': 'https://www.engadget.com/nvidia-rtx-3080-review-ray-tracing-130054340.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2F729754b5-f6c2-11ea-bd7d-3963b471ba98&client=amp-blogside-v2&signature=54afb6b9663e682b9485f476dda1c7a5f7fd16f5',\n",
       "   'publishedAt': '2020-09-16T13:00:54Z',\n",
       "   'content': 'The 3080 Founders Edition card we reviewed isn’t much bigger than the 2080 Ti. It has a sleek, almost office-professional aesthetic that’s a nice contrast to the gaudy third-party cards we’ll inevita… [+2650 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Daniel Cooper',\n",
       "   'title': 'Bluetooth update could turn wearables into COVID-19 trackers',\n",
       "   'description': 'Billions of people have smartphones, but not everyone has them, and they’re not the only smart devices folks have access to. Older people, and young kids, have valid reasons for not owning one, which excludes them from the phone-based contact-tracing systems …',\n",
       "   'url': 'https://www.engadget.com/covid-bluetooth-sig-ens-wearables-plan-120555994.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2Ff19d5160-e20e-11ea-9ffa-788fbcb320b6&client=amp-blogside-v2&signature=fa307e69772ed219512d23065be4a1aa4fd423dc',\n",
       "   'publishedAt': '2020-08-19T12:05:55Z',\n",
       "   'content': 'Billions of people have smartphones, but not everyone has them, and they’re not the only smart devices folks have access to. Older people, and young kids, have valid reasons for not owning one, which… [+933 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Igor Bonifacic',\n",
       "   'title': \"Here's everything Apple announced at its 'Time Flies' event\",\n",
       "   'description': 'Apple didn’t announce any new iPhones at its latest keynote but it still had plenty of new devices to share, including two new Watch models, and an iPad Air that features a new design. The company also detailed its new Apple One subscription bundles and Fitne…',\n",
       "   'url': 'https://www.engadget.com/apple-fall-2020-event-roundup-214437110.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2Ff50cf9f0-f789-11ea-bf37-10ab88ba48f9&client=amp-blogside-v2&signature=99975e4e044ccb08f51f255a17583e3351790da9',\n",
       "   'publishedAt': '2020-09-15T21:44:37Z',\n",
       "   'content': 'Other hardware upgrades include a new S6 chip that Apple says is more power-efficient and charges 20 percent faster. The Series 6’s always-on display is 2.5 times brighter than the one on its predece… [+4421 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Daniel Cooper',\n",
       "   'title': \"Huawei's latest MateBook X looks great, but good luck getting one\",\n",
       "   'description': 'It’s a shame that Huawei is the most controversial hardware company in technology. Its laptop products have been getting progressively better in the last few years, but so few people in the US will ever see them, let alone buy one. Today the company is updati…',\n",
       "   'url': 'https://www.engadget.com/huawei-matebook-x-2020-123047706.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2F3494f820-f2b2-11ea-bf4d-1914468a4e8e&client=amp-blogside-v2&signature=3647bf4627511c62839b25b7eb896d6d1838cca4',\n",
       "   'publishedAt': '2020-09-10T12:30:47Z',\n",
       "   'content': 'Modeled after Apple’s suffix-less MacBook (RIP), the MateBook X is a stripped-down machine designed to travel. It’s the third-generation of this machine that the company has made, and each one has pr… [+3074 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Daniel Cooper',\n",
       "   'title': 'Amazon Halo is a subscription fitness wearable and platform',\n",
       "   'description': 'Amazon is no longer content to allow mainstream wearable technology companies to dominate the fitness space. Today, the mega-retailer is launching a subscription fitness product dubbed Amazon Halo that’s designed to encourage users to improve their health and…',\n",
       "   'url': 'https://www.engadget.com/amazon-halo-fitness-platform-134146361.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F8a10ddc0-e86a-11ea-96de-5e63d8ccb037&client=amp-blogside-v2&signature=c8931d3fa9955156bc529b2260ed8b861d3249a6',\n",
       "   'publishedAt': '2020-08-27T13:41:46Z',\n",
       "   'content': 'According to Amazon, how you speak is a useful indicator of your wellbeing, both emotionally and physically. Consequently, the Halo Band will monitor your tone to determine if you’re feeling positive… [+2472 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Nick Summers',\n",
       "   'title': \"How the UK's algorithm-based grading fell apart\",\n",
       "   'description': 'The coronavirus pandemic has made it impossible for UK students to take any traditional exams. In England, these include GCSEs, the qualifications that mark the end of compulsory school education, AS and A-levels, the latter of which are required for most uni…',\n",
       "   'url': 'https://www.engadget.com/uk-algorithm-a-levels-gcse-results-143503870.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2F928ef4e0-e096-11ea-aebf-e4caa85e8374&client=amp-blogside-v2&signature=d0dccb66069f5d85e3aaf6fd72fb1bc578c5560e',\n",
       "   'publishedAt': '2020-08-18T14:45:42Z',\n",
       "   'content': 'The backlash to Ofqual’s algorithm was only matched by its complexity. The non-ministerial government department started with a “historical grade distribution” — the percentage of students who achiev… [+10630 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'James Trew',\n",
       "   'title': 'WildLeaks: The whistleblowing site for planet Earth',\n",
       "   'description': '“Really, fuck fuck fuck fuck, fuck” Andrea Crosta tells the driver of the car he just got in. Crosta is the founder of WildLeaks, a whistleblowing site for environmental crime, and he’s just aborted an undercover operation with a prominent ivory trader in Chi…',\n",
       "   'url': 'https://www.engadget.com/wildleaks-earth-league-international-conservation-whistleblower-133053631.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-09%2F29ca8250-f1ba-11ea-a62f-971ff835448b&client=amp-blogside-v2&signature=183207d89d2630c85a616565f130ed3ad2cc6d3c',\n",
       "   'publishedAt': '2020-09-08T13:30:53Z',\n",
       "   'content': 'A shaky video is posted to WildLeaks’ blog. At first, it just looks like any other (badly shot) home video of a safari trip, until you see the barrel of the gun. The person holding it is standing in … [+7972 chars]'},\n",
       "  {'source': {'id': 'engadget', 'name': 'Engadget'},\n",
       "   'author': 'Chris Velazco',\n",
       "   'title': \"What you need to know about Apple's iPhone 12 and 12 Pro\",\n",
       "   'description': \"Fall is nearly upon us, which means Apple is gearing up to unveil its newest iPhones. 2020 being what it is, however, it's far from business as usual over in Cupertino. Apple has already confirmed it will ship its new smartphones later than usual this year an…\",\n",
       "   'url': 'https://www.engadget.com/iphone-12-iphone-12-pro-what-you-need-to-know-price-5g-release-date-2020-184302416.html',\n",
       "   'urlToImage': 'https://o.aolcdn.com/images/dims?resize=1200%2C630&crop=1200%2C630%2C0%2C0&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2020-08%2Fcef3bbc0-e940-11ea-b77e-777ef3259f53&client=amp-blogside-v2&signature=6ac17effc7b5aaa24f79276c2f32f7ae73537ab6',\n",
       "   'publishedAt': '2020-08-28T18:43:02Z',\n",
       "   'content': \"While we wait for the full, official details to emerge, let's take a look at what we already know about the most unusual iPhone launch in Apple's history.\\r\\nThis story was first published on August 28… [+2403 chars]\"},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Gregory Barber, Will Knight',\n",
       "   'title': 'Why Contact-Tracing Apps Haven’t Slowed Covid-19 in the US',\n",
       "   'description': 'Lack of coordination, test shortages, and mistrust of technology have hobbled what looked like a promising innovation.',\n",
       "   'url': 'https://www.wired.com/story/why-contact-tracing-apps-not-slowed-covid-us/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f4ee4350cf9e337f0b184ab/191:100/w_1280,c_limit/business_tracing_1263517240.jpg',\n",
       "   'publishedAt': '2020-09-08T11:00:00Z',\n",
       "   'content': 'States such as Massachusetts and New Jersey have left their app plans in limbo or abandoned them to focus on the bigger picture. States are struggling to stand up a public health response in general,… [+4304 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Kevin Xu, Jordan Schneider',\n",
       "   'title': 'The Future of American Industry Depends on Open Source Tech',\n",
       "   'description': 'Instead of launching into a costly trade war with China, we need to fully embrace the fastest, safest, and most democratic way of advancing technology.',\n",
       "   'url': 'https://www.wired.com/story/opinon-the-future-of-american-industry-depends-on-open-source-tech/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f451500d741517d4f090371/191:100/w_1280,c_limit/open-source.png',\n",
       "   'publishedAt': '2020-08-26T14:02:29Z',\n",
       "   'content': 'When you stream the latest Netflix show, you fire up servers on Amazon Web Services, most of which run on Linux. When a F-16 fighter takes off, three Kubernetes clusters run to keep the jets software… [+5180 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Megan Molteni',\n",
       "   'title': 'Human Embryo Gene Editing Gets a Road Map—Not a Green Light',\n",
       "   'description': 'After the 2018 “Crispr\\xa0baby” scandal, a global commission assessed the technology and set strict criteria for moving it toward clinical trials.',\n",
       "   'url': 'https://www.wired.com/story/human-embryo-gene-editing-gets-a-road-map-not-a-green-light/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f5039bf0cf9e337f0b184b4/191:100/w_1280,c_limit/image%2520(14).png',\n",
       "   'publishedAt': '2020-09-03T16:05:50Z',\n",
       "   'content': 'For that reason, the authors of the report lay out exactly how many and what kind of off-target effects might be acceptable. They put that threshold at no more than the average rate of new mutations … [+4223 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Casey Fiesler, Natalie Garrett',\n",
       "   'title': 'Ethical Tech Starts With Addressing Ethical Debt',\n",
       "   'description': 'The rise of “zoombombing” is just the latest example of why developers need to plan for harmful misuses as much as potential costly bugs.',\n",
       "   'url': 'https://www.wired.com/story/opinion-ethical-tech-starts-with-addressing-ethical-debt/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f6150c119124f1a90537185/191:100/w_1280,c_limit/OpEd-Debt-528127540.jpg',\n",
       "   'publishedAt': '2020-09-16T13:00:00Z',\n",
       "   'content': 'Awful people will use technology to do awful things. This is a universal truth that applies to almost any technology that facilitates communication and interaction, no matter how well intentioned it … [+4893 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Tom Simonite',\n",
       "   'title': 'Google Offers to Help Others With the Tricky Ethics of AI',\n",
       "   'description': 'After learning its own ethics lessons the hard way, the tech giant will offer services like spotting racial bias or developing guidelines around AI projects.',\n",
       "   'url': 'https://www.wired.com/story/google-help-others-tricky-ethics-ai/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f483e71bb023d54b55e4e09/191:100/w_1280,c_limit/business_google_20.93146987.jpg',\n",
       "   'publishedAt': '2020-08-28T13:00:00Z',\n",
       "   'content': 'Companies pay cloud computing providers like Amazon, Microsoft, and Google big money to avoid operating their own digital infrastructure. Googles cloud division will soon invite customers to outsourc… [+3877 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Lauren Goode',\n",
       "   'title': 'How Animal Activists Exposed the Brutality of Factory Farming',\n",
       "   'description': \"In the second part of a Get WIRED series, we go inside one man's mission to bring to light one of factory farming's most notorious practices.\",\n",
       "   'url': 'https://www.wired.com/story/get-wired-podcast-6-ventilation-shutdown-factory-farms/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f403a8f379d27ec95b71332/191:100/w_1280,c_limit/Science_GETWIRED_596098072.jpg',\n",
       "   'publishedAt': '2020-08-24T11:00:00Z',\n",
       "   'content': 'Last weeks episode of the Get WIRED podcast introduced listeners to Direct Action Everywhereone of the most radical animal-rights organizations aroundand the groups leader, Wayne Hsiung. We learned h… [+1437 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Timothy B. Lee, Ars Technica',\n",
       "   'title': 'Lidar Is Finally Becoming a Real Business',\n",
       "   'description': 'The success of lidar companies was unclear until this summer, when three leading makers offered glimpses of their finances.',\n",
       "   'url': 'https://www.wired.com/story/lidar-is-finally-becoming-a-real-business/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f5aa5315fc9e3620ef2e8ba/191:100/w_1280,c_limit/business_lidar_1164317768.jpg',\n",
       "   'publishedAt': '2020-09-11T12:00:00Z',\n",
       "   'content': \"For years, thelidar business has had a lot of hype but not a lot of hard numbers. Dozens of lidar startups have touted their impressive technology, but until recently it wasn't clear who, if anyone, … [+4197 chars]\"},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Arielle Pardes',\n",
       "   'title': 'Hate Social Media? You’ll Love This Documentary',\n",
       "   'description': 'The Social Dilemma argues that humanity’s greatest existential threat is not climate change, but Facebook.',\n",
       "   'url': 'https://www.wired.com/story/social-dilemma-netflix-documentary/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f57b6d02e2f5001616e3172/191:100/w_1280,c_limit/Culture_SocialDelimma_Ben-w-Overlays_SMALL_PhotoCredit-TheSocialDilemma.jpg',\n",
       "   'publishedAt': '2020-09-09T13:00:00Z',\n",
       "   'content': 'As a documentary filmmaker, Jeff Orlowski seems preoccupied with the destruction of the world. His 2012 film Chasing Ice captured the devastating effects of climate change on melting glaciers. In 201… [+3537 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Lauren Goode',\n",
       "   'title': 'School in the Age of Covid: A Series of Impossible Decisions',\n",
       "   'description': 'Pandemic pods? Blended learning? What about the digital divide? On this week’s Get WIRED podcast, listeners share their “back” to school struggles.',\n",
       "   'url': 'https://www.wired.com/story/get-wired-podcast-7-covid-school/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f515aa63cf60fd0f7b47703/191:100/w_1280,c_limit/Get-Wired-Remote-Learning-1226846898.jpg',\n",
       "   'publishedAt': '2020-09-08T11:00:00Z',\n",
       "   'content': 'The coronavirus pandemic has forced people to perform complicated mental gymnastics and assess the risk of nearly every interaction they have. And now that fall is here, parents, teachers, and kids i… [+1561 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Brennan Kilbane, Allure',\n",
       "   'title': 'The Bathroom of Tomorrow: Shower & Bath Tech of 2020',\n",
       "   'description': 'Bathrooms are getting smarter, smelling nicer, making you sweat, cooling you down, and, of course, still graciously accepting your waste.',\n",
       "   'url': 'https://www.wired.com/story/a-glimpse-at-the-shiny-ritzy-bathroom-of-tomorrow/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f44049037e06d513ea90723/191:100/w_1280,c_limit/future-of-beauty-bathroom.jpg',\n",
       "   'publishedAt': '2020-08-27T11:00:00Z',\n",
       "   'content': 'Oh, bathroomsa place in the house where so much happens. You shower, shave, perform your skin-care routine, and so much more. As technology gets smarter, bathrooms do too. You might have thought that… [+1412 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Ricki Harris',\n",
       "   'title': 'How the Pandemic Reshaped Election Campaigns—Maybe Forever',\n",
       "   'description': 'The digital infrastructures have been under construction for years. But the pandemic has forced candidates to embrace them and to get creative with how they use them.',\n",
       "   'url': 'https://www.wired.com/story/pandemic-reshaped-2020-election-campaigns-democrats-republicans/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f3f07cbed34684a71e81e3e/191:100/w_1280,c_limit/GettyImages-1228115255.jpg',\n",
       "   'publishedAt': '2020-08-21T14:12:03Z',\n",
       "   'content': 'Not long after the coronavirus shut down life in most parts of the country, Sarah Crawfords weekend runs took an unusual turn, as mapped out by her Garmin watch. On April 11, her trail spelled the wo… [+3935 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Bradley Hope, Justin Scheck',\n",
       "   'title': \"A Saudi Prince's Attempt to Silence Critics on Twitter\",\n",
       "   'description': \"An ongoing investigation reveals how Mohammed bin Salman's team allegedly infiltrated the platform—and got away with it.\",\n",
       "   'url': 'https://www.wired.com/story/mohammed-bin-salman-twitter-investigation/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f4d59680cf9e337f0b1849c/191:100/w_1280,c_limit/backchannel-excerpt-blood-and-oil.jpg',\n",
       "   'publishedAt': '2020-09-01T12:00:00Z',\n",
       "   'content': 'Abouammo complied, using his access to internal systems to find Mujtahidds email address and phone number. It was a potentially reckless move by the Twitter employee, possibly unmasking critics of a … [+3565 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Arielle Pardes',\n",
       "   'title': 'Elon Musk Is About to Show Off His Neuralink Brain Implant',\n",
       "   'description': 'Musk tweeted that his “V2” update will blow our minds. But how close is he to putting computer chips in them?',\n",
       "   'url': 'https://www.wired.com/story/elon-musk-neuralink-brain-implant-v2-demo/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f47ef05c36fa4bcfd9eca03/191:100/w_1280,c_limit/Security_ElonMusk-1206292074.jpg',\n",
       "   'publishedAt': '2020-08-28T11:00:00Z',\n",
       "   'content': 'In the mind of Elon Musk, the worlds thorniest problems become shockingly, wonderfully simple. Traffic in LA got you down? Here, take a ride on this underground super-luge. Carbon emissions are stink… [+3705 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Louise Matsakis',\n",
       "   'title': 'How WeChat Censored the Coronavirus Pandemic',\n",
       "   'description': 'In China, the messaging platform blocked thousands of keywords related to the virus, a new report reveals.',\n",
       "   'url': 'https://www.wired.com/story/wechat-chinese-internet-censorship-coronavirus/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f46ababa73ba18581f3aac0/191:100/w_1280,c_limit/Security_China_1228043332.jpg',\n",
       "   'publishedAt': '2020-08-27T21:30:00Z',\n",
       "   'content': 'When the novelcoronavirus was first discovered in China last winter, the country responded aggressively, placing tens of millions of people into strict lockdown. As Covid-19 spread from Wuhan to the … [+3647 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Gilad Edelman',\n",
       "   'title': 'Should Google’s Ad Market Be Regulated Like the Stock Market?',\n",
       "   'description': 'A leading antitrust scholar says yes. Congress may be listening.',\n",
       "   'url': 'https://www.wired.com/story/google-ad-market-regulated-like-stock-market/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f4719509626ac1b1b3e51fa/191:100/w_1280,c_limit/security-google-markets-ads%2520588310690.jpg',\n",
       "   'publishedAt': '2020-08-31T11:00:00Z',\n",
       "   'content': 'The days of suit-clad men shouting out orders on the bustling floors of stock exchanges are mostly gone, replaced by windowless rooms full of servers, but the stock market is still a busy place. On t… [+4592 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Will Knight',\n",
       "   'title': 'Anduril’s New Drone Offers to Inject More AI Into Warfare',\n",
       "   'description': 'A swarm of Ghost 4s, controlled by a single person on the ground, can perform reconnaissance missions like searching for enemy weapons or soldiers.',\n",
       "   'url': 'https://www.wired.com/story/anduril-new-drone-inject-ai-warfare/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f59679f7d996391a1b72bde/191:100/w_1280,c_limit/business_ghost4_studio_01.jpg',\n",
       "   'publishedAt': '2020-09-10T12:00:00Z',\n",
       "   'content': 'This spring, a team of small drones, each resembling a small, sensor-laden helicopter, scoured a lush stretch of wilderness near Irvine, California. They spent hours circling the sky, seeking, among … [+3950 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Victoria Turk, WIRED UK',\n",
       "   'title': 'In a Touch-Free World, the QR Code Is Having Its Moment',\n",
       "   'description': 'Once dismissed as a marketing gimmick, the black and white patterns are proving their worth during the coronavirus pandemic.',\n",
       "   'url': 'https://www.wired.com/story/in-a-touch-free-world-the-qr-code-is-having-its-moment/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f3b17cb34cbc2004e146eb6/191:100/w_1280,c_limit/Gear-QR-Code-1227671909.jpg',\n",
       "   'publishedAt': '2020-08-18T13:00:00Z',\n",
       "   'content': 'Venture outside and youll soon see them. Printed on posters and signs, pasted on pub walls and hotel lobbies, taped to picnic tables in beer gardens: QR codes. \\r\\nThis story originally appeared on WIR… [+3881 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Gregory Barber',\n",
       "   'title': 'This Plane Flies Itself. We Went for a Ride',\n",
       "   'description': \"Xwing is testing a Cessna that's controlled from the ground, not the cockpit. Its goal is to automate as much as possible, while keeping a human in the loop.\",\n",
       "   'url': 'https://www.wired.com/story/autonomous-plane-xwing/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f3dd5e4d054108dce8a4940/191:100/w_1280,c_limit/business_xwing_4.jpg',\n",
       "   'publishedAt': '2020-08-20T16:00:00Z',\n",
       "   'content': 'The challenge is there is no track record of how safe these systems are, says Cathy Cahill, director of the University of Alaskas Center for Unmanned Aircraft Systems Integration. The FAAs rules and … [+4270 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Jaime Stathis',\n",
       "   'title': \"There's No Better Time to Be an Amateur Radio Geek\",\n",
       "   'description': 'Once considered a nerdy basement hobby, lo-fi transmissions from ordinary folks save lives during wildfires, hurricanes, and other climate disasters.',\n",
       "   'url': 'https://www.wired.com/story/amateur-radio-disaster-preparedness/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f61492b8595a16063bbc4aa/191:100/w_1280,c_limit/Gear-Amateur-Radio-Geek-77136522.jpg',\n",
       "   'publishedAt': '2020-09-16T11:00:00Z',\n",
       "   'content': 'Haggerty-Sollars and her neighbor, Judy, were never far from each other, but first Judy lost her cellphone signal and then Haggerty-Sollars lost hers when she drove through flamesdespite being in a r… [+4016 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Sandra Upson',\n",
       "   'title': 'How an Epic Series of Tech Errors Hobbled Miami’s Schools',\n",
       "   'description': 'It started with the district hiring a little-known virtual charter school company, which led to balky connections and an even more troublesome curriculum.',\n",
       "   'url': 'https://www.wired.com/story/epic-tech-errors-hobbled-miamis-schools/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f600ea8470e71528f4f8835/191:100/w_1280,c_limit/business_miami_1228339859.jpg',\n",
       "   'publishedAt': '2020-09-16T11:00:00Z',\n",
       "   'content': 'The teachers received demo logins to try out the platform, but they didnt work, and even the trainers struggled to access it, West says. From 8 am until 3:30 pm each day, teachers took notes without … [+4113 chars]'},\n",
       "  {'source': {'id': 'wired', 'name': 'Wired'},\n",
       "   'author': 'Julian Chokkattu',\n",
       "   'title': 'Samsung Galaxy Note 20 Ultra Review: Ultimate Android',\n",
       "   'description': \"This phone crams in all the extras you'd want. But the price is steep.\",\n",
       "   'url': 'https://www.wired.com/review/samsung-galaxy-note-20-ultra/',\n",
       "   'urlToImage': 'https://media.wired.com/photos/5f3b090391d87e6680b809ab/191:100/w_1280,c_limit/Gear-Samsung-Galaxy-Note-20-Ultra-SOURCE-Samsung.jpg',\n",
       "   'publishedAt': '2020-08-18T14:00:00Z',\n",
       "   'content': \"Unlike with most phones that come across my desk, it takes me a minute (or a day) to fully remember how to put Samsung's Galaxy Note phones to full use. These giant, feature-rich phones make me feel … [+10972 chars]\"}]}"
      ]
     },
     "execution_count": 137,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "\n",
    "# API_key\n",
    "api_k='Put the api key here'\n",
    "\n",
    "\n",
    "url = ('http://newsapi.org/v2/everything?'\n",
    "       'q=Technology&'\n",
    "       'from=2020-08-18&'\n",
    "       'sortBy=popularity&'\n",
    "       'pageSize=60&'\n",
    "       'apiKey='+api_k)\n",
    "\n",
    "response = requests.get(url)\n",
    "\n",
    "\n",
    "response.json()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "`------------------`\n",
    "\n",
    "`Category`: this is what you would like to get the headlines for.\n",
    "+ Options: here I am using everything, which is an endpoint. This will be good if we want to do some news analysis later.\n",
    "\n",
    "**`'http://newsapi.org/v2/everything?'`**\n",
    "\n",
    "**`q`**: is used as a keyword or phrase lookup\n",
    "\n",
    "**`'from=2020-08-18&'`** the dates for lookup are limited for the free version but good enough for practice anyway\n",
    "\n",
    "`'sortBy=popularity&'`: self-explanatory I would assume"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 204,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>source</th>\n",
       "      <th>author</th>\n",
       "      <th>title</th>\n",
       "      <th>description</th>\n",
       "      <th>url</th>\n",
       "      <th>urlToImage</th>\n",
       "      <th>publishedAt</th>\n",
       "      <th>content</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>{'id': None, 'name': 'Lifehacker.com'}</td>\n",
       "      <td>Joel Cunningham</td>\n",
       "      <td>How to Turn Off Alexa's Creepy 'Whisper Mode'</td>\n",
       "      <td>I love my smart speaker—as much as one can eve...</td>\n",
       "      <td>https://lifehacker.com/how-to-turn-off-alexas-...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-08-31T20:30:00Z</td>\n",
       "      <td>I love my smart speakeras much as one can ever...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>{'id': None, 'name': 'Lifehacker.com'}</td>\n",
       "      <td>Elizabeth Yuko</td>\n",
       "      <td>How to Avoid Getting a Last-Minute Booking Blo...</td>\n",
       "      <td>Airbnb is cracking down on parties. They are n...</td>\n",
       "      <td>https://lifehacker.com/how-to-avoid-getting-a-...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-09-06T14:00:00Z</td>\n",
       "      <td>Airbnb is cracking down on parties. They are n...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>{'id': None, 'name': 'Lifehacker.com'}</td>\n",
       "      <td>Beth Skwarecki on Vitals, shared by Beth Skwar...</td>\n",
       "      <td>Tackle a Hill Head-On</td>\n",
       "      <td>Did you find a new trail to run or hike for la...</td>\n",
       "      <td>https://vitals.lifehacker.com/tackle-a-hill-he...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-09-11T16:30:00Z</td>\n",
       "      <td>Did you find a new trail to run or hike for la...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>{'id': None, 'name': 'Lifehacker.com'}</td>\n",
       "      <td>David Murphy</td>\n",
       "      <td>How Do I Share a Hard Drive on My Home Network?</td>\n",
       "      <td>I will never fault someone for asking a tech q...</td>\n",
       "      <td>https://lifehacker.com/how-do-i-share-a-hard-d...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-08-21T13:00:00Z</td>\n",
       "      <td>I will never fault someone for asking a tech q...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>{'id': 'engadget', 'name': 'Engadget'}</td>\n",
       "      <td>Richard Lawler</td>\n",
       "      <td>Watch Elon Musk's Neuralink reveal live at 6PM ET</td>\n",
       "      <td>Last year Neuralink launched with lofty promis...</td>\n",
       "      <td>https://www.engadget.com/neuralink-bmi-livestr...</td>\n",
       "      <td>https://o.aolcdn.com/images/dims?resize=1200%2...</td>\n",
       "      <td>2020-08-28T21:48:56Z</td>\n",
       "      <td>Last year Neuralink launched with lofty promis...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                   source  \\\n",
       "0  {'id': None, 'name': 'Lifehacker.com'}   \n",
       "1  {'id': None, 'name': 'Lifehacker.com'}   \n",
       "2  {'id': None, 'name': 'Lifehacker.com'}   \n",
       "3  {'id': None, 'name': 'Lifehacker.com'}   \n",
       "4  {'id': 'engadget', 'name': 'Engadget'}   \n",
       "\n",
       "                                              author  \\\n",
       "0                                    Joel Cunningham   \n",
       "1                                     Elizabeth Yuko   \n",
       "2  Beth Skwarecki on Vitals, shared by Beth Skwar...   \n",
       "3                                       David Murphy   \n",
       "4                                     Richard Lawler   \n",
       "\n",
       "                                               title  \\\n",
       "0      How to Turn Off Alexa's Creepy 'Whisper Mode'   \n",
       "1  How to Avoid Getting a Last-Minute Booking Blo...   \n",
       "2                              Tackle a Hill Head-On   \n",
       "3    How Do I Share a Hard Drive on My Home Network?   \n",
       "4  Watch Elon Musk's Neuralink reveal live at 6PM ET   \n",
       "\n",
       "                                         description  \\\n",
       "0  I love my smart speaker—as much as one can eve...   \n",
       "1  Airbnb is cracking down on parties. They are n...   \n",
       "2  Did you find a new trail to run or hike for la...   \n",
       "3  I will never fault someone for asking a tech q...   \n",
       "4  Last year Neuralink launched with lofty promis...   \n",
       "\n",
       "                                                 url  \\\n",
       "0  https://lifehacker.com/how-to-turn-off-alexas-...   \n",
       "1  https://lifehacker.com/how-to-avoid-getting-a-...   \n",
       "2  https://vitals.lifehacker.com/tackle-a-hill-he...   \n",
       "3  https://lifehacker.com/how-do-i-share-a-hard-d...   \n",
       "4  https://www.engadget.com/neuralink-bmi-livestr...   \n",
       "\n",
       "                                          urlToImage           publishedAt  \\\n",
       "0  https://i.kinja-img.com/gawker-media/image/upl...  2020-08-31T20:30:00Z   \n",
       "1  https://i.kinja-img.com/gawker-media/image/upl...  2020-09-06T14:00:00Z   \n",
       "2  https://i.kinja-img.com/gawker-media/image/upl...  2020-09-11T16:30:00Z   \n",
       "3  https://i.kinja-img.com/gawker-media/image/upl...  2020-08-21T13:00:00Z   \n",
       "4  https://o.aolcdn.com/images/dims?resize=1200%2...  2020-08-28T21:48:56Z   \n",
       "\n",
       "                                             content  \n",
       "0  I love my smart speakeras much as one can ever...  \n",
       "1  Airbnb is cracking down on parties. They are n...  \n",
       "2  Did you find a new trail to run or hike for la...  \n",
       "3  I will never fault someone for asking a tech q...  \n",
       "4  Last year Neuralink launched with lofty promis...  "
      ]
     },
     "execution_count": 204,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "for i in response.json():\n",
    "\n",
    "    p=response.json()[i]\n",
    "    \n",
    "pd.DataFrame(p).head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "+ `We can read in the data but there is some formatting we need to take care of`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 205,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>source</th>\n",
       "      <th>author</th>\n",
       "      <th>title</th>\n",
       "      <th>description</th>\n",
       "      <th>url</th>\n",
       "      <th>urlToImage</th>\n",
       "      <th>publishedAt</th>\n",
       "      <th>content</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>Joel Cunningham</td>\n",
       "      <td>How to Turn Off Alexa's Creepy 'Whisper Mode'</td>\n",
       "      <td>I love my smart speaker—as much as one can eve...</td>\n",
       "      <td>https://lifehacker.com/how-to-turn-off-alexas-...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-08-31T20:30:00Z</td>\n",
       "      <td>I love my smart speakeras much as one can ever...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>Elizabeth Yuko</td>\n",
       "      <td>How to Avoid Getting a Last-Minute Booking Blo...</td>\n",
       "      <td>Airbnb is cracking down on parties. They are n...</td>\n",
       "      <td>https://lifehacker.com/how-to-avoid-getting-a-...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-09-06T14:00:00Z</td>\n",
       "      <td>Airbnb is cracking down on parties. They are n...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>Beth Skwarecki on Vitals, shared by Beth Skwar...</td>\n",
       "      <td>Tackle a Hill Head-On</td>\n",
       "      <td>Did you find a new trail to run or hike for la...</td>\n",
       "      <td>https://vitals.lifehacker.com/tackle-a-hill-he...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-09-11T16:30:00Z</td>\n",
       "      <td>Did you find a new trail to run or hike for la...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>David Murphy</td>\n",
       "      <td>How Do I Share a Hard Drive on My Home Network?</td>\n",
       "      <td>I will never fault someone for asking a tech q...</td>\n",
       "      <td>https://lifehacker.com/how-do-i-share-a-hard-d...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-08-21T13:00:00Z</td>\n",
       "      <td>I will never fault someone for asking a tech q...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Engadget</td>\n",
       "      <td>Richard Lawler</td>\n",
       "      <td>Watch Elon Musk's Neuralink reveal live at 6PM ET</td>\n",
       "      <td>Last year Neuralink launched with lofty promis...</td>\n",
       "      <td>https://www.engadget.com/neuralink-bmi-livestr...</td>\n",
       "      <td>https://o.aolcdn.com/images/dims?resize=1200%2...</td>\n",
       "      <td>2020-08-28T21:48:56Z</td>\n",
       "      <td>Last year Neuralink launched with lofty promis...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "           source                                             author  \\\n",
       "0  Lifehacker.com                                    Joel Cunningham   \n",
       "1  Lifehacker.com                                     Elizabeth Yuko   \n",
       "2  Lifehacker.com  Beth Skwarecki on Vitals, shared by Beth Skwar...   \n",
       "3  Lifehacker.com                                       David Murphy   \n",
       "4        Engadget                                     Richard Lawler   \n",
       "\n",
       "                                               title  \\\n",
       "0      How to Turn Off Alexa's Creepy 'Whisper Mode'   \n",
       "1  How to Avoid Getting a Last-Minute Booking Blo...   \n",
       "2                              Tackle a Hill Head-On   \n",
       "3    How Do I Share a Hard Drive on My Home Network?   \n",
       "4  Watch Elon Musk's Neuralink reveal live at 6PM ET   \n",
       "\n",
       "                                         description  \\\n",
       "0  I love my smart speaker—as much as one can eve...   \n",
       "1  Airbnb is cracking down on parties. They are n...   \n",
       "2  Did you find a new trail to run or hike for la...   \n",
       "3  I will never fault someone for asking a tech q...   \n",
       "4  Last year Neuralink launched with lofty promis...   \n",
       "\n",
       "                                                 url  \\\n",
       "0  https://lifehacker.com/how-to-turn-off-alexas-...   \n",
       "1  https://lifehacker.com/how-to-avoid-getting-a-...   \n",
       "2  https://vitals.lifehacker.com/tackle-a-hill-he...   \n",
       "3  https://lifehacker.com/how-do-i-share-a-hard-d...   \n",
       "4  https://www.engadget.com/neuralink-bmi-livestr...   \n",
       "\n",
       "                                          urlToImage           publishedAt  \\\n",
       "0  https://i.kinja-img.com/gawker-media/image/upl...  2020-08-31T20:30:00Z   \n",
       "1  https://i.kinja-img.com/gawker-media/image/upl...  2020-09-06T14:00:00Z   \n",
       "2  https://i.kinja-img.com/gawker-media/image/upl...  2020-09-11T16:30:00Z   \n",
       "3  https://i.kinja-img.com/gawker-media/image/upl...  2020-08-21T13:00:00Z   \n",
       "4  https://o.aolcdn.com/images/dims?resize=1200%2...  2020-08-28T21:48:56Z   \n",
       "\n",
       "                                             content  \n",
       "0  I love my smart speakeras much as one can ever...  \n",
       "1  Airbnb is cracking down on parties. They are n...  \n",
       "2  Did you find a new trail to run or hike for la...  \n",
       "3  I will never fault someone for asking a tech q...  \n",
       "4  Last year Neuralink launched with lofty promis...  "
      ]
     },
     "execution_count": 205,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "\n",
    "g=defaultdict(list)\n",
    "\n",
    "for i in p:\n",
    "    for j in i.items():\n",
    "        # values of source are dictionaries: we want only the 'names'\n",
    "        if j[0]=='source':\n",
    "            g[j[0]].append(j[1]['name'])\n",
    "        \n",
    "        # take everything else \n",
    "        else:\n",
    "            g[j[0]].append(j[1])\n",
    "\n",
    "pd.DataFrame(g).head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# We can take `PublishedAt` and convert  directly from the DF\n",
    " \n",
    " But, it is also in a strange format..."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 195,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "pandas._libs.tslibs.timestamps.Timestamp"
      ]
     },
     "execution_count": 195,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "type(pd.DataFrame(g)['publishedAt'][0]) # evaluate the type and it is a str NOT date\n",
    "\n",
    "oo=[]\n",
    "for i in pd.DataFrame(g)['publishedAt']:\n",
    "    # pay attention to the format\n",
    "    oo.append(datetime.datetime.strptime(i, '%Y-%m-%dT%H:%M:%S'+'Z'))\n",
    "\n",
    "# verify that the columns entries are converted\n",
    "type(pd.DataFrame(oo)[0][0])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 206,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>source</th>\n",
       "      <th>author</th>\n",
       "      <th>title</th>\n",
       "      <th>description</th>\n",
       "      <th>url</th>\n",
       "      <th>urlToImage</th>\n",
       "      <th>publishedAt</th>\n",
       "      <th>content</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>Joel Cunningham</td>\n",
       "      <td>How to Turn Off Alexa's Creepy 'Whisper Mode'</td>\n",
       "      <td>I love my smart speaker—as much as one can eve...</td>\n",
       "      <td>https://lifehacker.com/how-to-turn-off-alexas-...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-08-31 20:30:00</td>\n",
       "      <td>I love my smart speakeras much as one can ever...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>Elizabeth Yuko</td>\n",
       "      <td>How to Avoid Getting a Last-Minute Booking Blo...</td>\n",
       "      <td>Airbnb is cracking down on parties. They are n...</td>\n",
       "      <td>https://lifehacker.com/how-to-avoid-getting-a-...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-09-06 14:00:00</td>\n",
       "      <td>Airbnb is cracking down on parties. They are n...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>Beth Skwarecki on Vitals, shared by Beth Skwar...</td>\n",
       "      <td>Tackle a Hill Head-On</td>\n",
       "      <td>Did you find a new trail to run or hike for la...</td>\n",
       "      <td>https://vitals.lifehacker.com/tackle-a-hill-he...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-09-11 16:30:00</td>\n",
       "      <td>Did you find a new trail to run or hike for la...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>David Murphy</td>\n",
       "      <td>How Do I Share a Hard Drive on My Home Network?</td>\n",
       "      <td>I will never fault someone for asking a tech q...</td>\n",
       "      <td>https://lifehacker.com/how-do-i-share-a-hard-d...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-08-21 13:00:00</td>\n",
       "      <td>I will never fault someone for asking a tech q...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Engadget</td>\n",
       "      <td>Richard Lawler</td>\n",
       "      <td>Watch Elon Musk's Neuralink reveal live at 6PM ET</td>\n",
       "      <td>Last year Neuralink launched with lofty promis...</td>\n",
       "      <td>https://www.engadget.com/neuralink-bmi-livestr...</td>\n",
       "      <td>https://o.aolcdn.com/images/dims?resize=1200%2...</td>\n",
       "      <td>2020-08-28 21:48:56</td>\n",
       "      <td>Last year Neuralink launched with lofty promis...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "           source                                             author  \\\n",
       "0  Lifehacker.com                                    Joel Cunningham   \n",
       "1  Lifehacker.com                                     Elizabeth Yuko   \n",
       "2  Lifehacker.com  Beth Skwarecki on Vitals, shared by Beth Skwar...   \n",
       "3  Lifehacker.com                                       David Murphy   \n",
       "4        Engadget                                     Richard Lawler   \n",
       "\n",
       "                                               title  \\\n",
       "0      How to Turn Off Alexa's Creepy 'Whisper Mode'   \n",
       "1  How to Avoid Getting a Last-Minute Booking Blo...   \n",
       "2                              Tackle a Hill Head-On   \n",
       "3    How Do I Share a Hard Drive on My Home Network?   \n",
       "4  Watch Elon Musk's Neuralink reveal live at 6PM ET   \n",
       "\n",
       "                                         description  \\\n",
       "0  I love my smart speaker—as much as one can eve...   \n",
       "1  Airbnb is cracking down on parties. They are n...   \n",
       "2  Did you find a new trail to run or hike for la...   \n",
       "3  I will never fault someone for asking a tech q...   \n",
       "4  Last year Neuralink launched with lofty promis...   \n",
       "\n",
       "                                                 url  \\\n",
       "0  https://lifehacker.com/how-to-turn-off-alexas-...   \n",
       "1  https://lifehacker.com/how-to-avoid-getting-a-...   \n",
       "2  https://vitals.lifehacker.com/tackle-a-hill-he...   \n",
       "3  https://lifehacker.com/how-do-i-share-a-hard-d...   \n",
       "4  https://www.engadget.com/neuralink-bmi-livestr...   \n",
       "\n",
       "                                          urlToImage         publishedAt  \\\n",
       "0  https://i.kinja-img.com/gawker-media/image/upl... 2020-08-31 20:30:00   \n",
       "1  https://i.kinja-img.com/gawker-media/image/upl... 2020-09-06 14:00:00   \n",
       "2  https://i.kinja-img.com/gawker-media/image/upl... 2020-09-11 16:30:00   \n",
       "3  https://i.kinja-img.com/gawker-media/image/upl... 2020-08-21 13:00:00   \n",
       "4  https://o.aolcdn.com/images/dims?resize=1200%2... 2020-08-28 21:48:56   \n",
       "\n",
       "                                             content  \n",
       "0  I love my smart speakeras much as one can ever...  \n",
       "1  Airbnb is cracking down on parties. They are n...  \n",
       "2  Did you find a new trail to run or hike for la...  \n",
       "3  I will never fault someone for asking a tech q...  \n",
       "4  Last year Neuralink launched with lofty promis...  "
      ]
     },
     "execution_count": 206,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "news_parse=pd.DataFrame(g)\n",
    "\n",
    "# new column with our updated time formatting\n",
    "news_parse['publishedAt']=pd.DataFrame(oo)\n",
    "\n",
    "news_parse.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# `Or we can parse from the iteration of JSON directly`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 207,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>source</th>\n",
       "      <th>author</th>\n",
       "      <th>title</th>\n",
       "      <th>description</th>\n",
       "      <th>url</th>\n",
       "      <th>urlToImage</th>\n",
       "      <th>publishedAt</th>\n",
       "      <th>content</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>Joel Cunningham</td>\n",
       "      <td>How to Turn Off Alexa's Creepy 'Whisper Mode'</td>\n",
       "      <td>I love my smart speaker—as much as one can eve...</td>\n",
       "      <td>https://lifehacker.com/how-to-turn-off-alexas-...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-08-31 20:30:00</td>\n",
       "      <td>I love my smart speakeras much as one can ever...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>Elizabeth Yuko</td>\n",
       "      <td>How to Avoid Getting a Last-Minute Booking Blo...</td>\n",
       "      <td>Airbnb is cracking down on parties. They are n...</td>\n",
       "      <td>https://lifehacker.com/how-to-avoid-getting-a-...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-09-06 14:00:00</td>\n",
       "      <td>Airbnb is cracking down on parties. They are n...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>Beth Skwarecki on Vitals, shared by Beth Skwar...</td>\n",
       "      <td>Tackle a Hill Head-On</td>\n",
       "      <td>Did you find a new trail to run or hike for la...</td>\n",
       "      <td>https://vitals.lifehacker.com/tackle-a-hill-he...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-09-11 16:30:00</td>\n",
       "      <td>Did you find a new trail to run or hike for la...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Lifehacker.com</td>\n",
       "      <td>David Murphy</td>\n",
       "      <td>How Do I Share a Hard Drive on My Home Network?</td>\n",
       "      <td>I will never fault someone for asking a tech q...</td>\n",
       "      <td>https://lifehacker.com/how-do-i-share-a-hard-d...</td>\n",
       "      <td>https://i.kinja-img.com/gawker-media/image/upl...</td>\n",
       "      <td>2020-08-21 13:00:00</td>\n",
       "      <td>I will never fault someone for asking a tech q...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Engadget</td>\n",
       "      <td>Richard Lawler</td>\n",
       "      <td>Watch Elon Musk's Neuralink reveal live at 6PM ET</td>\n",
       "      <td>Last year Neuralink launched with lofty promis...</td>\n",
       "      <td>https://www.engadget.com/neuralink-bmi-livestr...</td>\n",
       "      <td>https://o.aolcdn.com/images/dims?resize=1200%2...</td>\n",
       "      <td>2020-08-28 21:48:56</td>\n",
       "      <td>Last year Neuralink launched with lofty promis...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "           source                                             author  \\\n",
       "0  Lifehacker.com                                    Joel Cunningham   \n",
       "1  Lifehacker.com                                     Elizabeth Yuko   \n",
       "2  Lifehacker.com  Beth Skwarecki on Vitals, shared by Beth Skwar...   \n",
       "3  Lifehacker.com                                       David Murphy   \n",
       "4        Engadget                                     Richard Lawler   \n",
       "\n",
       "                                               title  \\\n",
       "0      How to Turn Off Alexa's Creepy 'Whisper Mode'   \n",
       "1  How to Avoid Getting a Last-Minute Booking Blo...   \n",
       "2                              Tackle a Hill Head-On   \n",
       "3    How Do I Share a Hard Drive on My Home Network?   \n",
       "4  Watch Elon Musk's Neuralink reveal live at 6PM ET   \n",
       "\n",
       "                                         description  \\\n",
       "0  I love my smart speaker—as much as one can eve...   \n",
       "1  Airbnb is cracking down on parties. They are n...   \n",
       "2  Did you find a new trail to run or hike for la...   \n",
       "3  I will never fault someone for asking a tech q...   \n",
       "4  Last year Neuralink launched with lofty promis...   \n",
       "\n",
       "                                                 url  \\\n",
       "0  https://lifehacker.com/how-to-turn-off-alexas-...   \n",
       "1  https://lifehacker.com/how-to-avoid-getting-a-...   \n",
       "2  https://vitals.lifehacker.com/tackle-a-hill-he...   \n",
       "3  https://lifehacker.com/how-do-i-share-a-hard-d...   \n",
       "4  https://www.engadget.com/neuralink-bmi-livestr...   \n",
       "\n",
       "                                          urlToImage         publishedAt  \\\n",
       "0  https://i.kinja-img.com/gawker-media/image/upl... 2020-08-31 20:30:00   \n",
       "1  https://i.kinja-img.com/gawker-media/image/upl... 2020-09-06 14:00:00   \n",
       "2  https://i.kinja-img.com/gawker-media/image/upl... 2020-09-11 16:30:00   \n",
       "3  https://i.kinja-img.com/gawker-media/image/upl... 2020-08-21 13:00:00   \n",
       "4  https://o.aolcdn.com/images/dims?resize=1200%2... 2020-08-28 21:48:56   \n",
       "\n",
       "                                             content  \n",
       "0  I love my smart speakeras much as one can ever...  \n",
       "1  Airbnb is cracking down on parties. They are n...  \n",
       "2  Did you find a new trail to run or hike for la...  \n",
       "3  I will never fault someone for asking a tech q...  \n",
       "4  Last year Neuralink launched with lofty promis...  "
      ]
     },
     "execution_count": 207,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "b=defaultdict(list)\n",
    "\n",
    "for i in p:\n",
    "    for j in i.items(): # convert to tuples\n",
    "        \n",
    "        if j[0]=='source':\n",
    "             b[j[0]].append(j[1]['name'])\n",
    "                \n",
    "        # format date\n",
    "        elif j[0]=='publishedAt':\n",
    "            b[j[0]].append(datetime.datetime.strptime(j[1], '%Y-%m-%dT%H:%M:%S'+'Z'))\n",
    "       \n",
    "        else:\n",
    "            b[j[0]].append(j[1])\n",
    "            \n",
    "pd.DataFrame(b).head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "`------------------`\n",
    "\n",
    "# <font color=red>LIKE</font>, Share &\n",
    "\n",
    "# <font color=red>SUB</font>scribe"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# <font size=7>◔̯◔</font>"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}