3.3CurationFlagRelations.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Notebook 3.3 - Curation-flag-relation\n",
    "\n",
    "This notebook analyses the relations between items of the SSH Open Marketplace and writes back to the system via two dedicated curation properties: `curation-flag-relation` and `curation-detail` properties.\n",
    "\n",
    "This notebook flags Marketplace items for which contextualisation quality is low (based on interlinked items), helping Moderators improve the relations between items. \n",
    "\n",
    "This notebook is part of a series of 4 notebooks that inform the curation properties used in the SSH Open Marketplace Editorial Dashboard.\n",
    "\n",
    "It is composed of 3 sections:\n",
    "\n",
    "0. Requirements to run the notebook\n",
    "1. Check the number of relations per item\n",
    "2. Flag items with not enough relations"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 0 Requirements to run this notebook\n",
    "\n",
    "This section gives all the relevant information to \"interact\" with the MP data.\n",
    "\n",
    "### 0.1 libraries\n",
    "*There are a number of external libraries needed to run the notebook* \n",
    "\n",
    "*Furthermore, a dedicated SSH Open Marketplace library - sshmarketplacelib - with customised functions has been created and can be imported using the python import commands.* \n",
    "\n",
    "*Below the libraries import needed to run this notebook*"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import numpy as np\n",
    "import pandas as pd\n",
    "import requests\n",
    "#import the MarketPlace Library \n",
    "from sshmarketplacelib import MPData as mpd\n",
    "from sshmarketplacelib import  eval as eva, helper as hel\n",
    "utils=hel.Util()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 0.2 Get the data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "getting data from local repository...\n",
      "getting data from local repository...\n",
      "getting data from local repository...\n",
      "getting data from local repository...\n",
      "getting data from local repository...\n"
     ]
    }
   ],
   "source": [
    "mpdata = mpd()\n",
    "df_tool_flat =mpdata.getMPItems (\"toolsandservices\", True)\n",
    "df_publication_flat =mpdata.getMPItems (\"publications\", True)\n",
    "df_trainingmaterials_flat =mpdata.getMPItems (\"trainingmaterials\", True)\n",
    "df_workflows_flat =mpdata.getMPItems (\"workflows\", True)\n",
    "df_datasets_flat =mpdata.getMPItems (\"datasets\", True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 0.3 A look at the data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>category</th>\n",
       "      <th>label</th>\n",
       "      <th>persistentId</th>\n",
       "      <th>lastInfoUpdate</th>\n",
       "      <th>status</th>\n",
       "      <th>description</th>\n",
       "      <th>contributors</th>\n",
       "      <th>properties</th>\n",
       "      <th>externalIds</th>\n",
       "      <th>...</th>\n",
       "      <th>thumbnail.info.filename</th>\n",
       "      <th>thumbnail.info.mimeType</th>\n",
       "      <th>thumbnail.info.hasThumbnail</th>\n",
       "      <th>thumbnail.caption</th>\n",
       "      <th>version</th>\n",
       "      <th>thumbnail.info.location.sourceUrl</th>\n",
       "      <th>informationContributor.email</th>\n",
       "      <th>dateCreated</th>\n",
       "      <th>dateLastUpdated</th>\n",
       "      <th>composedOf</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>45953</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>140kit</td>\n",
       "      <td>3IAyEp</td>\n",
       "      <td>2021-07-30T16:03:01+0000</td>\n",
       "      <td>approved</td>\n",
       "      <td>140kit provides a management layer for tweet c...</td>\n",
       "      <td>[{'actor': {'id': 483, 'name': 'Ian Pearce, De...</td>\n",
       "      <td>[{'type': {'code': 'activity', 'label': 'Activ...</td>\n",
       "      <td>[]</td>\n",
       "      <td>...</td>\n",
       "      <td>acdh-ch-logo96.png</td>\n",
       "      <td>image/png</td>\n",
       "      <td>True</td>\n",
       "      <td>test thumbnail of uploaded media image</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>49576</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>3DF Zephyr - photogrammetry software - 3d mode...</td>\n",
       "      <td>U3gQrh</td>\n",
       "      <td>2021-09-22T15:51:38+0000</td>\n",
       "      <td>approved</td>\n",
       "      <td>No description provided.</td>\n",
       "      <td>[]</td>\n",
       "      <td>[{'type': {'code': 'curation-flag-description'...</td>\n",
       "      <td>[]</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>49577</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>3DHOP</td>\n",
       "      <td>MnpOWX</td>\n",
       "      <td>2021-09-22T15:51:39+0000</td>\n",
       "      <td>approved</td>\n",
       "      <td>No description provided.</td>\n",
       "      <td>[]</td>\n",
       "      <td>[{'type': {'code': 'curation-flag-description'...</td>\n",
       "      <td>[]</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>49578</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>3DHOP: 3D Heritage Online Presenter</td>\n",
       "      <td>gA7zFN</td>\n",
       "      <td>2021-09-22T15:51:39+0000</td>\n",
       "      <td>approved</td>\n",
       "      <td>No description provided.</td>\n",
       "      <td>[]</td>\n",
       "      <td>[{'type': {'code': 'curation-flag-description'...</td>\n",
       "      <td>[]</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>49579</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>3DReshaper \\| 3DReshaper</td>\n",
       "      <td>Q49CiV</td>\n",
       "      <td>2021-09-22T15:51:40+0000</td>\n",
       "      <td>approved</td>\n",
       "      <td>No description provided.</td>\n",
       "      <td>[]</td>\n",
       "      <td>[{'type': {'code': 'curation-flag-description'...</td>\n",
       "      <td>[]</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 37 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "      id         category                                              label  \\\n",
       "0  45953  tool-or-service                                             140kit   \n",
       "1  49576  tool-or-service  3DF Zephyr - photogrammetry software - 3d mode...   \n",
       "2  49577  tool-or-service                                              3DHOP   \n",
       "3  49578  tool-or-service                3DHOP: 3D Heritage Online Presenter   \n",
       "4  49579  tool-or-service                           3DReshaper \\| 3DReshaper   \n",
       "\n",
       "  persistentId            lastInfoUpdate    status  \\\n",
       "0       3IAyEp  2021-07-30T16:03:01+0000  approved   \n",
       "1       U3gQrh  2021-09-22T15:51:38+0000  approved   \n",
       "2       MnpOWX  2021-09-22T15:51:39+0000  approved   \n",
       "3       gA7zFN  2021-09-22T15:51:39+0000  approved   \n",
       "4       Q49CiV  2021-09-22T15:51:40+0000  approved   \n",
       "\n",
       "                                         description  \\\n",
       "0  140kit provides a management layer for tweet c...   \n",
       "1                           No description provided.   \n",
       "2                           No description provided.   \n",
       "3                           No description provided.   \n",
       "4                           No description provided.   \n",
       "\n",
       "                                        contributors  \\\n",
       "0  [{'actor': {'id': 483, 'name': 'Ian Pearce, De...   \n",
       "1                                                 []   \n",
       "2                                                 []   \n",
       "3                                                 []   \n",
       "4                                                 []   \n",
       "\n",
       "                                          properties externalIds  ...  \\\n",
       "0  [{'type': {'code': 'activity', 'label': 'Activ...          []  ...   \n",
       "1  [{'type': {'code': 'curation-flag-description'...          []  ...   \n",
       "2  [{'type': {'code': 'curation-flag-description'...          []  ...   \n",
       "3  [{'type': {'code': 'curation-flag-description'...          []  ...   \n",
       "4  [{'type': {'code': 'curation-flag-description'...          []  ...   \n",
       "\n",
       "  thumbnail.info.filename thumbnail.info.mimeType thumbnail.info.hasThumbnail  \\\n",
       "0      acdh-ch-logo96.png               image/png                        True   \n",
       "1                     NaN                     NaN                         NaN   \n",
       "2                     NaN                     NaN                         NaN   \n",
       "3                     NaN                     NaN                         NaN   \n",
       "4                     NaN                     NaN                         NaN   \n",
       "\n",
       "                        thumbnail.caption  version  \\\n",
       "0  test thumbnail of uploaded media image      NaN   \n",
       "1                                     NaN      NaN   \n",
       "2                                     NaN      NaN   \n",
       "3                                     NaN      NaN   \n",
       "4                                     NaN      NaN   \n",
       "\n",
       "  thumbnail.info.location.sourceUrl informationContributor.email dateCreated  \\\n",
       "0                               NaN                          NaN         NaN   \n",
       "1                               NaN                          NaN         NaN   \n",
       "2                               NaN                          NaN         NaN   \n",
       "3                               NaN                          NaN         NaN   \n",
       "4                               NaN                          NaN         NaN   \n",
       "\n",
       "  dateLastUpdated composedOf  \n",
       "0             NaN        NaN  \n",
       "1             NaN        NaN  \n",
       "2             NaN        NaN  \n",
       "3             NaN        NaN  \n",
       "4             NaN        NaN  \n",
       "\n",
       "[5 rows x 37 columns]"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_all_items=pd.concat([df_tool_flat, df_publication_flat, df_trainingmaterials_flat, df_workflows_flat, df_datasets_flat])\n",
    "df_all_items.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>persistentId</th>\n",
       "      <th>category</th>\n",
       "      <th>label</th>\n",
       "      <th>description</th>\n",
       "      <th>contributors</th>\n",
       "      <th>accessibleAt</th>\n",
       "      <th>source.label</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>303</th>\n",
       "      <td>12634</td>\n",
       "      <td>l8gLBb</td>\n",
       "      <td>dataset</td>\n",
       "      <td>Yelp Academic Challenge Dataset</td>\n",
       "      <td>The Yelp dataset is a subset of our businesses...</td>\n",
       "      <td>[{'actor': {'id': 1752, 'name': 'Eva Bacas', '...</td>\n",
       "      <td>[https://www.yelp.com/dataset]</td>\n",
       "      <td>Humanities Data</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>304</th>\n",
       "      <td>12631</td>\n",
       "      <td>xvYQQ4</td>\n",
       "      <td>dataset</td>\n",
       "      <td>YelpCHI</td>\n",
       "      <td>This dataset is collected from Yelp.com and fi...</td>\n",
       "      <td>[{'actor': {'id': 1752, 'name': 'Eva Bacas', '...</td>\n",
       "      <td>[http://odds.cs.stonybrook.edu/yelpchi-dataset/]</td>\n",
       "      <td>Humanities Data</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>305</th>\n",
       "      <td>12632</td>\n",
       "      <td>IdZGtV</td>\n",
       "      <td>dataset</td>\n",
       "      <td>YelpNYC</td>\n",
       "      <td>This dataset is collected from Yelp.com and fi...</td>\n",
       "      <td>[{'actor': {'id': 1752, 'name': 'Eva Bacas', '...</td>\n",
       "      <td>[http://odds.cs.stonybrook.edu/yelpnyc-dataset/]</td>\n",
       "      <td>Humanities Data</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>306</th>\n",
       "      <td>12633</td>\n",
       "      <td>OMny6U</td>\n",
       "      <td>dataset</td>\n",
       "      <td>YelpZIP</td>\n",
       "      <td>This dataset is collected from Yelp.com and fi...</td>\n",
       "      <td>[{'actor': {'id': 1752, 'name': 'Eva Bacas', '...</td>\n",
       "      <td>[http://odds.cs.stonybrook.edu/yelpzip-dataset/]</td>\n",
       "      <td>Humanities Data</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>307</th>\n",
       "      <td>12589</td>\n",
       "      <td>YnEaU0</td>\n",
       "      <td>dataset</td>\n",
       "      <td>\"You Are Where You Tweet: A Content-Based Appr...</td>\n",
       "      <td>This dataset is a collection of scraped public...</td>\n",
       "      <td>[{'actor': {'id': 1752, 'name': 'Eva Bacas', '...</td>\n",
       "      <td>[https://archive.org/details/twitter_cikm_2010]</td>\n",
       "      <td>Humanities Data</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "        id persistentId category  \\\n",
       "303  12634       l8gLBb  dataset   \n",
       "304  12631       xvYQQ4  dataset   \n",
       "305  12632       IdZGtV  dataset   \n",
       "306  12633       OMny6U  dataset   \n",
       "307  12589       YnEaU0  dataset   \n",
       "\n",
       "                                                 label  \\\n",
       "303                    Yelp Academic Challenge Dataset   \n",
       "304                                            YelpCHI   \n",
       "305                                            YelpNYC   \n",
       "306                                            YelpZIP   \n",
       "307  \"You Are Where You Tweet: A Content-Based Appr...   \n",
       "\n",
       "                                           description  \\\n",
       "303  The Yelp dataset is a subset of our businesses...   \n",
       "304  This dataset is collected from Yelp.com and fi...   \n",
       "305  This dataset is collected from Yelp.com and fi...   \n",
       "306  This dataset is collected from Yelp.com and fi...   \n",
       "307  This dataset is a collection of scraped public...   \n",
       "\n",
       "                                          contributors  \\\n",
       "303  [{'actor': {'id': 1752, 'name': 'Eva Bacas', '...   \n",
       "304  [{'actor': {'id': 1752, 'name': 'Eva Bacas', '...   \n",
       "305  [{'actor': {'id': 1752, 'name': 'Eva Bacas', '...   \n",
       "306  [{'actor': {'id': 1752, 'name': 'Eva Bacas', '...   \n",
       "307  [{'actor': {'id': 1752, 'name': 'Eva Bacas', '...   \n",
       "\n",
       "                                         accessibleAt     source.label  \n",
       "303                    [https://www.yelp.com/dataset]  Humanities Data  \n",
       "304  [http://odds.cs.stonybrook.edu/yelpchi-dataset/]  Humanities Data  \n",
       "305  [http://odds.cs.stonybrook.edu/yelpnyc-dataset/]  Humanities Data  \n",
       "306  [http://odds.cs.stonybrook.edu/yelpzip-dataset/]  Humanities Data  \n",
       "307   [https://archive.org/details/twitter_cikm_2010]  Humanities Data  "
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_all_items_work=df_all_items[['id', 'persistentId', 'category', 'label', 'description', 'contributors', 'accessibleAt', 'source.label']]\n",
    "df_all_items_work.tail()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 1. Check the number of relations per item\n",
    "\n",
    "By default, and according to rules set up in the Editorial Guidelines, items in the SSH Open Marketplace should be interlinked."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>item_persistentId</th>\n",
       "      <th>item_category</th>\n",
       "      <th>item_label</th>\n",
       "      <th>relation.label</th>\n",
       "      <th>persistentId</th>\n",
       "      <th>category</th>\n",
       "      <th>label</th>\n",
       "      <th>workflowId</th>\n",
       "      <th>description</th>\n",
       "      <th>relation.code</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>235</th>\n",
       "      <td>h8UTUS</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>Ethnic and Migrant Minorities (EMM) Survey Reg...</td>\n",
       "      <td>Is related to</td>\n",
       "      <td>4SVucl</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>Automated Verification Tool</td>\n",
       "      <td>NaN</td>\n",
       "      <td>The Automatic Verification Tool (AVT) enables ...</td>\n",
       "      <td>is-related-to</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>313</th>\n",
       "      <td>iQdKk2</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>Gephi</td>\n",
       "      <td>Is related to</td>\n",
       "      <td>4SVucl</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>Automated Verification Tool</td>\n",
       "      <td>NaN</td>\n",
       "      <td>The Automatic Verification Tool (AVT) enables ...</td>\n",
       "      <td>is-related-to</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>171</th>\n",
       "      <td>ip7fwu</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>DH Press</td>\n",
       "      <td>Is mentioned in</td>\n",
       "      <td>t6q6FW</td>\n",
       "      <td>publication</td>\n",
       "      <td>\"A Pale Reflection of the Violent Truth? Pract...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>No description provided.</td>\n",
       "      <td>is-mentioned-in</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1042</th>\n",
       "      <td>CduoOq</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>Skype</td>\n",
       "      <td>Is mentioned in</td>\n",
       "      <td>BNGWfl</td>\n",
       "      <td>publication</td>\n",
       "      <td>\"A picture is worth a thousand words\"? - From ...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>No description provided.</td>\n",
       "      <td>is-mentioned-in</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>465</th>\n",
       "      <td>dvJSDD</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>Google Books</td>\n",
       "      <td>Is mentioned in</td>\n",
       "      <td>GIb2N9</td>\n",
       "      <td>publication</td>\n",
       "      <td>\"Inventing the Map - \" from 19th-century Pedag...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>No description provided</td>\n",
       "      <td>is-mentioned-in</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     item_persistentId    item_category  \\\n",
       "235             h8UTUS  tool-or-service   \n",
       "313             iQdKk2  tool-or-service   \n",
       "171             ip7fwu  tool-or-service   \n",
       "1042            CduoOq  tool-or-service   \n",
       "465             dvJSDD  tool-or-service   \n",
       "\n",
       "                                             item_label   relation.label  \\\n",
       "235   Ethnic and Migrant Minorities (EMM) Survey Reg...    Is related to   \n",
       "313                                               Gephi    Is related to   \n",
       "171                                            DH Press  Is mentioned in   \n",
       "1042                                              Skype  Is mentioned in   \n",
       "465                                        Google Books  Is mentioned in   \n",
       "\n",
       "     persistentId         category  \\\n",
       "235        4SVucl  tool-or-service   \n",
       "313        4SVucl  tool-or-service   \n",
       "171        t6q6FW      publication   \n",
       "1042       BNGWfl      publication   \n",
       "465        GIb2N9      publication   \n",
       "\n",
       "                                                  label workflowId  \\\n",
       "235                         Automated Verification Tool        NaN   \n",
       "313                         Automated Verification Tool        NaN   \n",
       "171   \"A Pale Reflection of the Violent Truth? Pract...        NaN   \n",
       "1042  \"A picture is worth a thousand words\"? - From ...        NaN   \n",
       "465   \"Inventing the Map - \" from 19th-century Pedag...        NaN   \n",
       "\n",
       "                                            description    relation.code  \n",
       "235   The Automatic Verification Tool (AVT) enables ...    is-related-to  \n",
       "313   The Automatic Verification Tool (AVT) enables ...    is-related-to  \n",
       "171                            No description provided.  is-mentioned-in  \n",
       "1042                           No description provided.  is-mentioned-in  \n",
       "465                             No description provided  is-mentioned-in  "
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_rel_it=utils.getAllRelatedItems()\n",
    "df_rel_it.sort_values('label').head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(1766, 10)"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_rel_it.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The following cell code returns a dataframe with all the items having 3 related items, it uses the function __getRelateditems (itemcategories, operator, nrelitems)__  returns a dataframe with items in a specific category having related items. \n",
    "The parameters are:\n",
    "\n",
    "<ul>\n",
    "    <li>categories: the list of categories. This parameter is mandatory, if the search should be done in all categories the keyword *all* can be used</li>\n",
    "    <li> the operator.  Optional, accepted values are =, &lt; and &gt; (the default) </li> \n",
    "    <li> nrelitems: an optional parameter, if not present all items are returned.</li>\n",
    "</ul>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MPUrl</th>\n",
       "      <th>persistentId</th>\n",
       "      <th>category</th>\n",
       "      <th>label</th>\n",
       "      <th>relation.label</th>\n",
       "      <th>relitem_persistentId</th>\n",
       "      <th>relItem_category</th>\n",
       "      <th>relItem_label</th>\n",
       "      <th>relItem_description</th>\n",
       "      <th>relation.code</th>\n",
       "      <th>value</th>\n",
       "      <th>workflowId</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tool-or-service/4SVucl</td>\n",
       "      <td>4SVucl</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>Automated Verification Tool</td>\n",
       "      <td>Relates to</td>\n",
       "      <td>h8UTUS</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>Ethnic and Migrant Minorities (EMM) Survey Reg...</td>\n",
       "      <td>The EMM Survey Registry—which has been co-crea...</td>\n",
       "      <td>relates-to</td>\n",
       "      <td>2</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>tool-or-service/4SVucl</td>\n",
       "      <td>4SVucl</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>Automated Verification Tool</td>\n",
       "      <td>Relates to</td>\n",
       "      <td>iQdKk2</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>Gephi</td>\n",
       "      <td>Gephi is the leading visualization and explora...</td>\n",
       "      <td>relates-to</td>\n",
       "      <td>2</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>publication/rSRIZx</td>\n",
       "      <td>rSRIZx</td>\n",
       "      <td>publication</td>\n",
       "      <td>\"My Name is Lizzie Bennet - \" Reading, Partici...</td>\n",
       "      <td>Mentions</td>\n",
       "      <td>gNfOzz</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>YouTube</td>\n",
       "      <td>http://www.wikidata.org/entity/Q16971117</td>\n",
       "      <td>mentions</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>publication/UK7Sij</td>\n",
       "      <td>UK7Sij</td>\n",
       "      <td>publication</td>\n",
       "      <td>\"On the record\" - transcribing and valorizing ...</td>\n",
       "      <td>Is related to</td>\n",
       "      <td>h2MFPS</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>TEI Boilerplate</td>\n",
       "      <td>TEI Boilerplate is a lightweight solution for ...</td>\n",
       "      <td>is-related-to</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>training-material/baDTwh</td>\n",
       "      <td>baDTwh</td>\n",
       "      <td>training-material</td>\n",
       "      <td>2.1 Error rates and ground truth - Text Digiti...</td>\n",
       "      <td>Is mentioned in</td>\n",
       "      <td>KEugTm</td>\n",
       "      <td>step</td>\n",
       "      <td>Test on a subset and assess quality</td>\n",
       "      <td>The first step to take is the definition of a ...</td>\n",
       "      <td>is-mentioned-in</td>\n",
       "      <td>1</td>\n",
       "      <td>qYzKVU</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>tool-or-service/U3gQrh</td>\n",
       "      <td>U3gQrh</td>\n",
       "      <td>tool-or-service</td>\n",
       "      <td>3DF Zephyr - photogrammetry software - 3d mode...</td>\n",
       "      <td>Is mentioned in</td>\n",
       "      <td>pXppX6</td>\n",
       "      <td>step</td>\n",
       "      <td>Acquisition of a 3D object (by photogrammetry)</td>\n",
       "      <td>The photogrammetry method relies on a\\n       ...</td>\n",
       "      <td>is-mentioned-in</td>\n",
       "      <td>1</td>\n",
       "      <td>MHUaGI</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>training-material/T3JbA2</td>\n",
       "      <td>T3JbA2</td>\n",
       "      <td>training-material</td>\n",
       "      <td>3DHOP - How To</td>\n",
       "      <td>Is mentioned in</td>\n",
       "      <td>mSWgiF</td>\n",
       "      <td>step</td>\n",
       "      <td>Visualisation</td>\n",
       "      <td>Visualize 3D models requires specific (web-bas...</td>\n",
       "      <td>is-mentioned-in</td>\n",
       "      <td>1</td>\n",
       "      <td>B3V0jJ</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                      MPUrl persistentId           category  \\\n",
       "0    tool-or-service/4SVucl       4SVucl    tool-or-service   \n",
       "1    tool-or-service/4SVucl       4SVucl    tool-or-service   \n",
       "2        publication/rSRIZx       rSRIZx        publication   \n",
       "3        publication/UK7Sij       UK7Sij        publication   \n",
       "4  training-material/baDTwh       baDTwh  training-material   \n",
       "5    tool-or-service/U3gQrh       U3gQrh    tool-or-service   \n",
       "6  training-material/T3JbA2       T3JbA2  training-material   \n",
       "\n",
       "                                               label   relation.label  \\\n",
       "0                        Automated Verification Tool       Relates to   \n",
       "1                        Automated Verification Tool       Relates to   \n",
       "2  \"My Name is Lizzie Bennet - \" Reading, Partici...         Mentions   \n",
       "3  \"On the record\" - transcribing and valorizing ...    Is related to   \n",
       "4  2.1 Error rates and ground truth - Text Digiti...  Is mentioned in   \n",
       "5  3DF Zephyr - photogrammetry software - 3d mode...  Is mentioned in   \n",
       "6                                     3DHOP - How To  Is mentioned in   \n",
       "\n",
       "  relitem_persistentId relItem_category  \\\n",
       "0               h8UTUS  tool-or-service   \n",
       "1               iQdKk2  tool-or-service   \n",
       "2               gNfOzz  tool-or-service   \n",
       "3               h2MFPS  tool-or-service   \n",
       "4               KEugTm             step   \n",
       "5               pXppX6             step   \n",
       "6               mSWgiF             step   \n",
       "\n",
       "                                       relItem_label  \\\n",
       "0  Ethnic and Migrant Minorities (EMM) Survey Reg...   \n",
       "1                                              Gephi   \n",
       "2                                            YouTube   \n",
       "3                                    TEI Boilerplate   \n",
       "4                Test on a subset and assess quality   \n",
       "5     Acquisition of a 3D object (by photogrammetry)   \n",
       "6                                      Visualisation   \n",
       "\n",
       "                                 relItem_description    relation.code  value  \\\n",
       "0  The EMM Survey Registry—which has been co-crea...       relates-to      2   \n",
       "1  Gephi is the leading visualization and explora...       relates-to      2   \n",
       "2           http://www.wikidata.org/entity/Q16971117         mentions      1   \n",
       "3  TEI Boilerplate is a lightweight solution for ...    is-related-to      1   \n",
       "4  The first step to take is the definition of a ...  is-mentioned-in      1   \n",
       "5  The photogrammetry method relies on a\\n       ...  is-mentioned-in      1   \n",
       "6  Visualize 3D models requires specific (web-bas...  is-mentioned-in      1   \n",
       "\n",
       "  workflowId  \n",
       "0        NaN  \n",
       "1        NaN  \n",
       "2        NaN  \n",
       "3        NaN  \n",
       "4     qYzKVU  \n",
       "5     MHUaGI  \n",
       "6     B3V0jJ  "
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_test_ri=utils.getRelatedItems('all', '<', 3)\n",
    "df_test_ri.head(7)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_test_ri['property']='relations'\n",
    "df_test_ri_no_duplicates=df_test_ri[df_test_ri.duplicated(subset=['label'], keep='first')]\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 2. Flag items with with not enough relations"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "curation_flag_property={\"code\": \"curation-flag-relations\"}\n",
    "curation_detail_property={\"code\": \"curation-detail\"}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Creating log file...\n",
      "The property: relations, has value 1, in item with pid: tools/m9q6vc, (current version: 43477)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"1\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/n0cSzL, (current version: 63339)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/d2HMjC, (current version: 61434)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/5v0M24, (current version: 63438)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/iJHK6Q, (current version: 49587)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/RUZe3g, (current version: 62065)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/JKGhtG, (current version: 62032)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/4SVucl, (current version: 49905)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/mToGiG, (current version: 49596)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/mvAuo9, (current version: 45345)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/7vkKr2, (current version: 61630)\n",
      "{\"url\": [{\"accessibleAt\": \"503\"}], \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/i7Ah2U, (current version: 61497)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/oM2qv9, (current version: 49609)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/teNZSt, (current version: 63084)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/khUtdK, (current version: 61741)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/5IRWwi, (current version: 62029)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/8aoLzE, (current version: 54268)\n",
      "{\"url\": [{\"accessibleAt\": \"404\"}], \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/QWpvau, (current version: 61754)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/GHlkFz, (current version: 49633)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/Ji5s9J, (current version: 62923)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/FvtNkF, (current version: 62514)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/G05k3l, (current version: 61520)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/umj6Lg, (current version: 56468)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/6vZOfG, (current version: 56950)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/JTi8mw, (current version: 62706)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/ymydPK, (current version: 63445)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/rJ5Hqz, (current version: 62661)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/lwXTCA, (current version: 61850)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/WfhTvQ, (current version: 49683)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/tmCX0Z, (current version: 61682)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/FLK4Bl, (current version: 63411)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/d7T7Un, (current version: 62486)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/YmnOEu, (current version: 63345)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/N2DBHn, (current version: 55478)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/5yweb6, (current version: 49696)\n",
      "The property: relations, has value 2, in item with pid: tools/5yweb6, (current version: 49696)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/aZ99Rw, (current version: 62381)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/Bt7BX4, (current version: 49701)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/TFVbcI, (current version: 62262)\n",
      "The property: relations, has value 2, in item with pid: tools/TFVbcI, (current version: 62262)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/MTIBoJ, (current version: 61436)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/TnfNf3, (current version: 54110)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/aaq3fD, (current version: 61655)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/orjfXo, (current version: 55116)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/IV2Rgd, (current version: 49718)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/O2TBOZ, (current version: 62576)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/fmVaW7, (current version: 63352)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/K5js1D, (current version: 61576)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/5TuvTT, (current version: 63386)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/XNzmtl, (current version: 62671)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/fPLpV3, (current version: 54417)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/QX9TKA, (current version: 63452)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/oU3FjR, (current version: 62357)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/dbGwJK, (current version: 49763)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/f0G4GI, (current version: 61419)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/RX5XdB, (current version: 62978)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/fnRO5e, (current version: 49773)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"2\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/QQd3D5, (current version: 58001)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 1, in item with pid: tools/HQjxLh, (current version: 49774)\n",
      "{\"description\": {\"length\": \"0\"}, \"relations\": \"{\\\"length\\\": \\\"1\\\"}\"}\n",
      "append curation_property_value\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/MkELgr, (current version: 45876)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/eqVSrT, (current version: 63266)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/wwZCSd, (current version: 63080)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/eAy9zP, (current version: 63294)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/65uQpg, (current version: 63354)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/oda27K, (current version: 63361)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/iy9UL6, (current version: 62852)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/onidM5, (current version: 54710)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: tools/sGLPyd, (current version: 61665)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [200]>\n",
      "The property: relations, has value 2, in item with pid: publications/Ja3t2z, (current version: 40185)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/eaqXEQ, (current version: 36282)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/NyLFGF, (current version: 36939)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/iEgj71, (current version: 36945)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/6kYac0, (current version: 36948)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/I0TnYt, (current version: 36885)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/CUDWnT, (current version: 36525)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/VWAuuT, (current version: 36102)\n",
      "The property: relations, has value 2, in item with pid: publications/VWAuuT, (current version: 36102)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/gP6avY, (current version: 36888)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/vIkR3Q, (current version: 36894)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/GX5ERg, (current version: 36891)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/KZAW1u, (current version: 36450)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/Ev43G3, (current version: 40250)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/wAoWEu, (current version: 40282)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/Xo6GPy, (current version: 36453)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/6hXXvy, (current version: 36435)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/GuyjGt, (current version: 36147)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/8NGiHu, (current version: 36702)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/H56uhw, (current version: 36852)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/1Rmxc4, (current version: 40407)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/QyVRx2, (current version: 35913)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/7rX6ht, (current version: 36438)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/OEJRGr, (current version: 36075)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/HqdBbP, (current version: 36369)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/4jQvZ5, (current version: 36855)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: publications/MNtoS6, (current version: 36336)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: trainingMaterials/ARPZXa, (current version: 36882)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 1, in item with pid: trainingMaterials/KbYQxy, (current version: 36300)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"1\"}}'}\n",
      "updating item... \n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: trainingMaterials/dEKR6G, (current version: 36942)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: trainingMaterials/21muUk, (current version: 36456)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: trainingMaterials/ZV6GEg, (current version: 36468)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: trainingMaterials/dro7ts, (current version: 36936)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "The property: relations, has value 2, in item with pid: trainingMaterials/bxWKhV, (current version: 36951)\n",
      "append curation_property_value\n",
      "append curation_detail_value {'type': {'code': 'curation-detail'}, 'value': '{\"relations\": {\"length\": \"2\"}}'}\n",
      "updating item... \n",
      "<Response [404]>\n",
      "Reloading data from MP server, please wait...\n",
      "done!\n"
     ]
    }
   ],
   "source": [
    "\n",
    "res_des=mpdata.setPropertyFlags(df_test_ri_no_duplicates, curation_flag_property, curation_detail_property)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.0"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}