Skip to content

Latest commit

 

History

History
42 lines (29 loc) · 1.6 KB

README.md

File metadata and controls

42 lines (29 loc) · 1.6 KB

ldes-harvester-processor-ts

Build and tests with Node.js npm

This repository contains an RDF-Connect processor to partially harvest an LDES with some additional options to the ldes-client. It allows for the harvesting of a specific number of members per interval, ranging from a specific start to end date.

Configuration

At the time of writing, this repositories sets up the following boilerplate and tools for you.

  • outgoing: The outgoing channel to write the harvested members to.
  • url: The URL of the LDES to harvest.
  • start: The start date of the harvesting interval.
  • end: The end date of the harvesting interval.
  • interval: The number of milliseconds in each interval. Default is 3_600_000ms (1 hour).
  • membersPerInterval: The number of members to harvest per interval. Default is 100.
  • urlIsView: Whether the URL is a view or not. Default is false.

Installation

npm install
npm run build

Example

An example configuration of the processor can be found in the example directory.

You can run this example by executing the following command:

npx @rdfc/js-runner example/pipeline.ttl

To enable all debug logs, add DEBUG=* before the command:

DEBUG=* npx @rdfc/js-runner example/pipeline.ttl