Errors and their possible solutions

Errors and their possible solutions

Here we list some errors you may encounter in using OLS and their possible solutions.

Neo4J import larger than buffer size error

Error description

This error happens during import of the CSV files into Neo4J. Here are some of the important snippets from and example error:

Error in input data
11:29:58 Caused by:ERROR in input
11:29:58   data source: BufferedCharSeeker[source:/hps/nobackup/parkinso/spot/ols4/prod/slurm_pipeline/./output_csv/dron_classes.csv, position:7784628224, line:723073
.
.
.
  original error: Tried to read a field larger than buffer size 134217728. A common cause of this is that a field has an unterminated quote and so will try to seek until the next quote, which ever line it may be on. This should not happen if multi-line fields are disabled, given that the fields contains no new-line characters. ...

Fix

Increase the --read-buffer-size in ./dataload/load_into_neo4j.sh for data loads, or in ./dev-testing/load_test_into_neo4j.sh for test cases.