pyABSA crashes the python kernel on Azure Databricks

[ekum1167]

Hello, I'm using pyABSA 2.4.0, transformers 4.29. I was able to run the library on my local machine but on the Azure databricks with much better system (either with or without GPU) it crashes the kernel. I have the exact same library installations
I can provide more details if necessary.

autocuda-0.16 blis-0.7.11 boostaug-2.3.5 catalogue-2.0.10 cloudpathlib-0.16.0 confection-0.1.4 contourpy-1.2.0 cymem-2.0.8 et-xmlfile-1.1.0 findfile-2.0.1 fsspec-2023.12.2 gitdb-4.0.11 gitpython-3.1.41 huggingface-hub-0.20.2 langcodes-3.3.0 matplotlib-3.8.2 metric-visualizer-0.9.9 mpmath-1.3.0 murmurhash-1.0.10 natsort-8.4.0 networkx-3.2.1 nvidia-cublas-cu12-12.1.3.1 nvidia-cuda-cupti-cu12-12.1.105 nvidia-cuda-nvrtc-cu12-12.1.105 nvidia-cuda-runtime-cu12-12.1.105 nvidia-cudnn-cu12-8.9.2.26 nvidia-cufft-cu12-11.0.2.54 nvidia-curand-cu12-10.3.2.106 nvidia-cusolver-cu12-11.4.5.107 nvidia-cusparse-cu12-12.1.0.106 nvidia-nccl-cu12-2.18.1 nvidia-nvjitlink-cu12-12.3.101 nvidia-nvtx-cu12-12.1.105 openpyxl-3.1.2 preshed-3.0.9 pyabsa-2.4.0 pytorch-warmup-0.1.1 pyyaml-6.0.1 regex-2023.12.25 safetensors-0.4.1 scipy-1.10.1 sentencepiece-0.1.99 seqeval-1.2.2 smart-open-6.4.0 smmap-5.0.1 spacy-3.7.2 spacy-legacy-3.0.12 spacy-loggers-1.0.5 srsly-2.4.8 sympy-1.12 tabulate-0.9.0 termcolor-2.4.0 thinc-8.2.2 tikzplotlib-0.10.1 tokenizers-0.15.0 torch-2.1.2 tqdm-4.66.1 transformers-4.36.2 triton-2.1.0 typer-0.9.0 update-checker-0.18.0 wasabi-1.1.2 weasel-0.3.4 webcolors-1.13 xlsxwriter-3.1.9

And error is kernel crash. Code that causes this is just "import pyabsa"

Fatal error: The Python kernel is unresponsive.

The Python process exited with exit code 134 (SIGABRT: Aborted).

... I skipped some messages here

Last messages on stdout:
NOTE: When using the ipython kernel entry point, Ctrl-C will not work.

To exit, you will have to explicitly quit this process, by either sending
"quit" from a client, or using Ctrl-\ in UNIX-like environments.

To read more about this, see ipython/ipython#2049

To connect another client to this kernel, use:
--existing /databricks/kernel-connections/d785405038ce904e0b36bb664fe11124bbf785bfce6048418cedc19106143f8d.json
No CUDA GPU found in your device
[2024-01-12 09:05:24] (2.4.0) PyABSA(2.4.0): If your code crashes on Colab, please use the GPU runtime. Then run "pip install pyabsa[dev] -U" and restart the kernel.
Or if it does not work, you can use v1.x versions, e.g., pip install pyabsa<2.0 -U

WARNING: When you fails to load a checkpoint, e.g., Unexpected key(s),
Try to downgrade transformers<=4.29.0.