Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shiny app can crash with a large file. #83

Open
leppott opened this issue Aug 4, 2023 · 4 comments
Open

Shiny app can crash with a large file. #83

leppott opened this issue Aug 4, 2023 · 4 comments
Labels
performance Issue related to performance (speed).

Comments

@leppott
Copy link
Owner

leppott commented Aug 4, 2023

Describe the bug
Out of memory issue on ShinyApps.io with some large files.

To Reproduce
Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
Log file:

image

Additional context
Need to get limits from user on what size worked and what didn't.

@leppott
Copy link
Owner Author

leppott commented Aug 4, 2023

There might be some clean up of the memory and saving of objects in memory I can do prior to generating the report.

OR, since the report isn't a super important part of the process I can just comment it out.

@leppott
Copy link
Owner Author

leppott commented Aug 4, 2023

The file with the issues was 55 MB, 90,029 records, and 1,863 samples.

Not that big of a file so probably a memory management issue within the environment of the Shiny app. Ensure removing objects after no longer needed. Might need a garbage collection at some point in the code.

@leppott
Copy link
Owner Author

leppott commented Aug 4, 2023

Proposed solution = add "gc()" after each large section of code to free up any left overs in memory.

@leppott
Copy link
Owner Author

leppott commented Feb 6, 2024

Upped the app memory allocation on Shiny to the max. Feb 2 or so.

@leppott leppott added the performance Issue related to performance (speed). label Feb 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
performance Issue related to performance (speed).
Projects
None yet
Development

No branches or pull requests

1 participant