Changed data loader script to load one dataset at a time and delete in memory the previous one #21

Merged
duarteneves5 merged 2 commits from load-one-dataset into main 2025-11-22 17:07:05 +00:00
duarteneves5 commented 2025-11-22 14:59:55 +00:00 (Migrated from github.com)

As a out of memory error showed up, the loader script had to be modified to have only one dataset loaded in memory. A few tests were also created to test the data loader script.

As a out of memory error showed up, the loader script had to be modified to have only one dataset loaded in memory. A few tests were also created to test the data loader script.
vascodias23 (Migrated from github.com) reviewed 2025-11-22 14:59:55 +00:00
AndreFerreira5 (Migrated from github.com) approved these changes 2025-11-22 17:06:59 +00:00
AndreFerreira5 (Migrated from github.com) left a comment

all looks good! nice that you made some tests!

all looks good! nice that you made some tests!
Sign in to join this conversation.
No description provided.