Out of memory when uploading large file

[ClementToche]

Hi. First, thanks for this great service and tool, that's a real promising service.
I'm facing a problem with this app when uploading a large file.

I'm running under Debian 12.11 and node 24.6.0.
I have a file which is 16GB large and when I upload it, I can see my RAM memory usage increasing until the app gets killed as out of memory.
My system is a standard x64 CPU with 15GB or RAM. I disabled the swap management for different reasons.

The "internxt upload file" command is using more and more memory during the upload process (more than 6 GB of RAM) before being killed.
It's like the app is not using streamed data to encrypt and send it to the cloud and needs to have a full 16GB space in ram to fully encrypt it and send it to the cloud.

Can you confirm how this can be improved ? Do you need additional information / test to be done in my side ?

Thanks.

[rcfa]

Did you enable swapping on your system?
you could e.g. install the swapspace package, so you don’t need a permanently allocated swap file or swap partition.

[ClementToche]

Yes swap is enabled but it should not rely on that.
Like for "hashing" standard function, cryptographic function should "stream" encryption by buffers and not try to process the file as a whole in ram. This is really a bad design that may also open more easily to security issue.

[rcfa]

Yes swap is enabled but it should not rely on that.
Like for "hashing" standard function, cryptographic function should "stream" encryption by buffers and not try to process the file as a whole in ram. This is really a bad design that may also open more easily to security issue.

Exactly! This is particularly important when using it to back up severely memory/storage constrained v-server instances. Things that don't stream properly either crash due to being out of memory or out of disk space.