Import or Export fails with memory overflow

Problem

Import or Export fails with a memory overflow when working with large amounts of data.

Cause

When working with data, it's not cached by the IDE. However, the JDBC driver used for connection as an intermittent point might use caching, which could lead to memory overflow, especially with greater amounts of data.

Resolution

Increase the RAM allocated to the remote process as described below:

1. Open your data source properties (right-click the data source and select Properties).
2. Go to the Advanced tab and locate the VM Options field.

3. Add the following option, replacing # with the number of gigabytes you need to allocate (for example, -Xmx2G for 2 GB):

   -Xmx#G

   

   In this particular case, the RAM is set in GB, but a more granular measure can be set if needed.

Once it's set and changes are applied, the remote process will be initiated with more RAM assigned to it and, as a result, will prevent memory exhaustion when working with tasks processing bigger amounts of data.