IBM Support

Datastage PX job Error Message: Sort_17,2: write failed: Output file full, and no more
output files [sort/merger.C:1393]

Troubleshooting


Problem

Error Message: Sort_17,2: write failed: Output file full, and no more output files [sort/merger.C:1393] Message: Sort_17,2: Fatal Error: Tsort merger aborting: mergeOneRecord() punted [sort/merger.C:1214] Message: Sort_17,2: Fatal Error: Pipe read failed: short read [sort/m erger.C:1740]

Cause

This error is normally an indication that during job execution, it is running out of scratch, temporary or swap space. Checking the amount of space available without the job running can give a false indication that there is enough space

Diagnosing The Problem

Open the configuration file that is being used by the job. This can be found by checking the APT_CONFIG_FILE parameter of the job. You can find the configuration file in ../IBM/InformationServer/Server/Configurations/*.apt, Look to see the location of the scratch space identified for each node.

While the job is running, issue the following command:
df -k
This command will provide the amount of space allocated and being used on the system. Make sure that there is space available for /tmp, /swap and the scratch area. Also make sure that the location identified in the configuration file for scratch space also has enough space

Resolving The Problem

Increase the disk space for /tmp, /swap and /scratch. You can also add an additional scratch area in your configuration file. For instance, you may add a second scratch disk area, like this:
node "node1"
{
fastname "gcp5bs03"
pools ""
resource disk "/opt/local/InformationServer/Server/Datasets" {pools ""}
resource scratchdisk "/opt/local/InformationServer/Server/Scratch" {pools ""}
resource scratchdisk "/etc/svc/volatile" {pools ""}
}

[{"Product":{"code":"SSVSEF","label":"IBM InfoSphere DataStage"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Component":"--","Platform":[{"code":"PF027","label":"Solaris"},{"code":"PF016","label":"Linux"},{"code":"PF010","label":"HP-UX"},{"code":"PF002","label":"AIX"}],"Version":"8.1;8.0.1;7.5.3","Edition":"","Line of Business":{"code":"LOB10","label":"Data and AI"}}]

Document Information

Modified date:
16 June 2018

UID

swg21444852