Skip to content

Splitting toconfirmation files

Handling Large Confirmation Files

This procedure should be followed when confirmation files exceed ~4MB in the directory: apps/data/Midgard/report/confirmation

Notification email from zabbix is sent with subject: Out of Memory at LH MG on toconfirmationsender.out

Steps:

  1. Move the large file(s): Transfer the oversized confirmation file(s) from Apps/data/Midgard/report/confirmation to /home/qcuser/toconfsplit/.

  2. Run the splitting script: Execute the script, replacing [filename] with the actual name of the large file you moved: /home/qcuser/split_confirmation.sh [filename]

    • What the script does:
      • Splits the large input file into multiple smaller confirmation files.
      • Moves the original, large CSV file to an archive.
      • Places the newly created, smaller confirmation files back into Apps/data/Midgard/report/confirmation.