2021-06-10 03:54:42 [INFO] Starting.
2021-06-10 03:54:42 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/
2021-06-10 03:54:42 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/aggregate.hdf5
2021-06-10 03:54:42 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 03:54:42 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 03:54:42 [INFO] Building aggregate.
2021-06-10 03:54:42 [INFO] Writing every 10 Runs.
2021-06-10 03:54:42 [INFO] Processing SRX5807390. (1/6)
2021-06-10 03:54:42 [INFO] Processing SRX5807390-SRR9030109. (1/6)
2021-06-10 03:54:55 [INFO] Processing SRX5807392. (2/6)
2021-06-10 03:54:55 [INFO] Processing SRX5807392-SRR9030111. (2/6)
2021-06-10 03:55:07 [INFO] Processing SRX5807395. (3/6)
2021-06-10 03:55:07 [INFO] Processing SRX5807395-SRR9030114. (3/6)
2021-06-10 03:55:19 [INFO] Processing SRX5807391. (4/6)
2021-06-10 03:55:19 [INFO] Processing SRX5807391-SRR9030110. (4/6)
2021-06-10 03:55:31 [INFO] Processing SRX5807393. (5/6)
2021-06-10 03:55:31 [INFO] Processing SRX5807393-SRR9030112. (5/6)
2021-06-10 03:55:42 [INFO] Processing SRX5807394. (6/6)
2021-06-10 03:55:42 [INFO] Processing SRX5807394-SRR9030113. (6/6)
2021-06-10 03:55:53 [INFO] Writing to disk...
2021-06-10 03:55:56 [INFO] Finished.
2021-08-06 12:19:00 [INFO] SPECIAL NOTE: 1bp_raw aggregate build failed due to memory issues. It was manually copied in from a version that Ruchi calculated separately.
2021-08-12 14:31:17 [INFO] Starting.
2021-08-12 14:31:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/
2021-08-12 14:31:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/aggregate.hdf5
2021-08-12 14:31:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:18 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:18 [INFO] Writing every 10 Runs.
2021-08-12 14:31:18 [INFO] Processing SRX5807390. (1/6)
2021-08-12 14:31:18 [INFO] Processing SRX5807390-SRR9030109. (1/6)
2021-08-12 14:31:31 [INFO] Processing SRX5807392. (2/6)
2021-08-12 14:31:31 [INFO] Processing SRX5807392-SRR9030111. (2/6)
2021-08-12 14:31:42 [INFO] Processing SRX5807395. (3/6)
2021-08-12 14:31:42 [INFO] Processing SRX5807395-SRR9030114. (3/6)
2021-08-12 14:31:50 [INFO] Processing SRX5807391. (4/6)
2021-08-12 14:31:50 [INFO] Processing SRX5807391-SRR9030110. (4/6)
2021-08-12 14:32:01 [INFO] Processing SRX5807393. (5/6)
2021-08-12 14:32:01 [INFO] Processing SRX5807393-SRR9030112. (5/6)
2021-08-12 14:32:12 [INFO] Processing SRX5807394. (6/6)
2021-08-12 14:32:12 [INFO] Processing SRX5807394-SRR9030113. (6/6)
2021-08-12 14:32:23 [INFO] Writing to disk...
2021-08-12 14:32:27 [INFO] Finished.
2021-08-12 15:09:39 [INFO] Starting.
2021-08-12 15:09:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/
2021-08-12 15:09:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/aggregate.hdf5
2021-08-12 15:09:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:09:40 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 15:09:40 [INFO] Writing every 10 Runs.
2021-08-12 15:09:40 [INFO] Processing SRX5807390. (1/6)
2021-08-12 15:09:40 [INFO] Processing SRX5807390-SRR9030109. (1/6)
2021-08-12 15:09:52 [INFO] Processing SRX5807392. (2/6)
2021-08-12 15:09:52 [INFO] Processing SRX5807392-SRR9030111. (2/6)
2021-08-12 15:10:02 [INFO] Processing SRX5807395. (3/6)
2021-08-12 15:10:02 [INFO] Processing SRX5807395-SRR9030114. (3/6)
2021-08-12 15:10:11 [INFO] Processing SRX5807391. (4/6)
2021-08-12 15:10:11 [INFO] Processing SRX5807391-SRR9030110. (4/6)
2021-08-12 15:10:23 [INFO] Processing SRX5807393. (5/6)
2021-08-12 15:10:23 [INFO] Processing SRX5807393-SRR9030112. (5/6)
2021-08-12 15:10:33 [INFO] Processing SRX5807394. (6/6)
2021-08-12 15:10:33 [INFO] Processing SRX5807394-SRR9030113. (6/6)
2021-08-12 15:10:44 [INFO] Writing to disk...
2021-08-12 15:10:47 [INFO] Finished.
2021-08-12 15:44:41 [INFO] Starting.
2021-08-12 15:44:41 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/
2021-08-12 15:44:41 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/aggregate.hdf5
2021-08-12 15:44:41 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:44:42 [INFO] Building aggregate for 5kbp_raw network.
2021-08-12 15:44:42 [INFO] Writing every 10 Runs.
2021-08-12 15:44:42 [INFO] Processing SRX5807390. (1/6)
2021-08-12 15:44:42 [INFO] Processing SRX5807390-SRR9030109. (1/6)
2021-08-12 15:44:55 [INFO] Processing SRX5807392. (2/6)
2021-08-12 15:44:55 [INFO] Processing SRX5807392-SRR9030111. (2/6)
2021-08-12 15:45:07 [INFO] Processing SRX5807395. (3/6)
2021-08-12 15:45:07 [INFO] Processing SRX5807395-SRR9030114. (3/6)
2021-08-12 15:45:16 [INFO] Processing SRX5807391. (4/6)
2021-08-12 15:45:16 [INFO] Processing SRX5807391-SRR9030110. (4/6)
2021-08-12 15:45:28 [INFO] Processing SRX5807393. (5/6)
2021-08-12 15:45:28 [INFO] Processing SRX5807393-SRR9030112. (5/6)
2021-08-12 15:45:39 [INFO] Processing SRX5807394. (6/6)
2021-08-12 15:45:39 [INFO] Processing SRX5807394-SRR9030113. (6/6)
2021-08-12 15:45:51 [INFO] Writing to disk...
2021-08-12 15:45:56 [INFO] Finished.
2021-08-12 16:32:03 [INFO] Starting.
2021-08-12 16:32:03 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/
2021-08-12 16:32:03 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/aggregate.hdf5
2021-08-12 16:32:03 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:32:04 [INFO] Building aggregate for 1kbp_raw network.
2021-08-12 16:32:04 [INFO] Writing every 10 Runs.
2021-08-12 16:32:04 [INFO] Processing SRX5807390. (1/6)
2021-08-12 16:32:04 [INFO] Processing SRX5807390-SRR9030109. (1/6)
2021-08-12 16:32:16 [INFO] Processing SRX5807392. (2/6)
2021-08-12 16:32:16 [INFO] Processing SRX5807392-SRR9030111. (2/6)
2021-08-12 16:32:30 [INFO] Processing SRX5807395. (3/6)
2021-08-12 16:32:30 [INFO] Processing SRX5807395-SRR9030114. (3/6)
2021-08-12 16:32:42 [INFO] Processing SRX5807391. (4/6)
2021-08-12 16:32:42 [INFO] Processing SRX5807391-SRR9030110. (4/6)
2021-08-12 16:32:55 [INFO] Processing SRX5807393. (5/6)
2021-08-12 16:32:55 [INFO] Processing SRX5807393-SRR9030112. (5/6)
2021-08-12 16:33:07 [INFO] Processing SRX5807394. (6/6)
2021-08-12 16:33:07 [INFO] Processing SRX5807394-SRR9030113. (6/6)
2021-08-12 16:33:21 [INFO] Writing to disk...
2021-08-12 16:33:25 [INFO] Finished.
2021-08-20 17:58:27 [INFO] Starting.
2021-08-20 17:58:27 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/
2021-08-20 17:58:27 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/aggregate.hdf5
2021-08-20 17:58:27 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-20 17:58:27 [INFO] Building aggregate for 100kbp_raw network.
2021-08-20 17:58:27 [INFO] Writing every 10 Runs.
2021-08-20 17:58:27 [INFO] Processing SRX5807390. (1/6)
2021-08-20 17:58:27 [INFO] Processing SRX5807390-SRR9030109. (1/6)
2021-08-20 17:58:36 [INFO] Processing SRX5807392. (2/6)
2021-08-20 17:58:36 [INFO] Processing SRX5807392-SRR9030111. (2/6)
2021-08-20 17:58:44 [INFO] Processing SRX5807395. (3/6)
2021-08-20 17:58:44 [INFO] Processing SRX5807395-SRR9030114. (3/6)
2021-08-20 17:58:51 [INFO] Processing SRX5807391. (4/6)
2021-08-20 17:58:51 [INFO] Processing SRX5807391-SRR9030110. (4/6)
2021-08-20 17:58:59 [INFO] Processing SRX5807393. (5/6)
2021-08-20 17:58:59 [INFO] Processing SRX5807393-SRR9030112. (5/6)
2021-08-20 17:59:07 [INFO] Processing SRX5807394. (6/6)
2021-08-20 17:59:07 [INFO] Processing SRX5807394-SRR9030113. (6/6)
2021-08-20 17:59:17 [INFO] Writing to disk...
2021-08-20 17:59:19 [INFO] Finished.
2021-08-23 11:29:54 [INFO] Starting.
2021-08-23 11:29:54 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/
2021-08-23 11:29:54 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/aggregate.hdf5
2021-08-23 11:29:54 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 11:29:55 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 11:29:55 [INFO] Writing every 10 Runs.
2021-08-23 11:29:55 [INFO] Processing SRX5807390. (1/6)
2021-08-23 11:29:55 [INFO] Processing SRX5807390-SRR9030109. (1/6)
2021-08-23 11:30:03 [INFO] Processing SRX5807392. (2/6)
2021-08-23 11:30:03 [INFO] Processing SRX5807392-SRR9030111. (2/6)
2021-08-23 11:30:08 [INFO] Processing SRX5807395. (3/6)
2021-08-23 11:30:08 [INFO] Processing SRX5807395-SRR9030114. (3/6)
2021-08-23 11:30:14 [INFO] Processing SRX5807391. (4/6)
2021-08-23 11:30:14 [INFO] Processing SRX5807391-SRR9030110. (4/6)
2021-08-23 11:30:22 [INFO] Processing SRX5807393. (5/6)
2021-08-23 11:30:22 [INFO] Processing SRX5807393-SRR9030112. (5/6)
2021-08-23 11:30:28 [INFO] Processing SRX5807394. (6/6)
2021-08-23 11:30:28 [INFO] Processing SRX5807394-SRR9030113. (6/6)
2021-08-23 11:30:36 [INFO] Writing to disk...
2021-08-23 11:30:37 [INFO] Finished.
2021-08-23 13:16:28 [INFO] Starting.
2021-08-23 13:16:28 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/
2021-08-23 13:16:28 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP197114/aggregate.hdf5
2021-08-23 13:16:28 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:16:29 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 13:16:29 [INFO] Writing every 10 Runs.
2021-08-23 13:16:29 [INFO] Processing SRX5807390. (1/6)
2021-08-23 13:16:29 [INFO] Processing SRX5807390-SRR9030109. (1/6)
2021-08-23 13:16:34 [INFO] Processing SRX5807392. (2/6)
2021-08-23 13:16:34 [INFO] Processing SRX5807392-SRR9030111. (2/6)
2021-08-23 13:16:38 [INFO] Processing SRX5807395. (3/6)
2021-08-23 13:16:38 [INFO] Processing SRX5807395-SRR9030114. (3/6)
2021-08-23 13:16:42 [INFO] Processing SRX5807391. (4/6)
2021-08-23 13:16:42 [INFO] Processing SRX5807391-SRR9030110. (4/6)
2021-08-23 13:16:47 [INFO] Processing SRX5807393. (5/6)
2021-08-23 13:16:47 [INFO] Processing SRX5807393-SRR9030112. (5/6)
2021-08-23 13:16:52 [INFO] Processing SRX5807394. (6/6)
2021-08-23 13:16:52 [INFO] Processing SRX5807394-SRR9030113. (6/6)
2021-08-23 13:16:57 [INFO] Writing to disk...
2021-08-23 13:16:58 [INFO] Finished.