2021-06-10 03:05:31 [INFO] Starting.
2021-06-10 03:05:31 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/
2021-06-10 03:05:31 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/aggregate.hdf5
2021-06-10 03:05:31 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 03:05:31 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 03:05:32 [INFO] Building aggregate.
2021-06-10 03:05:32 [INFO] Writing every 10 Runs.
2021-06-10 03:05:32 [INFO] Processing SRX3312499. (1/6)
2021-06-10 03:05:32 [INFO] Processing SRX3312499-SRR6202586. (1/14)
2021-06-10 03:05:41 [INFO] Processing SRX3312499-SRR6202588. (2/14)
2021-06-10 03:05:54 [INFO] Processing SRX3312499-SRR6202587. (3/14)
2021-06-10 03:06:03 [INFO] Processing SRX3312500. (2/6)
2021-06-10 03:06:03 [INFO] Processing SRX3312500-SRR6202589. (4/14)
2021-06-10 03:06:40 [INFO] Processing SRX3312500-SRR6202590. (5/14)
2021-06-10 03:07:01 [INFO] Processing SRX3312496. (3/6)
2021-06-10 03:07:01 [INFO] Processing SRX3312496-SRR6202581. (6/14)
2021-06-10 03:07:17 [INFO] Processing SRX3312496-SRR6202580. (7/14)
2021-06-10 03:07:25 [INFO] Processing SRX3312496-SRR6202579. (8/14)
2021-06-10 03:07:57 [INFO] Processing SRX3312498. (4/6)
2021-06-10 03:07:57 [INFO] Processing SRX3312498-SRR6202585. (9/14)
2021-06-10 03:08:37 [INFO] Processing SRX3312501. (5/6)
2021-06-10 03:08:37 [INFO] Processing SRX3312501-SRR6202591. (10/14)
2021-06-10 03:09:08 [INFO] Writing to disk...
2021-06-10 03:09:23 [INFO] Processing SRX3312501-SRR6202592. (11/14)
2021-06-10 03:10:00 [INFO] Processing SRX3312497. (6/6)
2021-06-10 03:10:00 [INFO] Processing SRX3312497-SRR6202583. (12/14)
2021-06-10 03:10:16 [INFO] Processing SRX3312497-SRR6202584. (13/14)
2021-06-10 03:10:32 [INFO] Processing SRX3312497-SRR6202582. (14/14)
2021-06-10 03:10:59 [INFO] Writing to disk...
2021-06-10 03:11:20 [INFO] Finished.
2021-08-06 12:19:00 [INFO] SPECIAL NOTE: 1bp_raw aggregate build failed due to memory issues. It was manually copied in from a version that Ruchi calculated separately.
2021-08-12 14:31:17 [INFO] Starting.
2021-08-12 14:31:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/
2021-08-12 14:31:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/aggregate.hdf5
2021-08-12 14:31:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:18 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:18 [INFO] Writing every 10 Runs.
2021-08-12 14:31:18 [INFO] Processing SRX3312499. (1/6)
2021-08-12 14:31:18 [INFO] Processing SRX3312499-SRR6202586. (1/14)
2021-08-12 14:31:37 [INFO] Processing SRX3312499-SRR6202588. (2/14)
2021-08-12 14:32:00 [INFO] Processing SRX3312499-SRR6202587. (3/14)
2021-08-12 14:32:13 [INFO] Processing SRX3312500. (2/6)
2021-08-12 14:32:13 [INFO] Processing SRX3312500-SRR6202589. (4/14)
2021-08-12 14:32:47 [INFO] Processing SRX3312500-SRR6202590. (5/14)
2021-08-12 14:33:15 [INFO] Processing SRX3312496. (3/6)
2021-08-12 14:33:15 [INFO] Processing SRX3312496-SRR6202581. (6/14)
2021-08-12 14:33:36 [INFO] Processing SRX3312496-SRR6202580. (7/14)
2021-08-12 14:33:47 [INFO] Processing SRX3312496-SRR6202579. (8/14)
2021-08-12 14:34:17 [INFO] Processing SRX3312498. (4/6)
2021-08-12 14:34:17 [INFO] Processing SRX3312498-SRR6202585. (9/14)
2021-08-12 14:35:02 [INFO] Processing SRX3312501. (5/6)
2021-08-12 14:35:02 [INFO] Processing SRX3312501-SRR6202591. (10/14)
2021-08-12 14:35:27 [INFO] Writing to disk...
2021-08-12 14:35:49 [INFO] Processing SRX3312501-SRR6202592. (11/14)
2021-08-12 14:36:31 [INFO] Processing SRX3312497. (6/6)
2021-08-12 14:36:31 [INFO] Processing SRX3312497-SRR6202583. (12/14)
2021-08-12 14:36:42 [INFO] Processing SRX3312497-SRR6202584. (13/14)
2021-08-12 14:37:01 [INFO] Processing SRX3312497-SRR6202582. (14/14)
2021-08-12 14:37:31 [INFO] Writing to disk...
2021-08-12 14:37:57 [INFO] Finished.
2021-08-12 15:09:39 [INFO] Starting.
2021-08-12 15:09:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/
2021-08-12 15:09:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/aggregate.hdf5
2021-08-12 15:09:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:09:40 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 15:09:40 [INFO] Writing every 10 Runs.
2021-08-12 15:09:40 [INFO] Processing SRX3312499. (1/6)
2021-08-12 15:09:40 [INFO] Processing SRX3312499-SRR6202586. (1/14)
2021-08-12 15:09:59 [INFO] Processing SRX3312499-SRR6202588. (2/14)
2021-08-12 15:10:20 [INFO] Processing SRX3312499-SRR6202587. (3/14)
2021-08-12 15:10:29 [INFO] Processing SRX3312500. (2/6)
2021-08-12 15:10:29 [INFO] Processing SRX3312500-SRR6202589. (4/14)
2021-08-12 15:10:56 [INFO] Processing SRX3312500-SRR6202590. (5/14)
2021-08-12 15:11:21 [INFO] Processing SRX3312496. (3/6)
2021-08-12 15:11:21 [INFO] Processing SRX3312496-SRR6202581. (6/14)
2021-08-12 15:11:38 [INFO] Processing SRX3312496-SRR6202580. (7/14)
2021-08-12 15:11:46 [INFO] Processing SRX3312496-SRR6202579. (8/14)
2021-08-12 15:12:13 [INFO] Processing SRX3312498. (4/6)
2021-08-12 15:12:13 [INFO] Processing SRX3312498-SRR6202585. (9/14)
2021-08-12 15:12:53 [INFO] Processing SRX3312501. (5/6)
2021-08-12 15:12:53 [INFO] Processing SRX3312501-SRR6202591. (10/14)
2021-08-12 15:13:17 [INFO] Writing to disk...
2021-08-12 15:13:34 [INFO] Processing SRX3312501-SRR6202592. (11/14)
2021-08-12 15:14:12 [INFO] Processing SRX3312497. (6/6)
2021-08-12 15:14:12 [INFO] Processing SRX3312497-SRR6202583. (12/14)
2021-08-12 15:14:22 [INFO] Processing SRX3312497-SRR6202584. (13/14)
2021-08-12 15:14:43 [INFO] Processing SRX3312497-SRR6202582. (14/14)
2021-08-12 15:15:14 [INFO] Writing to disk...
2021-08-12 15:15:40 [INFO] Finished.
2021-08-12 15:44:39 [INFO] Starting.
2021-08-12 15:44:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/
2021-08-12 15:44:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/aggregate.hdf5
2021-08-12 15:44:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:44:39 [INFO] Building aggregate for 5kbp_raw network.
2021-08-12 15:44:39 [INFO] Writing every 10 Runs.
2021-08-12 15:44:39 [INFO] Processing SRX3312499. (1/6)
2021-08-12 15:44:39 [INFO] Processing SRX3312499-SRR6202586. (1/14)
2021-08-12 15:45:00 [INFO] Processing SRX3312499-SRR6202588. (2/14)
2021-08-12 15:45:21 [INFO] Processing SRX3312499-SRR6202587. (3/14)
2021-08-12 15:45:31 [INFO] Processing SRX3312500. (2/6)
2021-08-12 15:45:31 [INFO] Processing SRX3312500-SRR6202589. (4/14)
2021-08-12 15:46:00 [INFO] Processing SRX3312500-SRR6202590. (5/14)
2021-08-12 15:46:25 [INFO] Processing SRX3312496. (3/6)
2021-08-12 15:46:25 [INFO] Processing SRX3312496-SRR6202581. (6/14)
2021-08-12 15:46:47 [INFO] Processing SRX3312496-SRR6202580. (7/14)
2021-08-12 15:46:57 [INFO] Processing SRX3312496-SRR6202579. (8/14)
2021-08-12 15:47:23 [INFO] Processing SRX3312498. (4/6)
2021-08-12 15:47:23 [INFO] Processing SRX3312498-SRR6202585. (9/14)
2021-08-12 15:48:13 [INFO] Processing SRX3312501. (5/6)
2021-08-12 15:48:13 [INFO] Processing SRX3312501-SRR6202591. (10/14)
2021-08-12 15:48:43 [INFO] Writing to disk...
2021-08-12 15:49:04 [INFO] Processing SRX3312501-SRR6202592. (11/14)
2021-08-12 15:49:48 [INFO] Processing SRX3312497. (6/6)
2021-08-12 15:49:48 [INFO] Processing SRX3312497-SRR6202583. (12/14)
2021-08-12 15:50:00 [INFO] Processing SRX3312497-SRR6202584. (13/14)
2021-08-12 15:50:22 [INFO] Processing SRX3312497-SRR6202582. (14/14)
2021-08-12 15:50:50 [INFO] Writing to disk...
2021-08-12 15:51:16 [INFO] Finished.
2021-08-12 16:31:37 [INFO] Starting.
2021-08-12 16:31:37 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/
2021-08-12 16:31:37 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/aggregate.hdf5
2021-08-12 16:31:37 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:31:38 [INFO] Building aggregate for 1kbp_raw network.
2021-08-12 16:31:38 [INFO] Writing every 10 Runs.
2021-08-12 16:31:38 [INFO] Processing SRX3312499. (1/6)
2021-08-12 16:31:38 [INFO] Processing SRX3312499-SRR6202586. (1/14)
2021-08-12 16:32:02 [INFO] Processing SRX3312499-SRR6202588. (2/14)
2021-08-12 16:32:28 [INFO] Processing SRX3312499-SRR6202587. (3/14)
2021-08-12 16:32:42 [INFO] Processing SRX3312500. (2/6)
2021-08-12 16:32:42 [INFO] Processing SRX3312500-SRR6202589. (4/14)
2021-08-12 16:33:13 [INFO] Processing SRX3312500-SRR6202590. (5/14)
2021-08-12 16:33:46 [INFO] Processing SRX3312496. (3/6)
2021-08-12 16:33:46 [INFO] Processing SRX3312496-SRR6202581. (6/14)
2021-08-12 16:34:09 [INFO] Processing SRX3312496-SRR6202580. (7/14)
2021-08-12 16:34:22 [INFO] Processing SRX3312496-SRR6202579. (8/14)
2021-08-12 16:34:58 [INFO] Processing SRX3312498. (4/6)
2021-08-12 16:34:58 [INFO] Processing SRX3312498-SRR6202585. (9/14)
2021-08-12 16:35:53 [INFO] Processing SRX3312501. (5/6)
2021-08-12 16:35:53 [INFO] Processing SRX3312501-SRR6202591. (10/14)
2021-08-12 16:36:32 [INFO] Writing to disk...
2021-08-12 16:37:02 [INFO] Processing SRX3312501-SRR6202592. (11/14)
2021-08-12 16:37:54 [INFO] Processing SRX3312497. (6/6)
2021-08-12 16:37:54 [INFO] Processing SRX3312497-SRR6202583. (12/14)
2021-08-12 16:38:14 [INFO] Processing SRX3312497-SRR6202584. (13/14)
2021-08-12 16:38:46 [INFO] Processing SRX3312497-SRR6202582. (14/14)
2021-08-12 16:39:29 [INFO] Writing to disk...
2021-08-12 16:40:05 [INFO] Finished.
2021-08-20 17:50:48 [INFO] Starting.
2021-08-20 17:50:48 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/
2021-08-20 17:50:48 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/aggregate.hdf5
2021-08-20 17:50:48 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-20 17:50:49 [INFO] Building aggregate for 100kbp_raw network.
2021-08-20 17:50:49 [INFO] Writing every 10 Runs.
2021-08-20 17:50:49 [INFO] Processing SRX3312499. (1/6)
2021-08-20 17:50:49 [INFO] Processing SRX3312499-SRR6202586. (1/14)
2021-08-20 17:51:08 [INFO] Processing SRX3312499-SRR6202588. (2/14)
2021-08-20 17:51:30 [INFO] Processing SRX3312499-SRR6202587. (3/14)
2021-08-20 17:51:41 [INFO] Processing SRX3312500. (2/6)
2021-08-20 17:51:41 [INFO] Processing SRX3312500-SRR6202589. (4/14)
2021-08-20 17:52:07 [INFO] Processing SRX3312500-SRR6202590. (5/14)
2021-08-20 17:52:29 [INFO] Processing SRX3312496. (3/6)
2021-08-20 17:52:29 [INFO] Processing SRX3312496-SRR6202581. (6/14)
2021-08-20 17:52:50 [INFO] Processing SRX3312496-SRR6202580. (7/14)
2021-08-20 17:52:58 [INFO] Processing SRX3312496-SRR6202579. (8/14)
2021-08-20 17:53:24 [INFO] Processing SRX3312498. (4/6)
2021-08-20 17:53:24 [INFO] Processing SRX3312498-SRR6202585. (9/14)
2021-08-20 17:54:01 [INFO] Processing SRX3312501. (5/6)
2021-08-20 17:54:01 [INFO] Processing SRX3312501-SRR6202591. (10/14)
2021-08-20 17:54:25 [INFO] Writing to disk...
2021-08-20 17:54:35 [INFO] Processing SRX3312501-SRR6202592. (11/14)
2021-08-20 17:55:02 [INFO] Processing SRX3312497. (6/6)
2021-08-20 17:55:02 [INFO] Processing SRX3312497-SRR6202583. (12/14)
2021-08-20 17:55:13 [INFO] Processing SRX3312497-SRR6202584. (13/14)
2021-08-20 17:55:30 [INFO] Processing SRX3312497-SRR6202582. (14/14)
2021-08-20 17:55:55 [INFO] Writing to disk...
2021-08-20 17:56:09 [INFO] Finished.
2021-08-23 11:28:00 [INFO] Starting.
2021-08-23 11:28:00 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/
2021-08-23 11:28:00 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/aggregate.hdf5
2021-08-23 11:28:00 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 11:28:01 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 11:28:01 [INFO] Writing every 10 Runs.
2021-08-23 11:28:01 [INFO] Processing SRX3312499. (1/6)
2021-08-23 11:28:01 [INFO] Processing SRX3312499-SRR6202586. (1/14)
2021-08-23 11:28:11 [INFO] Processing SRX3312499-SRR6202588. (2/14)
2021-08-23 11:28:21 [INFO] Processing SRX3312499-SRR6202587. (3/14)
2021-08-23 11:28:29 [INFO] Processing SRX3312500. (2/6)
2021-08-23 11:28:29 [INFO] Processing SRX3312500-SRR6202589. (4/14)
2021-08-23 11:28:43 [INFO] Processing SRX3312500-SRR6202590. (5/14)
2021-08-23 11:28:57 [INFO] Processing SRX3312496. (3/6)
2021-08-23 11:28:57 [INFO] Processing SRX3312496-SRR6202581. (6/14)
2021-08-23 11:29:05 [INFO] Processing SRX3312496-SRR6202580. (7/14)
2021-08-23 11:29:10 [INFO] Processing SRX3312496-SRR6202579. (8/14)
2021-08-23 11:29:24 [INFO] Processing SRX3312498. (4/6)
2021-08-23 11:29:24 [INFO] Processing SRX3312498-SRR6202585. (9/14)
2021-08-23 11:29:40 [INFO] Processing SRX3312501. (5/6)
2021-08-23 11:29:40 [INFO] Processing SRX3312501-SRR6202591. (10/14)
2021-08-23 11:29:54 [INFO] Writing to disk...
2021-08-23 11:29:56 [INFO] Processing SRX3312501-SRR6202592. (11/14)
2021-08-23 11:30:12 [INFO] Processing SRX3312497. (6/6)
2021-08-23 11:30:12 [INFO] Processing SRX3312497-SRR6202583. (12/14)
2021-08-23 11:30:19 [INFO] Processing SRX3312497-SRR6202584. (13/14)
2021-08-23 11:30:30 [INFO] Processing SRX3312497-SRR6202582. (14/14)
2021-08-23 11:30:43 [INFO] Writing to disk...
2021-08-23 11:30:45 [INFO] Finished.
2021-08-23 13:15:16 [INFO] Starting.
2021-08-23 13:15:16 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/
2021-08-23 13:15:16 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP120957/aggregate.hdf5
2021-08-23 13:15:16 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:15:17 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 13:15:17 [INFO] Writing every 10 Runs.
2021-08-23 13:15:17 [INFO] Processing SRX3312499. (1/6)
2021-08-23 13:15:17 [INFO] Processing SRX3312499-SRR6202586. (1/14)
2021-08-23 13:15:23 [INFO] Processing SRX3312499-SRR6202588. (2/14)
2021-08-23 13:15:31 [INFO] Processing SRX3312499-SRR6202587. (3/14)
2021-08-23 13:15:36 [INFO] Processing SRX3312500. (2/6)
2021-08-23 13:15:36 [INFO] Processing SRX3312500-SRR6202589. (4/14)
2021-08-23 13:15:43 [INFO] Processing SRX3312500-SRR6202590. (5/14)
2021-08-23 13:15:51 [INFO] Processing SRX3312496. (3/6)
2021-08-23 13:15:51 [INFO] Processing SRX3312496-SRR6202581. (6/14)
2021-08-23 13:15:58 [INFO] Processing SRX3312496-SRR6202580. (7/14)
2021-08-23 13:16:02 [INFO] Processing SRX3312496-SRR6202579. (8/14)
2021-08-23 13:16:07 [INFO] Processing SRX3312498. (4/6)
2021-08-23 13:16:07 [INFO] Processing SRX3312498-SRR6202585. (9/14)
2021-08-23 13:16:15 [INFO] Processing SRX3312501. (5/6)
2021-08-23 13:16:15 [INFO] Processing SRX3312501-SRR6202591. (10/14)
2021-08-23 13:16:23 [INFO] Writing to disk...
2021-08-23 13:16:24 [INFO] Processing SRX3312501-SRR6202592. (11/14)
2021-08-23 13:16:32 [INFO] Processing SRX3312497. (6/6)
2021-08-23 13:16:32 [INFO] Processing SRX3312497-SRR6202583. (12/14)
2021-08-23 13:16:36 [INFO] Processing SRX3312497-SRR6202584. (13/14)
2021-08-23 13:16:43 [INFO] Processing SRX3312497-SRR6202582. (14/14)
2021-08-23 13:16:50 [INFO] Writing to disk...
2021-08-23 13:16:51 [INFO] Finished.