2021-06-10 03:40:01 [INFO] Starting.
2021-06-10 03:40:01 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/
2021-06-10 03:40:01 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/aggregate.hdf5
2021-06-10 03:40:01 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 03:40:01 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 03:40:02 [INFO] Building aggregate.
2021-06-10 03:40:02 [INFO] Writing every 10 Runs.
2021-06-10 03:40:02 [INFO] Processing SRX6095624. (1/8)
2021-06-10 03:40:02 [INFO] Processing SRX6095624-SRR9328809. (1/8)
2021-06-10 03:40:15 [INFO] Processing SRX6095626. (2/8)
2021-06-10 03:40:15 [INFO] Processing SRX6095626-SRR9328811. (2/8)
2021-06-10 03:40:24 [INFO] Processing SRX6095620. (3/8)
2021-06-10 03:40:24 [INFO] Processing SRX6095620-SRR9328805. (3/8)
2021-06-10 03:40:35 [INFO] Processing SRX6095625. (4/8)
2021-06-10 03:40:35 [INFO] Processing SRX6095625-SRR9328810. (4/8)
2021-06-10 03:40:42 [INFO] Processing SRX6095622. (5/8)
2021-06-10 03:40:42 [INFO] Processing SRX6095622-SRR9328807. (5/8)
2021-06-10 03:40:55 [INFO] Processing SRX6095621. (6/8)
2021-06-10 03:40:55 [INFO] Processing SRX6095621-SRR9328806. (6/8)
2021-06-10 03:41:07 [INFO] Processing SRX6095619. (7/8)
2021-06-10 03:41:07 [INFO] Processing SRX6095619-SRR9328804. (7/8)
2021-06-10 03:41:16 [INFO] Processing SRX6095623. (8/8)
2021-06-10 03:41:16 [INFO] Processing SRX6095623-SRR9328808. (8/8)
2021-06-10 03:41:27 [INFO] Writing to disk...
2021-06-10 03:41:32 [INFO] Finished.
2021-08-06 12:19:00 [INFO] SPECIAL NOTE: 1bp_raw aggregate build failed due to memory issues. It was manually copied in from a version that Ruchi calculated separately.
2021-08-12 14:31:16 [INFO] Starting.
2021-08-12 14:31:16 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/
2021-08-12 14:31:16 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/aggregate.hdf5
2021-08-12 14:31:16 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:18 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:18 [INFO] Writing every 10 Runs.
2021-08-12 14:31:18 [INFO] Processing SRX6095624. (1/8)
2021-08-12 14:31:18 [INFO] Processing SRX6095624-SRR9328809. (1/8)
2021-08-12 14:31:32 [INFO] Processing SRX6095626. (2/8)
2021-08-12 14:31:32 [INFO] Processing SRX6095626-SRR9328811. (2/8)
2021-08-12 14:31:43 [INFO] Processing SRX6095620. (3/8)
2021-08-12 14:31:43 [INFO] Processing SRX6095620-SRR9328805. (3/8)
2021-08-12 14:31:58 [INFO] Processing SRX6095625. (4/8)
2021-08-12 14:31:58 [INFO] Processing SRX6095625-SRR9328810. (4/8)
2021-08-12 14:32:07 [INFO] Processing SRX6095622. (5/8)
2021-08-12 14:32:07 [INFO] Processing SRX6095622-SRR9328807. (5/8)
2021-08-12 14:32:20 [INFO] Processing SRX6095621. (6/8)
2021-08-12 14:32:20 [INFO] Processing SRX6095621-SRR9328806. (6/8)
2021-08-12 14:32:34 [INFO] Processing SRX6095619. (7/8)
2021-08-12 14:32:34 [INFO] Processing SRX6095619-SRR9328804. (7/8)
2021-08-12 14:32:47 [INFO] Processing SRX6095623. (8/8)
2021-08-12 14:32:47 [INFO] Processing SRX6095623-SRR9328808. (8/8)
2021-08-12 14:33:02 [INFO] Writing to disk...
2021-08-12 14:33:08 [INFO] Finished.
2021-08-12 15:09:39 [INFO] Starting.
2021-08-12 15:09:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/
2021-08-12 15:09:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/aggregate.hdf5
2021-08-12 15:09:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:09:40 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 15:09:40 [INFO] Writing every 10 Runs.
2021-08-12 15:09:40 [INFO] Processing SRX6095624. (1/8)
2021-08-12 15:09:40 [INFO] Processing SRX6095624-SRR9328809. (1/8)
2021-08-12 15:09:53 [INFO] Processing SRX6095626. (2/8)
2021-08-12 15:09:53 [INFO] Processing SRX6095626-SRR9328811. (2/8)
2021-08-12 15:10:03 [INFO] Processing SRX6095620. (3/8)
2021-08-12 15:10:03 [INFO] Processing SRX6095620-SRR9328805. (3/8)
2021-08-12 15:10:16 [INFO] Processing SRX6095625. (4/8)
2021-08-12 15:10:16 [INFO] Processing SRX6095625-SRR9328810. (4/8)
2021-08-12 15:10:25 [INFO] Processing SRX6095622. (5/8)
2021-08-12 15:10:25 [INFO] Processing SRX6095622-SRR9328807. (5/8)
2021-08-12 15:10:35 [INFO] Processing SRX6095621. (6/8)
2021-08-12 15:10:35 [INFO] Processing SRX6095621-SRR9328806. (6/8)
2021-08-12 15:10:46 [INFO] Processing SRX6095619. (7/8)
2021-08-12 15:10:46 [INFO] Processing SRX6095619-SRR9328804. (7/8)
2021-08-12 15:10:59 [INFO] Processing SRX6095623. (8/8)
2021-08-12 15:10:59 [INFO] Processing SRX6095623-SRR9328808. (8/8)
2021-08-12 15:11:13 [INFO] Writing to disk...
2021-08-12 15:11:17 [INFO] Finished.
2021-08-12 15:44:39 [INFO] Starting.
2021-08-12 15:44:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/
2021-08-12 15:44:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/aggregate.hdf5
2021-08-12 15:44:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:44:40 [INFO] Building aggregate for 5kbp_raw network.
2021-08-12 15:44:40 [INFO] Writing every 10 Runs.
2021-08-12 15:44:40 [INFO] Processing SRX6095624. (1/8)
2021-08-12 15:44:40 [INFO] Processing SRX6095624-SRR9328809. (1/8)
2021-08-12 15:44:57 [INFO] Processing SRX6095626. (2/8)
2021-08-12 15:44:57 [INFO] Processing SRX6095626-SRR9328811. (2/8)
2021-08-12 15:45:09 [INFO] Processing SRX6095620. (3/8)
2021-08-12 15:45:09 [INFO] Processing SRX6095620-SRR9328805. (3/8)
2021-08-12 15:45:24 [INFO] Processing SRX6095625. (4/8)
2021-08-12 15:45:24 [INFO] Processing SRX6095625-SRR9328810. (4/8)
2021-08-12 15:45:35 [INFO] Processing SRX6095622. (5/8)
2021-08-12 15:45:35 [INFO] Processing SRX6095622-SRR9328807. (5/8)
2021-08-12 15:45:49 [INFO] Processing SRX6095621. (6/8)
2021-08-12 15:45:49 [INFO] Processing SRX6095621-SRR9328806. (6/8)
2021-08-12 15:46:04 [INFO] Processing SRX6095619. (7/8)
2021-08-12 15:46:04 [INFO] Processing SRX6095619-SRR9328804. (7/8)
2021-08-12 15:46:20 [INFO] Processing SRX6095623. (8/8)
2021-08-12 15:46:20 [INFO] Processing SRX6095623-SRR9328808. (8/8)
2021-08-12 15:46:37 [INFO] Writing to disk...
2021-08-12 15:46:45 [INFO] Finished.
2021-08-12 16:31:34 [INFO] Starting.
2021-08-12 16:31:34 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/
2021-08-12 16:31:34 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/aggregate.hdf5
2021-08-12 16:31:34 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:31:36 [INFO] Building aggregate for 1kbp_raw network.
2021-08-12 16:31:36 [INFO] Writing every 10 Runs.
2021-08-12 16:31:36 [INFO] Processing SRX6095624. (1/8)
2021-08-12 16:31:36 [INFO] Processing SRX6095624-SRR9328809. (1/8)
2021-08-12 16:31:54 [INFO] Processing SRX6095626. (2/8)
2021-08-12 16:31:54 [INFO] Processing SRX6095626-SRR9328811. (2/8)
2021-08-12 16:32:09 [INFO] Processing SRX6095620. (3/8)
2021-08-12 16:32:09 [INFO] Processing SRX6095620-SRR9328805. (3/8)
2021-08-12 16:32:26 [INFO] Processing SRX6095625. (4/8)
2021-08-12 16:32:26 [INFO] Processing SRX6095625-SRR9328810. (4/8)
2021-08-12 16:32:40 [INFO] Processing SRX6095622. (5/8)
2021-08-12 16:32:40 [INFO] Processing SRX6095622-SRR9328807. (5/8)
2021-08-12 16:32:57 [INFO] Processing SRX6095621. (6/8)
2021-08-12 16:32:57 [INFO] Processing SRX6095621-SRR9328806. (6/8)
2021-08-12 16:33:15 [INFO] Processing SRX6095619. (7/8)
2021-08-12 16:33:15 [INFO] Processing SRX6095619-SRR9328804. (7/8)
2021-08-12 16:33:33 [INFO] Processing SRX6095623. (8/8)
2021-08-12 16:33:33 [INFO] Processing SRX6095623-SRR9328808. (8/8)
2021-08-12 16:33:54 [INFO] Writing to disk...
2021-08-12 16:34:03 [INFO] Finished.
2021-08-20 17:56:48 [INFO] Starting.
2021-08-20 17:56:48 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/
2021-08-20 17:56:48 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/aggregate.hdf5
2021-08-20 17:56:48 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-20 17:56:49 [INFO] Building aggregate for 100kbp_raw network.
2021-08-20 17:56:49 [INFO] Writing every 10 Runs.
2021-08-20 17:56:49 [INFO] Processing SRX6095624. (1/8)
2021-08-20 17:56:49 [INFO] Processing SRX6095624-SRR9328809. (1/8)
2021-08-20 17:57:00 [INFO] Processing SRX6095626. (2/8)
2021-08-20 17:57:00 [INFO] Processing SRX6095626-SRR9328811. (2/8)
2021-08-20 17:57:09 [INFO] Processing SRX6095620. (3/8)
2021-08-20 17:57:09 [INFO] Processing SRX6095620-SRR9328805. (3/8)
2021-08-20 17:57:19 [INFO] Processing SRX6095625. (4/8)
2021-08-20 17:57:19 [INFO] Processing SRX6095625-SRR9328810. (4/8)
2021-08-20 17:57:27 [INFO] Processing SRX6095622. (5/8)
2021-08-20 17:57:27 [INFO] Processing SRX6095622-SRR9328807. (5/8)
2021-08-20 17:57:36 [INFO] Processing SRX6095621. (6/8)
2021-08-20 17:57:36 [INFO] Processing SRX6095621-SRR9328806. (6/8)
2021-08-20 17:57:47 [INFO] Processing SRX6095619. (7/8)
2021-08-20 17:57:47 [INFO] Processing SRX6095619-SRR9328804. (7/8)
2021-08-20 17:57:57 [INFO] Processing SRX6095623. (8/8)
2021-08-20 17:57:57 [INFO] Processing SRX6095623-SRR9328808. (8/8)
2021-08-20 17:58:08 [INFO] Writing to disk...
2021-08-20 17:58:12 [INFO] Finished.
2021-08-23 11:29:11 [INFO] Starting.
2021-08-23 11:29:11 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/
2021-08-23 11:29:11 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/aggregate.hdf5
2021-08-23 11:29:11 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 11:29:12 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 11:29:12 [INFO] Writing every 10 Runs.
2021-08-23 11:29:12 [INFO] Processing SRX6095624. (1/8)
2021-08-23 11:29:12 [INFO] Processing SRX6095624-SRR9328809. (1/8)
2021-08-23 11:29:20 [INFO] Processing SRX6095626. (2/8)
2021-08-23 11:29:20 [INFO] Processing SRX6095626-SRR9328811. (2/8)
2021-08-23 11:29:26 [INFO] Processing SRX6095620. (3/8)
2021-08-23 11:29:26 [INFO] Processing SRX6095620-SRR9328805. (3/8)
2021-08-23 11:29:34 [INFO] Processing SRX6095625. (4/8)
2021-08-23 11:29:34 [INFO] Processing SRX6095625-SRR9328810. (4/8)
2021-08-23 11:29:40 [INFO] Processing SRX6095622. (5/8)
2021-08-23 11:29:40 [INFO] Processing SRX6095622-SRR9328807. (5/8)
2021-08-23 11:29:47 [INFO] Processing SRX6095621. (6/8)
2021-08-23 11:29:47 [INFO] Processing SRX6095621-SRR9328806. (6/8)
2021-08-23 11:29:55 [INFO] Processing SRX6095619. (7/8)
2021-08-23 11:29:55 [INFO] Processing SRX6095619-SRR9328804. (7/8)
2021-08-23 11:30:04 [INFO] Processing SRX6095623. (8/8)
2021-08-23 11:30:04 [INFO] Processing SRX6095623-SRR9328808. (8/8)
2021-08-23 11:30:13 [INFO] Writing to disk...
2021-08-23 11:30:14 [INFO] Finished.
2021-08-23 13:16:17 [INFO] Starting.
2021-08-23 13:16:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/
2021-08-23 13:16:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP201909/aggregate.hdf5
2021-08-23 13:16:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:16:18 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 13:16:18 [INFO] Writing every 10 Runs.
2021-08-23 13:16:18 [INFO] Processing SRX6095624. (1/8)
2021-08-23 13:16:18 [INFO] Processing SRX6095624-SRR9328809. (1/8)
2021-08-23 13:16:23 [INFO] Processing SRX6095626. (2/8)
2021-08-23 13:16:23 [INFO] Processing SRX6095626-SRR9328811. (2/8)
2021-08-23 13:16:28 [INFO] Processing SRX6095620. (3/8)
2021-08-23 13:16:28 [INFO] Processing SRX6095620-SRR9328805. (3/8)
2021-08-23 13:16:33 [INFO] Processing SRX6095625. (4/8)
2021-08-23 13:16:33 [INFO] Processing SRX6095625-SRR9328810. (4/8)
2021-08-23 13:16:37 [INFO] Processing SRX6095622. (5/8)
2021-08-23 13:16:37 [INFO] Processing SRX6095622-SRR9328807. (5/8)
2021-08-23 13:16:42 [INFO] Processing SRX6095621. (6/8)
2021-08-23 13:16:42 [INFO] Processing SRX6095621-SRR9328806. (6/8)
2021-08-23 13:16:46 [INFO] Processing SRX6095619. (7/8)
2021-08-23 13:16:46 [INFO] Processing SRX6095619-SRR9328804. (7/8)
2021-08-23 13:16:51 [INFO] Processing SRX6095623. (8/8)
2021-08-23 13:16:51 [INFO] Processing SRX6095623-SRR9328808. (8/8)
2021-08-23 13:16:58 [INFO] Writing to disk...
2021-08-23 13:16:59 [INFO] Finished.