2021-06-10 04:10:25 [INFO] Starting.
2021-06-10 04:10:25 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/
2021-06-10 04:10:25 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/aggregate.hdf5
2021-06-10 04:10:25 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 04:10:25 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 04:10:26 [INFO] Building aggregate.
2021-06-10 04:10:26 [INFO] Writing every 10 Runs.
2021-06-10 04:10:26 [INFO] Processing SRX2821752. (1/4)
2021-06-10 04:10:26 [INFO] Processing SRX2821752-SRR5558587. (1/4)
2021-06-10 04:10:37 [INFO] Processing SRX2821753. (2/4)
2021-06-10 04:10:37 [INFO] Processing SRX2821753-SRR5558588. (2/4)
2021-06-10 04:10:56 [INFO] Processing SRX2821751. (3/4)
2021-06-10 04:10:56 [INFO] Processing SRX2821751-SRR5558586. (3/4)
2021-06-10 04:11:01 [INFO] Processing SRX2821750. (4/4)
2021-06-10 04:11:01 [INFO] Processing SRX2821750-SRR5558585. (4/4)
2021-06-10 04:11:09 [INFO] Writing to disk...
2021-06-10 04:11:12 [INFO] Finished.
2021-08-06 12:19:00 [INFO] SPECIAL NOTE: 1bp_raw aggregate build failed due to memory issues. It was manually copied in from a version that Ruchi calculated separately.
2021-08-12 14:32:36 [INFO] Starting.
2021-08-12 14:32:36 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/
2021-08-12 14:32:36 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/aggregate.hdf5
2021-08-12 14:32:36 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:32:37 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:32:37 [INFO] Writing every 10 Runs.
2021-08-12 14:32:37 [INFO] Processing SRX2821752. (1/4)
2021-08-12 14:32:37 [INFO] Processing SRX2821752-SRR5558587. (1/4)
2021-08-12 14:32:48 [INFO] Processing SRX2821753. (2/4)
2021-08-12 14:32:48 [INFO] Processing SRX2821753-SRR5558588. (2/4)
2021-08-12 14:32:57 [INFO] Processing SRX2821751. (3/4)
2021-08-12 14:32:57 [INFO] Processing SRX2821751-SRR5558586. (3/4)
2021-08-12 14:33:08 [INFO] Processing SRX2821750. (4/4)
2021-08-12 14:33:08 [INFO] Processing SRX2821750-SRR5558585. (4/4)
2021-08-12 14:33:20 [INFO] Writing to disk...
2021-08-12 14:33:23 [INFO] Finished.
2021-08-12 15:11:20 [INFO] Starting.
2021-08-12 15:11:20 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/
2021-08-12 15:11:20 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/aggregate.hdf5
2021-08-12 15:11:20 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:11:21 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 15:11:21 [INFO] Writing every 10 Runs.
2021-08-12 15:11:21 [INFO] Processing SRX2821752. (1/4)
2021-08-12 15:11:21 [INFO] Processing SRX2821752-SRR5558587. (1/4)
2021-08-12 15:11:30 [INFO] Processing SRX2821753. (2/4)
2021-08-12 15:11:30 [INFO] Processing SRX2821753-SRR5558588. (2/4)
2021-08-12 15:11:39 [INFO] Processing SRX2821751. (3/4)
2021-08-12 15:11:39 [INFO] Processing SRX2821751-SRR5558586. (3/4)
2021-08-12 15:11:49 [INFO] Processing SRX2821750. (4/4)
2021-08-12 15:11:49 [INFO] Processing SRX2821750-SRR5558585. (4/4)
2021-08-12 15:11:59 [INFO] Writing to disk...
2021-08-12 15:12:02 [INFO] Finished.
2021-08-12 15:46:10 [INFO] Starting.
2021-08-12 15:46:10 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/
2021-08-12 15:46:10 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/aggregate.hdf5
2021-08-12 15:46:10 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:46:11 [INFO] Building aggregate for 5kbp_raw network.
2021-08-12 15:46:11 [INFO] Writing every 10 Runs.
2021-08-12 15:46:11 [INFO] Processing SRX2821752. (1/4)
2021-08-12 15:46:11 [INFO] Processing SRX2821752-SRR5558587. (1/4)
2021-08-12 15:46:20 [INFO] Processing SRX2821753. (2/4)
2021-08-12 15:46:20 [INFO] Processing SRX2821753-SRR5558588. (2/4)
2021-08-12 15:46:32 [INFO] Processing SRX2821751. (3/4)
2021-08-12 15:46:32 [INFO] Processing SRX2821751-SRR5558586. (3/4)
2021-08-12 15:46:43 [INFO] Processing SRX2821750. (4/4)
2021-08-12 15:46:43 [INFO] Processing SRX2821750-SRR5558585. (4/4)
2021-08-12 15:46:55 [INFO] Writing to disk...
2021-08-12 15:46:59 [INFO] Finished.
2021-08-12 16:34:59 [INFO] Starting.
2021-08-12 16:34:59 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/
2021-08-12 16:34:59 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/aggregate.hdf5
2021-08-12 16:34:59 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:35:00 [INFO] Building aggregate for 1kbp_raw network.
2021-08-12 16:35:00 [INFO] Writing every 10 Runs.
2021-08-12 16:35:00 [INFO] Processing SRX2821752. (1/4)
2021-08-12 16:35:00 [INFO] Processing SRX2821752-SRR5558587. (1/4)
2021-08-12 16:35:12 [INFO] Processing SRX2821753. (2/4)
2021-08-12 16:35:12 [INFO] Processing SRX2821753-SRR5558588. (2/4)
2021-08-12 16:35:25 [INFO] Processing SRX2821751. (3/4)
2021-08-12 16:35:25 [INFO] Processing SRX2821751-SRR5558586. (3/4)
2021-08-12 16:35:39 [INFO] Processing SRX2821750. (4/4)
2021-08-12 16:35:39 [INFO] Processing SRX2821750-SRR5558585. (4/4)
2021-08-12 16:35:54 [INFO] Writing to disk...
2021-08-12 16:36:00 [INFO] Finished.
2021-08-20 18:02:01 [INFO] Starting.
2021-08-20 18:02:01 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/
2021-08-20 18:02:01 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/aggregate.hdf5
2021-08-20 18:02:01 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-20 18:02:03 [INFO] Building aggregate for 100kbp_raw network.
2021-08-20 18:02:03 [INFO] Writing every 10 Runs.
2021-08-20 18:02:03 [INFO] Processing SRX2821752. (1/4)
2021-08-20 18:02:03 [INFO] Processing SRX2821752-SRR5558587. (1/4)
2021-08-20 18:02:29 [INFO] Processing SRX2821753. (2/4)
2021-08-20 18:02:29 [INFO] Processing SRX2821753-SRR5558588. (2/4)
2021-08-20 18:02:38 [INFO] Processing SRX2821751. (3/4)
2021-08-20 18:02:38 [INFO] Processing SRX2821751-SRR5558586. (3/4)
2021-08-20 18:02:46 [INFO] Processing SRX2821750. (4/4)
2021-08-20 18:02:46 [INFO] Processing SRX2821750-SRR5558585. (4/4)
2021-08-20 18:03:01 [INFO] Writing to disk...
2021-08-20 18:03:15 [INFO] Finished.
2021-08-23 11:30:51 [INFO] Starting.
2021-08-23 11:30:51 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/
2021-08-23 11:30:51 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/aggregate.hdf5
2021-08-23 11:30:51 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 11:30:51 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 11:30:51 [INFO] Writing every 10 Runs.
2021-08-23 11:30:51 [INFO] Processing SRX2821752. (1/4)
2021-08-23 11:30:51 [INFO] Processing SRX2821752-SRR5558587. (1/4)
2021-08-23 11:30:57 [INFO] Processing SRX2821753. (2/4)
2021-08-23 11:30:57 [INFO] Processing SRX2821753-SRR5558588. (2/4)
2021-08-23 11:31:04 [INFO] Processing SRX2821751. (3/4)
2021-08-23 11:31:04 [INFO] Processing SRX2821751-SRR5558586. (3/4)
2021-08-23 11:31:10 [INFO] Processing SRX2821750. (4/4)
2021-08-23 11:31:10 [INFO] Processing SRX2821750-SRR5558585. (4/4)
2021-08-23 11:31:15 [INFO] Writing to disk...
2021-08-23 11:31:16 [INFO] Finished.
2021-08-23 13:17:11 [INFO] Starting.
2021-08-23 13:17:11 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/
2021-08-23 13:17:11 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP090318/aggregate.hdf5
2021-08-23 13:17:11 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:17:12 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 13:17:12 [INFO] Writing every 10 Runs.
2021-08-23 13:17:12 [INFO] Processing SRX2821752. (1/4)
2021-08-23 13:17:12 [INFO] Processing SRX2821752-SRR5558587. (1/4)
2021-08-23 13:17:15 [INFO] Processing SRX2821753. (2/4)
2021-08-23 13:17:15 [INFO] Processing SRX2821753-SRR5558588. (2/4)
2021-08-23 13:17:20 [INFO] Processing SRX2821751. (3/4)
2021-08-23 13:17:20 [INFO] Processing SRX2821751-SRR5558586. (3/4)
2021-08-23 13:17:25 [INFO] Processing SRX2821750. (4/4)
2021-08-23 13:17:25 [INFO] Processing SRX2821750-SRR5558585. (4/4)
2021-08-23 13:17:29 [INFO] Writing to disk...
2021-08-23 13:17:30 [INFO] Finished.