2021-06-10 03:16:26 [INFO] Starting.
2021-06-10 03:16:26 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/
2021-06-10 03:16:26 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/aggregate.hdf5
2021-06-10 03:16:26 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 03:16:26 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 03:16:26 [INFO] Building aggregate.
2021-06-10 03:16:26 [INFO] Writing every 10 Runs.
2021-06-10 03:16:26 [INFO] Processing SRX6366346. (1/10)
2021-06-10 03:16:26 [INFO] Processing SRX6366346-SRR9601016. (1/10)
2021-06-10 03:16:52 [INFO] Processing SRX6366348. (2/10)
2021-06-10 03:16:52 [INFO] Processing SRX6366348-SRR9601018. (2/10)
2021-06-10 03:17:14 [INFO] Processing SRX6366345. (3/10)
2021-06-10 03:17:14 [INFO] Processing SRX6366345-SRR9601015. (3/10)
2021-06-10 03:17:34 [INFO] Processing SRX6366349. (4/10)
2021-06-10 03:17:34 [INFO] Processing SRX6366349-SRR9601019. (4/10)
2021-06-10 03:18:16 [INFO] Processing SRX6366342. (5/10)
2021-06-10 03:18:16 [INFO] Processing SRX6366342-SRR9601012. (5/10)
2021-06-10 03:18:37 [INFO] Processing SRX6366350. (6/10)
2021-06-10 03:18:37 [INFO] Processing SRX6366350-SRR9601020. (6/10)
2021-06-10 03:19:10 [INFO] Processing SRX6366351. (7/10)
2021-06-10 03:19:10 [INFO] Processing SRX6366351-SRR9601021. (7/10)
2021-06-10 03:19:28 [INFO] Processing SRX6366343. (8/10)
2021-06-10 03:19:28 [INFO] Processing SRX6366343-SRR9601013. (8/10)
2021-06-10 03:19:56 [INFO] Processing SRX6366344. (9/10)
2021-06-10 03:19:56 [INFO] Processing SRX6366344-SRR9601014. (9/10)
2021-06-10 03:20:36 [INFO] Processing SRX6366347. (10/10)
2021-06-10 03:20:36 [INFO] Processing SRX6366347-SRR9601017. (10/10)
2021-06-10 03:21:07 [INFO] Writing to disk...
2021-06-10 03:21:27 [INFO] Finished.
2021-08-02 17:08:56 [INFO] Starting.
2021-08-02 17:08:56 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/
2021-08-02 17:08:56 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/aggregate.hdf5
2021-08-02 17:08:56 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-02 17:08:56 [INFO] Building aggregate for 1bp_raw network.
2021-08-02 17:08:56 [INFO] Writing every 10 Runs.
2021-08-02 17:08:56 [INFO] Processing SRX6366346. (1/10)
2021-08-02 17:08:56 [INFO] Processing SRX6366346-SRR9601016. (1/10)
2021-08-02 17:19:59 [INFO] Processing SRX6366348. (2/10)
2021-08-02 17:19:59 [INFO] Processing SRX6366348-SRR9601018. (2/10)
2021-08-02 17:31:22 [INFO] Processing SRX6366345. (3/10)
2021-08-02 17:31:22 [INFO] Processing SRX6366345-SRR9601015. (3/10)
2021-08-02 17:39:14 [INFO] Processing SRX6366349. (4/10)
2021-08-02 17:39:14 [INFO] Processing SRX6366349-SRR9601019. (4/10)
2021-08-02 17:47:03 [INFO] Processing SRX6366342. (5/10)
2021-08-02 17:47:03 [INFO] Processing SRX6366342-SRR9601012. (5/10)
2021-08-02 17:54:42 [INFO] Processing SRX6366350. (6/10)
2021-08-02 17:54:42 [INFO] Processing SRX6366350-SRR9601020. (6/10)
2021-08-02 18:03:18 [INFO] Processing SRX6366351. (7/10)
2021-08-02 18:03:18 [INFO] Processing SRX6366351-SRR9601021. (7/10)
2021-08-02 18:11:32 [INFO] Processing SRX6366343. (8/10)
2021-08-02 18:11:32 [INFO] Processing SRX6366343-SRR9601013. (8/10)
2021-08-02 18:19:29 [INFO] Processing SRX6366344. (9/10)
2021-08-02 18:19:29 [INFO] Processing SRX6366344-SRR9601014. (9/10)
2021-08-02 18:27:17 [INFO] Processing SRX6366347. (10/10)
2021-08-02 18:27:17 [INFO] Processing SRX6366347-SRR9601017. (10/10)
2021-08-02 18:35:07 [INFO] Writing to disk...
2021-08-02 18:36:36 [INFO] Finished.
2021-08-12 14:31:17 [INFO] Starting.
2021-08-12 14:31:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/
2021-08-12 14:31:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/aggregate.hdf5
2021-08-12 14:31:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:18 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:18 [INFO] Writing every 10 Runs.
2021-08-12 14:31:18 [INFO] Processing SRX6366346. (1/10)
2021-08-12 14:31:18 [INFO] Processing SRX6366346-SRR9601016. (1/10)
2021-08-12 14:31:38 [INFO] Processing SRX6366348. (2/10)
2021-08-12 14:31:38 [INFO] Processing SRX6366348-SRR9601018. (2/10)
2021-08-12 14:32:07 [INFO] Processing SRX6366345. (3/10)
2021-08-12 14:32:07 [INFO] Processing SRX6366345-SRR9601015. (3/10)
2021-08-12 14:32:40 [INFO] Processing SRX6366349. (4/10)
2021-08-12 14:32:40 [INFO] Processing SRX6366349-SRR9601019. (4/10)
2021-08-12 14:33:17 [INFO] Processing SRX6366342. (5/10)
2021-08-12 14:33:17 [INFO] Processing SRX6366342-SRR9601012. (5/10)
2021-08-12 14:33:43 [INFO] Processing SRX6366350. (6/10)
2021-08-12 14:33:43 [INFO] Processing SRX6366350-SRR9601020. (6/10)
2021-08-12 14:34:12 [INFO] Processing SRX6366351. (7/10)
2021-08-12 14:34:12 [INFO] Processing SRX6366351-SRR9601021. (7/10)
2021-08-12 14:34:42 [INFO] Processing SRX6366343. (8/10)
2021-08-12 14:34:42 [INFO] Processing SRX6366343-SRR9601013. (8/10)
2021-08-12 14:35:15 [INFO] Processing SRX6366344. (9/10)
2021-08-12 14:35:15 [INFO] Processing SRX6366344-SRR9601014. (9/10)
2021-08-12 14:35:47 [INFO] Processing SRX6366347. (10/10)
2021-08-12 14:35:47 [INFO] Processing SRX6366347-SRR9601017. (10/10)
2021-08-12 14:36:18 [INFO] Writing to disk...
2021-08-12 14:36:36 [INFO] Finished.
2021-08-12 15:09:40 [INFO] Starting.
2021-08-12 15:09:40 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/
2021-08-12 15:09:40 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/aggregate.hdf5
2021-08-12 15:09:40 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:09:40 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 15:09:40 [INFO] Writing every 10 Runs.
2021-08-12 15:09:40 [INFO] Processing SRX6366346. (1/10)
2021-08-12 15:09:40 [INFO] Processing SRX6366346-SRR9601016. (1/10)
2021-08-12 15:10:01 [INFO] Processing SRX6366348. (2/10)
2021-08-12 15:10:01 [INFO] Processing SRX6366348-SRR9601018. (2/10)
2021-08-12 15:10:27 [INFO] Processing SRX6366345. (3/10)
2021-08-12 15:10:27 [INFO] Processing SRX6366345-SRR9601015. (3/10)
2021-08-12 15:10:50 [INFO] Processing SRX6366349. (4/10)
2021-08-12 15:10:50 [INFO] Processing SRX6366349-SRR9601019. (4/10)
2021-08-12 15:11:15 [INFO] Processing SRX6366342. (5/10)
2021-08-12 15:11:15 [INFO] Processing SRX6366342-SRR9601012. (5/10)
2021-08-12 15:11:37 [INFO] Processing SRX6366350. (6/10)
2021-08-12 15:11:37 [INFO] Processing SRX6366350-SRR9601020. (6/10)
2021-08-12 15:11:58 [INFO] Processing SRX6366351. (7/10)
2021-08-12 15:11:58 [INFO] Processing SRX6366351-SRR9601021. (7/10)
2021-08-12 15:12:25 [INFO] Processing SRX6366343. (8/10)
2021-08-12 15:12:25 [INFO] Processing SRX6366343-SRR9601013. (8/10)
2021-08-12 15:12:52 [INFO] Processing SRX6366344. (9/10)
2021-08-12 15:12:52 [INFO] Processing SRX6366344-SRR9601014. (9/10)
2021-08-12 15:13:17 [INFO] Processing SRX6366347. (10/10)
2021-08-12 15:13:17 [INFO] Processing SRX6366347-SRR9601017. (10/10)
2021-08-12 15:13:51 [INFO] Writing to disk...
2021-08-12 15:14:10 [INFO] Finished.
2021-08-12 15:44:39 [INFO] Starting.
2021-08-12 15:44:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/
2021-08-12 15:44:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/aggregate.hdf5
2021-08-12 15:44:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:44:40 [INFO] Building aggregate for 5kbp_raw network.
2021-08-12 15:44:40 [INFO] Writing every 10 Runs.
2021-08-12 15:44:40 [INFO] Processing SRX6366346. (1/10)
2021-08-12 15:44:40 [INFO] Processing SRX6366346-SRR9601016. (1/10)
2021-08-12 15:45:04 [INFO] Processing SRX6366348. (2/10)
2021-08-12 15:45:04 [INFO] Processing SRX6366348-SRR9601018. (2/10)
2021-08-12 15:45:30 [INFO] Processing SRX6366345. (3/10)
2021-08-12 15:45:30 [INFO] Processing SRX6366345-SRR9601015. (3/10)
2021-08-12 15:45:59 [INFO] Processing SRX6366349. (4/10)
2021-08-12 15:45:59 [INFO] Processing SRX6366349-SRR9601019. (4/10)
2021-08-12 15:46:36 [INFO] Processing SRX6366342. (5/10)
2021-08-12 15:46:36 [INFO] Processing SRX6366342-SRR9601012. (5/10)
2021-08-12 15:47:07 [INFO] Processing SRX6366350. (6/10)
2021-08-12 15:47:07 [INFO] Processing SRX6366350-SRR9601020. (6/10)
2021-08-12 15:47:35 [INFO] Processing SRX6366351. (7/10)
2021-08-12 15:47:35 [INFO] Processing SRX6366351-SRR9601021. (7/10)
2021-08-12 15:48:05 [INFO] Processing SRX6366343. (8/10)
2021-08-12 15:48:05 [INFO] Processing SRX6366343-SRR9601013. (8/10)
2021-08-12 15:48:40 [INFO] Processing SRX6366344. (9/10)
2021-08-12 15:48:40 [INFO] Processing SRX6366344-SRR9601014. (9/10)
2021-08-12 15:49:17 [INFO] Processing SRX6366347. (10/10)
2021-08-12 15:49:17 [INFO] Processing SRX6366347-SRR9601017. (10/10)
2021-08-12 15:49:52 [INFO] Writing to disk...
2021-08-12 15:50:18 [INFO] Finished.
2021-08-12 16:31:34 [INFO] Starting.
2021-08-12 16:31:34 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/
2021-08-12 16:31:34 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/aggregate.hdf5
2021-08-12 16:31:34 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:31:35 [INFO] Building aggregate for 1kbp_raw network.
2021-08-12 16:31:35 [INFO] Writing every 10 Runs.
2021-08-12 16:31:35 [INFO] Processing SRX6366346. (1/10)
2021-08-12 16:31:35 [INFO] Processing SRX6366346-SRR9601016. (1/10)
2021-08-12 16:32:01 [INFO] Processing SRX6366348. (2/10)
2021-08-12 16:32:01 [INFO] Processing SRX6366348-SRR9601018. (2/10)
2021-08-12 16:32:29 [INFO] Processing SRX6366345. (3/10)
2021-08-12 16:32:29 [INFO] Processing SRX6366345-SRR9601015. (3/10)
2021-08-12 16:33:01 [INFO] Processing SRX6366349. (4/10)
2021-08-12 16:33:01 [INFO] Processing SRX6366349-SRR9601019. (4/10)
2021-08-12 16:33:33 [INFO] Processing SRX6366342. (5/10)
2021-08-12 16:33:33 [INFO] Processing SRX6366342-SRR9601012. (5/10)
2021-08-12 16:34:05 [INFO] Processing SRX6366350. (6/10)
2021-08-12 16:34:05 [INFO] Processing SRX6366350-SRR9601020. (6/10)
2021-08-12 16:34:36 [INFO] Processing SRX6366351. (7/10)
2021-08-12 16:34:36 [INFO] Processing SRX6366351-SRR9601021. (7/10)
2021-08-12 16:35:13 [INFO] Processing SRX6366343. (8/10)
2021-08-12 16:35:13 [INFO] Processing SRX6366343-SRR9601013. (8/10)
2021-08-12 16:35:52 [INFO] Processing SRX6366344. (9/10)
2021-08-12 16:35:52 [INFO] Processing SRX6366344-SRR9601014. (9/10)
2021-08-12 16:36:40 [INFO] Processing SRX6366347. (10/10)
2021-08-12 16:36:40 [INFO] Processing SRX6366347-SRR9601017. (10/10)
2021-08-12 16:37:25 [INFO] Writing to disk...
2021-08-12 16:38:02 [INFO] Finished.
2021-08-20 17:52:28 [INFO] Starting.
2021-08-20 17:52:28 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/
2021-08-20 17:52:28 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/aggregate.hdf5
2021-08-20 17:52:28 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-20 17:52:30 [INFO] Building aggregate for 100kbp_raw network.
2021-08-20 17:52:30 [INFO] Writing every 10 Runs.
2021-08-20 17:52:30 [INFO] Processing SRX6366346. (1/10)
2021-08-20 17:52:30 [INFO] Processing SRX6366346-SRR9601016. (1/10)
2021-08-20 17:52:52 [INFO] Processing SRX6366348. (2/10)
2021-08-20 17:52:52 [INFO] Processing SRX6366348-SRR9601018. (2/10)
2021-08-20 17:53:19 [INFO] Processing SRX6366345. (3/10)
2021-08-20 17:53:19 [INFO] Processing SRX6366345-SRR9601015. (3/10)
2021-08-20 17:53:47 [INFO] Processing SRX6366349. (4/10)
2021-08-20 17:53:47 [INFO] Processing SRX6366349-SRR9601019. (4/10)
2021-08-20 17:54:16 [INFO] Processing SRX6366342. (5/10)
2021-08-20 17:54:16 [INFO] Processing SRX6366342-SRR9601012. (5/10)
2021-08-20 17:54:37 [INFO] Processing SRX6366350. (6/10)
2021-08-20 17:54:37 [INFO] Processing SRX6366350-SRR9601020. (6/10)
2021-08-20 17:54:54 [INFO] Processing SRX6366351. (7/10)
2021-08-20 17:54:54 [INFO] Processing SRX6366351-SRR9601021. (7/10)
2021-08-20 17:55:18 [INFO] Processing SRX6366343. (8/10)
2021-08-20 17:55:18 [INFO] Processing SRX6366343-SRR9601013. (8/10)
2021-08-20 17:55:41 [INFO] Processing SRX6366344. (9/10)
2021-08-20 17:55:41 [INFO] Processing SRX6366344-SRR9601014. (9/10)
2021-08-20 17:56:06 [INFO] Processing SRX6366347. (10/10)
2021-08-20 17:56:06 [INFO] Processing SRX6366347-SRR9601017. (10/10)
2021-08-20 17:56:31 [INFO] Writing to disk...
2021-08-20 17:56:44 [INFO] Finished.
2021-08-23 11:28:00 [INFO] Starting.
2021-08-23 11:28:00 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/
2021-08-23 11:28:00 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/aggregate.hdf5
2021-08-23 11:28:00 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 11:28:01 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 11:28:01 [INFO] Writing every 10 Runs.
2021-08-23 11:28:01 [INFO] Processing SRX6366346. (1/10)
2021-08-23 11:28:01 [INFO] Processing SRX6366346-SRR9601016. (1/10)
2021-08-23 11:28:14 [INFO] Processing SRX6366348. (2/10)
2021-08-23 11:28:14 [INFO] Processing SRX6366348-SRR9601018. (2/10)
2021-08-23 11:28:29 [INFO] Processing SRX6366345. (3/10)
2021-08-23 11:28:29 [INFO] Processing SRX6366345-SRR9601015. (3/10)
2021-08-23 11:28:46 [INFO] Processing SRX6366349. (4/10)
2021-08-23 11:28:46 [INFO] Processing SRX6366349-SRR9601019. (4/10)
2021-08-23 11:29:03 [INFO] Processing SRX6366342. (5/10)
2021-08-23 11:29:03 [INFO] Processing SRX6366342-SRR9601012. (5/10)
2021-08-23 11:29:16 [INFO] Processing SRX6366350. (6/10)
2021-08-23 11:29:16 [INFO] Processing SRX6366350-SRR9601020. (6/10)
2021-08-23 11:29:28 [INFO] Processing SRX6366351. (7/10)
2021-08-23 11:29:28 [INFO] Processing SRX6366351-SRR9601021. (7/10)
2021-08-23 11:29:44 [INFO] Processing SRX6366343. (8/10)
2021-08-23 11:29:44 [INFO] Processing SRX6366343-SRR9601013. (8/10)
2021-08-23 11:29:58 [INFO] Processing SRX6366344. (9/10)
2021-08-23 11:29:58 [INFO] Processing SRX6366344-SRR9601014. (9/10)
2021-08-23 11:30:14 [INFO] Processing SRX6366347. (10/10)
2021-08-23 11:30:14 [INFO] Processing SRX6366347-SRR9601017. (10/10)
2021-08-23 11:30:33 [INFO] Writing to disk...
2021-08-23 11:30:35 [INFO] Finished.
2021-08-23 13:15:16 [INFO] Starting.
2021-08-23 13:15:16 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/
2021-08-23 13:15:16 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP212073/aggregate.hdf5
2021-08-23 13:15:16 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:15:17 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 13:15:17 [INFO] Writing every 10 Runs.
2021-08-23 13:15:17 [INFO] Processing SRX6366346. (1/10)
2021-08-23 13:15:17 [INFO] Processing SRX6366346-SRR9601016. (1/10)
2021-08-23 13:15:24 [INFO] Processing SRX6366348. (2/10)
2021-08-23 13:15:24 [INFO] Processing SRX6366348-SRR9601018. (2/10)
2021-08-23 13:15:29 [INFO] Processing SRX6366345. (3/10)
2021-08-23 13:15:29 [INFO] Processing SRX6366345-SRR9601015. (3/10)
2021-08-23 13:15:37 [INFO] Processing SRX6366349. (4/10)
2021-08-23 13:15:37 [INFO] Processing SRX6366349-SRR9601019. (4/10)
2021-08-23 13:15:44 [INFO] Processing SRX6366342. (5/10)
2021-08-23 13:15:44 [INFO] Processing SRX6366342-SRR9601012. (5/10)
2021-08-23 13:15:52 [INFO] Processing SRX6366350. (6/10)
2021-08-23 13:15:52 [INFO] Processing SRX6366350-SRR9601020. (6/10)
2021-08-23 13:15:58 [INFO] Processing SRX6366351. (7/10)
2021-08-23 13:15:58 [INFO] Processing SRX6366351-SRR9601021. (7/10)
2021-08-23 13:16:03 [INFO] Processing SRX6366343. (8/10)
2021-08-23 13:16:03 [INFO] Processing SRX6366343-SRR9601013. (8/10)
2021-08-23 13:16:10 [INFO] Processing SRX6366344. (9/10)
2021-08-23 13:16:10 [INFO] Processing SRX6366344-SRR9601014. (9/10)
2021-08-23 13:16:18 [INFO] Processing SRX6366347. (10/10)
2021-08-23 13:16:18 [INFO] Processing SRX6366347-SRR9601017. (10/10)
2021-08-23 13:16:24 [INFO] Writing to disk...
2021-08-23 13:16:25 [INFO] Finished.