2021-08-02 14:43:29 [INFO] Starting.
2021-08-02 14:43:29 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/
2021-08-02 14:43:29 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/aggregate.hdf5
2021-08-02 14:43:29 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes
2021-08-02 14:43:29 [INFO] Using only main chromosomes: chr1, chr2, chrX, chr3, chr4, chr5, chr6, chr7, chr10, chr8, chr14, chr9, chr11, chr13, chr12, chr15, chr16, chr17, chrY, chr18, chr19, chrM
2021-08-02 14:43:30 [INFO] Building aggregate.
2021-08-02 14:43:30 [INFO] Writing every 10 Runs.
2021-08-02 14:43:30 [INFO] Processing SRX8350013. (1/10)
2021-08-02 14:43:30 [INFO] Processing SRX8350013-SRR11798541. (1/20)
2021-08-02 14:43:59 [INFO] Processing SRX8350013-SRR11798540. (2/20)
2021-08-02 14:44:31 [INFO] Processing SRX8350004. (2/10)
2021-08-02 14:44:31 [INFO] Processing SRX8350004-SRR11798542. (3/20)
2021-08-02 14:45:03 [INFO] Processing SRX8350004-SRR11798543. (4/20)
2021-08-02 14:45:32 [INFO] Processing SRX8350011. (3/10)
2021-08-02 14:45:32 [INFO] Processing SRX8350011-SRR11798556. (5/20)
2021-08-02 14:46:15 [INFO] Processing SRX8350011-SRR11798557. (6/20)
2021-08-02 14:46:49 [INFO] Processing SRX8350005. (4/10)
2021-08-02 14:46:49 [INFO] Processing SRX8350005-SRR11798545. (7/20)
2021-08-02 14:47:14 [INFO] Processing SRX8350005-SRR11798544. (8/20)
2021-08-02 14:47:45 [INFO] Processing SRX8350012. (5/10)
2021-08-02 14:47:45 [INFO] Processing SRX8350012-SRR11798539. (9/20)
2021-08-02 14:48:22 [INFO] Processing SRX8350012-SRR11798538. (10/20)
2021-08-02 14:48:52 [INFO] Writing to disk...
2021-08-02 14:49:18 [INFO] Processing SRX8350010. (6/10)
2021-08-02 14:49:18 [INFO] Processing SRX8350010-SRR11798555. (11/20)
2021-08-02 14:50:01 [INFO] Processing SRX8350010-SRR11798554. (12/20)
2021-08-02 14:50:43 [INFO] Processing SRX8350008. (7/10)
2021-08-02 14:50:43 [INFO] Processing SRX8350008-SRR11798550. (13/20)
2021-08-02 14:51:18 [INFO] Processing SRX8350008-SRR11798551. (14/20)
2021-08-02 14:51:48 [INFO] Processing SRX8350007. (8/10)
2021-08-02 14:51:48 [INFO] Processing SRX8350007-SRR11798549. (15/20)
2021-08-02 14:52:20 [INFO] Processing SRX8350007-SRR11798548. (16/20)
2021-08-02 14:52:51 [INFO] Processing SRX8350006. (9/10)
2021-08-02 14:52:51 [INFO] Processing SRX8350006-SRR11798546. (17/20)
2021-08-02 14:53:29 [INFO] Processing SRX8350006-SRR11798547. (18/20)
2021-08-02 14:54:03 [INFO] Processing SRX8350009. (10/10)
2021-08-02 14:54:03 [INFO] Processing SRX8350009-SRR11798552. (19/20)
2021-08-02 14:54:46 [INFO] Processing SRX8350009-SRR11798553. (20/20)
2021-08-02 14:55:26 [INFO] Writing to disk...
2021-08-02 14:56:10 [INFO] Finished.
2021-08-12 14:31:21 [INFO] Starting.
2021-08-12 14:31:21 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/
2021-08-12 14:31:21 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/aggregate.hdf5
2021-08-12 14:31:21 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:21 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:21 [INFO] Writing every 10 Runs.
2021-08-12 14:31:21 [INFO] Processing SRX8350013. (1/10)
2021-08-12 14:31:21 [INFO] Processing SRX8350013-SRR11798541. (1/20)
2021-08-12 14:31:53 [INFO] Processing SRX8350013-SRR11798540. (2/20)
2021-08-12 14:32:30 [INFO] Processing SRX8350004. (2/10)
2021-08-12 14:32:30 [INFO] Processing SRX8350004-SRR11798542. (3/20)
2021-08-12 14:33:03 [INFO] Processing SRX8350004-SRR11798543. (4/20)
2021-08-12 14:33:31 [INFO] Processing SRX8350011. (3/10)
2021-08-12 14:33:31 [INFO] Processing SRX8350011-SRR11798556. (5/20)
2021-08-12 14:34:17 [INFO] Processing SRX8350011-SRR11798557. (6/20)
2021-08-12 14:35:00 [INFO] Processing SRX8350005. (4/10)
2021-08-12 14:35:00 [INFO] Processing SRX8350005-SRR11798545. (7/20)
2021-08-12 14:35:30 [INFO] Processing SRX8350005-SRR11798544. (8/20)
2021-08-12 14:36:01 [INFO] Processing SRX8350012. (5/10)
2021-08-12 14:36:01 [INFO] Processing SRX8350012-SRR11798539. (9/20)
2021-08-12 14:36:32 [INFO] Processing SRX8350012-SRR11798538. (10/20)
2021-08-12 14:37:05 [INFO] Writing to disk...
2021-08-12 14:37:22 [INFO] Processing SRX8350010. (6/10)
2021-08-12 14:37:22 [INFO] Processing SRX8350010-SRR11798555. (11/20)
2021-08-12 14:38:08 [INFO] Processing SRX8350010-SRR11798554. (12/20)
2021-08-12 14:38:52 [INFO] Processing SRX8350008. (7/10)
2021-08-12 14:38:52 [INFO] Processing SRX8350008-SRR11798550. (13/20)
2021-08-12 14:39:20 [INFO] Processing SRX8350008-SRR11798551. (14/20)
2021-08-12 14:39:50 [INFO] Processing SRX8350007. (8/10)
2021-08-12 14:39:50 [INFO] Processing SRX8350007-SRR11798549. (15/20)
2021-08-12 14:40:27 [INFO] Processing SRX8350007-SRR11798548. (16/20)
2021-08-12 14:40:58 [INFO] Processing SRX8350006. (9/10)
2021-08-12 14:40:58 [INFO] Processing SRX8350006-SRR11798546. (17/20)
2021-08-12 14:41:25 [INFO] Processing SRX8350006-SRR11798547. (18/20)
2021-08-12 14:41:56 [INFO] Processing SRX8350009. (10/10)
2021-08-12 14:41:56 [INFO] Processing SRX8350009-SRR11798552. (19/20)
2021-08-12 14:42:29 [INFO] Processing SRX8350009-SRR11798553. (20/20)
2021-08-12 14:43:07 [INFO] Writing to disk...
2021-08-12 14:43:30 [INFO] Finished.
2021-08-12 16:38:08 [INFO] Starting.
2021-08-12 16:38:08 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/
2021-08-12 16:38:08 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/aggregate.hdf5
2021-08-12 16:38:08 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:38:09 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 16:38:09 [INFO] Writing every 10 Runs.
2021-08-12 16:38:09 [INFO] Processing SRX8350013. (1/10)
2021-08-12 16:38:09 [INFO] Processing SRX8350013-SRR11798541. (1/20)
2021-08-12 16:38:47 [INFO] Processing SRX8350013-SRR11798540. (2/20)
2021-08-12 16:39:28 [INFO] Processing SRX8350004. (2/10)
2021-08-12 16:39:28 [INFO] Processing SRX8350004-SRR11798542. (3/20)
2021-08-12 16:39:56 [INFO] Processing SRX8350004-SRR11798543. (4/20)
2021-08-12 16:40:27 [INFO] Processing SRX8350011. (3/10)
2021-08-12 16:40:27 [INFO] Processing SRX8350011-SRR11798556. (5/20)
2021-08-12 16:41:24 [INFO] Processing SRX8350011-SRR11798557. (6/20)
2021-08-12 16:42:14 [INFO] Processing SRX8350005. (4/10)
2021-08-12 16:42:14 [INFO] Processing SRX8350005-SRR11798545. (7/20)
2021-08-12 16:42:41 [INFO] Processing SRX8350005-SRR11798544. (8/20)
2021-08-12 16:43:06 [INFO] Processing SRX8350012. (5/10)
2021-08-12 16:43:06 [INFO] Processing SRX8350012-SRR11798539. (9/20)
2021-08-12 16:43:41 [INFO] Processing SRX8350012-SRR11798538. (10/20)
2021-08-12 16:44:08 [INFO] Writing to disk...
2021-08-12 16:44:29 [INFO] Processing SRX8350010. (6/10)
2021-08-12 16:44:29 [INFO] Processing SRX8350010-SRR11798555. (11/20)
2021-08-12 16:45:12 [INFO] Processing SRX8350010-SRR11798554. (12/20)
2021-08-12 16:45:50 [INFO] Processing SRX8350008. (7/10)
2021-08-12 16:45:50 [INFO] Processing SRX8350008-SRR11798550. (13/20)
2021-08-12 16:46:13 [INFO] Processing SRX8350008-SRR11798551. (14/20)
2021-08-12 16:46:49 [INFO] Processing SRX8350007. (8/10)
2021-08-12 16:46:49 [INFO] Processing SRX8350007-SRR11798549. (15/20)
2021-08-12 16:47:23 [INFO] Processing SRX8350007-SRR11798548. (16/20)
2021-08-12 16:47:59 [INFO] Processing SRX8350006. (9/10)
2021-08-12 16:47:59 [INFO] Processing SRX8350006-SRR11798546. (17/20)
2021-08-12 16:48:32 [INFO] Processing SRX8350006-SRR11798547. (18/20)
2021-08-12 16:49:07 [INFO] Processing SRX8350009. (10/10)
2021-08-12 16:49:07 [INFO] Processing SRX8350009-SRR11798552. (19/20)
2021-08-12 16:49:53 [INFO] Processing SRX8350009-SRR11798553. (20/20)
2021-08-12 16:50:38 [INFO] Writing to disk...
2021-08-12 16:51:10 [INFO] Finished.
2021-08-13 09:44:55 [INFO] Starting.
2021-08-13 09:44:55 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/
2021-08-13 09:44:55 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/aggregate.hdf5
2021-08-13 09:44:55 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-13 09:44:56 [INFO] Building aggregate for 5kbp_raw network.
2021-08-13 09:44:56 [INFO] Writing every 10 Runs.
2021-08-13 09:44:56 [INFO] Processing SRX8350013. (1/10)
2021-08-13 09:44:56 [INFO] Processing SRX8350013-SRR11798541. (1/20)
2021-08-13 09:45:24 [INFO] Processing SRX8350013-SRR11798540. (2/20)
2021-08-13 09:45:53 [INFO] Processing SRX8350004. (2/10)
2021-08-13 09:45:53 [INFO] Processing SRX8350004-SRR11798542. (3/20)
2021-08-13 09:46:19 [INFO] Processing SRX8350004-SRR11798543. (4/20)
2021-08-13 09:46:45 [INFO] Processing SRX8350011. (3/10)
2021-08-13 09:46:45 [INFO] Processing SRX8350011-SRR11798556. (5/20)
2021-08-13 09:47:23 [INFO] Processing SRX8350011-SRR11798557. (6/20)
2021-08-13 09:47:58 [INFO] Processing SRX8350005. (4/10)
2021-08-13 09:47:58 [INFO] Processing SRX8350005-SRR11798545. (7/20)
2021-08-13 09:48:24 [INFO] Processing SRX8350005-SRR11798544. (8/20)
2021-08-13 09:48:50 [INFO] Processing SRX8350012. (5/10)
2021-08-13 09:48:50 [INFO] Processing SRX8350012-SRR11798539. (9/20)
2021-08-13 09:49:18 [INFO] Processing SRX8350012-SRR11798538. (10/20)
2021-08-13 09:49:48 [INFO] Writing to disk...
2021-08-13 09:50:17 [INFO] Processing SRX8350010. (6/10)
2021-08-13 09:50:17 [INFO] Processing SRX8350010-SRR11798555. (11/20)
2021-08-13 09:51:00 [INFO] Processing SRX8350010-SRR11798554. (12/20)
2021-08-13 09:51:44 [INFO] Processing SRX8350008. (7/10)
2021-08-13 09:51:44 [INFO] Processing SRX8350008-SRR11798550. (13/20)
2021-08-13 09:52:17 [INFO] Processing SRX8350008-SRR11798551. (14/20)
2021-08-13 09:52:47 [INFO] Processing SRX8350007. (8/10)
2021-08-13 09:52:47 [INFO] Processing SRX8350007-SRR11798549. (15/20)
2021-08-13 09:53:21 [INFO] Processing SRX8350007-SRR11798548. (16/20)
2021-08-13 09:53:55 [INFO] Processing SRX8350006. (9/10)
2021-08-13 09:53:55 [INFO] Processing SRX8350006-SRR11798546. (17/20)
2021-08-13 09:54:37 [INFO] Processing SRX8350006-SRR11798547. (18/20)
2021-08-13 09:55:10 [INFO] Processing SRX8350009. (10/10)
2021-08-13 09:55:10 [INFO] Processing SRX8350009-SRR11798552. (19/20)
2021-08-13 09:55:47 [INFO] Processing SRX8350009-SRR11798553. (20/20)
2021-08-13 09:56:24 [INFO] Writing to disk...
2021-08-13 09:57:10 [INFO] Finished.
2021-08-13 17:26:10 [INFO] Starting.
2021-08-13 17:26:10 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/
2021-08-13 17:26:10 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/aggregate.hdf5
2021-08-13 17:26:10 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-13 17:26:11 [INFO] Building aggregate for 1kbp_raw network.
2021-08-13 17:26:11 [INFO] Writing every 10 Runs.
2021-08-13 17:26:11 [INFO] Processing SRX8350013. (1/10)
2021-08-13 17:26:11 [INFO] Processing SRX8350013-SRR11798541. (1/20)
2021-08-13 17:27:01 [INFO] Processing SRX8350013-SRR11798540. (2/20)
2021-08-13 17:27:53 [INFO] Processing SRX8350004. (2/10)
2021-08-13 17:27:53 [INFO] Processing SRX8350004-SRR11798542. (3/20)
2021-08-13 17:28:36 [INFO] Processing SRX8350004-SRR11798543. (4/20)
2021-08-13 17:29:22 [INFO] Processing SRX8350011. (3/10)
2021-08-13 17:29:22 [INFO] Processing SRX8350011-SRR11798556. (5/20)
2021-08-13 17:30:20 [INFO] Processing SRX8350011-SRR11798557. (6/20)
2021-08-13 17:31:32 [INFO] Processing SRX8350005. (4/10)
2021-08-13 17:31:32 [INFO] Processing SRX8350005-SRR11798545. (7/20)
2021-08-13 17:32:16 [INFO] Processing SRX8350005-SRR11798544. (8/20)
2021-08-13 17:33:07 [INFO] Processing SRX8350012. (5/10)
2021-08-13 17:33:07 [INFO] Processing SRX8350012-SRR11798539. (9/20)
2021-08-13 17:33:55 [INFO] Processing SRX8350012-SRR11798538. (10/20)
2021-08-13 17:34:41 [INFO] Writing to disk...
2021-08-13 17:35:36 [INFO] Processing SRX8350010. (6/10)
2021-08-13 17:35:36 [INFO] Processing SRX8350010-SRR11798555. (11/20)
2021-08-13 17:36:56 [INFO] Processing SRX8350010-SRR11798554. (12/20)
2021-08-13 17:38:16 [INFO] Processing SRX8350008. (7/10)
2021-08-13 17:38:16 [INFO] Processing SRX8350008-SRR11798550. (13/20)
2021-08-13 17:39:13 [INFO] Processing SRX8350008-SRR11798551. (14/20)
2021-08-13 17:40:03 [INFO] Processing SRX8350007. (8/10)
2021-08-13 17:40:03 [INFO] Processing SRX8350007-SRR11798549. (15/20)
2021-08-13 17:40:55 [INFO] Processing SRX8350007-SRR11798548. (16/20)
2021-08-13 17:41:52 [INFO] Processing SRX8350006. (9/10)
2021-08-13 17:41:52 [INFO] Processing SRX8350006-SRR11798546. (17/20)
2021-08-13 17:42:52 [INFO] Processing SRX8350006-SRR11798547. (18/20)
2021-08-13 17:43:49 [INFO] Processing SRX8350009. (10/10)
2021-08-13 17:43:49 [INFO] Processing SRX8350009-SRR11798552. (19/20)
2021-08-13 17:44:44 [INFO] Processing SRX8350009-SRR11798553. (20/20)
2021-08-13 17:45:43 [INFO] Writing to disk...
2021-08-13 17:46:46 [INFO] Finished.
2021-08-16 11:36:45 [INFO] Starting.
2021-08-16 11:36:46 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/
2021-08-16 11:36:46 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/aggregate.hdf5
2021-08-16 11:36:46 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-16 11:36:46 [INFO] Building aggregate for 1bp_raw network.
2021-08-16 11:36:46 [INFO] Writing every 10 Runs.
2021-08-16 11:36:46 [INFO] Processing SRX8350013. (1/10)
2021-08-16 11:36:46 [INFO] Processing SRX8350013-SRR11798541. (1/20)
2021-08-16 11:44:28 [INFO] Processing SRX8350013-SRR11798540. (2/20)
2021-08-16 12:00:10 [ERROR] Adding SRR11798540:chr10_vs_chrM to in memory aggregate failed. Error message:
Traceback (most recent call last):
  File "/grid/gillis/data/nfox/hi_c_data_processing/software/aggregate.py", line 445, in add_dataset
    aggregate_data[c] = aggregate_data[c] + net
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/base.py", line 415, in __add__
    return self._add_sparse(other)
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 359, in _add_sparse
    return self._binopt(other, '_plus_')
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 1226, in _binopt
    indptr = np.empty(self.indptr.shape, dtype=idx_dtype)
MemoryError: Unable to allocate 499. MiB for an array with shape (130694994,) and data type int32

2021-08-17 03:04:02 [INFO] Starting.
2021-08-17 03:04:02 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/
2021-08-17 03:04:02 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/aggregate.hdf5
2021-08-17 03:04:02 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-17 03:04:02 [INFO] Building aggregate for 1bp_raw network.
2021-08-17 03:04:02 [INFO] Writing every 10 Runs.
2021-08-17 03:04:02 [INFO] Processing SRX8350013. (1/10)
2021-08-17 03:04:02 [INFO] Processing SRX8350013-SRR11798541. (1/20)
2021-08-17 03:08:16 [INFO] Processing SRX8350013-SRR11798540. (2/20)
2021-08-17 03:16:00 [INFO] Processing SRX8350004. (2/10)
2021-08-17 03:16:00 [INFO] Processing SRX8350004-SRR11798542. (3/20)
2021-08-17 03:23:31 [INFO] Processing SRX8350004-SRR11798543. (4/20)
2021-08-17 03:31:13 [INFO] Processing SRX8350011. (3/10)
2021-08-17 03:31:13 [INFO] Processing SRX8350011-SRR11798556. (5/20)
2021-08-17 03:39:09 [INFO] Processing SRX8350011-SRR11798557. (6/20)
2021-08-17 03:46:40 [INFO] Processing SRX8350005. (4/10)
2021-08-17 03:46:40 [INFO] Processing SRX8350005-SRR11798545. (7/20)
2021-08-17 03:54:04 [INFO] Processing SRX8350005-SRR11798544. (8/20)
2021-08-17 04:01:37 [INFO] Processing SRX8350012. (5/10)
2021-08-17 04:01:37 [INFO] Processing SRX8350012-SRR11798539. (9/20)
2021-08-17 04:08:55 [INFO] Processing SRX8350012-SRR11798538. (10/20)
2021-08-17 04:16:25 [INFO] Writing to disk...
2021-08-17 04:18:02 [INFO] Processing SRX8350010. (6/10)
2021-08-17 04:18:02 [INFO] Processing SRX8350010-SRR11798555. (11/20)
2021-08-17 04:25:37 [INFO] Processing SRX8350010-SRR11798554. (12/20)
2021-08-17 04:33:05 [INFO] Processing SRX8350008. (7/10)
2021-08-17 04:33:05 [INFO] Processing SRX8350008-SRR11798550. (13/20)
2021-08-17 04:40:38 [INFO] Processing SRX8350008-SRR11798551. (14/20)
2021-08-17 04:48:04 [INFO] Processing SRX8350007. (8/10)
2021-08-17 04:48:04 [INFO] Processing SRX8350007-SRR11798549. (15/20)
2021-08-17 04:55:26 [INFO] Processing SRX8350007-SRR11798548. (16/20)
2021-08-17 05:03:01 [INFO] Processing SRX8350006. (9/10)
2021-08-17 05:03:01 [INFO] Processing SRX8350006-SRR11798546. (17/20)
2021-08-17 05:10:44 [INFO] Processing SRX8350006-SRR11798547. (18/20)
2021-08-17 05:18:14 [INFO] Processing SRX8350009. (10/10)
2021-08-17 05:18:14 [INFO] Processing SRX8350009-SRR11798552. (19/20)
2021-08-17 05:26:07 [INFO] Processing SRX8350009-SRR11798553. (20/20)
2021-08-17 05:33:46 [INFO] Writing to disk...
2021-08-17 05:35:47 [INFO] Finished.
2021-08-23 13:34:04 [INFO] Starting.
2021-08-23 13:34:04 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/
2021-08-23 13:34:04 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/aggregate.hdf5
2021-08-23 13:34:04 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:34:05 [INFO] Building aggregate for 100kbp_raw network.
2021-08-23 13:34:05 [INFO] Writing every 10 Runs.
2021-08-23 13:34:05 [INFO] Processing SRX8350013. (1/10)
2021-08-23 13:34:05 [INFO] Processing SRX8350013-SRR11798541. (1/20)
2021-08-23 13:34:23 [INFO] Processing SRX8350013-SRR11798540. (2/20)
2021-08-23 13:34:42 [INFO] Processing SRX8350004. (2/10)
2021-08-23 13:34:42 [INFO] Processing SRX8350004-SRR11798542. (3/20)
2021-08-23 13:34:58 [INFO] Processing SRX8350004-SRR11798543. (4/20)
2021-08-23 13:35:18 [INFO] Processing SRX8350011. (3/10)
2021-08-23 13:35:18 [INFO] Processing SRX8350011-SRR11798556. (5/20)
2021-08-23 13:35:46 [INFO] Processing SRX8350011-SRR11798557. (6/20)
2021-08-23 13:36:15 [INFO] Processing SRX8350005. (4/10)
2021-08-23 13:36:15 [INFO] Processing SRX8350005-SRR11798545. (7/20)
2021-08-23 13:36:31 [INFO] Processing SRX8350005-SRR11798544. (8/20)
2021-08-23 13:36:51 [INFO] Processing SRX8350012. (5/10)
2021-08-23 13:36:51 [INFO] Processing SRX8350012-SRR11798539. (9/20)
2021-08-23 13:37:10 [INFO] Processing SRX8350012-SRR11798538. (10/20)
2021-08-23 13:37:29 [INFO] Writing to disk...
2021-08-23 13:37:42 [INFO] Processing SRX8350010. (6/10)
2021-08-23 13:37:42 [INFO] Processing SRX8350010-SRR11798555. (11/20)
2021-08-23 13:38:08 [INFO] Processing SRX8350010-SRR11798554. (12/20)
2021-08-23 13:38:31 [INFO] Processing SRX8350008. (7/10)
2021-08-23 13:38:31 [INFO] Processing SRX8350008-SRR11798550. (13/20)
2021-08-23 13:38:51 [INFO] Processing SRX8350008-SRR11798551. (14/20)
2021-08-23 13:39:11 [INFO] Processing SRX8350007. (8/10)
2021-08-23 13:39:11 [INFO] Processing SRX8350007-SRR11798549. (15/20)
2021-08-23 13:39:30 [INFO] Processing SRX8350007-SRR11798548. (16/20)
2021-08-23 13:39:53 [INFO] Processing SRX8350006. (9/10)
2021-08-23 13:39:53 [INFO] Processing SRX8350006-SRR11798546. (17/20)
2021-08-23 13:40:14 [INFO] Processing SRX8350006-SRR11798547. (18/20)
2021-08-23 13:40:39 [INFO] Processing SRX8350009. (10/10)
2021-08-23 13:40:39 [INFO] Processing SRX8350009-SRR11798552. (19/20)
2021-08-23 13:40:58 [INFO] Processing SRX8350009-SRR11798553. (20/20)
2021-08-23 13:41:24 [INFO] Writing to disk...
2021-08-23 13:41:38 [INFO] Finished.
2021-08-30 12:45:57 [INFO] Starting.
2021-08-30 12:45:57 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/
2021-08-30 12:45:57 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/aggregate.hdf5
2021-08-30 12:45:57 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-30 12:45:57 [INFO] Building aggregate for 250kbp_raw network.
2021-08-30 12:45:57 [INFO] Writing every 10 Runs.
2021-08-30 12:45:57 [INFO] Processing SRX8350013. (1/10)
2021-08-30 12:45:57 [INFO] Processing SRX8350013-SRR11798541. (1/20)
2021-08-30 12:46:09 [INFO] Processing SRX8350013-SRR11798540. (2/20)
2021-08-30 12:46:20 [INFO] Processing SRX8350004. (2/10)
2021-08-30 12:46:20 [INFO] Processing SRX8350004-SRR11798542. (3/20)
2021-08-30 12:46:32 [INFO] Processing SRX8350004-SRR11798543. (4/20)
2021-08-30 12:46:43 [INFO] Processing SRX8350011. (3/10)
2021-08-30 12:46:43 [INFO] Processing SRX8350011-SRR11798556. (5/20)
2021-08-30 12:47:00 [INFO] Processing SRX8350011-SRR11798557. (6/20)
2021-08-30 12:47:14 [INFO] Processing SRX8350005. (4/10)
2021-08-30 12:47:14 [INFO] Processing SRX8350005-SRR11798545. (7/20)
2021-08-30 12:47:23 [INFO] Processing SRX8350005-SRR11798544. (8/20)
2021-08-30 12:47:33 [INFO] Processing SRX8350012. (5/10)
2021-08-30 12:47:33 [INFO] Processing SRX8350012-SRR11798539. (9/20)
2021-08-30 12:47:43 [INFO] Processing SRX8350012-SRR11798538. (10/20)
2021-08-30 12:47:54 [INFO] Writing to disk...
2021-08-30 12:47:56 [INFO] Processing SRX8350010. (6/10)
2021-08-30 12:47:56 [INFO] Processing SRX8350010-SRR11798555. (11/20)
2021-08-30 12:48:12 [INFO] Processing SRX8350010-SRR11798554. (12/20)
2021-08-30 12:48:22 [INFO] Processing SRX8350008. (7/10)
2021-08-30 12:48:22 [INFO] Processing SRX8350008-SRR11798550. (13/20)
2021-08-30 12:48:33 [INFO] Processing SRX8350008-SRR11798551. (14/20)
2021-08-30 12:48:44 [INFO] Processing SRX8350007. (8/10)
2021-08-30 12:48:44 [INFO] Processing SRX8350007-SRR11798549. (15/20)
2021-08-30 12:48:55 [INFO] Processing SRX8350007-SRR11798548. (16/20)
2021-08-30 12:49:08 [INFO] Processing SRX8350006. (9/10)
2021-08-30 12:49:08 [INFO] Processing SRX8350006-SRR11798546. (17/20)
2021-08-30 12:49:20 [INFO] Processing SRX8350006-SRR11798547. (18/20)
2021-08-30 12:49:32 [INFO] Processing SRX8350009. (10/10)
2021-08-30 12:49:32 [INFO] Processing SRX8350009-SRR11798552. (19/20)
2021-08-30 12:49:46 [INFO] Processing SRX8350009-SRR11798553. (20/20)
2021-08-30 12:49:58 [INFO] Writing to disk...
2021-08-30 12:50:02 [INFO] Finished.
2021-08-30 21:29:37 [INFO] Starting.
2021-08-30 21:29:37 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/
2021-08-30 21:29:37 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP261290/aggregate.hdf5
2021-08-30 21:29:37 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-30 21:29:38 [INFO] Building aggregate for 500kbp_raw network.
2021-08-30 21:29:38 [INFO] Writing every 10 Runs.
2021-08-30 21:29:38 [INFO] Processing SRX8350013. (1/10)
2021-08-30 21:29:38 [INFO] Processing SRX8350013-SRR11798541. (1/20)
2021-08-30 21:29:45 [INFO] Processing SRX8350013-SRR11798540. (2/20)
2021-08-30 21:29:51 [INFO] Processing SRX8350004. (2/10)
2021-08-30 21:29:51 [INFO] Processing SRX8350004-SRR11798542. (3/20)
2021-08-30 21:29:59 [INFO] Processing SRX8350004-SRR11798543. (4/20)
2021-08-30 21:30:04 [INFO] Processing SRX8350011. (3/10)
2021-08-30 21:30:04 [INFO] Processing SRX8350011-SRR11798556. (5/20)
2021-08-30 21:30:09 [INFO] Processing SRX8350011-SRR11798557. (6/20)
2021-08-30 21:30:16 [INFO] Processing SRX8350005. (4/10)
2021-08-30 21:30:16 [INFO] Processing SRX8350005-SRR11798545. (7/20)
2021-08-30 21:30:21 [INFO] Processing SRX8350005-SRR11798544. (8/20)
2021-08-30 21:30:27 [INFO] Processing SRX8350012. (5/10)
2021-08-30 21:30:27 [INFO] Processing SRX8350012-SRR11798539. (9/20)
2021-08-30 21:30:34 [INFO] Processing SRX8350012-SRR11798538. (10/20)
2021-08-30 21:30:41 [INFO] Writing to disk...
2021-08-30 21:30:41 [INFO] Processing SRX8350010. (6/10)
2021-08-30 21:30:41 [INFO] Processing SRX8350010-SRR11798555. (11/20)
2021-08-30 21:30:48 [INFO] Processing SRX8350010-SRR11798554. (12/20)
2021-08-30 21:30:54 [INFO] Processing SRX8350008. (7/10)
2021-08-30 21:30:54 [INFO] Processing SRX8350008-SRR11798550. (13/20)
2021-08-30 21:31:00 [INFO] Processing SRX8350008-SRR11798551. (14/20)
2021-08-30 21:31:06 [INFO] Processing SRX8350007. (8/10)
2021-08-30 21:31:06 [INFO] Processing SRX8350007-SRR11798549. (15/20)
2021-08-30 21:31:14 [INFO] Processing SRX8350007-SRR11798548. (16/20)
2021-08-30 21:31:22 [INFO] Processing SRX8350006. (9/10)
2021-08-30 21:31:22 [INFO] Processing SRX8350006-SRR11798546. (17/20)
2021-08-30 21:31:28 [INFO] Processing SRX8350006-SRR11798547. (18/20)
2021-08-30 21:31:36 [INFO] Processing SRX8350009. (10/10)
2021-08-30 21:31:36 [INFO] Processing SRX8350009-SRR11798552. (19/20)
2021-08-30 21:31:44 [INFO] Processing SRX8350009-SRR11798553. (20/20)
2021-08-30 21:31:51 [INFO] Writing to disk...
2021-08-30 21:31:52 [INFO] Finished.