2021-06-10 00:16:40 [INFO] Starting.
2021-06-10 00:16:40 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/
2021-06-10 00:16:40 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/aggregate.hdf5
2021-06-10 00:16:40 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 00:16:40 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 00:16:41 [INFO] Building aggregate.
2021-06-10 00:16:41 [INFO] Writing every 10 Runs.
2021-06-10 00:16:41 [INFO] Processing SRX3634736. (1/12)
2021-06-10 00:16:41 [INFO] Processing SRX3634736-SRR6657559. (1/54)
2021-06-10 00:16:48 [INFO] Processing SRX3634736-SRR6657558. (2/54)
2021-06-10 00:17:04 [INFO] Processing SRX3634736-SRR6657556. (3/54)
2021-06-10 00:17:12 [INFO] Processing SRX3634736-SRR6657557. (4/54)
2021-06-10 00:17:16 [INFO] Processing SRX3634736-SRR6657560. (5/54)
2021-06-10 00:17:21 [INFO] Processing SRX3634729. (2/12)
2021-06-10 00:17:21 [INFO] Processing SRX3634729-SRR6657520. (6/54)
2021-06-10 00:17:29 [INFO] Processing SRX3634729-SRR6657522. (7/54)
2021-06-10 00:17:36 [INFO] Processing SRX3634729-SRR6657524. (8/54)
2021-06-10 00:17:41 [INFO] Processing SRX3634729-SRR6657521. (9/54)
2021-06-10 00:17:48 [INFO] Processing SRX3634729-SRR6657523. (10/54)
2021-06-10 00:17:54 [INFO] Writing to disk...
2021-06-10 00:17:57 [INFO] Processing SRX3634733. (3/12)
2021-06-10 00:17:57 [INFO] Processing SRX3634733-SRR6657542. (11/54)
2021-06-10 00:18:21 [INFO] Processing SRX3634733-SRR6657541. (12/54)
2021-06-10 00:18:27 [INFO] Processing SRX3634733-SRR6657545. (13/54)
2021-06-10 00:18:32 [INFO] Processing SRX3634733-SRR6657543. (14/54)
2021-06-10 00:18:38 [INFO] Processing SRX3634733-SRR6657544. (15/54)
2021-06-10 00:18:42 [INFO] Processing SRX3634738. (4/12)
2021-06-10 00:18:42 [INFO] Processing SRX3634738-SRR6657566. (16/54)
2021-06-10 00:18:48 [INFO] Processing SRX3634738-SRR6657568. (17/54)
2021-06-10 00:19:00 [INFO] Processing SRX3634738-SRR6657565. (18/54)
2021-06-10 00:19:08 [INFO] Processing SRX3634738-SRR6657567. (19/54)
2021-06-10 00:19:20 [INFO] Processing SRX3634728. (5/12)
2021-06-10 00:19:20 [INFO] Processing SRX3634728-SRR6657518. (20/54)
2021-06-10 00:19:46 [INFO] Writing to disk...
2021-06-10 00:19:57 [INFO] Processing SRX3634728-SRR6657516. (21/54)
2021-06-10 00:20:06 [INFO] Processing SRX3634728-SRR6657517. (22/54)
2021-06-10 00:20:14 [INFO] Processing SRX3634728-SRR6657519. (23/54)
2021-06-10 00:20:20 [INFO] Processing SRX3634728-SRR6657515. (24/54)
2021-06-10 00:20:29 [INFO] Processing SRX3634735. (6/12)
2021-06-10 00:20:29 [INFO] Processing SRX3634735-SRR6657551. (25/54)
2021-06-10 00:20:38 [INFO] Processing SRX3634735-SRR6657553. (26/54)
2021-06-10 00:21:15 [INFO] Processing SRX3634735-SRR6657555. (27/54)
2021-06-10 00:21:22 [INFO] Processing SRX3634735-SRR6657554. (28/54)
2021-06-10 00:21:29 [INFO] Processing SRX3634735-SRR6657552. (29/54)
2021-06-10 00:21:33 [INFO] Processing SRX3634730. (7/12)
2021-06-10 00:21:33 [INFO] Processing SRX3634730-SRR6657525. (30/54)
2021-06-10 00:21:42 [INFO] Writing to disk...
2021-06-10 00:21:57 [INFO] Processing SRX3634730-SRR6657528. (31/54)
2021-06-10 00:22:02 [INFO] Processing SRX3634730-SRR6657526. (32/54)
2021-06-10 00:22:10 [INFO] Processing SRX3634730-SRR6657529. (33/54)
2021-06-10 00:22:16 [INFO] Processing SRX3634730-SRR6657527. (34/54)
2021-06-10 00:22:42 [INFO] Processing SRX3634737. (8/12)
2021-06-10 00:22:42 [INFO] Processing SRX3634737-SRR6657561. (35/54)
2021-06-10 00:22:49 [INFO] Processing SRX3634737-SRR6657563. (36/54)
2021-06-10 00:22:57 [INFO] Processing SRX3634737-SRR6657564. (37/54)
2021-06-10 00:23:04 [INFO] Processing SRX3634737-SRR6657562. (38/54)
2021-06-10 00:23:12 [INFO] Processing SRX4711156. (9/12)
2021-06-10 00:23:12 [INFO] Processing SRX4711156-SRR7872270. (39/54)
2021-06-10 00:23:29 [INFO] Processing SRX3634734. (10/12)
2021-06-10 00:23:29 [INFO] Processing SRX3634734-SRR6657548. (40/54)
2021-06-10 00:23:49 [INFO] Writing to disk...
2021-06-10 00:24:05 [INFO] Processing SRX3634734-SRR6657546. (41/54)
2021-06-10 00:24:13 [INFO] Processing SRX3634734-SRR6657547. (42/54)
2021-06-10 00:24:23 [INFO] Processing SRX3634734-SRR6657549. (43/54)
2021-06-10 00:24:29 [INFO] Processing SRX3634734-SRR6657550. (44/54)
2021-06-10 00:24:36 [INFO] Processing SRX3634727. (11/12)
2021-06-10 00:24:36 [INFO] Processing SRX3634727-SRR6657511. (45/54)
2021-06-10 00:24:45 [INFO] Processing SRX3634727-SRR6657510. (46/54)
2021-06-10 00:25:05 [INFO] Processing SRX3634727-SRR6657513. (47/54)
2021-06-10 00:25:11 [INFO] Processing SRX3634727-SRR6657514. (48/54)
2021-06-10 00:25:18 [INFO] Processing SRX3634727-SRR6657512. (49/54)
2021-06-10 00:25:29 [INFO] Processing SRX3634732. (12/12)
2021-06-10 00:25:29 [INFO] Processing SRX3634732-SRR6657539. (50/54)
2021-06-10 00:25:35 [INFO] Writing to disk...
2021-06-10 00:25:55 [INFO] Processing SRX3634732-SRR6657538. (51/54)
2021-06-10 00:26:22 [INFO] Processing SRX3634732-SRR6657536. (52/54)
2021-06-10 00:26:31 [INFO] Processing SRX3634732-SRR6657540. (53/54)
2021-06-10 00:26:38 [INFO] Processing SRX3634732-SRR6657537. (54/54)
2021-06-10 00:26:50 [INFO] Writing to disk...
2021-06-10 00:27:06 [INFO] Finished.
2021-08-02 17:08:55 [INFO] Starting.
2021-08-02 17:08:56 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/
2021-08-02 17:08:56 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/aggregate.hdf5
2021-08-02 17:08:56 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-02 17:08:56 [INFO] Building aggregate for 1bp_raw network.
2021-08-02 17:08:56 [INFO] Writing every 10 Runs.
2021-08-02 17:08:56 [INFO] Processing SRX3634736. (1/12)
2021-08-02 17:08:56 [INFO] Processing SRX3634736-SRR6657559. (1/54)
2021-08-02 17:33:56 [INFO] Processing SRX3634736-SRR6657558. (2/54)
2021-08-02 17:37:02 [ERROR] Adding SRR6657558:chr1_vs_chr10 to in memory aggregate failed. Error message:
Traceback (most recent call last):
  File "/grid/gillis/data/nfox/hi_c_data_processing/software/aggregate.py", line 428, in add_dataset
    aggregate_data[c] = aggregate_data[c] + net
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/base.py", line 415, in __add__
    return self._add_sparse(other)
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 359, in _add_sparse
    return self._binopt(other, '_plus_')
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 1226, in _binopt
    indptr = np.empty(self.indptr.shape, dtype=idx_dtype)
MemoryError: Unable to allocate 950. MiB for an array with shape (248956423,) and data type int32

2021-08-04 22:08:05 [INFO] Starting.
2021-08-04 22:08:05 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/
2021-08-04 22:08:05 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/aggregate.hdf5
2021-08-04 22:08:05 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-04 22:08:06 [INFO] Building aggregate for 1bp_raw network.
2021-08-04 22:08:06 [INFO] Writing every 10 Runs.
2021-08-04 22:08:06 [INFO] Processing SRX3634736. (1/12)
2021-08-04 22:08:06 [INFO] Processing SRX3634736-SRR6657559. (1/54)
2021-08-04 22:13:15 [INFO] Processing SRX3634736-SRR6657558. (2/54)
2021-08-04 22:22:54 [INFO] Processing SRX3634736-SRR6657556. (3/54)
2021-08-04 22:32:59 [INFO] Processing SRX3634736-SRR6657557. (4/54)
2021-08-04 22:42:19 [INFO] Processing SRX3634736-SRR6657560. (5/54)
2021-08-04 22:51:32 [INFO] Processing SRX3634729. (2/12)
2021-08-04 22:51:32 [INFO] Processing SRX3634729-SRR6657520. (6/54)
2021-08-04 23:00:40 [INFO] Processing SRX3634729-SRR6657522. (7/54)
2021-08-04 23:10:26 [INFO] Processing SRX3634729-SRR6657524. (8/54)
2021-08-04 23:19:31 [INFO] Processing SRX3634729-SRR6657521. (9/54)
2021-08-04 23:29:00 [INFO] Processing SRX3634729-SRR6657523. (10/54)
2021-08-04 23:38:09 [INFO] Writing to disk...
2021-08-04 23:39:15 [INFO] Processing SRX3634733. (3/12)
2021-08-04 23:39:15 [INFO] Processing SRX3634733-SRR6657542. (11/54)
2021-08-04 23:48:17 [INFO] Processing SRX3634733-SRR6657541. (12/54)
2021-08-04 23:57:24 [INFO] Processing SRX3634733-SRR6657545. (13/54)
2021-08-05 00:05:53 [INFO] Processing SRX3634733-SRR6657543. (14/54)
2021-08-05 00:15:24 [INFO] Processing SRX3634733-SRR6657544. (15/54)
2021-08-05 00:24:23 [INFO] Processing SRX3634738. (4/12)
2021-08-05 00:24:23 [INFO] Processing SRX3634738-SRR6657566. (16/54)
2021-08-05 00:33:48 [INFO] Processing SRX3634738-SRR6657568. (17/54)
2021-08-05 00:43:26 [INFO] Processing SRX3634738-SRR6657565. (18/54)
2021-08-05 00:52:57 [INFO] Processing SRX3634738-SRR6657567. (19/54)
2021-08-05 01:02:27 [INFO] Processing SRX3634728. (5/12)
2021-08-05 01:02:27 [INFO] Processing SRX3634728-SRR6657518. (20/54)
2021-08-05 01:11:58 [INFO] Writing to disk...
2021-08-05 01:13:26 [INFO] Processing SRX3634728-SRR6657516. (21/54)
2021-08-05 01:22:41 [INFO] Processing SRX3634728-SRR6657517. (22/54)
2021-08-05 01:32:25 [INFO] Processing SRX3634728-SRR6657519. (23/54)
2021-08-05 01:41:56 [INFO] Processing SRX3634728-SRR6657515. (24/54)
2021-08-05 01:51:29 [INFO] Processing SRX3634735. (6/12)
2021-08-05 01:51:29 [INFO] Processing SRX3634735-SRR6657551. (25/54)
2021-08-05 02:01:01 [INFO] Processing SRX3634735-SRR6657553. (26/54)
2021-08-05 02:10:33 [INFO] Processing SRX3634735-SRR6657555. (27/54)
2021-08-05 02:20:04 [INFO] Processing SRX3634735-SRR6657554. (28/54)
2021-08-05 02:29:39 [INFO] Processing SRX3634735-SRR6657552. (29/54)
2021-08-05 02:39:10 [INFO] Processing SRX3634730. (7/12)
2021-08-05 02:39:10 [INFO] Processing SRX3634730-SRR6657525. (30/54)
2021-08-05 02:48:23 [INFO] Writing to disk...
2021-08-05 02:49:50 [INFO] Processing SRX3634730-SRR6657528. (31/54)
2021-08-05 02:58:46 [INFO] Processing SRX3634730-SRR6657526. (32/54)
2021-08-05 03:07:54 [INFO] Processing SRX3634730-SRR6657529. (33/54)
2021-08-05 03:16:48 [INFO] Processing SRX3634730-SRR6657527. (34/54)
2021-08-05 03:26:03 [INFO] Processing SRX3634737. (8/12)
2021-08-05 03:26:03 [INFO] Processing SRX3634737-SRR6657561. (35/54)
2021-08-05 03:35:27 [INFO] Processing SRX3634737-SRR6657563. (36/54)
2021-08-05 03:44:53 [INFO] Processing SRX3634737-SRR6657564. (37/54)
2021-08-05 03:54:21 [INFO] Processing SRX3634737-SRR6657562. (38/54)
2021-08-05 04:03:57 [INFO] Processing SRX4711156. (9/12)
2021-08-05 04:03:57 [INFO] Processing SRX4711156-SRR7872270. (39/54)
2021-08-05 04:13:47 [INFO] Processing SRX3634734. (10/12)
2021-08-05 04:13:47 [INFO] Processing SRX3634734-SRR6657548. (40/54)
2021-08-05 04:23:02 [INFO] Writing to disk...
2021-08-05 04:24:37 [INFO] Processing SRX3634734-SRR6657546. (41/54)
2021-08-05 04:33:50 [INFO] Processing SRX3634734-SRR6657547. (42/54)
2021-08-05 04:43:19 [INFO] Processing SRX3634734-SRR6657549. (43/54)
2021-08-05 04:52:39 [INFO] Processing SRX3634734-SRR6657550. (44/54)
2021-08-05 05:01:40 [INFO] Processing SRX3634727. (11/12)
2021-08-05 05:01:40 [INFO] Processing SRX3634727-SRR6657511. (45/54)
2021-08-05 05:10:49 [INFO] Processing SRX3634727-SRR6657510. (46/54)
2021-08-05 05:19:54 [INFO] Processing SRX3634727-SRR6657513. (47/54)
2021-08-05 05:28:55 [INFO] Processing SRX3634727-SRR6657514. (48/54)
2021-08-05 05:37:54 [INFO] Processing SRX3634727-SRR6657512. (49/54)
2021-08-05 05:46:59 [INFO] Processing SRX3634732. (12/12)
2021-08-05 05:46:59 [INFO] Processing SRX3634732-SRR6657539. (50/54)
2021-08-05 05:55:54 [INFO] Writing to disk...
2021-08-05 05:57:32 [INFO] Processing SRX3634732-SRR6657538. (51/54)
2021-08-05 06:06:37 [INFO] Processing SRX3634732-SRR6657536. (52/54)
2021-08-05 06:15:41 [INFO] Processing SRX3634732-SRR6657540. (53/54)
2021-08-05 06:24:34 [INFO] Processing SRX3634732-SRR6657537. (54/54)
2021-08-05 06:33:20 [INFO] Writing to disk...
2021-08-05 06:34:58 [INFO] Finished.
2021-08-12 17:10:03 [INFO] Starting.
2021-08-12 17:10:03 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/
2021-08-12 17:10:03 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/aggregate.hdf5
2021-08-12 17:10:03 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 17:10:03 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 17:10:03 [INFO] Writing every 10 Runs.
2021-08-12 17:10:03 [INFO] Processing SRX3634736. (1/12)
2021-08-12 17:10:03 [INFO] Processing SRX3634736-SRR6657559. (1/54)
2021-08-12 17:10:10 [INFO] Processing SRX3634736-SRR6657558. (2/54)
2021-08-12 17:10:15 [INFO] Processing SRX3634736-SRR6657556. (3/54)
2021-08-12 17:10:25 [INFO] Processing SRX3634736-SRR6657557. (4/54)
2021-08-12 17:10:30 [INFO] Processing SRX3634736-SRR6657560. (5/54)
2021-08-12 17:10:37 [INFO] Processing SRX3634729. (2/12)
2021-08-12 17:10:37 [INFO] Processing SRX3634729-SRR6657520. (6/54)
2021-08-12 17:10:49 [INFO] Processing SRX3634729-SRR6657522. (7/54)
2021-08-12 17:11:00 [INFO] Processing SRX3634729-SRR6657524. (8/54)
2021-08-12 17:11:05 [INFO] Processing SRX3634729-SRR6657521. (9/54)
2021-08-12 17:11:15 [INFO] Processing SRX3634729-SRR6657523. (10/54)
2021-08-12 17:11:20 [INFO] Writing to disk...
2021-08-12 17:11:23 [INFO] Processing SRX3634733. (3/12)
2021-08-12 17:11:23 [INFO] Processing SRX3634733-SRR6657542. (11/54)
2021-08-12 17:11:30 [INFO] Processing SRX3634733-SRR6657541. (12/54)
2021-08-12 17:11:37 [INFO] Processing SRX3634733-SRR6657545. (13/54)
2021-08-12 17:11:41 [INFO] Processing SRX3634733-SRR6657543. (14/54)
2021-08-12 17:11:48 [INFO] Processing SRX3634733-SRR6657544. (15/54)
2021-08-12 17:11:52 [INFO] Processing SRX3634738. (4/12)
2021-08-12 17:11:52 [INFO] Processing SRX3634738-SRR6657566. (16/54)
2021-08-12 17:12:00 [INFO] Processing SRX3634738-SRR6657568. (17/54)
2021-08-12 17:12:15 [INFO] Processing SRX3634738-SRR6657565. (18/54)
2021-08-12 17:12:30 [INFO] Processing SRX3634738-SRR6657567. (19/54)
2021-08-12 17:12:45 [INFO] Processing SRX3634728. (5/12)
2021-08-12 17:12:45 [INFO] Processing SRX3634728-SRR6657518. (20/54)
2021-08-12 17:12:52 [INFO] Writing to disk...
2021-08-12 17:13:04 [INFO] Processing SRX3634728-SRR6657516. (21/54)
2021-08-12 17:13:13 [INFO] Processing SRX3634728-SRR6657517. (22/54)
2021-08-12 17:13:24 [INFO] Processing SRX3634728-SRR6657519. (23/54)
2021-08-12 17:13:29 [INFO] Processing SRX3634728-SRR6657515. (24/54)
2021-08-12 17:13:41 [INFO] Processing SRX3634735. (6/12)
2021-08-12 17:13:41 [INFO] Processing SRX3634735-SRR6657551. (25/54)
2021-08-12 17:13:50 [INFO] Processing SRX3634735-SRR6657553. (26/54)
2021-08-12 17:13:55 [INFO] Processing SRX3634735-SRR6657555. (27/54)
2021-08-12 17:14:03 [INFO] Processing SRX3634735-SRR6657554. (28/54)
2021-08-12 17:14:11 [INFO] Processing SRX3634735-SRR6657552. (29/54)
2021-08-12 17:14:17 [INFO] Processing SRX3634730. (7/12)
2021-08-12 17:14:17 [INFO] Processing SRX3634730-SRR6657525. (30/54)
2021-08-12 17:14:26 [INFO] Writing to disk...
2021-08-12 17:14:42 [INFO] Processing SRX3634730-SRR6657528. (31/54)
2021-08-12 17:14:46 [INFO] Processing SRX3634730-SRR6657526. (32/54)
2021-08-12 17:14:56 [INFO] Processing SRX3634730-SRR6657529. (33/54)
2021-08-12 17:15:00 [INFO] Processing SRX3634730-SRR6657527. (34/54)
2021-08-12 17:15:10 [INFO] Processing SRX3634737. (8/12)
2021-08-12 17:15:10 [INFO] Processing SRX3634737-SRR6657561. (35/54)
2021-08-12 17:15:20 [INFO] Processing SRX3634737-SRR6657563. (36/54)
2021-08-12 17:15:32 [INFO] Processing SRX3634737-SRR6657564. (37/54)
2021-08-12 17:15:42 [INFO] Processing SRX3634737-SRR6657562. (38/54)
2021-08-12 17:15:51 [INFO] Processing SRX4711156. (9/12)
2021-08-12 17:15:51 [INFO] Processing SRX4711156-SRR7872270. (39/54)
2021-08-12 17:16:22 [INFO] Processing SRX3634734. (10/12)
2021-08-12 17:16:22 [INFO] Processing SRX3634734-SRR6657548. (40/54)
2021-08-12 17:16:33 [INFO] Writing to disk...
2021-08-12 17:16:49 [INFO] Processing SRX3634734-SRR6657546. (41/54)
2021-08-12 17:17:00 [INFO] Processing SRX3634734-SRR6657547. (42/54)
2021-08-12 17:17:13 [INFO] Processing SRX3634734-SRR6657549. (43/54)
2021-08-12 17:17:18 [INFO] Processing SRX3634734-SRR6657550. (44/54)
2021-08-12 17:17:24 [INFO] Processing SRX3634727. (11/12)
2021-08-12 17:17:24 [INFO] Processing SRX3634727-SRR6657511. (45/54)
2021-08-12 17:17:40 [INFO] Processing SRX3634727-SRR6657510. (46/54)
2021-08-12 17:17:53 [INFO] Processing SRX3634727-SRR6657513. (47/54)
2021-08-12 17:18:00 [INFO] Processing SRX3634727-SRR6657514. (48/54)
2021-08-12 17:18:07 [INFO] Processing SRX3634727-SRR6657512. (49/54)
2021-08-12 17:18:19 [INFO] Processing SRX3634732. (12/12)
2021-08-12 17:18:19 [INFO] Processing SRX3634732-SRR6657539. (50/54)
2021-08-12 17:18:25 [INFO] Writing to disk...
2021-08-12 17:18:44 [INFO] Processing SRX3634732-SRR6657538. (51/54)
2021-08-12 17:18:55 [INFO] Processing SRX3634732-SRR6657536. (52/54)
2021-08-12 17:19:05 [INFO] Processing SRX3634732-SRR6657540. (53/54)
2021-08-12 17:19:11 [INFO] Processing SRX3634732-SRR6657537. (54/54)
2021-08-12 17:19:22 [INFO] Writing to disk...
2021-08-12 17:19:40 [INFO] Finished.
2021-08-13 09:03:37 [INFO] Starting.
2021-08-13 09:03:37 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/
2021-08-13 09:03:37 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/aggregate.hdf5
2021-08-13 09:03:37 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-13 09:03:38 [INFO] Building aggregate for 25kbp_raw network.
2021-08-13 09:03:38 [INFO] Writing every 10 Runs.
2021-08-13 09:03:38 [INFO] Processing SRX3634736. (1/12)
2021-08-13 09:03:38 [INFO] Processing SRX3634736-SRR6657559. (1/54)
2021-08-13 09:03:47 [INFO] Processing SRX3634736-SRR6657558. (2/54)
2021-08-13 09:03:52 [INFO] Processing SRX3634736-SRR6657556. (3/54)
2021-08-13 09:04:01 [INFO] Processing SRX3634736-SRR6657557. (4/54)
2021-08-13 09:04:07 [INFO] Processing SRX3634736-SRR6657560. (5/54)
2021-08-13 09:04:15 [INFO] Processing SRX3634729. (2/12)
2021-08-13 09:04:15 [INFO] Processing SRX3634729-SRR6657520. (6/54)
2021-08-13 09:04:25 [INFO] Processing SRX3634729-SRR6657522. (7/54)
2021-08-13 09:04:37 [INFO] Processing SRX3634729-SRR6657524. (8/54)
2021-08-13 09:04:42 [INFO] Processing SRX3634729-SRR6657521. (9/54)
2021-08-13 09:04:54 [INFO] Processing SRX3634729-SRR6657523. (10/54)
2021-08-13 09:05:00 [INFO] Writing to disk...
2021-08-13 09:05:02 [INFO] Processing SRX3634733. (3/12)
2021-08-13 09:05:02 [INFO] Processing SRX3634733-SRR6657542. (11/54)
2021-08-13 09:05:10 [INFO] Processing SRX3634733-SRR6657541. (12/54)
2021-08-13 09:05:17 [INFO] Processing SRX3634733-SRR6657545. (13/54)
2021-08-13 09:05:21 [INFO] Processing SRX3634733-SRR6657543. (14/54)
2021-08-13 09:05:30 [INFO] Processing SRX3634733-SRR6657544. (15/54)
2021-08-13 09:05:34 [INFO] Processing SRX3634738. (4/12)
2021-08-13 09:05:34 [INFO] Processing SRX3634738-SRR6657566. (16/54)
2021-08-13 09:05:44 [INFO] Processing SRX3634738-SRR6657568. (17/54)
2021-08-13 09:05:56 [INFO] Processing SRX3634738-SRR6657565. (18/54)
2021-08-13 09:06:08 [INFO] Processing SRX3634738-SRR6657567. (19/54)
2021-08-13 09:06:23 [INFO] Processing SRX3634728. (5/12)
2021-08-13 09:06:23 [INFO] Processing SRX3634728-SRR6657518. (20/54)
2021-08-13 09:06:29 [INFO] Writing to disk...
2021-08-13 09:06:43 [INFO] Processing SRX3634728-SRR6657516. (21/54)
2021-08-13 09:06:53 [INFO] Processing SRX3634728-SRR6657517. (22/54)
2021-08-13 09:07:03 [INFO] Processing SRX3634728-SRR6657519. (23/54)
2021-08-13 09:07:09 [INFO] Processing SRX3634728-SRR6657515. (24/54)
2021-08-13 09:07:18 [INFO] Processing SRX3634735. (6/12)
2021-08-13 09:07:18 [INFO] Processing SRX3634735-SRR6657551. (25/54)
2021-08-13 09:07:27 [INFO] Processing SRX3634735-SRR6657553. (26/54)
2021-08-13 09:07:33 [INFO] Processing SRX3634735-SRR6657555. (27/54)
2021-08-13 09:07:43 [INFO] Processing SRX3634735-SRR6657554. (28/54)
2021-08-13 09:07:51 [INFO] Processing SRX3634735-SRR6657552. (29/54)
2021-08-13 09:07:55 [INFO] Processing SRX3634730. (7/12)
2021-08-13 09:07:55 [INFO] Processing SRX3634730-SRR6657525. (30/54)
2021-08-13 09:08:06 [INFO] Writing to disk...
2021-08-13 09:08:25 [INFO] Processing SRX3634730-SRR6657528. (31/54)
2021-08-13 09:08:29 [INFO] Processing SRX3634730-SRR6657526. (32/54)
2021-08-13 09:08:41 [INFO] Processing SRX3634730-SRR6657529. (33/54)
2021-08-13 09:08:45 [INFO] Processing SRX3634730-SRR6657527. (34/54)
2021-08-13 09:08:57 [INFO] Processing SRX3634737. (8/12)
2021-08-13 09:08:57 [INFO] Processing SRX3634737-SRR6657561. (35/54)
2021-08-13 09:09:08 [INFO] Processing SRX3634737-SRR6657563. (36/54)
2021-08-13 09:09:20 [INFO] Processing SRX3634737-SRR6657564. (37/54)
2021-08-13 09:09:33 [INFO] Processing SRX3634737-SRR6657562. (38/54)
2021-08-13 09:09:42 [INFO] Processing SRX4711156. (9/12)
2021-08-13 09:09:42 [INFO] Processing SRX4711156-SRR7872270. (39/54)
2021-08-13 09:10:13 [INFO] Processing SRX3634734. (10/12)
2021-08-13 09:10:13 [INFO] Processing SRX3634734-SRR6657548. (40/54)
2021-08-13 09:10:23 [INFO] Writing to disk...
2021-08-13 09:10:43 [INFO] Processing SRX3634734-SRR6657546. (41/54)
2021-08-13 09:10:54 [INFO] Processing SRX3634734-SRR6657547. (42/54)
2021-08-13 09:11:06 [INFO] Processing SRX3634734-SRR6657549. (43/54)
2021-08-13 09:11:13 [INFO] Processing SRX3634734-SRR6657550. (44/54)
2021-08-13 09:11:19 [INFO] Processing SRX3634727. (11/12)
2021-08-13 09:11:19 [INFO] Processing SRX3634727-SRR6657511. (45/54)
2021-08-13 09:11:35 [INFO] Processing SRX3634727-SRR6657510. (46/54)
2021-08-13 09:11:47 [INFO] Processing SRX3634727-SRR6657513. (47/54)
2021-08-13 09:11:54 [INFO] Processing SRX3634727-SRR6657514. (48/54)
2021-08-13 09:12:02 [INFO] Processing SRX3634727-SRR6657512. (49/54)
2021-08-13 09:12:14 [INFO] Processing SRX3634732. (12/12)
2021-08-13 09:12:14 [INFO] Processing SRX3634732-SRR6657539. (50/54)
2021-08-13 09:12:19 [INFO] Writing to disk...
2021-08-13 09:12:41 [INFO] Processing SRX3634732-SRR6657538. (51/54)
2021-08-13 09:12:52 [INFO] Processing SRX3634732-SRR6657536. (52/54)
2021-08-13 09:13:02 [INFO] Processing SRX3634732-SRR6657540. (53/54)
2021-08-13 09:13:07 [INFO] Processing SRX3634732-SRR6657537. (54/54)
2021-08-13 09:13:19 [INFO] Writing to disk...
2021-08-13 09:13:42 [INFO] Finished.
2021-08-13 13:10:08 [INFO] Starting.
2021-08-13 13:10:08 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/
2021-08-13 13:10:08 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/aggregate.hdf5
2021-08-13 13:10:08 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-13 13:10:09 [INFO] Building aggregate for 5kbp_raw network.
2021-08-13 13:10:09 [INFO] Writing every 10 Runs.
2021-08-13 13:10:09 [INFO] Processing SRX3634736. (1/12)
2021-08-13 13:10:09 [INFO] Processing SRX3634736-SRR6657559. (1/54)
2021-08-13 13:10:18 [INFO] Processing SRX3634736-SRR6657558. (2/54)
2021-08-13 13:10:22 [INFO] Processing SRX3634736-SRR6657556. (3/54)
2021-08-13 13:10:32 [INFO] Processing SRX3634736-SRR6657557. (4/54)
2021-08-13 13:10:38 [INFO] Processing SRX3634736-SRR6657560. (5/54)
2021-08-13 13:10:48 [INFO] Processing SRX3634729. (2/12)
2021-08-13 13:10:48 [INFO] Processing SRX3634729-SRR6657520. (6/54)
2021-08-13 13:10:59 [INFO] Processing SRX3634729-SRR6657522. (7/54)
2021-08-13 13:11:10 [INFO] Processing SRX3634729-SRR6657524. (8/54)
2021-08-13 13:11:16 [INFO] Processing SRX3634729-SRR6657521. (9/54)
2021-08-13 13:11:27 [INFO] Processing SRX3634729-SRR6657523. (10/54)
2021-08-13 13:11:32 [INFO] Writing to disk...
2021-08-13 13:11:35 [INFO] Processing SRX3634733. (3/12)
2021-08-13 13:11:35 [INFO] Processing SRX3634733-SRR6657542. (11/54)
2021-08-13 13:11:46 [INFO] Processing SRX3634733-SRR6657541. (12/54)
2021-08-13 13:11:54 [INFO] Processing SRX3634733-SRR6657545. (13/54)
2021-08-13 13:11:59 [INFO] Processing SRX3634733-SRR6657543. (14/54)
2021-08-13 13:12:09 [INFO] Processing SRX3634733-SRR6657544. (15/54)
2021-08-13 13:12:14 [INFO] Processing SRX3634738. (4/12)
2021-08-13 13:12:14 [INFO] Processing SRX3634738-SRR6657566. (16/54)
2021-08-13 13:12:23 [INFO] Processing SRX3634738-SRR6657568. (17/54)
2021-08-13 13:12:36 [INFO] Processing SRX3634738-SRR6657565. (18/54)
2021-08-13 13:12:47 [INFO] Processing SRX3634738-SRR6657567. (19/54)
2021-08-13 13:13:00 [INFO] Processing SRX3634728. (5/12)
2021-08-13 13:13:00 [INFO] Processing SRX3634728-SRR6657518. (20/54)
2021-08-13 13:13:06 [INFO] Writing to disk...
2021-08-13 13:13:18 [INFO] Processing SRX3634728-SRR6657516. (21/54)
2021-08-13 13:13:29 [INFO] Processing SRX3634728-SRR6657517. (22/54)
2021-08-13 13:13:39 [INFO] Processing SRX3634728-SRR6657519. (23/54)
2021-08-13 13:13:46 [INFO] Processing SRX3634728-SRR6657515. (24/54)
2021-08-13 13:13:56 [INFO] Processing SRX3634735. (6/12)
2021-08-13 13:13:56 [INFO] Processing SRX3634735-SRR6657551. (25/54)
2021-08-13 13:14:06 [INFO] Processing SRX3634735-SRR6657553. (26/54)
2021-08-13 13:14:12 [INFO] Processing SRX3634735-SRR6657555. (27/54)
2021-08-13 13:14:21 [INFO] Processing SRX3634735-SRR6657554. (28/54)
2021-08-13 13:14:29 [INFO] Processing SRX3634735-SRR6657552. (29/54)
2021-08-13 13:14:34 [INFO] Processing SRX3634730. (7/12)
2021-08-13 13:14:34 [INFO] Processing SRX3634730-SRR6657525. (30/54)
2021-08-13 13:14:44 [INFO] Writing to disk...
2021-08-13 13:15:02 [INFO] Processing SRX3634730-SRR6657528. (31/54)
2021-08-13 13:15:07 [INFO] Processing SRX3634730-SRR6657526. (32/54)
2021-08-13 13:15:20 [INFO] Processing SRX3634730-SRR6657529. (33/54)
2021-08-13 13:15:26 [INFO] Processing SRX3634730-SRR6657527. (34/54)
2021-08-13 13:15:36 [INFO] Processing SRX3634737. (8/12)
2021-08-13 13:15:36 [INFO] Processing SRX3634737-SRR6657561. (35/54)
2021-08-13 13:15:47 [INFO] Processing SRX3634737-SRR6657563. (36/54)
2021-08-13 13:15:57 [INFO] Processing SRX3634737-SRR6657564. (37/54)
2021-08-13 13:16:09 [INFO] Processing SRX3634737-SRR6657562. (38/54)
2021-08-13 13:16:17 [INFO] Processing SRX4711156. (9/12)
2021-08-13 13:16:17 [INFO] Processing SRX4711156-SRR7872270. (39/54)
2021-08-13 13:16:42 [INFO] Processing SRX3634734. (10/12)
2021-08-13 13:16:42 [INFO] Processing SRX3634734-SRR6657548. (40/54)
2021-08-13 13:16:54 [INFO] Writing to disk...
2021-08-13 13:17:13 [INFO] Processing SRX3634734-SRR6657546. (41/54)
2021-08-13 13:17:24 [INFO] Processing SRX3634734-SRR6657547. (42/54)
2021-08-13 13:17:37 [INFO] Processing SRX3634734-SRR6657549. (43/54)
2021-08-13 13:17:44 [INFO] Processing SRX3634734-SRR6657550. (44/54)
2021-08-13 13:17:51 [INFO] Processing SRX3634727. (11/12)
2021-08-13 13:17:51 [INFO] Processing SRX3634727-SRR6657511. (45/54)
2021-08-13 13:18:04 [INFO] Processing SRX3634727-SRR6657510. (46/54)
2021-08-13 13:18:16 [INFO] Processing SRX3634727-SRR6657513. (47/54)
2021-08-13 13:18:23 [INFO] Processing SRX3634727-SRR6657514. (48/54)
2021-08-13 13:18:31 [INFO] Processing SRX3634727-SRR6657512. (49/54)
2021-08-13 13:18:46 [INFO] Processing SRX3634732. (12/12)
2021-08-13 13:18:46 [INFO] Processing SRX3634732-SRR6657539. (50/54)
2021-08-13 13:18:53 [INFO] Writing to disk...
2021-08-13 13:19:16 [INFO] Processing SRX3634732-SRR6657538. (51/54)
2021-08-13 13:19:27 [INFO] Processing SRX3634732-SRR6657536. (52/54)
2021-08-13 13:19:36 [INFO] Processing SRX3634732-SRR6657540. (53/54)
2021-08-13 13:19:42 [INFO] Processing SRX3634732-SRR6657537. (54/54)
2021-08-13 13:19:55 [INFO] Writing to disk...
2021-08-13 13:20:20 [INFO] Finished.
2021-08-16 11:36:04 [INFO] Starting.
2021-08-16 11:36:04 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/
2021-08-16 11:36:04 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/aggregate.hdf5
2021-08-16 11:36:04 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-16 11:36:05 [INFO] Building aggregate for 1kbp_raw network.
2021-08-16 11:36:05 [INFO] Writing every 10 Runs.
2021-08-16 11:36:05 [INFO] Processing SRX3634736. (1/12)
2021-08-16 11:36:05 [INFO] Processing SRX3634736-SRR6657559. (1/54)
2021-08-16 11:36:13 [INFO] Processing SRX3634736-SRR6657558. (2/54)
2021-08-16 11:36:17 [INFO] Processing SRX3634736-SRR6657556. (3/54)
2021-08-16 11:36:28 [INFO] Processing SRX3634736-SRR6657557. (4/54)
2021-08-16 11:36:35 [INFO] Processing SRX3634736-SRR6657560. (5/54)
2021-08-16 11:36:44 [INFO] Processing SRX3634729. (2/12)
2021-08-16 11:36:44 [INFO] Processing SRX3634729-SRR6657520. (6/54)
2021-08-16 11:36:57 [INFO] Processing SRX3634729-SRR6657522. (7/54)
2021-08-16 11:37:11 [INFO] Processing SRX3634729-SRR6657524. (8/54)
2021-08-16 11:37:18 [INFO] Processing SRX3634729-SRR6657521. (9/54)
2021-08-16 11:37:31 [INFO] Processing SRX3634729-SRR6657523. (10/54)
2021-08-16 11:37:37 [INFO] Writing to disk...
2021-08-16 11:37:40 [INFO] Processing SRX3634733. (3/12)
2021-08-16 11:37:40 [INFO] Processing SRX3634733-SRR6657542. (11/54)
2021-08-16 11:37:48 [INFO] Processing SRX3634733-SRR6657541. (12/54)
2021-08-16 11:37:57 [INFO] Processing SRX3634733-SRR6657545. (13/54)
2021-08-16 11:38:02 [INFO] Processing SRX3634733-SRR6657543. (14/54)
2021-08-16 11:38:10 [INFO] Processing SRX3634733-SRR6657544. (15/54)
2021-08-16 11:38:16 [INFO] Processing SRX3634738. (4/12)
2021-08-16 11:38:16 [INFO] Processing SRX3634738-SRR6657566. (16/54)
2021-08-16 11:38:26 [INFO] Processing SRX3634738-SRR6657568. (17/54)
2021-08-16 11:38:40 [INFO] Processing SRX3634738-SRR6657565. (18/54)
2021-08-16 11:38:53 [INFO] Processing SRX3634738-SRR6657567. (19/54)
2021-08-16 11:39:06 [INFO] Processing SRX3634728. (5/12)
2021-08-16 11:39:06 [INFO] Processing SRX3634728-SRR6657518. (20/54)
2021-08-16 11:39:13 [INFO] Writing to disk...
2021-08-16 11:39:28 [INFO] Processing SRX3634728-SRR6657516. (21/54)
2021-08-16 11:39:39 [INFO] Processing SRX3634728-SRR6657517. (22/54)
2021-08-16 11:39:51 [INFO] Processing SRX3634728-SRR6657519. (23/54)
2021-08-16 11:39:58 [INFO] Processing SRX3634728-SRR6657515. (24/54)
2021-08-16 11:40:10 [INFO] Processing SRX3634735. (6/12)
2021-08-16 11:40:10 [INFO] Processing SRX3634735-SRR6657551. (25/54)
2021-08-16 11:40:21 [INFO] Processing SRX3634735-SRR6657553. (26/54)
2021-08-16 11:40:28 [INFO] Processing SRX3634735-SRR6657555. (27/54)
2021-08-16 11:40:37 [INFO] Processing SRX3634735-SRR6657554. (28/54)
2021-08-16 11:40:46 [INFO] Processing SRX3634735-SRR6657552. (29/54)
2021-08-16 11:40:52 [INFO] Processing SRX3634730. (7/12)
2021-08-16 11:40:52 [INFO] Processing SRX3634730-SRR6657525. (30/54)
2021-08-16 11:41:01 [INFO] Writing to disk...
2021-08-16 11:41:22 [INFO] Processing SRX3634730-SRR6657528. (31/54)
2021-08-16 11:41:27 [INFO] Processing SRX3634730-SRR6657526. (32/54)
2021-08-16 11:41:37 [INFO] Processing SRX3634730-SRR6657529. (33/54)
2021-08-16 11:41:43 [INFO] Processing SRX3634730-SRR6657527. (34/54)
2021-08-16 11:41:52 [INFO] Processing SRX3634737. (8/12)
2021-08-16 11:41:52 [INFO] Processing SRX3634737-SRR6657561. (35/54)
2021-08-16 11:42:03 [INFO] Processing SRX3634737-SRR6657563. (36/54)
2021-08-16 11:42:17 [INFO] Processing SRX3634737-SRR6657564. (37/54)
2021-08-16 11:42:28 [INFO] Processing SRX3634737-SRR6657562. (38/54)
2021-08-16 11:42:37 [INFO] Processing SRX4711156. (9/12)
2021-08-16 11:42:37 [INFO] Processing SRX4711156-SRR7872270. (39/54)
2021-08-16 11:43:05 [INFO] Processing SRX3634734. (10/12)
2021-08-16 11:43:05 [INFO] Processing SRX3634734-SRR6657548. (40/54)
2021-08-16 11:43:16 [INFO] Writing to disk...
2021-08-16 11:43:40 [INFO] Processing SRX3634734-SRR6657546. (41/54)
2021-08-16 11:43:52 [INFO] Processing SRX3634734-SRR6657547. (42/54)
2021-08-16 11:44:04 [INFO] Processing SRX3634734-SRR6657549. (43/54)
2021-08-16 11:44:12 [INFO] Processing SRX3634734-SRR6657550. (44/54)
2021-08-16 11:44:19 [INFO] Processing SRX3634727. (11/12)
2021-08-16 11:44:19 [INFO] Processing SRX3634727-SRR6657511. (45/54)
2021-08-16 11:44:33 [INFO] Processing SRX3634727-SRR6657510. (46/54)
2021-08-16 11:44:46 [INFO] Processing SRX3634727-SRR6657513. (47/54)
2021-08-16 11:44:54 [INFO] Processing SRX3634727-SRR6657514. (48/54)
2021-08-16 11:45:03 [INFO] Processing SRX3634727-SRR6657512. (49/54)
2021-08-16 11:45:21 [INFO] Processing SRX3634732. (12/12)
2021-08-16 11:45:21 [INFO] Processing SRX3634732-SRR6657539. (50/54)
2021-08-16 11:45:29 [INFO] Writing to disk...
2021-08-16 11:45:58 [INFO] Processing SRX3634732-SRR6657538. (51/54)
2021-08-16 11:46:10 [INFO] Processing SRX3634732-SRR6657536. (52/54)
2021-08-16 11:46:22 [INFO] Processing SRX3634732-SRR6657540. (53/54)
2021-08-16 11:46:29 [INFO] Processing SRX3634732-SRR6657537. (54/54)
2021-08-16 11:46:41 [INFO] Writing to disk...
2021-08-16 11:47:12 [INFO] Finished.
2021-08-21 00:31:28 [INFO] Starting.
2021-08-21 00:31:28 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/
2021-08-21 00:31:28 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/aggregate.hdf5
2021-08-21 00:31:28 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-21 00:31:29 [INFO] Building aggregate for 100kbp_raw network.
2021-08-21 00:31:29 [INFO] Writing every 10 Runs.
2021-08-21 00:31:29 [INFO] Processing SRX3634736. (1/12)
2021-08-21 00:31:29 [INFO] Processing SRX3634736-SRR6657559. (1/54)
2021-08-21 00:31:35 [INFO] Processing SRX3634736-SRR6657558. (2/54)
2021-08-21 00:31:38 [INFO] Processing SRX3634736-SRR6657556. (3/54)
2021-08-21 00:31:45 [INFO] Processing SRX3634736-SRR6657557. (4/54)
2021-08-21 00:31:49 [INFO] Processing SRX3634736-SRR6657560. (5/54)
2021-08-21 00:31:54 [INFO] Processing SRX3634729. (2/12)
2021-08-21 00:31:54 [INFO] Processing SRX3634729-SRR6657520. (6/54)
2021-08-21 00:32:00 [INFO] Processing SRX3634729-SRR6657522. (7/54)
2021-08-21 00:32:08 [INFO] Processing SRX3634729-SRR6657524. (8/54)
2021-08-21 00:32:11 [INFO] Processing SRX3634729-SRR6657521. (9/54)
2021-08-21 00:32:18 [INFO] Processing SRX3634729-SRR6657523. (10/54)
2021-08-21 00:32:22 [INFO] Writing to disk...
2021-08-21 00:32:24 [INFO] Processing SRX3634733. (3/12)
2021-08-21 00:32:24 [INFO] Processing SRX3634733-SRR6657542. (11/54)
2021-08-21 00:32:29 [INFO] Processing SRX3634733-SRR6657541. (12/54)
2021-08-21 00:32:34 [INFO] Processing SRX3634733-SRR6657545. (13/54)
2021-08-21 00:32:36 [INFO] Processing SRX3634733-SRR6657543. (14/54)
2021-08-21 00:32:41 [INFO] Processing SRX3634733-SRR6657544. (15/54)
2021-08-21 00:32:43 [INFO] Processing SRX3634738. (4/12)
2021-08-21 00:32:43 [INFO] Processing SRX3634738-SRR6657566. (16/54)
2021-08-21 00:32:49 [INFO] Processing SRX3634738-SRR6657568. (17/54)
2021-08-21 00:32:57 [INFO] Processing SRX3634738-SRR6657565. (18/54)
2021-08-21 00:33:03 [INFO] Processing SRX3634738-SRR6657567. (19/54)
2021-08-21 00:33:11 [INFO] Processing SRX3634728. (5/12)
2021-08-21 00:33:11 [INFO] Processing SRX3634728-SRR6657518. (20/54)
2021-08-21 00:33:14 [INFO] Writing to disk...
2021-08-21 00:33:17 [INFO] Processing SRX3634728-SRR6657516. (21/54)
2021-08-21 00:33:24 [INFO] Processing SRX3634728-SRR6657517. (22/54)
2021-08-21 00:33:29 [INFO] Processing SRX3634728-SRR6657519. (23/54)
2021-08-21 00:33:33 [INFO] Processing SRX3634728-SRR6657515. (24/54)
2021-08-21 00:33:40 [INFO] Processing SRX3634735. (6/12)
2021-08-21 00:33:40 [INFO] Processing SRX3634735-SRR6657551. (25/54)
2021-08-21 00:33:45 [INFO] Processing SRX3634735-SRR6657553. (26/54)
2021-08-21 00:33:49 [INFO] Processing SRX3634735-SRR6657555. (27/54)
2021-08-21 00:33:53 [INFO] Processing SRX3634735-SRR6657554. (28/54)
2021-08-21 00:33:58 [INFO] Processing SRX3634735-SRR6657552. (29/54)
2021-08-21 00:34:01 [INFO] Processing SRX3634730. (7/12)
2021-08-21 00:34:01 [INFO] Processing SRX3634730-SRR6657525. (30/54)
2021-08-21 00:34:06 [INFO] Writing to disk...
2021-08-21 00:34:13 [INFO] Processing SRX3634730-SRR6657528. (31/54)
2021-08-21 00:34:16 [INFO] Processing SRX3634730-SRR6657526. (32/54)
2021-08-21 00:34:22 [INFO] Processing SRX3634730-SRR6657529. (33/54)
2021-08-21 00:34:25 [INFO] Processing SRX3634730-SRR6657527. (34/54)
2021-08-21 00:34:32 [INFO] Processing SRX3634737. (8/12)
2021-08-21 00:34:32 [INFO] Processing SRX3634737-SRR6657561. (35/54)
2021-08-21 00:34:38 [INFO] Processing SRX3634737-SRR6657563. (36/54)
2021-08-21 00:34:45 [INFO] Processing SRX3634737-SRR6657564. (37/54)
2021-08-21 00:34:51 [INFO] Processing SRX3634737-SRR6657562. (38/54)
2021-08-21 00:34:55 [INFO] Processing SRX4711156. (9/12)
2021-08-21 00:34:55 [INFO] Processing SRX4711156-SRR7872270. (39/54)
2021-08-21 00:35:12 [INFO] Processing SRX3634734. (10/12)
2021-08-21 00:35:12 [INFO] Processing SRX3634734-SRR6657548. (40/54)
2021-08-21 00:35:18 [INFO] Writing to disk...
2021-08-21 00:35:30 [INFO] Processing SRX3634734-SRR6657546. (41/54)
2021-08-21 00:35:36 [INFO] Processing SRX3634734-SRR6657547. (42/54)
2021-08-21 00:35:43 [INFO] Processing SRX3634734-SRR6657549. (43/54)
2021-08-21 00:35:46 [INFO] Processing SRX3634734-SRR6657550. (44/54)
2021-08-21 00:35:49 [INFO] Processing SRX3634727. (11/12)
2021-08-21 00:35:49 [INFO] Processing SRX3634727-SRR6657511. (45/54)
2021-08-21 00:35:57 [INFO] Processing SRX3634727-SRR6657510. (46/54)
2021-08-21 00:36:03 [INFO] Processing SRX3634727-SRR6657513. (47/54)
2021-08-21 00:36:07 [INFO] Processing SRX3634727-SRR6657514. (48/54)
2021-08-21 00:36:12 [INFO] Processing SRX3634727-SRR6657512. (49/54)
2021-08-21 00:36:18 [INFO] Processing SRX3634732. (12/12)
2021-08-21 00:36:18 [INFO] Processing SRX3634732-SRR6657539. (50/54)
2021-08-21 00:36:21 [INFO] Writing to disk...
2021-08-21 00:36:38 [INFO] Processing SRX3634732-SRR6657538. (51/54)
2021-08-21 00:36:45 [INFO] Processing SRX3634732-SRR6657536. (52/54)
2021-08-21 00:36:52 [INFO] Processing SRX3634732-SRR6657540. (53/54)
2021-08-21 00:36:55 [INFO] Processing SRX3634732-SRR6657537. (54/54)
2021-08-21 00:37:00 [INFO] Writing to disk...
2021-08-21 00:37:09 [INFO] Finished.
2021-08-23 12:05:48 [INFO] Starting.
2021-08-23 12:05:48 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/
2021-08-23 12:05:48 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/aggregate.hdf5
2021-08-23 12:05:48 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 12:05:49 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 12:05:49 [INFO] Writing every 10 Runs.
2021-08-23 12:05:49 [INFO] Processing SRX3634736. (1/12)
2021-08-23 12:05:49 [INFO] Processing SRX3634736-SRR6657559. (1/54)
2021-08-23 12:05:54 [INFO] Processing SRX3634736-SRR6657558. (2/54)
2021-08-23 12:05:58 [INFO] Processing SRX3634736-SRR6657556. (3/54)
2021-08-23 12:06:04 [INFO] Processing SRX3634736-SRR6657557. (4/54)
2021-08-23 12:06:07 [INFO] Processing SRX3634736-SRR6657560. (5/54)
2021-08-23 12:06:12 [INFO] Processing SRX3634729. (2/12)
2021-08-23 12:06:12 [INFO] Processing SRX3634729-SRR6657520. (6/54)
2021-08-23 12:06:19 [INFO] Processing SRX3634729-SRR6657522. (7/54)
2021-08-23 12:06:25 [INFO] Processing SRX3634729-SRR6657524. (8/54)
2021-08-23 12:06:28 [INFO] Processing SRX3634729-SRR6657521. (9/54)
2021-08-23 12:06:34 [INFO] Processing SRX3634729-SRR6657523. (10/54)
2021-08-23 12:06:37 [INFO] Writing to disk...
2021-08-23 12:06:38 [INFO] Processing SRX3634733. (3/12)
2021-08-23 12:06:38 [INFO] Processing SRX3634733-SRR6657542. (11/54)
2021-08-23 12:06:42 [INFO] Processing SRX3634733-SRR6657541. (12/54)
2021-08-23 12:06:46 [INFO] Processing SRX3634733-SRR6657545. (13/54)
2021-08-23 12:06:48 [INFO] Processing SRX3634733-SRR6657543. (14/54)
2021-08-23 12:06:51 [INFO] Processing SRX3634733-SRR6657544. (15/54)
2021-08-23 12:06:53 [INFO] Processing SRX3634738. (4/12)
2021-08-23 12:06:53 [INFO] Processing SRX3634738-SRR6657566. (16/54)
2021-08-23 12:06:57 [INFO] Processing SRX3634738-SRR6657568. (17/54)
2021-08-23 12:07:04 [INFO] Processing SRX3634738-SRR6657565. (18/54)
2021-08-23 12:07:12 [INFO] Processing SRX3634738-SRR6657567. (19/54)
2021-08-23 12:07:22 [INFO] Processing SRX3634728. (5/12)
2021-08-23 12:07:22 [INFO] Processing SRX3634728-SRR6657518. (20/54)
2021-08-23 12:07:25 [INFO] Writing to disk...
2021-08-23 12:07:32 [INFO] Processing SRX3634728-SRR6657516. (21/54)
2021-08-23 12:07:37 [INFO] Processing SRX3634728-SRR6657517. (22/54)
2021-08-23 12:07:43 [INFO] Processing SRX3634728-SRR6657519. (23/54)
2021-08-23 12:07:46 [INFO] Processing SRX3634728-SRR6657515. (24/54)
2021-08-23 12:07:51 [INFO] Processing SRX3634735. (6/12)
2021-08-23 12:07:51 [INFO] Processing SRX3634735-SRR6657551. (25/54)
2021-08-23 12:07:56 [INFO] Processing SRX3634735-SRR6657553. (26/54)
2021-08-23 12:07:59 [INFO] Processing SRX3634735-SRR6657555. (27/54)
2021-08-23 12:08:04 [INFO] Processing SRX3634735-SRR6657554. (28/54)
2021-08-23 12:08:08 [INFO] Processing SRX3634735-SRR6657552. (29/54)
2021-08-23 12:08:10 [INFO] Processing SRX3634730. (7/12)
2021-08-23 12:08:10 [INFO] Processing SRX3634730-SRR6657525. (30/54)
2021-08-23 12:08:14 [INFO] Writing to disk...
2021-08-23 12:08:21 [INFO] Processing SRX3634730-SRR6657528. (31/54)
2021-08-23 12:08:23 [INFO] Processing SRX3634730-SRR6657526. (32/54)
2021-08-23 12:08:28 [INFO] Processing SRX3634730-SRR6657529. (33/54)
2021-08-23 12:08:31 [INFO] Processing SRX3634730-SRR6657527. (34/54)
2021-08-23 12:08:36 [INFO] Processing SRX3634737. (8/12)
2021-08-23 12:08:36 [INFO] Processing SRX3634737-SRR6657561. (35/54)
2021-08-23 12:08:40 [INFO] Processing SRX3634737-SRR6657563. (36/54)
2021-08-23 12:08:47 [INFO] Processing SRX3634737-SRR6657564. (37/54)
2021-08-23 12:08:52 [INFO] Processing SRX3634737-SRR6657562. (38/54)
2021-08-23 12:08:56 [INFO] Processing SRX4711156. (9/12)
2021-08-23 12:08:56 [INFO] Processing SRX4711156-SRR7872270. (39/54)
2021-08-23 12:09:07 [INFO] Processing SRX3634734. (10/12)
2021-08-23 12:09:07 [INFO] Processing SRX3634734-SRR6657548. (40/54)
2021-08-23 12:09:12 [INFO] Writing to disk...
2021-08-23 12:09:22 [INFO] Processing SRX3634734-SRR6657546. (41/54)
2021-08-23 12:09:26 [INFO] Processing SRX3634734-SRR6657547. (42/54)
2021-08-23 12:09:31 [INFO] Processing SRX3634734-SRR6657549. (43/54)
2021-08-23 12:09:34 [INFO] Processing SRX3634734-SRR6657550. (44/54)
2021-08-23 12:09:36 [INFO] Processing SRX3634727. (11/12)
2021-08-23 12:09:36 [INFO] Processing SRX3634727-SRR6657511. (45/54)
2021-08-23 12:09:42 [INFO] Processing SRX3634727-SRR6657510. (46/54)
2021-08-23 12:09:49 [INFO] Processing SRX3634727-SRR6657513. (47/54)
2021-08-23 12:09:52 [INFO] Processing SRX3634727-SRR6657514. (48/54)
2021-08-23 12:09:55 [INFO] Processing SRX3634727-SRR6657512. (49/54)
2021-08-23 12:10:00 [INFO] Processing SRX3634732. (12/12)
2021-08-23 12:10:00 [INFO] Processing SRX3634732-SRR6657539. (50/54)
2021-08-23 12:10:03 [INFO] Writing to disk...
2021-08-23 12:10:13 [INFO] Processing SRX3634732-SRR6657538. (51/54)
2021-08-23 12:10:17 [INFO] Processing SRX3634732-SRR6657536. (52/54)
2021-08-23 12:10:24 [INFO] Processing SRX3634732-SRR6657540. (53/54)
2021-08-23 12:10:27 [INFO] Processing SRX3634732-SRR6657537. (54/54)
2021-08-23 12:10:32 [INFO] Writing to disk...
2021-08-23 12:10:39 [INFO] Finished.
2021-08-23 15:05:52 [INFO] Starting.
2021-08-23 15:05:52 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/
2021-08-23 15:05:52 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP131871/aggregate.hdf5
2021-08-23 15:05:52 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 15:05:53 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 15:05:53 [INFO] Writing every 10 Runs.
2021-08-23 15:05:53 [INFO] Processing SRX3634736. (1/12)
2021-08-23 15:05:53 [INFO] Processing SRX3634736-SRR6657559. (1/54)
2021-08-23 15:05:57 [INFO] Processing SRX3634736-SRR6657558. (2/54)
2021-08-23 15:05:59 [INFO] Processing SRX3634736-SRR6657556. (3/54)
2021-08-23 15:06:04 [INFO] Processing SRX3634736-SRR6657557. (4/54)
2021-08-23 15:06:07 [INFO] Processing SRX3634736-SRR6657560. (5/54)
2021-08-23 15:06:11 [INFO] Processing SRX3634729. (2/12)
2021-08-23 15:06:11 [INFO] Processing SRX3634729-SRR6657520. (6/54)
2021-08-23 15:06:17 [INFO] Processing SRX3634729-SRR6657522. (7/54)
2021-08-23 15:06:23 [INFO] Processing SRX3634729-SRR6657524. (8/54)
2021-08-23 15:06:26 [INFO] Processing SRX3634729-SRR6657521. (9/54)
2021-08-23 15:06:31 [INFO] Processing SRX3634729-SRR6657523. (10/54)
2021-08-23 15:06:34 [INFO] Writing to disk...
2021-08-23 15:06:35 [INFO] Processing SRX3634733. (3/12)
2021-08-23 15:06:35 [INFO] Processing SRX3634733-SRR6657542. (11/54)
2021-08-23 15:06:39 [INFO] Processing SRX3634733-SRR6657541. (12/54)
2021-08-23 15:06:42 [INFO] Processing SRX3634733-SRR6657545. (13/54)
2021-08-23 15:06:44 [INFO] Processing SRX3634733-SRR6657543. (14/54)
2021-08-23 15:06:48 [INFO] Processing SRX3634733-SRR6657544. (15/54)
2021-08-23 15:06:50 [INFO] Processing SRX3634738. (4/12)
2021-08-23 15:06:50 [INFO] Processing SRX3634738-SRR6657566. (16/54)
2021-08-23 15:06:54 [INFO] Processing SRX3634738-SRR6657568. (17/54)
2021-08-23 15:07:00 [INFO] Processing SRX3634738-SRR6657565. (18/54)
2021-08-23 15:07:06 [INFO] Processing SRX3634738-SRR6657567. (19/54)
2021-08-23 15:07:11 [INFO] Processing SRX3634728. (5/12)
2021-08-23 15:07:11 [INFO] Processing SRX3634728-SRR6657518. (20/54)
2021-08-23 15:07:14 [INFO] Writing to disk...
2021-08-23 15:07:14 [INFO] Processing SRX3634728-SRR6657516. (21/54)
2021-08-23 15:07:19 [INFO] Processing SRX3634728-SRR6657517. (22/54)
2021-08-23 15:07:24 [INFO] Processing SRX3634728-SRR6657519. (23/54)
2021-08-23 15:07:27 [INFO] Processing SRX3634728-SRR6657515. (24/54)
2021-08-23 15:07:32 [INFO] Processing SRX3634735. (6/12)
2021-08-23 15:07:32 [INFO] Processing SRX3634735-SRR6657551. (25/54)
2021-08-23 15:07:37 [INFO] Processing SRX3634735-SRR6657553. (26/54)
2021-08-23 15:07:40 [INFO] Processing SRX3634735-SRR6657555. (27/54)
2021-08-23 15:07:43 [INFO] Processing SRX3634735-SRR6657554. (28/54)
2021-08-23 15:07:47 [INFO] Processing SRX3634735-SRR6657552. (29/54)
2021-08-23 15:07:48 [INFO] Processing SRX3634730. (7/12)
2021-08-23 15:07:48 [INFO] Processing SRX3634730-SRR6657525. (30/54)
2021-08-23 15:07:53 [INFO] Writing to disk...
2021-08-23 15:07:56 [INFO] Processing SRX3634730-SRR6657528. (31/54)
2021-08-23 15:07:58 [INFO] Processing SRX3634730-SRR6657526. (32/54)
2021-08-23 15:08:02 [INFO] Processing SRX3634730-SRR6657529. (33/54)
2021-08-23 15:08:04 [INFO] Processing SRX3634730-SRR6657527. (34/54)
2021-08-23 15:08:09 [INFO] Processing SRX3634737. (8/12)
2021-08-23 15:08:09 [INFO] Processing SRX3634737-SRR6657561. (35/54)
2021-08-23 15:08:13 [INFO] Processing SRX3634737-SRR6657563. (36/54)
2021-08-23 15:08:18 [INFO] Processing SRX3634737-SRR6657564. (37/54)
2021-08-23 15:08:22 [INFO] Processing SRX3634737-SRR6657562. (38/54)
2021-08-23 15:08:25 [INFO] Processing SRX4711156. (9/12)
2021-08-23 15:08:25 [INFO] Processing SRX4711156-SRR7872270. (39/54)
2021-08-23 15:08:33 [INFO] Processing SRX3634734. (10/12)
2021-08-23 15:08:33 [INFO] Processing SRX3634734-SRR6657548. (40/54)
2021-08-23 15:08:37 [INFO] Writing to disk...
2021-08-23 15:08:39 [INFO] Processing SRX3634734-SRR6657546. (41/54)
2021-08-23 15:08:44 [INFO] Processing SRX3634734-SRR6657547. (42/54)
2021-08-23 15:08:48 [INFO] Processing SRX3634734-SRR6657549. (43/54)
2021-08-23 15:08:50 [INFO] Processing SRX3634734-SRR6657550. (44/54)
2021-08-23 15:08:52 [INFO] Processing SRX3634727. (11/12)
2021-08-23 15:08:52 [INFO] Processing SRX3634727-SRR6657511. (45/54)
2021-08-23 15:08:58 [INFO] Processing SRX3634727-SRR6657510. (46/54)
2021-08-23 15:09:06 [INFO] Processing SRX3634727-SRR6657513. (47/54)
2021-08-23 15:09:09 [INFO] Processing SRX3634727-SRR6657514. (48/54)
2021-08-23 15:09:12 [INFO] Processing SRX3634727-SRR6657512. (49/54)
2021-08-23 15:09:17 [INFO] Processing SRX3634732. (12/12)
2021-08-23 15:09:17 [INFO] Processing SRX3634732-SRR6657539. (50/54)
2021-08-23 15:09:19 [INFO] Writing to disk...
2021-08-23 15:09:28 [INFO] Processing SRX3634732-SRR6657538. (51/54)
2021-08-23 15:09:33 [INFO] Processing SRX3634732-SRR6657536. (52/54)
2021-08-23 15:09:37 [INFO] Processing SRX3634732-SRR6657540. (53/54)
2021-08-23 15:09:40 [INFO] Processing SRX3634732-SRR6657537. (54/54)
2021-08-23 15:09:45 [INFO] Writing to disk...
2021-08-23 15:09:45 [INFO] Finished.