2021-08-02 14:43:29 [INFO] Starting.
2021-08-02 14:43:29 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/
2021-08-02 14:43:29 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/aggregate.hdf5
2021-08-02 14:43:29 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes
2021-08-02 14:43:29 [INFO] Using only main chromosomes: chr1, chr2, chrX, chr3, chr4, chr5, chr6, chr7, chr10, chr8, chr14, chr9, chr11, chr13, chr12, chr15, chr16, chr17, chrY, chr18, chr19, chrM
2021-08-02 14:43:30 [INFO] Building aggregate.
2021-08-02 14:43:30 [INFO] Writing every 10 Runs.
2021-08-02 14:43:30 [INFO] Processing SRX6686163. (1/37)
2021-08-02 14:43:30 [INFO] Processing SRX6686163-SRR9937452. (1/63)
2021-08-02 14:43:32 [INFO] Processing SRX4519331. (2/37)
2021-08-02 14:43:32 [INFO] Processing SRX4519331-SRR7657714. (2/63)
2021-08-02 14:43:41 [INFO] Processing SRX4519331-SRR7657713. (3/63)
2021-08-02 14:43:49 [INFO] Processing SRX4519330. (3/37)
2021-08-02 14:43:49 [INFO] Processing SRX4519330-SRR7657712. (4/63)
2021-08-02 14:43:57 [INFO] Processing SRX6686159. (4/37)
2021-08-02 14:43:57 [INFO] Processing SRX6686159-SRR9937447. (5/63)
2021-08-02 14:44:00 [INFO] Processing SRX4519324. (5/37)
2021-08-02 14:44:00 [INFO] Processing SRX4519324-SRR7657701. (6/63)
2021-08-02 14:44:14 [INFO] Processing SRX4551479. (6/37)
2021-08-02 14:44:14 [INFO] Processing SRX4551479-SRR7691911. (7/63)
2021-08-02 14:44:21 [INFO] Processing SRX4551488. (7/37)
2021-08-02 14:44:21 [INFO] Processing SRX4551488-SRR7691924. (8/63)
2021-08-02 14:44:28 [INFO] Processing SRX4551488-SRR7691925. (9/63)
2021-08-02 14:44:36 [INFO] Processing SRX4551486. (8/37)
2021-08-02 14:44:36 [INFO] Processing SRX4551486-SRR7691921. (10/63)
2021-08-02 14:44:45 [INFO] Writing to disk...
2021-08-02 14:44:48 [INFO] Processing SRX4551486-SRR7691920. (11/63)
2021-08-02 14:44:57 [INFO] Processing SRX4519325. (9/37)
2021-08-02 14:44:57 [INFO] Processing SRX4519325-SRR7657702. (12/63)
2021-08-02 14:45:09 [INFO] Processing SRX4519325-SRR7657703. (13/63)
2021-08-02 14:45:17 [INFO] Processing SRX4519328. (10/37)
2021-08-02 14:45:17 [INFO] Processing SRX4519328-SRR7657709. (14/63)
2021-08-02 14:45:32 [INFO] Processing SRX4519328-SRR7657710. (15/63)
2021-08-02 14:45:43 [INFO] Processing SRX4551485. (11/37)
2021-08-02 14:45:43 [INFO] Processing SRX4551485-SRR7691919. (16/63)
2021-08-02 14:45:52 [INFO] Processing SRX4551485-SRR7691918. (17/63)
2021-08-02 14:45:59 [INFO] Processing SRX4551487. (12/37)
2021-08-02 14:45:59 [INFO] Processing SRX4551487-SRR7691922. (18/63)
2021-08-02 14:46:07 [INFO] Processing SRX4551487-SRR7691923. (19/63)
2021-08-02 14:46:18 [INFO] Processing SRX6686148. (13/37)
2021-08-02 14:46:18 [INFO] Processing SRX6686148-SRR9937441. (20/63)
2021-08-02 14:46:27 [INFO] Writing to disk...
2021-08-02 14:46:32 [INFO] Processing SRX6686148-SRR9937442. (21/63)
2021-08-02 14:46:43 [INFO] Processing SRX4551484. (14/37)
2021-08-02 14:46:43 [INFO] Processing SRX4551484-SRR7691917. (22/63)
2021-08-02 14:46:49 [INFO] Processing SRX4519322. (15/37)
2021-08-02 14:46:49 [INFO] Processing SRX4519322-SRR7657698. (23/63)
2021-08-02 14:47:02 [INFO] Processing SRX4519322-SRR7657697. (24/63)
2021-08-02 14:47:11 [INFO] Processing SRX6686162. (16/37)
2021-08-02 14:47:11 [INFO] Processing SRX6686162-SRR9937451. (25/63)
2021-08-02 14:47:15 [INFO] Processing SRX4519323. (17/37)
2021-08-02 14:47:15 [INFO] Processing SRX4519323-SRR7657700. (26/63)
2021-08-02 14:47:33 [INFO] Processing SRX4519323-SRR7657699. (27/63)
2021-08-02 14:47:39 [INFO] Processing SRX6686160. (18/37)
2021-08-02 14:47:39 [INFO] Processing SRX6686160-SRR9937448. (28/63)
2021-08-02 14:47:44 [INFO] Processing SRX4551491. (19/37)
2021-08-02 14:47:44 [INFO] Processing SRX4551491-SRR7691931. (29/63)
2021-08-02 14:47:51 [INFO] Processing SRX4551491-SRR7691929. (30/63)
2021-08-02 14:47:56 [INFO] Writing to disk...
2021-08-02 14:48:04 [INFO] Processing SRX4551491-SRR7691930. (31/63)
2021-08-02 14:48:11 [INFO] Processing SRX4551492. (20/37)
2021-08-02 14:48:11 [INFO] Processing SRX4551492-SRR7691932. (32/63)
2021-08-02 14:48:22 [INFO] Processing SRX4551492-SRR7691933. (33/63)
2021-08-02 14:48:34 [INFO] Processing SRX4551489. (21/37)
2021-08-02 14:48:34 [INFO] Processing SRX4551489-SRR7691926. (34/63)
2021-08-02 14:48:41 [INFO] Processing SRX4551489-SRR7691927. (35/63)
2021-08-02 14:48:50 [INFO] Processing SRX4519319. (22/37)
2021-08-02 14:48:50 [INFO] Processing SRX4519319-SRR7657689. (36/63)
2021-08-02 14:49:03 [INFO] Processing SRX4519319-SRR7657690. (37/63)
2021-08-02 14:49:17 [INFO] Processing SRX4551490. (23/37)
2021-08-02 14:49:17 [INFO] Processing SRX4551490-SRR7691928. (38/63)
2021-08-02 14:49:30 [INFO] Processing SRX6686161. (24/37)
2021-08-02 14:49:30 [INFO] Processing SRX6686161-SRR9937450. (39/63)
2021-08-02 14:49:36 [INFO] Processing SRX6686161-SRR9937449. (40/63)
2021-08-02 14:49:42 [INFO] Writing to disk...
2021-08-02 14:49:52 [INFO] Processing SRX6686149. (25/37)
2021-08-02 14:49:52 [INFO] Processing SRX6686149-SRR9937453. (41/63)
2021-08-02 14:49:57 [INFO] Processing SRX6686149-SRR9937454. (42/63)
2021-08-02 14:50:03 [INFO] Processing SRX4551481. (26/37)
2021-08-02 14:50:03 [INFO] Processing SRX4551481-SRR7691914. (43/63)
2021-08-02 14:50:10 [INFO] Processing SRX4551481-SRR7691913. (44/63)
2021-08-02 14:50:15 [INFO] Processing SRX4551483. (27/37)
2021-08-02 14:50:15 [INFO] Processing SRX4551483-SRR7691916. (45/63)
2021-08-02 14:50:22 [INFO] Processing SRX4519327. (28/37)
2021-08-02 14:50:22 [INFO] Processing SRX4519327-SRR7657706. (46/63)
2021-08-02 14:50:30 [INFO] Processing SRX4519327-SRR7657707. (47/63)
2021-08-02 14:50:39 [INFO] Processing SRX4519327-SRR7657708. (48/63)
2021-08-02 14:50:46 [INFO] Processing SRX6686158. (29/37)
2021-08-02 14:50:46 [INFO] Processing SRX6686158-SRR9937446. (49/63)
2021-08-02 14:50:59 [INFO] Processing SRX6686156. (30/37)
2021-08-02 14:50:59 [INFO] Processing SRX6686156-SRR9937443. (50/63)
2021-08-02 14:51:15 [INFO] Writing to disk...
2021-08-02 14:51:27 [INFO] Processing SRX4551480. (31/37)
2021-08-02 14:51:27 [INFO] Processing SRX4551480-SRR7691912. (51/63)
2021-08-02 14:51:34 [INFO] Processing SRX4519321. (32/37)
2021-08-02 14:51:34 [INFO] Processing SRX4519321-SRR7657694. (52/63)
2021-08-02 14:51:40 [INFO] Processing SRX4519321-SRR7657695. (53/63)
2021-08-02 14:52:04 [INFO] Processing SRX4519321-SRR7657696. (54/63)
2021-08-02 14:52:13 [INFO] Processing SRX4519329. (33/37)
2021-08-02 14:52:13 [INFO] Processing SRX4519329-SRR7657711. (55/63)
2021-08-02 14:52:24 [INFO] Processing SRX4551482. (34/37)
2021-08-02 14:52:24 [INFO] Processing SRX4551482-SRR7691915. (56/63)
2021-08-02 14:52:30 [INFO] Processing SRX6686157. (35/37)
2021-08-02 14:52:30 [INFO] Processing SRX6686157-SRR9937444. (57/63)
2021-08-02 14:52:39 [INFO] Processing SRX6686157-SRR9937445. (58/63)
2021-08-02 14:52:50 [INFO] Processing SRX4519320. (36/37)
2021-08-02 14:52:50 [INFO] Processing SRX4519320-SRR7657691. (59/63)
2021-08-02 14:53:02 [INFO] Processing SRX4519320-SRR7657693. (60/63)
2021-08-02 14:53:16 [INFO] Writing to disk...
2021-08-02 14:53:33 [INFO] Processing SRX4519320-SRR7657692. (61/63)
2021-08-02 14:53:44 [INFO] Processing SRX4519326. (37/37)
2021-08-02 14:53:44 [INFO] Processing SRX4519326-SRR7657705. (62/63)
2021-08-02 14:53:56 [INFO] Processing SRX4519326-SRR7657704. (63/63)
2021-08-02 14:54:08 [INFO] Writing to disk...
2021-08-02 14:54:22 [INFO] Finished.
2021-08-12 14:31:21 [INFO] Starting.
2021-08-12 14:31:21 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/
2021-08-12 14:31:21 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/aggregate.hdf5
2021-08-12 14:31:21 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:21 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:21 [INFO] Writing every 10 Runs.
2021-08-12 14:31:21 [INFO] Processing SRX6686163. (1/37)
2021-08-12 14:31:21 [INFO] Processing SRX6686163-SRR9937452. (1/63)
2021-08-12 14:31:24 [INFO] Processing SRX4519331. (2/37)
2021-08-12 14:31:24 [INFO] Processing SRX4519331-SRR7657714. (2/63)
2021-08-12 14:31:34 [INFO] Processing SRX4519331-SRR7657713. (3/63)
2021-08-12 14:31:44 [INFO] Processing SRX4519330. (3/37)
2021-08-12 14:31:44 [INFO] Processing SRX4519330-SRR7657712. (4/63)
2021-08-12 14:31:53 [INFO] Processing SRX6686159. (4/37)
2021-08-12 14:31:53 [INFO] Processing SRX6686159-SRR9937447. (5/63)
2021-08-12 14:31:55 [INFO] Processing SRX4519324. (5/37)
2021-08-12 14:31:55 [INFO] Processing SRX4519324-SRR7657701. (6/63)
2021-08-12 14:32:15 [INFO] Processing SRX4551479. (6/37)
2021-08-12 14:32:15 [INFO] Processing SRX4551479-SRR7691911. (7/63)
2021-08-12 14:32:23 [INFO] Processing SRX4551488. (7/37)
2021-08-12 14:32:23 [INFO] Processing SRX4551488-SRR7691924. (8/63)
2021-08-12 14:32:31 [INFO] Processing SRX4551488-SRR7691925. (9/63)
2021-08-12 14:32:41 [INFO] Processing SRX4551486. (8/37)
2021-08-12 14:32:41 [INFO] Processing SRX4551486-SRR7691921. (10/63)
2021-08-12 14:32:52 [INFO] Writing to disk...
2021-08-12 14:32:55 [INFO] Processing SRX4551486-SRR7691920. (11/63)
2021-08-12 14:33:05 [INFO] Processing SRX4519325. (9/37)
2021-08-12 14:33:05 [INFO] Processing SRX4519325-SRR7657702. (12/63)
2021-08-12 14:33:17 [INFO] Processing SRX4519325-SRR7657703. (13/63)
2021-08-12 14:33:25 [INFO] Processing SRX4519328. (10/37)
2021-08-12 14:33:25 [INFO] Processing SRX4519328-SRR7657709. (14/63)
2021-08-12 14:33:41 [INFO] Processing SRX4519328-SRR7657710. (15/63)
2021-08-12 14:33:53 [INFO] Processing SRX4551485. (11/37)
2021-08-12 14:33:53 [INFO] Processing SRX4551485-SRR7691919. (16/63)
2021-08-12 14:34:02 [INFO] Processing SRX4551485-SRR7691918. (17/63)
2021-08-12 14:34:11 [INFO] Processing SRX4551487. (12/37)
2021-08-12 14:34:11 [INFO] Processing SRX4551487-SRR7691922. (18/63)
2021-08-12 14:34:22 [INFO] Processing SRX4551487-SRR7691923. (19/63)
2021-08-12 14:34:31 [INFO] Processing SRX6686148. (13/37)
2021-08-12 14:34:31 [INFO] Processing SRX6686148-SRR9937441. (20/63)
2021-08-12 14:34:40 [INFO] Writing to disk...
2021-08-12 14:34:54 [INFO] Processing SRX6686148-SRR9937442. (21/63)
2021-08-12 14:35:04 [INFO] Processing SRX4551484. (14/37)
2021-08-12 14:35:04 [INFO] Processing SRX4551484-SRR7691917. (22/63)
2021-08-12 14:35:12 [INFO] Processing SRX4519322. (15/37)
2021-08-12 14:35:12 [INFO] Processing SRX4519322-SRR7657698. (23/63)
2021-08-12 14:35:27 [INFO] Processing SRX4519322-SRR7657697. (24/63)
2021-08-12 14:35:38 [INFO] Processing SRX6686162. (16/37)
2021-08-12 14:35:38 [INFO] Processing SRX6686162-SRR9937451. (25/63)
2021-08-12 14:35:42 [INFO] Processing SRX4519323. (17/37)
2021-08-12 14:35:42 [INFO] Processing SRX4519323-SRR7657700. (26/63)
2021-08-12 14:36:00 [INFO] Processing SRX4519323-SRR7657699. (27/63)
2021-08-12 14:36:08 [INFO] Processing SRX6686160. (18/37)
2021-08-12 14:36:08 [INFO] Processing SRX6686160-SRR9937448. (28/63)
2021-08-12 14:36:13 [INFO] Processing SRX4551491. (19/37)
2021-08-12 14:36:13 [INFO] Processing SRX4551491-SRR7691931. (29/63)
2021-08-12 14:36:20 [INFO] Processing SRX4551491-SRR7691929. (30/63)
2021-08-12 14:36:24 [INFO] Writing to disk...
2021-08-12 14:36:39 [INFO] Processing SRX4551491-SRR7691930. (31/63)
2021-08-12 14:36:46 [INFO] Processing SRX4551492. (20/37)
2021-08-12 14:36:46 [INFO] Processing SRX4551492-SRR7691932. (32/63)
2021-08-12 14:36:55 [INFO] Processing SRX4551492-SRR7691933. (33/63)
2021-08-12 14:37:06 [INFO] Processing SRX4551489. (21/37)
2021-08-12 14:37:06 [INFO] Processing SRX4551489-SRR7691926. (34/63)
2021-08-12 14:37:12 [INFO] Processing SRX4551489-SRR7691927. (35/63)
2021-08-12 14:37:20 [INFO] Processing SRX4519319. (22/37)
2021-08-12 14:37:20 [INFO] Processing SRX4519319-SRR7657689. (36/63)
2021-08-12 14:37:35 [INFO] Processing SRX4519319-SRR7657690. (37/63)
2021-08-12 14:37:48 [INFO] Processing SRX4551490. (23/37)
2021-08-12 14:37:48 [INFO] Processing SRX4551490-SRR7691928. (38/63)
2021-08-12 14:38:02 [INFO] Processing SRX6686161. (24/37)
2021-08-12 14:38:02 [INFO] Processing SRX6686161-SRR9937450. (39/63)
2021-08-12 14:38:08 [INFO] Processing SRX6686161-SRR9937449. (40/63)
2021-08-12 14:38:12 [INFO] Writing to disk...
2021-08-12 14:38:27 [INFO] Processing SRX6686149. (25/37)
2021-08-12 14:38:27 [INFO] Processing SRX6686149-SRR9937453. (41/63)
2021-08-12 14:38:31 [INFO] Processing SRX6686149-SRR9937454. (42/63)
2021-08-12 14:38:35 [INFO] Processing SRX4551481. (26/37)
2021-08-12 14:38:35 [INFO] Processing SRX4551481-SRR7691914. (43/63)
2021-08-12 14:38:41 [INFO] Processing SRX4551481-SRR7691913. (44/63)
2021-08-12 14:38:44 [INFO] Processing SRX4551483. (27/37)
2021-08-12 14:38:44 [INFO] Processing SRX4551483-SRR7691916. (45/63)
2021-08-12 14:38:51 [INFO] Processing SRX4519327. (28/37)
2021-08-12 14:38:51 [INFO] Processing SRX4519327-SRR7657706. (46/63)
2021-08-12 14:38:58 [INFO] Processing SRX4519327-SRR7657707. (47/63)
2021-08-12 14:39:06 [INFO] Processing SRX4519327-SRR7657708. (48/63)
2021-08-12 14:39:12 [INFO] Processing SRX6686158. (29/37)
2021-08-12 14:39:12 [INFO] Processing SRX6686158-SRR9937446. (49/63)
2021-08-12 14:39:22 [INFO] Processing SRX6686156. (30/37)
2021-08-12 14:39:22 [INFO] Processing SRX6686156-SRR9937443. (50/63)
2021-08-12 14:39:34 [INFO] Writing to disk...
2021-08-12 14:39:51 [INFO] Processing SRX4551480. (31/37)
2021-08-12 14:39:51 [INFO] Processing SRX4551480-SRR7691912. (51/63)
2021-08-12 14:39:56 [INFO] Processing SRX4519321. (32/37)
2021-08-12 14:39:56 [INFO] Processing SRX4519321-SRR7657694. (52/63)
2021-08-12 14:40:02 [INFO] Processing SRX4519321-SRR7657695. (53/63)
2021-08-12 14:40:25 [INFO] Processing SRX4519321-SRR7657696. (54/63)
2021-08-12 14:40:35 [INFO] Processing SRX4519329. (33/37)
2021-08-12 14:40:35 [INFO] Processing SRX4519329-SRR7657711. (55/63)
2021-08-12 14:40:47 [INFO] Processing SRX4551482. (34/37)
2021-08-12 14:40:47 [INFO] Processing SRX4551482-SRR7691915. (56/63)
2021-08-12 14:40:52 [INFO] Processing SRX6686157. (35/37)
2021-08-12 14:40:52 [INFO] Processing SRX6686157-SRR9937444. (57/63)
2021-08-12 14:41:02 [INFO] Processing SRX6686157-SRR9937445. (58/63)
2021-08-12 14:41:11 [INFO] Processing SRX4519320. (36/37)
2021-08-12 14:41:11 [INFO] Processing SRX4519320-SRR7657691. (59/63)
2021-08-12 14:41:22 [INFO] Processing SRX4519320-SRR7657693. (60/63)
2021-08-12 14:41:34 [INFO] Writing to disk...
2021-08-12 14:41:52 [INFO] Processing SRX4519320-SRR7657692. (61/63)
2021-08-12 14:42:02 [INFO] Processing SRX4519326. (37/37)
2021-08-12 14:42:02 [INFO] Processing SRX4519326-SRR7657705. (62/63)
2021-08-12 14:42:14 [INFO] Processing SRX4519326-SRR7657704. (63/63)
2021-08-12 14:42:24 [INFO] Writing to disk...
2021-08-12 14:42:41 [INFO] Finished.
2021-08-12 16:34:16 [INFO] Starting.
2021-08-12 16:34:16 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/
2021-08-12 16:34:16 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/aggregate.hdf5
2021-08-12 16:34:16 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:34:17 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 16:34:17 [INFO] Writing every 10 Runs.
2021-08-12 16:34:17 [INFO] Processing SRX6686163. (1/37)
2021-08-12 16:34:17 [INFO] Processing SRX6686163-SRR9937452. (1/63)
2021-08-12 16:34:20 [INFO] Processing SRX4519331. (2/37)
2021-08-12 16:34:20 [INFO] Processing SRX4519331-SRR7657714. (2/63)
2021-08-12 16:34:31 [INFO] Processing SRX4519331-SRR7657713. (3/63)
2021-08-12 16:34:39 [INFO] Processing SRX4519330. (3/37)
2021-08-12 16:34:39 [INFO] Processing SRX4519330-SRR7657712. (4/63)
2021-08-12 16:34:47 [INFO] Processing SRX6686159. (4/37)
2021-08-12 16:34:47 [INFO] Processing SRX6686159-SRR9937447. (5/63)
2021-08-12 16:34:50 [INFO] Processing SRX4519324. (5/37)
2021-08-12 16:34:50 [INFO] Processing SRX4519324-SRR7657701. (6/63)
2021-08-12 16:35:06 [INFO] Processing SRX4551479. (6/37)
2021-08-12 16:35:06 [INFO] Processing SRX4551479-SRR7691911. (7/63)
2021-08-12 16:35:15 [INFO] Processing SRX4551488. (7/37)
2021-08-12 16:35:15 [INFO] Processing SRX4551488-SRR7691924. (8/63)
2021-08-12 16:35:23 [INFO] Processing SRX4551488-SRR7691925. (9/63)
2021-08-12 16:35:34 [INFO] Processing SRX4551486. (8/37)
2021-08-12 16:35:34 [INFO] Processing SRX4551486-SRR7691921. (10/63)
2021-08-12 16:35:43 [INFO] Writing to disk...
2021-08-12 16:35:48 [INFO] Processing SRX4551486-SRR7691920. (11/63)
2021-08-12 16:35:57 [INFO] Processing SRX4519325. (9/37)
2021-08-12 16:35:57 [INFO] Processing SRX4519325-SRR7657702. (12/63)
2021-08-12 16:36:09 [INFO] Processing SRX4519325-SRR7657703. (13/63)
2021-08-12 16:36:19 [INFO] Processing SRX4519328. (10/37)
2021-08-12 16:36:19 [INFO] Processing SRX4519328-SRR7657709. (14/63)
2021-08-12 16:36:36 [INFO] Processing SRX4519328-SRR7657710. (15/63)
2021-08-12 16:36:50 [INFO] Processing SRX4551485. (11/37)
2021-08-12 16:36:50 [INFO] Processing SRX4551485-SRR7691919. (16/63)
2021-08-12 16:36:59 [INFO] Processing SRX4551485-SRR7691918. (17/63)
2021-08-12 16:37:08 [INFO] Processing SRX4551487. (12/37)
2021-08-12 16:37:08 [INFO] Processing SRX4551487-SRR7691922. (18/63)
2021-08-12 16:37:17 [INFO] Processing SRX4551487-SRR7691923. (19/63)
2021-08-12 16:37:29 [INFO] Processing SRX6686148. (13/37)
2021-08-12 16:37:29 [INFO] Processing SRX6686148-SRR9937441. (20/63)
2021-08-12 16:37:40 [INFO] Writing to disk...
2021-08-12 16:37:56 [INFO] Processing SRX6686148-SRR9937442. (21/63)
2021-08-12 16:38:08 [INFO] Processing SRX4551484. (14/37)
2021-08-12 16:38:08 [INFO] Processing SRX4551484-SRR7691917. (22/63)
2021-08-12 16:38:15 [INFO] Processing SRX4519322. (15/37)
2021-08-12 16:38:15 [INFO] Processing SRX4519322-SRR7657698. (23/63)
2021-08-12 16:38:31 [INFO] Processing SRX4519322-SRR7657697. (24/63)
2021-08-12 16:38:43 [INFO] Processing SRX6686162. (16/37)
2021-08-12 16:38:43 [INFO] Processing SRX6686162-SRR9937451. (25/63)
2021-08-12 16:38:47 [INFO] Processing SRX4519323. (17/37)
2021-08-12 16:38:47 [INFO] Processing SRX4519323-SRR7657700. (26/63)
2021-08-12 16:39:06 [INFO] Processing SRX4519323-SRR7657699. (27/63)
2021-08-12 16:39:14 [INFO] Processing SRX6686160. (18/37)
2021-08-12 16:39:14 [INFO] Processing SRX6686160-SRR9937448. (28/63)
2021-08-12 16:39:19 [INFO] Processing SRX4551491. (19/37)
2021-08-12 16:39:19 [INFO] Processing SRX4551491-SRR7691931. (29/63)
2021-08-12 16:39:26 [INFO] Processing SRX4551491-SRR7691929. (30/63)
2021-08-12 16:39:31 [INFO] Writing to disk...
2021-08-12 16:39:44 [INFO] Processing SRX4551491-SRR7691930. (31/63)
2021-08-12 16:39:52 [INFO] Processing SRX4551492. (20/37)
2021-08-12 16:39:52 [INFO] Processing SRX4551492-SRR7691932. (32/63)
2021-08-12 16:40:04 [INFO] Processing SRX4551492-SRR7691933. (33/63)
2021-08-12 16:40:14 [INFO] Processing SRX4551489. (21/37)
2021-08-12 16:40:14 [INFO] Processing SRX4551489-SRR7691926. (34/63)
2021-08-12 16:40:22 [INFO] Processing SRX4551489-SRR7691927. (35/63)
2021-08-12 16:40:31 [INFO] Processing SRX4519319. (22/37)
2021-08-12 16:40:31 [INFO] Processing SRX4519319-SRR7657689. (36/63)
2021-08-12 16:40:48 [INFO] Processing SRX4519319-SRR7657690. (37/63)
2021-08-12 16:41:02 [INFO] Processing SRX4551490. (23/37)
2021-08-12 16:41:02 [INFO] Processing SRX4551490-SRR7691928. (38/63)
2021-08-12 16:41:19 [INFO] Processing SRX6686161. (24/37)
2021-08-12 16:41:19 [INFO] Processing SRX6686161-SRR9937450. (39/63)
2021-08-12 16:41:26 [INFO] Processing SRX6686161-SRR9937449. (40/63)
2021-08-12 16:41:32 [INFO] Writing to disk...
2021-08-12 16:41:48 [INFO] Processing SRX6686149. (25/37)
2021-08-12 16:41:48 [INFO] Processing SRX6686149-SRR9937453. (41/63)
2021-08-12 16:41:53 [INFO] Processing SRX6686149-SRR9937454. (42/63)
2021-08-12 16:42:00 [INFO] Processing SRX4551481. (26/37)
2021-08-12 16:42:00 [INFO] Processing SRX4551481-SRR7691914. (43/63)
2021-08-12 16:42:05 [INFO] Processing SRX4551481-SRR7691913. (44/63)
2021-08-12 16:42:10 [INFO] Processing SRX4551483. (27/37)
2021-08-12 16:42:10 [INFO] Processing SRX4551483-SRR7691916. (45/63)
2021-08-12 16:42:18 [INFO] Processing SRX4519327. (28/37)
2021-08-12 16:42:18 [INFO] Processing SRX4519327-SRR7657706. (46/63)
2021-08-12 16:42:25 [INFO] Processing SRX4519327-SRR7657707. (47/63)
2021-08-12 16:42:33 [INFO] Processing SRX4519327-SRR7657708. (48/63)
2021-08-12 16:42:41 [INFO] Processing SRX6686158. (29/37)
2021-08-12 16:42:41 [INFO] Processing SRX6686158-SRR9937446. (49/63)
2021-08-12 16:42:54 [INFO] Processing SRX6686156. (30/37)
2021-08-12 16:42:54 [INFO] Processing SRX6686156-SRR9937443. (50/63)
2021-08-12 16:43:09 [INFO] Writing to disk...
2021-08-12 16:43:28 [INFO] Processing SRX4551480. (31/37)
2021-08-12 16:43:28 [INFO] Processing SRX4551480-SRR7691912. (51/63)
2021-08-12 16:43:34 [INFO] Processing SRX4519321. (32/37)
2021-08-12 16:43:34 [INFO] Processing SRX4519321-SRR7657694. (52/63)
2021-08-12 16:43:40 [INFO] Processing SRX4519321-SRR7657695. (53/63)
2021-08-12 16:43:59 [INFO] Processing SRX4519321-SRR7657696. (54/63)
2021-08-12 16:44:08 [INFO] Processing SRX4519329. (33/37)
2021-08-12 16:44:08 [INFO] Processing SRX4519329-SRR7657711. (55/63)
2021-08-12 16:44:20 [INFO] Processing SRX4551482. (34/37)
2021-08-12 16:44:20 [INFO] Processing SRX4551482-SRR7691915. (56/63)
2021-08-12 16:44:25 [INFO] Processing SRX6686157. (35/37)
2021-08-12 16:44:25 [INFO] Processing SRX6686157-SRR9937444. (57/63)
2021-08-12 16:44:35 [INFO] Processing SRX6686157-SRR9937445. (58/63)
2021-08-12 16:44:47 [INFO] Processing SRX4519320. (36/37)
2021-08-12 16:44:47 [INFO] Processing SRX4519320-SRR7657691. (59/63)
2021-08-12 16:45:00 [INFO] Processing SRX4519320-SRR7657693. (60/63)
2021-08-12 16:45:16 [INFO] Writing to disk...
2021-08-12 16:45:37 [INFO] Processing SRX4519320-SRR7657692. (61/63)
2021-08-12 16:45:48 [INFO] Processing SRX4519326. (37/37)
2021-08-12 16:45:48 [INFO] Processing SRX4519326-SRR7657705. (62/63)
2021-08-12 16:46:00 [INFO] Processing SRX4519326-SRR7657704. (63/63)
2021-08-12 16:46:10 [INFO] Writing to disk...
2021-08-12 16:46:31 [INFO] Finished.
2021-08-13 09:44:54 [INFO] Starting.
2021-08-13 09:44:54 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/
2021-08-13 09:44:54 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/aggregate.hdf5
2021-08-13 09:44:54 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-13 09:44:55 [INFO] Building aggregate for 5kbp_raw network.
2021-08-13 09:44:55 [INFO] Writing every 10 Runs.
2021-08-13 09:44:55 [INFO] Processing SRX6686163. (1/37)
2021-08-13 09:44:55 [INFO] Processing SRX6686163-SRR9937452. (1/63)
2021-08-13 09:44:58 [INFO] Processing SRX4519331. (2/37)
2021-08-13 09:44:58 [INFO] Processing SRX4519331-SRR7657714. (2/63)
2021-08-13 09:45:06 [INFO] Processing SRX4519331-SRR7657713. (3/63)
2021-08-13 09:45:15 [INFO] Processing SRX4519330. (3/37)
2021-08-13 09:45:15 [INFO] Processing SRX4519330-SRR7657712. (4/63)
2021-08-13 09:45:23 [INFO] Processing SRX6686159. (4/37)
2021-08-13 09:45:23 [INFO] Processing SRX6686159-SRR9937447. (5/63)
2021-08-13 09:45:26 [INFO] Processing SRX4519324. (5/37)
2021-08-13 09:45:26 [INFO] Processing SRX4519324-SRR7657701. (6/63)
2021-08-13 09:45:42 [INFO] Processing SRX4551479. (6/37)
2021-08-13 09:45:42 [INFO] Processing SRX4551479-SRR7691911. (7/63)
2021-08-13 09:45:50 [INFO] Processing SRX4551488. (7/37)
2021-08-13 09:45:50 [INFO] Processing SRX4551488-SRR7691924. (8/63)
2021-08-13 09:45:56 [INFO] Processing SRX4551488-SRR7691925. (9/63)
2021-08-13 09:46:05 [INFO] Processing SRX4551486. (8/37)
2021-08-13 09:46:05 [INFO] Processing SRX4551486-SRR7691921. (10/63)
2021-08-13 09:46:13 [INFO] Writing to disk...
2021-08-13 09:46:18 [INFO] Processing SRX4551486-SRR7691920. (11/63)
2021-08-13 09:46:26 [INFO] Processing SRX4519325. (9/37)
2021-08-13 09:46:26 [INFO] Processing SRX4519325-SRR7657702. (12/63)
2021-08-13 09:46:39 [INFO] Processing SRX4519325-SRR7657703. (13/63)
2021-08-13 09:46:48 [INFO] Processing SRX4519328. (10/37)
2021-08-13 09:46:48 [INFO] Processing SRX4519328-SRR7657709. (14/63)
2021-08-13 09:47:03 [INFO] Processing SRX4519328-SRR7657710. (15/63)
2021-08-13 09:47:16 [INFO] Processing SRX4551485. (11/37)
2021-08-13 09:47:16 [INFO] Processing SRX4551485-SRR7691919. (16/63)
2021-08-13 09:47:25 [INFO] Processing SRX4551485-SRR7691918. (17/63)
2021-08-13 09:47:33 [INFO] Processing SRX4551487. (12/37)
2021-08-13 09:47:33 [INFO] Processing SRX4551487-SRR7691922. (18/63)
2021-08-13 09:47:41 [INFO] Processing SRX4551487-SRR7691923. (19/63)
2021-08-13 09:47:50 [INFO] Processing SRX6686148. (13/37)
2021-08-13 09:47:50 [INFO] Processing SRX6686148-SRR9937441. (20/63)
2021-08-13 09:48:01 [INFO] Writing to disk...
2021-08-13 09:48:16 [INFO] Processing SRX6686148-SRR9937442. (21/63)
2021-08-13 09:48:28 [INFO] Processing SRX4551484. (14/37)
2021-08-13 09:48:28 [INFO] Processing SRX4551484-SRR7691917. (22/63)
2021-08-13 09:48:34 [INFO] Processing SRX4519322. (15/37)
2021-08-13 09:48:34 [INFO] Processing SRX4519322-SRR7657698. (23/63)
2021-08-13 09:48:50 [INFO] Processing SRX4519322-SRR7657697. (24/63)
2021-08-13 09:49:00 [INFO] Processing SRX6686162. (16/37)
2021-08-13 09:49:00 [INFO] Processing SRX6686162-SRR9937451. (25/63)
2021-08-13 09:49:05 [INFO] Processing SRX4519323. (17/37)
2021-08-13 09:49:05 [INFO] Processing SRX4519323-SRR7657700. (26/63)
2021-08-13 09:49:22 [INFO] Processing SRX4519323-SRR7657699. (27/63)
2021-08-13 09:49:31 [INFO] Processing SRX6686160. (18/37)
2021-08-13 09:49:31 [INFO] Processing SRX6686160-SRR9937448. (28/63)
2021-08-13 09:49:37 [INFO] Processing SRX4551491. (19/37)
2021-08-13 09:49:37 [INFO] Processing SRX4551491-SRR7691931. (29/63)
2021-08-13 09:49:46 [INFO] Processing SRX4551491-SRR7691929. (30/63)
2021-08-13 09:49:52 [INFO] Writing to disk...
2021-08-13 09:50:11 [INFO] Processing SRX4551491-SRR7691930. (31/63)
2021-08-13 09:50:21 [INFO] Processing SRX4551492. (20/37)
2021-08-13 09:50:21 [INFO] Processing SRX4551492-SRR7691932. (32/63)
2021-08-13 09:50:33 [INFO] Processing SRX4551492-SRR7691933. (33/63)
2021-08-13 09:50:45 [INFO] Processing SRX4551489. (21/37)
2021-08-13 09:50:45 [INFO] Processing SRX4551489-SRR7691926. (34/63)
2021-08-13 09:50:53 [INFO] Processing SRX4551489-SRR7691927. (35/63)
2021-08-13 09:51:05 [INFO] Processing SRX4519319. (22/37)
2021-08-13 09:51:05 [INFO] Processing SRX4519319-SRR7657689. (36/63)
2021-08-13 09:51:22 [INFO] Processing SRX4519319-SRR7657690. (37/63)
2021-08-13 09:51:35 [INFO] Processing SRX4551490. (23/37)
2021-08-13 09:51:35 [INFO] Processing SRX4551490-SRR7691928. (38/63)
2021-08-13 09:51:51 [INFO] Processing SRX6686161. (24/37)
2021-08-13 09:51:51 [INFO] Processing SRX6686161-SRR9937450. (39/63)
2021-08-13 09:51:59 [INFO] Processing SRX6686161-SRR9937449. (40/63)
2021-08-13 09:52:05 [INFO] Writing to disk...
2021-08-13 09:52:29 [INFO] Processing SRX6686149. (25/37)
2021-08-13 09:52:29 [INFO] Processing SRX6686149-SRR9937453. (41/63)
2021-08-13 09:52:36 [INFO] Processing SRX6686149-SRR9937454. (42/63)
2021-08-13 09:52:43 [INFO] Processing SRX4551481. (26/37)
2021-08-13 09:52:43 [INFO] Processing SRX4551481-SRR7691914. (43/63)
2021-08-13 09:52:51 [INFO] Processing SRX4551481-SRR7691913. (44/63)
2021-08-13 09:52:57 [INFO] Processing SRX4551483. (27/37)
2021-08-13 09:52:57 [INFO] Processing SRX4551483-SRR7691916. (45/63)
2021-08-13 09:53:05 [INFO] Processing SRX4519327. (28/37)
2021-08-13 09:53:05 [INFO] Processing SRX4519327-SRR7657706. (46/63)
2021-08-13 09:53:13 [INFO] Processing SRX4519327-SRR7657707. (47/63)
2021-08-13 09:53:23 [INFO] Processing SRX4519327-SRR7657708. (48/63)
2021-08-13 09:53:32 [INFO] Processing SRX6686158. (29/37)
2021-08-13 09:53:32 [INFO] Processing SRX6686158-SRR9937446. (49/63)
2021-08-13 09:53:45 [INFO] Processing SRX6686156. (30/37)
2021-08-13 09:53:45 [INFO] Processing SRX6686156-SRR9937443. (50/63)
2021-08-13 09:54:01 [INFO] Writing to disk...
2021-08-13 09:54:24 [INFO] Processing SRX4551480. (31/37)
2021-08-13 09:54:24 [INFO] Processing SRX4551480-SRR7691912. (51/63)
2021-08-13 09:54:32 [INFO] Processing SRX4519321. (32/37)
2021-08-13 09:54:32 [INFO] Processing SRX4519321-SRR7657694. (52/63)
2021-08-13 09:54:39 [INFO] Processing SRX4519321-SRR7657695. (53/63)
2021-08-13 09:54:58 [INFO] Processing SRX4519321-SRR7657696. (54/63)
2021-08-13 09:55:10 [INFO] Processing SRX4519329. (33/37)
2021-08-13 09:55:10 [INFO] Processing SRX4519329-SRR7657711. (55/63)
2021-08-13 09:55:21 [INFO] Processing SRX4551482. (34/37)
2021-08-13 09:55:21 [INFO] Processing SRX4551482-SRR7691915. (56/63)
2021-08-13 09:55:29 [INFO] Processing SRX6686157. (35/37)
2021-08-13 09:55:29 [INFO] Processing SRX6686157-SRR9937444. (57/63)
2021-08-13 09:55:38 [INFO] Processing SRX6686157-SRR9937445. (58/63)
2021-08-13 09:55:50 [INFO] Processing SRX4519320. (36/37)
2021-08-13 09:55:50 [INFO] Processing SRX4519320-SRR7657691. (59/63)
2021-08-13 09:56:02 [INFO] Processing SRX4519320-SRR7657693. (60/63)
2021-08-13 09:56:17 [INFO] Writing to disk...
2021-08-13 09:56:42 [INFO] Processing SRX4519320-SRR7657692. (61/63)
2021-08-13 09:56:55 [INFO] Processing SRX4519326. (37/37)
2021-08-13 09:56:55 [INFO] Processing SRX4519326-SRR7657705. (62/63)
2021-08-13 09:57:10 [INFO] Processing SRX4519326-SRR7657704. (63/63)
2021-08-13 09:57:24 [INFO] Writing to disk...
2021-08-13 09:57:50 [INFO] Finished.
2021-08-13 17:23:01 [INFO] Starting.
2021-08-13 17:23:01 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/
2021-08-13 17:23:01 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/aggregate.hdf5
2021-08-13 17:23:01 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-13 17:23:02 [INFO] Building aggregate for 1kbp_raw network.
2021-08-13 17:23:02 [INFO] Writing every 10 Runs.
2021-08-13 17:23:02 [INFO] Processing SRX6686163. (1/37)
2021-08-13 17:23:02 [INFO] Processing SRX6686163-SRR9937452. (1/63)
2021-08-13 17:23:05 [INFO] Processing SRX4519331. (2/37)
2021-08-13 17:23:05 [INFO] Processing SRX4519331-SRR7657714. (2/63)
2021-08-13 17:23:18 [INFO] Processing SRX4519331-SRR7657713. (3/63)
2021-08-13 17:23:28 [INFO] Processing SRX4519330. (3/37)
2021-08-13 17:23:28 [INFO] Processing SRX4519330-SRR7657712. (4/63)
2021-08-13 17:23:40 [INFO] Processing SRX6686159. (4/37)
2021-08-13 17:23:40 [INFO] Processing SRX6686159-SRR9937447. (5/63)
2021-08-13 17:23:45 [INFO] Processing SRX4519324. (5/37)
2021-08-13 17:23:45 [INFO] Processing SRX4519324-SRR7657701. (6/63)
2021-08-13 17:24:08 [INFO] Processing SRX4551479. (6/37)
2021-08-13 17:24:08 [INFO] Processing SRX4551479-SRR7691911. (7/63)
2021-08-13 17:24:22 [INFO] Processing SRX4551488. (7/37)
2021-08-13 17:24:22 [INFO] Processing SRX4551488-SRR7691924. (8/63)
2021-08-13 17:24:32 [INFO] Processing SRX4551488-SRR7691925. (9/63)
2021-08-13 17:24:45 [INFO] Processing SRX4551486. (8/37)
2021-08-13 17:24:45 [INFO] Processing SRX4551486-SRR7691921. (10/63)
2021-08-13 17:24:58 [INFO] Writing to disk...
2021-08-13 17:25:05 [INFO] Processing SRX4551486-SRR7691920. (11/63)
2021-08-13 17:25:17 [INFO] Processing SRX4519325. (9/37)
2021-08-13 17:25:17 [INFO] Processing SRX4519325-SRR7657702. (12/63)
2021-08-13 17:25:34 [INFO] Processing SRX4519325-SRR7657703. (13/63)
2021-08-13 17:25:48 [INFO] Processing SRX4519328. (10/37)
2021-08-13 17:25:48 [INFO] Processing SRX4519328-SRR7657709. (14/63)
2021-08-13 17:26:09 [INFO] Processing SRX4519328-SRR7657710. (15/63)
2021-08-13 17:26:26 [INFO] Processing SRX4551485. (11/37)
2021-08-13 17:26:26 [INFO] Processing SRX4551485-SRR7691919. (16/63)
2021-08-13 17:26:40 [INFO] Processing SRX4551485-SRR7691918. (17/63)
2021-08-13 17:26:53 [INFO] Processing SRX4551487. (12/37)
2021-08-13 17:26:53 [INFO] Processing SRX4551487-SRR7691922. (18/63)
2021-08-13 17:27:04 [INFO] Processing SRX4551487-SRR7691923. (19/63)
2021-08-13 17:27:17 [INFO] Processing SRX6686148. (13/37)
2021-08-13 17:27:17 [INFO] Processing SRX6686148-SRR9937441. (20/63)
2021-08-13 17:27:37 [INFO] Writing to disk...
2021-08-13 17:27:59 [INFO] Processing SRX6686148-SRR9937442. (21/63)
2021-08-13 17:28:18 [INFO] Processing SRX4551484. (14/37)
2021-08-13 17:28:18 [INFO] Processing SRX4551484-SRR7691917. (22/63)
2021-08-13 17:28:27 [INFO] Processing SRX4519322. (15/37)
2021-08-13 17:28:27 [INFO] Processing SRX4519322-SRR7657698. (23/63)
2021-08-13 17:28:50 [INFO] Processing SRX4519322-SRR7657697. (24/63)
2021-08-13 17:29:06 [INFO] Processing SRX6686162. (16/37)
2021-08-13 17:29:06 [INFO] Processing SRX6686162-SRR9937451. (25/63)
2021-08-13 17:29:14 [INFO] Processing SRX4519323. (17/37)
2021-08-13 17:29:14 [INFO] Processing SRX4519323-SRR7657700. (26/63)
2021-08-13 17:29:39 [INFO] Processing SRX4519323-SRR7657699. (27/63)
2021-08-13 17:29:51 [INFO] Processing SRX6686160. (18/37)
2021-08-13 17:29:51 [INFO] Processing SRX6686160-SRR9937448. (28/63)
2021-08-13 17:30:00 [INFO] Processing SRX4551491. (19/37)
2021-08-13 17:30:01 [INFO] Processing SRX4551491-SRR7691931. (29/63)
2021-08-13 17:30:14 [INFO] Processing SRX4551491-SRR7691929. (30/63)
2021-08-13 17:30:23 [INFO] Writing to disk...
2021-08-13 17:30:52 [INFO] Processing SRX4551491-SRR7691930. (31/63)
2021-08-13 17:31:04 [INFO] Processing SRX4551492. (20/37)
2021-08-13 17:31:04 [INFO] Processing SRX4551492-SRR7691932. (32/63)
2021-08-13 17:31:22 [INFO] Processing SRX4551492-SRR7691933. (33/63)
2021-08-13 17:31:42 [INFO] Processing SRX4551489. (21/37)
2021-08-13 17:31:42 [INFO] Processing SRX4551489-SRR7691926. (34/63)
2021-08-13 17:31:56 [INFO] Processing SRX4551489-SRR7691927. (35/63)
2021-08-13 17:32:11 [INFO] Processing SRX4519319. (22/37)
2021-08-13 17:32:11 [INFO] Processing SRX4519319-SRR7657689. (36/63)
2021-08-13 17:32:36 [INFO] Processing SRX4519319-SRR7657690. (37/63)
2021-08-13 17:32:57 [INFO] Processing SRX4551490. (23/37)
2021-08-13 17:32:57 [INFO] Processing SRX4551490-SRR7691928. (38/63)
2021-08-13 17:33:22 [INFO] Processing SRX6686161. (24/37)
2021-08-13 17:33:22 [INFO] Processing SRX6686161-SRR9937450. (39/63)
2021-08-13 17:33:33 [INFO] Processing SRX6686161-SRR9937449. (40/63)
2021-08-13 17:33:43 [INFO] Writing to disk...
2021-08-13 17:34:12 [INFO] Processing SRX6686149. (25/37)
2021-08-13 17:34:12 [INFO] Processing SRX6686149-SRR9937453. (41/63)
2021-08-13 17:34:23 [INFO] Processing SRX6686149-SRR9937454. (42/63)
2021-08-13 17:34:34 [INFO] Processing SRX4551481. (26/37)
2021-08-13 17:34:34 [INFO] Processing SRX4551481-SRR7691914. (43/63)
2021-08-13 17:34:45 [INFO] Processing SRX4551481-SRR7691913. (44/63)
2021-08-13 17:34:56 [INFO] Processing SRX4551483. (27/37)
2021-08-13 17:34:56 [INFO] Processing SRX4551483-SRR7691916. (45/63)
2021-08-13 17:35:11 [INFO] Processing SRX4519327. (28/37)
2021-08-13 17:35:11 [INFO] Processing SRX4519327-SRR7657706. (46/63)
2021-08-13 17:35:28 [INFO] Processing SRX4519327-SRR7657707. (47/63)
2021-08-13 17:35:46 [INFO] Processing SRX4519327-SRR7657708. (48/63)
2021-08-13 17:36:01 [INFO] Processing SRX6686158. (29/37)
2021-08-13 17:36:01 [INFO] Processing SRX6686158-SRR9937446. (49/63)
2021-08-13 17:36:23 [INFO] Processing SRX6686156. (30/37)
2021-08-13 17:36:23 [INFO] Processing SRX6686156-SRR9937443. (50/63)
2021-08-13 17:36:48 [INFO] Writing to disk...
2021-08-13 17:37:25 [INFO] Processing SRX4551480. (31/37)
2021-08-13 17:37:25 [INFO] Processing SRX4551480-SRR7691912. (51/63)
2021-08-13 17:37:40 [INFO] Processing SRX4519321. (32/37)
2021-08-13 17:37:40 [INFO] Processing SRX4519321-SRR7657694. (52/63)
2021-08-13 17:37:53 [INFO] Processing SRX4519321-SRR7657695. (53/63)
2021-08-13 17:38:26 [INFO] Processing SRX4519321-SRR7657696. (54/63)
2021-08-13 17:38:43 [INFO] Processing SRX4519329. (33/37)
2021-08-13 17:38:43 [INFO] Processing SRX4519329-SRR7657711. (55/63)
2021-08-13 17:39:02 [INFO] Processing SRX4551482. (34/37)
2021-08-13 17:39:02 [INFO] Processing SRX4551482-SRR7691915. (56/63)
2021-08-13 17:39:13 [INFO] Processing SRX6686157. (35/37)
2021-08-13 17:39:13 [INFO] Processing SRX6686157-SRR9937444. (57/63)
2021-08-13 17:39:35 [INFO] Processing SRX6686157-SRR9937445. (58/63)
2021-08-13 17:39:56 [INFO] Processing SRX4519320. (36/37)
2021-08-13 17:39:56 [INFO] Processing SRX4519320-SRR7657691. (59/63)
2021-08-13 17:40:17 [INFO] Processing SRX4519320-SRR7657693. (60/63)
2021-08-13 17:40:38 [INFO] Writing to disk...
2021-08-13 17:41:16 [INFO] Processing SRX4519320-SRR7657692. (61/63)
2021-08-13 17:41:35 [INFO] Processing SRX4519326. (37/37)
2021-08-13 17:41:35 [INFO] Processing SRX4519326-SRR7657705. (62/63)
2021-08-13 17:41:57 [INFO] Processing SRX4519326-SRR7657704. (63/63)
2021-08-13 17:42:17 [INFO] Writing to disk...
2021-08-13 17:42:55 [INFO] Finished.
2021-08-16 11:36:45 [INFO] Starting.
2021-08-16 11:36:46 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/
2021-08-16 11:36:46 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/aggregate.hdf5
2021-08-16 11:36:46 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-16 11:36:46 [INFO] Building aggregate for 1bp_raw network.
2021-08-16 11:36:46 [INFO] Writing every 10 Runs.
2021-08-16 11:36:46 [INFO] Processing SRX6686163. (1/37)
2021-08-16 11:36:46 [INFO] Processing SRX6686163-SRR9937452. (1/63)
2021-08-16 11:40:43 [INFO] Processing SRX4519331. (2/37)
2021-08-16 11:40:43 [INFO] Processing SRX4519331-SRR7657714. (2/63)
2021-08-16 11:51:52 [ERROR] Adding SRR7657714:chr19_vs_chr4 to in memory aggregate failed. Error message:
Traceback (most recent call last):
  File "/grid/gillis/data/nfox/hi_c_data_processing/software/aggregate.py", line 445, in add_dataset
    aggregate_data[c] = aggregate_data[c] + net
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/base.py", line 415, in __add__
    return self._add_sparse(other)
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 359, in _add_sparse
    return self._binopt(other, '_plus_')
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 1226, in _binopt
    indptr = np.empty(self.indptr.shape, dtype=idx_dtype)
MemoryError: Unable to allocate 234. MiB for an array with shape (61431567,) and data type int32

2021-08-16 16:36:44 [INFO] Starting.
2021-08-16 16:36:44 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/
2021-08-16 16:36:44 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/aggregate.hdf5
2021-08-16 16:36:44 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-16 16:36:44 [INFO] Building aggregate for 1bp_raw network.
2021-08-16 16:36:44 [INFO] Writing every 10 Runs.
2021-08-16 16:36:44 [INFO] Processing SRX6686163. (1/37)
2021-08-16 16:36:44 [INFO] Processing SRX6686163-SRR9937452. (1/63)
2021-08-16 16:39:20 [INFO] Processing SRX4519331. (2/37)
2021-08-16 16:39:20 [INFO] Processing SRX4519331-SRR7657714. (2/63)
2021-08-16 16:45:01 [INFO] Processing SRX4519331-SRR7657713. (3/63)
2021-08-16 16:50:44 [INFO] Processing SRX4519330. (3/37)
2021-08-16 16:50:44 [INFO] Processing SRX4519330-SRR7657712. (4/63)
2021-08-16 16:56:41 [INFO] Processing SRX6686159. (4/37)
2021-08-16 16:56:41 [INFO] Processing SRX6686159-SRR9937447. (5/63)
2021-08-16 17:02:22 [INFO] Processing SRX4519324. (5/37)
2021-08-16 17:02:22 [INFO] Processing SRX4519324-SRR7657701. (6/63)
2021-08-16 17:07:55 [INFO] Processing SRX4551479. (6/37)
2021-08-16 17:07:55 [INFO] Processing SRX4551479-SRR7691911. (7/63)
2021-08-16 17:13:22 [INFO] Processing SRX4551488. (7/37)
2021-08-16 17:13:22 [INFO] Processing SRX4551488-SRR7691924. (8/63)
2021-08-16 17:18:47 [INFO] Processing SRX4551488-SRR7691925. (9/63)
2021-08-16 17:24:14 [INFO] Processing SRX4551486. (8/37)
2021-08-16 17:24:14 [INFO] Processing SRX4551486-SRR7691921. (10/63)
2021-08-16 17:29:43 [INFO] Writing to disk...
2021-08-16 17:30:18 [INFO] Processing SRX4551486-SRR7691920. (11/63)
2021-08-16 17:35:45 [INFO] Processing SRX4519325. (9/37)
2021-08-16 17:35:45 [INFO] Processing SRX4519325-SRR7657702. (12/63)
2021-08-16 17:41:21 [INFO] Processing SRX4519325-SRR7657703. (13/63)
2021-08-16 17:46:51 [INFO] Processing SRX4519328. (10/37)
2021-08-16 17:46:51 [INFO] Processing SRX4519328-SRR7657709. (14/63)
2021-08-16 17:52:31 [INFO] Processing SRX4519328-SRR7657710. (15/63)
2021-08-16 17:58:07 [INFO] Processing SRX4551485. (11/37)
2021-08-16 17:58:07 [INFO] Processing SRX4551485-SRR7691919. (16/63)
2021-08-16 18:05:57 [INFO] Processing SRX4551485-SRR7691918. (17/63)
2021-08-16 18:14:26 [INFO] Processing SRX4551487. (12/37)
2021-08-16 18:14:26 [INFO] Processing SRX4551487-SRR7691922. (18/63)
2021-08-16 18:22:35 [INFO] Processing SRX4551487-SRR7691923. (19/63)
2021-08-16 18:29:47 [INFO] Processing SRX6686148. (13/37)
2021-08-16 18:29:47 [INFO] Processing SRX6686148-SRR9937441. (20/63)
2021-08-16 18:39:17 [INFO] Writing to disk...
2021-08-16 18:42:40 [INFO] Processing SRX6686148-SRR9937442. (21/63)
2021-08-16 18:51:35 [INFO] Processing SRX4551484. (14/37)
2021-08-16 18:51:35 [INFO] Processing SRX4551484-SRR7691917. (22/63)
2021-08-16 18:58:01 [INFO] Processing SRX4519322. (15/37)
2021-08-16 18:58:01 [INFO] Processing SRX4519322-SRR7657698. (23/63)
2021-08-16 19:04:03 [INFO] Processing SRX4519322-SRR7657697. (24/63)
2021-08-16 19:10:45 [INFO] Processing SRX6686162. (16/37)
2021-08-16 19:10:45 [INFO] Processing SRX6686162-SRR9937451. (25/63)
2021-08-16 19:17:17 [INFO] Processing SRX4519323. (17/37)
2021-08-16 19:17:17 [INFO] Processing SRX4519323-SRR7657700. (26/63)
2021-08-16 19:25:18 [INFO] Processing SRX4519323-SRR7657699. (27/63)
2021-08-16 19:31:41 [INFO] Processing SRX6686160. (18/37)
2021-08-16 19:31:41 [INFO] Processing SRX6686160-SRR9937448. (28/63)
2021-08-16 19:38:31 [INFO] Processing SRX4551491. (19/37)
2021-08-16 19:38:31 [INFO] Processing SRX4551491-SRR7691931. (29/63)
2021-08-16 19:45:58 [INFO] Processing SRX4551491-SRR7691929. (30/63)
2021-08-16 19:52:31 [INFO] Writing to disk...
2021-08-16 19:53:48 [INFO] Processing SRX4551491-SRR7691930. (31/63)
2021-08-16 20:00:19 [INFO] Processing SRX4551492. (20/37)
2021-08-16 20:00:19 [INFO] Processing SRX4551492-SRR7691932. (32/63)
2021-08-16 20:07:37 [INFO] Processing SRX4551492-SRR7691933. (33/63)
2021-08-16 20:14:15 [INFO] Processing SRX4551489. (21/37)
2021-08-16 20:14:15 [INFO] Processing SRX4551489-SRR7691926. (34/63)
2021-08-16 20:21:05 [INFO] Processing SRX4551489-SRR7691927. (35/63)
2021-08-16 20:27:49 [INFO] Processing SRX4519319. (22/37)
2021-08-16 20:27:49 [INFO] Processing SRX4519319-SRR7657689. (36/63)
2021-08-16 20:35:22 [INFO] Processing SRX4519319-SRR7657690. (37/63)
2021-08-16 20:43:22 [INFO] Processing SRX4551490. (23/37)
2021-08-16 20:43:22 [INFO] Processing SRX4551490-SRR7691928. (38/63)
2021-08-16 20:50:16 [INFO] Processing SRX6686161. (24/37)
2021-08-16 20:50:16 [INFO] Processing SRX6686161-SRR9937450. (39/63)
2021-08-16 20:57:09 [INFO] Processing SRX6686161-SRR9937449. (40/63)
2021-08-16 21:04:12 [INFO] Writing to disk...
2021-08-16 21:05:36 [INFO] Processing SRX6686149. (25/37)
2021-08-16 21:05:36 [INFO] Processing SRX6686149-SRR9937453. (41/63)
2021-08-16 21:13:56 [INFO] Processing SRX6686149-SRR9937454. (42/63)
2021-08-16 21:22:47 [INFO] Processing SRX4551481. (26/37)
2021-08-16 21:22:47 [INFO] Processing SRX4551481-SRR7691914. (43/63)
2021-08-16 21:28:27 [INFO] Processing SRX4551481-SRR7691913. (44/63)
2021-08-16 21:34:02 [INFO] Processing SRX4551483. (27/37)
2021-08-16 21:34:02 [INFO] Processing SRX4551483-SRR7691916. (45/63)
2021-08-16 21:39:45 [INFO] Processing SRX4519327. (28/37)
2021-08-16 21:39:45 [INFO] Processing SRX4519327-SRR7657706. (46/63)
2021-08-16 21:45:26 [INFO] Processing SRX4519327-SRR7657707. (47/63)
2021-08-16 21:51:13 [INFO] Processing SRX4519327-SRR7657708. (48/63)
2021-08-16 21:56:54 [INFO] Processing SRX6686158. (29/37)
2021-08-16 21:56:54 [INFO] Processing SRX6686158-SRR9937446. (49/63)
2021-08-16 22:02:42 [INFO] Processing SRX6686156. (30/37)
2021-08-16 22:02:42 [INFO] Processing SRX6686156-SRR9937443. (50/63)
2021-08-16 22:08:33 [INFO] Writing to disk...
2021-08-16 22:09:45 [INFO] Processing SRX4551480. (31/37)
2021-08-16 22:09:45 [INFO] Processing SRX4551480-SRR7691912. (51/63)
2021-08-16 22:15:26 [INFO] Processing SRX4519321. (32/37)
2021-08-16 22:15:26 [INFO] Processing SRX4519321-SRR7657694. (52/63)
2021-08-16 22:20:58 [INFO] Processing SRX4519321-SRR7657695. (53/63)
2021-08-16 22:26:53 [INFO] Processing SRX4519321-SRR7657696. (54/63)
2021-08-16 22:32:37 [INFO] Processing SRX4519329. (33/37)
2021-08-16 22:32:37 [INFO] Processing SRX4519329-SRR7657711. (55/63)
2021-08-16 22:38:29 [INFO] Processing SRX4551482. (34/37)
2021-08-16 22:38:29 [INFO] Processing SRX4551482-SRR7691915. (56/63)
2021-08-16 22:44:15 [INFO] Processing SRX6686157. (35/37)
2021-08-16 22:44:15 [INFO] Processing SRX6686157-SRR9937444. (57/63)
2021-08-16 22:50:07 [INFO] Processing SRX6686157-SRR9937445. (58/63)
2021-08-16 22:56:01 [INFO] Processing SRX4519320. (36/37)
2021-08-16 22:56:01 [INFO] Processing SRX4519320-SRR7657691. (59/63)
2021-08-16 23:01:52 [INFO] Processing SRX4519320-SRR7657693. (60/63)
2021-08-16 23:07:45 [INFO] Writing to disk...
2021-08-16 23:09:04 [INFO] Processing SRX4519320-SRR7657692. (61/63)
2021-08-16 23:14:58 [INFO] Processing SRX4519326. (37/37)
2021-08-16 23:14:58 [INFO] Processing SRX4519326-SRR7657705. (62/63)
2021-08-16 23:21:33 [INFO] Processing SRX4519326-SRR7657704. (63/63)
2021-08-16 23:28:21 [INFO] Writing to disk...
2021-08-16 23:29:55 [INFO] Finished.
2021-08-23 13:34:04 [INFO] Starting.
2021-08-23 13:34:04 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/
2021-08-23 13:34:04 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/aggregate.hdf5
2021-08-23 13:34:04 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:34:04 [INFO] Building aggregate for 100kbp_raw network.
2021-08-23 13:34:04 [INFO] Writing every 10 Runs.
2021-08-23 13:34:04 [INFO] Processing SRX6686163. (1/37)
2021-08-23 13:34:04 [INFO] Processing SRX6686163-SRR9937452. (1/63)
2021-08-23 13:34:06 [INFO] Processing SRX4519331. (2/37)
2021-08-23 13:34:06 [INFO] Processing SRX4519331-SRR7657714. (2/63)
2021-08-23 13:34:11 [INFO] Processing SRX4519331-SRR7657713. (3/63)
2021-08-23 13:34:15 [INFO] Processing SRX4519330. (3/37)
2021-08-23 13:34:15 [INFO] Processing SRX4519330-SRR7657712. (4/63)
2021-08-23 13:34:20 [INFO] Processing SRX6686159. (4/37)
2021-08-23 13:34:20 [INFO] Processing SRX6686159-SRR9937447. (5/63)
2021-08-23 13:34:22 [INFO] Processing SRX4519324. (5/37)
2021-08-23 13:34:22 [INFO] Processing SRX4519324-SRR7657701. (6/63)
2021-08-23 13:34:31 [INFO] Processing SRX4551479. (6/37)
2021-08-23 13:34:31 [INFO] Processing SRX4551479-SRR7691911. (7/63)
2021-08-23 13:34:36 [INFO] Processing SRX4551488. (7/37)
2021-08-23 13:34:36 [INFO] Processing SRX4551488-SRR7691924. (8/63)
2021-08-23 13:34:39 [INFO] Processing SRX4551488-SRR7691925. (9/63)
2021-08-23 13:34:43 [INFO] Processing SRX4551486. (8/37)
2021-08-23 13:34:43 [INFO] Processing SRX4551486-SRR7691921. (10/63)
2021-08-23 13:34:49 [INFO] Writing to disk...
2021-08-23 13:34:50 [INFO] Processing SRX4551486-SRR7691920. (11/63)
2021-08-23 13:34:54 [INFO] Processing SRX4519325. (9/37)
2021-08-23 13:34:54 [INFO] Processing SRX4519325-SRR7657702. (12/63)
2021-08-23 13:35:00 [INFO] Processing SRX4519325-SRR7657703. (13/63)
2021-08-23 13:35:05 [INFO] Processing SRX4519328. (10/37)
2021-08-23 13:35:05 [INFO] Processing SRX4519328-SRR7657709. (14/63)
2021-08-23 13:35:14 [INFO] Processing SRX4519328-SRR7657710. (15/63)
2021-08-23 13:35:20 [INFO] Processing SRX4551485. (11/37)
2021-08-23 13:35:20 [INFO] Processing SRX4551485-SRR7691919. (16/63)
2021-08-23 13:35:25 [INFO] Processing SRX4551485-SRR7691918. (17/63)
2021-08-23 13:35:29 [INFO] Processing SRX4551487. (12/37)
2021-08-23 13:35:29 [INFO] Processing SRX4551487-SRR7691922. (18/63)
2021-08-23 13:35:34 [INFO] Processing SRX4551487-SRR7691923. (19/63)
2021-08-23 13:35:38 [INFO] Processing SRX6686148. (13/37)
2021-08-23 13:35:38 [INFO] Processing SRX6686148-SRR9937441. (20/63)
2021-08-23 13:35:43 [INFO] Writing to disk...
2021-08-23 13:35:53 [INFO] Processing SRX6686148-SRR9937442. (21/63)
2021-08-23 13:35:59 [INFO] Processing SRX4551484. (14/37)
2021-08-23 13:35:59 [INFO] Processing SRX4551484-SRR7691917. (22/63)
2021-08-23 13:36:03 [INFO] Processing SRX4519322. (15/37)
2021-08-23 13:36:03 [INFO] Processing SRX4519322-SRR7657698. (23/63)
2021-08-23 13:36:11 [INFO] Processing SRX4519322-SRR7657697. (24/63)
2021-08-23 13:36:16 [INFO] Processing SRX6686162. (16/37)
2021-08-23 13:36:16 [INFO] Processing SRX6686162-SRR9937451. (25/63)
2021-08-23 13:36:19 [INFO] Processing SRX4519323. (17/37)
2021-08-23 13:36:19 [INFO] Processing SRX4519323-SRR7657700. (26/63)
2021-08-23 13:36:28 [INFO] Processing SRX4519323-SRR7657699. (27/63)
2021-08-23 13:36:32 [INFO] Processing SRX6686160. (18/37)
2021-08-23 13:36:32 [INFO] Processing SRX6686160-SRR9937448. (28/63)
2021-08-23 13:36:34 [INFO] Processing SRX4551491. (19/37)
2021-08-23 13:36:34 [INFO] Processing SRX4551491-SRR7691931. (29/63)
2021-08-23 13:36:38 [INFO] Processing SRX4551491-SRR7691929. (30/63)
2021-08-23 13:36:41 [INFO] Writing to disk...
2021-08-23 13:36:52 [INFO] Processing SRX4551491-SRR7691930. (31/63)
2021-08-23 13:36:56 [INFO] Processing SRX4551492. (20/37)
2021-08-23 13:36:56 [INFO] Processing SRX4551492-SRR7691932. (32/63)
2021-08-23 13:37:02 [INFO] Processing SRX4551492-SRR7691933. (33/63)
2021-08-23 13:37:08 [INFO] Processing SRX4551489. (21/37)
2021-08-23 13:37:08 [INFO] Processing SRX4551489-SRR7691926. (34/63)
2021-08-23 13:37:12 [INFO] Processing SRX4551489-SRR7691927. (35/63)
2021-08-23 13:37:16 [INFO] Processing SRX4519319. (22/37)
2021-08-23 13:37:16 [INFO] Processing SRX4519319-SRR7657689. (36/63)
2021-08-23 13:37:24 [INFO] Processing SRX4519319-SRR7657690. (37/63)
2021-08-23 13:37:31 [INFO] Processing SRX4551490. (23/37)
2021-08-23 13:37:31 [INFO] Processing SRX4551490-SRR7691928. (38/63)
2021-08-23 13:37:39 [INFO] Processing SRX6686161. (24/37)
2021-08-23 13:37:39 [INFO] Processing SRX6686161-SRR9937450. (39/63)
2021-08-23 13:37:43 [INFO] Processing SRX6686161-SRR9937449. (40/63)
2021-08-23 13:37:45 [INFO] Writing to disk...
2021-08-23 13:37:57 [INFO] Processing SRX6686149. (25/37)
2021-08-23 13:37:57 [INFO] Processing SRX6686149-SRR9937453. (41/63)
2021-08-23 13:38:00 [INFO] Processing SRX6686149-SRR9937454. (42/63)
2021-08-23 13:38:02 [INFO] Processing SRX4551481. (26/37)
2021-08-23 13:38:02 [INFO] Processing SRX4551481-SRR7691914. (43/63)
2021-08-23 13:38:05 [INFO] Processing SRX4551481-SRR7691913. (44/63)
2021-08-23 13:38:08 [INFO] Processing SRX4551483. (27/37)
2021-08-23 13:38:08 [INFO] Processing SRX4551483-SRR7691916. (45/63)
2021-08-23 13:38:11 [INFO] Processing SRX4519327. (28/37)
2021-08-23 13:38:11 [INFO] Processing SRX4519327-SRR7657706. (46/63)
2021-08-23 13:38:14 [INFO] Processing SRX4519327-SRR7657707. (47/63)
2021-08-23 13:38:18 [INFO] Processing SRX4519327-SRR7657708. (48/63)
2021-08-23 13:38:21 [INFO] Processing SRX6686158. (29/37)
2021-08-23 13:38:21 [INFO] Processing SRX6686158-SRR9937446. (49/63)
2021-08-23 13:38:28 [INFO] Processing SRX6686156. (30/37)
2021-08-23 13:38:28 [INFO] Processing SRX6686156-SRR9937443. (50/63)
2021-08-23 13:38:38 [INFO] Writing to disk...
2021-08-23 13:38:53 [INFO] Processing SRX4551480. (31/37)
2021-08-23 13:38:53 [INFO] Processing SRX4551480-SRR7691912. (51/63)
2021-08-23 13:38:55 [INFO] Processing SRX4519321. (32/37)
2021-08-23 13:38:55 [INFO] Processing SRX4519321-SRR7657694. (52/63)
2021-08-23 13:38:58 [INFO] Processing SRX4519321-SRR7657695. (53/63)
2021-08-23 13:39:10 [INFO] Processing SRX4519321-SRR7657696. (54/63)
2021-08-23 13:39:15 [INFO] Processing SRX4519329. (33/37)
2021-08-23 13:39:15 [INFO] Processing SRX4519329-SRR7657711. (55/63)
2021-08-23 13:39:20 [INFO] Processing SRX4551482. (34/37)
2021-08-23 13:39:20 [INFO] Processing SRX4551482-SRR7691915. (56/63)
2021-08-23 13:39:23 [INFO] Processing SRX6686157. (35/37)
2021-08-23 13:39:23 [INFO] Processing SRX6686157-SRR9937444. (57/63)
2021-08-23 13:39:28 [INFO] Processing SRX6686157-SRR9937445. (58/63)
2021-08-23 13:39:33 [INFO] Processing SRX4519320. (36/37)
2021-08-23 13:39:33 [INFO] Processing SRX4519320-SRR7657691. (59/63)
2021-08-23 13:39:41 [INFO] Processing SRX4519320-SRR7657693. (60/63)
2021-08-23 13:39:48 [INFO] Writing to disk...
2021-08-23 13:40:02 [INFO] Processing SRX4519320-SRR7657692. (61/63)
2021-08-23 13:40:10 [INFO] Processing SRX4519326. (37/37)
2021-08-23 13:40:10 [INFO] Processing SRX4519326-SRR7657705. (62/63)
2021-08-23 13:40:16 [INFO] Processing SRX4519326-SRR7657704. (63/63)
2021-08-23 13:40:23 [INFO] Writing to disk...
2021-08-23 13:40:36 [INFO] Finished.
2021-08-30 12:45:57 [INFO] Starting.
2021-08-30 12:45:57 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/
2021-08-30 12:45:57 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/aggregate.hdf5
2021-08-30 12:45:57 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-30 12:45:57 [INFO] Building aggregate for 250kbp_raw network.
2021-08-30 12:45:57 [INFO] Writing every 10 Runs.
2021-08-30 12:45:57 [INFO] Processing SRX6686163. (1/37)
2021-08-30 12:45:57 [INFO] Processing SRX6686163-SRR9937452. (1/63)
2021-08-30 12:45:59 [INFO] Processing SRX4519331. (2/37)
2021-08-30 12:45:59 [INFO] Processing SRX4519331-SRR7657714. (2/63)
2021-08-30 12:46:03 [INFO] Processing SRX4519331-SRR7657713. (3/63)
2021-08-30 12:46:07 [INFO] Processing SRX4519330. (3/37)
2021-08-30 12:46:07 [INFO] Processing SRX4519330-SRR7657712. (4/63)
2021-08-30 12:46:11 [INFO] Processing SRX6686159. (4/37)
2021-08-30 12:46:11 [INFO] Processing SRX6686159-SRR9937447. (5/63)
2021-08-30 12:46:12 [INFO] Processing SRX4519324. (5/37)
2021-08-30 12:46:12 [INFO] Processing SRX4519324-SRR7657701. (6/63)
2021-08-30 12:46:18 [INFO] Processing SRX4551479. (6/37)
2021-08-30 12:46:18 [INFO] Processing SRX4551479-SRR7691911. (7/63)
2021-08-30 12:46:22 [INFO] Processing SRX4551488. (7/37)
2021-08-30 12:46:22 [INFO] Processing SRX4551488-SRR7691924. (8/63)
2021-08-30 12:46:24 [INFO] Processing SRX4551488-SRR7691925. (9/63)
2021-08-30 12:46:27 [INFO] Processing SRX4551486. (8/37)
2021-08-30 12:46:27 [INFO] Processing SRX4551486-SRR7691921. (10/63)
2021-08-30 12:46:31 [INFO] Writing to disk...
2021-08-30 12:46:32 [INFO] Processing SRX4551486-SRR7691920. (11/63)
2021-08-30 12:46:36 [INFO] Processing SRX4519325. (9/37)
2021-08-30 12:46:36 [INFO] Processing SRX4519325-SRR7657702. (12/63)
2021-08-30 12:46:40 [INFO] Processing SRX4519325-SRR7657703. (13/63)
2021-08-30 12:46:43 [INFO] Processing SRX4519328. (10/37)
2021-08-30 12:46:43 [INFO] Processing SRX4519328-SRR7657709. (14/63)
2021-08-30 12:46:49 [INFO] Processing SRX4519328-SRR7657710. (15/63)
2021-08-30 12:46:54 [INFO] Processing SRX4551485. (11/37)
2021-08-30 12:46:54 [INFO] Processing SRX4551485-SRR7691919. (16/63)
2021-08-30 12:46:58 [INFO] Processing SRX4551485-SRR7691918. (17/63)
2021-08-30 12:47:02 [INFO] Processing SRX4551487. (12/37)
2021-08-30 12:47:02 [INFO] Processing SRX4551487-SRR7691922. (18/63)
2021-08-30 12:47:05 [INFO] Processing SRX4551487-SRR7691923. (19/63)
2021-08-30 12:47:07 [INFO] Processing SRX6686148. (13/37)
2021-08-30 12:47:07 [INFO] Processing SRX6686148-SRR9937441. (20/63)
2021-08-30 12:47:11 [INFO] Writing to disk...
2021-08-30 12:47:17 [INFO] Processing SRX6686148-SRR9937442. (21/63)
2021-08-30 12:47:22 [INFO] Processing SRX4551484. (14/37)
2021-08-30 12:47:22 [INFO] Processing SRX4551484-SRR7691917. (22/63)
2021-08-30 12:47:24 [INFO] Processing SRX4519322. (15/37)
2021-08-30 12:47:24 [INFO] Processing SRX4519322-SRR7657698. (23/63)
2021-08-30 12:47:28 [INFO] Processing SRX4519322-SRR7657697. (24/63)
2021-08-30 12:47:30 [INFO] Processing SRX6686162. (16/37)
2021-08-30 12:47:30 [INFO] Processing SRX6686162-SRR9937451. (25/63)
2021-08-30 12:47:32 [INFO] Processing SRX4519323. (17/37)
2021-08-30 12:47:32 [INFO] Processing SRX4519323-SRR7657700. (26/63)
2021-08-30 12:47:39 [INFO] Processing SRX4519323-SRR7657699. (27/63)
2021-08-30 12:47:42 [INFO] Processing SRX6686160. (18/37)
2021-08-30 12:47:42 [INFO] Processing SRX6686160-SRR9937448. (28/63)
2021-08-30 12:47:45 [INFO] Processing SRX4551491. (19/37)
2021-08-30 12:47:45 [INFO] Processing SRX4551491-SRR7691931. (29/63)
2021-08-30 12:47:47 [INFO] Processing SRX4551491-SRR7691929. (30/63)
2021-08-30 12:47:49 [INFO] Writing to disk...
2021-08-30 12:47:56 [INFO] Processing SRX4551491-SRR7691930. (31/63)
2021-08-30 12:47:59 [INFO] Processing SRX4551492. (20/37)
2021-08-30 12:47:59 [INFO] Processing SRX4551492-SRR7691932. (32/63)
2021-08-30 12:48:04 [INFO] Processing SRX4551492-SRR7691933. (33/63)
2021-08-30 12:48:09 [INFO] Processing SRX4551489. (21/37)
2021-08-30 12:48:09 [INFO] Processing SRX4551489-SRR7691926. (34/63)
2021-08-30 12:48:12 [INFO] Processing SRX4551489-SRR7691927. (35/63)
2021-08-30 12:48:15 [INFO] Processing SRX4519319. (22/37)
2021-08-30 12:48:15 [INFO] Processing SRX4519319-SRR7657689. (36/63)
2021-08-30 12:48:21 [INFO] Processing SRX4519319-SRR7657690. (37/63)
2021-08-30 12:48:26 [INFO] Processing SRX4551490. (23/37)
2021-08-30 12:48:26 [INFO] Processing SRX4551490-SRR7691928. (38/63)
2021-08-30 12:48:32 [INFO] Processing SRX6686161. (24/37)
2021-08-30 12:48:32 [INFO] Processing SRX6686161-SRR9937450. (39/63)
2021-08-30 12:48:35 [INFO] Processing SRX6686161-SRR9937449. (40/63)
2021-08-30 12:48:37 [INFO] Writing to disk...
2021-08-30 12:48:44 [INFO] Processing SRX6686149. (25/37)
2021-08-30 12:48:44 [INFO] Processing SRX6686149-SRR9937453. (41/63)
2021-08-30 12:48:46 [INFO] Processing SRX6686149-SRR9937454. (42/63)
2021-08-30 12:48:48 [INFO] Processing SRX4551481. (26/37)
2021-08-30 12:48:48 [INFO] Processing SRX4551481-SRR7691914. (43/63)
2021-08-30 12:48:50 [INFO] Processing SRX4551481-SRR7691913. (44/63)
2021-08-30 12:48:52 [INFO] Processing SRX4551483. (27/37)
2021-08-30 12:48:52 [INFO] Processing SRX4551483-SRR7691916. (45/63)
2021-08-30 12:48:54 [INFO] Processing SRX4519327. (28/37)
2021-08-30 12:48:54 [INFO] Processing SRX4519327-SRR7657706. (46/63)
2021-08-30 12:48:57 [INFO] Processing SRX4519327-SRR7657707. (47/63)
2021-08-30 12:49:00 [INFO] Processing SRX4519327-SRR7657708. (48/63)
2021-08-30 12:49:02 [INFO] Processing SRX6686158. (29/37)
2021-08-30 12:49:02 [INFO] Processing SRX6686158-SRR9937446. (49/63)
2021-08-30 12:49:07 [INFO] Processing SRX6686156. (30/37)
2021-08-30 12:49:07 [INFO] Processing SRX6686156-SRR9937443. (50/63)
2021-08-30 12:49:14 [INFO] Writing to disk...
2021-08-30 12:49:16 [INFO] Processing SRX4551480. (31/37)
2021-08-30 12:49:16 [INFO] Processing SRX4551480-SRR7691912. (51/63)
2021-08-30 12:49:18 [INFO] Processing SRX4519321. (32/37)
2021-08-30 12:49:18 [INFO] Processing SRX4519321-SRR7657694. (52/63)
2021-08-30 12:49:21 [INFO] Processing SRX4519321-SRR7657695. (53/63)
2021-08-30 12:49:28 [INFO] Processing SRX4519321-SRR7657696. (54/63)
2021-08-30 12:49:32 [INFO] Processing SRX4519329. (33/37)
2021-08-30 12:49:32 [INFO] Processing SRX4519329-SRR7657711. (55/63)
2021-08-30 12:49:36 [INFO] Processing SRX4551482. (34/37)
2021-08-30 12:49:36 [INFO] Processing SRX4551482-SRR7691915. (56/63)
2021-08-30 12:49:38 [INFO] Processing SRX6686157. (35/37)
2021-08-30 12:49:38 [INFO] Processing SRX6686157-SRR9937444. (57/63)
2021-08-30 12:49:42 [INFO] Processing SRX6686157-SRR9937445. (58/63)
2021-08-30 12:49:47 [INFO] Processing SRX4519320. (36/37)
2021-08-30 12:49:47 [INFO] Processing SRX4519320-SRR7657691. (59/63)
2021-08-30 12:49:53 [INFO] Processing SRX4519320-SRR7657693. (60/63)
2021-08-30 12:49:58 [INFO] Writing to disk...
2021-08-30 12:50:06 [INFO] Processing SRX4519320-SRR7657692. (61/63)
2021-08-30 12:50:12 [INFO] Processing SRX4519326. (37/37)
2021-08-30 12:50:12 [INFO] Processing SRX4519326-SRR7657705. (62/63)
2021-08-30 12:50:17 [INFO] Processing SRX4519326-SRR7657704. (63/63)
2021-08-30 12:50:21 [INFO] Writing to disk...
2021-08-30 12:50:23 [INFO] Finished.
2021-08-30 21:24:20 [INFO] Starting.
2021-08-30 21:24:20 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/
2021-08-30 21:24:20 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP156597/aggregate.hdf5
2021-08-30 21:24:20 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate.
2021-08-30 21:24:21 [INFO] Building aggregate for 500kbp_raw network.
2021-08-30 21:24:21 [INFO] Writing every 10 Runs.
2021-08-30 21:24:21 [INFO] Processing SRX6686163. (1/37)
2021-08-30 21:24:21 [INFO] Processing SRX6686163-SRR9937452. (1/63)
2021-08-30 21:24:22 [INFO] Processing SRX4519331. (2/37)
2021-08-30 21:24:22 [INFO] Processing SRX4519331-SRR7657714. (2/63)
2021-08-30 21:24:26 [INFO] Processing SRX4519331-SRR7657713. (3/63)
2021-08-30 21:24:29 [INFO] Processing SRX4519330. (3/37)
2021-08-30 21:24:29 [INFO] Processing SRX4519330-SRR7657712. (4/63)
2021-08-30 21:24:32 [INFO] Processing SRX6686159. (4/37)
2021-08-30 21:24:32 [INFO] Processing SRX6686159-SRR9937447. (5/63)
2021-08-30 21:24:34 [INFO] Processing SRX4519324. (5/37)
2021-08-30 21:24:34 [INFO] Processing SRX4519324-SRR7657701. (6/63)
2021-08-30 21:24:40 [INFO] Processing SRX4551479. (6/37)
2021-08-30 21:24:40 [INFO] Processing SRX4551479-SRR7691911. (7/63)
2021-08-30 21:24:44 [INFO] Processing SRX4551488. (7/37)
2021-08-30 21:24:44 [INFO] Processing SRX4551488-SRR7691924. (8/63)
2021-08-30 21:24:46 [INFO] Processing SRX4551488-SRR7691925. (9/63)
2021-08-30 21:24:48 [INFO] Processing SRX4551486. (8/37)
2021-08-30 21:24:48 [INFO] Processing SRX4551486-SRR7691921. (10/63)
2021-08-30 21:24:52 [INFO] Writing to disk...
2021-08-30 21:24:53 [INFO] Processing SRX4551486-SRR7691920. (11/63)
2021-08-30 21:24:56 [INFO] Processing SRX4519325. (9/37)
2021-08-30 21:24:56 [INFO] Processing SRX4519325-SRR7657702. (12/63)
2021-08-30 21:25:00 [INFO] Processing SRX4519325-SRR7657703. (13/63)
2021-08-30 21:25:03 [INFO] Processing SRX4519328. (10/37)
2021-08-30 21:25:03 [INFO] Processing SRX4519328-SRR7657709. (14/63)
2021-08-30 21:25:08 [INFO] Processing SRX4519328-SRR7657710. (15/63)
2021-08-30 21:25:13 [INFO] Processing SRX4551485. (11/37)
2021-08-30 21:25:13 [INFO] Processing SRX4551485-SRR7691919. (16/63)
2021-08-30 21:25:16 [INFO] Processing SRX4551485-SRR7691918. (17/63)
2021-08-30 21:25:19 [INFO] Processing SRX4551487. (12/37)
2021-08-30 21:25:19 [INFO] Processing SRX4551487-SRR7691922. (18/63)
2021-08-30 21:25:21 [INFO] Processing SRX4551487-SRR7691923. (19/63)
2021-08-30 21:25:23 [INFO] Processing SRX6686148. (13/37)
2021-08-30 21:25:23 [INFO] Processing SRX6686148-SRR9937441. (20/63)
2021-08-30 21:25:27 [INFO] Writing to disk...
2021-08-30 21:25:28 [INFO] Processing SRX6686148-SRR9937442. (21/63)
2021-08-30 21:25:32 [INFO] Processing SRX4551484. (14/37)
2021-08-30 21:25:32 [INFO] Processing SRX4551484-SRR7691917. (22/63)
2021-08-30 21:25:34 [INFO] Processing SRX4519322. (15/37)
2021-08-30 21:25:34 [INFO] Processing SRX4519322-SRR7657698. (23/63)
2021-08-30 21:25:39 [INFO] Processing SRX4519322-SRR7657697. (24/63)
2021-08-30 21:25:42 [INFO] Processing SRX6686162. (16/37)
2021-08-30 21:25:42 [INFO] Processing SRX6686162-SRR9937451. (25/63)
2021-08-30 21:25:44 [INFO] Processing SRX4519323. (17/37)
2021-08-30 21:25:44 [INFO] Processing SRX4519323-SRR7657700. (26/63)
2021-08-30 21:25:49 [INFO] Processing SRX4519323-SRR7657699. (27/63)
2021-08-30 21:25:52 [INFO] Processing SRX6686160. (18/37)
2021-08-30 21:25:52 [INFO] Processing SRX6686160-SRR9937448. (28/63)
2021-08-30 21:25:54 [INFO] Processing SRX4551491. (19/37)
2021-08-30 21:25:54 [INFO] Processing SRX4551491-SRR7691931. (29/63)
2021-08-30 21:25:57 [INFO] Processing SRX4551491-SRR7691929. (30/63)
2021-08-30 21:25:59 [INFO] Writing to disk...
2021-08-30 21:26:00 [INFO] Processing SRX4551491-SRR7691930. (31/63)
2021-08-30 21:26:02 [INFO] Processing SRX4551492. (20/37)
2021-08-30 21:26:02 [INFO] Processing SRX4551492-SRR7691932. (32/63)
2021-08-30 21:26:06 [INFO] Processing SRX4551492-SRR7691933. (33/63)
2021-08-30 21:26:10 [INFO] Processing SRX4551489. (21/37)
2021-08-30 21:26:10 [INFO] Processing SRX4551489-SRR7691926. (34/63)
2021-08-30 21:26:12 [INFO] Processing SRX4551489-SRR7691927. (35/63)
2021-08-30 21:26:15 [INFO] Processing SRX4519319. (22/37)
2021-08-30 21:26:15 [INFO] Processing SRX4519319-SRR7657689. (36/63)
2021-08-30 21:26:20 [INFO] Processing SRX4519319-SRR7657690. (37/63)
2021-08-30 21:26:24 [INFO] Processing SRX4551490. (23/37)
2021-08-30 21:26:24 [INFO] Processing SRX4551490-SRR7691928. (38/63)
2021-08-30 21:26:29 [INFO] Processing SRX6686161. (24/37)
2021-08-30 21:26:29 [INFO] Processing SRX6686161-SRR9937450. (39/63)
2021-08-30 21:26:31 [INFO] Processing SRX6686161-SRR9937449. (40/63)
2021-08-30 21:26:33 [INFO] Writing to disk...
2021-08-30 21:26:40 [INFO] Processing SRX6686149. (25/37)
2021-08-30 21:26:40 [INFO] Processing SRX6686149-SRR9937453. (41/63)
2021-08-30 21:26:42 [INFO] Processing SRX6686149-SRR9937454. (42/63)
2021-08-30 21:26:44 [INFO] Processing SRX4551481. (26/37)
2021-08-30 21:26:44 [INFO] Processing SRX4551481-SRR7691914. (43/63)
2021-08-30 21:26:46 [INFO] Processing SRX4551481-SRR7691913. (44/63)
2021-08-30 21:26:47 [INFO] Processing SRX4551483. (27/37)
2021-08-30 21:26:47 [INFO] Processing SRX4551483-SRR7691916. (45/63)
2021-08-30 21:26:49 [INFO] Processing SRX4519327. (28/37)
2021-08-30 21:26:49 [INFO] Processing SRX4519327-SRR7657706. (46/63)
2021-08-30 21:26:51 [INFO] Processing SRX4519327-SRR7657707. (47/63)
2021-08-30 21:26:54 [INFO] Processing SRX4519327-SRR7657708. (48/63)
2021-08-30 21:26:56 [INFO] Processing SRX6686158. (29/37)
2021-08-30 21:26:56 [INFO] Processing SRX6686158-SRR9937446. (49/63)
2021-08-30 21:26:59 [INFO] Processing SRX6686156. (30/37)
2021-08-30 21:26:59 [INFO] Processing SRX6686156-SRR9937443. (50/63)
2021-08-30 21:27:04 [INFO] Writing to disk...
2021-08-30 21:27:06 [INFO] Processing SRX4551480. (31/37)
2021-08-30 21:27:06 [INFO] Processing SRX4551480-SRR7691912. (51/63)
2021-08-30 21:27:08 [INFO] Processing SRX4519321. (32/37)
2021-08-30 21:27:08 [INFO] Processing SRX4519321-SRR7657694. (52/63)
2021-08-30 21:27:10 [INFO] Processing SRX4519321-SRR7657695. (53/63)
2021-08-30 21:27:17 [INFO] Processing SRX4519321-SRR7657696. (54/63)
2021-08-30 21:27:20 [INFO] Processing SRX4519329. (33/37)
2021-08-30 21:27:20 [INFO] Processing SRX4519329-SRR7657711. (55/63)
2021-08-30 21:27:23 [INFO] Processing SRX4551482. (34/37)
2021-08-30 21:27:23 [INFO] Processing SRX4551482-SRR7691915. (56/63)
2021-08-30 21:27:25 [INFO] Processing SRX6686157. (35/37)
2021-08-30 21:27:25 [INFO] Processing SRX6686157-SRR9937444. (57/63)
2021-08-30 21:27:28 [INFO] Processing SRX6686157-SRR9937445. (58/63)
2021-08-30 21:27:31 [INFO] Processing SRX4519320. (36/37)
2021-08-30 21:27:31 [INFO] Processing SRX4519320-SRR7657691. (59/63)
2021-08-30 21:27:36 [INFO] Processing SRX4519320-SRR7657693. (60/63)
2021-08-30 21:27:40 [INFO] Writing to disk...
2021-08-30 21:27:45 [INFO] Processing SRX4519320-SRR7657692. (61/63)
2021-08-30 21:27:50 [INFO] Processing SRX4519326. (37/37)
2021-08-30 21:27:50 [INFO] Processing SRX4519326-SRR7657705. (62/63)
2021-08-30 21:27:54 [INFO] Processing SRX4519326-SRR7657704. (63/63)
2021-08-30 21:27:59 [INFO] Writing to disk...
2021-08-30 21:28:00 [INFO] Finished.