2021-08-02 14:38:41 [INFO] Starting.
2021-08-02 14:38:41 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-02 14:38:41 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-02 14:38:41 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes
2021-08-02 14:38:41 [INFO] Using only main chromosomes: chr3R, chr3L, chr2R, chrX, chr2L, chrY, chr4, chrM
2021-08-02 14:38:41 [INFO] Building aggregate.
2021-08-02 14:38:41 [INFO] Writing every 10 Runs.
2021-08-02 14:38:41 [INFO] Processing SRX7988204. (1/13)
2021-08-02 14:38:41 [INFO] Processing SRX7988204-SRR11409492. (1/24)
2021-08-02 14:38:43 [INFO] Processing SRX7988204-SRR11409491. (2/24)
2021-08-02 14:38:44 [INFO] Processing SRX7988210. (2/13)
2021-08-02 14:38:44 [INFO] Processing SRX7988210-SRR11409501. (3/24)
2021-08-02 14:38:45 [INFO] Processing SRX7988210-SRR11409502. (4/24)
2021-08-02 14:38:48 [INFO] Processing SRX7988213. (3/13)
2021-08-02 14:38:48 [INFO] Processing SRX7988213-SRR11409507. (5/24)
2021-08-02 14:38:50 [INFO] Processing SRX7988213-SRR11409508. (6/24)
2021-08-02 14:38:52 [INFO] Processing SRX7988216. (4/13)
2021-08-02 14:38:52 [INFO] Processing SRX7988216-SRR11409513. (7/24)
2021-08-02 14:38:54 [INFO] Processing SRX7988216-SRR11409514. (8/24)
2021-08-02 14:38:56 [INFO] Processing SRX7988211. (5/13)
2021-08-02 14:38:56 [INFO] Processing SRX7988211-SRR11409504. (9/24)
2021-08-02 14:38:59 [INFO] Processing SRX7988211-SRR11409503. (10/24)
2021-08-02 14:39:00 [INFO] Writing to disk...
2021-08-02 14:39:01 [INFO] Processing SRX7988214. (6/13)
2021-08-02 14:39:01 [INFO] Processing SRX7988214-SRR11409509. (11/24)
2021-08-02 14:39:02 [INFO] Processing SRX7988214-SRR11409510. (12/24)
2021-08-02 14:39:04 [INFO] Processing SRX7988205. (7/13)
2021-08-02 14:39:04 [INFO] Processing SRX7988205-SRR11409493. (13/24)
2021-08-02 14:39:06 [INFO] Processing SRX7988207. (8/13)
2021-08-02 14:39:06 [INFO] Processing SRX7988207-SRR11409496. (14/24)
2021-08-02 14:39:07 [INFO] Processing SRX7988207-SRR11409495. (15/24)
2021-08-02 14:39:09 [INFO] Processing SRX7988208. (9/13)
2021-08-02 14:39:09 [INFO] Processing SRX7988208-SRR11409497. (16/24)
2021-08-02 14:39:11 [INFO] Processing SRX7988208-SRR11409498. (17/24)
2021-08-02 14:39:12 [INFO] Processing SRX7988212. (10/13)
2021-08-02 14:39:12 [INFO] Processing SRX7988212-SRR11409506. (18/24)
2021-08-02 14:39:15 [INFO] Processing SRX7988212-SRR11409505. (19/24)
2021-08-02 14:39:16 [INFO] Processing SRX7988209. (11/13)
2021-08-02 14:39:16 [INFO] Processing SRX7988209-SRR11409500. (20/24)
2021-08-02 14:39:19 [INFO] Writing to disk...
2021-08-02 14:39:20 [INFO] Processing SRX7988209-SRR11409499. (21/24)
2021-08-02 14:39:21 [INFO] Processing SRX7988206. (12/13)
2021-08-02 14:39:21 [INFO] Processing SRX7988206-SRR11409494. (22/24)
2021-08-02 14:39:22 [INFO] Processing SRX7988215. (13/13)
2021-08-02 14:39:22 [INFO] Processing SRX7988215-SRR11409511. (23/24)
2021-08-02 14:39:23 [INFO] Processing SRX7988215-SRR11409512. (24/24)
2021-08-02 14:39:26 [INFO] Writing to disk...
2021-08-02 14:39:26 [INFO] Finished.
2021-08-02 16:00:58 [INFO] Starting.
2021-08-02 16:00:58 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-02 16:00:58 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-02 16:00:58 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5.
2021-08-02 16:00:58 [INFO] Building aggregate.
2021-08-02 16:00:58 [INFO] Writing every 10 Runs.
2021-08-02 16:00:58 [INFO] Processing SRX7988204. (1/13)
2021-08-02 16:44:31 [INFO] Starting.
2021-08-02 16:44:31 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-02 16:44:31 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-02 16:44:31 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-02 16:44:31 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5.
2021-08-02 16:44:31 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5.
2021-08-02 16:44:31 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5.
2021-08-02 16:44:31 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5.
2021-08-02 16:44:31 [INFO] Building aggregate.
2021-08-02 16:44:31 [INFO] Writing every 10 Runs.
2021-08-02 16:44:31 [INFO] Processing SRX7988204. (1/13)
2021-08-02 16:56:36 [INFO] Starting.
2021-08-02 16:56:36 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-02 16:56:36 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-02 16:56:36 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-02 16:56:36 [INFO] Building aggregate.
2021-08-02 16:56:36 [INFO] Writing every 10 Runs.
2021-08-02 16:56:36 [INFO] Processing SRX7988204. (1/13)
2021-08-02 16:56:36 [INFO] Processing SRX7988204-SRR11409492. (1/24)
2021-08-02 16:56:45 [INFO] Processing SRX7988204-SRR11409491. (2/24)
2021-08-02 16:56:55 [INFO] Processing SRX7988210. (2/13)
2021-08-02 16:56:55 [INFO] Processing SRX7988210-SRR11409501. (3/24)
2021-08-02 16:57:04 [INFO] Processing SRX7988210-SRR11409502. (4/24)
2021-08-02 16:57:19 [INFO] Processing SRX7988213. (3/13)
2021-08-02 16:57:19 [INFO] Processing SRX7988213-SRR11409507. (5/24)
2021-08-02 16:57:28 [INFO] Processing SRX7988213-SRR11409508. (6/24)
2021-08-02 16:57:42 [INFO] Processing SRX7988216. (4/13)
2021-08-02 16:57:42 [INFO] Processing SRX7988216-SRR11409513. (7/24)
2021-08-02 16:57:53 [INFO] Processing SRX7988216-SRR11409514. (8/24)
2021-08-02 16:58:09 [INFO] Processing SRX7988211. (5/13)
2021-08-02 16:58:09 [INFO] Processing SRX7988211-SRR11409504. (9/24)
2021-08-02 16:58:26 [INFO] Processing SRX7988211-SRR11409503. (10/24)
2021-08-02 16:58:38 [INFO] Writing to disk...
2021-08-02 16:58:43 [INFO] Processing SRX7988214. (6/13)
2021-08-02 16:58:43 [INFO] Processing SRX7988214-SRR11409509. (11/24)
2021-08-02 16:58:55 [INFO] Processing SRX7988214-SRR11409510. (12/24)
2021-08-02 16:59:12 [INFO] Processing SRX7988205. (7/13)
2021-08-02 16:59:12 [INFO] Processing SRX7988205-SRR11409493. (13/24)
2021-08-02 16:59:27 [INFO] Processing SRX7988207. (8/13)
2021-08-02 16:59:27 [INFO] Processing SRX7988207-SRR11409496. (14/24)
2021-08-02 16:59:39 [INFO] Processing SRX7988207-SRR11409495. (15/24)
2021-08-02 16:59:54 [INFO] Processing SRX7988208. (9/13)
2021-08-02 16:59:54 [INFO] Processing SRX7988208-SRR11409497. (16/24)
2021-08-02 17:00:10 [INFO] Processing SRX7988208-SRR11409498. (17/24)
2021-08-02 17:00:23 [INFO] Processing SRX7988212. (10/13)
2021-08-02 17:00:23 [INFO] Processing SRX7988212-SRR11409506. (18/24)
2021-08-02 17:00:39 [INFO] Processing SRX7988212-SRR11409505. (19/24)
2021-08-02 17:00:52 [INFO] Processing SRX7988209. (11/13)
2021-08-02 17:00:52 [INFO] Processing SRX7988209-SRR11409500. (20/24)
2021-08-02 17:01:11 [INFO] Writing to disk...
2021-08-02 17:01:19 [INFO] Processing SRX7988209-SRR11409499. (21/24)
2021-08-02 17:01:31 [INFO] Processing SRX7988206. (12/13)
2021-08-02 17:01:31 [INFO] Processing SRX7988206-SRR11409494. (22/24)
2021-08-02 17:01:46 [INFO] Processing SRX7988215. (13/13)
2021-08-02 17:01:46 [INFO] Processing SRX7988215-SRR11409511. (23/24)
2021-08-02 17:01:58 [INFO] Processing SRX7988215-SRR11409512. (24/24)
2021-08-02 17:02:15 [INFO] Writing to disk...
2021-08-02 17:02:24 [INFO] Finished.
2021-08-03 14:01:06 [INFO] Starting.
2021-08-03 14:01:06 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-03 14:01:06 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-03 14:01:06 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:01:07 [INFO] Building aggregate for 40kbp_raw network.
2021-08-03 14:01:07 [INFO] Writing every 10 Runs.
2021-08-03 14:01:07 [INFO] Processing SRX7988204. (1/13)
2021-08-03 14:01:07 [INFO] Processing SRX7988204-SRR11409492. (1/24)
2021-08-03 14:01:08 [INFO] Processing SRX7988204-SRR11409491. (2/24)
2021-08-03 14:01:08 [INFO] Processing SRX7988210. (2/13)
2021-08-03 14:01:08 [INFO] Processing SRX7988210-SRR11409501. (3/24)
2021-08-03 14:01:09 [INFO] Processing SRX7988210-SRR11409502. (4/24)
2021-08-03 14:01:11 [INFO] Processing SRX7988213. (3/13)
2021-08-03 14:01:11 [INFO] Processing SRX7988213-SRR11409507. (5/24)
2021-08-03 14:01:12 [INFO] Processing SRX7988213-SRR11409508. (6/24)
2021-08-03 14:01:13 [INFO] Processing SRX7988216. (4/13)
2021-08-03 14:01:13 [INFO] Processing SRX7988216-SRR11409513. (7/24)
2021-08-03 14:01:14 [INFO] Processing SRX7988216-SRR11409514. (8/24)
2021-08-03 14:01:15 [INFO] Processing SRX7988211. (5/13)
2021-08-03 14:01:15 [INFO] Processing SRX7988211-SRR11409504. (9/24)
2021-08-03 14:01:17 [INFO] Processing SRX7988211-SRR11409503. (10/24)
2021-08-03 14:01:18 [INFO] Writing to disk...
2021-08-03 14:01:18 [INFO] Processing SRX7988214. (6/13)
2021-08-03 14:01:18 [INFO] Processing SRX7988214-SRR11409509. (11/24)
2021-08-03 14:01:19 [INFO] Processing SRX7988214-SRR11409510. (12/24)
2021-08-03 14:01:20 [INFO] Processing SRX7988205. (7/13)
2021-08-03 14:01:20 [INFO] Processing SRX7988205-SRR11409493. (13/24)
2021-08-03 14:01:21 [INFO] Processing SRX7988207. (8/13)
2021-08-03 14:01:21 [INFO] Processing SRX7988207-SRR11409496. (14/24)
2021-08-03 14:01:21 [INFO] Processing SRX7988207-SRR11409495. (15/24)
2021-08-03 14:01:22 [INFO] Processing SRX7988208. (9/13)
2021-08-03 14:01:22 [INFO] Processing SRX7988208-SRR11409497. (16/24)
2021-08-03 14:01:23 [INFO] Processing SRX7988208-SRR11409498. (17/24)
2021-08-03 14:01:24 [INFO] Processing SRX7988212. (10/13)
2021-08-03 14:01:24 [INFO] Processing SRX7988212-SRR11409506. (18/24)
2021-08-03 14:01:25 [INFO] Processing SRX7988212-SRR11409505. (19/24)
2021-08-03 14:01:25 [INFO] Processing SRX7988209. (11/13)
2021-08-03 14:01:25 [INFO] Processing SRX7988209-SRR11409500. (20/24)
2021-08-03 14:01:26 [INFO] Writing to disk...
2021-08-03 14:01:26 [INFO] Processing SRX7988209-SRR11409499. (21/24)
2021-08-03 14:01:27 [INFO] Processing SRX7988206. (12/13)
2021-08-03 14:01:27 [INFO] Processing SRX7988206-SRR11409494. (22/24)
2021-08-03 14:01:27 [INFO] Processing SRX7988215. (13/13)
2021-08-03 14:01:27 [INFO] Processing SRX7988215-SRR11409511. (23/24)
2021-08-03 14:01:28 [INFO] Processing SRX7988215-SRR11409512. (24/24)
2021-08-03 14:01:30 [INFO] Writing to disk...
2021-08-03 14:01:30 [INFO] Finished.
2021-08-03 14:03:17 [INFO] Starting.
2021-08-03 14:03:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-03 14:03:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-03 14:03:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:03:18 [INFO] Building aggregate for 25kbp_raw network.
2021-08-03 14:03:18 [INFO] Writing every 10 Runs.
2021-08-03 14:03:18 [INFO] Processing SRX7988204. (1/13)
2021-08-03 14:03:18 [INFO] Processing SRX7988204-SRR11409492. (1/24)
2021-08-03 14:03:19 [INFO] Processing SRX7988204-SRR11409491. (2/24)
2021-08-03 14:03:19 [INFO] Processing SRX7988210. (2/13)
2021-08-03 14:03:19 [INFO] Processing SRX7988210-SRR11409501. (3/24)
2021-08-03 14:03:20 [INFO] Processing SRX7988210-SRR11409502. (4/24)
2021-08-03 14:03:22 [INFO] Processing SRX7988213. (3/13)
2021-08-03 14:03:22 [INFO] Processing SRX7988213-SRR11409507. (5/24)
2021-08-03 14:03:22 [INFO] Processing SRX7988213-SRR11409508. (6/24)
2021-08-03 14:03:24 [INFO] Processing SRX7988216. (4/13)
2021-08-03 14:03:24 [INFO] Processing SRX7988216-SRR11409513. (7/24)
2021-08-03 14:03:25 [INFO] Processing SRX7988216-SRR11409514. (8/24)
2021-08-03 14:03:26 [INFO] Processing SRX7988211. (5/13)
2021-08-03 14:03:26 [INFO] Processing SRX7988211-SRR11409504. (9/24)
2021-08-03 14:03:27 [INFO] Processing SRX7988211-SRR11409503. (10/24)
2021-08-03 14:03:28 [INFO] Writing to disk...
2021-08-03 14:03:29 [INFO] Processing SRX7988214. (6/13)
2021-08-03 14:03:29 [INFO] Processing SRX7988214-SRR11409509. (11/24)
2021-08-03 14:03:29 [INFO] Processing SRX7988214-SRR11409510. (12/24)
2021-08-03 14:03:31 [INFO] Processing SRX7988205. (7/13)
2021-08-03 14:03:31 [INFO] Processing SRX7988205-SRR11409493. (13/24)
2021-08-03 14:03:31 [INFO] Processing SRX7988207. (8/13)
2021-08-03 14:03:31 [INFO] Processing SRX7988207-SRR11409496. (14/24)
2021-08-03 14:03:32 [INFO] Processing SRX7988207-SRR11409495. (15/24)
2021-08-03 14:03:33 [INFO] Processing SRX7988208. (9/13)
2021-08-03 14:03:33 [INFO] Processing SRX7988208-SRR11409497. (16/24)
2021-08-03 14:03:34 [INFO] Processing SRX7988208-SRR11409498. (17/24)
2021-08-03 14:03:35 [INFO] Processing SRX7988212. (10/13)
2021-08-03 14:03:35 [INFO] Processing SRX7988212-SRR11409506. (18/24)
2021-08-03 14:03:36 [INFO] Processing SRX7988212-SRR11409505. (19/24)
2021-08-03 14:03:37 [INFO] Processing SRX7988209. (11/13)
2021-08-03 14:03:37 [INFO] Processing SRX7988209-SRR11409500. (20/24)
2021-08-03 14:03:38 [INFO] Writing to disk...
2021-08-03 14:03:38 [INFO] Processing SRX7988209-SRR11409499. (21/24)
2021-08-03 14:03:39 [INFO] Processing SRX7988206. (12/13)
2021-08-03 14:03:39 [INFO] Processing SRX7988206-SRR11409494. (22/24)
2021-08-03 14:03:40 [INFO] Processing SRX7988215. (13/13)
2021-08-03 14:03:40 [INFO] Processing SRX7988215-SRR11409511. (23/24)
2021-08-03 14:03:40 [INFO] Processing SRX7988215-SRR11409512. (24/24)
2021-08-03 14:03:42 [INFO] Writing to disk...
2021-08-03 14:03:42 [INFO] Finished.
2021-08-03 14:05:45 [INFO] Starting.
2021-08-03 14:05:45 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-03 14:05:45 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-03 14:05:45 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:05:45 [INFO] Building aggregate for 5kbp_raw network.
2021-08-03 14:05:45 [INFO] Writing every 10 Runs.
2021-08-03 14:05:45 [INFO] Processing SRX7988204. (1/13)
2021-08-03 14:05:45 [INFO] Processing SRX7988204-SRR11409492. (1/24)
2021-08-03 14:05:47 [INFO] Processing SRX7988204-SRR11409491. (2/24)
2021-08-03 14:05:47 [INFO] Processing SRX7988210. (2/13)
2021-08-03 14:05:47 [INFO] Processing SRX7988210-SRR11409501. (3/24)
2021-08-03 14:05:48 [INFO] Processing SRX7988210-SRR11409502. (4/24)
2021-08-03 14:05:50 [INFO] Processing SRX7988213. (3/13)
2021-08-03 14:05:50 [INFO] Processing SRX7988213-SRR11409507. (5/24)
2021-08-03 14:05:51 [INFO] Processing SRX7988213-SRR11409508. (6/24)
2021-08-03 14:05:54 [INFO] Processing SRX7988216. (4/13)
2021-08-03 14:05:54 [INFO] Processing SRX7988216-SRR11409513. (7/24)
2021-08-03 14:05:55 [INFO] Processing SRX7988216-SRR11409514. (8/24)
2021-08-03 14:05:57 [INFO] Processing SRX7988211. (5/13)
2021-08-03 14:05:57 [INFO] Processing SRX7988211-SRR11409504. (9/24)
2021-08-03 14:05:59 [INFO] Processing SRX7988211-SRR11409503. (10/24)
2021-08-03 14:06:00 [INFO] Writing to disk...
2021-08-03 14:06:01 [INFO] Processing SRX7988214. (6/13)
2021-08-03 14:06:01 [INFO] Processing SRX7988214-SRR11409509. (11/24)
2021-08-03 14:06:02 [INFO] Processing SRX7988214-SRR11409510. (12/24)
2021-08-03 14:06:05 [INFO] Processing SRX7988205. (7/13)
2021-08-03 14:06:05 [INFO] Processing SRX7988205-SRR11409493. (13/24)
2021-08-03 14:06:06 [INFO] Processing SRX7988207. (8/13)
2021-08-03 14:06:06 [INFO] Processing SRX7988207-SRR11409496. (14/24)
2021-08-03 14:06:07 [INFO] Processing SRX7988207-SRR11409495. (15/24)
2021-08-03 14:06:09 [INFO] Processing SRX7988208. (9/13)
2021-08-03 14:06:09 [INFO] Processing SRX7988208-SRR11409497. (16/24)
2021-08-03 14:06:11 [INFO] Processing SRX7988208-SRR11409498. (17/24)
2021-08-03 14:06:12 [INFO] Processing SRX7988212. (10/13)
2021-08-03 14:06:12 [INFO] Processing SRX7988212-SRR11409506. (18/24)
2021-08-03 14:06:15 [INFO] Processing SRX7988212-SRR11409505. (19/24)
2021-08-03 14:06:16 [INFO] Processing SRX7988209. (11/13)
2021-08-03 14:06:16 [INFO] Processing SRX7988209-SRR11409500. (20/24)
2021-08-03 14:06:18 [INFO] Writing to disk...
2021-08-03 14:06:20 [INFO] Processing SRX7988209-SRR11409499. (21/24)
2021-08-03 14:06:21 [INFO] Processing SRX7988206. (12/13)
2021-08-03 14:06:21 [INFO] Processing SRX7988206-SRR11409494. (22/24)
2021-08-03 14:06:22 [INFO] Processing SRX7988215. (13/13)
2021-08-03 14:06:22 [INFO] Processing SRX7988215-SRR11409511. (23/24)
2021-08-03 14:06:23 [INFO] Processing SRX7988215-SRR11409512. (24/24)
2021-08-03 14:06:25 [INFO] Writing to disk...
2021-08-03 14:06:27 [INFO] Finished.
2021-08-03 14:10:56 [INFO] Starting.
2021-08-03 14:10:56 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-03 14:10:56 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-03 14:10:56 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:10:56 [INFO] Building aggregate for 1kbp_raw network.
2021-08-03 14:10:56 [INFO] Writing every 10 Runs.
2021-08-03 14:10:56 [INFO] Processing SRX7988204. (1/13)
2021-08-03 14:10:56 [INFO] Processing SRX7988204-SRR11409492. (1/24)
2021-08-03 14:10:59 [INFO] Processing SRX7988204-SRR11409491. (2/24)
2021-08-03 14:11:01 [INFO] Processing SRX7988210. (2/13)
2021-08-03 14:11:01 [INFO] Processing SRX7988210-SRR11409501. (3/24)
2021-08-03 14:11:02 [INFO] Processing SRX7988210-SRR11409502. (4/24)
2021-08-03 14:11:05 [INFO] Processing SRX7988213. (3/13)
2021-08-03 14:11:05 [INFO] Processing SRX7988213-SRR11409507. (5/24)
2021-08-03 14:11:06 [INFO] Processing SRX7988213-SRR11409508. (6/24)
2021-08-03 14:11:10 [INFO] Processing SRX7988216. (4/13)
2021-08-03 14:11:10 [INFO] Processing SRX7988216-SRR11409513. (7/24)
2021-08-03 14:11:12 [INFO] Processing SRX7988216-SRR11409514. (8/24)
2021-08-03 14:11:15 [INFO] Processing SRX7988211. (5/13)
2021-08-03 14:11:15 [INFO] Processing SRX7988211-SRR11409504. (9/24)
2021-08-03 14:11:18 [INFO] Processing SRX7988211-SRR11409503. (10/24)
2021-08-03 14:11:20 [INFO] Writing to disk...
2021-08-03 14:11:21 [INFO] Processing SRX7988214. (6/13)
2021-08-03 14:11:21 [INFO] Processing SRX7988214-SRR11409509. (11/24)
2021-08-03 14:11:23 [INFO] Processing SRX7988214-SRR11409510. (12/24)
2021-08-03 14:11:26 [INFO] Processing SRX7988205. (7/13)
2021-08-03 14:11:26 [INFO] Processing SRX7988205-SRR11409493. (13/24)
2021-08-03 14:11:29 [INFO] Processing SRX7988207. (8/13)
2021-08-03 14:11:29 [INFO] Processing SRX7988207-SRR11409496. (14/24)
2021-08-03 14:11:31 [INFO] Processing SRX7988207-SRR11409495. (15/24)
2021-08-03 14:11:34 [INFO] Processing SRX7988208. (9/13)
2021-08-03 14:11:34 [INFO] Processing SRX7988208-SRR11409497. (16/24)
2021-08-03 14:11:36 [INFO] Processing SRX7988208-SRR11409498. (17/24)
2021-08-03 14:11:38 [INFO] Processing SRX7988212. (10/13)
2021-08-03 14:11:38 [INFO] Processing SRX7988212-SRR11409506. (18/24)
2021-08-03 14:11:41 [INFO] Processing SRX7988212-SRR11409505. (19/24)
2021-08-03 14:11:43 [INFO] Processing SRX7988209. (11/13)
2021-08-03 14:11:43 [INFO] Processing SRX7988209-SRR11409500. (20/24)
2021-08-03 14:11:46 [INFO] Writing to disk...
2021-08-03 14:11:49 [INFO] Processing SRX7988209-SRR11409499. (21/24)
2021-08-03 14:11:50 [INFO] Processing SRX7988206. (12/13)
2021-08-03 14:11:50 [INFO] Processing SRX7988206-SRR11409494. (22/24)
2021-08-03 14:11:53 [INFO] Processing SRX7988215. (13/13)
2021-08-03 14:11:53 [INFO] Processing SRX7988215-SRR11409511. (23/24)
2021-08-03 14:11:54 [INFO] Processing SRX7988215-SRR11409512. (24/24)
2021-08-03 14:11:57 [INFO] Writing to disk...
2021-08-03 14:12:00 [INFO] Finished.
2021-08-17 10:17:26 [INFO] Starting.
2021-08-17 10:17:26 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-17 10:17:26 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-17 10:17:26 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:17:26 [INFO] Building aggregate for 100kbp_raw network.
2021-08-17 10:17:26 [INFO] Writing every 10 Runs.
2021-08-17 10:17:26 [INFO] Processing SRX7988204. (1/13)
2021-08-17 10:17:26 [INFO] Processing SRX7988204-SRR11409492. (1/24)
2021-08-17 10:32:25 [INFO] Starting.
2021-08-17 10:32:25 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-17 10:32:25 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-17 10:32:25 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:32:25 [INFO] Building aggregate for 100kbp_raw network.
2021-08-17 10:32:25 [INFO] Writing every 10 Runs.
2021-08-17 10:32:25 [INFO] Processing SRX7988204. (1/13)
2021-08-17 10:32:25 [INFO] Processing SRX7988204-SRR11409492. (1/24)
2021-08-17 10:32:25 [INFO] Processing SRX7988204-SRR11409491. (2/24)
2021-08-17 10:32:26 [INFO] Processing SRX7988210. (2/13)
2021-08-17 10:32:26 [INFO] Processing SRX7988210-SRR11409501. (3/24)
2021-08-17 10:32:26 [INFO] Processing SRX7988210-SRR11409502. (4/24)
2021-08-17 10:32:27 [INFO] Processing SRX7988213. (3/13)
2021-08-17 10:32:27 [INFO] Processing SRX7988213-SRR11409507. (5/24)
2021-08-17 10:32:28 [INFO] Processing SRX7988213-SRR11409508. (6/24)
2021-08-17 10:32:28 [INFO] Processing SRX7988216. (4/13)
2021-08-17 10:32:28 [INFO] Processing SRX7988216-SRR11409513. (7/24)
2021-08-17 10:32:29 [INFO] Processing SRX7988216-SRR11409514. (8/24)
2021-08-17 10:32:29 [INFO] Processing SRX7988211. (5/13)
2021-08-17 10:32:29 [INFO] Processing SRX7988211-SRR11409504. (9/24)
2021-08-17 10:32:30 [INFO] Processing SRX7988211-SRR11409503. (10/24)
2021-08-17 10:32:30 [INFO] Writing to disk...
2021-08-17 10:32:30 [INFO] Processing SRX7988214. (6/13)
2021-08-17 10:32:30 [INFO] Processing SRX7988214-SRR11409509. (11/24)
2021-08-17 10:32:31 [INFO] Processing SRX7988214-SRR11409510. (12/24)
2021-08-17 10:32:31 [INFO] Processing SRX7988205. (7/13)
2021-08-17 10:32:31 [INFO] Processing SRX7988205-SRR11409493. (13/24)
2021-08-17 10:32:31 [INFO] Processing SRX7988207. (8/13)
2021-08-17 10:32:31 [INFO] Processing SRX7988207-SRR11409496. (14/24)
2021-08-17 10:32:32 [INFO] Processing SRX7988207-SRR11409495. (15/24)
2021-08-17 10:32:32 [INFO] Processing SRX7988208. (9/13)
2021-08-17 10:32:32 [INFO] Processing SRX7988208-SRR11409497. (16/24)
2021-08-17 10:32:33 [INFO] Processing SRX7988208-SRR11409498. (17/24)
2021-08-17 10:32:34 [INFO] Processing SRX7988212. (10/13)
2021-08-17 10:32:34 [INFO] Processing SRX7988212-SRR11409506. (18/24)
2021-08-17 10:32:34 [INFO] Processing SRX7988212-SRR11409505. (19/24)
2021-08-17 10:32:35 [INFO] Processing SRX7988209. (11/13)
2021-08-17 10:32:35 [INFO] Processing SRX7988209-SRR11409500. (20/24)
2021-08-17 10:32:35 [INFO] Writing to disk...
2021-08-17 10:32:35 [INFO] Processing SRX7988209-SRR11409499. (21/24)
2021-08-17 10:32:36 [INFO] Processing SRX7988206. (12/13)
2021-08-17 10:32:36 [INFO] Processing SRX7988206-SRR11409494. (22/24)
2021-08-17 10:32:36 [INFO] Processing SRX7988215. (13/13)
2021-08-17 10:32:36 [INFO] Processing SRX7988215-SRR11409511. (23/24)
2021-08-17 10:32:37 [INFO] Processing SRX7988215-SRR11409512. (24/24)
2021-08-17 10:32:37 [INFO] Writing to disk...
2021-08-17 10:32:37 [INFO] Finished.
2021-08-17 10:38:54 [INFO] Starting.
2021-08-17 10:38:54 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-17 10:38:54 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-17 10:38:54 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:38:54 [INFO] Building aggregate for 250kbp_raw network.
2021-08-17 10:38:54 [INFO] Writing every 10 Runs.
2021-08-17 10:38:54 [INFO] Processing SRX7988204. (1/13)
2021-08-17 10:38:54 [INFO] Processing SRX7988204-SRR11409492. (1/24)
2021-08-17 10:38:54 [INFO] Processing SRX7988204-SRR11409491. (2/24)
2021-08-17 10:38:54 [INFO] Processing SRX7988210. (2/13)
2021-08-17 10:38:54 [INFO] Processing SRX7988210-SRR11409501. (3/24)
2021-08-17 10:38:55 [INFO] Processing SRX7988210-SRR11409502. (4/24)
2021-08-17 10:38:55 [INFO] Processing SRX7988213. (3/13)
2021-08-17 10:38:55 [INFO] Processing SRX7988213-SRR11409507. (5/24)
2021-08-17 10:38:55 [INFO] Processing SRX7988213-SRR11409508. (6/24)
2021-08-17 10:38:55 [INFO] Processing SRX7988216. (4/13)
2021-08-17 10:38:55 [INFO] Processing SRX7988216-SRR11409513. (7/24)
2021-08-17 10:38:56 [INFO] Processing SRX7988216-SRR11409514. (8/24)
2021-08-17 10:38:56 [INFO] Processing SRX7988211. (5/13)
2021-08-17 10:38:56 [INFO] Processing SRX7988211-SRR11409504. (9/24)
2021-08-17 10:38:56 [INFO] Processing SRX7988211-SRR11409503. (10/24)
2021-08-17 10:38:57 [INFO] Writing to disk...
2021-08-17 10:38:57 [INFO] Processing SRX7988214. (6/13)
2021-08-17 10:38:57 [INFO] Processing SRX7988214-SRR11409509. (11/24)
2021-08-17 10:38:57 [INFO] Processing SRX7988214-SRR11409510. (12/24)
2021-08-17 10:38:57 [INFO] Processing SRX7988205. (7/13)
2021-08-17 10:38:57 [INFO] Processing SRX7988205-SRR11409493. (13/24)
2021-08-17 10:38:58 [INFO] Processing SRX7988207. (8/13)
2021-08-17 10:38:58 [INFO] Processing SRX7988207-SRR11409496. (14/24)
2021-08-17 10:38:58 [INFO] Processing SRX7988207-SRR11409495. (15/24)
2021-08-17 10:38:58 [INFO] Processing SRX7988208. (9/13)
2021-08-17 10:38:58 [INFO] Processing SRX7988208-SRR11409497. (16/24)
2021-08-17 10:38:59 [INFO] Processing SRX7988208-SRR11409498. (17/24)
2021-08-17 10:38:59 [INFO] Processing SRX7988212. (10/13)
2021-08-17 10:38:59 [INFO] Processing SRX7988212-SRR11409506. (18/24)
2021-08-17 10:38:59 [INFO] Processing SRX7988212-SRR11409505. (19/24)
2021-08-17 10:39:00 [INFO] Processing SRX7988209. (11/13)
2021-08-17 10:39:00 [INFO] Processing SRX7988209-SRR11409500. (20/24)
2021-08-17 10:39:00 [INFO] Writing to disk...
2021-08-17 10:39:00 [INFO] Processing SRX7988209-SRR11409499. (21/24)
2021-08-17 10:39:00 [INFO] Processing SRX7988206. (12/13)
2021-08-17 10:39:00 [INFO] Processing SRX7988206-SRR11409494. (22/24)
2021-08-17 10:39:01 [INFO] Processing SRX7988215. (13/13)
2021-08-17 10:39:01 [INFO] Processing SRX7988215-SRR11409511. (23/24)
2021-08-17 10:39:01 [INFO] Processing SRX7988215-SRR11409512. (24/24)
2021-08-17 10:39:01 [INFO] Writing to disk...
2021-08-17 10:39:01 [INFO] Finished.
2021-08-17 10:40:20 [INFO] Starting.
2021-08-17 10:40:20 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/
2021-08-17 10:40:20 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP193880/aggregate.hdf5
2021-08-17 10:40:20 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:40:20 [INFO] Building aggregate for 500kbp_raw network.
2021-08-17 10:40:20 [INFO] Writing every 10 Runs.
2021-08-17 10:40:20 [INFO] Processing SRX7988204. (1/13)
2021-08-17 10:40:20 [INFO] Processing SRX7988204-SRR11409492. (1/24)
2021-08-17 10:40:20 [INFO] Processing SRX7988204-SRR11409491. (2/24)
2021-08-17 10:40:20 [INFO] Processing SRX7988210. (2/13)
2021-08-17 10:40:20 [INFO] Processing SRX7988210-SRR11409501. (3/24)
2021-08-17 10:40:20 [INFO] Processing SRX7988210-SRR11409502. (4/24)
2021-08-17 10:40:21 [INFO] Processing SRX7988213. (3/13)
2021-08-17 10:40:21 [INFO] Processing SRX7988213-SRR11409507. (5/24)
2021-08-17 10:40:21 [INFO] Processing SRX7988213-SRR11409508. (6/24)
2021-08-17 10:40:21 [INFO] Processing SRX7988216. (4/13)
2021-08-17 10:40:21 [INFO] Processing SRX7988216-SRR11409513. (7/24)
2021-08-17 10:40:21 [INFO] Processing SRX7988216-SRR11409514. (8/24)
2021-08-17 10:40:21 [INFO] Processing SRX7988211. (5/13)
2021-08-17 10:40:21 [INFO] Processing SRX7988211-SRR11409504. (9/24)
2021-08-17 10:40:22 [INFO] Processing SRX7988211-SRR11409503. (10/24)
2021-08-17 10:40:22 [INFO] Writing to disk...
2021-08-17 10:40:22 [INFO] Processing SRX7988214. (6/13)
2021-08-17 10:40:22 [INFO] Processing SRX7988214-SRR11409509. (11/24)
2021-08-17 10:40:22 [INFO] Processing SRX7988214-SRR11409510. (12/24)
2021-08-17 10:40:22 [INFO] Processing SRX7988205. (7/13)
2021-08-17 10:40:22 [INFO] Processing SRX7988205-SRR11409493. (13/24)
2021-08-17 10:40:22 [INFO] Processing SRX7988207. (8/13)
2021-08-17 10:40:22 [INFO] Processing SRX7988207-SRR11409496. (14/24)
2021-08-17 10:40:22 [INFO] Processing SRX7988207-SRR11409495. (15/24)
2021-08-17 10:40:23 [INFO] Processing SRX7988208. (9/13)
2021-08-17 10:40:23 [INFO] Processing SRX7988208-SRR11409497. (16/24)
2021-08-17 10:40:23 [INFO] Processing SRX7988208-SRR11409498. (17/24)
2021-08-17 10:40:23 [INFO] Processing SRX7988212. (10/13)
2021-08-17 10:40:23 [INFO] Processing SRX7988212-SRR11409506. (18/24)
2021-08-17 10:40:23 [INFO] Processing SRX7988212-SRR11409505. (19/24)
2021-08-17 10:40:23 [INFO] Processing SRX7988209. (11/13)
2021-08-17 10:40:23 [INFO] Processing SRX7988209-SRR11409500. (20/24)
2021-08-17 10:40:23 [INFO] Writing to disk...
2021-08-17 10:40:24 [INFO] Processing SRX7988209-SRR11409499. (21/24)
2021-08-17 10:40:24 [INFO] Processing SRX7988206. (12/13)
2021-08-17 10:40:24 [INFO] Processing SRX7988206-SRR11409494. (22/24)
2021-08-17 10:40:24 [INFO] Processing SRX7988215. (13/13)
2021-08-17 10:40:24 [INFO] Processing SRX7988215-SRR11409511. (23/24)
2021-08-17 10:40:24 [INFO] Processing SRX7988215-SRR11409512. (24/24)
2021-08-17 10:40:24 [INFO] Writing to disk...
2021-08-17 10:40:24 [INFO] Finished.