2021-08-02 14:38:41 [INFO] Starting.
2021-08-02 14:38:41 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-02 14:38:41 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-02 14:38:41 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes
2021-08-02 14:38:41 [INFO] Using only main chromosomes: chr3R, chr3L, chr2R, chrX, chr2L, chrY, chr4, chrM
2021-08-02 14:38:41 [INFO] Building aggregate.
2021-08-02 14:38:41 [INFO] Writing every 10 Runs.
2021-08-02 14:38:41 [INFO] Processing SRX4501959. (1/7)
2021-08-02 14:38:41 [INFO] Processing SRX4501959-SRR7638416. (1/8)
2021-08-02 14:38:42 [INFO] Processing SRX4501957. (2/7)
2021-08-02 14:38:42 [INFO] Processing SRX4501957-SRR7638414. (2/8)
2021-08-02 14:38:43 [INFO] Processing SRX5346168. (3/7)
2021-08-02 14:38:43 [INFO] Processing SRX5346168-SRR8544055. (3/8)
2021-08-02 14:38:45 [INFO] Processing SRX5346168-SRR8544056. (4/8)
2021-08-02 14:38:46 [INFO] Processing SRX4501960. (4/7)
2021-08-02 14:38:46 [INFO] Processing SRX4501960-SRR7638417. (5/8)
2021-08-02 14:38:47 [INFO] Processing SRX4501958. (5/7)
2021-08-02 14:38:47 [INFO] Processing SRX4501958-SRR7638415. (6/8)
2021-08-02 14:38:49 [INFO] Processing SRX4501961. (6/7)
2021-08-02 14:38:49 [INFO] Processing SRX4501961-SRR7638418. (7/8)
2021-08-02 14:38:51 [INFO] Processing SRX4501956. (7/7)
2021-08-02 14:38:51 [INFO] Processing SRX4501956-SRR7638413. (8/8)
2021-08-02 14:38:53 [INFO] Writing to disk...
2021-08-02 14:38:54 [INFO] Finished.
2021-08-02 16:00:58 [INFO] Starting.
2021-08-02 16:00:58 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-02 16:00:58 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-02 16:00:58 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5.
2021-08-02 16:00:58 [INFO] Building aggregate.
2021-08-02 16:00:58 [INFO] Writing every 10 Runs.
2021-08-02 16:00:58 [INFO] Processing SRX4501959. (1/7)
2021-08-02 16:44:31 [INFO] Starting.
2021-08-02 16:44:31 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-02 16:44:31 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-02 16:44:31 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-02 16:44:31 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5.
2021-08-02 16:44:31 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5.
2021-08-02 16:44:31 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5.
2021-08-02 16:44:31 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5.
2021-08-02 16:44:31 [INFO] Building aggregate.
2021-08-02 16:44:31 [INFO] Writing every 10 Runs.
2021-08-02 16:44:31 [INFO] Processing SRX4501959. (1/7)
2021-08-02 16:56:36 [INFO] Starting.
2021-08-02 16:56:36 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-02 16:56:36 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-02 16:56:36 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-02 16:56:36 [INFO] Building aggregate.
2021-08-02 16:56:36 [INFO] Writing every 10 Runs.
2021-08-02 16:56:36 [INFO] Processing SRX4501959. (1/7)
2021-08-02 16:56:36 [INFO] Processing SRX4501959-SRR7638416. (1/8)
2021-08-02 16:56:41 [INFO] Processing SRX4501957. (2/7)
2021-08-02 16:56:41 [INFO] Processing SRX4501957-SRR7638414. (2/8)
2021-08-02 16:56:50 [INFO] Processing SRX5346168. (3/7)
2021-08-02 16:56:50 [INFO] Processing SRX5346168-SRR8544055. (3/8)
2021-08-02 16:57:01 [INFO] Processing SRX5346168-SRR8544056. (4/8)
2021-08-02 16:57:12 [INFO] Processing SRX4501960. (4/7)
2021-08-02 16:57:12 [INFO] Processing SRX4501960-SRR7638417. (5/8)
2021-08-02 16:57:22 [INFO] Processing SRX4501958. (5/7)
2021-08-02 16:57:22 [INFO] Processing SRX4501958-SRR7638415. (6/8)
2021-08-02 16:57:33 [INFO] Processing SRX4501961. (6/7)
2021-08-02 16:57:33 [INFO] Processing SRX4501961-SRR7638418. (7/8)
2021-08-02 16:57:46 [INFO] Processing SRX4501956. (7/7)
2021-08-02 16:57:46 [INFO] Processing SRX4501956-SRR7638413. (8/8)
2021-08-02 16:58:03 [INFO] Writing to disk...
2021-08-02 16:58:06 [INFO] Finished.
2021-08-03 14:01:07 [INFO] Starting.
2021-08-03 14:01:07 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-03 14:01:07 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-03 14:01:07 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:01:07 [INFO] Building aggregate for 40kbp_raw network.
2021-08-03 14:01:07 [INFO] Writing every 10 Runs.
2021-08-03 14:01:07 [INFO] Processing SRX4501959. (1/7)
2021-08-03 14:01:07 [INFO] Processing SRX4501959-SRR7638416. (1/8)
2021-08-03 14:01:08 [INFO] Processing SRX4501957. (2/7)
2021-08-03 14:01:08 [INFO] Processing SRX4501957-SRR7638414. (2/8)
2021-08-03 14:01:08 [INFO] Processing SRX5346168. (3/7)
2021-08-03 14:01:08 [INFO] Processing SRX5346168-SRR8544055. (3/8)
2021-08-03 14:01:09 [INFO] Processing SRX5346168-SRR8544056. (4/8)
2021-08-03 14:01:10 [INFO] Processing SRX4501960. (4/7)
2021-08-03 14:01:10 [INFO] Processing SRX4501960-SRR7638417. (5/8)
2021-08-03 14:01:11 [INFO] Processing SRX4501958. (5/7)
2021-08-03 14:01:11 [INFO] Processing SRX4501958-SRR7638415. (6/8)
2021-08-03 14:01:12 [INFO] Processing SRX4501961. (6/7)
2021-08-03 14:01:12 [INFO] Processing SRX4501961-SRR7638418. (7/8)
2021-08-03 14:01:13 [INFO] Processing SRX4501956. (7/7)
2021-08-03 14:01:13 [INFO] Processing SRX4501956-SRR7638413. (8/8)
2021-08-03 14:01:14 [INFO] Writing to disk...
2021-08-03 14:01:14 [INFO] Finished.
2021-08-03 14:03:17 [INFO] Starting.
2021-08-03 14:03:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-03 14:03:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-03 14:03:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:03:17 [INFO] Building aggregate for 25kbp_raw network.
2021-08-03 14:03:17 [INFO] Writing every 10 Runs.
2021-08-03 14:03:17 [INFO] Processing SRX4501959. (1/7)
2021-08-03 14:03:17 [INFO] Processing SRX4501959-SRR7638416. (1/8)
2021-08-03 14:03:18 [INFO] Processing SRX4501957. (2/7)
2021-08-03 14:03:18 [INFO] Processing SRX4501957-SRR7638414. (2/8)
2021-08-03 14:03:19 [INFO] Processing SRX5346168. (3/7)
2021-08-03 14:03:19 [INFO] Processing SRX5346168-SRR8544055. (3/8)
2021-08-03 14:03:20 [INFO] Processing SRX5346168-SRR8544056. (4/8)
2021-08-03 14:03:21 [INFO] Processing SRX4501960. (4/7)
2021-08-03 14:03:21 [INFO] Processing SRX4501960-SRR7638417. (5/8)
2021-08-03 14:03:21 [INFO] Processing SRX4501958. (5/7)
2021-08-03 14:03:21 [INFO] Processing SRX4501958-SRR7638415. (6/8)
2021-08-03 14:03:22 [INFO] Processing SRX4501961. (6/7)
2021-08-03 14:03:22 [INFO] Processing SRX4501961-SRR7638418. (7/8)
2021-08-03 14:03:24 [INFO] Processing SRX4501956. (7/7)
2021-08-03 14:03:24 [INFO] Processing SRX4501956-SRR7638413. (8/8)
2021-08-03 14:03:25 [INFO] Writing to disk...
2021-08-03 14:03:25 [INFO] Finished.
2021-08-03 14:05:45 [INFO] Starting.
2021-08-03 14:05:45 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-03 14:05:45 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-03 14:05:45 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:05:45 [INFO] Building aggregate for 5kbp_raw network.
2021-08-03 14:05:45 [INFO] Writing every 10 Runs.
2021-08-03 14:05:45 [INFO] Processing SRX4501959. (1/7)
2021-08-03 14:05:45 [INFO] Processing SRX4501959-SRR7638416. (1/8)
2021-08-03 14:05:46 [INFO] Processing SRX4501957. (2/7)
2021-08-03 14:05:46 [INFO] Processing SRX4501957-SRR7638414. (2/8)
2021-08-03 14:05:47 [INFO] Processing SRX5346168. (3/7)
2021-08-03 14:05:47 [INFO] Processing SRX5346168-SRR8544055. (3/8)
2021-08-03 14:05:49 [INFO] Processing SRX5346168-SRR8544056. (4/8)
2021-08-03 14:05:50 [INFO] Processing SRX4501960. (4/7)
2021-08-03 14:05:50 [INFO] Processing SRX4501960-SRR7638417. (5/8)
2021-08-03 14:05:51 [INFO] Processing SRX4501958. (5/7)
2021-08-03 14:05:51 [INFO] Processing SRX4501958-SRR7638415. (6/8)
2021-08-03 14:05:53 [INFO] Processing SRX4501961. (6/7)
2021-08-03 14:05:53 [INFO] Processing SRX4501961-SRR7638418. (7/8)
2021-08-03 14:05:56 [INFO] Processing SRX4501956. (7/7)
2021-08-03 14:05:56 [INFO] Processing SRX4501956-SRR7638413. (8/8)
2021-08-03 14:05:58 [INFO] Writing to disk...
2021-08-03 14:05:59 [INFO] Finished.
2021-08-03 14:10:56 [INFO] Starting.
2021-08-03 14:10:56 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-03 14:10:56 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-03 14:10:56 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:10:56 [INFO] Building aggregate for 1kbp_raw network.
2021-08-03 14:10:56 [INFO] Writing every 10 Runs.
2021-08-03 14:10:56 [INFO] Processing SRX4501959. (1/7)
2021-08-03 14:10:56 [INFO] Processing SRX4501959-SRR7638416. (1/8)
2021-08-03 14:10:58 [INFO] Processing SRX4501957. (2/7)
2021-08-03 14:10:58 [INFO] Processing SRX4501957-SRR7638414. (2/8)
2021-08-03 14:10:59 [INFO] Processing SRX5346168. (3/7)
2021-08-03 14:10:59 [INFO] Processing SRX5346168-SRR8544055. (3/8)
2021-08-03 14:11:00 [INFO] Processing SRX5346168-SRR8544056. (4/8)
2021-08-03 14:11:03 [INFO] Processing SRX4501960. (4/7)
2021-08-03 14:11:03 [INFO] Processing SRX4501960-SRR7638417. (5/8)
2021-08-03 14:11:03 [INFO] Processing SRX4501958. (5/7)
2021-08-03 14:11:03 [INFO] Processing SRX4501958-SRR7638415. (6/8)
2021-08-03 14:11:06 [INFO] Processing SRX4501961. (6/7)
2021-08-03 14:11:06 [INFO] Processing SRX4501961-SRR7638418. (7/8)
2021-08-03 14:11:08 [INFO] Processing SRX4501956. (7/7)
2021-08-03 14:11:08 [INFO] Processing SRX4501956-SRR7638413. (8/8)
2021-08-03 14:11:11 [INFO] Writing to disk...
2021-08-03 14:11:13 [INFO] Finished.
2021-08-17 10:17:26 [INFO] Starting.
2021-08-17 10:17:26 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-17 10:17:26 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-17 10:17:26 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:17:26 [INFO] Building aggregate for 100kbp_raw network.
2021-08-17 10:17:26 [INFO] Writing every 10 Runs.
2021-08-17 10:17:26 [INFO] Processing SRX4501959. (1/7)
2021-08-17 10:17:26 [INFO] Processing SRX4501959-SRR7638416. (1/8)
2021-08-17 10:32:24 [INFO] Starting.
2021-08-17 10:32:24 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-17 10:32:24 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-17 10:32:24 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:32:24 [INFO] Building aggregate for 100kbp_raw network.
2021-08-17 10:32:24 [INFO] Writing every 10 Runs.
2021-08-17 10:32:24 [INFO] Processing SRX4501959. (1/7)
2021-08-17 10:32:24 [INFO] Processing SRX4501959-SRR7638416. (1/8)
2021-08-17 10:32:25 [INFO] Processing SRX4501957. (2/7)
2021-08-17 10:32:25 [INFO] Processing SRX4501957-SRR7638414. (2/8)
2021-08-17 10:32:25 [INFO] Processing SRX5346168. (3/7)
2021-08-17 10:32:25 [INFO] Processing SRX5346168-SRR8544055. (3/8)
2021-08-17 10:32:26 [INFO] Processing SRX5346168-SRR8544056. (4/8)
2021-08-17 10:32:26 [INFO] Processing SRX4501960. (4/7)
2021-08-17 10:32:26 [INFO] Processing SRX4501960-SRR7638417. (5/8)
2021-08-17 10:32:26 [INFO] Processing SRX4501958. (5/7)
2021-08-17 10:32:26 [INFO] Processing SRX4501958-SRR7638415. (6/8)
2021-08-17 10:32:27 [INFO] Processing SRX4501961. (6/7)
2021-08-17 10:32:27 [INFO] Processing SRX4501961-SRR7638418. (7/8)
2021-08-17 10:32:28 [INFO] Processing SRX4501956. (7/7)
2021-08-17 10:32:28 [INFO] Processing SRX4501956-SRR7638413. (8/8)
2021-08-17 10:32:28 [INFO] Writing to disk...
2021-08-17 10:32:28 [INFO] Finished.
2021-08-17 10:38:52 [INFO] Starting.
2021-08-17 10:38:52 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-17 10:38:52 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-17 10:38:52 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:38:53 [INFO] Building aggregate for 250kbp_raw network.
2021-08-17 10:38:53 [INFO] Writing every 10 Runs.
2021-08-17 10:38:53 [INFO] Processing SRX4501959. (1/7)
2021-08-17 10:38:53 [INFO] Processing SRX4501959-SRR7638416. (1/8)
2021-08-17 10:38:53 [INFO] Processing SRX4501957. (2/7)
2021-08-17 10:38:53 [INFO] Processing SRX4501957-SRR7638414. (2/8)
2021-08-17 10:38:53 [INFO] Processing SRX5346168. (3/7)
2021-08-17 10:38:53 [INFO] Processing SRX5346168-SRR8544055. (3/8)
2021-08-17 10:38:53 [INFO] Processing SRX5346168-SRR8544056. (4/8)
2021-08-17 10:38:54 [INFO] Processing SRX4501960. (4/7)
2021-08-17 10:38:54 [INFO] Processing SRX4501960-SRR7638417. (5/8)
2021-08-17 10:38:54 [INFO] Processing SRX4501958. (5/7)
2021-08-17 10:38:54 [INFO] Processing SRX4501958-SRR7638415. (6/8)
2021-08-17 10:38:54 [INFO] Processing SRX4501961. (6/7)
2021-08-17 10:38:54 [INFO] Processing SRX4501961-SRR7638418. (7/8)
2021-08-17 10:38:55 [INFO] Processing SRX4501956. (7/7)
2021-08-17 10:38:55 [INFO] Processing SRX4501956-SRR7638413. (8/8)
2021-08-17 10:38:55 [INFO] Writing to disk...
2021-08-17 10:38:55 [INFO] Finished.
2021-08-17 10:40:21 [INFO] Starting.
2021-08-17 10:40:21 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/
2021-08-17 10:40:21 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP156199/aggregate.hdf5
2021-08-17 10:40:21 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:40:21 [INFO] Building aggregate for 500kbp_raw network.
2021-08-17 10:40:21 [INFO] Writing every 10 Runs.
2021-08-17 10:40:21 [INFO] Processing SRX4501959. (1/7)
2021-08-17 10:40:21 [INFO] Processing SRX4501959-SRR7638416. (1/8)
2021-08-17 10:40:21 [INFO] Processing SRX4501957. (2/7)
2021-08-17 10:40:21 [INFO] Processing SRX4501957-SRR7638414. (2/8)
2021-08-17 10:40:22 [INFO] Processing SRX5346168. (3/7)
2021-08-17 10:40:22 [INFO] Processing SRX5346168-SRR8544055. (3/8)
2021-08-17 10:40:22 [INFO] Processing SRX5346168-SRR8544056. (4/8)
2021-08-17 10:40:22 [INFO] Processing SRX4501960. (4/7)
2021-08-17 10:40:22 [INFO] Processing SRX4501960-SRR7638417. (5/8)
2021-08-17 10:40:22 [INFO] Processing SRX4501958. (5/7)
2021-08-17 10:40:22 [INFO] Processing SRX4501958-SRR7638415. (6/8)
2021-08-17 10:40:22 [INFO] Processing SRX4501961. (6/7)
2021-08-17 10:40:22 [INFO] Processing SRX4501961-SRR7638418. (7/8)
2021-08-17 10:40:22 [INFO] Processing SRX4501956. (7/7)
2021-08-17 10:40:22 [INFO] Processing SRX4501956-SRR7638413. (8/8)
2021-08-17 10:40:23 [INFO] Writing to disk...
2021-08-17 10:40:23 [INFO] Finished.