2021-08-02 14:38:41 [INFO] Starting.
2021-08-02 14:38:41 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-02 14:38:41 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-02 14:38:41 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes
2021-08-02 14:38:41 [INFO] Using only main chromosomes: chr3R, chr3L, chr2R, chrX, chr2L, chrY, chr4, chrM
2021-08-02 14:38:41 [INFO] Building aggregate.
2021-08-02 14:38:41 [INFO] Writing every 10 Runs.
2021-08-02 14:38:41 [INFO] Processing SRX764893. (1/17)
2021-08-02 14:38:41 [INFO] Processing SRX764893-SRR1658530. (1/17)
2021-08-02 14:38:44 [INFO] Processing SRX764890. (2/17)
2021-08-02 14:38:44 [INFO] Processing SRX764890-SRR1658527. (2/17)
2021-08-02 14:38:47 [INFO] Processing SRX764887. (3/17)
2021-08-02 14:38:47 [INFO] Processing SRX764887-SRR1658524. (3/17)
2021-08-02 14:38:52 [INFO] Processing SRX764896. (4/17)
2021-08-02 14:38:52 [INFO] Processing SRX764896-SRR1658533. (4/17)
2021-08-02 14:38:54 [INFO] Processing SRX764901. (5/17)
2021-08-02 14:38:54 [INFO] Processing SRX764901-SRR1658538. (5/17)
2021-08-02 14:38:58 [INFO] Processing SRX764899. (6/17)
2021-08-02 14:38:58 [INFO] Processing SRX764899-SRR1658536. (6/17)
2021-08-02 14:39:00 [INFO] Processing SRX764900. (7/17)
2021-08-02 14:39:00 [INFO] Processing SRX764900-SRR1658537. (7/17)
2021-08-02 14:39:04 [INFO] Processing SRX764891. (8/17)
2021-08-02 14:39:04 [INFO] Processing SRX764891-SRR1658528. (8/17)
2021-08-02 14:39:08 [INFO] Processing SRX764902. (9/17)
2021-08-02 14:39:08 [INFO] Processing SRX764902-SRR1658539. (9/17)
2021-08-02 14:39:11 [INFO] Processing SRX764892. (10/17)
2021-08-02 14:39:11 [INFO] Processing SRX764892-SRR1658529. (10/17)
2021-08-02 14:39:13 [INFO] Writing to disk...
2021-08-02 14:39:15 [INFO] Processing SRX764895. (11/17)
2021-08-02 14:39:15 [INFO] Processing SRX764895-SRR1658532. (11/17)
2021-08-02 14:39:17 [INFO] Processing SRX764889. (12/17)
2021-08-02 14:39:17 [INFO] Processing SRX764889-SRR1658526. (12/17)
2021-08-02 14:39:19 [INFO] Processing SRX764886. (13/17)
2021-08-02 14:39:19 [INFO] Processing SRX764886-SRR1658523. (13/17)
2021-08-02 14:39:23 [INFO] Processing SRX764897. (14/17)
2021-08-02 14:39:23 [INFO] Processing SRX764897-SRR1658534. (14/17)
2021-08-02 14:39:26 [INFO] Processing SRX764894. (15/17)
2021-08-02 14:39:26 [INFO] Processing SRX764894-SRR1658531. (15/17)
2021-08-02 14:39:28 [INFO] Processing SRX764888. (16/17)
2021-08-02 14:39:28 [INFO] Processing SRX764888-SRR1658525. (16/17)
2021-08-02 14:39:30 [INFO] Processing SRX764898. (17/17)
2021-08-02 14:39:30 [INFO] Processing SRX764898-SRR1658535. (17/17)
2021-08-02 14:39:33 [INFO] Writing to disk...
2021-08-02 14:39:39 [INFO] Finished.
2021-08-02 16:00:58 [INFO] Starting.
2021-08-02 16:00:58 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-02 16:00:58 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-02 16:00:58 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5.
2021-08-02 16:00:58 [ERROR] /aggregates/1kbp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5.
2021-08-02 16:00:58 [INFO] Building aggregate.
2021-08-02 16:00:58 [INFO] Writing every 10 Runs.
2021-08-02 16:00:58 [INFO] Processing SRX764893. (1/17)
2021-08-02 16:44:32 [INFO] Starting.
2021-08-02 16:44:32 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-02 16:44:32 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-02 16:44:32 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-02 16:44:32 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5.
2021-08-02 16:44:32 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5.
2021-08-02 16:44:32 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5.
2021-08-02 16:44:32 [ERROR] /aggregates/1bp_raw does not exist in /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5.
2021-08-02 16:44:32 [INFO] Building aggregate.
2021-08-02 16:44:32 [INFO] Writing every 10 Runs.
2021-08-02 16:44:32 [INFO] Processing SRX764893. (1/17)
2021-08-02 16:56:36 [INFO] Starting.
2021-08-02 16:56:36 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-02 16:56:36 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-02 16:56:36 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-02 16:56:36 [INFO] Building aggregate.
2021-08-02 16:56:36 [INFO] Writing every 10 Runs.
2021-08-02 16:56:36 [INFO] Processing SRX764893. (1/17)
2021-08-02 16:56:36 [INFO] Processing SRX764893-SRR1658530. (1/17)
2021-08-02 16:56:43 [INFO] Processing SRX764890. (2/17)
2021-08-02 16:56:43 [INFO] Processing SRX764890-SRR1658527. (2/17)
2021-08-02 16:56:59 [INFO] Processing SRX764887. (3/17)
2021-08-02 16:56:59 [INFO] Processing SRX764887-SRR1658524. (3/17)
2021-08-02 16:57:17 [INFO] Processing SRX764896. (4/17)
2021-08-02 16:57:17 [INFO] Processing SRX764896-SRR1658533. (4/17)
2021-08-02 16:57:28 [INFO] Processing SRX764901. (5/17)
2021-08-02 16:57:28 [INFO] Processing SRX764901-SRR1658538. (5/17)
2021-08-02 16:57:52 [INFO] Processing SRX764899. (6/17)
2021-08-02 16:57:52 [INFO] Processing SRX764899-SRR1658536. (6/17)
2021-08-02 16:58:06 [INFO] Processing SRX764900. (7/17)
2021-08-02 16:58:06 [INFO] Processing SRX764900-SRR1658537. (7/17)
2021-08-02 16:58:21 [INFO] Processing SRX764891. (8/17)
2021-08-02 16:58:21 [INFO] Processing SRX764891-SRR1658528. (8/17)
2021-08-02 16:58:46 [INFO] Processing SRX764902. (9/17)
2021-08-02 16:58:46 [INFO] Processing SRX764902-SRR1658539. (9/17)
2021-08-02 16:59:12 [INFO] Processing SRX764892. (10/17)
2021-08-02 16:59:12 [INFO] Processing SRX764892-SRR1658529. (10/17)
2021-08-02 16:59:27 [INFO] Writing to disk...
2021-08-02 16:59:36 [INFO] Processing SRX764895. (11/17)
2021-08-02 16:59:36 [INFO] Processing SRX764895-SRR1658532. (11/17)
2021-08-02 16:59:49 [INFO] Processing SRX764889. (12/17)
2021-08-02 16:59:49 [INFO] Processing SRX764889-SRR1658526. (12/17)
2021-08-02 17:00:04 [INFO] Processing SRX764886. (13/17)
2021-08-02 17:00:04 [INFO] Processing SRX764886-SRR1658523. (13/17)
2021-08-02 17:00:27 [INFO] Processing SRX764897. (14/17)
2021-08-02 17:00:27 [INFO] Processing SRX764897-SRR1658534. (14/17)
2021-08-02 17:00:43 [INFO] Processing SRX764894. (15/17)
2021-08-02 17:00:43 [INFO] Processing SRX764894-SRR1658531. (15/17)
2021-08-02 17:01:02 [INFO] Processing SRX764888. (16/17)
2021-08-02 17:01:02 [INFO] Processing SRX764888-SRR1658525. (16/17)
2021-08-02 17:01:18 [INFO] Processing SRX764898. (17/17)
2021-08-02 17:01:18 [INFO] Processing SRX764898-SRR1658535. (17/17)
2021-08-02 17:01:46 [INFO] Writing to disk...
2021-08-02 17:02:00 [INFO] Finished.
2021-08-03 14:01:06 [INFO] Starting.
2021-08-03 14:01:06 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-03 14:01:06 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-03 14:01:06 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:01:07 [INFO] Building aggregate for 40kbp_raw network.
2021-08-03 14:01:07 [INFO] Writing every 10 Runs.
2021-08-03 14:01:07 [INFO] Processing SRX764893. (1/17)
2021-08-03 14:01:07 [INFO] Processing SRX764893-SRR1658530. (1/17)
2021-08-03 14:01:08 [INFO] Processing SRX764890. (2/17)
2021-08-03 14:01:08 [INFO] Processing SRX764890-SRR1658527. (2/17)
2021-08-03 14:01:10 [INFO] Processing SRX764887. (3/17)
2021-08-03 14:01:10 [INFO] Processing SRX764887-SRR1658524. (3/17)
2021-08-03 14:01:12 [INFO] Processing SRX764896. (4/17)
2021-08-03 14:01:12 [INFO] Processing SRX764896-SRR1658533. (4/17)
2021-08-03 14:01:13 [INFO] Processing SRX764901. (5/17)
2021-08-03 14:01:13 [INFO] Processing SRX764901-SRR1658538. (5/17)
2021-08-03 14:01:15 [INFO] Processing SRX764899. (6/17)
2021-08-03 14:01:15 [INFO] Processing SRX764899-SRR1658536. (6/17)
2021-08-03 14:01:16 [INFO] Processing SRX764900. (7/17)
2021-08-03 14:01:16 [INFO] Processing SRX764900-SRR1658537. (7/17)
2021-08-03 14:01:17 [INFO] Processing SRX764891. (8/17)
2021-08-03 14:01:17 [INFO] Processing SRX764891-SRR1658528. (8/17)
2021-08-03 14:01:19 [INFO] Processing SRX764902. (9/17)
2021-08-03 14:01:19 [INFO] Processing SRX764902-SRR1658539. (9/17)
2021-08-03 14:01:20 [INFO] Processing SRX764892. (10/17)
2021-08-03 14:01:20 [INFO] Processing SRX764892-SRR1658529. (10/17)
2021-08-03 14:01:21 [INFO] Writing to disk...
2021-08-03 14:01:21 [INFO] Processing SRX764895. (11/17)
2021-08-03 14:01:21 [INFO] Processing SRX764895-SRR1658532. (11/17)
2021-08-03 14:01:22 [INFO] Processing SRX764889. (12/17)
2021-08-03 14:01:22 [INFO] Processing SRX764889-SRR1658526. (12/17)
2021-08-03 14:01:23 [INFO] Processing SRX764886. (13/17)
2021-08-03 14:01:23 [INFO] Processing SRX764886-SRR1658523. (13/17)
2021-08-03 14:01:25 [INFO] Processing SRX764897. (14/17)
2021-08-03 14:01:25 [INFO] Processing SRX764897-SRR1658534. (14/17)
2021-08-03 14:01:26 [INFO] Processing SRX764894. (15/17)
2021-08-03 14:01:26 [INFO] Processing SRX764894-SRR1658531. (15/17)
2021-08-03 14:01:27 [INFO] Processing SRX764888. (16/17)
2021-08-03 14:01:27 [INFO] Processing SRX764888-SRR1658525. (16/17)
2021-08-03 14:01:28 [INFO] Processing SRX764898. (17/17)
2021-08-03 14:01:28 [INFO] Processing SRX764898-SRR1658535. (17/17)
2021-08-03 14:01:30 [INFO] Writing to disk...
2021-08-03 14:01:30 [INFO] Finished.
2021-08-03 14:03:17 [INFO] Starting.
2021-08-03 14:03:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-03 14:03:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-03 14:03:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:03:17 [INFO] Building aggregate for 25kbp_raw network.
2021-08-03 14:03:17 [INFO] Writing every 10 Runs.
2021-08-03 14:03:17 [INFO] Processing SRX764893. (1/17)
2021-08-03 14:03:17 [INFO] Processing SRX764893-SRR1658530. (1/17)
2021-08-03 14:03:19 [INFO] Processing SRX764890. (2/17)
2021-08-03 14:03:19 [INFO] Processing SRX764890-SRR1658527. (2/17)
2021-08-03 14:03:22 [INFO] Processing SRX764887. (3/17)
2021-08-03 14:03:22 [INFO] Processing SRX764887-SRR1658524. (3/17)
2021-08-03 14:03:25 [INFO] Processing SRX764896. (4/17)
2021-08-03 14:03:25 [INFO] Processing SRX764896-SRR1658533. (4/17)
2021-08-03 14:03:26 [INFO] Processing SRX764901. (5/17)
2021-08-03 14:03:26 [INFO] Processing SRX764901-SRR1658538. (5/17)
2021-08-03 14:03:28 [INFO] Processing SRX764899. (6/17)
2021-08-03 14:03:28 [INFO] Processing SRX764899-SRR1658536. (6/17)
2021-08-03 14:03:30 [INFO] Processing SRX764900. (7/17)
2021-08-03 14:03:30 [INFO] Processing SRX764900-SRR1658537. (7/17)
2021-08-03 14:03:31 [INFO] Processing SRX764891. (8/17)
2021-08-03 14:03:31 [INFO] Processing SRX764891-SRR1658528. (8/17)
2021-08-03 14:03:33 [INFO] Processing SRX764902. (9/17)
2021-08-03 14:03:33 [INFO] Processing SRX764902-SRR1658539. (9/17)
2021-08-03 14:03:35 [INFO] Processing SRX764892. (10/17)
2021-08-03 14:03:35 [INFO] Processing SRX764892-SRR1658529. (10/17)
2021-08-03 14:03:36 [INFO] Writing to disk...
2021-08-03 14:03:37 [INFO] Processing SRX764895. (11/17)
2021-08-03 14:03:37 [INFO] Processing SRX764895-SRR1658532. (11/17)
2021-08-03 14:03:38 [INFO] Processing SRX764889. (12/17)
2021-08-03 14:03:38 [INFO] Processing SRX764889-SRR1658526. (12/17)
2021-08-03 14:03:39 [INFO] Processing SRX764886. (13/17)
2021-08-03 14:03:39 [INFO] Processing SRX764886-SRR1658523. (13/17)
2021-08-03 14:03:42 [INFO] Processing SRX764897. (14/17)
2021-08-03 14:03:42 [INFO] Processing SRX764897-SRR1658534. (14/17)
2021-08-03 14:03:44 [INFO] Processing SRX764894. (15/17)
2021-08-03 14:03:44 [INFO] Processing SRX764894-SRR1658531. (15/17)
2021-08-03 14:03:46 [INFO] Processing SRX764888. (16/17)
2021-08-03 14:03:46 [INFO] Processing SRX764888-SRR1658525. (16/17)
2021-08-03 14:03:47 [INFO] Processing SRX764898. (17/17)
2021-08-03 14:03:47 [INFO] Processing SRX764898-SRR1658535. (17/17)
2021-08-03 14:03:48 [INFO] Writing to disk...
2021-08-03 14:03:49 [INFO] Finished.
2021-08-03 14:05:45 [INFO] Starting.
2021-08-03 14:05:45 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-03 14:05:45 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-03 14:05:45 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:05:45 [INFO] Building aggregate for 5kbp_raw network.
2021-08-03 14:05:45 [INFO] Writing every 10 Runs.
2021-08-03 14:05:45 [INFO] Processing SRX764893. (1/17)
2021-08-03 14:05:45 [INFO] Processing SRX764893-SRR1658530. (1/17)
2021-08-03 14:05:47 [INFO] Processing SRX764890. (2/17)
2021-08-03 14:05:47 [INFO] Processing SRX764890-SRR1658527. (2/17)
2021-08-03 14:05:50 [INFO] Processing SRX764887. (3/17)
2021-08-03 14:05:50 [INFO] Processing SRX764887-SRR1658524. (3/17)
2021-08-03 14:05:56 [INFO] Processing SRX764896. (4/17)
2021-08-03 14:05:56 [INFO] Processing SRX764896-SRR1658533. (4/17)
2021-08-03 14:05:57 [INFO] Processing SRX764901. (5/17)
2021-08-03 14:05:57 [INFO] Processing SRX764901-SRR1658538. (5/17)
2021-08-03 14:06:02 [INFO] Processing SRX764899. (6/17)
2021-08-03 14:06:02 [INFO] Processing SRX764899-SRR1658536. (6/17)
2021-08-03 14:06:05 [INFO] Processing SRX764900. (7/17)
2021-08-03 14:06:05 [INFO] Processing SRX764900-SRR1658537. (7/17)
2021-08-03 14:06:08 [INFO] Processing SRX764891. (8/17)
2021-08-03 14:06:08 [INFO] Processing SRX764891-SRR1658528. (8/17)
2021-08-03 14:06:12 [INFO] Processing SRX764902. (9/17)
2021-08-03 14:06:12 [INFO] Processing SRX764902-SRR1658539. (9/17)
2021-08-03 14:06:16 [INFO] Processing SRX764892. (10/17)
2021-08-03 14:06:16 [INFO] Processing SRX764892-SRR1658529. (10/17)
2021-08-03 14:06:18 [INFO] Writing to disk...
2021-08-03 14:06:20 [INFO] Processing SRX764895. (11/17)
2021-08-03 14:06:20 [INFO] Processing SRX764895-SRR1658532. (11/17)
2021-08-03 14:06:22 [INFO] Processing SRX764889. (12/17)
2021-08-03 14:06:22 [INFO] Processing SRX764889-SRR1658526. (12/17)
2021-08-03 14:06:24 [INFO] Processing SRX764886. (13/17)
2021-08-03 14:06:24 [INFO] Processing SRX764886-SRR1658523. (13/17)
2021-08-03 14:06:30 [INFO] Processing SRX764897. (14/17)
2021-08-03 14:06:30 [INFO] Processing SRX764897-SRR1658534. (14/17)
2021-08-03 14:06:33 [INFO] Processing SRX764894. (15/17)
2021-08-03 14:06:33 [INFO] Processing SRX764894-SRR1658531. (15/17)
2021-08-03 14:06:36 [INFO] Processing SRX764888. (16/17)
2021-08-03 14:06:36 [INFO] Processing SRX764888-SRR1658525. (16/17)
2021-08-03 14:06:37 [INFO] Processing SRX764898. (17/17)
2021-08-03 14:06:37 [INFO] Processing SRX764898-SRR1658535. (17/17)
2021-08-03 14:06:40 [INFO] Writing to disk...
2021-08-03 14:06:42 [INFO] Finished.
2021-08-03 14:10:56 [INFO] Starting.
2021-08-03 14:10:56 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-03 14:10:56 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-03 14:10:56 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-03 14:10:56 [INFO] Building aggregate for 1kbp_raw network.
2021-08-03 14:10:56 [INFO] Writing every 10 Runs.
2021-08-03 14:10:56 [INFO] Processing SRX764893. (1/17)
2021-08-03 14:10:56 [INFO] Processing SRX764893-SRR1658530. (1/17)
2021-08-03 14:10:58 [INFO] Processing SRX764890. (2/17)
2021-08-03 14:10:58 [INFO] Processing SRX764890-SRR1658527. (2/17)
2021-08-03 14:11:03 [INFO] Processing SRX764887. (3/17)
2021-08-03 14:11:03 [INFO] Processing SRX764887-SRR1658524. (3/17)
2021-08-03 14:11:09 [INFO] Processing SRX764896. (4/17)
2021-08-03 14:11:09 [INFO] Processing SRX764896-SRR1658533. (4/17)
2021-08-03 14:11:12 [INFO] Processing SRX764901. (5/17)
2021-08-03 14:11:12 [INFO] Processing SRX764901-SRR1658538. (5/17)
2021-08-03 14:11:18 [INFO] Processing SRX764899. (6/17)
2021-08-03 14:11:18 [INFO] Processing SRX764899-SRR1658536. (6/17)
2021-08-03 14:11:21 [INFO] Processing SRX764900. (7/17)
2021-08-03 14:11:21 [INFO] Processing SRX764900-SRR1658537. (7/17)
2021-08-03 14:11:25 [INFO] Processing SRX764891. (8/17)
2021-08-03 14:11:25 [INFO] Processing SRX764891-SRR1658528. (8/17)
2021-08-03 14:11:32 [INFO] Processing SRX764902. (9/17)
2021-08-03 14:11:32 [INFO] Processing SRX764902-SRR1658539. (9/17)
2021-08-03 14:11:37 [INFO] Processing SRX764892. (10/17)
2021-08-03 14:11:37 [INFO] Processing SRX764892-SRR1658529. (10/17)
2021-08-03 14:11:41 [INFO] Writing to disk...
2021-08-03 14:11:45 [INFO] Processing SRX764895. (11/17)
2021-08-03 14:11:45 [INFO] Processing SRX764895-SRR1658532. (11/17)
2021-08-03 14:11:48 [INFO] Processing SRX764889. (12/17)
2021-08-03 14:11:48 [INFO] Processing SRX764889-SRR1658526. (12/17)
2021-08-03 14:11:52 [INFO] Processing SRX764886. (13/17)
2021-08-03 14:11:52 [INFO] Processing SRX764886-SRR1658523. (13/17)
2021-08-03 14:12:00 [INFO] Processing SRX764897. (14/17)
2021-08-03 14:12:00 [INFO] Processing SRX764897-SRR1658534. (14/17)
2021-08-03 14:12:03 [INFO] Processing SRX764894. (15/17)
2021-08-03 14:12:03 [INFO] Processing SRX764894-SRR1658531. (15/17)
2021-08-03 14:12:07 [INFO] Processing SRX764888. (16/17)
2021-08-03 14:12:07 [INFO] Processing SRX764888-SRR1658525. (16/17)
2021-08-03 14:12:11 [INFO] Processing SRX764898. (17/17)
2021-08-03 14:12:11 [INFO] Processing SRX764898-SRR1658535. (17/17)
2021-08-03 14:12:18 [INFO] Writing to disk...
2021-08-03 14:12:25 [INFO] Finished.
2021-08-17 10:17:26 [INFO] Starting.
2021-08-17 10:17:26 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-17 10:17:26 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-17 10:17:26 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:17:26 [INFO] Building aggregate for 100kbp_raw network.
2021-08-17 10:17:26 [INFO] Writing every 10 Runs.
2021-08-17 10:17:27 [INFO] Processing SRX764893. (1/17)
2021-08-17 10:17:27 [INFO] Processing SRX764893-SRR1658530. (1/17)
2021-08-17 10:32:25 [INFO] Starting.
2021-08-17 10:32:25 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-17 10:32:25 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-17 10:32:25 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:32:25 [INFO] Building aggregate for 100kbp_raw network.
2021-08-17 10:32:25 [INFO] Writing every 10 Runs.
2021-08-17 10:32:25 [INFO] Processing SRX764893. (1/17)
2021-08-17 10:32:25 [INFO] Processing SRX764893-SRR1658530. (1/17)
2021-08-17 10:32:26 [INFO] Processing SRX764890. (2/17)
2021-08-17 10:32:26 [INFO] Processing SRX764890-SRR1658527. (2/17)
2021-08-17 10:32:26 [INFO] Processing SRX764887. (3/17)
2021-08-17 10:32:26 [INFO] Processing SRX764887-SRR1658524. (3/17)
2021-08-17 10:32:27 [INFO] Processing SRX764896. (4/17)
2021-08-17 10:32:27 [INFO] Processing SRX764896-SRR1658533. (4/17)
2021-08-17 10:32:28 [INFO] Processing SRX764901. (5/17)
2021-08-17 10:32:28 [INFO] Processing SRX764901-SRR1658538. (5/17)
2021-08-17 10:32:29 [INFO] Processing SRX764899. (6/17)
2021-08-17 10:32:29 [INFO] Processing SRX764899-SRR1658536. (6/17)
2021-08-17 10:32:29 [INFO] Processing SRX764900. (7/17)
2021-08-17 10:32:29 [INFO] Processing SRX764900-SRR1658537. (7/17)
2021-08-17 10:32:30 [INFO] Processing SRX764891. (8/17)
2021-08-17 10:32:30 [INFO] Processing SRX764891-SRR1658528. (8/17)
2021-08-17 10:32:30 [INFO] Processing SRX764902. (9/17)
2021-08-17 10:32:30 [INFO] Processing SRX764902-SRR1658539. (9/17)
2021-08-17 10:32:31 [INFO] Processing SRX764892. (10/17)
2021-08-17 10:32:31 [INFO] Processing SRX764892-SRR1658529. (10/17)
2021-08-17 10:32:31 [INFO] Writing to disk...
2021-08-17 10:32:32 [INFO] Processing SRX764895. (11/17)
2021-08-17 10:32:32 [INFO] Processing SRX764895-SRR1658532. (11/17)
2021-08-17 10:32:32 [INFO] Processing SRX764889. (12/17)
2021-08-17 10:32:32 [INFO] Processing SRX764889-SRR1658526. (12/17)
2021-08-17 10:32:33 [INFO] Processing SRX764886. (13/17)
2021-08-17 10:32:33 [INFO] Processing SRX764886-SRR1658523. (13/17)
2021-08-17 10:32:34 [INFO] Processing SRX764897. (14/17)
2021-08-17 10:32:34 [INFO] Processing SRX764897-SRR1658534. (14/17)
2021-08-17 10:32:34 [INFO] Processing SRX764894. (15/17)
2021-08-17 10:32:34 [INFO] Processing SRX764894-SRR1658531. (15/17)
2021-08-17 10:32:35 [INFO] Processing SRX764888. (16/17)
2021-08-17 10:32:35 [INFO] Processing SRX764888-SRR1658525. (16/17)
2021-08-17 10:32:36 [INFO] Processing SRX764898. (17/17)
2021-08-17 10:32:36 [INFO] Processing SRX764898-SRR1658535. (17/17)
2021-08-17 10:32:36 [INFO] Writing to disk...
2021-08-17 10:32:36 [INFO] Finished.
2021-08-17 10:38:53 [INFO] Starting.
2021-08-17 10:38:53 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-17 10:38:53 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-17 10:38:53 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:38:53 [INFO] Building aggregate for 250kbp_raw network.
2021-08-17 10:38:53 [INFO] Writing every 10 Runs.
2021-08-17 10:38:53 [INFO] Processing SRX764893. (1/17)
2021-08-17 10:38:53 [INFO] Processing SRX764893-SRR1658530. (1/17)
2021-08-17 10:38:53 [INFO] Processing SRX764890. (2/17)
2021-08-17 10:38:53 [INFO] Processing SRX764890-SRR1658527. (2/17)
2021-08-17 10:38:53 [INFO] Processing SRX764887. (3/17)
2021-08-17 10:38:53 [INFO] Processing SRX764887-SRR1658524. (3/17)
2021-08-17 10:38:54 [INFO] Processing SRX764896. (4/17)
2021-08-17 10:38:54 [INFO] Processing SRX764896-SRR1658533. (4/17)
2021-08-17 10:38:54 [INFO] Processing SRX764901. (5/17)
2021-08-17 10:38:54 [INFO] Processing SRX764901-SRR1658538. (5/17)
2021-08-17 10:38:54 [INFO] Processing SRX764899. (6/17)
2021-08-17 10:38:54 [INFO] Processing SRX764899-SRR1658536. (6/17)
2021-08-17 10:38:54 [INFO] Processing SRX764900. (7/17)
2021-08-17 10:38:54 [INFO] Processing SRX764900-SRR1658537. (7/17)
2021-08-17 10:38:54 [INFO] Processing SRX764891. (8/17)
2021-08-17 10:38:54 [INFO] Processing SRX764891-SRR1658528. (8/17)
2021-08-17 10:38:55 [INFO] Processing SRX764902. (9/17)
2021-08-17 10:38:55 [INFO] Processing SRX764902-SRR1658539. (9/17)
2021-08-17 10:38:55 [INFO] Processing SRX764892. (10/17)
2021-08-17 10:38:55 [INFO] Processing SRX764892-SRR1658529. (10/17)
2021-08-17 10:38:55 [INFO] Writing to disk...
2021-08-17 10:38:55 [INFO] Processing SRX764895. (11/17)
2021-08-17 10:38:55 [INFO] Processing SRX764895-SRR1658532. (11/17)
2021-08-17 10:38:55 [INFO] Processing SRX764889. (12/17)
2021-08-17 10:38:55 [INFO] Processing SRX764889-SRR1658526. (12/17)
2021-08-17 10:38:55 [INFO] Processing SRX764886. (13/17)
2021-08-17 10:38:55 [INFO] Processing SRX764886-SRR1658523. (13/17)
2021-08-17 10:38:56 [INFO] Processing SRX764897. (14/17)
2021-08-17 10:38:56 [INFO] Processing SRX764897-SRR1658534. (14/17)
2021-08-17 10:38:56 [INFO] Processing SRX764894. (15/17)
2021-08-17 10:38:56 [INFO] Processing SRX764894-SRR1658531. (15/17)
2021-08-17 10:38:56 [INFO] Processing SRX764888. (16/17)
2021-08-17 10:38:56 [INFO] Processing SRX764888-SRR1658525. (16/17)
2021-08-17 10:38:56 [INFO] Processing SRX764898. (17/17)
2021-08-17 10:38:56 [INFO] Processing SRX764898-SRR1658535. (17/17)
2021-08-17 10:38:56 [INFO] Writing to disk...
2021-08-17 10:38:57 [INFO] Finished.
2021-08-17 10:40:20 [INFO] Starting.
2021-08-17 10:40:20 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/
2021-08-17 10:40:20 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_drosophila/SRP050096/aggregate.hdf5
2021-08-17 10:40:20 [WARNING] chroms=/grid/gillis/data/nfox/genomes/drosophila_melanogaster_6/dm6.chrom.sizes is ignored due to existing aggregate.
2021-08-17 10:40:20 [INFO] Building aggregate for 500kbp_raw network.
2021-08-17 10:40:20 [INFO] Writing every 10 Runs.
2021-08-17 10:40:20 [INFO] Processing SRX764893. (1/17)
2021-08-17 10:40:20 [INFO] Processing SRX764893-SRR1658530. (1/17)
2021-08-17 10:40:21 [INFO] Processing SRX764890. (2/17)
2021-08-17 10:40:21 [INFO] Processing SRX764890-SRR1658527. (2/17)
2021-08-17 10:40:21 [INFO] Processing SRX764887. (3/17)
2021-08-17 10:40:21 [INFO] Processing SRX764887-SRR1658524. (3/17)
2021-08-17 10:40:21 [INFO] Processing SRX764896. (4/17)
2021-08-17 10:40:21 [INFO] Processing SRX764896-SRR1658533. (4/17)
2021-08-17 10:40:21 [INFO] Processing SRX764901. (5/17)
2021-08-17 10:40:21 [INFO] Processing SRX764901-SRR1658538. (5/17)
2021-08-17 10:40:22 [INFO] Processing SRX764899. (6/17)
2021-08-17 10:40:22 [INFO] Processing SRX764899-SRR1658536. (6/17)
2021-08-17 10:40:22 [INFO] Processing SRX764900. (7/17)
2021-08-17 10:40:22 [INFO] Processing SRX764900-SRR1658537. (7/17)
2021-08-17 10:40:22 [INFO] Processing SRX764891. (8/17)
2021-08-17 10:40:22 [INFO] Processing SRX764891-SRR1658528. (8/17)
2021-08-17 10:40:22 [INFO] Processing SRX764902. (9/17)
2021-08-17 10:40:22 [INFO] Processing SRX764902-SRR1658539. (9/17)
2021-08-17 10:40:22 [INFO] Processing SRX764892. (10/17)
2021-08-17 10:40:22 [INFO] Processing SRX764892-SRR1658529. (10/17)
2021-08-17 10:40:23 [INFO] Writing to disk...
2021-08-17 10:40:23 [INFO] Processing SRX764895. (11/17)
2021-08-17 10:40:23 [INFO] Processing SRX764895-SRR1658532. (11/17)
2021-08-17 10:40:23 [INFO] Processing SRX764889. (12/17)
2021-08-17 10:40:23 [INFO] Processing SRX764889-SRR1658526. (12/17)
2021-08-17 10:40:23 [INFO] Processing SRX764886. (13/17)
2021-08-17 10:40:23 [INFO] Processing SRX764886-SRR1658523. (13/17)
2021-08-17 10:40:23 [INFO] Processing SRX764897. (14/17)
2021-08-17 10:40:23 [INFO] Processing SRX764897-SRR1658534. (14/17)
2021-08-17 10:40:23 [INFO] Processing SRX764894. (15/17)
2021-08-17 10:40:23 [INFO] Processing SRX764894-SRR1658531. (15/17)
2021-08-17 10:40:24 [INFO] Processing SRX764888. (16/17)
2021-08-17 10:40:24 [INFO] Processing SRX764888-SRR1658525. (16/17)
2021-08-17 10:40:24 [INFO] Processing SRX764898. (17/17)
2021-08-17 10:40:24 [INFO] Processing SRX764898-SRR1658535. (17/17)
2021-08-17 10:40:24 [INFO] Writing to disk...
2021-08-17 10:40:24 [INFO] Finished.