2021-06-10 03:24:54 [INFO] Starting.
2021-06-10 03:24:54 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/
2021-06-10 03:24:54 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/aggregate.hdf5
2021-06-10 03:24:54 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 03:24:54 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 03:24:55 [INFO] Building aggregate.
2021-06-10 03:24:55 [INFO] Writing every 10 Runs.
2021-06-10 03:24:55 [INFO] Processing SRX2577856. (1/10)
2021-06-10 03:24:55 [INFO] Processing SRX2577856-SRR5273873. (1/10)
2021-06-10 03:24:59 [INFO] Processing SRX2577857. (2/10)
2021-06-10 03:24:59 [INFO] Processing SRX2577857-SRR5273874. (2/10)
2021-06-10 03:25:01 [INFO] Processing SRX2577852. (3/10)
2021-06-10 03:25:01 [INFO] Processing SRX2577852-SRR5273869. (3/10)
2021-06-10 03:25:02 [INFO] Processing SRX2577860. (4/10)
2021-06-10 03:25:02 [INFO] Processing SRX2577860-SRR5273877. (4/10)
2021-06-10 03:25:04 [INFO] Processing SRX2577858. (5/10)
2021-06-10 03:25:04 [INFO] Processing SRX2577858-SRR5273875. (5/10)
2021-06-10 03:25:06 [INFO] Processing SRX2577859. (6/10)
2021-06-10 03:25:06 [INFO] Processing SRX2577859-SRR5273876. (6/10)
2021-06-10 03:25:07 [INFO] Processing SRX2577854. (7/10)
2021-06-10 03:25:07 [INFO] Processing SRX2577854-SRR5273871. (7/10)
2021-06-10 03:25:11 [INFO] Processing SRX2577855. (8/10)
2021-06-10 03:25:11 [INFO] Processing SRX2577855-SRR5273872. (8/10)
2021-06-10 03:25:12 [INFO] Processing SRX2577851. (9/10)
2021-06-10 03:25:12 [INFO] Processing SRX2577851-SRR5273868. (9/10)
2021-06-10 03:25:15 [INFO] Processing SRX2577853. (10/10)
2021-06-10 03:25:15 [INFO] Processing SRX2577853-SRR5273870. (10/10)
2021-06-10 03:25:27 [INFO] Writing to disk...
2021-06-10 03:25:29 [INFO] Finished.
2021-08-02 17:08:55 [INFO] Starting.
2021-08-02 17:08:55 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/
2021-08-02 17:08:56 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/aggregate.hdf5
2021-08-02 17:08:56 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-02 17:08:56 [INFO] Building aggregate for 1bp_raw network.
2021-08-02 17:08:56 [INFO] Writing every 10 Runs.
2021-08-02 17:08:56 [INFO] Processing SRX2577856. (1/10)
2021-08-02 17:08:56 [INFO] Processing SRX2577856-SRR5273873. (1/10)
2021-08-02 17:48:01 [INFO] Processing SRX2577857. (2/10)
2021-08-02 17:48:01 [INFO] Processing SRX2577857-SRR5273874. (2/10)
2021-08-02 18:05:03 [INFO] Processing SRX2577852. (3/10)
2021-08-02 18:05:03 [INFO] Processing SRX2577852-SRR5273869. (3/10)
2021-08-02 18:12:14 [INFO] Processing SRX2577860. (4/10)
2021-08-02 18:12:14 [INFO] Processing SRX2577860-SRR5273877. (4/10)
2021-08-02 18:18:28 [INFO] Processing SRX2577858. (5/10)
2021-08-02 18:18:28 [INFO] Processing SRX2577858-SRR5273875. (5/10)
2021-08-02 18:24:50 [INFO] Processing SRX2577859. (6/10)
2021-08-02 18:24:50 [INFO] Processing SRX2577859-SRR5273876. (6/10)
2021-08-02 18:31:04 [INFO] Processing SRX2577854. (7/10)
2021-08-02 18:31:04 [INFO] Processing SRX2577854-SRR5273871. (7/10)
2021-08-02 18:37:53 [INFO] Processing SRX2577855. (8/10)
2021-08-02 18:37:53 [INFO] Processing SRX2577855-SRR5273872. (8/10)
2021-08-02 18:44:06 [INFO] Processing SRX2577851. (9/10)
2021-08-02 18:44:06 [INFO] Processing SRX2577851-SRR5273868. (9/10)
2021-08-02 18:50:30 [INFO] Processing SRX2577853. (10/10)
2021-08-02 18:50:30 [INFO] Processing SRX2577853-SRR5273870. (10/10)
2021-08-02 18:56:34 [INFO] Writing to disk...
2021-08-02 18:57:25 [INFO] Finished.
2021-08-12 14:31:17 [INFO] Starting.
2021-08-12 14:31:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/
2021-08-12 14:31:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/aggregate.hdf5
2021-08-12 14:31:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:18 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:18 [INFO] Writing every 10 Runs.
2021-08-12 14:31:18 [INFO] Processing SRX2577856. (1/10)
2021-08-12 14:31:18 [INFO] Processing SRX2577856-SRR5273873. (1/10)
2021-08-12 14:31:23 [INFO] Processing SRX2577857. (2/10)
2021-08-12 14:31:23 [INFO] Processing SRX2577857-SRR5273874. (2/10)
2021-08-12 14:31:25 [INFO] Processing SRX2577852. (3/10)
2021-08-12 14:31:25 [INFO] Processing SRX2577852-SRR5273869. (3/10)
2021-08-12 14:31:26 [INFO] Processing SRX2577860. (4/10)
2021-08-12 14:31:26 [INFO] Processing SRX2577860-SRR5273877. (4/10)
2021-08-12 14:31:27 [INFO] Processing SRX2577858. (5/10)
2021-08-12 14:31:27 [INFO] Processing SRX2577858-SRR5273875. (5/10)
2021-08-12 14:31:29 [INFO] Processing SRX2577859. (6/10)
2021-08-12 14:31:29 [INFO] Processing SRX2577859-SRR5273876. (6/10)
2021-08-12 14:31:30 [INFO] Processing SRX2577854. (7/10)
2021-08-12 14:31:30 [INFO] Processing SRX2577854-SRR5273871. (7/10)
2021-08-12 14:31:34 [INFO] Processing SRX2577855. (8/10)
2021-08-12 14:31:34 [INFO] Processing SRX2577855-SRR5273872. (8/10)
2021-08-12 14:31:35 [INFO] Processing SRX2577851. (9/10)
2021-08-12 14:31:35 [INFO] Processing SRX2577851-SRR5273868. (9/10)
2021-08-12 14:31:37 [INFO] Processing SRX2577853. (10/10)
2021-08-12 14:31:37 [INFO] Processing SRX2577853-SRR5273870. (10/10)
2021-08-12 14:31:39 [INFO] Writing to disk...
2021-08-12 14:31:39 [INFO] Finished.
2021-08-12 15:09:39 [INFO] Starting.
2021-08-12 15:09:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/
2021-08-12 15:09:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/aggregate.hdf5
2021-08-12 15:09:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:09:40 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 15:09:40 [INFO] Writing every 10 Runs.
2021-08-12 15:09:40 [INFO] Processing SRX2577856. (1/10)
2021-08-12 15:09:40 [INFO] Processing SRX2577856-SRR5273873. (1/10)
2021-08-12 15:09:45 [INFO] Processing SRX2577857. (2/10)
2021-08-12 15:09:45 [INFO] Processing SRX2577857-SRR5273874. (2/10)
2021-08-12 15:09:47 [INFO] Processing SRX2577852. (3/10)
2021-08-12 15:09:47 [INFO] Processing SRX2577852-SRR5273869. (3/10)
2021-08-12 15:09:49 [INFO] Processing SRX2577860. (4/10)
2021-08-12 15:09:49 [INFO] Processing SRX2577860-SRR5273877. (4/10)
2021-08-12 15:09:50 [INFO] Processing SRX2577858. (5/10)
2021-08-12 15:09:50 [INFO] Processing SRX2577858-SRR5273875. (5/10)
2021-08-12 15:09:52 [INFO] Processing SRX2577859. (6/10)
2021-08-12 15:09:52 [INFO] Processing SRX2577859-SRR5273876. (6/10)
2021-08-12 15:09:53 [INFO] Processing SRX2577854. (7/10)
2021-08-12 15:09:53 [INFO] Processing SRX2577854-SRR5273871. (7/10)
2021-08-12 15:09:56 [INFO] Processing SRX2577855. (8/10)
2021-08-12 15:09:56 [INFO] Processing SRX2577855-SRR5273872. (8/10)
2021-08-12 15:09:58 [INFO] Processing SRX2577851. (9/10)
2021-08-12 15:09:58 [INFO] Processing SRX2577851-SRR5273868. (9/10)
2021-08-12 15:10:00 [INFO] Processing SRX2577853. (10/10)
2021-08-12 15:10:00 [INFO] Processing SRX2577853-SRR5273870. (10/10)
2021-08-12 15:10:02 [INFO] Writing to disk...
2021-08-12 15:10:04 [INFO] Finished.
2021-08-12 15:44:39 [INFO] Starting.
2021-08-12 15:44:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/
2021-08-12 15:44:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/aggregate.hdf5
2021-08-12 15:44:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:44:40 [INFO] Building aggregate for 5kbp_raw network.
2021-08-12 15:44:40 [INFO] Writing every 10 Runs.
2021-08-12 15:44:40 [INFO] Processing SRX2577856. (1/10)
2021-08-12 15:44:40 [INFO] Processing SRX2577856-SRR5273873. (1/10)
2021-08-12 15:44:46 [INFO] Processing SRX2577857. (2/10)
2021-08-12 15:44:46 [INFO] Processing SRX2577857-SRR5273874. (2/10)
2021-08-12 15:44:48 [INFO] Processing SRX2577852. (3/10)
2021-08-12 15:44:48 [INFO] Processing SRX2577852-SRR5273869. (3/10)
2021-08-12 15:44:50 [INFO] Processing SRX2577860. (4/10)
2021-08-12 15:44:50 [INFO] Processing SRX2577860-SRR5273877. (4/10)
2021-08-12 15:44:52 [INFO] Processing SRX2577858. (5/10)
2021-08-12 15:44:52 [INFO] Processing SRX2577858-SRR5273875. (5/10)
2021-08-12 15:44:54 [INFO] Processing SRX2577859. (6/10)
2021-08-12 15:44:54 [INFO] Processing SRX2577859-SRR5273876. (6/10)
2021-08-12 15:44:56 [INFO] Processing SRX2577854. (7/10)
2021-08-12 15:44:56 [INFO] Processing SRX2577854-SRR5273871. (7/10)
2021-08-12 15:45:00 [INFO] Processing SRX2577855. (8/10)
2021-08-12 15:45:00 [INFO] Processing SRX2577855-SRR5273872. (8/10)
2021-08-12 15:45:01 [INFO] Processing SRX2577851. (9/10)
2021-08-12 15:45:01 [INFO] Processing SRX2577851-SRR5273868. (9/10)
2021-08-12 15:45:03 [INFO] Processing SRX2577853. (10/10)
2021-08-12 15:45:03 [INFO] Processing SRX2577853-SRR5273870. (10/10)
2021-08-12 15:45:05 [INFO] Writing to disk...
2021-08-12 15:45:06 [INFO] Finished.
2021-08-12 16:31:34 [INFO] Starting.
2021-08-12 16:31:34 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/
2021-08-12 16:31:34 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/aggregate.hdf5
2021-08-12 16:31:34 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:31:35 [INFO] Building aggregate for 1kbp_raw network.
2021-08-12 16:31:35 [INFO] Writing every 10 Runs.
2021-08-12 16:31:35 [INFO] Processing SRX2577856. (1/10)
2021-08-12 16:31:35 [INFO] Processing SRX2577856-SRR5273873. (1/10)
2021-08-12 16:31:42 [INFO] Processing SRX2577857. (2/10)
2021-08-12 16:31:42 [INFO] Processing SRX2577857-SRR5273874. (2/10)
2021-08-12 16:31:45 [INFO] Processing SRX2577852. (3/10)
2021-08-12 16:31:45 [INFO] Processing SRX2577852-SRR5273869. (3/10)
2021-08-12 16:31:47 [INFO] Processing SRX2577860. (4/10)
2021-08-12 16:31:47 [INFO] Processing SRX2577860-SRR5273877. (4/10)
2021-08-12 16:31:50 [INFO] Processing SRX2577858. (5/10)
2021-08-12 16:31:50 [INFO] Processing SRX2577858-SRR5273875. (5/10)
2021-08-12 16:31:53 [INFO] Processing SRX2577859. (6/10)
2021-08-12 16:31:53 [INFO] Processing SRX2577859-SRR5273876. (6/10)
2021-08-12 16:31:55 [INFO] Processing SRX2577854. (7/10)
2021-08-12 16:31:55 [INFO] Processing SRX2577854-SRR5273871. (7/10)
2021-08-12 16:32:00 [INFO] Processing SRX2577855. (8/10)
2021-08-12 16:32:00 [INFO] Processing SRX2577855-SRR5273872. (8/10)
2021-08-12 16:32:02 [INFO] Processing SRX2577851. (9/10)
2021-08-12 16:32:02 [INFO] Processing SRX2577851-SRR5273868. (9/10)
2021-08-12 16:32:04 [INFO] Processing SRX2577853. (10/10)
2021-08-12 16:32:04 [INFO] Processing SRX2577853-SRR5273870. (10/10)
2021-08-12 16:32:06 [INFO] Writing to disk...
2021-08-12 16:32:08 [INFO] Finished.
2021-08-20 17:55:23 [INFO] Starting.
2021-08-20 17:55:23 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/
2021-08-20 17:55:23 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/aggregate.hdf5
2021-08-20 17:55:23 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-20 17:55:24 [INFO] Building aggregate for 100kbp_raw network.
2021-08-20 17:55:24 [INFO] Writing every 10 Runs.
2021-08-20 17:55:24 [INFO] Processing SRX2577856. (1/10)
2021-08-20 17:55:24 [INFO] Processing SRX2577856-SRR5273873. (1/10)
2021-08-20 17:55:27 [INFO] Processing SRX2577857. (2/10)
2021-08-20 17:55:27 [INFO] Processing SRX2577857-SRR5273874. (2/10)
2021-08-20 17:55:29 [INFO] Processing SRX2577852. (3/10)
2021-08-20 17:55:29 [INFO] Processing SRX2577852-SRR5273869. (3/10)
2021-08-20 17:55:30 [INFO] Processing SRX2577860. (4/10)
2021-08-20 17:55:30 [INFO] Processing SRX2577860-SRR5273877. (4/10)
2021-08-20 17:55:31 [INFO] Processing SRX2577858. (5/10)
2021-08-20 17:55:31 [INFO] Processing SRX2577858-SRR5273875. (5/10)
2021-08-20 17:55:33 [INFO] Processing SRX2577859. (6/10)
2021-08-20 17:55:33 [INFO] Processing SRX2577859-SRR5273876. (6/10)
2021-08-20 17:55:35 [INFO] Processing SRX2577854. (7/10)
2021-08-20 17:55:35 [INFO] Processing SRX2577854-SRR5273871. (7/10)
2021-08-20 17:55:37 [INFO] Processing SRX2577855. (8/10)
2021-08-20 17:55:37 [INFO] Processing SRX2577855-SRR5273872. (8/10)
2021-08-20 17:55:39 [INFO] Processing SRX2577851. (9/10)
2021-08-20 17:55:39 [INFO] Processing SRX2577851-SRR5273868. (9/10)
2021-08-20 17:55:41 [INFO] Processing SRX2577853. (10/10)
2021-08-20 17:55:41 [INFO] Processing SRX2577853-SRR5273870. (10/10)
2021-08-20 17:55:42 [INFO] Writing to disk...
2021-08-20 17:55:43 [INFO] Finished.
2021-08-23 11:28:00 [INFO] Starting.
2021-08-23 11:28:00 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/
2021-08-23 11:28:00 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/aggregate.hdf5
2021-08-23 11:28:00 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 11:28:01 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 11:28:01 [INFO] Writing every 10 Runs.
2021-08-23 11:28:01 [INFO] Processing SRX2577856. (1/10)
2021-08-23 11:28:01 [INFO] Processing SRX2577856-SRR5273873. (1/10)
2021-08-23 11:28:04 [INFO] Processing SRX2577857. (2/10)
2021-08-23 11:28:04 [INFO] Processing SRX2577857-SRR5273874. (2/10)
2021-08-23 11:28:05 [INFO] Processing SRX2577852. (3/10)
2021-08-23 11:28:05 [INFO] Processing SRX2577852-SRR5273869. (3/10)
2021-08-23 11:28:06 [INFO] Processing SRX2577860. (4/10)
2021-08-23 11:28:06 [INFO] Processing SRX2577860-SRR5273877. (4/10)
2021-08-23 11:28:07 [INFO] Processing SRX2577858. (5/10)
2021-08-23 11:28:07 [INFO] Processing SRX2577858-SRR5273875. (5/10)
2021-08-23 11:28:08 [INFO] Processing SRX2577859. (6/10)
2021-08-23 11:28:08 [INFO] Processing SRX2577859-SRR5273876. (6/10)
2021-08-23 11:28:09 [INFO] Processing SRX2577854. (7/10)
2021-08-23 11:28:09 [INFO] Processing SRX2577854-SRR5273871. (7/10)
2021-08-23 11:28:11 [INFO] Processing SRX2577855. (8/10)
2021-08-23 11:28:11 [INFO] Processing SRX2577855-SRR5273872. (8/10)
2021-08-23 11:28:12 [INFO] Processing SRX2577851. (9/10)
2021-08-23 11:28:12 [INFO] Processing SRX2577851-SRR5273868. (9/10)
2021-08-23 11:28:13 [INFO] Processing SRX2577853. (10/10)
2021-08-23 11:28:13 [INFO] Processing SRX2577853-SRR5273870. (10/10)
2021-08-23 11:28:14 [INFO] Writing to disk...
2021-08-23 11:28:14 [INFO] Finished.
2021-08-23 13:15:15 [INFO] Starting.
2021-08-23 13:15:16 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/
2021-08-23 13:15:16 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP100408/aggregate.hdf5
2021-08-23 13:15:16 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:15:16 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 13:15:16 [INFO] Writing every 10 Runs.
2021-08-23 13:15:16 [INFO] Processing SRX2577856. (1/10)
2021-08-23 13:15:16 [INFO] Processing SRX2577856-SRR5273873. (1/10)
2021-08-23 13:15:19 [INFO] Processing SRX2577857. (2/10)
2021-08-23 13:15:19 [INFO] Processing SRX2577857-SRR5273874. (2/10)
2021-08-23 13:15:20 [INFO] Processing SRX2577852. (3/10)
2021-08-23 13:15:20 [INFO] Processing SRX2577852-SRR5273869. (3/10)
2021-08-23 13:15:21 [INFO] Processing SRX2577860. (4/10)
2021-08-23 13:15:21 [INFO] Processing SRX2577860-SRR5273877. (4/10)
2021-08-23 13:15:21 [INFO] Processing SRX2577858. (5/10)
2021-08-23 13:15:21 [INFO] Processing SRX2577858-SRR5273875. (5/10)
2021-08-23 13:15:22 [INFO] Processing SRX2577859. (6/10)
2021-08-23 13:15:22 [INFO] Processing SRX2577859-SRR5273876. (6/10)
2021-08-23 13:15:23 [INFO] Processing SRX2577854. (7/10)
2021-08-23 13:15:23 [INFO] Processing SRX2577854-SRR5273871. (7/10)
2021-08-23 13:15:25 [INFO] Processing SRX2577855. (8/10)
2021-08-23 13:15:25 [INFO] Processing SRX2577855-SRR5273872. (8/10)
2021-08-23 13:15:26 [INFO] Processing SRX2577851. (9/10)
2021-08-23 13:15:26 [INFO] Processing SRX2577851-SRR5273868. (9/10)
2021-08-23 13:15:27 [INFO] Processing SRX2577853. (10/10)
2021-08-23 13:15:27 [INFO] Processing SRX2577853-SRR5273870. (10/10)
2021-08-23 13:15:28 [INFO] Writing to disk...
2021-08-23 13:15:28 [INFO] Finished.