2021-06-10 03:22:43 [INFO] Starting.
2021-06-10 03:22:43 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/
2021-06-10 03:22:43 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/aggregate.hdf5
2021-06-10 03:22:43 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 03:22:43 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 03:22:44 [INFO] Building aggregate.
2021-06-10 03:22:44 [INFO] Writing every 10 Runs.
2021-06-10 03:22:44 [INFO] Processing SRX3798657. (1/10)
2021-06-10 03:22:44 [INFO] Processing SRX3798657-SRR6843220. (1/10)
2021-06-10 03:23:00 [INFO] Processing SRX3798661. (2/10)
2021-06-10 03:23:00 [INFO] Processing SRX3798661-SRR6843224. (2/10)
2021-06-10 03:23:21 [INFO] Processing SRX3798659. (3/10)
2021-06-10 03:23:21 [INFO] Processing SRX3798659-SRR6843222. (3/10)
2021-06-10 03:23:49 [INFO] Processing SRX3798664. (4/10)
2021-06-10 03:23:50 [INFO] Processing SRX3798664-SRR6843227. (4/10)
2021-06-10 03:24:19 [INFO] Processing SRX3798663. (5/10)
2021-06-10 03:24:19 [INFO] Processing SRX3798663-SRR6843226. (5/10)
2021-06-10 03:24:40 [INFO] Processing SRX3798666. (6/10)
2021-06-10 03:24:40 [INFO] Processing SRX3798666-SRR6843229. (6/10)
2021-06-10 03:24:58 [INFO] Processing SRX3798658. (7/10)
2021-06-10 03:24:58 [INFO] Processing SRX3798658-SRR6843221. (7/10)
2021-06-10 03:25:36 [INFO] Processing SRX3798665. (8/10)
2021-06-10 03:25:36 [INFO] Processing SRX3798665-SRR6843228. (8/10)
2021-06-10 03:25:59 [INFO] Processing SRX3798660. (9/10)
2021-06-10 03:25:59 [INFO] Processing SRX3798660-SRR6843223. (9/10)
2021-06-10 03:26:39 [INFO] Processing SRX3798662. (10/10)
2021-06-10 03:26:39 [INFO] Processing SRX3798662-SRR6843225. (10/10)
2021-06-10 03:27:02 [INFO] Writing to disk...
2021-06-10 03:27:19 [INFO] Finished.
2021-08-06 12:19:00 [INFO] SPECIAL NOTE: 1bp_raw aggregate build failed due to memory issues. It was manually copied in from a version that Ruchi calculated separately.
2021-08-12 14:31:17 [INFO] Starting.
2021-08-12 14:31:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/
2021-08-12 14:31:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/aggregate.hdf5
2021-08-12 14:31:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:18 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:18 [INFO] Writing every 10 Runs.
2021-08-12 14:31:18 [INFO] Processing SRX3798657. (1/10)
2021-08-12 14:31:18 [INFO] Processing SRX3798657-SRR6843220. (1/10)
2021-08-12 14:31:40 [INFO] Processing SRX3798661. (2/10)
2021-08-12 14:31:40 [INFO] Processing SRX3798661-SRR6843224. (2/10)
2021-08-12 14:31:57 [INFO] Processing SRX3798659. (3/10)
2021-08-12 14:31:58 [INFO] Processing SRX3798659-SRR6843222. (3/10)
2021-08-12 14:32:28 [INFO] Processing SRX3798664. (4/10)
2021-08-12 14:32:28 [INFO] Processing SRX3798664-SRR6843227. (4/10)
2021-08-12 14:32:52 [INFO] Processing SRX3798663. (5/10)
2021-08-12 14:32:52 [INFO] Processing SRX3798663-SRR6843226. (5/10)
2021-08-12 14:33:20 [INFO] Processing SRX3798666. (6/10)
2021-08-12 14:33:20 [INFO] Processing SRX3798666-SRR6843229. (6/10)
2021-08-12 14:33:47 [INFO] Processing SRX3798658. (7/10)
2021-08-12 14:33:47 [INFO] Processing SRX3798658-SRR6843221. (7/10)
2021-08-12 14:34:30 [INFO] Processing SRX3798665. (8/10)
2021-08-12 14:34:30 [INFO] Processing SRX3798665-SRR6843228. (8/10)
2021-08-12 14:34:53 [INFO] Processing SRX3798660. (9/10)
2021-08-12 14:34:53 [INFO] Processing SRX3798660-SRR6843223. (9/10)
2021-08-12 14:35:32 [INFO] Processing SRX3798662. (10/10)
2021-08-12 14:35:32 [INFO] Processing SRX3798662-SRR6843225. (10/10)
2021-08-12 14:35:58 [INFO] Writing to disk...
2021-08-12 14:36:17 [INFO] Finished.
2021-08-12 15:09:39 [INFO] Starting.
2021-08-12 15:09:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/
2021-08-12 15:09:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/aggregate.hdf5
2021-08-12 15:09:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:09:40 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 15:09:40 [INFO] Writing every 10 Runs.
2021-08-12 15:09:40 [INFO] Processing SRX3798657. (1/10)
2021-08-12 15:09:40 [INFO] Processing SRX3798657-SRR6843220. (1/10)
2021-08-12 15:10:01 [INFO] Processing SRX3798661. (2/10)
2021-08-12 15:10:01 [INFO] Processing SRX3798661-SRR6843224. (2/10)
2021-08-12 15:10:19 [INFO] Processing SRX3798659. (3/10)
2021-08-12 15:10:19 [INFO] Processing SRX3798659-SRR6843222. (3/10)
2021-08-12 15:10:45 [INFO] Processing SRX3798664. (4/10)
2021-08-12 15:10:45 [INFO] Processing SRX3798664-SRR6843227. (4/10)
2021-08-12 15:11:09 [INFO] Processing SRX3798663. (5/10)
2021-08-12 15:11:09 [INFO] Processing SRX3798663-SRR6843226. (5/10)
2021-08-12 15:11:30 [INFO] Processing SRX3798666. (6/10)
2021-08-12 15:11:30 [INFO] Processing SRX3798666-SRR6843229. (6/10)
2021-08-12 15:11:51 [INFO] Processing SRX3798658. (7/10)
2021-08-12 15:11:51 [INFO] Processing SRX3798658-SRR6843221. (7/10)
2021-08-12 15:12:24 [INFO] Processing SRX3798665. (8/10)
2021-08-12 15:12:24 [INFO] Processing SRX3798665-SRR6843228. (8/10)
2021-08-12 15:12:45 [INFO] Processing SRX3798660. (9/10)
2021-08-12 15:12:45 [INFO] Processing SRX3798660-SRR6843223. (9/10)
2021-08-12 15:13:13 [INFO] Processing SRX3798662. (10/10)
2021-08-12 15:13:13 [INFO] Processing SRX3798662-SRR6843225. (10/10)
2021-08-12 15:13:36 [INFO] Writing to disk...
2021-08-12 15:13:55 [INFO] Finished.
2021-08-12 15:44:39 [INFO] Starting.
2021-08-12 15:44:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/
2021-08-12 15:44:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/aggregate.hdf5
2021-08-12 15:44:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:44:39 [INFO] Building aggregate for 5kbp_raw network.
2021-08-12 15:44:39 [INFO] Writing every 10 Runs.
2021-08-12 15:44:39 [INFO] Processing SRX3798657. (1/10)
2021-08-12 15:44:39 [INFO] Processing SRX3798657-SRR6843220. (1/10)
2021-08-12 15:45:02 [INFO] Processing SRX3798661. (2/10)
2021-08-12 15:45:02 [INFO] Processing SRX3798661-SRR6843224. (2/10)
2021-08-12 15:45:21 [INFO] Processing SRX3798659. (3/10)
2021-08-12 15:45:21 [INFO] Processing SRX3798659-SRR6843222. (3/10)
2021-08-12 15:45:50 [INFO] Processing SRX3798664. (4/10)
2021-08-12 15:45:50 [INFO] Processing SRX3798664-SRR6843227. (4/10)
2021-08-12 15:46:19 [INFO] Processing SRX3798663. (5/10)
2021-08-12 15:46:19 [INFO] Processing SRX3798663-SRR6843226. (5/10)
2021-08-12 15:46:47 [INFO] Processing SRX3798666. (6/10)
2021-08-12 15:46:47 [INFO] Processing SRX3798666-SRR6843229. (6/10)
2021-08-12 15:47:11 [INFO] Processing SRX3798658. (7/10)
2021-08-12 15:47:11 [INFO] Processing SRX3798658-SRR6843221. (7/10)
2021-08-12 15:47:50 [INFO] Processing SRX3798665. (8/10)
2021-08-12 15:47:50 [INFO] Processing SRX3798665-SRR6843228. (8/10)
2021-08-12 15:48:14 [INFO] Processing SRX3798660. (9/10)
2021-08-12 15:48:14 [INFO] Processing SRX3798660-SRR6843223. (9/10)
2021-08-12 15:48:53 [INFO] Processing SRX3798662. (10/10)
2021-08-12 15:48:53 [INFO] Processing SRX3798662-SRR6843225. (10/10)
2021-08-12 15:49:19 [INFO] Writing to disk...
2021-08-12 15:49:41 [INFO] Finished.
2021-08-12 16:31:35 [INFO] Starting.
2021-08-12 16:31:35 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/
2021-08-12 16:31:35 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/aggregate.hdf5
2021-08-12 16:31:35 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:31:36 [INFO] Building aggregate for 1kbp_raw network.
2021-08-12 16:31:36 [INFO] Writing every 10 Runs.
2021-08-12 16:31:36 [INFO] Processing SRX3798657. (1/10)
2021-08-12 16:31:36 [INFO] Processing SRX3798657-SRR6843220. (1/10)
2021-08-12 16:32:02 [INFO] Processing SRX3798661. (2/10)
2021-08-12 16:32:02 [INFO] Processing SRX3798661-SRR6843224. (2/10)
2021-08-12 16:32:23 [INFO] Processing SRX3798659. (3/10)
2021-08-12 16:32:23 [INFO] Processing SRX3798659-SRR6843222. (3/10)
2021-08-12 16:32:56 [INFO] Processing SRX3798664. (4/10)
2021-08-12 16:32:56 [INFO] Processing SRX3798664-SRR6843227. (4/10)
2021-08-12 16:33:25 [INFO] Processing SRX3798663. (5/10)
2021-08-12 16:33:25 [INFO] Processing SRX3798663-SRR6843226. (5/10)
2021-08-12 16:33:54 [INFO] Processing SRX3798666. (6/10)
2021-08-12 16:33:54 [INFO] Processing SRX3798666-SRR6843229. (6/10)
2021-08-12 16:34:24 [INFO] Processing SRX3798658. (7/10)
2021-08-12 16:34:24 [INFO] Processing SRX3798658-SRR6843221. (7/10)
2021-08-12 16:35:13 [INFO] Processing SRX3798665. (8/10)
2021-08-12 16:35:13 [INFO] Processing SRX3798665-SRR6843228. (8/10)
2021-08-12 16:35:47 [INFO] Processing SRX3798660. (9/10)
2021-08-12 16:35:47 [INFO] Processing SRX3798660-SRR6843223. (9/10)
2021-08-12 16:36:45 [INFO] Processing SRX3798662. (10/10)
2021-08-12 16:36:45 [INFO] Processing SRX3798662-SRR6843225. (10/10)
2021-08-12 16:37:24 [INFO] Writing to disk...
2021-08-12 16:37:57 [INFO] Finished.
2021-08-20 17:55:17 [INFO] Starting.
2021-08-20 17:55:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/
2021-08-20 17:55:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/aggregate.hdf5
2021-08-20 17:55:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-20 17:55:18 [INFO] Building aggregate for 100kbp_raw network.
2021-08-20 17:55:18 [INFO] Writing every 10 Runs.
2021-08-20 17:55:18 [INFO] Processing SRX3798657. (1/10)
2021-08-20 17:55:18 [INFO] Processing SRX3798657-SRR6843220. (1/10)
2021-08-20 17:55:39 [INFO] Processing SRX3798661. (2/10)
2021-08-20 17:55:39 [INFO] Processing SRX3798661-SRR6843224. (2/10)
2021-08-20 17:55:53 [INFO] Processing SRX3798659. (3/10)
2021-08-20 17:55:53 [INFO] Processing SRX3798659-SRR6843222. (3/10)
2021-08-20 17:56:15 [INFO] Processing SRX3798664. (4/10)
2021-08-20 17:56:15 [INFO] Processing SRX3798664-SRR6843227. (4/10)
2021-08-20 17:56:34 [INFO] Processing SRX3798663. (5/10)
2021-08-20 17:56:34 [INFO] Processing SRX3798663-SRR6843226. (5/10)
2021-08-20 17:56:55 [INFO] Processing SRX3798666. (6/10)
2021-08-20 17:56:55 [INFO] Processing SRX3798666-SRR6843229. (6/10)
2021-08-20 17:57:17 [INFO] Processing SRX3798658. (7/10)
2021-08-20 17:57:17 [INFO] Processing SRX3798658-SRR6843221. (7/10)
2021-08-20 17:57:42 [INFO] Processing SRX3798665. (8/10)
2021-08-20 17:57:42 [INFO] Processing SRX3798665-SRR6843228. (8/10)
2021-08-20 17:58:00 [INFO] Processing SRX3798660. (9/10)
2021-08-20 17:58:00 [INFO] Processing SRX3798660-SRR6843223. (9/10)
2021-08-20 17:58:25 [INFO] Processing SRX3798662. (10/10)
2021-08-20 17:58:25 [INFO] Processing SRX3798662-SRR6843225. (10/10)
2021-08-20 17:58:43 [INFO] Writing to disk...
2021-08-20 17:58:54 [INFO] Finished.
2021-08-23 11:28:00 [INFO] Starting.
2021-08-23 11:28:00 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/
2021-08-23 11:28:00 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/aggregate.hdf5
2021-08-23 11:28:00 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 11:28:01 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 11:28:01 [INFO] Writing every 10 Runs.
2021-08-23 11:28:01 [INFO] Processing SRX3798657. (1/10)
2021-08-23 11:28:01 [INFO] Processing SRX3798657-SRR6843220. (1/10)
2021-08-23 11:28:12 [INFO] Processing SRX3798661. (2/10)
2021-08-23 11:28:12 [INFO] Processing SRX3798661-SRR6843224. (2/10)
2021-08-23 11:28:21 [INFO] Processing SRX3798659. (3/10)
2021-08-23 11:28:21 [INFO] Processing SRX3798659-SRR6843222. (3/10)
2021-08-23 11:28:36 [INFO] Processing SRX3798664. (4/10)
2021-08-23 11:28:36 [INFO] Processing SRX3798664-SRR6843227. (4/10)
2021-08-23 11:28:49 [INFO] Processing SRX3798663. (5/10)
2021-08-23 11:28:49 [INFO] Processing SRX3798663-SRR6843226. (5/10)
2021-08-23 11:29:00 [INFO] Processing SRX3798666. (6/10)
2021-08-23 11:29:00 [INFO] Processing SRX3798666-SRR6843229. (6/10)
2021-08-23 11:29:13 [INFO] Processing SRX3798658. (7/10)
2021-08-23 11:29:13 [INFO] Processing SRX3798658-SRR6843221. (7/10)
2021-08-23 11:29:29 [INFO] Processing SRX3798665. (8/10)
2021-08-23 11:29:29 [INFO] Processing SRX3798665-SRR6843228. (8/10)
2021-08-23 11:29:40 [INFO] Processing SRX3798660. (9/10)
2021-08-23 11:29:40 [INFO] Processing SRX3798660-SRR6843223. (9/10)
2021-08-23 11:29:53 [INFO] Processing SRX3798662. (10/10)
2021-08-23 11:29:53 [INFO] Processing SRX3798662-SRR6843225. (10/10)
2021-08-23 11:30:02 [INFO] Writing to disk...
2021-08-23 11:30:05 [INFO] Finished.
2021-08-23 13:15:15 [INFO] Starting.
2021-08-23 13:15:16 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/
2021-08-23 13:15:16 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP135798/aggregate.hdf5
2021-08-23 13:15:16 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:15:16 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 13:15:16 [INFO] Writing every 10 Runs.
2021-08-23 13:15:16 [INFO] Processing SRX3798657. (1/10)
2021-08-23 13:15:16 [INFO] Processing SRX3798657-SRR6843220. (1/10)
2021-08-23 13:15:23 [INFO] Processing SRX3798661. (2/10)
2021-08-23 13:15:23 [INFO] Processing SRX3798661-SRR6843224. (2/10)
2021-08-23 13:15:30 [INFO] Processing SRX3798659. (3/10)
2021-08-23 13:15:30 [INFO] Processing SRX3798659-SRR6843222. (3/10)
2021-08-23 13:15:36 [INFO] Processing SRX3798664. (4/10)
2021-08-23 13:15:36 [INFO] Processing SRX3798664-SRR6843227. (4/10)
2021-08-23 13:15:43 [INFO] Processing SRX3798663. (5/10)
2021-08-23 13:15:43 [INFO] Processing SRX3798663-SRR6843226. (5/10)
2021-08-23 13:15:49 [INFO] Processing SRX3798666. (6/10)
2021-08-23 13:15:49 [INFO] Processing SRX3798666-SRR6843229. (6/10)
2021-08-23 13:15:57 [INFO] Processing SRX3798658. (7/10)
2021-08-23 13:15:57 [INFO] Processing SRX3798658-SRR6843221. (7/10)
2021-08-23 13:16:05 [INFO] Processing SRX3798665. (8/10)
2021-08-23 13:16:05 [INFO] Processing SRX3798665-SRR6843228. (8/10)
2021-08-23 13:16:12 [INFO] Processing SRX3798660. (9/10)
2021-08-23 13:16:12 [INFO] Processing SRX3798660-SRR6843223. (9/10)
2021-08-23 13:16:19 [INFO] Processing SRX3798662. (10/10)
2021-08-23 13:16:19 [INFO] Processing SRX3798662-SRR6843225. (10/10)
2021-08-23 13:16:26 [INFO] Writing to disk...
2021-08-23 13:16:27 [INFO] Finished.