2021-06-10 02:53:49 [INFO] Starting.
2021-06-10 02:53:49 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/
2021-06-10 02:53:49 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/aggregate.hdf5
2021-06-10 02:53:49 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 02:53:49 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 02:53:50 [INFO] Building aggregate.
2021-06-10 02:53:50 [INFO] Writing every 10 Runs.
2021-06-10 02:53:50 [INFO] Processing SRX5007082. (1/4)
2021-06-10 02:53:50 [INFO] Processing SRX5007082-SRR8187258. (1/15)
2021-06-10 02:54:41 [INFO] Processing SRX5007082-SRR8187257. (2/15)
2021-06-10 02:55:06 [INFO] Processing SRX5007082-SRR8187259. (3/15)
2021-06-10 02:55:40 [INFO] Processing SRX5007081. (2/4)
2021-06-10 02:55:40 [INFO] Processing SRX5007081-SRR8187256. (4/15)
2021-06-10 02:56:20 [INFO] Processing SRX5007081-SRR8187254. (5/15)
2021-06-10 02:56:58 [INFO] Processing SRX5007081-SRR8187255. (6/15)
2021-06-10 02:57:29 [INFO] Processing SRX5007079. (3/4)
2021-06-10 02:57:29 [INFO] Processing SRX5007079-SRR8187246. (7/15)
2021-06-10 02:57:56 [INFO] Processing SRX5007079-SRR8187247. (8/15)
2021-06-10 02:58:34 [INFO] Processing SRX5007079-SRR8187249. (9/15)
2021-06-10 02:59:25 [INFO] Processing SRX5007079-SRR8187248. (10/15)
2021-06-10 03:00:03 [INFO] Writing to disk...
2021-06-10 03:00:36 [INFO] Processing SRX5007079-SRR8187245. (11/15)
2021-06-10 03:01:01 [INFO] Processing SRX5007080. (4/4)
2021-06-10 03:01:01 [INFO] Processing SRX5007080-SRR8187251. (12/15)
2021-06-10 03:01:51 [INFO] Processing SRX5007080-SRR8187252. (13/15)
2021-06-10 03:02:25 [INFO] Processing SRX5007080-SRR8187253. (14/15)
2021-06-10 03:03:16 [INFO] Processing SRX5007080-SRR8187250. (15/15)
2021-06-10 03:03:35 [INFO] Writing to disk...
2021-06-10 03:04:05 [INFO] Finished.
2021-08-06 12:19:00 [INFO] SPECIAL NOTE: 1bp_raw aggregate build failed due to memory issues. It was manually copied in from a version that Ruchi calculated separately.
2021-08-12 14:31:17 [INFO] Starting.
2021-08-12 14:31:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/
2021-08-12 14:31:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/aggregate.hdf5
2021-08-12 14:31:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:18 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:18 [INFO] Writing every 10 Runs.
2021-08-12 14:31:18 [INFO] Processing SRX5007082. (1/4)
2021-08-12 14:31:18 [INFO] Processing SRX5007082-SRR8187258. (1/15)
2021-08-12 14:31:49 [INFO] Processing SRX5007082-SRR8187257. (2/15)
2021-08-12 14:32:28 [INFO] Processing SRX5007082-SRR8187259. (3/15)
2021-08-12 14:33:02 [INFO] Processing SRX5007081. (2/4)
2021-08-12 14:33:02 [INFO] Processing SRX5007081-SRR8187256. (4/15)
2021-08-12 14:33:39 [INFO] Processing SRX5007081-SRR8187254. (5/15)
2021-08-12 14:34:22 [INFO] Processing SRX5007081-SRR8187255. (6/15)
2021-08-12 14:34:55 [INFO] Processing SRX5007079. (3/4)
2021-08-12 14:34:55 [INFO] Processing SRX5007079-SRR8187246. (7/15)
2021-08-12 14:35:11 [INFO] Processing SRX5007079-SRR8187247. (8/15)
2021-08-12 14:35:52 [INFO] Processing SRX5007079-SRR8187249. (9/15)
2021-08-12 14:36:30 [INFO] Processing SRX5007079-SRR8187248. (10/15)
2021-08-12 14:37:11 [INFO] Writing to disk...
2021-08-12 14:37:29 [INFO] Processing SRX5007079-SRR8187245. (11/15)
2021-08-12 14:37:54 [INFO] Processing SRX5007080. (4/4)
2021-08-12 14:37:54 [INFO] Processing SRX5007080-SRR8187251. (12/15)
2021-08-12 14:38:33 [INFO] Processing SRX5007080-SRR8187252. (13/15)
2021-08-12 14:39:07 [INFO] Processing SRX5007080-SRR8187253. (14/15)
2021-08-12 14:39:40 [INFO] Processing SRX5007080-SRR8187250. (15/15)
2021-08-12 14:39:54 [INFO] Writing to disk...
2021-08-12 14:40:21 [INFO] Finished.
2021-08-12 15:09:39 [INFO] Starting.
2021-08-12 15:09:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/
2021-08-12 15:09:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/aggregate.hdf5
2021-08-12 15:09:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:09:40 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 15:09:40 [INFO] Writing every 10 Runs.
2021-08-12 15:09:40 [INFO] Processing SRX5007082. (1/4)
2021-08-12 15:09:40 [INFO] Processing SRX5007082-SRR8187258. (1/15)
2021-08-12 15:10:09 [INFO] Processing SRX5007082-SRR8187257. (2/15)
2021-08-12 15:10:38 [INFO] Processing SRX5007082-SRR8187259. (3/15)
2021-08-12 15:11:05 [INFO] Processing SRX5007081. (2/4)
2021-08-12 15:11:05 [INFO] Processing SRX5007081-SRR8187256. (4/15)
2021-08-12 15:11:35 [INFO] Processing SRX5007081-SRR8187254. (5/15)
2021-08-12 15:12:10 [INFO] Processing SRX5007081-SRR8187255. (6/15)
2021-08-12 15:12:39 [INFO] Processing SRX5007079. (3/4)
2021-08-12 15:12:39 [INFO] Processing SRX5007079-SRR8187246. (7/15)
2021-08-12 15:12:53 [INFO] Processing SRX5007079-SRR8187247. (8/15)
2021-08-12 15:13:32 [INFO] Processing SRX5007079-SRR8187249. (9/15)
2021-08-12 15:14:15 [INFO] Processing SRX5007079-SRR8187248. (10/15)
2021-08-12 15:14:50 [INFO] Writing to disk...
2021-08-12 15:15:11 [INFO] Processing SRX5007079-SRR8187245. (11/15)
2021-08-12 15:15:37 [INFO] Processing SRX5007080. (4/4)
2021-08-12 15:15:37 [INFO] Processing SRX5007080-SRR8187251. (12/15)
2021-08-12 15:16:12 [INFO] Processing SRX5007080-SRR8187252. (13/15)
2021-08-12 15:16:48 [INFO] Processing SRX5007080-SRR8187253. (14/15)
2021-08-12 15:17:19 [INFO] Processing SRX5007080-SRR8187250. (15/15)
2021-08-12 15:17:36 [INFO] Writing to disk...
2021-08-12 15:18:03 [INFO] Finished.
2021-08-12 15:44:40 [INFO] Starting.
2021-08-12 15:44:40 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/
2021-08-12 15:44:40 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/aggregate.hdf5
2021-08-12 15:44:40 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:44:41 [INFO] Building aggregate for 5kbp_raw network.
2021-08-12 15:44:41 [INFO] Writing every 10 Runs.
2021-08-12 15:44:41 [INFO] Processing SRX5007082. (1/4)
2021-08-12 15:44:41 [INFO] Processing SRX5007082-SRR8187258. (1/15)
2021-08-12 15:45:14 [INFO] Processing SRX5007082-SRR8187257. (2/15)
2021-08-12 15:45:51 [INFO] Processing SRX5007082-SRR8187259. (3/15)
2021-08-12 15:46:28 [INFO] Processing SRX5007081. (2/4)
2021-08-12 15:46:28 [INFO] Processing SRX5007081-SRR8187256. (4/15)
2021-08-12 15:47:14 [INFO] Processing SRX5007081-SRR8187254. (5/15)
2021-08-12 15:47:58 [INFO] Processing SRX5007081-SRR8187255. (6/15)
2021-08-12 15:48:44 [INFO] Processing SRX5007079. (3/4)
2021-08-12 15:48:44 [INFO] Processing SRX5007079-SRR8187246. (7/15)
2021-08-12 15:49:04 [INFO] Processing SRX5007079-SRR8187247. (8/15)
2021-08-12 15:49:54 [INFO] Processing SRX5007079-SRR8187249. (9/15)
2021-08-12 15:50:37 [INFO] Processing SRX5007079-SRR8187248. (10/15)
2021-08-12 15:51:22 [INFO] Writing to disk...
2021-08-12 15:51:48 [INFO] Processing SRX5007079-SRR8187245. (11/15)
2021-08-12 15:52:12 [INFO] Processing SRX5007080. (4/4)
2021-08-12 15:52:12 [INFO] Processing SRX5007080-SRR8187251. (12/15)
2021-08-12 15:53:01 [INFO] Processing SRX5007080-SRR8187252. (13/15)
2021-08-12 15:53:42 [INFO] Processing SRX5007080-SRR8187253. (14/15)
2021-08-12 15:54:31 [INFO] Processing SRX5007080-SRR8187250. (15/15)
2021-08-12 15:54:55 [INFO] Writing to disk...
2021-08-12 15:55:27 [INFO] Finished.
2021-08-12 16:31:34 [INFO] Starting.
2021-08-12 16:31:34 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/
2021-08-12 16:31:34 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/aggregate.hdf5
2021-08-12 16:31:34 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:31:42 [INFO] Building aggregate for 1kbp_raw network.
2021-08-12 16:31:42 [INFO] Writing every 10 Runs.
2021-08-12 16:31:42 [INFO] Processing SRX5007082. (1/4)
2021-08-12 16:31:42 [INFO] Processing SRX5007082-SRR8187258. (1/15)
2021-08-12 16:32:20 [INFO] Processing SRX5007082-SRR8187257. (2/15)
2021-08-12 16:33:06 [INFO] Processing SRX5007082-SRR8187259. (3/15)
2021-08-12 16:33:55 [INFO] Processing SRX5007081. (2/4)
2021-08-12 16:33:55 [INFO] Processing SRX5007081-SRR8187256. (4/15)
2021-08-12 16:34:49 [INFO] Processing SRX5007081-SRR8187254. (5/15)
2021-08-12 16:35:47 [INFO] Processing SRX5007081-SRR8187255. (6/15)
2021-08-12 16:36:41 [INFO] Processing SRX5007079. (3/4)
2021-08-12 16:36:41 [INFO] Processing SRX5007079-SRR8187246. (7/15)
2021-08-12 16:37:08 [INFO] Processing SRX5007079-SRR8187247. (8/15)
2021-08-12 16:38:16 [INFO] Processing SRX5007079-SRR8187249. (9/15)
2021-08-12 16:39:21 [INFO] Processing SRX5007079-SRR8187248. (10/15)
2021-08-12 16:40:21 [INFO] Writing to disk...
2021-08-12 16:41:06 [INFO] Processing SRX5007079-SRR8187245. (11/15)
2021-08-12 16:41:47 [INFO] Processing SRX5007080. (4/4)
2021-08-12 16:41:47 [INFO] Processing SRX5007080-SRR8187251. (12/15)
2021-08-12 16:42:48 [INFO] Processing SRX5007080-SRR8187252. (13/15)
2021-08-12 16:43:46 [INFO] Processing SRX5007080-SRR8187253. (14/15)
2021-08-12 16:44:44 [INFO] Processing SRX5007080-SRR8187250. (15/15)
2021-08-12 16:45:14 [INFO] Writing to disk...
2021-08-12 16:46:01 [INFO] Finished.
2021-08-20 17:47:58 [INFO] Starting.
2021-08-20 17:47:58 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/
2021-08-20 17:47:58 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/aggregate.hdf5
2021-08-20 17:47:58 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-20 17:48:00 [INFO] Building aggregate for 100kbp_raw network.
2021-08-20 17:48:00 [INFO] Writing every 10 Runs.
2021-08-20 17:48:00 [INFO] Processing SRX5007082. (1/4)
2021-08-20 17:48:00 [INFO] Processing SRX5007082-SRR8187258. (1/15)
2021-08-20 17:48:26 [INFO] Processing SRX5007082-SRR8187257. (2/15)
2021-08-20 17:48:56 [INFO] Processing SRX5007082-SRR8187259. (3/15)
2021-08-20 17:49:24 [INFO] Processing SRX5007081. (2/4)
2021-08-20 17:49:24 [INFO] Processing SRX5007081-SRR8187256. (4/15)
2021-08-20 17:49:56 [INFO] Processing SRX5007081-SRR8187254. (5/15)
2021-08-20 17:50:24 [INFO] Processing SRX5007081-SRR8187255. (6/15)
2021-08-20 17:50:54 [INFO] Processing SRX5007079. (3/4)
2021-08-20 17:50:54 [INFO] Processing SRX5007079-SRR8187246. (7/15)
2021-08-20 17:51:08 [INFO] Processing SRX5007079-SRR8187247. (8/15)
2021-08-20 17:51:39 [INFO] Processing SRX5007079-SRR8187249. (9/15)
2021-08-20 17:52:08 [INFO] Processing SRX5007079-SRR8187248. (10/15)
2021-08-20 17:52:41 [INFO] Writing to disk...
2021-08-20 17:52:55 [INFO] Processing SRX5007079-SRR8187245. (11/15)
2021-08-20 17:53:17 [INFO] Processing SRX5007080. (4/4)
2021-08-20 17:53:17 [INFO] Processing SRX5007080-SRR8187251. (12/15)
2021-08-20 17:53:53 [INFO] Processing SRX5007080-SRR8187252. (13/15)
2021-08-20 17:54:23 [INFO] Processing SRX5007080-SRR8187253. (14/15)
2021-08-20 17:54:51 [INFO] Processing SRX5007080-SRR8187250. (15/15)
2021-08-20 17:55:03 [INFO] Writing to disk...
2021-08-20 17:55:24 [INFO] Finished.
2021-08-23 11:28:00 [INFO] Starting.
2021-08-23 11:28:00 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/
2021-08-23 11:28:00 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/aggregate.hdf5
2021-08-23 11:28:00 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 11:28:01 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 11:28:01 [INFO] Writing every 10 Runs.
2021-08-23 11:28:01 [INFO] Processing SRX5007082. (1/4)
2021-08-23 11:28:01 [INFO] Processing SRX5007082-SRR8187258. (1/15)
2021-08-23 11:28:17 [INFO] Processing SRX5007082-SRR8187257. (2/15)
2021-08-23 11:28:28 [INFO] Processing SRX5007082-SRR8187259. (3/15)
2021-08-23 11:28:41 [INFO] Processing SRX5007081. (2/4)
2021-08-23 11:28:41 [INFO] Processing SRX5007081-SRR8187256. (4/15)
2021-08-23 11:28:58 [INFO] Processing SRX5007081-SRR8187254. (5/15)
2021-08-23 11:29:12 [INFO] Processing SRX5007081-SRR8187255. (6/15)
2021-08-23 11:29:29 [INFO] Processing SRX5007079. (3/4)
2021-08-23 11:29:29 [INFO] Processing SRX5007079-SRR8187246. (7/15)
2021-08-23 11:29:37 [INFO] Processing SRX5007079-SRR8187247. (8/15)
2021-08-23 11:29:53 [INFO] Processing SRX5007079-SRR8187249. (9/15)
2021-08-23 11:30:08 [INFO] Processing SRX5007079-SRR8187248. (10/15)
2021-08-23 11:30:23 [INFO] Writing to disk...
2021-08-23 11:30:25 [INFO] Processing SRX5007079-SRR8187245. (11/15)
2021-08-23 11:30:36 [INFO] Processing SRX5007080. (4/4)
2021-08-23 11:30:36 [INFO] Processing SRX5007080-SRR8187251. (12/15)
2021-08-23 11:30:52 [INFO] Processing SRX5007080-SRR8187252. (13/15)
2021-08-23 11:31:11 [INFO] Processing SRX5007080-SRR8187253. (14/15)
2021-08-23 11:31:31 [INFO] Processing SRX5007080-SRR8187250. (15/15)
2021-08-23 11:31:39 [INFO] Writing to disk...
2021-08-23 11:31:53 [INFO] Finished.
2021-08-23 13:15:16 [INFO] Starting.
2021-08-23 13:15:16 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/
2021-08-23 13:15:16 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP168606/aggregate.hdf5
2021-08-23 13:15:16 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:15:16 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 13:15:16 [INFO] Writing every 10 Runs.
2021-08-23 13:15:16 [INFO] Processing SRX5007082. (1/4)
2021-08-23 13:15:16 [INFO] Processing SRX5007082-SRR8187258. (1/15)
2021-08-23 13:15:23 [INFO] Processing SRX5007082-SRR8187257. (2/15)
2021-08-23 13:15:31 [INFO] Processing SRX5007082-SRR8187259. (3/15)
2021-08-23 13:15:37 [INFO] Processing SRX5007081. (2/4)
2021-08-23 13:15:37 [INFO] Processing SRX5007081-SRR8187256. (4/15)
2021-08-23 13:15:43 [INFO] Processing SRX5007081-SRR8187254. (5/15)
2021-08-23 13:15:51 [INFO] Processing SRX5007081-SRR8187255. (6/15)
2021-08-23 13:15:55 [INFO] Processing SRX5007079. (3/4)
2021-08-23 13:15:55 [INFO] Processing SRX5007079-SRR8187246. (7/15)
2021-08-23 13:16:00 [INFO] Processing SRX5007079-SRR8187247. (8/15)
2021-08-23 13:16:08 [INFO] Processing SRX5007079-SRR8187249. (9/15)
2021-08-23 13:16:16 [INFO] Processing SRX5007079-SRR8187248. (10/15)
2021-08-23 13:16:22 [INFO] Writing to disk...
2021-08-23 13:16:23 [INFO] Processing SRX5007079-SRR8187245. (11/15)
2021-08-23 13:16:30 [INFO] Processing SRX5007080. (4/4)
2021-08-23 13:16:30 [INFO] Processing SRX5007080-SRR8187251. (12/15)
2021-08-23 13:16:38 [INFO] Processing SRX5007080-SRR8187252. (13/15)
2021-08-23 13:16:45 [INFO] Processing SRX5007080-SRR8187253. (14/15)
2021-08-23 13:16:54 [INFO] Processing SRX5007080-SRR8187250. (15/15)
2021-08-23 13:17:00 [INFO] Writing to disk...
2021-08-23 13:17:01 [INFO] Finished.