2021-06-10 01:37:48 [INFO] Starting.
2021-06-10 01:37:48 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/
2021-06-10 01:37:48 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/aggregate.hdf5
2021-06-10 01:37:48 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 01:37:48 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 01:37:49 [INFO] Building aggregate.
2021-06-10 01:37:49 [INFO] Writing every 10 Runs.
2021-06-10 01:37:49 [INFO] Processing SRX4451231. (1/2)
2021-06-10 01:37:49 [INFO] Processing SRX4451231-SRR7621292. (1/31)
2021-06-10 01:38:10 [INFO] Processing SRX4451231-SRR7621286. (2/31)
2021-06-10 01:38:59 [INFO] Processing SRX4451231-SRR7621293. (3/31)
2021-06-10 01:39:31 [INFO] Processing SRX4451231-SRR7621287. (4/31)
2021-06-10 01:40:21 [INFO] Processing SRX4451231-SRR7621282. (5/31)
2021-06-10 01:40:55 [INFO] Processing SRX4451231-SRR7621288. (6/31)
2021-06-10 01:41:49 [INFO] Processing SRX4451231-SRR7621283. (7/31)
2021-06-10 01:42:36 [INFO] Processing SRX4451231-SRR7621290. (8/31)
2021-06-10 01:43:12 [INFO] Processing SRX4451231-SRR7621289. (9/31)
2021-06-10 01:44:13 [INFO] Processing SRX4451231-SRR7621294. (10/31)
2021-06-10 01:44:50 [INFO] Writing to disk...
2021-06-10 01:45:36 [INFO] Processing SRX4451231-SRR7621284. (11/31)
2021-06-10 01:46:22 [INFO] Processing SRX4451231-SRR7621291. (12/31)
2021-06-10 01:47:07 [INFO] Processing SRX4451231-SRR7621285. (13/31)
2021-06-10 01:48:10 [INFO] Processing SRX4451235. (2/2)
2021-06-10 01:48:10 [INFO] Processing SRX4451235-SRR7621299. (14/31)
2021-06-10 01:49:06 [INFO] Processing SRX4451235-SRR7621304. (15/31)
2021-06-10 01:49:24 [INFO] Processing SRX4451235-SRR7621309. (16/31)
2021-06-10 01:50:08 [INFO] Processing SRX4451235-SRR7621297. (17/31)
2021-06-10 01:50:46 [INFO] Processing SRX4451235-SRR7621300. (18/31)
2021-06-10 01:51:28 [INFO] Processing SRX4451235-SRR7621302. (19/31)
2021-06-10 01:52:31 [INFO] Processing SRX4451235-SRR7621298. (20/31)
2021-06-10 01:53:25 [INFO] Writing to disk...
2021-06-10 01:54:10 [INFO] Processing SRX4451235-SRR7621306. (21/31)
2021-06-10 01:54:38 [INFO] Processing SRX4451235-SRR7621307. (22/31)
2021-06-10 01:55:11 [INFO] Processing SRX4451235-SRR7621310. (23/31)
2021-06-10 01:55:47 [INFO] Processing SRX4451235-SRR7621311. (24/31)
2021-06-10 01:56:25 [INFO] Processing SRX4451235-SRR7621301. (25/31)
2021-06-10 01:57:14 [INFO] Processing SRX4451235-SRR7621308. (26/31)
2021-06-10 01:57:45 [INFO] Processing SRX4451235-SRR7621312. (27/31)
2021-06-10 01:58:21 [INFO] Processing SRX4451235-SRR7621305. (28/31)
2021-06-10 01:59:03 [INFO] Processing SRX4451235-SRR7621303. (29/31)
2021-06-10 01:59:45 [INFO] Processing SRX4451235-SRR7621296. (30/31)
2021-06-10 02:01:01 [INFO] Writing to disk...
2021-06-10 02:02:22 [INFO] Processing SRX4451235-SRR7621295. (31/31)
2021-06-10 02:03:31 [INFO] Writing to disk...
2021-06-10 02:04:45 [INFO] Finished.
2021-08-02 17:08:55 [INFO] Starting.
2021-08-02 17:08:56 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/
2021-08-02 17:08:56 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/aggregate.hdf5
2021-08-02 17:08:56 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-02 17:08:56 [INFO] Building aggregate for 1bp_raw network.
2021-08-02 17:08:56 [INFO] Writing every 10 Runs.
2021-08-02 17:08:56 [INFO] Processing SRX4451231. (1/2)
2021-08-02 17:08:56 [INFO] Processing SRX4451231-SRR7621292. (1/31)
2021-08-02 17:20:08 [INFO] Processing SRX4451231-SRR7621286. (2/31)
2021-08-02 17:26:51 [ERROR] Adding SRR7621286:chr5_vs_chr7 to in memory aggregate failed. Error message:
Traceback (most recent call last):
  File "/grid/gillis/data/nfox/hi_c_data_processing/software/aggregate.py", line 428, in add_dataset
    aggregate_data[c] = aggregate_data[c] + net
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/base.py", line 415, in __add__
    return self._add_sparse(other)
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 359, in _add_sparse
    return self._binopt(other, '_plus_')
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 1226, in _binopt
    indptr = np.empty(self.indptr.shape, dtype=idx_dtype)
MemoryError: Unable to allocate 693. MiB for an array with shape (181538260,) and data type int32

2021-08-05 02:56:45 [INFO] Starting.
2021-08-05 02:56:45 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/
2021-08-05 02:56:45 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/aggregate.hdf5
2021-08-05 02:56:45 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-05 02:56:46 [INFO] Building aggregate for 1bp_raw network.
2021-08-05 02:56:46 [INFO] Writing every 10 Runs.
2021-08-05 02:56:46 [INFO] Processing SRX4451231. (1/2)
2021-08-05 02:56:46 [INFO] Processing SRX4451231-SRR7621292. (1/31)
2021-08-05 03:00:18 [INFO] Processing SRX4451231-SRR7621286. (2/31)
2021-08-05 03:07:52 [INFO] Processing SRX4451231-SRR7621293. (3/31)
2021-08-05 03:15:13 [INFO] Processing SRX4451231-SRR7621287. (4/31)
2021-08-05 03:22:56 [INFO] Processing SRX4451231-SRR7621282. (5/31)
2021-08-05 03:30:32 [INFO] Processing SRX4451231-SRR7621288. (6/31)
2021-08-05 03:38:42 [INFO] Processing SRX4451231-SRR7621283. (7/31)
2021-08-05 03:46:53 [INFO] Processing SRX4451231-SRR7621290. (8/31)
2021-08-05 03:55:02 [INFO] Processing SRX4451231-SRR7621289. (9/31)
2021-08-05 04:03:14 [INFO] Processing SRX4451231-SRR7621294. (10/31)
2021-08-05 04:11:36 [INFO] Writing to disk...
2021-08-05 04:13:15 [INFO] Processing SRX4451231-SRR7621284. (11/31)
2021-08-05 04:21:29 [INFO] Processing SRX4451231-SRR7621291. (12/31)
2021-08-05 04:29:45 [INFO] Processing SRX4451231-SRR7621285. (13/31)
2021-08-05 04:38:23 [INFO] Processing SRX4451235. (2/2)
2021-08-05 04:38:23 [INFO] Processing SRX4451235-SRR7621299. (14/31)
2021-08-05 04:46:46 [INFO] Processing SRX4451235-SRR7621304. (15/31)
2021-08-05 04:54:44 [INFO] Processing SRX4451235-SRR7621309. (16/31)
2021-08-05 05:03:05 [INFO] Processing SRX4451235-SRR7621297. (17/31)
2021-08-05 05:11:16 [INFO] Processing SRX4451235-SRR7621300. (18/31)
2021-08-05 05:19:43 [INFO] Processing SRX4451235-SRR7621302. (19/31)
2021-08-05 05:28:16 [INFO] Processing SRX4451235-SRR7621298. (20/31)
2021-08-05 05:37:03 [INFO] Writing to disk...
2021-08-05 05:39:12 [INFO] Processing SRX4451235-SRR7621306. (21/31)
2021-08-05 05:47:23 [INFO] Processing SRX4451235-SRR7621307. (22/31)
2021-08-05 05:55:49 [INFO] Processing SRX4451235-SRR7621310. (23/31)
2021-08-05 06:04:28 [INFO] Processing SRX4451235-SRR7621311. (24/31)
2021-08-05 06:13:08 [INFO] Processing SRX4451235-SRR7621301. (25/31)
2021-08-05 06:22:01 [INFO] Processing SRX4451235-SRR7621308. (26/31)
2021-08-05 06:30:11 [INFO] Processing SRX4451235-SRR7621312. (27/31)
2021-08-05 06:38:53 [INFO] Processing SRX4451235-SRR7621305. (28/31)
2021-08-05 06:47:23 [INFO] Processing SRX4451235-SRR7621303. (29/31)
2021-08-05 06:56:05 [INFO] Processing SRX4451235-SRR7621296. (30/31)
2021-08-05 07:05:12 [INFO] Writing to disk...
2021-08-05 07:07:54 [INFO] Processing SRX4451235-SRR7621295. (31/31)
2021-08-05 07:17:02 [INFO] Writing to disk...
2021-08-05 07:19:48 [INFO] Finished.
2021-08-12 17:31:12 [INFO] Starting.
2021-08-12 17:31:12 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/
2021-08-12 17:31:12 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/aggregate.hdf5
2021-08-12 17:31:12 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 17:31:13 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 17:31:13 [INFO] Writing every 10 Runs.
2021-08-12 17:31:13 [INFO] Processing SRX4451231. (1/2)
2021-08-12 17:31:13 [INFO] Processing SRX4451231-SRR7621292. (1/31)
2021-08-12 17:32:00 [INFO] Processing SRX4451231-SRR7621286. (2/31)
2021-08-12 17:33:05 [INFO] Processing SRX4451231-SRR7621293. (3/31)
2021-08-12 17:34:01 [INFO] Processing SRX4451231-SRR7621287. (4/31)
2021-08-12 17:34:40 [INFO] Processing SRX4451231-SRR7621282. (5/31)
2021-08-12 17:35:26 [INFO] Processing SRX4451231-SRR7621288. (6/31)
2021-08-12 17:36:15 [INFO] Processing SRX4451231-SRR7621283. (7/31)
2021-08-12 17:36:56 [INFO] Processing SRX4451231-SRR7621290. (8/31)
2021-08-12 17:37:40 [INFO] Processing SRX4451231-SRR7621289. (9/31)
2021-08-12 17:38:24 [INFO] Processing SRX4451231-SRR7621294. (10/31)
2021-08-12 17:38:59 [INFO] Writing to disk...
2021-08-12 17:39:24 [INFO] Processing SRX4451231-SRR7621284. (11/31)
2021-08-12 17:39:56 [INFO] Processing SRX4451231-SRR7621291. (12/31)
2021-08-12 17:40:42 [INFO] Processing SRX4451231-SRR7621285. (13/31)
2021-08-12 17:41:47 [INFO] Processing SRX4451235. (2/2)
2021-08-12 17:41:47 [INFO] Processing SRX4451235-SRR7621299. (14/31)
2021-08-12 17:42:29 [INFO] Processing SRX4451235-SRR7621304. (15/31)
2021-08-12 17:42:46 [INFO] Processing SRX4451235-SRR7621309. (16/31)
2021-08-12 17:43:24 [INFO] Processing SRX4451235-SRR7621297. (17/31)
2021-08-12 17:44:01 [INFO] Processing SRX4451235-SRR7621300. (18/31)
2021-08-12 17:44:35 [INFO] Processing SRX4451235-SRR7621302. (19/31)
2021-08-12 17:45:22 [INFO] Processing SRX4451235-SRR7621298. (20/31)
2021-08-12 17:46:01 [INFO] Writing to disk...
2021-08-12 17:46:31 [INFO] Processing SRX4451235-SRR7621306. (21/31)
2021-08-12 17:46:47 [INFO] Processing SRX4451235-SRR7621307. (22/31)
2021-08-12 17:47:20 [INFO] Processing SRX4451235-SRR7621310. (23/31)
2021-08-12 17:48:01 [INFO] Processing SRX4451235-SRR7621311. (24/31)
2021-08-12 17:48:40 [INFO] Processing SRX4451235-SRR7621301. (25/31)
2021-08-12 17:49:31 [INFO] Processing SRX4451235-SRR7621308. (26/31)
2021-08-12 17:49:41 [INFO] Processing SRX4451235-SRR7621312. (27/31)
2021-08-12 17:50:10 [INFO] Processing SRX4451235-SRR7621305. (28/31)
2021-08-12 17:50:36 [INFO] Processing SRX4451235-SRR7621303. (29/31)
2021-08-12 17:51:24 [INFO] Processing SRX4451235-SRR7621296. (30/31)
2021-08-12 17:52:19 [INFO] Writing to disk...
2021-08-12 17:52:56 [INFO] Processing SRX4451235-SRR7621295. (31/31)
2021-08-12 17:53:52 [INFO] Writing to disk...
2021-08-12 17:54:31 [INFO] Finished.
2021-08-13 09:08:37 [INFO] Starting.
2021-08-13 09:08:37 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/
2021-08-13 09:08:37 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/aggregate.hdf5
2021-08-13 09:08:37 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-13 09:08:37 [INFO] Building aggregate for 25kbp_raw network.
2021-08-13 09:08:37 [INFO] Writing every 10 Runs.
2021-08-13 09:08:37 [INFO] Processing SRX4451231. (1/2)
2021-08-13 09:08:37 [INFO] Processing SRX4451231-SRR7621292. (1/31)
2021-08-13 09:09:31 [INFO] Processing SRX4451231-SRR7621286. (2/31)
2021-08-13 09:10:28 [INFO] Processing SRX4451231-SRR7621293. (3/31)
2021-08-13 09:11:18 [INFO] Processing SRX4451231-SRR7621287. (4/31)
2021-08-13 09:12:07 [INFO] Processing SRX4451231-SRR7621282. (5/31)
2021-08-13 09:13:02 [INFO] Processing SRX4451231-SRR7621288. (6/31)
2021-08-13 09:14:01 [INFO] Processing SRX4451231-SRR7621283. (7/31)
2021-08-13 09:14:49 [INFO] Processing SRX4451231-SRR7621290. (8/31)
2021-08-13 09:15:26 [INFO] Processing SRX4451231-SRR7621289. (9/31)
2021-08-13 09:16:14 [INFO] Processing SRX4451231-SRR7621294. (10/31)
2021-08-13 09:16:46 [INFO] Writing to disk...
2021-08-13 09:17:19 [INFO] Processing SRX4451231-SRR7621284. (11/31)
2021-08-13 09:17:51 [INFO] Processing SRX4451231-SRR7621291. (12/31)
2021-08-13 09:18:28 [INFO] Processing SRX4451231-SRR7621285. (13/31)
2021-08-13 09:19:09 [INFO] Processing SRX4451235. (2/2)
2021-08-13 09:19:09 [INFO] Processing SRX4451235-SRR7621299. (14/31)
2021-08-13 09:19:46 [INFO] Processing SRX4451235-SRR7621304. (15/31)
2021-08-13 09:20:01 [INFO] Processing SRX4451235-SRR7621309. (16/31)
2021-08-13 09:20:31 [INFO] Processing SRX4451235-SRR7621297. (17/31)
2021-08-13 09:21:23 [INFO] Processing SRX4451235-SRR7621300. (18/31)
2021-08-13 09:21:56 [INFO] Processing SRX4451235-SRR7621302. (19/31)
2021-08-13 09:22:49 [INFO] Processing SRX4451235-SRR7621298. (20/31)
2021-08-13 09:23:35 [INFO] Writing to disk...
2021-08-13 09:24:08 [INFO] Processing SRX4451235-SRR7621306. (21/31)
2021-08-13 09:24:26 [INFO] Processing SRX4451235-SRR7621307. (22/31)
2021-08-13 09:24:51 [INFO] Processing SRX4451235-SRR7621310. (23/31)
2021-08-13 09:25:22 [INFO] Processing SRX4451235-SRR7621311. (24/31)
2021-08-13 09:25:51 [INFO] Processing SRX4451235-SRR7621301. (25/31)
2021-08-13 09:26:32 [INFO] Processing SRX4451235-SRR7621308. (26/31)
2021-08-13 09:26:44 [INFO] Processing SRX4451235-SRR7621312. (27/31)
2021-08-13 09:27:12 [INFO] Processing SRX4451235-SRR7621305. (28/31)
2021-08-13 09:27:35 [INFO] Processing SRX4451235-SRR7621303. (29/31)
2021-08-13 09:28:13 [INFO] Processing SRX4451235-SRR7621296. (30/31)
2021-08-13 09:28:54 [INFO] Writing to disk...
2021-08-13 09:29:36 [INFO] Processing SRX4451235-SRR7621295. (31/31)
2021-08-13 09:30:14 [INFO] Writing to disk...
2021-08-13 09:30:58 [INFO] Finished.
2021-08-13 13:15:11 [INFO] Starting.
2021-08-13 13:15:11 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/
2021-08-13 13:15:11 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/aggregate.hdf5
2021-08-13 13:15:11 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-13 13:15:11 [INFO] Building aggregate for 5kbp_raw network.
2021-08-13 13:15:11 [INFO] Writing every 10 Runs.
2021-08-13 13:15:11 [INFO] Processing SRX4451231. (1/2)
2021-08-13 13:15:11 [INFO] Processing SRX4451231-SRR7621292. (1/31)
2021-08-13 13:15:51 [INFO] Processing SRX4451231-SRR7621286. (2/31)
2021-08-13 13:16:50 [INFO] Processing SRX4451231-SRR7621293. (3/31)
2021-08-13 13:17:29 [INFO] Processing SRX4451231-SRR7621287. (4/31)
2021-08-13 13:18:11 [INFO] Processing SRX4451231-SRR7621282. (5/31)
2021-08-13 13:18:56 [INFO] Processing SRX4451231-SRR7621288. (6/31)
2021-08-13 13:19:52 [INFO] Processing SRX4451231-SRR7621283. (7/31)
2021-08-13 13:20:39 [INFO] Processing SRX4451231-SRR7621290. (8/31)
2021-08-13 13:21:30 [INFO] Processing SRX4451231-SRR7621289. (9/31)
2021-08-13 13:22:27 [INFO] Processing SRX4451231-SRR7621294. (10/31)
2021-08-13 13:23:15 [INFO] Writing to disk...
2021-08-13 13:23:55 [INFO] Processing SRX4451231-SRR7621284. (11/31)
2021-08-13 13:24:45 [INFO] Processing SRX4451231-SRR7621291. (12/31)
2021-08-13 13:25:28 [INFO] Processing SRX4451231-SRR7621285. (13/31)
2021-08-13 13:26:17 [INFO] Processing SRX4451235. (2/2)
2021-08-13 13:26:17 [INFO] Processing SRX4451235-SRR7621299. (14/31)
2021-08-13 13:27:03 [INFO] Processing SRX4451235-SRR7621304. (15/31)
2021-08-13 13:27:26 [INFO] Processing SRX4451235-SRR7621309. (16/31)
2021-08-13 13:28:12 [INFO] Processing SRX4451235-SRR7621297. (17/31)
2021-08-13 13:29:04 [INFO] Processing SRX4451235-SRR7621300. (18/31)
2021-08-13 13:29:55 [INFO] Processing SRX4451235-SRR7621302. (19/31)
2021-08-13 13:30:51 [INFO] Processing SRX4451235-SRR7621298. (20/31)
2021-08-13 13:31:53 [INFO] Writing to disk...
2021-08-13 13:33:01 [INFO] Processing SRX4451235-SRR7621306. (21/31)
2021-08-13 13:33:31 [INFO] Processing SRX4451235-SRR7621307. (22/31)
2021-08-13 13:34:17 [INFO] Processing SRX4451235-SRR7621310. (23/31)
2021-08-13 13:35:05 [INFO] Processing SRX4451235-SRR7621311. (24/31)
2021-08-13 13:35:57 [INFO] Processing SRX4451235-SRR7621301. (25/31)
2021-08-13 13:37:04 [INFO] Processing SRX4451235-SRR7621308. (26/31)
2021-08-13 13:37:33 [INFO] Processing SRX4451235-SRR7621312. (27/31)
2021-08-13 13:38:24 [INFO] Processing SRX4451235-SRR7621305. (28/31)
2021-08-13 13:39:01 [INFO] Processing SRX4451235-SRR7621303. (29/31)
2021-08-13 13:39:56 [INFO] Processing SRX4451235-SRR7621296. (30/31)
2021-08-13 13:41:06 [INFO] Writing to disk...
2021-08-13 13:42:33 [INFO] Processing SRX4451235-SRR7621295. (31/31)
2021-08-13 13:43:41 [INFO] Writing to disk...
2021-08-13 13:45:06 [INFO] Finished.
2021-08-16 12:00:16 [INFO] Starting.
2021-08-16 12:00:16 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/
2021-08-16 12:00:16 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/aggregate.hdf5
2021-08-16 12:00:16 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-16 12:00:17 [INFO] Building aggregate for 1kbp_raw network.
2021-08-16 12:00:17 [INFO] Writing every 10 Runs.
2021-08-16 12:00:17 [INFO] Processing SRX4451231. (1/2)
2021-08-16 12:00:17 [INFO] Processing SRX4451231-SRR7621292. (1/31)
2021-08-16 12:00:52 [INFO] Processing SRX4451231-SRR7621286. (2/31)
2021-08-16 12:01:36 [INFO] Processing SRX4451231-SRR7621293. (3/31)
2021-08-16 12:02:25 [INFO] Processing SRX4451231-SRR7621287. (4/31)
2021-08-16 12:03:07 [INFO] Processing SRX4451231-SRR7621282. (5/31)
2021-08-16 12:03:57 [INFO] Processing SRX4451231-SRR7621288. (6/31)
2021-08-16 12:04:57 [INFO] Processing SRX4451231-SRR7621283. (7/31)
2021-08-16 12:05:52 [INFO] Processing SRX4451231-SRR7621290. (8/31)
2021-08-16 12:06:40 [INFO] Processing SRX4451231-SRR7621289. (9/31)
2021-08-16 12:07:32 [INFO] Processing SRX4451231-SRR7621294. (10/31)
2021-08-16 12:08:21 [INFO] Writing to disk...
2021-08-16 12:08:57 [INFO] Processing SRX4451231-SRR7621284. (11/31)
2021-08-16 12:09:42 [INFO] Processing SRX4451231-SRR7621291. (12/31)
2021-08-16 12:10:31 [INFO] Processing SRX4451231-SRR7621285. (13/31)
2021-08-16 12:11:39 [INFO] Processing SRX4451235. (2/2)
2021-08-16 12:11:39 [INFO] Processing SRX4451235-SRR7621299. (14/31)
2021-08-16 12:12:51 [INFO] Processing SRX4451235-SRR7621304. (15/31)
2021-08-16 12:13:15 [INFO] Processing SRX4451235-SRR7621309. (16/31)
2021-08-16 12:14:10 [INFO] Processing SRX4451235-SRR7621297. (17/31)
2021-08-16 12:15:07 [INFO] Processing SRX4451235-SRR7621300. (18/31)
2021-08-16 12:16:01 [INFO] Processing SRX4451235-SRR7621302. (19/31)
2021-08-16 12:17:19 [INFO] Processing SRX4451235-SRR7621298. (20/31)
2021-08-16 12:18:33 [INFO] Writing to disk...
2021-08-16 12:19:39 [INFO] Processing SRX4451235-SRR7621306. (21/31)
2021-08-16 12:20:08 [INFO] Processing SRX4451235-SRR7621307. (22/31)
2021-08-16 12:20:55 [INFO] Processing SRX4451235-SRR7621310. (23/31)
2021-08-16 12:21:56 [INFO] Processing SRX4451235-SRR7621311. (24/31)
2021-08-16 12:22:50 [INFO] Processing SRX4451235-SRR7621301. (25/31)
2021-08-16 12:23:59 [INFO] Processing SRX4451235-SRR7621308. (26/31)
2021-08-16 12:24:23 [INFO] Processing SRX4451235-SRR7621312. (27/31)
2021-08-16 12:25:17 [INFO] Processing SRX4451235-SRR7621305. (28/31)
2021-08-16 12:25:59 [INFO] Processing SRX4451235-SRR7621303. (29/31)
2021-08-16 12:27:00 [INFO] Processing SRX4451235-SRR7621296. (30/31)
2021-08-16 12:28:22 [INFO] Writing to disk...
2021-08-16 12:29:43 [INFO] Processing SRX4451235-SRR7621295. (31/31)
2021-08-16 12:31:08 [INFO] Writing to disk...
2021-08-16 12:32:31 [INFO] Finished.
2021-08-21 00:50:35 [INFO] Starting.
2021-08-21 00:50:35 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/
2021-08-21 00:50:35 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/aggregate.hdf5
2021-08-21 00:50:35 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-21 00:50:35 [INFO] Building aggregate for 100kbp_raw network.
2021-08-21 00:50:35 [INFO] Writing every 10 Runs.
2021-08-21 00:50:35 [INFO] Processing SRX4451231. (1/2)
2021-08-21 00:50:35 [INFO] Processing SRX4451231-SRR7621292. (1/31)
2021-08-21 00:50:52 [INFO] Processing SRX4451231-SRR7621286. (2/31)
2021-08-21 00:51:18 [INFO] Processing SRX4451231-SRR7621293. (3/31)
2021-08-21 00:51:37 [INFO] Processing SRX4451231-SRR7621287. (4/31)
2021-08-21 00:51:55 [INFO] Processing SRX4451231-SRR7621282. (5/31)
2021-08-21 00:52:17 [INFO] Processing SRX4451231-SRR7621288. (6/31)
2021-08-21 00:52:39 [INFO] Processing SRX4451231-SRR7621283. (7/31)
2021-08-21 00:53:00 [INFO] Processing SRX4451231-SRR7621290. (8/31)
2021-08-21 00:53:18 [INFO] Processing SRX4451231-SRR7621289. (9/31)
2021-08-21 00:53:38 [INFO] Processing SRX4451231-SRR7621294. (10/31)
2021-08-21 00:53:54 [INFO] Writing to disk...
2021-08-21 00:54:08 [INFO] Processing SRX4451231-SRR7621284. (11/31)
2021-08-21 00:54:29 [INFO] Processing SRX4451231-SRR7621291. (12/31)
2021-08-21 00:54:52 [INFO] Processing SRX4451231-SRR7621285. (13/31)
2021-08-21 00:55:21 [INFO] Processing SRX4451235. (2/2)
2021-08-21 00:55:21 [INFO] Processing SRX4451235-SRR7621299. (14/31)
2021-08-21 00:55:46 [INFO] Processing SRX4451235-SRR7621304. (15/31)
2021-08-21 00:55:55 [INFO] Processing SRX4451235-SRR7621309. (16/31)
2021-08-21 00:56:16 [INFO] Processing SRX4451235-SRR7621297. (17/31)
2021-08-21 00:56:38 [INFO] Processing SRX4451235-SRR7621300. (18/31)
2021-08-21 00:56:55 [INFO] Processing SRX4451235-SRR7621302. (19/31)
2021-08-21 00:57:26 [INFO] Processing SRX4451235-SRR7621298. (20/31)
2021-08-21 00:57:55 [INFO] Writing to disk...
2021-08-21 00:58:21 [INFO] Processing SRX4451235-SRR7621306. (21/31)
2021-08-21 00:58:33 [INFO] Processing SRX4451235-SRR7621307. (22/31)
2021-08-21 00:58:51 [INFO] Processing SRX4451235-SRR7621310. (23/31)
2021-08-21 00:59:12 [INFO] Processing SRX4451235-SRR7621311. (24/31)
2021-08-21 00:59:33 [INFO] Processing SRX4451235-SRR7621301. (25/31)
2021-08-21 01:00:03 [INFO] Processing SRX4451235-SRR7621308. (26/31)
2021-08-21 01:00:10 [INFO] Processing SRX4451235-SRR7621312. (27/31)
2021-08-21 01:00:27 [INFO] Processing SRX4451235-SRR7621305. (28/31)
2021-08-21 01:00:43 [INFO] Processing SRX4451235-SRR7621303. (29/31)
2021-08-21 01:01:10 [INFO] Processing SRX4451235-SRR7621296. (30/31)
2021-08-21 01:01:46 [INFO] Writing to disk...
2021-08-21 01:02:14 [INFO] Processing SRX4451235-SRR7621295. (31/31)
2021-08-21 01:02:46 [INFO] Writing to disk...
2021-08-21 01:03:20 [INFO] Finished.
2021-08-23 12:21:23 [INFO] Starting.
2021-08-23 12:21:23 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/
2021-08-23 12:21:23 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/aggregate.hdf5
2021-08-23 12:21:23 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 12:21:24 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 12:21:24 [INFO] Writing every 10 Runs.
2021-08-23 12:21:24 [INFO] Processing SRX4451231. (1/2)
2021-08-23 12:21:24 [INFO] Processing SRX4451231-SRR7621292. (1/31)
2021-08-23 12:21:40 [INFO] Processing SRX4451231-SRR7621286. (2/31)
2021-08-23 12:22:03 [INFO] Processing SRX4451231-SRR7621293. (3/31)
2021-08-23 12:22:21 [INFO] Processing SRX4451231-SRR7621287. (4/31)
2021-08-23 12:22:37 [INFO] Processing SRX4451231-SRR7621282. (5/31)
2021-08-23 12:22:51 [INFO] Processing SRX4451231-SRR7621288. (6/31)
2021-08-23 12:23:13 [INFO] Processing SRX4451231-SRR7621283. (7/31)
2021-08-23 12:23:26 [INFO] Processing SRX4451231-SRR7621290. (8/31)
2021-08-23 12:23:42 [INFO] Processing SRX4451231-SRR7621289. (9/31)
2021-08-23 12:23:55 [INFO] Processing SRX4451231-SRR7621294. (10/31)
2021-08-23 12:24:07 [INFO] Writing to disk...
2021-08-23 12:24:10 [INFO] Processing SRX4451231-SRR7621284. (11/31)
2021-08-23 12:24:22 [INFO] Processing SRX4451231-SRR7621291. (12/31)
2021-08-23 12:24:41 [INFO] Processing SRX4451231-SRR7621285. (13/31)
2021-08-23 12:24:56 [INFO] Processing SRX4451235. (2/2)
2021-08-23 12:24:56 [INFO] Processing SRX4451235-SRR7621299. (14/31)
2021-08-23 12:25:08 [INFO] Processing SRX4451235-SRR7621304. (15/31)
2021-08-23 12:25:16 [INFO] Processing SRX4451235-SRR7621309. (16/31)
2021-08-23 12:25:30 [INFO] Processing SRX4451235-SRR7621297. (17/31)
2021-08-23 12:25:45 [INFO] Processing SRX4451235-SRR7621300. (18/31)
2021-08-23 12:25:54 [INFO] Processing SRX4451235-SRR7621302. (19/31)
2021-08-23 12:26:10 [INFO] Processing SRX4451235-SRR7621298. (20/31)
2021-08-23 12:26:23 [INFO] Writing to disk...
2021-08-23 12:26:34 [INFO] Processing SRX4451235-SRR7621306. (21/31)
2021-08-23 12:26:41 [INFO] Processing SRX4451235-SRR7621307. (22/31)
2021-08-23 12:26:51 [INFO] Processing SRX4451235-SRR7621310. (23/31)
2021-08-23 12:27:07 [INFO] Processing SRX4451235-SRR7621311. (24/31)
2021-08-23 12:27:23 [INFO] Processing SRX4451235-SRR7621301. (25/31)
2021-08-23 12:27:37 [INFO] Processing SRX4451235-SRR7621308. (26/31)
2021-08-23 12:27:39 [INFO] Processing SRX4451235-SRR7621312. (27/31)
2021-08-23 12:27:50 [INFO] Processing SRX4451235-SRR7621305. (28/31)
2021-08-23 12:27:59 [INFO] Processing SRX4451235-SRR7621303. (29/31)
2021-08-23 12:28:11 [INFO] Processing SRX4451235-SRR7621296. (30/31)
2021-08-23 12:28:23 [INFO] Writing to disk...
2021-08-23 12:28:31 [INFO] Processing SRX4451235-SRR7621295. (31/31)
2021-08-23 12:28:44 [INFO] Writing to disk...
2021-08-23 12:28:46 [INFO] Finished.
2021-08-23 15:18:59 [INFO] Starting.
2021-08-23 15:18:59 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/
2021-08-23 15:18:59 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP154953/aggregate.hdf5
2021-08-23 15:18:59 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 15:18:59 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 15:18:59 [INFO] Writing every 10 Runs.
2021-08-23 15:18:59 [INFO] Processing SRX4451231. (1/2)
2021-08-23 15:18:59 [INFO] Processing SRX4451231-SRR7621292. (1/31)
2021-08-23 15:19:08 [INFO] Processing SRX4451231-SRR7621286. (2/31)
2021-08-23 15:19:16 [INFO] Processing SRX4451231-SRR7621293. (3/31)
2021-08-23 15:19:25 [INFO] Processing SRX4451231-SRR7621287. (4/31)
2021-08-23 15:19:34 [INFO] Processing SRX4451231-SRR7621282. (5/31)
2021-08-23 15:19:43 [INFO] Processing SRX4451231-SRR7621288. (6/31)
2021-08-23 15:19:53 [INFO] Processing SRX4451231-SRR7621283. (7/31)
2021-08-23 15:20:02 [INFO] Processing SRX4451231-SRR7621290. (8/31)
2021-08-23 15:20:11 [INFO] Processing SRX4451231-SRR7621289. (9/31)
2021-08-23 15:20:20 [INFO] Processing SRX4451231-SRR7621294. (10/31)
2021-08-23 15:20:29 [INFO] Writing to disk...
2021-08-23 15:20:29 [INFO] Processing SRX4451231-SRR7621284. (11/31)
2021-08-23 15:20:38 [INFO] Processing SRX4451231-SRR7621291. (12/31)
2021-08-23 15:20:47 [INFO] Processing SRX4451231-SRR7621285. (13/31)
2021-08-23 15:20:56 [INFO] Processing SRX4451235. (2/2)
2021-08-23 15:20:56 [INFO] Processing SRX4451235-SRR7621299. (14/31)
2021-08-23 15:21:04 [INFO] Processing SRX4451235-SRR7621304. (15/31)
2021-08-23 15:21:11 [INFO] Processing SRX4451235-SRR7621309. (16/31)
2021-08-23 15:21:19 [INFO] Processing SRX4451235-SRR7621297. (17/31)
2021-08-23 15:21:27 [INFO] Processing SRX4451235-SRR7621300. (18/31)
2021-08-23 15:21:35 [INFO] Processing SRX4451235-SRR7621302. (19/31)
2021-08-23 15:21:45 [INFO] Processing SRX4451235-SRR7621298. (20/31)
2021-08-23 15:21:53 [INFO] Writing to disk...
2021-08-23 15:22:05 [INFO] Processing SRX4451235-SRR7621306. (21/31)
2021-08-23 15:22:11 [INFO] Processing SRX4451235-SRR7621307. (22/31)
2021-08-23 15:22:20 [INFO] Processing SRX4451235-SRR7621310. (23/31)
2021-08-23 15:22:29 [INFO] Processing SRX4451235-SRR7621311. (24/31)
2021-08-23 15:22:37 [INFO] Processing SRX4451235-SRR7621301. (25/31)
2021-08-23 15:22:46 [INFO] Processing SRX4451235-SRR7621308. (26/31)
2021-08-23 15:22:51 [INFO] Processing SRX4451235-SRR7621312. (27/31)
2021-08-23 15:22:58 [INFO] Processing SRX4451235-SRR7621305. (28/31)
2021-08-23 15:23:05 [INFO] Processing SRX4451235-SRR7621303. (29/31)
2021-08-23 15:23:15 [INFO] Processing SRX4451235-SRR7621296. (30/31)
2021-08-23 15:23:21 [INFO] Writing to disk...
2021-08-23 15:23:27 [INFO] Processing SRX4451235-SRR7621295. (31/31)
2021-08-23 15:23:38 [INFO] Writing to disk...
2021-08-23 15:23:42 [INFO] Finished.