2021-06-10 02:44:04 [INFO] Starting.
2021-06-10 02:44:04 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/
2021-06-10 02:44:04 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/aggregate.hdf5
2021-06-10 02:44:04 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 02:44:04 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 02:44:05 [INFO] Building aggregate.
2021-06-10 02:44:05 [INFO] Writing every 10 Runs.
2021-06-10 02:44:05 [INFO] Processing SRX4654290. (1/17)
2021-06-10 02:44:05 [INFO] Processing SRX4654290-SRR7802507. (1/17)
2021-06-10 02:44:08 [INFO] Processing SRX4654291. (2/17)
2021-06-10 02:44:08 [INFO] Processing SRX4654291-SRR7802506. (2/17)
2021-06-10 02:44:25 [INFO] Processing SRX4654292. (3/17)
2021-06-10 02:44:25 [INFO] Processing SRX4654292-SRR7802505. (3/17)
2021-06-10 02:44:35 [INFO] Processing SRX4654297. (4/17)
2021-06-10 02:44:35 [INFO] Processing SRX4654297-SRR7802500. (4/17)
2021-06-10 02:44:41 [INFO] Processing SRX4654301. (5/17)
2021-06-10 02:44:41 [INFO] Processing SRX4654301-SRR7802496. (5/17)
2021-06-10 02:44:45 [INFO] Processing SRX4654282. (6/17)
2021-06-10 02:44:45 [INFO] Processing SRX4654282-SRR7802515. (6/17)
2021-06-10 02:44:49 [INFO] Processing SRX4654279. (7/17)
2021-06-10 02:44:49 [INFO] Processing SRX4654279-SRR7802518. (7/17)
2021-06-10 02:44:54 [INFO] Processing SRX4654299. (8/17)
2021-06-10 02:44:54 [INFO] Processing SRX4654299-SRR7802498. (8/17)
2021-06-10 02:44:56 [INFO] Processing SRX4654295. (9/17)
2021-06-10 02:44:56 [INFO] Processing SRX4654295-SRR7802502. (9/17)
2021-06-10 02:45:00 [INFO] Processing SRX4654300. (10/17)
2021-06-10 02:45:00 [INFO] Processing SRX4654300-SRR7802497. (10/17)
2021-06-10 02:45:40 [INFO] Writing to disk...
2021-06-10 02:45:45 [INFO] Processing SRX4654280. (11/17)
2021-06-10 02:45:45 [INFO] Processing SRX4654280-SRR7802517. (11/17)
2021-06-10 02:46:05 [INFO] Processing SRX4654293. (12/17)
2021-06-10 02:46:05 [INFO] Processing SRX4654293-SRR7802504. (12/17)
2021-06-10 02:46:12 [INFO] Processing SRX4654298. (13/17)
2021-06-10 02:46:12 [INFO] Processing SRX4654298-SRR7802499. (13/17)
2021-06-10 02:46:30 [INFO] Processing SRX4654294. (14/17)
2021-06-10 02:46:30 [INFO] Processing SRX4654294-SRR7802503. (14/17)
2021-06-10 02:46:41 [INFO] Processing SRX4654283. (15/17)
2021-06-10 02:46:41 [INFO] Processing SRX4654283-SRR7802514. (15/17)
2021-06-10 02:47:05 [INFO] Processing SRX4654281. (16/17)
2021-06-10 02:47:05 [INFO] Processing SRX4654281-SRR7802516. (16/17)
2021-06-10 02:47:19 [INFO] Processing SRX4654296. (17/17)
2021-06-10 02:47:19 [INFO] Processing SRX4654296-SRR7802501. (17/17)
2021-06-10 02:47:32 [INFO] Writing to disk...
2021-06-10 02:47:47 [INFO] Finished.
2021-08-02 17:08:55 [INFO] Starting.
2021-08-02 17:08:55 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/
2021-08-02 17:08:55 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/aggregate.hdf5
2021-08-02 17:08:55 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-02 17:08:56 [INFO] Building aggregate for 1bp_raw network.
2021-08-02 17:08:56 [INFO] Writing every 10 Runs.
2021-08-02 17:08:56 [INFO] Processing SRX4654290. (1/17)
2021-08-02 17:08:56 [INFO] Processing SRX4654290-SRR7802507. (1/17)
2021-08-02 17:33:28 [INFO] Processing SRX4654291. (2/17)
2021-08-02 17:33:28 [INFO] Processing SRX4654291-SRR7802506. (2/17)
2021-08-02 17:38:58 [ERROR] Adding SRR7802506:chr18_vs_chr4 to in memory aggregate failed. Error message:
Traceback (most recent call last):
  File "/grid/gillis/data/nfox/hi_c_data_processing/software/aggregate.py", line 428, in add_dataset
    aggregate_data[c] = aggregate_data[c] + net
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/base.py", line 415, in __add__
    return self._add_sparse(other)
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 359, in _add_sparse
    return self._binopt(other, '_plus_')
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 1226, in _binopt
    indptr = np.empty(self.indptr.shape, dtype=idx_dtype)
MemoryError: Unable to allocate 307. MiB for an array with shape (80373286,) and data type int32

2021-08-04 22:04:26 [INFO] Starting.
2021-08-04 22:04:26 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/
2021-08-04 22:04:26 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/aggregate.hdf5
2021-08-04 22:04:26 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-04 22:04:26 [INFO] Building aggregate for 1bp_raw network.
2021-08-04 22:04:26 [INFO] Writing every 10 Runs.
2021-08-04 22:04:26 [INFO] Processing SRX4654290. (1/17)
2021-08-04 22:04:26 [INFO] Processing SRX4654290-SRR7802507. (1/17)
2021-08-04 22:07:53 [INFO] Processing SRX4654291. (2/17)
2021-08-04 22:07:53 [INFO] Processing SRX4654291-SRR7802506. (2/17)
2021-08-04 22:15:31 [INFO] Processing SRX4654292. (3/17)
2021-08-04 22:15:31 [INFO] Processing SRX4654292-SRR7802505. (3/17)
2021-08-04 22:23:05 [INFO] Processing SRX4654297. (4/17)
2021-08-04 22:23:05 [INFO] Processing SRX4654297-SRR7802500. (4/17)
2021-08-04 22:33:04 [INFO] Processing SRX4654301. (5/17)
2021-08-04 22:33:04 [INFO] Processing SRX4654301-SRR7802496. (5/17)
2021-08-04 22:40:54 [INFO] Processing SRX4654282. (6/17)
2021-08-04 22:40:54 [INFO] Processing SRX4654282-SRR7802515. (6/17)
2021-08-04 22:48:25 [INFO] Processing SRX4654279. (7/17)
2021-08-04 22:48:25 [INFO] Processing SRX4654279-SRR7802518. (7/17)
2021-08-04 22:55:49 [INFO] Processing SRX4654299. (8/17)
2021-08-04 22:55:49 [INFO] Processing SRX4654299-SRR7802498. (8/17)
2021-08-04 23:03:12 [INFO] Processing SRX4654295. (9/17)
2021-08-04 23:03:12 [INFO] Processing SRX4654295-SRR7802502. (9/17)
2021-08-04 23:10:31 [INFO] Processing SRX4654300. (10/17)
2021-08-04 23:10:31 [INFO] Processing SRX4654300-SRR7802497. (10/17)
2021-08-04 23:18:11 [INFO] Writing to disk...
2021-08-04 23:19:08 [INFO] Processing SRX4654280. (11/17)
2021-08-04 23:19:08 [INFO] Processing SRX4654280-SRR7802517. (11/17)
2021-08-04 23:26:29 [INFO] Processing SRX4654293. (12/17)
2021-08-04 23:26:29 [INFO] Processing SRX4654293-SRR7802504. (12/17)
2021-08-04 23:33:52 [INFO] Processing SRX4654298. (13/17)
2021-08-04 23:33:52 [INFO] Processing SRX4654298-SRR7802499. (13/17)
2021-08-04 23:41:14 [INFO] Processing SRX4654294. (14/17)
2021-08-04 23:41:14 [INFO] Processing SRX4654294-SRR7802503. (14/17)
2021-08-04 23:48:31 [INFO] Processing SRX4654283. (15/17)
2021-08-04 23:48:31 [INFO] Processing SRX4654283-SRR7802514. (15/17)
2021-08-04 23:55:54 [INFO] Processing SRX4654281. (16/17)
2021-08-04 23:55:54 [INFO] Processing SRX4654281-SRR7802516. (16/17)
2021-08-05 00:03:18 [INFO] Processing SRX4654296. (17/17)
2021-08-05 00:03:18 [INFO] Processing SRX4654296-SRR7802501. (17/17)
2021-08-05 00:10:52 [INFO] Writing to disk...
2021-08-05 00:12:12 [INFO] Finished.
2021-08-12 14:31:17 [INFO] Starting.
2021-08-12 14:31:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/
2021-08-12 14:31:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/aggregate.hdf5
2021-08-12 14:31:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:18 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:18 [INFO] Writing every 10 Runs.
2021-08-12 14:31:18 [INFO] Processing SRX4654290. (1/17)
2021-08-12 14:31:18 [INFO] Processing SRX4654290-SRR7802507. (1/17)
2021-08-12 14:31:22 [INFO] Processing SRX4654291. (2/17)
2021-08-12 14:31:22 [INFO] Processing SRX4654291-SRR7802506. (2/17)
2021-08-12 14:31:31 [INFO] Processing SRX4654292. (3/17)
2021-08-12 14:31:31 [INFO] Processing SRX4654292-SRR7802505. (3/17)
2021-08-12 14:31:47 [INFO] Processing SRX4654297. (4/17)
2021-08-12 14:31:47 [INFO] Processing SRX4654297-SRR7802500. (4/17)
2021-08-12 14:31:53 [INFO] Processing SRX4654301. (5/17)
2021-08-12 14:31:53 [INFO] Processing SRX4654301-SRR7802496. (5/17)
2021-08-12 14:31:58 [INFO] Processing SRX4654282. (6/17)
2021-08-12 14:31:58 [INFO] Processing SRX4654282-SRR7802515. (6/17)
2021-08-12 14:32:03 [INFO] Processing SRX4654279. (7/17)
2021-08-12 14:32:03 [INFO] Processing SRX4654279-SRR7802518. (7/17)
2021-08-12 14:32:15 [INFO] Processing SRX4654299. (8/17)
2021-08-12 14:32:15 [INFO] Processing SRX4654299-SRR7802498. (8/17)
2021-08-12 14:32:17 [INFO] Processing SRX4654295. (9/17)
2021-08-12 14:32:17 [INFO] Processing SRX4654295-SRR7802502. (9/17)
2021-08-12 14:32:21 [INFO] Processing SRX4654300. (10/17)
2021-08-12 14:32:21 [INFO] Processing SRX4654300-SRR7802497. (10/17)
2021-08-12 14:32:55 [INFO] Writing to disk...
2021-08-12 14:33:01 [INFO] Processing SRX4654280. (11/17)
2021-08-12 14:33:01 [INFO] Processing SRX4654280-SRR7802517. (11/17)
2021-08-12 14:33:24 [INFO] Processing SRX4654293. (12/17)
2021-08-12 14:33:24 [INFO] Processing SRX4654293-SRR7802504. (12/17)
2021-08-12 14:33:36 [INFO] Processing SRX4654298. (13/17)
2021-08-12 14:33:36 [INFO] Processing SRX4654298-SRR7802499. (13/17)
2021-08-12 14:34:05 [INFO] Processing SRX4654294. (14/17)
2021-08-12 14:34:05 [INFO] Processing SRX4654294-SRR7802503. (14/17)
2021-08-12 14:34:11 [INFO] Processing SRX4654283. (15/17)
2021-08-12 14:34:11 [INFO] Processing SRX4654283-SRR7802514. (15/17)
2021-08-12 14:34:26 [INFO] Processing SRX4654281. (16/17)
2021-08-12 14:34:26 [INFO] Processing SRX4654281-SRR7802516. (16/17)
2021-08-12 14:34:43 [INFO] Processing SRX4654296. (17/17)
2021-08-12 14:34:43 [INFO] Processing SRX4654296-SRR7802501. (17/17)
2021-08-12 14:34:59 [INFO] Writing to disk...
2021-08-12 14:35:18 [INFO] Finished.
2021-08-12 15:09:39 [INFO] Starting.
2021-08-12 15:09:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/
2021-08-12 15:09:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/aggregate.hdf5
2021-08-12 15:09:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:09:40 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 15:09:40 [INFO] Writing every 10 Runs.
2021-08-12 15:09:40 [INFO] Processing SRX4654290. (1/17)
2021-08-12 15:09:40 [INFO] Processing SRX4654290-SRR7802507. (1/17)
2021-08-12 15:09:44 [INFO] Processing SRX4654291. (2/17)
2021-08-12 15:09:44 [INFO] Processing SRX4654291-SRR7802506. (2/17)
2021-08-12 15:09:52 [INFO] Processing SRX4654292. (3/17)
2021-08-12 15:09:52 [INFO] Processing SRX4654292-SRR7802505. (3/17)
2021-08-12 15:10:09 [INFO] Processing SRX4654297. (4/17)
2021-08-12 15:10:09 [INFO] Processing SRX4654297-SRR7802500. (4/17)
2021-08-12 15:10:15 [INFO] Processing SRX4654301. (5/17)
2021-08-12 15:10:15 [INFO] Processing SRX4654301-SRR7802496. (5/17)
2021-08-12 15:10:18 [INFO] Processing SRX4654282. (6/17)
2021-08-12 15:10:18 [INFO] Processing SRX4654282-SRR7802515. (6/17)
2021-08-12 15:10:22 [INFO] Processing SRX4654279. (7/17)
2021-08-12 15:10:22 [INFO] Processing SRX4654279-SRR7802518. (7/17)
2021-08-12 15:10:31 [INFO] Processing SRX4654299. (8/17)
2021-08-12 15:10:31 [INFO] Processing SRX4654299-SRR7802498. (8/17)
2021-08-12 15:10:33 [INFO] Processing SRX4654295. (9/17)
2021-08-12 15:10:33 [INFO] Processing SRX4654295-SRR7802502. (9/17)
2021-08-12 15:10:36 [INFO] Processing SRX4654300. (10/17)
2021-08-12 15:10:36 [INFO] Processing SRX4654300-SRR7802497. (10/17)
2021-08-12 15:11:05 [INFO] Writing to disk...
2021-08-12 15:11:10 [INFO] Processing SRX4654280. (11/17)
2021-08-12 15:11:10 [INFO] Processing SRX4654280-SRR7802517. (11/17)
2021-08-12 15:11:27 [INFO] Processing SRX4654293. (12/17)
2021-08-12 15:11:27 [INFO] Processing SRX4654293-SRR7802504. (12/17)
2021-08-12 15:11:39 [INFO] Processing SRX4654298. (13/17)
2021-08-12 15:11:39 [INFO] Processing SRX4654298-SRR7802499. (13/17)
2021-08-12 15:12:02 [INFO] Processing SRX4654294. (14/17)
2021-08-12 15:12:02 [INFO] Processing SRX4654294-SRR7802503. (14/17)
2021-08-12 15:12:08 [INFO] Processing SRX4654283. (15/17)
2021-08-12 15:12:08 [INFO] Processing SRX4654283-SRR7802514. (15/17)
2021-08-12 15:12:22 [INFO] Processing SRX4654281. (16/17)
2021-08-12 15:12:22 [INFO] Processing SRX4654281-SRR7802516. (16/17)
2021-08-12 15:12:37 [INFO] Processing SRX4654296. (17/17)
2021-08-12 15:12:37 [INFO] Processing SRX4654296-SRR7802501. (17/17)
2021-08-12 15:12:52 [INFO] Writing to disk...
2021-08-12 15:13:08 [INFO] Finished.
2021-08-12 15:44:39 [INFO] Starting.
2021-08-12 15:44:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/
2021-08-12 15:44:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/aggregate.hdf5
2021-08-12 15:44:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:44:40 [INFO] Building aggregate for 5kbp_raw network.
2021-08-12 15:44:40 [INFO] Writing every 10 Runs.
2021-08-12 15:44:40 [INFO] Processing SRX4654290. (1/17)
2021-08-12 15:44:40 [INFO] Processing SRX4654290-SRR7802507. (1/17)
2021-08-12 15:44:43 [INFO] Processing SRX4654291. (2/17)
2021-08-12 15:44:43 [INFO] Processing SRX4654291-SRR7802506. (2/17)
2021-08-12 15:44:54 [INFO] Processing SRX4654292. (3/17)
2021-08-12 15:44:54 [INFO] Processing SRX4654292-SRR7802505. (3/17)
2021-08-12 15:45:11 [INFO] Processing SRX4654297. (4/17)
2021-08-12 15:45:11 [INFO] Processing SRX4654297-SRR7802500. (4/17)
2021-08-12 15:45:17 [INFO] Processing SRX4654301. (5/17)
2021-08-12 15:45:17 [INFO] Processing SRX4654301-SRR7802496. (5/17)
2021-08-12 15:45:20 [INFO] Processing SRX4654282. (6/17)
2021-08-12 15:45:20 [INFO] Processing SRX4654282-SRR7802515. (6/17)
2021-08-12 15:45:26 [INFO] Processing SRX4654279. (7/17)
2021-08-12 15:45:26 [INFO] Processing SRX4654279-SRR7802518. (7/17)
2021-08-12 15:45:37 [INFO] Processing SRX4654299. (8/17)
2021-08-12 15:45:37 [INFO] Processing SRX4654299-SRR7802498. (8/17)
2021-08-12 15:45:40 [INFO] Processing SRX4654295. (9/17)
2021-08-12 15:45:40 [INFO] Processing SRX4654295-SRR7802502. (9/17)
2021-08-12 15:45:44 [INFO] Processing SRX4654300. (10/17)
2021-08-12 15:45:44 [INFO] Processing SRX4654300-SRR7802497. (10/17)
2021-08-12 15:46:12 [INFO] Writing to disk...
2021-08-12 15:46:19 [INFO] Processing SRX4654280. (11/17)
2021-08-12 15:46:19 [INFO] Processing SRX4654280-SRR7802517. (11/17)
2021-08-12 15:46:40 [INFO] Processing SRX4654293. (12/17)
2021-08-12 15:46:40 [INFO] Processing SRX4654293-SRR7802504. (12/17)
2021-08-12 15:46:51 [INFO] Processing SRX4654298. (13/17)
2021-08-12 15:46:51 [INFO] Processing SRX4654298-SRR7802499. (13/17)
2021-08-12 15:47:16 [INFO] Processing SRX4654294. (14/17)
2021-08-12 15:47:16 [INFO] Processing SRX4654294-SRR7802503. (14/17)
2021-08-12 15:47:23 [INFO] Processing SRX4654283. (15/17)
2021-08-12 15:47:23 [INFO] Processing SRX4654283-SRR7802514. (15/17)
2021-08-12 15:47:40 [INFO] Processing SRX4654281. (16/17)
2021-08-12 15:47:40 [INFO] Processing SRX4654281-SRR7802516. (16/17)
2021-08-12 15:48:01 [INFO] Processing SRX4654296. (17/17)
2021-08-12 15:48:01 [INFO] Processing SRX4654296-SRR7802501. (17/17)
2021-08-12 15:48:16 [INFO] Writing to disk...
2021-08-12 15:48:36 [INFO] Finished.
2021-08-12 16:31:34 [INFO] Starting.
2021-08-12 16:31:34 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/
2021-08-12 16:31:34 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/aggregate.hdf5
2021-08-12 16:31:34 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:31:35 [INFO] Building aggregate for 1kbp_raw network.
2021-08-12 16:31:35 [INFO] Writing every 10 Runs.
2021-08-12 16:31:35 [INFO] Processing SRX4654290. (1/17)
2021-08-12 16:31:35 [INFO] Processing SRX4654290-SRR7802507. (1/17)
2021-08-12 16:31:39 [INFO] Processing SRX4654291. (2/17)
2021-08-12 16:31:39 [INFO] Processing SRX4654291-SRR7802506. (2/17)
2021-08-12 16:31:52 [INFO] Processing SRX4654292. (3/17)
2021-08-12 16:31:52 [INFO] Processing SRX4654292-SRR7802505. (3/17)
2021-08-12 16:32:08 [INFO] Processing SRX4654297. (4/17)
2021-08-12 16:32:08 [INFO] Processing SRX4654297-SRR7802500. (4/17)
2021-08-12 16:32:16 [INFO] Processing SRX4654301. (5/17)
2021-08-12 16:32:16 [INFO] Processing SRX4654301-SRR7802496. (5/17)
2021-08-12 16:32:21 [INFO] Processing SRX4654282. (6/17)
2021-08-12 16:32:21 [INFO] Processing SRX4654282-SRR7802515. (6/17)
2021-08-12 16:32:28 [INFO] Processing SRX4654279. (7/17)
2021-08-12 16:32:28 [INFO] Processing SRX4654279-SRR7802518. (7/17)
2021-08-12 16:32:39 [INFO] Processing SRX4654299. (8/17)
2021-08-12 16:32:39 [INFO] Processing SRX4654299-SRR7802498. (8/17)
2021-08-12 16:32:43 [INFO] Processing SRX4654295. (9/17)
2021-08-12 16:32:43 [INFO] Processing SRX4654295-SRR7802502. (9/17)
2021-08-12 16:32:48 [INFO] Processing SRX4654300. (10/17)
2021-08-12 16:32:48 [INFO] Processing SRX4654300-SRR7802497. (10/17)
2021-08-12 16:33:22 [INFO] Writing to disk...
2021-08-12 16:33:30 [INFO] Processing SRX4654280. (11/17)
2021-08-12 16:33:30 [INFO] Processing SRX4654280-SRR7802517. (11/17)
2021-08-12 16:33:57 [INFO] Processing SRX4654293. (12/17)
2021-08-12 16:33:57 [INFO] Processing SRX4654293-SRR7802504. (12/17)
2021-08-12 16:34:11 [INFO] Processing SRX4654298. (13/17)
2021-08-12 16:34:11 [INFO] Processing SRX4654298-SRR7802499. (13/17)
2021-08-12 16:34:43 [INFO] Processing SRX4654294. (14/17)
2021-08-12 16:34:43 [INFO] Processing SRX4654294-SRR7802503. (14/17)
2021-08-12 16:34:50 [INFO] Processing SRX4654283. (15/17)
2021-08-12 16:34:50 [INFO] Processing SRX4654283-SRR7802514. (15/17)
2021-08-12 16:35:10 [INFO] Processing SRX4654281. (16/17)
2021-08-12 16:35:10 [INFO] Processing SRX4654281-SRR7802516. (16/17)
2021-08-12 16:35:31 [INFO] Processing SRX4654296. (17/17)
2021-08-12 16:35:31 [INFO] Processing SRX4654296-SRR7802501. (17/17)
2021-08-12 16:35:56 [INFO] Writing to disk...
2021-08-12 16:36:21 [INFO] Finished.
2021-08-20 17:44:31 [INFO] Starting.
2021-08-20 17:44:31 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/
2021-08-20 17:44:31 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/aggregate.hdf5
2021-08-20 17:44:31 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-20 17:44:32 [INFO] Building aggregate for 100kbp_raw network.
2021-08-20 17:44:32 [INFO] Writing every 10 Runs.
2021-08-20 17:44:32 [INFO] Processing SRX4654290. (1/17)
2021-08-20 17:44:32 [INFO] Processing SRX4654290-SRR7802507. (1/17)
2021-08-20 17:44:35 [INFO] Processing SRX4654291. (2/17)
2021-08-20 17:44:35 [INFO] Processing SRX4654291-SRR7802506. (2/17)
2021-08-20 17:44:43 [INFO] Processing SRX4654292. (3/17)
2021-08-20 17:44:43 [INFO] Processing SRX4654292-SRR7802505. (3/17)
2021-08-20 17:44:56 [INFO] Processing SRX4654297. (4/17)
2021-08-20 17:44:56 [INFO] Processing SRX4654297-SRR7802500. (4/17)
2021-08-20 17:45:02 [INFO] Processing SRX4654301. (5/17)
2021-08-20 17:45:02 [INFO] Processing SRX4654301-SRR7802496. (5/17)
2021-08-20 17:45:05 [INFO] Processing SRX4654282. (6/17)
2021-08-20 17:45:05 [INFO] Processing SRX4654282-SRR7802515. (6/17)
2021-08-20 17:45:10 [INFO] Processing SRX4654279. (7/17)
2021-08-20 17:45:10 [INFO] Processing SRX4654279-SRR7802518. (7/17)
2021-08-20 17:45:19 [INFO] Processing SRX4654299. (8/17)
2021-08-20 17:45:19 [INFO] Processing SRX4654299-SRR7802498. (8/17)
2021-08-20 17:45:22 [INFO] Processing SRX4654295. (9/17)
2021-08-20 17:45:22 [INFO] Processing SRX4654295-SRR7802502. (9/17)
2021-08-20 17:45:26 [INFO] Processing SRX4654300. (10/17)
2021-08-20 17:45:26 [INFO] Processing SRX4654300-SRR7802497. (10/17)
2021-08-20 17:45:53 [INFO] Writing to disk...
2021-08-20 17:45:58 [INFO] Processing SRX4654280. (11/17)
2021-08-20 17:45:58 [INFO] Processing SRX4654280-SRR7802517. (11/17)
2021-08-20 17:46:17 [INFO] Processing SRX4654293. (12/17)
2021-08-20 17:46:17 [INFO] Processing SRX4654293-SRR7802504. (12/17)
2021-08-20 17:46:26 [INFO] Processing SRX4654298. (13/17)
2021-08-20 17:46:26 [INFO] Processing SRX4654298-SRR7802499. (13/17)
2021-08-20 17:46:49 [INFO] Processing SRX4654294. (14/17)
2021-08-20 17:46:49 [INFO] Processing SRX4654294-SRR7802503. (14/17)
2021-08-20 17:46:54 [INFO] Processing SRX4654283. (15/17)
2021-08-20 17:46:54 [INFO] Processing SRX4654283-SRR7802514. (15/17)
2021-08-20 17:47:05 [INFO] Processing SRX4654281. (16/17)
2021-08-20 17:47:05 [INFO] Processing SRX4654281-SRR7802516. (16/17)
2021-08-20 17:47:19 [INFO] Processing SRX4654296. (17/17)
2021-08-20 17:47:19 [INFO] Processing SRX4654296-SRR7802501. (17/17)
2021-08-20 17:47:32 [INFO] Writing to disk...
2021-08-20 17:47:47 [INFO] Finished.
2021-08-23 11:28:00 [INFO] Starting.
2021-08-23 11:28:00 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/
2021-08-23 11:28:00 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/aggregate.hdf5
2021-08-23 11:28:00 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 11:28:01 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 11:28:01 [INFO] Writing every 10 Runs.
2021-08-23 11:28:01 [INFO] Processing SRX4654290. (1/17)
2021-08-23 11:28:01 [INFO] Processing SRX4654290-SRR7802507. (1/17)
2021-08-23 11:28:03 [INFO] Processing SRX4654291. (2/17)
2021-08-23 11:28:03 [INFO] Processing SRX4654291-SRR7802506. (2/17)
2021-08-23 11:28:08 [INFO] Processing SRX4654292. (3/17)
2021-08-23 11:28:08 [INFO] Processing SRX4654292-SRR7802505. (3/17)
2021-08-23 11:28:15 [INFO] Processing SRX4654297. (4/17)
2021-08-23 11:28:15 [INFO] Processing SRX4654297-SRR7802500. (4/17)
2021-08-23 11:28:18 [INFO] Processing SRX4654301. (5/17)
2021-08-23 11:28:18 [INFO] Processing SRX4654301-SRR7802496. (5/17)
2021-08-23 11:28:20 [INFO] Processing SRX4654282. (6/17)
2021-08-23 11:28:20 [INFO] Processing SRX4654282-SRR7802515. (6/17)
2021-08-23 11:28:23 [INFO] Processing SRX4654279. (7/17)
2021-08-23 11:28:23 [INFO] Processing SRX4654279-SRR7802518. (7/17)
2021-08-23 11:28:29 [INFO] Processing SRX4654299. (8/17)
2021-08-23 11:28:29 [INFO] Processing SRX4654299-SRR7802498. (8/17)
2021-08-23 11:28:31 [INFO] Processing SRX4654295. (9/17)
2021-08-23 11:28:31 [INFO] Processing SRX4654295-SRR7802502. (9/17)
2021-08-23 11:28:33 [INFO] Processing SRX4654300. (10/17)
2021-08-23 11:28:33 [INFO] Processing SRX4654300-SRR7802497. (10/17)
2021-08-23 11:28:50 [INFO] Writing to disk...
2021-08-23 11:28:51 [INFO] Processing SRX4654280. (11/17)
2021-08-23 11:28:51 [INFO] Processing SRX4654280-SRR7802517. (11/17)
2021-08-23 11:29:01 [INFO] Processing SRX4654293. (12/17)
2021-08-23 11:29:01 [INFO] Processing SRX4654293-SRR7802504. (12/17)
2021-08-23 11:29:06 [INFO] Processing SRX4654298. (13/17)
2021-08-23 11:29:06 [INFO] Processing SRX4654298-SRR7802499. (13/17)
2021-08-23 11:29:17 [INFO] Processing SRX4654294. (14/17)
2021-08-23 11:29:17 [INFO] Processing SRX4654294-SRR7802503. (14/17)
2021-08-23 11:29:19 [INFO] Processing SRX4654283. (15/17)
2021-08-23 11:29:19 [INFO] Processing SRX4654283-SRR7802514. (15/17)
2021-08-23 11:29:26 [INFO] Processing SRX4654281. (16/17)
2021-08-23 11:29:26 [INFO] Processing SRX4654281-SRR7802516. (16/17)
2021-08-23 11:29:32 [INFO] Processing SRX4654296. (17/17)
2021-08-23 11:29:32 [INFO] Processing SRX4654296-SRR7802501. (17/17)
2021-08-23 11:29:41 [INFO] Writing to disk...
2021-08-23 11:29:45 [INFO] Finished.
2021-08-23 13:15:15 [INFO] Starting.
2021-08-23 13:15:15 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/
2021-08-23 13:15:15 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP160101/aggregate.hdf5
2021-08-23 13:15:15 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:15:16 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 13:15:16 [INFO] Writing every 10 Runs.
2021-08-23 13:15:16 [INFO] Processing SRX4654290. (1/17)
2021-08-23 13:15:16 [INFO] Processing SRX4654290-SRR7802507. (1/17)
2021-08-23 13:15:18 [INFO] Processing SRX4654291. (2/17)
2021-08-23 13:15:18 [INFO] Processing SRX4654291-SRR7802506. (2/17)
2021-08-23 13:15:22 [INFO] Processing SRX4654292. (3/17)
2021-08-23 13:15:22 [INFO] Processing SRX4654292-SRR7802505. (3/17)
2021-08-23 13:15:27 [INFO] Processing SRX4654297. (4/17)
2021-08-23 13:15:27 [INFO] Processing SRX4654297-SRR7802500. (4/17)
2021-08-23 13:15:31 [INFO] Processing SRX4654301. (5/17)
2021-08-23 13:15:31 [INFO] Processing SRX4654301-SRR7802496. (5/17)
2021-08-23 13:15:33 [INFO] Processing SRX4654282. (6/17)
2021-08-23 13:15:33 [INFO] Processing SRX4654282-SRR7802515. (6/17)
2021-08-23 13:15:35 [INFO] Processing SRX4654279. (7/17)
2021-08-23 13:15:35 [INFO] Processing SRX4654279-SRR7802518. (7/17)
2021-08-23 13:15:39 [INFO] Processing SRX4654299. (8/17)
2021-08-23 13:15:39 [INFO] Processing SRX4654299-SRR7802498. (8/17)
2021-08-23 13:15:40 [INFO] Processing SRX4654295. (9/17)
2021-08-23 13:15:40 [INFO] Processing SRX4654295-SRR7802502. (9/17)
2021-08-23 13:15:42 [INFO] Processing SRX4654300. (10/17)
2021-08-23 13:15:42 [INFO] Processing SRX4654300-SRR7802497. (10/17)
2021-08-23 13:15:48 [INFO] Writing to disk...
2021-08-23 13:15:49 [INFO] Processing SRX4654280. (11/17)
2021-08-23 13:15:49 [INFO] Processing SRX4654280-SRR7802517. (11/17)
2021-08-23 13:15:55 [INFO] Processing SRX4654293. (12/17)
2021-08-23 13:15:55 [INFO] Processing SRX4654293-SRR7802504. (12/17)
2021-08-23 13:15:59 [INFO] Processing SRX4654298. (13/17)
2021-08-23 13:15:59 [INFO] Processing SRX4654298-SRR7802499. (13/17)
2021-08-23 13:16:06 [INFO] Processing SRX4654294. (14/17)
2021-08-23 13:16:06 [INFO] Processing SRX4654294-SRR7802503. (14/17)
2021-08-23 13:16:09 [INFO] Processing SRX4654283. (15/17)
2021-08-23 13:16:09 [INFO] Processing SRX4654283-SRR7802514. (15/17)
2021-08-23 13:16:14 [INFO] Processing SRX4654281. (16/17)
2021-08-23 13:16:14 [INFO] Processing SRX4654281-SRR7802516. (16/17)
2021-08-23 13:16:18 [INFO] Processing SRX4654296. (17/17)
2021-08-23 13:16:18 [INFO] Processing SRX4654296-SRR7802501. (17/17)
2021-08-23 13:16:25 [INFO] Writing to disk...
2021-08-23 13:16:25 [INFO] Finished.