2021-06-10 01:07:43 [INFO] Starting.
2021-06-10 01:07:43 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/
2021-06-10 01:07:43 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/aggregate.hdf5
2021-06-10 01:07:43 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 01:07:43 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 01:07:44 [INFO] Building aggregate.
2021-06-10 01:07:44 [INFO] Writing every 10 Runs.
2021-06-10 01:07:44 [INFO] Processing SRX8570418. (1/38)
2021-06-10 01:07:44 [INFO] Processing SRX8570418-SRR12040660. (1/38)
2021-06-10 01:07:50 [INFO] Processing SRX8570414. (2/38)
2021-06-10 01:07:50 [INFO] Processing SRX8570414-SRR12040679. (2/38)
2021-06-10 01:07:58 [INFO] Processing SRX6841311. (3/38)
2021-06-10 01:07:58 [INFO] Processing SRX6841311-SRR10109422. (3/38)
2021-06-10 01:08:07 [INFO] Processing SRX8570424. (4/38)
2021-06-10 01:08:07 [INFO] Processing SRX8570424-SRR12040666. (4/38)
2021-06-10 01:08:13 [INFO] Processing SRX8570412. (5/38)
2021-06-10 01:08:13 [INFO] Processing SRX8570412-SRR12040677. (5/38)
2021-06-10 01:08:32 [INFO] Processing SRX8570413. (6/38)
2021-06-10 01:08:32 [INFO] Processing SRX8570413-SRR12040678. (6/38)
2021-06-10 01:08:38 [INFO] Processing SRX8570433. (7/38)
2021-06-10 01:08:38 [INFO] Processing SRX8570433-SRR12040683. (7/38)
2021-06-10 01:08:48 [INFO] Processing SRX8570434. (8/38)
2021-06-10 01:08:48 [INFO] Processing SRX8570434-SRR12040684. (8/38)
2021-06-10 01:08:56 [INFO] Processing SRX8570425. (9/38)
2021-06-10 01:08:56 [INFO] Processing SRX8570425-SRR12040667. (9/38)
2021-06-10 01:09:06 [INFO] Processing SRX8570415. (10/38)
2021-06-10 01:09:06 [INFO] Processing SRX8570415-SRR12040680. (10/38)
2021-06-10 01:09:15 [INFO] Writing to disk...
2021-06-10 01:09:20 [INFO] Processing SRX6841313. (11/38)
2021-06-10 01:09:20 [INFO] Processing SRX6841313-SRR10109424. (11/38)
2021-06-10 01:09:43 [INFO] Processing SRX8570426. (12/38)
2021-06-10 01:09:43 [INFO] Processing SRX8570426-SRR12040668. (12/38)
2021-06-10 01:09:51 [INFO] Processing SRX8570431. (13/38)
2021-06-10 01:09:51 [INFO] Processing SRX8570431-SRR12040673. (13/38)
2021-06-10 01:10:03 [INFO] Processing SRX8570429. (14/38)
2021-06-10 01:10:03 [INFO] Processing SRX8570429-SRR12040671. (14/38)
2021-06-10 01:10:12 [INFO] Processing SRX6841304. (15/38)
2021-06-10 01:10:12 [INFO] Processing SRX6841304-SRR10109415. (15/38)
2021-06-10 01:10:18 [INFO] Processing SRX8570416. (16/38)
2021-06-10 01:10:18 [INFO] Processing SRX8570416-SRR12040681. (16/38)
2021-06-10 01:10:28 [INFO] Processing SRX6841309. (17/38)
2021-06-10 01:10:28 [INFO] Processing SRX6841309-SRR10109420. (17/38)
2021-06-10 01:10:56 [INFO] Processing SRX6841308. (18/38)
2021-06-10 01:10:56 [INFO] Processing SRX6841308-SRR10109419. (18/38)
2021-06-10 01:11:04 [INFO] Processing SRX8570421. (19/38)
2021-06-10 01:11:04 [INFO] Processing SRX8570421-SRR12040663. (19/38)
2021-06-10 01:11:10 [INFO] Processing SRX8570410. (20/38)
2021-06-10 01:11:10 [INFO] Processing SRX8570410-SRR12040675. (20/38)
2021-06-10 01:11:19 [INFO] Writing to disk...
2021-06-10 01:11:33 [INFO] Processing SRX8570432. (21/38)
2021-06-10 01:11:33 [INFO] Processing SRX8570432-SRR12040674. (21/38)
2021-06-10 01:11:41 [INFO] Processing SRX6841307. (22/38)
2021-06-10 01:11:41 [INFO] Processing SRX6841307-SRR10109418. (22/38)
2021-06-10 01:11:50 [INFO] Processing SRX6841306. (23/38)
2021-06-10 01:11:50 [INFO] Processing SRX6841306-SRR10109417. (23/38)
2021-06-10 01:11:58 [INFO] Processing SRX6841303. (24/38)
2021-06-10 01:11:58 [INFO] Processing SRX6841303-SRR10109414. (24/38)
2021-06-10 01:12:16 [INFO] Processing SRX8570427. (25/38)
2021-06-10 01:12:16 [INFO] Processing SRX8570427-SRR12040669. (25/38)
2021-06-10 01:12:27 [INFO] Processing SRX8570422. (26/38)
2021-06-10 01:12:27 [INFO] Processing SRX8570422-SRR12040664. (26/38)
2021-06-10 01:12:34 [INFO] Processing SRX8570435. (27/38)
2021-06-10 01:12:34 [INFO] Processing SRX8570435-SRR12040685. (27/38)
2021-06-10 01:12:43 [INFO] Processing SRX8570428. (28/38)
2021-06-10 01:12:43 [INFO] Processing SRX8570428-SRR12040670. (28/38)
2021-06-10 01:12:54 [INFO] Processing SRX8570417. (29/38)
2021-06-10 01:12:54 [INFO] Processing SRX8570417-SRR12040682. (29/38)
2021-06-10 01:13:03 [INFO] Processing SRX8570430. (30/38)
2021-06-10 01:13:03 [INFO] Processing SRX8570430-SRR12040672. (30/38)
2021-06-10 01:13:23 [INFO] Writing to disk...
2021-06-10 01:13:42 [INFO] Processing SRX8570419. (31/38)
2021-06-10 01:13:42 [INFO] Processing SRX8570419-SRR12040661. (31/38)
2021-06-10 01:13:49 [INFO] Processing SRX6841305. (32/38)
2021-06-10 01:13:49 [INFO] Processing SRX6841305-SRR10109416. (32/38)
2021-06-10 01:13:57 [INFO] Processing SRX8570423. (33/38)
2021-06-10 01:13:57 [INFO] Processing SRX8570423-SRR12040665. (33/38)
2021-06-10 01:14:06 [INFO] Processing SRX8570411. (34/38)
2021-06-10 01:14:06 [INFO] Processing SRX8570411-SRR12040676. (34/38)
2021-06-10 01:14:16 [INFO] Processing SRX6841310. (35/38)
2021-06-10 01:14:16 [INFO] Processing SRX6841310-SRR10109421. (35/38)
2021-06-10 01:14:40 [INFO] Processing SRX6841312. (36/38)
2021-06-10 01:14:40 [INFO] Processing SRX6841312-SRR10109423. (36/38)
2021-06-10 01:14:52 [INFO] Processing SRX8570420. (37/38)
2021-06-10 01:14:52 [INFO] Processing SRX8570420-SRR12040662. (37/38)
2021-06-10 01:15:04 [INFO] Processing SRX6841314. (38/38)
2021-06-10 01:15:04 [INFO] Processing SRX6841314-SRR10109425. (38/38)
2021-06-10 01:15:19 [INFO] Writing to disk...
2021-06-10 01:15:53 [INFO] Finished.
2021-08-02 17:08:55 [INFO] Starting.
2021-08-02 17:08:56 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/
2021-08-02 17:08:56 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/aggregate.hdf5
2021-08-02 17:08:56 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-02 17:08:56 [INFO] Building aggregate for 1bp_raw network.
2021-08-02 17:08:56 [INFO] Writing every 10 Runs.
2021-08-02 17:08:56 [INFO] Processing SRX8570418. (1/38)
2021-08-02 17:08:56 [INFO] Processing SRX8570418-SRR12040660. (1/38)
2021-08-02 17:48:08 [INFO] Processing SRX8570414. (2/38)
2021-08-02 17:48:08 [INFO] Processing SRX8570414-SRR12040679. (2/38)
2021-08-02 17:57:01 [ERROR] Adding SRR12040679:chr8_vs_chrX to in memory aggregate failed. Error message:
Traceback (most recent call last):
  File "/grid/gillis/data/nfox/hi_c_data_processing/software/aggregate.py", line 428, in add_dataset
    aggregate_data[c] = aggregate_data[c] + net
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/base.py", line 415, in __add__
    return self._add_sparse(other)
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 359, in _add_sparse
    return self._binopt(other, '_plus_')
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 1226, in _binopt
    indptr = np.empty(self.indptr.shape, dtype=idx_dtype)
MemoryError: Unable to allocate 554. MiB for an array with shape (145138637,) and data type int32

2021-08-04 22:08:19 [INFO] Starting.
2021-08-04 22:08:19 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/
2021-08-04 22:08:19 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/aggregate.hdf5
2021-08-04 22:08:19 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-04 22:08:20 [INFO] Building aggregate for 1bp_raw network.
2021-08-04 22:08:20 [INFO] Writing every 10 Runs.
2021-08-04 22:08:20 [INFO] Processing SRX8570418. (1/38)
2021-08-04 22:08:20 [INFO] Processing SRX8570418-SRR12040660. (1/38)
2021-08-04 22:11:40 [INFO] Processing SRX8570414. (2/38)
2021-08-04 22:11:40 [INFO] Processing SRX8570414-SRR12040679. (2/38)
2021-08-04 22:19:09 [INFO] Processing SRX6841311. (3/38)
2021-08-04 22:19:09 [INFO] Processing SRX6841311-SRR10109422. (3/38)
2021-08-04 22:26:35 [INFO] Processing SRX8570424. (4/38)
2021-08-04 22:26:35 [INFO] Processing SRX8570424-SRR12040666. (4/38)
2021-08-04 22:34:02 [INFO] Processing SRX8570412. (5/38)
2021-08-04 22:34:03 [INFO] Processing SRX8570412-SRR12040677. (5/38)
2021-08-04 22:40:58 [INFO] Processing SRX8570413. (6/38)
2021-08-04 22:40:58 [INFO] Processing SRX8570413-SRR12040678. (6/38)
2021-08-04 22:47:48 [INFO] Processing SRX8570433. (7/38)
2021-08-04 22:47:48 [INFO] Processing SRX8570433-SRR12040683. (7/38)
2021-08-04 22:54:40 [INFO] Processing SRX8570434. (8/38)
2021-08-04 22:54:40 [INFO] Processing SRX8570434-SRR12040684. (8/38)
2021-08-04 23:01:35 [INFO] Processing SRX8570425. (9/38)
2021-08-04 23:01:35 [INFO] Processing SRX8570425-SRR12040667. (9/38)
2021-08-04 23:08:30 [INFO] Processing SRX8570415. (10/38)
2021-08-04 23:08:30 [INFO] Processing SRX8570415-SRR12040680. (10/38)
2021-08-04 23:15:26 [INFO] Writing to disk...
2021-08-04 23:16:14 [INFO] Processing SRX6841313. (11/38)
2021-08-04 23:16:14 [INFO] Processing SRX6841313-SRR10109424. (11/38)
2021-08-04 23:23:14 [INFO] Processing SRX8570426. (12/38)
2021-08-04 23:23:14 [INFO] Processing SRX8570426-SRR12040668. (12/38)
2021-08-04 23:30:06 [INFO] Processing SRX8570431. (13/38)
2021-08-04 23:30:06 [INFO] Processing SRX8570431-SRR12040673. (13/38)
2021-08-04 23:37:03 [INFO] Processing SRX8570429. (14/38)
2021-08-04 23:37:03 [INFO] Processing SRX8570429-SRR12040671. (14/38)
2021-08-04 23:43:56 [INFO] Processing SRX6841304. (15/38)
2021-08-04 23:43:56 [INFO] Processing SRX6841304-SRR10109415. (15/38)
2021-08-04 23:50:45 [INFO] Processing SRX8570416. (16/38)
2021-08-04 23:50:45 [INFO] Processing SRX8570416-SRR12040681. (16/38)
2021-08-04 23:57:42 [INFO] Processing SRX6841309. (17/38)
2021-08-04 23:57:42 [INFO] Processing SRX6841309-SRR10109420. (17/38)
2021-08-05 00:04:44 [INFO] Processing SRX6841308. (18/38)
2021-08-05 00:04:44 [INFO] Processing SRX6841308-SRR10109419. (18/38)
2021-08-05 00:11:36 [INFO] Processing SRX8570421. (19/38)
2021-08-05 00:11:36 [INFO] Processing SRX8570421-SRR12040663. (19/38)
2021-08-05 00:18:23 [INFO] Processing SRX8570410. (20/38)
2021-08-05 00:18:23 [INFO] Processing SRX8570410-SRR12040675. (20/38)
2021-08-05 00:25:17 [INFO] Writing to disk...
2021-08-05 00:26:20 [INFO] Processing SRX8570432. (21/38)
2021-08-05 00:26:20 [INFO] Processing SRX8570432-SRR12040674. (21/38)
2021-08-05 00:33:21 [INFO] Processing SRX6841307. (22/38)
2021-08-05 00:33:21 [INFO] Processing SRX6841307-SRR10109418. (22/38)
2021-08-05 00:40:13 [INFO] Processing SRX6841306. (23/38)
2021-08-05 00:40:13 [INFO] Processing SRX6841306-SRR10109417. (23/38)
2021-08-05 00:47:02 [INFO] Processing SRX6841303. (24/38)
2021-08-05 00:47:02 [INFO] Processing SRX6841303-SRR10109414. (24/38)
2021-08-05 00:53:53 [INFO] Processing SRX8570427. (25/38)
2021-08-05 00:53:53 [INFO] Processing SRX8570427-SRR12040669. (25/38)
2021-08-05 01:00:57 [INFO] Processing SRX8570422. (26/38)
2021-08-05 01:00:57 [INFO] Processing SRX8570422-SRR12040664. (26/38)
2021-08-05 01:07:53 [INFO] Processing SRX8570435. (27/38)
2021-08-05 01:07:53 [INFO] Processing SRX8570435-SRR12040685. (27/38)
2021-08-05 01:14:56 [INFO] Processing SRX8570428. (28/38)
2021-08-05 01:14:56 [INFO] Processing SRX8570428-SRR12040670. (28/38)
2021-08-05 01:21:57 [INFO] Processing SRX8570417. (29/38)
2021-08-05 01:21:57 [INFO] Processing SRX8570417-SRR12040682. (29/38)
2021-08-05 01:29:01 [INFO] Processing SRX8570430. (30/38)
2021-08-05 01:29:01 [INFO] Processing SRX8570430-SRR12040672. (30/38)
2021-08-05 01:36:08 [INFO] Writing to disk...
2021-08-05 01:37:25 [INFO] Processing SRX8570419. (31/38)
2021-08-05 01:37:25 [INFO] Processing SRX8570419-SRR12040661. (31/38)
2021-08-05 01:44:25 [INFO] Processing SRX6841305. (32/38)
2021-08-05 01:44:25 [INFO] Processing SRX6841305-SRR10109416. (32/38)
2021-08-05 01:51:22 [INFO] Processing SRX8570423. (33/38)
2021-08-05 01:51:22 [INFO] Processing SRX8570423-SRR12040665. (33/38)
2021-08-05 01:58:30 [INFO] Processing SRX8570411. (34/38)
2021-08-05 01:58:30 [INFO] Processing SRX8570411-SRR12040676. (34/38)
2021-08-05 02:05:36 [INFO] Processing SRX6841310. (35/38)
2021-08-05 02:05:36 [INFO] Processing SRX6841310-SRR10109421. (35/38)
2021-08-05 02:12:47 [INFO] Processing SRX6841312. (36/38)
2021-08-05 02:12:47 [INFO] Processing SRX6841312-SRR10109423. (36/38)
2021-08-05 02:19:58 [INFO] Processing SRX8570420. (37/38)
2021-08-05 02:19:58 [INFO] Processing SRX8570420-SRR12040662. (37/38)
2021-08-05 02:27:12 [INFO] Processing SRX6841314. (38/38)
2021-08-05 02:27:12 [INFO] Processing SRX6841314-SRR10109425. (38/38)
2021-08-05 02:34:29 [INFO] Writing to disk...
2021-08-05 02:35:53 [INFO] Finished.
2021-08-12 17:20:23 [INFO] Starting.
2021-08-12 17:20:23 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/
2021-08-12 17:20:23 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/aggregate.hdf5
2021-08-12 17:20:23 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 17:20:24 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 17:20:24 [INFO] Writing every 10 Runs.
2021-08-12 17:20:24 [INFO] Processing SRX8570418. (1/38)
2021-08-12 17:20:24 [INFO] Processing SRX8570418-SRR12040660. (1/38)
2021-08-12 17:20:29 [INFO] Processing SRX8570414. (2/38)
2021-08-12 17:20:29 [INFO] Processing SRX8570414-SRR12040679. (2/38)
2021-08-12 17:20:38 [INFO] Processing SRX6841311. (3/38)
2021-08-12 17:20:38 [INFO] Processing SRX6841311-SRR10109422. (3/38)
2021-08-12 17:20:50 [INFO] Processing SRX8570424. (4/38)
2021-08-12 17:20:50 [INFO] Processing SRX8570424-SRR12040666. (4/38)
2021-08-12 17:20:58 [INFO] Processing SRX8570412. (5/38)
2021-08-12 17:20:58 [INFO] Processing SRX8570412-SRR12040677. (5/38)
2021-08-12 17:21:04 [INFO] Processing SRX8570413. (6/38)
2021-08-12 17:21:04 [INFO] Processing SRX8570413-SRR12040678. (6/38)
2021-08-12 17:21:14 [INFO] Processing SRX8570433. (7/38)
2021-08-12 17:21:14 [INFO] Processing SRX8570433-SRR12040683. (7/38)
2021-08-12 17:21:24 [INFO] Processing SRX8570434. (8/38)
2021-08-12 17:21:24 [INFO] Processing SRX8570434-SRR12040684. (8/38)
2021-08-12 17:21:34 [INFO] Processing SRX8570425. (9/38)
2021-08-12 17:21:34 [INFO] Processing SRX8570425-SRR12040667. (9/38)
2021-08-12 17:21:45 [INFO] Processing SRX8570415. (10/38)
2021-08-12 17:21:45 [INFO] Processing SRX8570415-SRR12040680. (10/38)
2021-08-12 17:21:55 [INFO] Writing to disk...
2021-08-12 17:21:59 [INFO] Processing SRX6841313. (11/38)
2021-08-12 17:21:59 [INFO] Processing SRX6841313-SRR10109424. (11/38)
2021-08-12 17:22:11 [INFO] Processing SRX8570426. (12/38)
2021-08-12 17:22:11 [INFO] Processing SRX8570426-SRR12040668. (12/38)
2021-08-12 17:22:19 [INFO] Processing SRX8570431. (13/38)
2021-08-12 17:22:19 [INFO] Processing SRX8570431-SRR12040673. (13/38)
2021-08-12 17:22:29 [INFO] Processing SRX8570429. (14/38)
2021-08-12 17:22:29 [INFO] Processing SRX8570429-SRR12040671. (14/38)
2021-08-12 17:22:36 [INFO] Processing SRX6841304. (15/38)
2021-08-12 17:22:36 [INFO] Processing SRX6841304-SRR10109415. (15/38)
2021-08-12 17:22:41 [INFO] Processing SRX8570416. (16/38)
2021-08-12 17:22:41 [INFO] Processing SRX8570416-SRR12040681. (16/38)
2021-08-12 17:22:51 [INFO] Processing SRX6841309. (17/38)
2021-08-12 17:22:51 [INFO] Processing SRX6841309-SRR10109420. (17/38)
2021-08-12 17:23:05 [INFO] Processing SRX6841308. (18/38)
2021-08-12 17:23:05 [INFO] Processing SRX6841308-SRR10109419. (18/38)
2021-08-12 17:23:12 [INFO] Processing SRX8570421. (19/38)
2021-08-12 17:23:12 [INFO] Processing SRX8570421-SRR12040663. (19/38)
2021-08-12 17:23:19 [INFO] Processing SRX8570410. (20/38)
2021-08-12 17:23:19 [INFO] Processing SRX8570410-SRR12040675. (20/38)
2021-08-12 17:23:30 [INFO] Writing to disk...
2021-08-12 17:23:43 [INFO] Processing SRX8570432. (21/38)
2021-08-12 17:23:43 [INFO] Processing SRX8570432-SRR12040674. (21/38)
2021-08-12 17:23:50 [INFO] Processing SRX6841307. (22/38)
2021-08-12 17:23:50 [INFO] Processing SRX6841307-SRR10109418. (22/38)
2021-08-12 17:23:56 [INFO] Processing SRX6841306. (23/38)
2021-08-12 17:23:56 [INFO] Processing SRX6841306-SRR10109417. (23/38)
2021-08-12 17:24:01 [INFO] Processing SRX6841303. (24/38)
2021-08-12 17:24:01 [INFO] Processing SRX6841303-SRR10109414. (24/38)
2021-08-12 17:24:07 [INFO] Processing SRX8570427. (25/38)
2021-08-12 17:24:07 [INFO] Processing SRX8570427-SRR12040669. (25/38)
2021-08-12 17:24:17 [INFO] Processing SRX8570422. (26/38)
2021-08-12 17:24:17 [INFO] Processing SRX8570422-SRR12040664. (26/38)
2021-08-12 17:24:22 [INFO] Processing SRX8570435. (27/38)
2021-08-12 17:24:22 [INFO] Processing SRX8570435-SRR12040685. (27/38)
2021-08-12 17:24:30 [INFO] Processing SRX8570428. (28/38)
2021-08-12 17:24:30 [INFO] Processing SRX8570428-SRR12040670. (28/38)
2021-08-12 17:24:41 [INFO] Processing SRX8570417. (29/38)
2021-08-12 17:24:41 [INFO] Processing SRX8570417-SRR12040682. (29/38)
2021-08-12 17:24:50 [INFO] Processing SRX8570430. (30/38)
2021-08-12 17:24:50 [INFO] Processing SRX8570430-SRR12040672. (30/38)
2021-08-12 17:25:00 [INFO] Writing to disk...
2021-08-12 17:25:17 [INFO] Processing SRX8570419. (31/38)
2021-08-12 17:25:17 [INFO] Processing SRX8570419-SRR12040661. (31/38)
2021-08-12 17:25:22 [INFO] Processing SRX6841305. (32/38)
2021-08-12 17:25:22 [INFO] Processing SRX6841305-SRR10109416. (32/38)
2021-08-12 17:25:29 [INFO] Processing SRX8570423. (33/38)
2021-08-12 17:25:29 [INFO] Processing SRX8570423-SRR12040665. (33/38)
2021-08-12 17:25:40 [INFO] Processing SRX8570411. (34/38)
2021-08-12 17:25:40 [INFO] Processing SRX8570411-SRR12040676. (34/38)
2021-08-12 17:25:50 [INFO] Processing SRX6841310. (35/38)
2021-08-12 17:25:50 [INFO] Processing SRX6841310-SRR10109421. (35/38)
2021-08-12 17:26:01 [INFO] Processing SRX6841312. (36/38)
2021-08-12 17:26:01 [INFO] Processing SRX6841312-SRR10109423. (36/38)
2021-08-12 17:26:12 [INFO] Processing SRX8570420. (37/38)
2021-08-12 17:26:12 [INFO] Processing SRX8570420-SRR12040662. (37/38)
2021-08-12 17:26:26 [INFO] Processing SRX6841314. (38/38)
2021-08-12 17:26:26 [INFO] Processing SRX6841314-SRR10109425. (38/38)
2021-08-12 17:26:41 [INFO] Writing to disk...
2021-08-12 17:26:58 [INFO] Finished.
2021-08-13 09:03:35 [INFO] Starting.
2021-08-13 09:03:35 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/
2021-08-13 09:03:35 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/aggregate.hdf5
2021-08-13 09:03:35 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-13 09:03:36 [INFO] Building aggregate for 25kbp_raw network.
2021-08-13 09:03:36 [INFO] Writing every 10 Runs.
2021-08-13 09:03:36 [INFO] Processing SRX8570418. (1/38)
2021-08-13 09:03:36 [INFO] Processing SRX8570418-SRR12040660. (1/38)
2021-08-13 09:03:42 [INFO] Processing SRX8570414. (2/38)
2021-08-13 09:03:42 [INFO] Processing SRX8570414-SRR12040679. (2/38)
2021-08-13 09:03:50 [INFO] Processing SRX6841311. (3/38)
2021-08-13 09:03:50 [INFO] Processing SRX6841311-SRR10109422. (3/38)
2021-08-13 09:04:03 [INFO] Processing SRX8570424. (4/38)
2021-08-13 09:04:03 [INFO] Processing SRX8570424-SRR12040666. (4/38)
2021-08-13 09:04:12 [INFO] Processing SRX8570412. (5/38)
2021-08-13 09:04:12 [INFO] Processing SRX8570412-SRR12040677. (5/38)
2021-08-13 09:04:19 [INFO] Processing SRX8570413. (6/38)
2021-08-13 09:04:19 [INFO] Processing SRX8570413-SRR12040678. (6/38)
2021-08-13 09:04:29 [INFO] Processing SRX8570433. (7/38)
2021-08-13 09:04:29 [INFO] Processing SRX8570433-SRR12040683. (7/38)
2021-08-13 09:04:40 [INFO] Processing SRX8570434. (8/38)
2021-08-13 09:04:40 [INFO] Processing SRX8570434-SRR12040684. (8/38)
2021-08-13 09:04:49 [INFO] Processing SRX8570425. (9/38)
2021-08-13 09:04:49 [INFO] Processing SRX8570425-SRR12040667. (9/38)
2021-08-13 09:05:00 [INFO] Processing SRX8570415. (10/38)
2021-08-13 09:05:00 [INFO] Processing SRX8570415-SRR12040680. (10/38)
2021-08-13 09:05:10 [INFO] Writing to disk...
2021-08-13 09:05:14 [INFO] Processing SRX6841313. (11/38)
2021-08-13 09:05:14 [INFO] Processing SRX6841313-SRR10109424. (11/38)
2021-08-13 09:05:26 [INFO] Processing SRX8570426. (12/38)
2021-08-13 09:05:26 [INFO] Processing SRX8570426-SRR12040668. (12/38)
2021-08-13 09:05:34 [INFO] Processing SRX8570431. (13/38)
2021-08-13 09:05:34 [INFO] Processing SRX8570431-SRR12040673. (13/38)
2021-08-13 09:05:46 [INFO] Processing SRX8570429. (14/38)
2021-08-13 09:05:46 [INFO] Processing SRX8570429-SRR12040671. (14/38)
2021-08-13 09:05:55 [INFO] Processing SRX6841304. (15/38)
2021-08-13 09:05:55 [INFO] Processing SRX6841304-SRR10109415. (15/38)
2021-08-13 09:06:03 [INFO] Processing SRX8570416. (16/38)
2021-08-13 09:06:03 [INFO] Processing SRX8570416-SRR12040681. (16/38)
2021-08-13 09:06:12 [INFO] Processing SRX6841309. (17/38)
2021-08-13 09:06:12 [INFO] Processing SRX6841309-SRR10109420. (17/38)
2021-08-13 09:06:24 [INFO] Processing SRX6841308. (18/38)
2021-08-13 09:06:24 [INFO] Processing SRX6841308-SRR10109419. (18/38)
2021-08-13 09:06:32 [INFO] Processing SRX8570421. (19/38)
2021-08-13 09:06:32 [INFO] Processing SRX8570421-SRR12040663. (19/38)
2021-08-13 09:06:40 [INFO] Processing SRX8570410. (20/38)
2021-08-13 09:06:40 [INFO] Processing SRX8570410-SRR12040675. (20/38)
2021-08-13 09:06:52 [INFO] Writing to disk...
2021-08-13 09:07:07 [INFO] Processing SRX8570432. (21/38)
2021-08-13 09:07:07 [INFO] Processing SRX8570432-SRR12040674. (21/38)
2021-08-13 09:07:16 [INFO] Processing SRX6841307. (22/38)
2021-08-13 09:07:16 [INFO] Processing SRX6841307-SRR10109418. (22/38)
2021-08-13 09:07:23 [INFO] Processing SRX6841306. (23/38)
2021-08-13 09:07:23 [INFO] Processing SRX6841306-SRR10109417. (23/38)
2021-08-13 09:07:29 [INFO] Processing SRX6841303. (24/38)
2021-08-13 09:07:29 [INFO] Processing SRX6841303-SRR10109414. (24/38)
2021-08-13 09:07:36 [INFO] Processing SRX8570427. (25/38)
2021-08-13 09:07:36 [INFO] Processing SRX8570427-SRR12040669. (25/38)
2021-08-13 09:07:50 [INFO] Processing SRX8570422. (26/38)
2021-08-13 09:07:50 [INFO] Processing SRX8570422-SRR12040664. (26/38)
2021-08-13 09:07:56 [INFO] Processing SRX8570435. (27/38)
2021-08-13 09:07:56 [INFO] Processing SRX8570435-SRR12040685. (27/38)
2021-08-13 09:08:10 [INFO] Processing SRX8570428. (28/38)
2021-08-13 09:08:10 [INFO] Processing SRX8570428-SRR12040670. (28/38)
2021-08-13 09:08:24 [INFO] Processing SRX8570417. (29/38)
2021-08-13 09:08:24 [INFO] Processing SRX8570417-SRR12040682. (29/38)
2021-08-13 09:08:35 [INFO] Processing SRX8570430. (30/38)
2021-08-13 09:08:35 [INFO] Processing SRX8570430-SRR12040672. (30/38)
2021-08-13 09:08:48 [INFO] Writing to disk...
2021-08-13 09:09:08 [INFO] Processing SRX8570419. (31/38)
2021-08-13 09:09:08 [INFO] Processing SRX8570419-SRR12040661. (31/38)
2021-08-13 09:09:14 [INFO] Processing SRX6841305. (32/38)
2021-08-13 09:09:14 [INFO] Processing SRX6841305-SRR10109416. (32/38)
2021-08-13 09:09:21 [INFO] Processing SRX8570423. (33/38)
2021-08-13 09:09:21 [INFO] Processing SRX8570423-SRR12040665. (33/38)
2021-08-13 09:09:32 [INFO] Processing SRX8570411. (34/38)
2021-08-13 09:09:32 [INFO] Processing SRX8570411-SRR12040676. (34/38)
2021-08-13 09:09:47 [INFO] Processing SRX6841310. (35/38)
2021-08-13 09:09:47 [INFO] Processing SRX6841310-SRR10109421. (35/38)
2021-08-13 09:10:02 [INFO] Processing SRX6841312. (36/38)
2021-08-13 09:10:02 [INFO] Processing SRX6841312-SRR10109423. (36/38)
2021-08-13 09:10:16 [INFO] Processing SRX8570420. (37/38)
2021-08-13 09:10:16 [INFO] Processing SRX8570420-SRR12040662. (37/38)
2021-08-13 09:10:29 [INFO] Processing SRX6841314. (38/38)
2021-08-13 09:10:29 [INFO] Processing SRX6841314-SRR10109425. (38/38)
2021-08-13 09:10:46 [INFO] Writing to disk...
2021-08-13 09:11:12 [INFO] Finished.
2021-08-13 13:10:11 [INFO] Starting.
2021-08-13 13:10:11 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/
2021-08-13 13:10:11 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/aggregate.hdf5
2021-08-13 13:10:11 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-13 13:10:12 [INFO] Building aggregate for 5kbp_raw network.
2021-08-13 13:10:12 [INFO] Writing every 10 Runs.
2021-08-13 13:10:12 [INFO] Processing SRX8570418. (1/38)
2021-08-13 13:10:12 [INFO] Processing SRX8570418-SRR12040660. (1/38)
2021-08-13 13:10:19 [INFO] Processing SRX8570414. (2/38)
2021-08-13 13:10:19 [INFO] Processing SRX8570414-SRR12040679. (2/38)
2021-08-13 13:10:29 [INFO] Processing SRX6841311. (3/38)
2021-08-13 13:10:29 [INFO] Processing SRX6841311-SRR10109422. (3/38)
2021-08-13 13:10:41 [INFO] Processing SRX8570424. (4/38)
2021-08-13 13:10:41 [INFO] Processing SRX8570424-SRR12040666. (4/38)
2021-08-13 13:10:51 [INFO] Processing SRX8570412. (5/38)
2021-08-13 13:10:51 [INFO] Processing SRX8570412-SRR12040677. (5/38)
2021-08-13 13:10:59 [INFO] Processing SRX8570413. (6/38)
2021-08-13 13:10:59 [INFO] Processing SRX8570413-SRR12040678. (6/38)
2021-08-13 13:11:11 [INFO] Processing SRX8570433. (7/38)
2021-08-13 13:11:11 [INFO] Processing SRX8570433-SRR12040683. (7/38)
2021-08-13 13:11:23 [INFO] Processing SRX8570434. (8/38)
2021-08-13 13:11:23 [INFO] Processing SRX8570434-SRR12040684. (8/38)
2021-08-13 13:11:32 [INFO] Processing SRX8570425. (9/38)
2021-08-13 13:11:32 [INFO] Processing SRX8570425-SRR12040667. (9/38)
2021-08-13 13:11:44 [INFO] Processing SRX8570415. (10/38)
2021-08-13 13:11:44 [INFO] Processing SRX8570415-SRR12040680. (10/38)
2021-08-13 13:11:54 [INFO] Writing to disk...
2021-08-13 13:12:00 [INFO] Processing SRX6841313. (11/38)
2021-08-13 13:12:00 [INFO] Processing SRX6841313-SRR10109424. (11/38)
2021-08-13 13:12:12 [INFO] Processing SRX8570426. (12/38)
2021-08-13 13:12:12 [INFO] Processing SRX8570426-SRR12040668. (12/38)
2021-08-13 13:12:22 [INFO] Processing SRX8570431. (13/38)
2021-08-13 13:12:22 [INFO] Processing SRX8570431-SRR12040673. (13/38)
2021-08-13 13:12:35 [INFO] Processing SRX8570429. (14/38)
2021-08-13 13:12:35 [INFO] Processing SRX8570429-SRR12040671. (14/38)
2021-08-13 13:12:46 [INFO] Processing SRX6841304. (15/38)
2021-08-13 13:12:46 [INFO] Processing SRX6841304-SRR10109415. (15/38)
2021-08-13 13:12:53 [INFO] Processing SRX8570416. (16/38)
2021-08-13 13:12:53 [INFO] Processing SRX8570416-SRR12040681. (16/38)
2021-08-13 13:13:04 [INFO] Processing SRX6841309. (17/38)
2021-08-13 13:13:04 [INFO] Processing SRX6841309-SRR10109420. (17/38)
2021-08-13 13:13:19 [INFO] Processing SRX6841308. (18/38)
2021-08-13 13:13:19 [INFO] Processing SRX6841308-SRR10109419. (18/38)
2021-08-13 13:13:28 [INFO] Processing SRX8570421. (19/38)
2021-08-13 13:13:28 [INFO] Processing SRX8570421-SRR12040663. (19/38)
2021-08-13 13:13:38 [INFO] Processing SRX8570410. (20/38)
2021-08-13 13:13:38 [INFO] Processing SRX8570410-SRR12040675. (20/38)
2021-08-13 13:13:54 [INFO] Writing to disk...
2021-08-13 13:14:11 [INFO] Processing SRX8570432. (21/38)
2021-08-13 13:14:11 [INFO] Processing SRX8570432-SRR12040674. (21/38)
2021-08-13 13:14:22 [INFO] Processing SRX6841307. (22/38)
2021-08-13 13:14:22 [INFO] Processing SRX6841307-SRR10109418. (22/38)
2021-08-13 13:14:32 [INFO] Processing SRX6841306. (23/38)
2021-08-13 13:14:32 [INFO] Processing SRX6841306-SRR10109417. (23/38)
2021-08-13 13:14:41 [INFO] Processing SRX6841303. (24/38)
2021-08-13 13:14:41 [INFO] Processing SRX6841303-SRR10109414. (24/38)
2021-08-13 13:14:51 [INFO] Processing SRX8570427. (25/38)
2021-08-13 13:14:51 [INFO] Processing SRX8570427-SRR12040669. (25/38)
2021-08-13 13:15:04 [INFO] Processing SRX8570422. (26/38)
2021-08-13 13:15:04 [INFO] Processing SRX8570422-SRR12040664. (26/38)
2021-08-13 13:15:14 [INFO] Processing SRX8570435. (27/38)
2021-08-13 13:15:14 [INFO] Processing SRX8570435-SRR12040685. (27/38)
2021-08-13 13:15:28 [INFO] Processing SRX8570428. (28/38)
2021-08-13 13:15:28 [INFO] Processing SRX8570428-SRR12040670. (28/38)
2021-08-13 13:15:42 [INFO] Processing SRX8570417. (29/38)
2021-08-13 13:15:42 [INFO] Processing SRX8570417-SRR12040682. (29/38)
2021-08-13 13:15:56 [INFO] Processing SRX8570430. (30/38)
2021-08-13 13:15:56 [INFO] Processing SRX8570430-SRR12040672. (30/38)
2021-08-13 13:16:10 [INFO] Writing to disk...
2021-08-13 13:16:33 [INFO] Processing SRX8570419. (31/38)
2021-08-13 13:16:33 [INFO] Processing SRX8570419-SRR12040661. (31/38)
2021-08-13 13:16:42 [INFO] Processing SRX6841305. (32/38)
2021-08-13 13:16:42 [INFO] Processing SRX6841305-SRR10109416. (32/38)
2021-08-13 13:16:51 [INFO] Processing SRX8570423. (33/38)
2021-08-13 13:16:51 [INFO] Processing SRX8570423-SRR12040665. (33/38)
2021-08-13 13:17:03 [INFO] Processing SRX8570411. (34/38)
2021-08-13 13:17:03 [INFO] Processing SRX8570411-SRR12040676. (34/38)
2021-08-13 13:17:20 [INFO] Processing SRX6841310. (35/38)
2021-08-13 13:17:20 [INFO] Processing SRX6841310-SRR10109421. (35/38)
2021-08-13 13:17:35 [INFO] Processing SRX6841312. (36/38)
2021-08-13 13:17:35 [INFO] Processing SRX6841312-SRR10109423. (36/38)
2021-08-13 13:17:52 [INFO] Processing SRX8570420. (37/38)
2021-08-13 13:17:52 [INFO] Processing SRX8570420-SRR12040662. (37/38)
2021-08-13 13:18:06 [INFO] Processing SRX6841314. (38/38)
2021-08-13 13:18:06 [INFO] Processing SRX6841314-SRR10109425. (38/38)
2021-08-13 13:18:26 [INFO] Writing to disk...
2021-08-13 13:18:52 [INFO] Finished.
2021-08-16 11:43:17 [INFO] Starting.
2021-08-16 11:43:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/
2021-08-16 11:43:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/aggregate.hdf5
2021-08-16 11:43:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-16 11:43:18 [INFO] Building aggregate for 1kbp_raw network.
2021-08-16 11:43:18 [INFO] Writing every 10 Runs.
2021-08-16 11:43:18 [INFO] Processing SRX8570418. (1/38)
2021-08-16 11:43:18 [INFO] Processing SRX8570418-SRR12040660. (1/38)
2021-08-16 11:43:26 [INFO] Processing SRX8570414. (2/38)
2021-08-16 11:43:26 [INFO] Processing SRX8570414-SRR12040679. (2/38)
2021-08-16 11:43:38 [INFO] Processing SRX6841311. (3/38)
2021-08-16 11:43:38 [INFO] Processing SRX6841311-SRR10109422. (3/38)
2021-08-16 11:43:52 [INFO] Processing SRX8570424. (4/38)
2021-08-16 11:43:52 [INFO] Processing SRX8570424-SRR12040666. (4/38)
2021-08-16 11:44:02 [INFO] Processing SRX8570412. (5/38)
2021-08-16 11:44:02 [INFO] Processing SRX8570412-SRR12040677. (5/38)
2021-08-16 11:44:11 [INFO] Processing SRX8570413. (6/38)
2021-08-16 11:44:11 [INFO] Processing SRX8570413-SRR12040678. (6/38)
2021-08-16 11:44:22 [INFO] Processing SRX8570433. (7/38)
2021-08-16 11:44:22 [INFO] Processing SRX8570433-SRR12040683. (7/38)
2021-08-16 11:44:34 [INFO] Processing SRX8570434. (8/38)
2021-08-16 11:44:34 [INFO] Processing SRX8570434-SRR12040684. (8/38)
2021-08-16 11:44:45 [INFO] Processing SRX8570425. (9/38)
2021-08-16 11:44:45 [INFO] Processing SRX8570425-SRR12040667. (9/38)
2021-08-16 11:44:59 [INFO] Processing SRX8570415. (10/38)
2021-08-16 11:44:59 [INFO] Processing SRX8570415-SRR12040680. (10/38)
2021-08-16 11:45:13 [INFO] Writing to disk...
2021-08-16 11:45:23 [INFO] Processing SRX6841313. (11/38)
2021-08-16 11:45:23 [INFO] Processing SRX6841313-SRR10109424. (11/38)
2021-08-16 11:45:41 [INFO] Processing SRX8570426. (12/38)
2021-08-16 11:45:41 [INFO] Processing SRX8570426-SRR12040668. (12/38)
2021-08-16 11:45:53 [INFO] Processing SRX8570431. (13/38)
2021-08-16 11:45:53 [INFO] Processing SRX8570431-SRR12040673. (13/38)
2021-08-16 11:46:09 [INFO] Processing SRX8570429. (14/38)
2021-08-16 11:46:09 [INFO] Processing SRX8570429-SRR12040671. (14/38)
2021-08-16 11:46:18 [INFO] Processing SRX6841304. (15/38)
2021-08-16 11:46:18 [INFO] Processing SRX6841304-SRR10109415. (15/38)
2021-08-16 11:46:27 [INFO] Processing SRX8570416. (16/38)
2021-08-16 11:46:27 [INFO] Processing SRX8570416-SRR12040681. (16/38)
2021-08-16 11:46:38 [INFO] Processing SRX6841309. (17/38)
2021-08-16 11:46:38 [INFO] Processing SRX6841309-SRR10109420. (17/38)
2021-08-16 11:46:54 [INFO] Processing SRX6841308. (18/38)
2021-08-16 11:46:54 [INFO] Processing SRX6841308-SRR10109419. (18/38)
2021-08-16 11:47:04 [INFO] Processing SRX8570421. (19/38)
2021-08-16 11:47:04 [INFO] Processing SRX8570421-SRR12040663. (19/38)
2021-08-16 11:47:17 [INFO] Processing SRX8570410. (20/38)
2021-08-16 11:47:17 [INFO] Processing SRX8570410-SRR12040675. (20/38)
2021-08-16 11:47:32 [INFO] Writing to disk...
2021-08-16 11:47:55 [INFO] Processing SRX8570432. (21/38)
2021-08-16 11:47:55 [INFO] Processing SRX8570432-SRR12040674. (21/38)
2021-08-16 11:48:08 [INFO] Processing SRX6841307. (22/38)
2021-08-16 11:48:08 [INFO] Processing SRX6841307-SRR10109418. (22/38)
2021-08-16 11:48:19 [INFO] Processing SRX6841306. (23/38)
2021-08-16 11:48:19 [INFO] Processing SRX6841306-SRR10109417. (23/38)
2021-08-16 11:48:29 [INFO] Processing SRX6841303. (24/38)
2021-08-16 11:48:29 [INFO] Processing SRX6841303-SRR10109414. (24/38)
2021-08-16 11:48:41 [INFO] Processing SRX8570427. (25/38)
2021-08-16 11:48:41 [INFO] Processing SRX8570427-SRR12040669. (25/38)
2021-08-16 11:48:56 [INFO] Processing SRX8570422. (26/38)
2021-08-16 11:48:56 [INFO] Processing SRX8570422-SRR12040664. (26/38)
2021-08-16 11:49:07 [INFO] Processing SRX8570435. (27/38)
2021-08-16 11:49:07 [INFO] Processing SRX8570435-SRR12040685. (27/38)
2021-08-16 11:49:22 [INFO] Processing SRX8570428. (28/38)
2021-08-16 11:49:22 [INFO] Processing SRX8570428-SRR12040670. (28/38)
2021-08-16 11:49:40 [INFO] Processing SRX8570417. (29/38)
2021-08-16 11:49:40 [INFO] Processing SRX8570417-SRR12040682. (29/38)
2021-08-16 11:49:54 [INFO] Processing SRX8570430. (30/38)
2021-08-16 11:49:54 [INFO] Processing SRX8570430-SRR12040672. (30/38)
2021-08-16 11:50:09 [INFO] Writing to disk...
2021-08-16 11:50:37 [INFO] Processing SRX8570419. (31/38)
2021-08-16 11:50:37 [INFO] Processing SRX8570419-SRR12040661. (31/38)
2021-08-16 11:50:48 [INFO] Processing SRX6841305. (32/38)
2021-08-16 11:50:48 [INFO] Processing SRX6841305-SRR10109416. (32/38)
2021-08-16 11:51:00 [INFO] Processing SRX8570423. (33/38)
2021-08-16 11:51:00 [INFO] Processing SRX8570423-SRR12040665. (33/38)
2021-08-16 11:51:14 [INFO] Processing SRX8570411. (34/38)
2021-08-16 11:51:14 [INFO] Processing SRX8570411-SRR12040676. (34/38)
2021-08-16 11:51:31 [INFO] Processing SRX6841310. (35/38)
2021-08-16 11:51:31 [INFO] Processing SRX6841310-SRR10109421. (35/38)
2021-08-16 11:51:52 [INFO] Processing SRX6841312. (36/38)
2021-08-16 11:51:52 [INFO] Processing SRX6841312-SRR10109423. (36/38)
2021-08-16 11:52:13 [INFO] Processing SRX8570420. (37/38)
2021-08-16 11:52:13 [INFO] Processing SRX8570420-SRR12040662. (37/38)
2021-08-16 11:52:33 [INFO] Processing SRX6841314. (38/38)
2021-08-16 11:52:33 [INFO] Processing SRX6841314-SRR10109425. (38/38)
2021-08-16 11:52:58 [INFO] Writing to disk...
2021-08-16 11:53:33 [INFO] Finished.
2021-08-21 00:42:58 [INFO] Starting.
2021-08-21 00:42:58 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/
2021-08-21 00:42:58 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/aggregate.hdf5
2021-08-21 00:42:58 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-21 00:42:59 [INFO] Building aggregate for 100kbp_raw network.
2021-08-21 00:42:59 [INFO] Writing every 10 Runs.
2021-08-21 00:42:59 [INFO] Processing SRX8570418. (1/38)
2021-08-21 00:42:59 [INFO] Processing SRX8570418-SRR12040660. (1/38)
2021-08-21 00:43:03 [INFO] Processing SRX8570414. (2/38)
2021-08-21 00:43:03 [INFO] Processing SRX8570414-SRR12040679. (2/38)
2021-08-21 00:43:08 [INFO] Processing SRX6841311. (3/38)
2021-08-21 00:43:08 [INFO] Processing SRX6841311-SRR10109422. (3/38)
2021-08-21 00:43:14 [INFO] Processing SRX8570424. (4/38)
2021-08-21 00:43:14 [INFO] Processing SRX8570424-SRR12040666. (4/38)
2021-08-21 00:43:19 [INFO] Processing SRX8570412. (5/38)
2021-08-21 00:43:19 [INFO] Processing SRX8570412-SRR12040677. (5/38)
2021-08-21 00:43:24 [INFO] Processing SRX8570413. (6/38)
2021-08-21 00:43:24 [INFO] Processing SRX8570413-SRR12040678. (6/38)
2021-08-21 00:43:29 [INFO] Processing SRX8570433. (7/38)
2021-08-21 00:43:29 [INFO] Processing SRX8570433-SRR12040683. (7/38)
2021-08-21 00:43:35 [INFO] Processing SRX8570434. (8/38)
2021-08-21 00:43:35 [INFO] Processing SRX8570434-SRR12040684. (8/38)
2021-08-21 00:43:41 [INFO] Processing SRX8570425. (9/38)
2021-08-21 00:43:41 [INFO] Processing SRX8570425-SRR12040667. (9/38)
2021-08-21 00:43:47 [INFO] Processing SRX8570415. (10/38)
2021-08-21 00:43:47 [INFO] Processing SRX8570415-SRR12040680. (10/38)
2021-08-21 00:43:53 [INFO] Writing to disk...
2021-08-21 00:43:54 [INFO] Processing SRX6841313. (11/38)
2021-08-21 00:43:54 [INFO] Processing SRX6841313-SRR10109424. (11/38)
2021-08-21 00:44:01 [INFO] Processing SRX8570426. (12/38)
2021-08-21 00:44:01 [INFO] Processing SRX8570426-SRR12040668. (12/38)
2021-08-21 00:44:06 [INFO] Processing SRX8570431. (13/38)
2021-08-21 00:44:06 [INFO] Processing SRX8570431-SRR12040673. (13/38)
2021-08-21 00:44:13 [INFO] Processing SRX8570429. (14/38)
2021-08-21 00:44:13 [INFO] Processing SRX8570429-SRR12040671. (14/38)
2021-08-21 00:44:16 [INFO] Processing SRX6841304. (15/38)
2021-08-21 00:44:16 [INFO] Processing SRX6841304-SRR10109415. (15/38)
2021-08-21 00:44:20 [INFO] Processing SRX8570416. (16/38)
2021-08-21 00:44:20 [INFO] Processing SRX8570416-SRR12040681. (16/38)
2021-08-21 00:44:25 [INFO] Processing SRX6841309. (17/38)
2021-08-21 00:44:25 [INFO] Processing SRX6841309-SRR10109420. (17/38)
2021-08-21 00:44:32 [INFO] Processing SRX6841308. (18/38)
2021-08-21 00:44:32 [INFO] Processing SRX6841308-SRR10109419. (18/38)
2021-08-21 00:44:36 [INFO] Processing SRX8570421. (19/38)
2021-08-21 00:44:36 [INFO] Processing SRX8570421-SRR12040663. (19/38)
2021-08-21 00:44:41 [INFO] Processing SRX8570410. (20/38)
2021-08-21 00:44:41 [INFO] Processing SRX8570410-SRR12040675. (20/38)
2021-08-21 00:44:45 [INFO] Writing to disk...
2021-08-21 00:44:52 [INFO] Processing SRX8570432. (21/38)
2021-08-21 00:44:52 [INFO] Processing SRX8570432-SRR12040674. (21/38)
2021-08-21 00:44:57 [INFO] Processing SRX6841307. (22/38)
2021-08-21 00:44:57 [INFO] Processing SRX6841307-SRR10109418. (22/38)
2021-08-21 00:45:00 [INFO] Processing SRX6841306. (23/38)
2021-08-21 00:45:00 [INFO] Processing SRX6841306-SRR10109417. (23/38)
2021-08-21 00:45:04 [INFO] Processing SRX6841303. (24/38)
2021-08-21 00:45:04 [INFO] Processing SRX6841303-SRR10109414. (24/38)
2021-08-21 00:45:08 [INFO] Processing SRX8570427. (25/38)
2021-08-21 00:45:08 [INFO] Processing SRX8570427-SRR12040669. (25/38)
2021-08-21 00:45:14 [INFO] Processing SRX8570422. (26/38)
2021-08-21 00:45:14 [INFO] Processing SRX8570422-SRR12040664. (26/38)
2021-08-21 00:45:18 [INFO] Processing SRX8570435. (27/38)
2021-08-21 00:45:18 [INFO] Processing SRX8570435-SRR12040685. (27/38)
2021-08-21 00:45:24 [INFO] Processing SRX8570428. (28/38)
2021-08-21 00:45:24 [INFO] Processing SRX8570428-SRR12040670. (28/38)
2021-08-21 00:45:30 [INFO] Processing SRX8570417. (29/38)
2021-08-21 00:45:30 [INFO] Processing SRX8570417-SRR12040682. (29/38)
2021-08-21 00:45:35 [INFO] Processing SRX8570430. (30/38)
2021-08-21 00:45:35 [INFO] Processing SRX8570430-SRR12040672. (30/38)
2021-08-21 00:45:42 [INFO] Writing to disk...
2021-08-21 00:45:50 [INFO] Processing SRX8570419. (31/38)
2021-08-21 00:45:50 [INFO] Processing SRX8570419-SRR12040661. (31/38)
2021-08-21 00:45:53 [INFO] Processing SRX6841305. (32/38)
2021-08-21 00:45:53 [INFO] Processing SRX6841305-SRR10109416. (32/38)
2021-08-21 00:45:56 [INFO] Processing SRX8570423. (33/38)
2021-08-21 00:45:56 [INFO] Processing SRX8570423-SRR12040665. (33/38)
2021-08-21 00:46:01 [INFO] Processing SRX8570411. (34/38)
2021-08-21 00:46:01 [INFO] Processing SRX8570411-SRR12040676. (34/38)
2021-08-21 00:46:08 [INFO] Processing SRX6841310. (35/38)
2021-08-21 00:46:08 [INFO] Processing SRX6841310-SRR10109421. (35/38)
2021-08-21 00:46:13 [INFO] Processing SRX6841312. (36/38)
2021-08-21 00:46:13 [INFO] Processing SRX6841312-SRR10109423. (36/38)
2021-08-21 00:46:20 [INFO] Processing SRX8570420. (37/38)
2021-08-21 00:46:20 [INFO] Processing SRX8570420-SRR12040662. (37/38)
2021-08-21 00:46:26 [INFO] Processing SRX6841314. (38/38)
2021-08-21 00:46:26 [INFO] Processing SRX6841314-SRR10109425. (38/38)
2021-08-21 00:46:35 [INFO] Writing to disk...
2021-08-21 00:46:43 [INFO] Finished.
2021-08-23 12:16:55 [INFO] Starting.
2021-08-23 12:16:55 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/
2021-08-23 12:16:55 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/aggregate.hdf5
2021-08-23 12:16:55 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 12:16:55 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 12:16:55 [INFO] Writing every 10 Runs.
2021-08-23 12:16:55 [INFO] Processing SRX8570418. (1/38)
2021-08-23 12:16:55 [INFO] Processing SRX8570418-SRR12040660. (1/38)
2021-08-23 12:16:58 [INFO] Processing SRX8570414. (2/38)
2021-08-23 12:16:58 [INFO] Processing SRX8570414-SRR12040679. (2/38)
2021-08-23 12:17:03 [INFO] Processing SRX6841311. (3/38)
2021-08-23 12:17:03 [INFO] Processing SRX6841311-SRR10109422. (3/38)
2021-08-23 12:17:09 [INFO] Processing SRX8570424. (4/38)
2021-08-23 12:17:09 [INFO] Processing SRX8570424-SRR12040666. (4/38)
2021-08-23 12:17:14 [INFO] Processing SRX8570412. (5/38)
2021-08-23 12:17:14 [INFO] Processing SRX8570412-SRR12040677. (5/38)
2021-08-23 12:17:17 [INFO] Processing SRX8570413. (6/38)
2021-08-23 12:17:17 [INFO] Processing SRX8570413-SRR12040678. (6/38)
2021-08-23 12:17:22 [INFO] Processing SRX8570433. (7/38)
2021-08-23 12:17:22 [INFO] Processing SRX8570433-SRR12040683. (7/38)
2021-08-23 12:17:27 [INFO] Processing SRX8570434. (8/38)
2021-08-23 12:17:27 [INFO] Processing SRX8570434-SRR12040684. (8/38)
2021-08-23 12:17:31 [INFO] Processing SRX8570425. (9/38)
2021-08-23 12:17:31 [INFO] Processing SRX8570425-SRR12040667. (9/38)
2021-08-23 12:17:36 [INFO] Processing SRX8570415. (10/38)
2021-08-23 12:17:36 [INFO] Processing SRX8570415-SRR12040680. (10/38)
2021-08-23 12:17:40 [INFO] Writing to disk...
2021-08-23 12:17:42 [INFO] Processing SRX6841313. (11/38)
2021-08-23 12:17:42 [INFO] Processing SRX6841313-SRR10109424. (11/38)
2021-08-23 12:17:47 [INFO] Processing SRX8570426. (12/38)
2021-08-23 12:17:47 [INFO] Processing SRX8570426-SRR12040668. (12/38)
2021-08-23 12:17:51 [INFO] Processing SRX8570431. (13/38)
2021-08-23 12:17:51 [INFO] Processing SRX8570431-SRR12040673. (13/38)
2021-08-23 12:17:57 [INFO] Processing SRX8570429. (14/38)
2021-08-23 12:17:57 [INFO] Processing SRX8570429-SRR12040671. (14/38)
2021-08-23 12:18:00 [INFO] Processing SRX6841304. (15/38)
2021-08-23 12:18:00 [INFO] Processing SRX6841304-SRR10109415. (15/38)
2021-08-23 12:18:03 [INFO] Processing SRX8570416. (16/38)
2021-08-23 12:18:03 [INFO] Processing SRX8570416-SRR12040681. (16/38)
2021-08-23 12:18:07 [INFO] Processing SRX6841309. (17/38)
2021-08-23 12:18:07 [INFO] Processing SRX6841309-SRR10109420. (17/38)
2021-08-23 12:18:14 [INFO] Processing SRX6841308. (18/38)
2021-08-23 12:18:14 [INFO] Processing SRX6841308-SRR10109419. (18/38)
2021-08-23 12:18:18 [INFO] Processing SRX8570421. (19/38)
2021-08-23 12:18:18 [INFO] Processing SRX8570421-SRR12040663. (19/38)
2021-08-23 12:18:21 [INFO] Processing SRX8570410. (20/38)
2021-08-23 12:18:21 [INFO] Processing SRX8570410-SRR12040675. (20/38)
2021-08-23 12:18:26 [INFO] Writing to disk...
2021-08-23 12:18:27 [INFO] Processing SRX8570432. (21/38)
2021-08-23 12:18:27 [INFO] Processing SRX8570432-SRR12040674. (21/38)
2021-08-23 12:18:31 [INFO] Processing SRX6841307. (22/38)
2021-08-23 12:18:31 [INFO] Processing SRX6841307-SRR10109418. (22/38)
2021-08-23 12:18:34 [INFO] Processing SRX6841306. (23/38)
2021-08-23 12:18:34 [INFO] Processing SRX6841306-SRR10109417. (23/38)
2021-08-23 12:18:37 [INFO] Processing SRX6841303. (24/38)
2021-08-23 12:18:37 [INFO] Processing SRX6841303-SRR10109414. (24/38)
2021-08-23 12:18:40 [INFO] Processing SRX8570427. (25/38)
2021-08-23 12:18:40 [INFO] Processing SRX8570427-SRR12040669. (25/38)
2021-08-23 12:18:45 [INFO] Processing SRX8570422. (26/38)
2021-08-23 12:18:45 [INFO] Processing SRX8570422-SRR12040664. (26/38)
2021-08-23 12:18:48 [INFO] Processing SRX8570435. (27/38)
2021-08-23 12:18:48 [INFO] Processing SRX8570435-SRR12040685. (27/38)
2021-08-23 12:18:52 [INFO] Processing SRX8570428. (28/38)
2021-08-23 12:18:52 [INFO] Processing SRX8570428-SRR12040670. (28/38)
2021-08-23 12:18:58 [INFO] Processing SRX8570417. (29/38)
2021-08-23 12:18:58 [INFO] Processing SRX8570417-SRR12040682. (29/38)
2021-08-23 12:19:02 [INFO] Processing SRX8570430. (30/38)
2021-08-23 12:19:02 [INFO] Processing SRX8570430-SRR12040672. (30/38)
2021-08-23 12:19:07 [INFO] Writing to disk...
2021-08-23 12:19:13 [INFO] Processing SRX8570419. (31/38)
2021-08-23 12:19:13 [INFO] Processing SRX8570419-SRR12040661. (31/38)
2021-08-23 12:19:15 [INFO] Processing SRX6841305. (32/38)
2021-08-23 12:19:15 [INFO] Processing SRX6841305-SRR10109416. (32/38)
2021-08-23 12:19:19 [INFO] Processing SRX8570423. (33/38)
2021-08-23 12:19:19 [INFO] Processing SRX8570423-SRR12040665. (33/38)
2021-08-23 12:19:25 [INFO] Processing SRX8570411. (34/38)
2021-08-23 12:19:25 [INFO] Processing SRX8570411-SRR12040676. (34/38)
2021-08-23 12:19:30 [INFO] Processing SRX6841310. (35/38)
2021-08-23 12:19:30 [INFO] Processing SRX6841310-SRR10109421. (35/38)
2021-08-23 12:19:36 [INFO] Processing SRX6841312. (36/38)
2021-08-23 12:19:36 [INFO] Processing SRX6841312-SRR10109423. (36/38)
2021-08-23 12:19:43 [INFO] Processing SRX8570420. (37/38)
2021-08-23 12:19:43 [INFO] Processing SRX8570420-SRR12040662. (37/38)
2021-08-23 12:19:48 [INFO] Processing SRX6841314. (38/38)
2021-08-23 12:19:48 [INFO] Processing SRX6841314-SRR10109425. (38/38)
2021-08-23 12:19:56 [INFO] Writing to disk...
2021-08-23 12:19:57 [INFO] Finished.
2021-08-23 15:13:59 [INFO] Starting.
2021-08-23 15:13:59 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/
2021-08-23 15:13:59 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP221518/aggregate.hdf5
2021-08-23 15:13:59 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 15:13:59 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 15:13:59 [INFO] Writing every 10 Runs.
2021-08-23 15:13:59 [INFO] Processing SRX8570418. (1/38)
2021-08-23 15:13:59 [INFO] Processing SRX8570418-SRR12040660. (1/38)
2021-08-23 15:14:02 [INFO] Processing SRX8570414. (2/38)
2021-08-23 15:14:02 [INFO] Processing SRX8570414-SRR12040679. (2/38)
2021-08-23 15:14:06 [INFO] Processing SRX6841311. (3/38)
2021-08-23 15:14:06 [INFO] Processing SRX6841311-SRR10109422. (3/38)
2021-08-23 15:14:10 [INFO] Processing SRX8570424. (4/38)
2021-08-23 15:14:10 [INFO] Processing SRX8570424-SRR12040666. (4/38)
2021-08-23 15:14:14 [INFO] Processing SRX8570412. (5/38)
2021-08-23 15:14:14 [INFO] Processing SRX8570412-SRR12040677. (5/38)
2021-08-23 15:14:17 [INFO] Processing SRX8570413. (6/38)
2021-08-23 15:14:17 [INFO] Processing SRX8570413-SRR12040678. (6/38)
2021-08-23 15:14:21 [INFO] Processing SRX8570433. (7/38)
2021-08-23 15:14:21 [INFO] Processing SRX8570433-SRR12040683. (7/38)
2021-08-23 15:14:25 [INFO] Processing SRX8570434. (8/38)
2021-08-23 15:14:25 [INFO] Processing SRX8570434-SRR12040684. (8/38)
2021-08-23 15:14:30 [INFO] Processing SRX8570425. (9/38)
2021-08-23 15:14:30 [INFO] Processing SRX8570425-SRR12040667. (9/38)
2021-08-23 15:14:35 [INFO] Processing SRX8570415. (10/38)
2021-08-23 15:14:35 [INFO] Processing SRX8570415-SRR12040680. (10/38)
2021-08-23 15:14:38 [INFO] Writing to disk...
2021-08-23 15:14:39 [INFO] Processing SRX6841313. (11/38)
2021-08-23 15:14:39 [INFO] Processing SRX6841313-SRR10109424. (11/38)
2021-08-23 15:14:45 [INFO] Processing SRX8570426. (12/38)
2021-08-23 15:14:45 [INFO] Processing SRX8570426-SRR12040668. (12/38)
2021-08-23 15:14:48 [INFO] Processing SRX8570431. (13/38)
2021-08-23 15:14:48 [INFO] Processing SRX8570431-SRR12040673. (13/38)
2021-08-23 15:14:52 [INFO] Processing SRX8570429. (14/38)
2021-08-23 15:14:52 [INFO] Processing SRX8570429-SRR12040671. (14/38)
2021-08-23 15:14:56 [INFO] Processing SRX6841304. (15/38)
2021-08-23 15:14:56 [INFO] Processing SRX6841304-SRR10109415. (15/38)
2021-08-23 15:14:58 [INFO] Processing SRX8570416. (16/38)
2021-08-23 15:14:58 [INFO] Processing SRX8570416-SRR12040681. (16/38)
2021-08-23 15:15:02 [INFO] Processing SRX6841309. (17/38)
2021-08-23 15:15:02 [INFO] Processing SRX6841309-SRR10109420. (17/38)
2021-08-23 15:15:07 [INFO] Processing SRX6841308. (18/38)
2021-08-23 15:15:07 [INFO] Processing SRX6841308-SRR10109419. (18/38)
2021-08-23 15:15:10 [INFO] Processing SRX8570421. (19/38)
2021-08-23 15:15:10 [INFO] Processing SRX8570421-SRR12040663. (19/38)
2021-08-23 15:15:13 [INFO] Processing SRX8570410. (20/38)
2021-08-23 15:15:13 [INFO] Processing SRX8570410-SRR12040675. (20/38)
2021-08-23 15:15:18 [INFO] Writing to disk...
2021-08-23 15:15:19 [INFO] Processing SRX8570432. (21/38)
2021-08-23 15:15:19 [INFO] Processing SRX8570432-SRR12040674. (21/38)
2021-08-23 15:15:22 [INFO] Processing SRX6841307. (22/38)
2021-08-23 15:15:22 [INFO] Processing SRX6841307-SRR10109418. (22/38)
2021-08-23 15:15:25 [INFO] Processing SRX6841306. (23/38)
2021-08-23 15:15:25 [INFO] Processing SRX6841306-SRR10109417. (23/38)
2021-08-23 15:15:27 [INFO] Processing SRX6841303. (24/38)
2021-08-23 15:15:27 [INFO] Processing SRX6841303-SRR10109414. (24/38)
2021-08-23 15:15:30 [INFO] Processing SRX8570427. (25/38)
2021-08-23 15:15:30 [INFO] Processing SRX8570427-SRR12040669. (25/38)
2021-08-23 15:15:34 [INFO] Processing SRX8570422. (26/38)
2021-08-23 15:15:34 [INFO] Processing SRX8570422-SRR12040664. (26/38)
2021-08-23 15:15:37 [INFO] Processing SRX8570435. (27/38)
2021-08-23 15:15:37 [INFO] Processing SRX8570435-SRR12040685. (27/38)
2021-08-23 15:15:41 [INFO] Processing SRX8570428. (28/38)
2021-08-23 15:15:41 [INFO] Processing SRX8570428-SRR12040670. (28/38)
2021-08-23 15:15:46 [INFO] Processing SRX8570417. (29/38)
2021-08-23 15:15:46 [INFO] Processing SRX8570417-SRR12040682. (29/38)
2021-08-23 15:15:50 [INFO] Processing SRX8570430. (30/38)
2021-08-23 15:15:50 [INFO] Processing SRX8570430-SRR12040672. (30/38)
2021-08-23 15:15:54 [INFO] Writing to disk...
2021-08-23 15:15:55 [INFO] Processing SRX8570419. (31/38)
2021-08-23 15:15:55 [INFO] Processing SRX8570419-SRR12040661. (31/38)
2021-08-23 15:15:58 [INFO] Processing SRX6841305. (32/38)
2021-08-23 15:15:58 [INFO] Processing SRX6841305-SRR10109416. (32/38)
2021-08-23 15:16:00 [INFO] Processing SRX8570423. (33/38)
2021-08-23 15:16:00 [INFO] Processing SRX8570423-SRR12040665. (33/38)
2021-08-23 15:16:04 [INFO] Processing SRX8570411. (34/38)
2021-08-23 15:16:04 [INFO] Processing SRX8570411-SRR12040676. (34/38)
2021-08-23 15:16:08 [INFO] Processing SRX6841310. (35/38)
2021-08-23 15:16:08 [INFO] Processing SRX6841310-SRR10109421. (35/38)
2021-08-23 15:16:14 [INFO] Processing SRX6841312. (36/38)
2021-08-23 15:16:14 [INFO] Processing SRX6841312-SRR10109423. (36/38)
2021-08-23 15:16:18 [INFO] Processing SRX8570420. (37/38)
2021-08-23 15:16:18 [INFO] Processing SRX8570420-SRR12040662. (37/38)
2021-08-23 15:16:23 [INFO] Processing SRX6841314. (38/38)
2021-08-23 15:16:23 [INFO] Processing SRX6841314-SRR10109425. (38/38)
2021-08-23 15:16:29 [INFO] Writing to disk...
2021-08-23 15:16:30 [INFO] Finished.