2021-06-10 01:51:15 [INFO] Starting.
2021-06-10 01:51:15 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/
2021-06-10 01:51:15 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/aggregate.hdf5
2021-06-10 01:51:15 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 01:51:15 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 01:51:16 [INFO] Building aggregate.
2021-06-10 01:51:16 [INFO] Writing every 10 Runs.
2021-06-10 01:51:16 [INFO] Processing SRX3718133. (1/2)
2021-06-10 01:51:16 [INFO] Processing SRX3718133-SRR7904214. (1/30)
2021-06-10 01:51:21 [INFO] Processing SRX3718133-SRR7904221. (2/30)
2021-06-10 01:51:34 [INFO] Processing SRX3718133-SRR7904216. (3/30)
2021-06-10 01:51:44 [INFO] Processing SRX3718133-SRR7904217. (4/30)
2021-06-10 01:51:56 [INFO] Processing SRX3718133-SRR7904215. (5/30)
2021-06-10 01:52:06 [INFO] Processing SRX3718133-SRR7904213. (6/30)
2021-06-10 01:52:29 [INFO] Processing SRX3718133-SRR7904219. (7/30)
2021-06-10 01:52:41 [INFO] Processing SRX3718133-SRR7904220. (8/30)
2021-06-10 01:52:51 [INFO] Processing SRX3718133-SRR7904222. (9/30)
2021-06-10 01:53:04 [INFO] Processing SRX3718133-SRR7904212. (10/30)
2021-06-10 01:53:10 [INFO] Writing to disk...
2021-06-10 01:53:13 [INFO] Processing SRX3718133-SRR6745451. (11/30)
2021-06-10 01:53:24 [INFO] Processing SRX3718133-SRR7904218. (12/30)
2021-06-10 01:53:32 [INFO] Processing SRX3718134. (2/2)
2021-06-10 01:53:32 [INFO] Processing SRX3718134-SRR6813823. (13/30)
2021-06-10 01:53:40 [INFO] Processing SRX3718134-SRR6813825. (14/30)
2021-06-10 01:53:46 [INFO] Processing SRX3718134-SRR6813822. (15/30)
2021-06-10 01:53:53 [INFO] Processing SRX3718134-SRR6813816. (16/30)
2021-06-10 01:53:55 [INFO] Processing SRX3718134-SRR6813824. (17/30)
2021-06-10 01:54:00 [INFO] Processing SRX3718134-SRR6813828. (18/30)
2021-06-10 01:54:09 [INFO] Processing SRX3718134-SRR6813820. (19/30)
2021-06-10 01:54:15 [INFO] Processing SRX3718134-SRR6813827. (20/30)
2021-06-10 01:54:20 [INFO] Writing to disk...
2021-06-10 01:54:28 [INFO] Processing SRX3718134-SRR6813813. (21/30)
2021-06-10 01:54:31 [INFO] Processing SRX3718134-SRR6745452. (22/30)
2021-06-10 01:54:33 [INFO] Processing SRX3718134-SRR6813814. (23/30)
2021-06-10 01:54:36 [INFO] Processing SRX3718134-SRR6813819. (24/30)
2021-06-10 01:54:43 [INFO] Processing SRX3718134-SRR6813821. (25/30)
2021-06-10 01:54:47 [INFO] Processing SRX3718134-SRR6813826. (26/30)
2021-06-10 01:54:53 [INFO] Processing SRX3718134-SRR6813815. (27/30)
2021-06-10 01:54:56 [INFO] Processing SRX3718134-SRR6813812. (28/30)
2021-06-10 01:54:58 [INFO] Processing SRX3718134-SRR6813818. (29/30)
2021-06-10 01:55:05 [INFO] Processing SRX3718134-SRR6813817. (30/30)
2021-06-10 01:55:10 [INFO] Writing to disk...
2021-06-10 01:55:16 [INFO] Finished.
2021-08-02 17:08:55 [INFO] Starting.
2021-08-02 17:08:55 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/
2021-08-02 17:08:55 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/aggregate.hdf5
2021-08-02 17:08:55 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-02 17:08:56 [INFO] Building aggregate for 1bp_raw network.
2021-08-02 17:08:56 [INFO] Writing every 10 Runs.
2021-08-02 17:08:56 [INFO] Processing SRX3718133. (1/2)
2021-08-02 17:08:56 [INFO] Processing SRX3718133-SRR7904214. (1/30)
2021-08-02 17:46:06 [INFO] Processing SRX3718133-SRR7904221. (2/30)
2021-08-02 17:54:10 [ERROR] Adding SRR7904221:chr13_vs_chr5 to in memory aggregate failed. Error message:
Traceback (most recent call last):
  File "/grid/gillis/data/nfox/hi_c_data_processing/software/aggregate.py", line 428, in add_dataset
    aggregate_data[c] = aggregate_data[c] + net
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/base.py", line 415, in __add__
    return self._add_sparse(other)
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 359, in _add_sparse
    return self._binopt(other, '_plus_')
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 1226, in _binopt
    indptr = np.empty(self.indptr.shape, dtype=idx_dtype)
MemoryError: Unable to allocate 436. MiB for an array with shape (114364329,) and data type int32

2021-08-05 03:24:26 [INFO] Starting.
2021-08-05 03:24:26 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/
2021-08-05 03:24:26 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/aggregate.hdf5
2021-08-05 03:24:26 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-05 03:24:26 [INFO] Building aggregate for 1bp_raw network.
2021-08-05 03:24:26 [INFO] Writing every 10 Runs.
2021-08-05 03:24:26 [INFO] Processing SRX3718133. (1/2)
2021-08-05 03:24:26 [INFO] Processing SRX3718133-SRR7904214. (1/30)
2021-08-05 03:27:45 [INFO] Processing SRX3718133-SRR7904221. (2/30)
2021-08-05 03:35:02 [INFO] Processing SRX3718133-SRR7904216. (3/30)
2021-08-05 03:42:38 [INFO] Processing SRX3718133-SRR7904217. (4/30)
2021-08-05 03:50:15 [INFO] Processing SRX3718133-SRR7904215. (5/30)
2021-08-05 03:57:51 [INFO] Processing SRX3718133-SRR7904213. (6/30)
2021-08-05 04:05:22 [INFO] Processing SRX3718133-SRR7904219. (7/30)
2021-08-05 04:12:57 [INFO] Processing SRX3718133-SRR7904220. (8/30)
2021-08-05 04:20:30 [INFO] Processing SRX3718133-SRR7904222. (9/30)
2021-08-05 04:28:08 [INFO] Processing SRX3718133-SRR7904212. (10/30)
2021-08-05 04:35:43 [INFO] Writing to disk...
2021-08-05 04:36:25 [INFO] Processing SRX3718133-SRR6745451. (11/30)
2021-08-05 04:44:04 [INFO] Processing SRX3718133-SRR7904218. (12/30)
2021-08-05 04:51:40 [INFO] Processing SRX3718134. (2/2)
2021-08-05 04:51:40 [INFO] Processing SRX3718134-SRR6813823. (13/30)
2021-08-05 04:59:06 [INFO] Processing SRX3718134-SRR6813825. (14/30)
2021-08-05 05:06:35 [INFO] Processing SRX3718134-SRR6813822. (15/30)
2021-08-05 05:14:08 [INFO] Processing SRX3718134-SRR6813816. (16/30)
2021-08-05 05:21:31 [INFO] Processing SRX3718134-SRR6813824. (17/30)
2021-08-05 05:29:01 [INFO] Processing SRX3718134-SRR6813828. (18/30)
2021-08-05 05:36:33 [INFO] Processing SRX3718134-SRR6813820. (19/30)
2021-08-05 05:44:07 [INFO] Processing SRX3718134-SRR6813827. (20/30)
2021-08-05 05:51:38 [INFO] Writing to disk...
2021-08-05 05:52:29 [INFO] Processing SRX3718134-SRR6813813. (21/30)
2021-08-05 05:59:53 [INFO] Processing SRX3718134-SRR6745452. (22/30)
2021-08-05 06:07:21 [INFO] Processing SRX3718134-SRR6813814. (23/30)
2021-08-05 06:14:45 [INFO] Processing SRX3718134-SRR6813819. (24/30)
2021-08-05 06:22:13 [INFO] Processing SRX3718134-SRR6813821. (25/30)
2021-08-05 06:29:43 [INFO] Processing SRX3718134-SRR6813826. (26/30)
2021-08-05 06:37:16 [INFO] Processing SRX3718134-SRR6813815. (27/30)
2021-08-05 06:44:34 [INFO] Processing SRX3718134-SRR6813812. (28/30)
2021-08-05 06:51:54 [INFO] Processing SRX3718134-SRR6813818. (29/30)
2021-08-05 06:59:22 [INFO] Processing SRX3718134-SRR6813817. (30/30)
2021-08-05 07:06:49 [INFO] Writing to disk...
2021-08-05 07:07:42 [INFO] Finished.
2021-08-12 17:33:50 [INFO] Starting.
2021-08-12 17:33:50 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/
2021-08-12 17:33:50 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/aggregate.hdf5
2021-08-12 17:33:50 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 17:33:50 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 17:33:50 [INFO] Writing every 10 Runs.
2021-08-12 17:33:50 [INFO] Processing SRX3718133. (1/2)
2021-08-12 17:33:50 [INFO] Processing SRX3718133-SRR7904214. (1/30)
2021-08-12 17:34:04 [INFO] Processing SRX3718133-SRR7904221. (2/30)
2021-08-12 17:34:18 [INFO] Processing SRX3718133-SRR7904216. (3/30)
2021-08-12 17:34:32 [INFO] Processing SRX3718133-SRR7904217. (4/30)
2021-08-12 17:34:48 [INFO] Processing SRX3718133-SRR7904215. (5/30)
2021-08-12 17:35:06 [INFO] Processing SRX3718133-SRR7904213. (6/30)
2021-08-12 17:35:20 [INFO] Processing SRX3718133-SRR7904219. (7/30)
2021-08-12 17:35:34 [INFO] Processing SRX3718133-SRR7904220. (8/30)
2021-08-12 17:35:49 [INFO] Processing SRX3718133-SRR7904222. (9/30)
2021-08-12 17:36:08 [INFO] Processing SRX3718133-SRR7904212. (10/30)
2021-08-12 17:36:23 [INFO] Writing to disk...
2021-08-12 17:36:26 [INFO] Processing SRX3718133-SRR6745451. (11/30)
2021-08-12 17:36:37 [INFO] Processing SRX3718133-SRR7904218. (12/30)
2021-08-12 17:36:51 [INFO] Processing SRX3718134. (2/2)
2021-08-12 17:36:51 [INFO] Processing SRX3718134-SRR6813823. (13/30)
2021-08-12 17:36:58 [INFO] Processing SRX3718134-SRR6813825. (14/30)
2021-08-12 17:37:05 [INFO] Processing SRX3718134-SRR6813822. (15/30)
2021-08-12 17:37:12 [INFO] Processing SRX3718134-SRR6813816. (16/30)
2021-08-12 17:37:15 [INFO] Processing SRX3718134-SRR6813824. (17/30)
2021-08-12 17:37:24 [INFO] Processing SRX3718134-SRR6813828. (18/30)
2021-08-12 17:37:30 [INFO] Processing SRX3718134-SRR6813820. (19/30)
2021-08-12 17:37:39 [INFO] Processing SRX3718134-SRR6813827. (20/30)
2021-08-12 17:37:47 [INFO] Writing to disk...
2021-08-12 17:38:01 [INFO] Processing SRX3718134-SRR6813813. (21/30)
2021-08-12 17:38:03 [INFO] Processing SRX3718134-SRR6745452. (22/30)
2021-08-12 17:38:05 [INFO] Processing SRX3718134-SRR6813814. (23/30)
2021-08-12 17:38:08 [INFO] Processing SRX3718134-SRR6813819. (24/30)
2021-08-12 17:38:14 [INFO] Processing SRX3718134-SRR6813821. (25/30)
2021-08-12 17:38:21 [INFO] Processing SRX3718134-SRR6813826. (26/30)
2021-08-12 17:38:28 [INFO] Processing SRX3718134-SRR6813815. (27/30)
2021-08-12 17:38:30 [INFO] Processing SRX3718134-SRR6813812. (28/30)
2021-08-12 17:38:32 [INFO] Processing SRX3718134-SRR6813818. (29/30)
2021-08-12 17:38:39 [INFO] Processing SRX3718134-SRR6813817. (30/30)
2021-08-12 17:38:46 [INFO] Writing to disk...
2021-08-12 17:39:01 [INFO] Finished.
2021-08-13 09:12:09 [INFO] Starting.
2021-08-13 09:12:09 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/
2021-08-13 09:12:09 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/aggregate.hdf5
2021-08-13 09:12:09 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-13 09:12:10 [INFO] Building aggregate for 25kbp_raw network.
2021-08-13 09:12:10 [INFO] Writing every 10 Runs.
2021-08-13 09:12:10 [INFO] Processing SRX3718133. (1/2)
2021-08-13 09:12:10 [INFO] Processing SRX3718133-SRR7904214. (1/30)
2021-08-13 09:12:23 [INFO] Processing SRX3718133-SRR7904221. (2/30)
2021-08-13 09:12:39 [INFO] Processing SRX3718133-SRR7904216. (3/30)
2021-08-13 09:12:57 [INFO] Processing SRX3718133-SRR7904217. (4/30)
2021-08-13 09:13:10 [INFO] Processing SRX3718133-SRR7904215. (5/30)
2021-08-13 09:13:29 [INFO] Processing SRX3718133-SRR7904213. (6/30)
2021-08-13 09:13:44 [INFO] Processing SRX3718133-SRR7904219. (7/30)
2021-08-13 09:14:02 [INFO] Processing SRX3718133-SRR7904220. (8/30)
2021-08-13 09:14:17 [INFO] Processing SRX3718133-SRR7904222. (9/30)
2021-08-13 09:14:30 [INFO] Processing SRX3718133-SRR7904212. (10/30)
2021-08-13 09:14:40 [INFO] Writing to disk...
2021-08-13 09:14:42 [INFO] Processing SRX3718133-SRR6745451. (11/30)
2021-08-13 09:14:54 [INFO] Processing SRX3718133-SRR7904218. (12/30)
2021-08-13 09:15:07 [INFO] Processing SRX3718134. (2/2)
2021-08-13 09:15:07 [INFO] Processing SRX3718134-SRR6813823. (13/30)
2021-08-13 09:15:15 [INFO] Processing SRX3718134-SRR6813825. (14/30)
2021-08-13 09:15:22 [INFO] Processing SRX3718134-SRR6813822. (15/30)
2021-08-13 09:15:29 [INFO] Processing SRX3718134-SRR6813816. (16/30)
2021-08-13 09:15:31 [INFO] Processing SRX3718134-SRR6813824. (17/30)
2021-08-13 09:15:38 [INFO] Processing SRX3718134-SRR6813828. (18/30)
2021-08-13 09:15:45 [INFO] Processing SRX3718134-SRR6813820. (19/30)
2021-08-13 09:15:51 [INFO] Processing SRX3718134-SRR6813827. (20/30)
2021-08-13 09:15:57 [INFO] Writing to disk...
2021-08-13 09:16:13 [INFO] Processing SRX3718134-SRR6813813. (21/30)
2021-08-13 09:16:15 [INFO] Processing SRX3718134-SRR6745452. (22/30)
2021-08-13 09:16:18 [INFO] Processing SRX3718134-SRR6813814. (23/30)
2021-08-13 09:16:20 [INFO] Processing SRX3718134-SRR6813819. (24/30)
2021-08-13 09:16:27 [INFO] Processing SRX3718134-SRR6813821. (25/30)
2021-08-13 09:16:33 [INFO] Processing SRX3718134-SRR6813826. (26/30)
2021-08-13 09:16:39 [INFO] Processing SRX3718134-SRR6813815. (27/30)
2021-08-13 09:16:42 [INFO] Processing SRX3718134-SRR6813812. (28/30)
2021-08-13 09:16:44 [INFO] Processing SRX3718134-SRR6813818. (29/30)
2021-08-13 09:16:50 [INFO] Processing SRX3718134-SRR6813817. (30/30)
2021-08-13 09:16:56 [INFO] Writing to disk...
2021-08-13 09:17:15 [INFO] Finished.
2021-08-13 13:19:44 [INFO] Starting.
2021-08-13 13:19:44 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/
2021-08-13 13:19:44 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/aggregate.hdf5
2021-08-13 13:19:44 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-13 13:19:44 [INFO] Building aggregate for 5kbp_raw network.
2021-08-13 13:19:44 [INFO] Writing every 10 Runs.
2021-08-13 13:19:44 [INFO] Processing SRX3718133. (1/2)
2021-08-13 13:19:44 [INFO] Processing SRX3718133-SRR7904214. (1/30)
2021-08-13 13:19:56 [INFO] Processing SRX3718133-SRR7904221. (2/30)
2021-08-13 13:20:11 [INFO] Processing SRX3718133-SRR7904216. (3/30)
2021-08-13 13:20:27 [INFO] Processing SRX3718133-SRR7904217. (4/30)
2021-08-13 13:20:44 [INFO] Processing SRX3718133-SRR7904215. (5/30)
2021-08-13 13:20:59 [INFO] Processing SRX3718133-SRR7904213. (6/30)
2021-08-13 13:21:13 [INFO] Processing SRX3718133-SRR7904219. (7/30)
2021-08-13 13:21:25 [INFO] Processing SRX3718133-SRR7904220. (8/30)
2021-08-13 13:21:39 [INFO] Processing SRX3718133-SRR7904222. (9/30)
2021-08-13 13:21:54 [INFO] Processing SRX3718133-SRR7904212. (10/30)
2021-08-13 13:22:09 [INFO] Writing to disk...
2021-08-13 13:22:12 [INFO] Processing SRX3718133-SRR6745451. (11/30)
2021-08-13 13:22:25 [INFO] Processing SRX3718133-SRR7904218. (12/30)
2021-08-13 13:22:39 [INFO] Processing SRX3718134. (2/2)
2021-08-13 13:22:39 [INFO] Processing SRX3718134-SRR6813823. (13/30)
2021-08-13 13:22:46 [INFO] Processing SRX3718134-SRR6813825. (14/30)
2021-08-13 13:22:53 [INFO] Processing SRX3718134-SRR6813822. (15/30)
2021-08-13 13:23:00 [INFO] Processing SRX3718134-SRR6813816. (16/30)
2021-08-13 13:23:03 [INFO] Processing SRX3718134-SRR6813824. (17/30)
2021-08-13 13:23:11 [INFO] Processing SRX3718134-SRR6813828. (18/30)
2021-08-13 13:23:19 [INFO] Processing SRX3718134-SRR6813820. (19/30)
2021-08-13 13:23:26 [INFO] Processing SRX3718134-SRR6813827. (20/30)
2021-08-13 13:23:33 [INFO] Writing to disk...
2021-08-13 13:23:45 [INFO] Processing SRX3718134-SRR6813813. (21/30)
2021-08-13 13:23:48 [INFO] Processing SRX3718134-SRR6745452. (22/30)
2021-08-13 13:23:51 [INFO] Processing SRX3718134-SRR6813814. (23/30)
2021-08-13 13:23:53 [INFO] Processing SRX3718134-SRR6813819. (24/30)
2021-08-13 13:24:01 [INFO] Processing SRX3718134-SRR6813821. (25/30)
2021-08-13 13:24:07 [INFO] Processing SRX3718134-SRR6813826. (26/30)
2021-08-13 13:24:15 [INFO] Processing SRX3718134-SRR6813815. (27/30)
2021-08-13 13:24:18 [INFO] Processing SRX3718134-SRR6813812. (28/30)
2021-08-13 13:24:20 [INFO] Processing SRX3718134-SRR6813818. (29/30)
2021-08-13 13:24:27 [INFO] Processing SRX3718134-SRR6813817. (30/30)
2021-08-13 13:24:34 [INFO] Writing to disk...
2021-08-13 13:24:36 [INFO] Finished.
2021-08-16 12:03:53 [INFO] Starting.
2021-08-16 12:03:53 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/
2021-08-16 12:03:53 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/aggregate.hdf5
2021-08-16 12:03:53 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-16 12:03:53 [INFO] Building aggregate for 1kbp_raw network.
2021-08-16 12:03:53 [INFO] Writing every 10 Runs.
2021-08-16 12:03:54 [INFO] Processing SRX3718133. (1/2)
2021-08-16 12:03:54 [INFO] Processing SRX3718133-SRR7904214. (1/30)
2021-08-16 12:04:06 [INFO] Processing SRX3718133-SRR7904221. (2/30)
2021-08-16 12:04:22 [INFO] Processing SRX3718133-SRR7904216. (3/30)
2021-08-16 12:04:38 [INFO] Processing SRX3718133-SRR7904217. (4/30)
2021-08-16 12:04:58 [INFO] Processing SRX3718133-SRR7904215. (5/30)
2021-08-16 12:05:16 [INFO] Processing SRX3718133-SRR7904213. (6/30)
2021-08-16 12:05:31 [INFO] Processing SRX3718133-SRR7904219. (7/30)
2021-08-16 12:05:47 [INFO] Processing SRX3718133-SRR7904220. (8/30)
2021-08-16 12:06:03 [INFO] Processing SRX3718133-SRR7904222. (9/30)
2021-08-16 12:06:21 [INFO] Processing SRX3718133-SRR7904212. (10/30)
2021-08-16 12:06:34 [INFO] Writing to disk...
2021-08-16 12:06:37 [INFO] Processing SRX3718133-SRR6745451. (11/30)
2021-08-16 12:06:50 [INFO] Processing SRX3718133-SRR7904218. (12/30)
2021-08-16 12:07:06 [INFO] Processing SRX3718134. (2/2)
2021-08-16 12:07:06 [INFO] Processing SRX3718134-SRR6813823. (13/30)
2021-08-16 12:07:12 [INFO] Processing SRX3718134-SRR6813825. (14/30)
2021-08-16 12:07:18 [INFO] Processing SRX3718134-SRR6813822. (15/30)
2021-08-16 12:07:26 [INFO] Processing SRX3718134-SRR6813816. (16/30)
2021-08-16 12:07:29 [INFO] Processing SRX3718134-SRR6813824. (17/30)
2021-08-16 12:07:37 [INFO] Processing SRX3718134-SRR6813828. (18/30)
2021-08-16 12:07:45 [INFO] Processing SRX3718134-SRR6813820. (19/30)
2021-08-16 12:07:51 [INFO] Processing SRX3718134-SRR6813827. (20/30)
2021-08-16 12:07:58 [INFO] Writing to disk...
2021-08-16 12:08:01 [INFO] Processing SRX3718134-SRR6813813. (21/30)
2021-08-16 12:08:04 [INFO] Processing SRX3718134-SRR6745452. (22/30)
2021-08-16 12:08:08 [INFO] Processing SRX3718134-SRR6813814. (23/30)
2021-08-16 12:08:11 [INFO] Processing SRX3718134-SRR6813819. (24/30)
2021-08-16 12:08:19 [INFO] Processing SRX3718134-SRR6813821. (25/30)
2021-08-16 12:08:27 [INFO] Processing SRX3718134-SRR6813826. (26/30)
2021-08-16 12:08:34 [INFO] Processing SRX3718134-SRR6813815. (27/30)
2021-08-16 12:08:37 [INFO] Processing SRX3718134-SRR6813812. (28/30)
2021-08-16 12:08:41 [INFO] Processing SRX3718134-SRR6813818. (29/30)
2021-08-16 12:08:47 [INFO] Processing SRX3718134-SRR6813817. (30/30)
2021-08-16 12:08:54 [INFO] Writing to disk...
2021-08-16 12:08:56 [INFO] Finished.
2021-08-21 00:50:35 [INFO] Starting.
2021-08-21 00:50:35 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/
2021-08-21 00:50:35 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/aggregate.hdf5
2021-08-21 00:50:35 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-21 00:50:35 [INFO] Building aggregate for 100kbp_raw network.
2021-08-21 00:50:35 [INFO] Writing every 10 Runs.
2021-08-21 00:50:35 [INFO] Processing SRX3718133. (1/2)
2021-08-21 00:50:35 [INFO] Processing SRX3718133-SRR7904214. (1/30)
2021-08-21 00:50:43 [INFO] Processing SRX3718133-SRR7904221. (2/30)
2021-08-21 00:50:52 [INFO] Processing SRX3718133-SRR7904216. (3/30)
2021-08-21 00:51:02 [INFO] Processing SRX3718133-SRR7904217. (4/30)
2021-08-21 00:51:10 [INFO] Processing SRX3718133-SRR7904215. (5/30)
2021-08-21 00:51:19 [INFO] Processing SRX3718133-SRR7904213. (6/30)
2021-08-21 00:51:29 [INFO] Processing SRX3718133-SRR7904219. (7/30)
2021-08-21 00:51:37 [INFO] Processing SRX3718133-SRR7904220. (8/30)
2021-08-21 00:51:48 [INFO] Processing SRX3718133-SRR7904222. (9/30)
2021-08-21 00:52:00 [INFO] Processing SRX3718133-SRR7904212. (10/30)
2021-08-21 00:52:09 [INFO] Writing to disk...
2021-08-21 00:52:11 [INFO] Processing SRX3718133-SRR6745451. (11/30)
2021-08-21 00:52:19 [INFO] Processing SRX3718133-SRR7904218. (12/30)
2021-08-21 00:52:29 [INFO] Processing SRX3718134. (2/2)
2021-08-21 00:52:29 [INFO] Processing SRX3718134-SRR6813823. (13/30)
2021-08-21 00:52:35 [INFO] Processing SRX3718134-SRR6813825. (14/30)
2021-08-21 00:52:41 [INFO] Processing SRX3718134-SRR6813822. (15/30)
2021-08-21 00:52:46 [INFO] Processing SRX3718134-SRR6813816. (16/30)
2021-08-21 00:52:48 [INFO] Processing SRX3718134-SRR6813824. (17/30)
2021-08-21 00:52:53 [INFO] Processing SRX3718134-SRR6813828. (18/30)
2021-08-21 00:52:59 [INFO] Processing SRX3718134-SRR6813820. (19/30)
2021-08-21 00:53:04 [INFO] Processing SRX3718134-SRR6813827. (20/30)
2021-08-21 00:53:08 [INFO] Writing to disk...
2021-08-21 00:53:19 [INFO] Processing SRX3718134-SRR6813813. (21/30)
2021-08-21 00:53:21 [INFO] Processing SRX3718134-SRR6745452. (22/30)
2021-08-21 00:53:23 [INFO] Processing SRX3718134-SRR6813814. (23/30)
2021-08-21 00:53:25 [INFO] Processing SRX3718134-SRR6813819. (24/30)
2021-08-21 00:53:30 [INFO] Processing SRX3718134-SRR6813821. (25/30)
2021-08-21 00:53:34 [INFO] Processing SRX3718134-SRR6813826. (26/30)
2021-08-21 00:53:40 [INFO] Processing SRX3718134-SRR6813815. (27/30)
2021-08-21 00:53:42 [INFO] Processing SRX3718134-SRR6813812. (28/30)
2021-08-21 00:53:44 [INFO] Processing SRX3718134-SRR6813818. (29/30)
2021-08-21 00:53:49 [INFO] Processing SRX3718134-SRR6813817. (30/30)
2021-08-21 00:53:54 [INFO] Writing to disk...
2021-08-21 00:54:00 [INFO] Finished.
2021-08-23 12:22:08 [INFO] Starting.
2021-08-23 12:22:08 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/
2021-08-23 12:22:08 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/aggregate.hdf5
2021-08-23 12:22:08 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 12:22:08 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 12:22:08 [INFO] Writing every 10 Runs.
2021-08-23 12:22:08 [INFO] Processing SRX3718133. (1/2)
2021-08-23 12:22:08 [INFO] Processing SRX3718133-SRR7904214. (1/30)
2021-08-23 12:22:15 [INFO] Processing SRX3718133-SRR7904221. (2/30)
2021-08-23 12:22:25 [INFO] Processing SRX3718133-SRR7904216. (3/30)
2021-08-23 12:22:32 [INFO] Processing SRX3718133-SRR7904217. (4/30)
2021-08-23 12:22:37 [INFO] Processing SRX3718133-SRR7904215. (5/30)
2021-08-23 12:22:45 [INFO] Processing SRX3718133-SRR7904213. (6/30)
2021-08-23 12:22:51 [INFO] Processing SRX3718133-SRR7904219. (7/30)
2021-08-23 12:22:58 [INFO] Processing SRX3718133-SRR7904220. (8/30)
2021-08-23 12:23:05 [INFO] Processing SRX3718133-SRR7904222. (9/30)
2021-08-23 12:23:13 [INFO] Processing SRX3718133-SRR7904212. (10/30)
2021-08-23 12:23:19 [INFO] Writing to disk...
2021-08-23 12:23:20 [INFO] Processing SRX3718133-SRR6745451. (11/30)
2021-08-23 12:23:27 [INFO] Processing SRX3718133-SRR7904218. (12/30)
2021-08-23 12:23:34 [INFO] Processing SRX3718134. (2/2)
2021-08-23 12:23:34 [INFO] Processing SRX3718134-SRR6813823. (13/30)
2021-08-23 12:23:39 [INFO] Processing SRX3718134-SRR6813825. (14/30)
2021-08-23 12:23:44 [INFO] Processing SRX3718134-SRR6813822. (15/30)
2021-08-23 12:23:48 [INFO] Processing SRX3718134-SRR6813816. (16/30)
2021-08-23 12:23:50 [INFO] Processing SRX3718134-SRR6813824. (17/30)
2021-08-23 12:23:55 [INFO] Processing SRX3718134-SRR6813828. (18/30)
2021-08-23 12:24:00 [INFO] Processing SRX3718134-SRR6813820. (19/30)
2021-08-23 12:24:04 [INFO] Processing SRX3718134-SRR6813827. (20/30)
2021-08-23 12:24:10 [INFO] Writing to disk...
2021-08-23 12:24:18 [INFO] Processing SRX3718134-SRR6813813. (21/30)
2021-08-23 12:24:20 [INFO] Processing SRX3718134-SRR6745452. (22/30)
2021-08-23 12:24:22 [INFO] Processing SRX3718134-SRR6813814. (23/30)
2021-08-23 12:24:24 [INFO] Processing SRX3718134-SRR6813819. (24/30)
2021-08-23 12:24:29 [INFO] Processing SRX3718134-SRR6813821. (25/30)
2021-08-23 12:24:34 [INFO] Processing SRX3718134-SRR6813826. (26/30)
2021-08-23 12:24:38 [INFO] Processing SRX3718134-SRR6813815. (27/30)
2021-08-23 12:24:41 [INFO] Processing SRX3718134-SRR6813812. (28/30)
2021-08-23 12:24:43 [INFO] Processing SRX3718134-SRR6813818. (29/30)
2021-08-23 12:24:48 [INFO] Processing SRX3718134-SRR6813817. (30/30)
2021-08-23 12:24:52 [INFO] Writing to disk...
2021-08-23 12:24:57 [INFO] Finished.
2021-08-23 15:19:32 [INFO] Starting.
2021-08-23 15:19:32 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/
2021-08-23 15:19:32 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP133031/aggregate.hdf5
2021-08-23 15:19:32 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 15:19:32 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 15:19:32 [INFO] Writing every 10 Runs.
2021-08-23 15:19:32 [INFO] Processing SRX3718133. (1/2)
2021-08-23 15:19:32 [INFO] Processing SRX3718133-SRR7904214. (1/30)
2021-08-23 15:19:39 [INFO] Processing SRX3718133-SRR7904221. (2/30)
2021-08-23 15:19:46 [INFO] Processing SRX3718133-SRR7904216. (3/30)
2021-08-23 15:19:53 [INFO] Processing SRX3718133-SRR7904217. (4/30)
2021-08-23 15:20:00 [INFO] Processing SRX3718133-SRR7904215. (5/30)
2021-08-23 15:20:07 [INFO] Processing SRX3718133-SRR7904213. (6/30)
2021-08-23 15:20:14 [INFO] Processing SRX3718133-SRR7904219. (7/30)
2021-08-23 15:20:22 [INFO] Processing SRX3718133-SRR7904220. (8/30)
2021-08-23 15:20:29 [INFO] Processing SRX3718133-SRR7904222. (9/30)
2021-08-23 15:20:37 [INFO] Processing SRX3718133-SRR7904212. (10/30)
2021-08-23 15:20:44 [INFO] Writing to disk...
2021-08-23 15:20:44 [INFO] Processing SRX3718133-SRR6745451. (11/30)
2021-08-23 15:20:51 [INFO] Processing SRX3718133-SRR7904218. (12/30)
2021-08-23 15:20:58 [INFO] Processing SRX3718134. (2/2)
2021-08-23 15:20:58 [INFO] Processing SRX3718134-SRR6813823. (13/30)
2021-08-23 15:21:02 [INFO] Processing SRX3718134-SRR6813825. (14/30)
2021-08-23 15:21:07 [INFO] Processing SRX3718134-SRR6813822. (15/30)
2021-08-23 15:21:14 [INFO] Processing SRX3718134-SRR6813816. (16/30)
2021-08-23 15:21:16 [INFO] Processing SRX3718134-SRR6813824. (17/30)
2021-08-23 15:21:21 [INFO] Processing SRX3718134-SRR6813828. (18/30)
2021-08-23 15:21:26 [INFO] Processing SRX3718134-SRR6813820. (19/30)
2021-08-23 15:21:31 [INFO] Processing SRX3718134-SRR6813827. (20/30)
2021-08-23 15:21:36 [INFO] Writing to disk...
2021-08-23 15:21:36 [INFO] Processing SRX3718134-SRR6813813. (21/30)
2021-08-23 15:21:38 [INFO] Processing SRX3718134-SRR6745452. (22/30)
2021-08-23 15:21:40 [INFO] Processing SRX3718134-SRR6813814. (23/30)
2021-08-23 15:21:42 [INFO] Processing SRX3718134-SRR6813819. (24/30)
2021-08-23 15:21:47 [INFO] Processing SRX3718134-SRR6813821. (25/30)
2021-08-23 15:21:51 [INFO] Processing SRX3718134-SRR6813826. (26/30)
2021-08-23 15:21:56 [INFO] Processing SRX3718134-SRR6813815. (27/30)
2021-08-23 15:21:58 [INFO] Processing SRX3718134-SRR6813812. (28/30)
2021-08-23 15:22:00 [INFO] Processing SRX3718134-SRR6813818. (29/30)
2021-08-23 15:22:05 [INFO] Processing SRX3718134-SRR6813817. (30/30)
2021-08-23 15:22:10 [INFO] Writing to disk...
2021-08-23 15:22:11 [INFO] Finished.