2021-06-10 02:48:54 [INFO] Starting.
2021-06-10 02:48:54 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/
2021-06-10 02:48:54 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/aggregate.hdf5
2021-06-10 02:48:54 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes
2021-06-10 02:48:54 [INFO] Using only main chromosomes: chr1, chr2, chr3, chr4, chr5, chr6, chr7, chrX, chr8, chr9, chr11, chr10, chr12, chr13, chr14, chr15, chr16, chr17, chr18, chr20, chr19, chrY, chr22, chr21, chrM
2021-06-10 02:48:55 [INFO] Building aggregate.
2021-06-10 02:48:55 [INFO] Writing every 10 Runs.
2021-06-10 02:48:55 [INFO] Processing SRX7223631. (1/16)
2021-06-10 02:48:55 [INFO] Processing SRX7223631-SRR10539835. (1/16)
2021-06-10 02:49:38 [INFO] Processing SRX7223637. (2/16)
2021-06-10 02:49:38 [INFO] Processing SRX7223637-SRR10539841. (2/16)
2021-06-10 02:50:03 [INFO] Processing SRX7223642. (3/16)
2021-06-10 02:50:03 [INFO] Processing SRX7223642-SRR10539846. (3/16)
2021-06-10 02:50:54 [INFO] Processing SRX7223635. (4/16)
2021-06-10 02:50:54 [INFO] Processing SRX7223635-SRR10539839. (4/16)
2021-06-10 02:51:42 [INFO] Processing SRX7223636. (5/16)
2021-06-10 02:51:42 [INFO] Processing SRX7223636-SRR10539840. (5/16)
2021-06-10 02:52:37 [INFO] Processing SRX7223630. (6/16)
2021-06-10 02:52:37 [INFO] Processing SRX7223630-SRR10539834. (6/16)
2021-06-10 02:53:28 [INFO] Processing SRX7223641. (7/16)
2021-06-10 02:53:28 [INFO] Processing SRX7223641-SRR10539845. (7/16)
2021-06-10 02:53:50 [INFO] Processing SRX7223634. (8/16)
2021-06-10 02:53:50 [INFO] Processing SRX7223634-SRR10539838. (8/16)
2021-06-10 02:54:51 [INFO] Processing SRX7223629. (9/16)
2021-06-10 02:54:51 [INFO] Processing SRX7223629-SRR10539833. (9/16)
2021-06-10 02:55:39 [INFO] Processing SRX7223640. (10/16)
2021-06-10 02:55:39 [INFO] Processing SRX7223640-SRR10539844. (10/16)
2021-06-10 02:56:56 [INFO] Writing to disk...
2021-06-10 02:57:23 [INFO] Processing SRX7223639. (11/16)
2021-06-10 02:57:23 [INFO] Processing SRX7223639-SRR10539843. (11/16)
2021-06-10 02:58:09 [INFO] Processing SRX7223628. (12/16)
2021-06-10 02:58:09 [INFO] Processing SRX7223628-SRR10539832. (12/16)
2021-06-10 02:59:31 [INFO] Processing SRX7223632. (13/16)
2021-06-10 02:59:31 [INFO] Processing SRX7223632-SRR10539836. (13/16)
2021-06-10 03:00:37 [INFO] Processing SRX7223633. (14/16)
2021-06-10 03:00:37 [INFO] Processing SRX7223633-SRR10539837. (14/16)
2021-06-10 03:01:01 [INFO] Processing SRX7223638. (15/16)
2021-06-10 03:01:01 [INFO] Processing SRX7223638-SRR10539842. (15/16)
2021-06-10 03:02:00 [INFO] Processing SRX7223643. (16/16)
2021-06-10 03:02:00 [INFO] Processing SRX7223643-SRR10539847. (16/16)
2021-06-10 03:02:36 [INFO] Writing to disk...
2021-06-10 03:03:40 [INFO] Finished.
2021-08-02 17:08:56 [INFO] Starting.
2021-08-02 17:08:56 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/
2021-08-02 17:08:56 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/aggregate.hdf5
2021-08-02 17:08:56 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-02 17:08:56 [INFO] Building aggregate for 1bp_raw network.
2021-08-02 17:08:56 [INFO] Writing every 10 Runs.
2021-08-02 17:08:56 [INFO] Processing SRX7223631. (1/16)
2021-08-02 17:08:56 [INFO] Processing SRX7223631-SRR10539835. (1/16)
2021-08-02 17:16:52 [INFO] Processing SRX7223637. (2/16)
2021-08-02 17:16:52 [INFO] Processing SRX7223637-SRR10539841. (2/16)
2021-08-02 17:20:08 [ERROR] Adding SRR10539841:chr19_vs_chr3 to in memory aggregate failed. Error message:
Traceback (most recent call last):
  File "/grid/gillis/data/nfox/hi_c_data_processing/software/aggregate.py", line 428, in add_dataset
    aggregate_data[c] = aggregate_data[c] + net
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/base.py", line 415, in __add__
    return self._add_sparse(other)
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 359, in _add_sparse
    return self._binopt(other, '_plus_')
  File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 1226, in _binopt
    indptr = np.empty(self.indptr.shape, dtype=idx_dtype)
MemoryError: Unable to allocate 224. MiB for an array with shape (58617617,) and data type int32

2021-08-04 22:04:35 [INFO] Starting.
2021-08-04 22:04:35 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/
2021-08-04 22:04:35 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/aggregate.hdf5
2021-08-04 22:04:35 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-04 22:04:35 [INFO] Building aggregate for 1bp_raw network.
2021-08-04 22:04:35 [INFO] Writing every 10 Runs.
2021-08-04 22:04:35 [INFO] Processing SRX7223631. (1/16)
2021-08-04 22:04:35 [INFO] Processing SRX7223631-SRR10539835. (1/16)
2021-08-04 22:08:05 [INFO] Processing SRX7223637. (2/16)
2021-08-04 22:08:05 [INFO] Processing SRX7223637-SRR10539841. (2/16)
2021-08-04 22:21:56 [INFO] Processing SRX7223642. (3/16)
2021-08-04 22:21:56 [INFO] Processing SRX7223642-SRR10539846. (3/16)
2021-08-04 22:30:54 [INFO] Processing SRX7223635. (4/16)
2021-08-04 22:30:54 [INFO] Processing SRX7223635-SRR10539839. (4/16)
2021-08-04 22:39:04 [INFO] Processing SRX7223636. (5/16)
2021-08-04 22:39:04 [INFO] Processing SRX7223636-SRR10539840. (5/16)
2021-08-04 22:47:39 [INFO] Processing SRX7223630. (6/16)
2021-08-04 22:47:39 [INFO] Processing SRX7223630-SRR10539834. (6/16)
2021-08-04 22:55:53 [INFO] Processing SRX7223641. (7/16)
2021-08-04 22:55:53 [INFO] Processing SRX7223641-SRR10539845. (7/16)
2021-08-04 23:04:09 [INFO] Processing SRX7223634. (8/16)
2021-08-04 23:04:09 [INFO] Processing SRX7223634-SRR10539838. (8/16)
2021-08-04 23:12:35 [INFO] Processing SRX7223629. (9/16)
2021-08-04 23:12:35 [INFO] Processing SRX7223629-SRR10539833. (9/16)
2021-08-04 23:20:47 [INFO] Processing SRX7223640. (10/16)
2021-08-04 23:20:47 [INFO] Processing SRX7223640-SRR10539844. (10/16)
2021-08-04 23:29:41 [INFO] Writing to disk...
2021-08-04 23:31:38 [INFO] Processing SRX7223639. (11/16)
2021-08-04 23:31:38 [INFO] Processing SRX7223639-SRR10539843. (11/16)
2021-08-04 23:39:54 [INFO] Processing SRX7223628. (12/16)
2021-08-04 23:39:54 [INFO] Processing SRX7223628-SRR10539832. (12/16)
2021-08-04 23:48:56 [INFO] Processing SRX7223632. (13/16)
2021-08-04 23:48:56 [INFO] Processing SRX7223632-SRR10539836. (13/16)
2021-08-04 23:58:00 [INFO] Processing SRX7223633. (14/16)
2021-08-04 23:58:00 [INFO] Processing SRX7223633-SRR10539837. (14/16)
2021-08-05 00:06:51 [INFO] Processing SRX7223638. (15/16)
2021-08-05 00:06:51 [INFO] Processing SRX7223638-SRR10539842. (15/16)
2021-08-05 00:15:50 [INFO] Processing SRX7223643. (16/16)
2021-08-05 00:15:50 [INFO] Processing SRX7223643-SRR10539847. (16/16)
2021-08-05 00:24:47 [INFO] Writing to disk...
2021-08-05 00:27:08 [INFO] Finished.
2021-08-12 14:31:17 [INFO] Starting.
2021-08-12 14:31:17 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/
2021-08-12 14:31:17 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/aggregate.hdf5
2021-08-12 14:31:17 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 14:31:18 [INFO] Building aggregate for 40kbp_raw network.
2021-08-12 14:31:18 [INFO] Writing every 10 Runs.
2021-08-12 14:31:18 [INFO] Processing SRX7223631. (1/16)
2021-08-12 14:31:18 [INFO] Processing SRX7223631-SRR10539835. (1/16)
2021-08-12 14:31:45 [INFO] Processing SRX7223637. (2/16)
2021-08-12 14:31:45 [INFO] Processing SRX7223637-SRR10539841. (2/16)
2021-08-12 14:32:17 [INFO] Processing SRX7223642. (3/16)
2021-08-12 14:32:17 [INFO] Processing SRX7223642-SRR10539846. (3/16)
2021-08-12 14:33:06 [INFO] Processing SRX7223635. (4/16)
2021-08-12 14:33:06 [INFO] Processing SRX7223635-SRR10539839. (4/16)
2021-08-12 14:33:40 [INFO] Processing SRX7223636. (5/16)
2021-08-12 14:33:40 [INFO] Processing SRX7223636-SRR10539840. (5/16)
2021-08-12 14:34:36 [INFO] Processing SRX7223630. (6/16)
2021-08-12 14:34:36 [INFO] Processing SRX7223630-SRR10539834. (6/16)
2021-08-12 14:35:13 [INFO] Processing SRX7223641. (7/16)
2021-08-12 14:35:13 [INFO] Processing SRX7223641-SRR10539845. (7/16)
2021-08-12 14:35:46 [INFO] Processing SRX7223634. (8/16)
2021-08-12 14:35:46 [INFO] Processing SRX7223634-SRR10539838. (8/16)
2021-08-12 14:36:34 [INFO] Processing SRX7223629. (9/16)
2021-08-12 14:36:34 [INFO] Processing SRX7223629-SRR10539833. (9/16)
2021-08-12 14:37:04 [INFO] Processing SRX7223640. (10/16)
2021-08-12 14:37:04 [INFO] Processing SRX7223640-SRR10539844. (10/16)
2021-08-12 14:37:55 [INFO] Writing to disk...
2021-08-12 14:38:16 [INFO] Processing SRX7223639. (11/16)
2021-08-12 14:38:16 [INFO] Processing SRX7223639-SRR10539843. (11/16)
2021-08-12 14:38:42 [INFO] Processing SRX7223628. (12/16)
2021-08-12 14:38:42 [INFO] Processing SRX7223628-SRR10539832. (12/16)
2021-08-12 14:39:25 [INFO] Processing SRX7223632. (13/16)
2021-08-12 14:39:25 [INFO] Processing SRX7223632-SRR10539836. (13/16)
2021-08-12 14:40:20 [INFO] Processing SRX7223633. (14/16)
2021-08-12 14:40:20 [INFO] Processing SRX7223633-SRR10539837. (14/16)
2021-08-12 14:40:40 [INFO] Processing SRX7223638. (15/16)
2021-08-12 14:40:40 [INFO] Processing SRX7223638-SRR10539842. (15/16)
2021-08-12 14:41:27 [INFO] Processing SRX7223643. (16/16)
2021-08-12 14:41:27 [INFO] Processing SRX7223643-SRR10539847. (16/16)
2021-08-12 14:42:03 [INFO] Writing to disk...
2021-08-12 14:42:26 [INFO] Finished.
2021-08-12 15:09:39 [INFO] Starting.
2021-08-12 15:09:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/
2021-08-12 15:09:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/aggregate.hdf5
2021-08-12 15:09:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:09:40 [INFO] Building aggregate for 25kbp_raw network.
2021-08-12 15:09:40 [INFO] Writing every 10 Runs.
2021-08-12 15:09:40 [INFO] Processing SRX7223631. (1/16)
2021-08-12 15:09:40 [INFO] Processing SRX7223631-SRR10539835. (1/16)
2021-08-12 15:10:03 [INFO] Processing SRX7223637. (2/16)
2021-08-12 15:10:03 [INFO] Processing SRX7223637-SRR10539841. (2/16)
2021-08-12 15:10:27 [INFO] Processing SRX7223642. (3/16)
2021-08-12 15:10:27 [INFO] Processing SRX7223642-SRR10539846. (3/16)
2021-08-12 15:11:07 [INFO] Processing SRX7223635. (4/16)
2021-08-12 15:11:07 [INFO] Processing SRX7223635-SRR10539839. (4/16)
2021-08-12 15:11:37 [INFO] Processing SRX7223636. (5/16)
2021-08-12 15:11:37 [INFO] Processing SRX7223636-SRR10539840. (5/16)
2021-08-12 15:12:22 [INFO] Processing SRX7223630. (6/16)
2021-08-12 15:12:22 [INFO] Processing SRX7223630-SRR10539834. (6/16)
2021-08-12 15:12:57 [INFO] Processing SRX7223641. (7/16)
2021-08-12 15:12:57 [INFO] Processing SRX7223641-SRR10539845. (7/16)
2021-08-12 15:13:24 [INFO] Processing SRX7223634. (8/16)
2021-08-12 15:13:24 [INFO] Processing SRX7223634-SRR10539838. (8/16)
2021-08-12 15:14:14 [INFO] Processing SRX7223629. (9/16)
2021-08-12 15:14:14 [INFO] Processing SRX7223629-SRR10539833. (9/16)
2021-08-12 15:14:42 [INFO] Processing SRX7223640. (10/16)
2021-08-12 15:14:42 [INFO] Processing SRX7223640-SRR10539844. (10/16)
2021-08-12 15:15:42 [INFO] Writing to disk...
2021-08-12 15:16:00 [INFO] Processing SRX7223639. (11/16)
2021-08-12 15:16:00 [INFO] Processing SRX7223639-SRR10539843. (11/16)
2021-08-12 15:16:22 [INFO] Processing SRX7223628. (12/16)
2021-08-12 15:16:22 [INFO] Processing SRX7223628-SRR10539832. (12/16)
2021-08-12 15:17:06 [INFO] Processing SRX7223632. (13/16)
2021-08-12 15:17:06 [INFO] Processing SRX7223632-SRR10539836. (13/16)
2021-08-12 15:17:41 [INFO] Processing SRX7223633. (14/16)
2021-08-12 15:17:41 [INFO] Processing SRX7223633-SRR10539837. (14/16)
2021-08-12 15:17:59 [INFO] Processing SRX7223638. (15/16)
2021-08-12 15:17:59 [INFO] Processing SRX7223638-SRR10539842. (15/16)
2021-08-12 15:18:35 [INFO] Processing SRX7223643. (16/16)
2021-08-12 15:18:35 [INFO] Processing SRX7223643-SRR10539847. (16/16)
2021-08-12 15:19:02 [INFO] Writing to disk...
2021-08-12 15:19:28 [INFO] Finished.
2021-08-12 15:44:39 [INFO] Starting.
2021-08-12 15:44:39 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/
2021-08-12 15:44:39 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/aggregate.hdf5
2021-08-12 15:44:39 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 15:44:39 [INFO] Building aggregate for 5kbp_raw network.
2021-08-12 15:44:39 [INFO] Writing every 10 Runs.
2021-08-12 15:44:39 [INFO] Processing SRX7223631. (1/16)
2021-08-12 15:44:39 [INFO] Processing SRX7223631-SRR10539835. (1/16)
2021-08-12 15:45:14 [INFO] Processing SRX7223637. (2/16)
2021-08-12 15:45:14 [INFO] Processing SRX7223637-SRR10539841. (2/16)
2021-08-12 15:45:49 [INFO] Processing SRX7223642. (3/16)
2021-08-12 15:45:49 [INFO] Processing SRX7223642-SRR10539846. (3/16)
2021-08-12 15:46:50 [INFO] Processing SRX7223635. (4/16)
2021-08-12 15:46:50 [INFO] Processing SRX7223635-SRR10539839. (4/16)
2021-08-12 15:47:31 [INFO] Processing SRX7223636. (5/16)
2021-08-12 15:47:31 [INFO] Processing SRX7223636-SRR10539840. (5/16)
2021-08-12 15:48:24 [INFO] Processing SRX7223630. (6/16)
2021-08-12 15:48:24 [INFO] Processing SRX7223630-SRR10539834. (6/16)
2021-08-12 15:49:23 [INFO] Processing SRX7223641. (7/16)
2021-08-12 15:49:23 [INFO] Processing SRX7223641-SRR10539845. (7/16)
2021-08-12 15:50:00 [INFO] Processing SRX7223634. (8/16)
2021-08-12 15:50:00 [INFO] Processing SRX7223634-SRR10539838. (8/16)
2021-08-12 15:50:50 [INFO] Processing SRX7223629. (9/16)
2021-08-12 15:50:50 [INFO] Processing SRX7223629-SRR10539833. (9/16)
2021-08-12 15:51:35 [INFO] Processing SRX7223640. (10/16)
2021-08-12 15:51:35 [INFO] Processing SRX7223640-SRR10539844. (10/16)
2021-08-12 15:52:36 [INFO] Writing to disk...
2021-08-12 15:53:10 [INFO] Processing SRX7223639. (11/16)
2021-08-12 15:53:10 [INFO] Processing SRX7223639-SRR10539843. (11/16)
2021-08-12 15:53:49 [INFO] Processing SRX7223628. (12/16)
2021-08-12 15:53:49 [INFO] Processing SRX7223628-SRR10539832. (12/16)
2021-08-12 15:54:46 [INFO] Processing SRX7223632. (13/16)
2021-08-12 15:54:46 [INFO] Processing SRX7223632-SRR10539836. (13/16)
2021-08-12 15:55:41 [INFO] Processing SRX7223633. (14/16)
2021-08-12 15:55:41 [INFO] Processing SRX7223633-SRR10539837. (14/16)
2021-08-12 15:56:08 [INFO] Processing SRX7223638. (15/16)
2021-08-12 15:56:08 [INFO] Processing SRX7223638-SRR10539842. (15/16)
2021-08-12 15:56:57 [INFO] Processing SRX7223643. (16/16)
2021-08-12 15:56:57 [INFO] Processing SRX7223643-SRR10539847. (16/16)
2021-08-12 15:57:42 [INFO] Writing to disk...
2021-08-12 15:58:24 [INFO] Finished.
2021-08-12 16:31:34 [INFO] Starting.
2021-08-12 16:31:34 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/
2021-08-12 16:31:34 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/aggregate.hdf5
2021-08-12 16:31:34 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-12 16:31:35 [INFO] Building aggregate for 1kbp_raw network.
2021-08-12 16:31:35 [INFO] Writing every 10 Runs.
2021-08-12 16:31:35 [INFO] Processing SRX7223631. (1/16)
2021-08-12 16:31:35 [INFO] Processing SRX7223631-SRR10539835. (1/16)
2021-08-12 16:32:10 [INFO] Processing SRX7223637. (2/16)
2021-08-12 16:32:10 [INFO] Processing SRX7223637-SRR10539841. (2/16)
2021-08-12 16:32:47 [INFO] Processing SRX7223642. (3/16)
2021-08-12 16:32:47 [INFO] Processing SRX7223642-SRR10539846. (3/16)
2021-08-12 16:33:49 [INFO] Processing SRX7223635. (4/16)
2021-08-12 16:33:49 [INFO] Processing SRX7223635-SRR10539839. (4/16)
2021-08-12 16:34:41 [INFO] Processing SRX7223636. (5/16)
2021-08-12 16:34:41 [INFO] Processing SRX7223636-SRR10539840. (5/16)
2021-08-12 16:36:01 [INFO] Processing SRX7223630. (6/16)
2021-08-12 16:36:01 [INFO] Processing SRX7223630-SRR10539834. (6/16)
2021-08-12 16:37:04 [INFO] Processing SRX7223641. (7/16)
2021-08-12 16:37:04 [INFO] Processing SRX7223641-SRR10539845. (7/16)
2021-08-12 16:37:58 [INFO] Processing SRX7223634. (8/16)
2021-08-12 16:37:58 [INFO] Processing SRX7223634-SRR10539838. (8/16)
2021-08-12 16:39:18 [INFO] Processing SRX7223629. (9/16)
2021-08-12 16:39:18 [INFO] Processing SRX7223629-SRR10539833. (9/16)
2021-08-12 16:40:17 [INFO] Processing SRX7223640. (10/16)
2021-08-12 16:40:17 [INFO] Processing SRX7223640-SRR10539844. (10/16)
2021-08-12 16:41:53 [INFO] Writing to disk...
2021-08-12 16:42:47 [INFO] Processing SRX7223639. (11/16)
2021-08-12 16:42:47 [INFO] Processing SRX7223639-SRR10539843. (11/16)
2021-08-12 16:43:35 [INFO] Processing SRX7223628. (12/16)
2021-08-12 16:43:35 [INFO] Processing SRX7223628-SRR10539832. (12/16)
2021-08-12 16:44:53 [INFO] Processing SRX7223632. (13/16)
2021-08-12 16:44:53 [INFO] Processing SRX7223632-SRR10539836. (13/16)
2021-08-12 16:46:10 [INFO] Processing SRX7223633. (14/16)
2021-08-12 16:46:10 [INFO] Processing SRX7223633-SRR10539837. (14/16)
2021-08-12 16:46:50 [INFO] Processing SRX7223638. (15/16)
2021-08-12 16:46:50 [INFO] Processing SRX7223638-SRR10539842. (15/16)
2021-08-12 16:48:06 [INFO] Processing SRX7223643. (16/16)
2021-08-12 16:48:06 [INFO] Processing SRX7223643-SRR10539847. (16/16)
2021-08-12 16:49:13 [INFO] Writing to disk...
2021-08-12 16:50:28 [INFO] Finished.
2021-08-20 17:46:33 [INFO] Starting.
2021-08-20 17:46:33 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/
2021-08-20 17:46:33 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/aggregate.hdf5
2021-08-20 17:46:33 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-20 17:46:34 [INFO] Building aggregate for 100kbp_raw network.
2021-08-20 17:46:34 [INFO] Writing every 10 Runs.
2021-08-20 17:46:34 [INFO] Processing SRX7223631. (1/16)
2021-08-20 17:46:34 [INFO] Processing SRX7223631-SRR10539835. (1/16)
2021-08-20 17:46:54 [INFO] Processing SRX7223637. (2/16)
2021-08-20 17:46:54 [INFO] Processing SRX7223637-SRR10539841. (2/16)
2021-08-20 17:47:21 [INFO] Processing SRX7223642. (3/16)
2021-08-20 17:47:21 [INFO] Processing SRX7223642-SRR10539846. (3/16)
2021-08-20 17:48:02 [INFO] Processing SRX7223635. (4/16)
2021-08-20 17:48:02 [INFO] Processing SRX7223635-SRR10539839. (4/16)
2021-08-20 17:48:30 [INFO] Processing SRX7223636. (5/16)
2021-08-20 17:48:30 [INFO] Processing SRX7223636-SRR10539840. (5/16)
2021-08-20 17:49:11 [INFO] Processing SRX7223630. (6/16)
2021-08-20 17:49:11 [INFO] Processing SRX7223630-SRR10539834. (6/16)
2021-08-20 17:49:38 [INFO] Processing SRX7223641. (7/16)
2021-08-20 17:49:38 [INFO] Processing SRX7223641-SRR10539845. (7/16)
2021-08-20 17:50:02 [INFO] Processing SRX7223634. (8/16)
2021-08-20 17:50:02 [INFO] Processing SRX7223634-SRR10539838. (8/16)
2021-08-20 17:50:43 [INFO] Processing SRX7223629. (9/16)
2021-08-20 17:50:43 [INFO] Processing SRX7223629-SRR10539833. (9/16)
2021-08-20 17:51:08 [INFO] Processing SRX7223640. (10/16)
2021-08-20 17:51:08 [INFO] Processing SRX7223640-SRR10539844. (10/16)
2021-08-20 17:51:49 [INFO] Writing to disk...
2021-08-20 17:52:02 [INFO] Processing SRX7223639. (11/16)
2021-08-20 17:52:02 [INFO] Processing SRX7223639-SRR10539843. (11/16)
2021-08-20 17:52:25 [INFO] Processing SRX7223628. (12/16)
2021-08-20 17:52:25 [INFO] Processing SRX7223628-SRR10539832. (12/16)
2021-08-20 17:53:04 [INFO] Processing SRX7223632. (13/16)
2021-08-20 17:53:04 [INFO] Processing SRX7223632-SRR10539836. (13/16)
2021-08-20 17:53:50 [INFO] Processing SRX7223633. (14/16)
2021-08-20 17:53:50 [INFO] Processing SRX7223633-SRR10539837. (14/16)
2021-08-20 17:54:07 [INFO] Processing SRX7223638. (15/16)
2021-08-20 17:54:07 [INFO] Processing SRX7223638-SRR10539842. (15/16)
2021-08-20 17:54:42 [INFO] Processing SRX7223643. (16/16)
2021-08-20 17:54:42 [INFO] Processing SRX7223643-SRR10539847. (16/16)
2021-08-20 17:55:10 [INFO] Writing to disk...
2021-08-20 17:55:31 [INFO] Finished.
2021-08-23 11:28:00 [INFO] Starting.
2021-08-23 11:28:00 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/
2021-08-23 11:28:00 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/aggregate.hdf5
2021-08-23 11:28:00 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 11:28:01 [INFO] Building aggregate for 250kbp_raw network.
2021-08-23 11:28:01 [INFO] Writing every 10 Runs.
2021-08-23 11:28:01 [INFO] Processing SRX7223631. (1/16)
2021-08-23 11:28:01 [INFO] Processing SRX7223631-SRR10539835. (1/16)
2021-08-23 11:28:13 [INFO] Processing SRX7223637. (2/16)
2021-08-23 11:28:13 [INFO] Processing SRX7223637-SRR10539841. (2/16)
2021-08-23 11:28:26 [INFO] Processing SRX7223642. (3/16)
2021-08-23 11:28:26 [INFO] Processing SRX7223642-SRR10539846. (3/16)
2021-08-23 11:28:46 [INFO] Processing SRX7223635. (4/16)
2021-08-23 11:28:46 [INFO] Processing SRX7223635-SRR10539839. (4/16)
2021-08-23 11:29:03 [INFO] Processing SRX7223636. (5/16)
2021-08-23 11:29:03 [INFO] Processing SRX7223636-SRR10539840. (5/16)
2021-08-23 11:29:23 [INFO] Processing SRX7223630. (6/16)
2021-08-23 11:29:23 [INFO] Processing SRX7223630-SRR10539834. (6/16)
2021-08-23 11:29:40 [INFO] Processing SRX7223641. (7/16)
2021-08-23 11:29:40 [INFO] Processing SRX7223641-SRR10539845. (7/16)
2021-08-23 11:29:54 [INFO] Processing SRX7223634. (8/16)
2021-08-23 11:29:54 [INFO] Processing SRX7223634-SRR10539838. (8/16)
2021-08-23 11:30:12 [INFO] Processing SRX7223629. (9/16)
2021-08-23 11:30:12 [INFO] Processing SRX7223629-SRR10539833. (9/16)
2021-08-23 11:30:26 [INFO] Processing SRX7223640. (10/16)
2021-08-23 11:30:26 [INFO] Processing SRX7223640-SRR10539844. (10/16)
2021-08-23 11:30:48 [INFO] Writing to disk...
2021-08-23 11:30:51 [INFO] Processing SRX7223639. (11/16)
2021-08-23 11:30:51 [INFO] Processing SRX7223639-SRR10539843. (11/16)
2021-08-23 11:31:05 [INFO] Processing SRX7223628. (12/16)
2021-08-23 11:31:05 [INFO] Processing SRX7223628-SRR10539832. (12/16)
2021-08-23 11:31:26 [INFO] Processing SRX7223632. (13/16)
2021-08-23 11:31:26 [INFO] Processing SRX7223632-SRR10539836. (13/16)
2021-08-23 11:31:46 [INFO] Processing SRX7223633. (14/16)
2021-08-23 11:31:46 [INFO] Processing SRX7223633-SRR10539837. (14/16)
2021-08-23 11:31:56 [INFO] Processing SRX7223638. (15/16)
2021-08-23 11:31:56 [INFO] Processing SRX7223638-SRR10539842. (15/16)
2021-08-23 11:32:14 [INFO] Processing SRX7223643. (16/16)
2021-08-23 11:32:14 [INFO] Processing SRX7223643-SRR10539847. (16/16)
2021-08-23 11:32:32 [INFO] Writing to disk...
2021-08-23 11:32:42 [INFO] Finished.
2021-08-23 13:15:16 [INFO] Starting.
2021-08-23 13:15:16 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/
2021-08-23 13:15:16 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_human/SRP233368/aggregate.hdf5
2021-08-23 13:15:16 [WARNING] chroms=/grid/gillis/data/nfox/genomes/homo_sapiens_38/hg38.chrom.sizes is ignored due to existing aggregate.
2021-08-23 13:15:17 [INFO] Building aggregate for 500kbp_raw network.
2021-08-23 13:15:17 [INFO] Writing every 10 Runs.
2021-08-23 13:15:17 [INFO] Processing SRX7223631. (1/16)
2021-08-23 13:15:17 [INFO] Processing SRX7223631-SRR10539835. (1/16)
2021-08-23 13:15:23 [INFO] Processing SRX7223637. (2/16)
2021-08-23 13:15:23 [INFO] Processing SRX7223637-SRR10539841. (2/16)
2021-08-23 13:15:29 [INFO] Processing SRX7223642. (3/16)
2021-08-23 13:15:29 [INFO] Processing SRX7223642-SRR10539846. (3/16)
2021-08-23 13:15:38 [INFO] Processing SRX7223635. (4/16)
2021-08-23 13:15:38 [INFO] Processing SRX7223635-SRR10539839. (4/16)
2021-08-23 13:15:43 [INFO] Processing SRX7223636. (5/16)
2021-08-23 13:15:43 [INFO] Processing SRX7223636-SRR10539840. (5/16)
2021-08-23 13:15:48 [INFO] Processing SRX7223630. (6/16)
2021-08-23 13:15:48 [INFO] Processing SRX7223630-SRR10539834. (6/16)
2021-08-23 13:15:57 [INFO] Processing SRX7223641. (7/16)
2021-08-23 13:15:57 [INFO] Processing SRX7223641-SRR10539845. (7/16)
2021-08-23 13:16:03 [INFO] Processing SRX7223634. (8/16)
2021-08-23 13:16:03 [INFO] Processing SRX7223634-SRR10539838. (8/16)
2021-08-23 13:16:10 [INFO] Processing SRX7223629. (9/16)
2021-08-23 13:16:10 [INFO] Processing SRX7223629-SRR10539833. (9/16)
2021-08-23 13:16:17 [INFO] Processing SRX7223640. (10/16)
2021-08-23 13:16:17 [INFO] Processing SRX7223640-SRR10539844. (10/16)
2021-08-23 13:16:24 [INFO] Writing to disk...
2021-08-23 13:16:25 [INFO] Processing SRX7223639. (11/16)
2021-08-23 13:16:25 [INFO] Processing SRX7223639-SRR10539843. (11/16)
2021-08-23 13:16:32 [INFO] Processing SRX7223628. (12/16)
2021-08-23 13:16:32 [INFO] Processing SRX7223628-SRR10539832. (12/16)
2021-08-23 13:16:40 [INFO] Processing SRX7223632. (13/16)
2021-08-23 13:16:40 [INFO] Processing SRX7223632-SRR10539836. (13/16)
2021-08-23 13:16:48 [INFO] Processing SRX7223633. (14/16)
2021-08-23 13:16:48 [INFO] Processing SRX7223633-SRR10539837. (14/16)
2021-08-23 13:16:53 [INFO] Processing SRX7223638. (15/16)
2021-08-23 13:16:53 [INFO] Processing SRX7223638-SRR10539842. (15/16)
2021-08-23 13:17:01 [INFO] Processing SRX7223643. (16/16)
2021-08-23 13:17:01 [INFO] Processing SRX7223643-SRR10539847. (16/16)
2021-08-23 13:17:09 [INFO] Writing to disk...
2021-08-23 13:17:21 [INFO] Finished.