Upload folder using huggingface_hub
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- README.md +120 -0
- fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.args.json +42 -0
- fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.batch_loss.tsv +0 -0
- fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.bias_formatting.stdout.txt +1 -0
- fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.chrombpnet_data_params.tsv +3 -0
- fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.chrombpnet_formatting.stdout.txt +1 -0
- fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.chrombpnet_model_params.tsv +9 -0
- fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.chrombpnet_no_bias_formatting.stdout.txt +1 -0
- fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.epoch_loss.csv +11 -0
- fold_0/model.bias_scaled.fold_0.ENCSR457ILW.h5 +3 -0
- fold_0/model.bias_scaled.fold_0.ENCSR457ILW.tar +3 -0
- fold_0/model.chrombpnet.fold_0.ENCSR457ILW.h5 +3 -0
- fold_0/model.chrombpnet.fold_0.ENCSR457ILW.tar +3 -0
- fold_0/model.chrombpnet_nobias.fold_0.ENCSR457ILW.h5 +3 -0
- fold_0/model.chrombpnet_nobias.fold_0.ENCSR457ILW.tar +3 -0
- fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.args.json +50 -0
- fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.batch_loss.tsv +0 -0
- fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.bias_formatting.stdout.txt +1 -0
- fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.chrombpnet_data_params.tsv +3 -0
- fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.chrombpnet_formatting.stdout.txt +1 -0
- fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.chrombpnet_model_params.tsv +9 -0
- fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.chrombpnet_no_bias_formatting.stdout.txt +1 -0
- fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.epoch_loss.csv +14 -0
- fold_1/model.bias_scaled.fold_1.ENCSR457ILW.h5 +3 -0
- fold_1/model.bias_scaled.fold_1.ENCSR457ILW.tar +3 -0
- fold_1/model.chrombpnet.fold_1.ENCSR457ILW.h5 +3 -0
- fold_1/model.chrombpnet.fold_1.ENCSR457ILW.tar +3 -0
- fold_1/model.chrombpnet_nobias.fold_1.ENCSR457ILW.h5 +3 -0
- fold_1/model.chrombpnet_nobias.fold_1.ENCSR457ILW.tar +3 -0
- fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.args.json +50 -0
- fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.batch_loss.tsv +0 -0
- fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.bias_formatting.stdout.txt +1 -0
- fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.chrombpnet_data_params.tsv +3 -0
- fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.chrombpnet_formatting.stdout.txt +1 -0
- fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.chrombpnet_model_params.tsv +9 -0
- fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.chrombpnet_no_bias_formatting.stdout.txt +1 -0
- fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.epoch_loss.csv +12 -0
- fold_2/model.bias_scaled.fold_2.ENCSR457ILW.h5 +3 -0
- fold_2/model.bias_scaled.fold_2.ENCSR457ILW.tar +3 -0
- fold_2/model.chrombpnet.fold_2.ENCSR457ILW.h5 +3 -0
- fold_2/model.chrombpnet.fold_2.ENCSR457ILW.tar +3 -0
- fold_2/model.chrombpnet_nobias.fold_2.ENCSR457ILW.h5 +3 -0
- fold_2/model.chrombpnet_nobias.fold_2.ENCSR457ILW.tar +3 -0
- fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.args.json +50 -0
- fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.batch_loss.tsv +0 -0
- fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.bias_formatting.stdout.txt +1 -0
- fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.chrombpnet_data_params.tsv +3 -0
- fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.chrombpnet_formatting.stdout.txt +1 -0
- fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.chrombpnet_model_params.tsv +9 -0
- fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.chrombpnet_no_bias_formatting.stdout.txt +1 -0
README.md
ADDED
|
@@ -0,0 +1,120 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
library_name: chrombpnet
|
| 4 |
+
tags:
|
| 5 |
+
- encode
|
| 6 |
+
- chrombpnet
|
| 7 |
+
- chromatin-accessibility
|
| 8 |
+
- DNASE
|
| 9 |
+
- small-intestine
|
| 10 |
+
- hg38
|
| 11 |
+
---
|
| 12 |
+
# ENCODE ChromBPNet Atlas
|
| 13 |
+
As part of the ENCODE 4 Project, we trained ChromBPNet models on 1,512 ENCODE DNAse-seq and ATAC-seq across 408 biosamples. Here, we provide all models for open-source use.
|
| 14 |
+
|
| 15 |
+
For more information about the models, see:
|
| 16 |
+
- Main ENCODE 4 Paper
|
| 17 |
+
- [A unified lexicon of predictive DNA sequence motifs from ENCODE transcription factor binding and chromatin accessibility assays](https://doi.org/10.5281/zenodo.17123347) (Deshpande et al., Zenodo 2025)
|
| 18 |
+
- [ChromBPNet: bias factorized, base-resolution deep learning models of chromatin accessibility reveal cis-regulatory sequence syntax, transcription factor footprints and regulatory variants](https://doi.org/10.1101/2024.12.25.630221) (Pampari et al., bioRxiv 2024)
|
| 19 |
+
|
| 20 |
+
## ChromBPNet model: DNASE in small intestine (ENCSR457ILW)
|
| 21 |
+
- Model: ChromBPNet
|
| 22 |
+
- Assay: DNASE-seq
|
| 23 |
+
- Experiment: [ENCSR457ILW](https://www.encodeproject.org/experiments/ENCSR457ILW/)
|
| 24 |
+
- Model annotation: [ENCSR141OSZ](https://www.encodeproject.org/annotations/ENCSR141OSZ/)
|
| 25 |
+
- Biosample: small intestine (Full name: Homo sapiens small intestine tissue female embryo (91 days))
|
| 26 |
+
- Cell slim(s): None
|
| 27 |
+
- Organ slim(s): intestine,small-intestine
|
| 28 |
+
- Developmental slim(s): endoderm
|
| 29 |
+
- System slim(s): digestive-system
|
| 30 |
+
- Assembly: hg38
|
| 31 |
+
|
| 32 |
+
## Directory structure
|
| 33 |
+
- `fold_0`: Model of 5-fold cross-validation: Fold 0
|
| 34 |
+
- `model.chrombpnet.fold_0.encid.h5`: full chrombpnet model that combines both bias and corrected model in .h5 format
|
| 35 |
+
- `model.chrombpnet_nobias.fold_0.encid.h5`: bias-corrected accessibility model in .h5 format (Use for all biological discovery)
|
| 36 |
+
- `model.bias_scaled.fold_0.encid.h5`: bias model in .h5 format
|
| 37 |
+
- `model.chrombpnet.fold_0.encid.tar`: full chrombpnet model that combines both bias and corrected model in SavedModel format. After being untarred, it results in a directory named "chrombpnet".
|
| 38 |
+
- `model.chrombpnet_nobias.fold_0.encid.tar`: bias-corrected accessibility model in SavedModel format (Use for all biological discovery). After being untarred, it results in a directory named "chrombpnet_wo_bias".
|
| 39 |
+
- `model.bias_scaled.fold_0.encid.tar`: bias model in SavedModel format. After being untarred, it results in a directory named "bias_model_scaled".
|
| 40 |
+
- `logs.models.fold_0.encid`: folder containing log files for training models
|
| 41 |
+
- `fold_1`: Model of 5-fold coss-validation: Fold 1
|
| 42 |
+
- `fold_2`: Model of 5-fold cross-validation: Fold 2
|
| 43 |
+
- `fold_3`: Model of 5-fold cross-validation: Fold 3
|
| 44 |
+
- `fold_4`: Model of 5-fold cross-validation: Fold 4
|
| 45 |
+
|
| 46 |
+
# Instructions
|
| 47 |
+
## 1. Pseudocode for loading models in .h5 format
|
| 48 |
+
|
| 49 |
+
(1) Use the code in python after appropriately defining `model_in_h5_format` and `inputs`. \
|
| 50 |
+
(2) `inputs` is a one hot encoded sequence of shape (N,2114,4). Here N corresponds to the
|
| 51 |
+
number of tested sequences, 2114 is the input sequence length and 4 corresponds to [A,C,G,T].
|
| 52 |
+
|
| 53 |
+
```python
|
| 54 |
+
import tensorflow as tf
|
| 55 |
+
from tensorflow.keras.utils import get_custom_objects
|
| 56 |
+
from tensorflow.keras.models import load_model
|
| 57 |
+
|
| 58 |
+
custom_objects={"tf": tf}
|
| 59 |
+
get_custom_objects().update(custom_objects)
|
| 60 |
+
|
| 61 |
+
model=load_model(model_in_h5_format,compile=False)
|
| 62 |
+
outputs = model(inputs)
|
| 63 |
+
```
|
| 64 |
+
|
| 65 |
+
The list `outputs` consists of two elements. The first element has a shape of (N, 1000) and
|
| 66 |
+
contains logit predictions for a 1000-base-pair output. The second element, with a shape of
|
| 67 |
+
(N, 1), contains logcount predictions. To transform these predictions into per-base signals,
|
| 68 |
+
follow the provided pseudo code lines below.
|
| 69 |
+
|
| 70 |
+
```python
|
| 71 |
+
import numpy as np
|
| 72 |
+
|
| 73 |
+
def softmax(x, temp=1):
|
| 74 |
+
norm_x = x - np.mean(x,axis=1, keepdims=True)
|
| 75 |
+
return np.exp(temp*norm_x)/np.sum(np.exp(temp*norm_x), axis=1, keepdims=True)
|
| 76 |
+
|
| 77 |
+
predictions = softmax(outputs[0]) * (np.exp(outputs[1])-1)
|
| 78 |
+
```
|
| 79 |
+
|
| 80 |
+
## 2. Pseudocode for loading models in .tar format
|
| 81 |
+
|
| 82 |
+
(1) First untar the directory as follows `tar -xvf model.tar`. \
|
| 83 |
+
(2) Use the code below in python after appropriately defining `model_dir_untared` and `inputs`. \
|
| 84 |
+
(3) `inputs` is a one hot encoded sequence of shape (N,2114,4). Here N corresponds to the number
|
| 85 |
+
of tested sequences, 2114 is the input sequence length and 4 corresponds to ACGT.
|
| 86 |
+
|
| 87 |
+
Reference: https://www.tensorflow.org/api_docs/python/tf/saved_model/load
|
| 88 |
+
|
| 89 |
+
```python
|
| 90 |
+
import tensorflow as tf
|
| 91 |
+
|
| 92 |
+
model = tf.saved_model.load('model_dir_untared')
|
| 93 |
+
outputs = model.signatures['serving_default'](**{'sequence':inputs.astype('float32')})
|
| 94 |
+
```
|
| 95 |
+
|
| 96 |
+
The variable `outputs` represents a dictionary containing two key-value pairs. The first key
|
| 97 |
+
is `logits_profile_predictions`, holding a value with a shape of (N, 1000). This value corresponds
|
| 98 |
+
to logit predictions for a 1000-base-pair output. The second key, named `logcount_predictions``,
|
| 99 |
+
is associated with a value of shape (N, 1), representing logcount predictions. To transform these
|
| 100 |
+
predictions into per-base signals, utilize the provided pseudo code lines mentioned below.
|
| 101 |
+
|
| 102 |
+
```python
|
| 103 |
+
import numpy as np
|
| 104 |
+
def softmax(x, temp=1):
|
| 105 |
+
norm_x = x - np.mean(x,axis=1, keepdims=True)
|
| 106 |
+
return np.exp(temp*norm_x)/np.sum(np.exp(temp*norm_x), axis=1, keepdims=True)
|
| 107 |
+
|
| 108 |
+
predictions = softmax(outputs["logits_profile_predictions"]) * (np.exp(outputs["logcount_predictions"])-1)
|
| 109 |
+
```
|
| 110 |
+
|
| 111 |
+
## Docker image to load and use the models
|
| 112 |
+
- https://hub.docker.com/r/kundajelab/chrombpnet-atlas/ (tag:v1)
|
| 113 |
+
|
| 114 |
+
## Code for ChromBPNet
|
| 115 |
+
- https://github.com/kundajelab/chrombpnet/
|
| 116 |
+
|
| 117 |
+
# License & citation
|
| 118 |
+
External data users may freely download, analyze and publish results based on any ENCODE data without restrictions.
|
| 119 |
+
|
| 120 |
+
Released under the [ENCODE data-use policy](https://www.encodeproject.org/about/data-use-policy/). Please cite the ENCODE Project Consortium and the model software: [ChromBPNet](https://github.com/kundajelab/chrombpnet) (Pampari et al., bioRxiv 2024).
|
fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.args.json
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"cmd": "pipeline",
|
| 3 |
+
"genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
|
| 4 |
+
"chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
|
| 5 |
+
"bigwig": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/DNASE/ENCSR457ILW/preprocessing/bigWigs/ENCSR457ILW.bigWig",
|
| 6 |
+
"output_dir": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR457ILW/fold0/",
|
| 7 |
+
"data_type": "DNASE",
|
| 8 |
+
"peaks": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR457ILW/fold0/auxiliary/filtered.peaks.bed",
|
| 9 |
+
"nonpeaks": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR457ILW/fold0/auxiliary/filtered.nonpeaks.bed",
|
| 10 |
+
"chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_0.json",
|
| 11 |
+
"outlier_threshold": 0.9999,
|
| 12 |
+
"ATAC_ref_path": null,
|
| 13 |
+
"DNASE_ref_path": null,
|
| 14 |
+
"num_samples": 10000,
|
| 15 |
+
"inputlen": 2114,
|
| 16 |
+
"outputlen": 1000,
|
| 17 |
+
"seed": 1234,
|
| 18 |
+
"epochs": 50,
|
| 19 |
+
"early_stop": 5,
|
| 20 |
+
"learning_rate": 0.001,
|
| 21 |
+
"trackables": [
|
| 22 |
+
"logcount_predictions_loss",
|
| 23 |
+
"loss",
|
| 24 |
+
"logits_profile_predictions_loss",
|
| 25 |
+
"val_logcount_predictions_loss",
|
| 26 |
+
"val_loss",
|
| 27 |
+
"val_logits_profile_predictions_loss"
|
| 28 |
+
],
|
| 29 |
+
"architecture_from_file": "/home/groups/akundaje/ziwei75/anaconda3/envs/chrombpnet/lib/python3.8/site-packages/chrombpnet/training/models/chrombpnet_with_bias_model.py",
|
| 30 |
+
"file_prefix": null,
|
| 31 |
+
"html_prefix": "./",
|
| 32 |
+
"bias_model_path": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_bias_model/bias_threshold_0.8/ENCSR457ILW/models/bias.h5",
|
| 33 |
+
"negative_sampling_ratio": 0.1,
|
| 34 |
+
"filters": 512,
|
| 35 |
+
"n_dilation_layers": 8,
|
| 36 |
+
"max_jitter": 500,
|
| 37 |
+
"batch_size": 64,
|
| 38 |
+
"output_prefix": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR457ILW/fold0/models/chrombpnet",
|
| 39 |
+
"chr": "chr8",
|
| 40 |
+
"pwm_width": 24,
|
| 41 |
+
"params": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR457ILW/fold0/logs/chrombpnet_model_params.tsv"
|
| 42 |
+
}
|
fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.batch_loss.tsv
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.bias_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR457ILW/fold0/models/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_0/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py
|
fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.chrombpnet_data_params.tsv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
counts_sum_min_thresh 0.0
|
| 2 |
+
counts_sum_max_thresh 965.95
|
| 3 |
+
trainings_pts_post_thresh 169755
|
fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.chrombpnet_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR457ILW/fold0/models/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_0/new_model_format/chrombpnet.tar with get_new_tf_model_format.py
|
fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.chrombpnet_model_params.tsv
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
counts_loss_weight 3.8
|
| 2 |
+
filters 512
|
| 3 |
+
n_dil_layers 8
|
| 4 |
+
bias_model_path /oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR457ILW/fold0/models/bias_model_scaled.h5
|
| 5 |
+
inputlen 2114
|
| 6 |
+
outputlen 1000
|
| 7 |
+
max_jitter 500
|
| 8 |
+
chr_fold_path /oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_0.json
|
| 9 |
+
negative_sampling_ratio 0.1
|
fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.chrombpnet_no_bias_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR457ILW/fold0/models/chrombpnet_nobias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_0/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py
|
fold_0/logs.models.fold_0.ENCSR457ILW/logfile.modelling.fold_0.ENCSR457ILW.epoch_loss.csv
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
|
| 2 |
+
0,2.0396456718444824,206.2191162109375,213.9697265625,0.7904415726661682,208.82862854003906,211.8323516845703
|
| 3 |
+
1,0.7899583578109741,200.19699096679688,203.1988525390625,0.8133494853973389,205.62454223632812,208.71533203125
|
| 4 |
+
2,0.7175617814064026,198.61827087402344,201.34503173828125,0.6639836430549622,204.62088012695312,207.14407348632812
|
| 5 |
+
3,0.6638920307159424,197.44886779785156,199.97129821777344,0.6209403276443481,204.28504943847656,206.64466857910156
|
| 6 |
+
4,0.6278467178344727,196.64993286132812,199.0358123779297,0.608626663684845,202.59634399414062,204.9092254638672
|
| 7 |
+
5,0.6002027988433838,195.25453186035156,197.5354461669922,0.5746828317642212,204.5530242919922,206.73695373535156
|
| 8 |
+
6,0.5770463347434998,194.5323944091797,196.7250213623047,0.5887589454650879,204.56121826171875,206.79843139648438
|
| 9 |
+
7,0.5611333847045898,193.8445281982422,195.97715759277344,0.6153395175933838,204.4545135498047,206.7928009033203
|
| 10 |
+
8,0.5440455079078674,192.9458465576172,195.01309204101562,0.5809420347213745,204.3937225341797,206.6013946533203
|
| 11 |
+
9,0.5267396569252014,192.03732299804688,194.0389404296875,0.5673112869262695,205.35592651367188,207.5117645263672
|
fold_0/model.bias_scaled.fold_0.ENCSR457ILW.h5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:66e83ff61366afe51c2d3bbf94232e6e30c355361b6b96e83ba3d8eb697b0c79
|
| 3 |
+
size 2691928
|
fold_0/model.bias_scaled.fold_0.ENCSR457ILW.tar
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4bb275628d54172e17d575fec33dc10c2dffcca9d443937a9ae9e6606201e40b
|
| 3 |
+
size 1198080
|
fold_0/model.chrombpnet.fold_0.ENCSR457ILW.h5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:993bb0028f2ecebf73bca180108902b3c1f09ed402eaa7be01bf54147d911422
|
| 3 |
+
size 77538952
|
fold_0/model.chrombpnet.fold_0.ENCSR457ILW.tar
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:37e715fbd5af4332b72ad869096cb6b452d7be5d8fd84c428d1aa71e4d06acf7
|
| 3 |
+
size 27525120
|
fold_0/model.chrombpnet_nobias.fold_0.ENCSR457ILW.h5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f2c9dd78d9afd54857715c3fdef88fcda99e84bb773c199e401daa4cabd7d8d3
|
| 3 |
+
size 25582648
|
fold_0/model.chrombpnet_nobias.fold_0.ENCSR457ILW.tar
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3eaff6f41f4e0f1875fbc4c1dffaea7e7e2a0d43e20aca1a4e6f46e85748a568
|
| 3 |
+
size 26060800
|
fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.args.json
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"cmd": "pipeline",
|
| 3 |
+
"genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
|
| 4 |
+
"chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
|
| 5 |
+
"input_bam_file": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/DNASE/ENCSR457ILW/preprocessing/bigWigs/ENCSR457ILW.bigWig",
|
| 6 |
+
"input_fragment_file": null,
|
| 7 |
+
"input_tagalign_file": null,
|
| 8 |
+
"output_dir": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_1",
|
| 9 |
+
"data_type": "DNASE",
|
| 10 |
+
"peaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_1/auxiliary/filtered.peaks.bed",
|
| 11 |
+
"nonpeaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_1/auxiliary/filtered.nonpeaks.bed",
|
| 12 |
+
"chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_1.json",
|
| 13 |
+
"outlier_threshold": 0.9999,
|
| 14 |
+
"ATAC_ref_path": null,
|
| 15 |
+
"DNASE_ref_path": null,
|
| 16 |
+
"num_samples": 10000,
|
| 17 |
+
"inputlen": 2114,
|
| 18 |
+
"outputlen": 1000,
|
| 19 |
+
"seed": 1234,
|
| 20 |
+
"epochs": 50,
|
| 21 |
+
"early_stop": 5,
|
| 22 |
+
"learning_rate": 0.001,
|
| 23 |
+
"trackables": [
|
| 24 |
+
"logcount_predictions_loss",
|
| 25 |
+
"loss",
|
| 26 |
+
"logits_profile_predictions_loss",
|
| 27 |
+
"val_logcount_predictions_loss",
|
| 28 |
+
"val_loss",
|
| 29 |
+
"val_logits_profile_predictions_loss"
|
| 30 |
+
],
|
| 31 |
+
"architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
|
| 32 |
+
"file_prefix": null,
|
| 33 |
+
"html_prefix": "./",
|
| 34 |
+
"bsort": false,
|
| 35 |
+
"tmpdir": null,
|
| 36 |
+
"no_st": false,
|
| 37 |
+
"bias_model_path": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_bias_model/bias_threshold_0.8/ENCSR457ILW/models/bias.h5",
|
| 38 |
+
"negative_sampling_ratio": 0.1,
|
| 39 |
+
"filters": 512,
|
| 40 |
+
"n_dilation_layers": 8,
|
| 41 |
+
"max_jitter": 500,
|
| 42 |
+
"batch_size": 64,
|
| 43 |
+
"output_prefix": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_1/models/chrombpnet",
|
| 44 |
+
"bigwig": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_1/auxiliary/data_unstranded.bw",
|
| 45 |
+
"plus_shift": null,
|
| 46 |
+
"minus_shift": null,
|
| 47 |
+
"chr": "chr12",
|
| 48 |
+
"pwm_width": 24,
|
| 49 |
+
"params": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_1/logs/chrombpnet_model_params.tsv"
|
| 50 |
+
}
|
fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.batch_loss.tsv
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.bias_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_1/models/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_1/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py
|
fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.chrombpnet_data_params.tsv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
counts_sum_min_thresh 0.0
|
| 2 |
+
counts_sum_max_thresh 971.0
|
| 3 |
+
trainings_pts_post_thresh 173841
|
fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.chrombpnet_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_1/models/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_1/new_model_format/chrombpnet.tar with get_new_tf_model_format.py
|
fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.chrombpnet_model_params.tsv
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
counts_loss_weight 3.9
|
| 2 |
+
filters 512
|
| 3 |
+
n_dil_layers 8
|
| 4 |
+
bias_model_path /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_1/models/bias_model_scaled.h5
|
| 5 |
+
inputlen 2114
|
| 6 |
+
outputlen 1000
|
| 7 |
+
max_jitter 500
|
| 8 |
+
chr_fold_path /oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_1.json
|
| 9 |
+
negative_sampling_ratio 0.1
|
fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.chrombpnet_no_bias_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_1/models/chrombpnet_nobias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_1/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py
|
fold_1/logs.models.fold_1.ENCSR457ILW/logfile.modelling.fold_1.ENCSR457ILW.epoch_loss.csv
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
|
| 2 |
+
0,4.5622782707214355,206.3902587890625,224.18304443359375,0.8805033564567566,232.58685302734375,236.02081298828125
|
| 3 |
+
1,0.8101252913475037,200.3817596435547,203.54122924804688,0.7934682965278625,229.3227081298828,232.4174346923828
|
| 4 |
+
2,0.7403674721717834,198.2509002685547,201.13829040527344,0.7157703638076782,227.7458953857422,230.53721618652344
|
| 5 |
+
3,0.6939588189125061,197.30572509765625,200.01219177246094,0.7027337551116943,227.96083068847656,230.7014923095703
|
| 6 |
+
4,0.6545529365539551,196.11561584472656,198.66864013671875,0.724991500377655,225.99966430664062,228.82704162597656
|
| 7 |
+
5,0.621681272983551,195.41064453125,197.8349151611328,0.7269238233566284,225.73228454589844,228.5673370361328
|
| 8 |
+
6,0.596393346786499,194.4217071533203,196.7476043701172,0.5944740772247314,227.11810302734375,229.4366455078125
|
| 9 |
+
7,0.5784561038017273,193.62156677246094,195.87701416015625,0.6079334616661072,225.85476684570312,228.22567749023438
|
| 10 |
+
8,0.5540717244148254,192.75619506835938,194.9171600341797,0.6267793774604797,226.25563049316406,228.7002410888672
|
| 11 |
+
9,0.5398144125938416,192.02442932128906,194.12960815429688,0.6420609354972839,227.26385498046875,229.768310546875
|
| 12 |
+
10,0.5234595537185669,191.1979217529297,193.23934936523438,0.5703637599945068,226.7427978515625,228.96731567382812
|
| 13 |
+
11,0.5171127319335938,190.09796142578125,192.1148223876953,0.5991123914718628,228.06227111816406,230.39891052246094
|
| 14 |
+
12,0.5047810077667236,189.40350341796875,191.3720703125,0.603268563747406,229.38265991210938,231.73550415039062
|
fold_1/model.bias_scaled.fold_1.ENCSR457ILW.h5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5aaec29b5ef874e73886f751be784440207f12b17d71bd321137779f10e8bc00
|
| 3 |
+
size 2691928
|
fold_1/model.bias_scaled.fold_1.ENCSR457ILW.tar
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7c39358aa68d7c181cd49495c2932beaf2daa0142554ce1fa641c94d8a77460a
|
| 3 |
+
size 1198080
|
fold_1/model.chrombpnet.fold_1.ENCSR457ILW.h5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1204f5bce8d23bd9ab17771c6a365a00e4276a5c278d8fed9222875555be2799
|
| 3 |
+
size 77538840
|
fold_1/model.chrombpnet.fold_1.ENCSR457ILW.tar
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:63b10411cdd19c854c15170f0c804a3b7a8cb5b465cb624417c71ad00e4751f4
|
| 3 |
+
size 27525120
|
fold_1/model.chrombpnet_nobias.fold_1.ENCSR457ILW.h5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b0e71dea8a6e606fb67f8c8052798551dd0a5c28803f35453e58886e00dd6d2e
|
| 3 |
+
size 25582648
|
fold_1/model.chrombpnet_nobias.fold_1.ENCSR457ILW.tar
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f1fa3c306606c4b623faa0090821dbc875cba0c877ea50f2c4099022fced47fa
|
| 3 |
+
size 26060800
|
fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.args.json
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"cmd": "pipeline",
|
| 3 |
+
"genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
|
| 4 |
+
"chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
|
| 5 |
+
"input_bam_file": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/DNASE/ENCSR457ILW/preprocessing/bigWigs/ENCSR457ILW.bigWig",
|
| 6 |
+
"input_fragment_file": null,
|
| 7 |
+
"input_tagalign_file": null,
|
| 8 |
+
"output_dir": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_2",
|
| 9 |
+
"data_type": "DNASE",
|
| 10 |
+
"peaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_2/auxiliary/filtered.peaks.bed",
|
| 11 |
+
"nonpeaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_2/auxiliary/filtered.nonpeaks.bed",
|
| 12 |
+
"chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_2.json",
|
| 13 |
+
"outlier_threshold": 0.9999,
|
| 14 |
+
"ATAC_ref_path": null,
|
| 15 |
+
"DNASE_ref_path": null,
|
| 16 |
+
"num_samples": 10000,
|
| 17 |
+
"inputlen": 2114,
|
| 18 |
+
"outputlen": 1000,
|
| 19 |
+
"seed": 1234,
|
| 20 |
+
"epochs": 50,
|
| 21 |
+
"early_stop": 5,
|
| 22 |
+
"learning_rate": 0.001,
|
| 23 |
+
"trackables": [
|
| 24 |
+
"logcount_predictions_loss",
|
| 25 |
+
"loss",
|
| 26 |
+
"logits_profile_predictions_loss",
|
| 27 |
+
"val_logcount_predictions_loss",
|
| 28 |
+
"val_loss",
|
| 29 |
+
"val_logits_profile_predictions_loss"
|
| 30 |
+
],
|
| 31 |
+
"architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
|
| 32 |
+
"file_prefix": null,
|
| 33 |
+
"html_prefix": "./",
|
| 34 |
+
"bsort": false,
|
| 35 |
+
"tmpdir": null,
|
| 36 |
+
"no_st": false,
|
| 37 |
+
"bias_model_path": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_bias_model/bias_threshold_0.8/ENCSR457ILW/models/bias.h5",
|
| 38 |
+
"negative_sampling_ratio": 0.1,
|
| 39 |
+
"filters": 512,
|
| 40 |
+
"n_dilation_layers": 8,
|
| 41 |
+
"max_jitter": 500,
|
| 42 |
+
"batch_size": 64,
|
| 43 |
+
"output_prefix": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_2/models/chrombpnet",
|
| 44 |
+
"bigwig": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_2/auxiliary/data_unstranded.bw",
|
| 45 |
+
"plus_shift": null,
|
| 46 |
+
"minus_shift": null,
|
| 47 |
+
"chr": "chr22",
|
| 48 |
+
"pwm_width": 24,
|
| 49 |
+
"params": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_2/logs/chrombpnet_model_params.tsv"
|
| 50 |
+
}
|
fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.batch_loss.tsv
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.bias_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_2/models/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_2/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py
|
fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.chrombpnet_data_params.tsv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
counts_sum_min_thresh 0.0
|
| 2 |
+
counts_sum_max_thresh 971.29
|
| 3 |
+
trainings_pts_post_thresh 176744
|
fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.chrombpnet_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_2/models/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_2/new_model_format/chrombpnet.tar with get_new_tf_model_format.py
|
fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.chrombpnet_model_params.tsv
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
counts_loss_weight 3.9
|
| 2 |
+
filters 512
|
| 3 |
+
n_dil_layers 8
|
| 4 |
+
bias_model_path /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_2/models/bias_model_scaled.h5
|
| 5 |
+
inputlen 2114
|
| 6 |
+
outputlen 1000
|
| 7 |
+
max_jitter 500
|
| 8 |
+
chr_fold_path /oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_2.json
|
| 9 |
+
negative_sampling_ratio 0.1
|
fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.chrombpnet_no_bias_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_2/models/chrombpnet_nobias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_2/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py
|
fold_2/logs.models.fold_2.ENCSR457ILW/logfile.modelling.fold_2.ENCSR457ILW.epoch_loss.csv
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
|
| 2 |
+
0,3.9998111724853516,207.462646484375,223.0618438720703,0.8280704021453857,214.63441467285156,217.86383056640625
|
| 3 |
+
1,0.8002015948295593,201.4031524658203,204.52410888671875,0.740251362323761,212.6656494140625,215.55267333984375
|
| 4 |
+
2,0.7243360877037048,199.58441162109375,202.40948486328125,0.7174428105354309,211.1627960205078,213.96090698242188
|
| 5 |
+
3,0.6731985211372375,198.17213439941406,200.7976837158203,0.7227088212966919,210.9661102294922,213.7847137451172
|
| 6 |
+
4,0.6577355265617371,197.45184326171875,200.01705932617188,0.7068642973899841,210.41140747070312,213.16831970214844
|
| 7 |
+
5,0.6138964295387268,196.47146606445312,198.86587524414062,0.6138699054718018,209.65914916992188,212.05331420898438
|
| 8 |
+
6,0.5902565121650696,195.78192138671875,198.084228515625,0.6372717022895813,210.6596221923828,213.14503479003906
|
| 9 |
+
7,0.5700458288192749,194.841552734375,197.06459045410156,0.6239614486694336,210.31007385253906,212.74327087402344
|
| 10 |
+
8,0.5496845245361328,194.2911376953125,196.43487548828125,0.6125854253768921,210.76039123535156,213.14950561523438
|
| 11 |
+
9,0.5407032370567322,193.3179168701172,195.42648315429688,0.6282303929328918,210.49874877929688,212.9486846923828
|
| 12 |
+
10,0.5237365961074829,192.58163452148438,194.6240234375,0.5815297365188599,211.8433837890625,214.11114501953125
|
fold_2/model.bias_scaled.fold_2.ENCSR457ILW.h5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5a63d1309b2243ca32096f7f274cc359a50e9c3ad563a96b2fe6804e11cb8759
|
| 3 |
+
size 2691928
|
fold_2/model.bias_scaled.fold_2.ENCSR457ILW.tar
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ef4c40f84abb7b379e50b637c3cd5e7f9073f8d357ba9c04ec56b3ed7913da78
|
| 3 |
+
size 1198080
|
fold_2/model.chrombpnet.fold_2.ENCSR457ILW.h5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b75ba884393ac00d6ea5e9b9bf99b77d8c1991e7cfafe1bcf68d3e7708d1d3cb
|
| 3 |
+
size 77538840
|
fold_2/model.chrombpnet.fold_2.ENCSR457ILW.tar
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b534e90c29e1e68ffd3d3883ac400b37d4ea468877f67ac4fb9e4b8d9a0724f8
|
| 3 |
+
size 27525120
|
fold_2/model.chrombpnet_nobias.fold_2.ENCSR457ILW.h5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:516a646aee4cdddf5e93895e79e9ac834a1938d98afad636c078a521a1df88f3
|
| 3 |
+
size 25582648
|
fold_2/model.chrombpnet_nobias.fold_2.ENCSR457ILW.tar
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:21eaaf18aa3395b83556dee94853ea6fc4757c503ac8b31babf16c47ea92fa34
|
| 3 |
+
size 26060800
|
fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.args.json
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"cmd": "pipeline",
|
| 3 |
+
"genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
|
| 4 |
+
"chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
|
| 5 |
+
"input_bam_file": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/DNASE/ENCSR457ILW/preprocessing/bigWigs/ENCSR457ILW.bigWig",
|
| 6 |
+
"input_fragment_file": null,
|
| 7 |
+
"input_tagalign_file": null,
|
| 8 |
+
"output_dir": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_3",
|
| 9 |
+
"data_type": "DNASE",
|
| 10 |
+
"peaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_3/auxiliary/filtered.peaks.bed",
|
| 11 |
+
"nonpeaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_3/auxiliary/filtered.nonpeaks.bed",
|
| 12 |
+
"chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_3.json",
|
| 13 |
+
"outlier_threshold": 0.9999,
|
| 14 |
+
"ATAC_ref_path": null,
|
| 15 |
+
"DNASE_ref_path": null,
|
| 16 |
+
"num_samples": 10000,
|
| 17 |
+
"inputlen": 2114,
|
| 18 |
+
"outputlen": 1000,
|
| 19 |
+
"seed": 1234,
|
| 20 |
+
"epochs": 50,
|
| 21 |
+
"early_stop": 5,
|
| 22 |
+
"learning_rate": 0.001,
|
| 23 |
+
"trackables": [
|
| 24 |
+
"logcount_predictions_loss",
|
| 25 |
+
"loss",
|
| 26 |
+
"logits_profile_predictions_loss",
|
| 27 |
+
"val_logcount_predictions_loss",
|
| 28 |
+
"val_loss",
|
| 29 |
+
"val_logits_profile_predictions_loss"
|
| 30 |
+
],
|
| 31 |
+
"architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
|
| 32 |
+
"file_prefix": null,
|
| 33 |
+
"html_prefix": "./",
|
| 34 |
+
"bsort": false,
|
| 35 |
+
"tmpdir": null,
|
| 36 |
+
"no_st": false,
|
| 37 |
+
"bias_model_path": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_bias_model/bias_threshold_0.8/ENCSR457ILW/models/bias.h5",
|
| 38 |
+
"negative_sampling_ratio": 0.1,
|
| 39 |
+
"filters": 512,
|
| 40 |
+
"n_dilation_layers": 8,
|
| 41 |
+
"max_jitter": 500,
|
| 42 |
+
"batch_size": 64,
|
| 43 |
+
"output_prefix": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_3/models/chrombpnet",
|
| 44 |
+
"bigwig": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_3/auxiliary/data_unstranded.bw",
|
| 45 |
+
"plus_shift": null,
|
| 46 |
+
"minus_shift": null,
|
| 47 |
+
"chr": "chr6",
|
| 48 |
+
"pwm_width": 24,
|
| 49 |
+
"params": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_3/logs/chrombpnet_model_params.tsv"
|
| 50 |
+
}
|
fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.batch_loss.tsv
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.bias_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_3/models/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_3/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py
|
fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.chrombpnet_data_params.tsv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
counts_sum_min_thresh 0.0
|
| 2 |
+
counts_sum_max_thresh 973.03
|
| 3 |
+
trainings_pts_post_thresh 172520
|
fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.chrombpnet_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_3/models/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_3/new_model_format/chrombpnet.tar with get_new_tf_model_format.py
|
fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.chrombpnet_model_params.tsv
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
counts_loss_weight 3.9
|
| 2 |
+
filters 512
|
| 3 |
+
n_dil_layers 8
|
| 4 |
+
bias_model_path /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_3/models/bias_model_scaled.h5
|
| 5 |
+
inputlen 2114
|
| 6 |
+
outputlen 1000
|
| 7 |
+
max_jitter 500
|
| 8 |
+
chr_fold_path /oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_3.json
|
| 9 |
+
negative_sampling_ratio 0.1
|
fold_3/logs.models.fold_3.ENCSR457ILW/logfile.modelling.fold_3.ENCSR457ILW.chrombpnet_no_bias_formatting.stdout.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR457ILW/fold_3/models/chrombpnet_nobias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR457ILW/fold_3/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py
|