Skip to content

modify rnn_train.py script, vad_gru and denoise_gru will use relu as …#125

Open
pyu1538 wants to merge 1 commit into
xiph:masterfrom
pyu1538:fix_training_activation_functions
Open

modify rnn_train.py script, vad_gru and denoise_gru will use relu as …#125
pyu1538 wants to merge 1 commit into
xiph:masterfrom
pyu1538:fix_training_activation_functions

Conversation

@pyu1538

@pyu1538 pyu1538 commented Jun 5, 2020

Copy link
Copy Markdown
Contributor

…activation, so it matches the paper

@tracek

tracek commented Jun 7, 2020

Copy link
Copy Markdown

Doing so will prevent the kernel from using cuDNN version of GRU, defaulting to the generic implementation. That in turn will severely slow down the training (assuming you're using GPU for the training).

@pyu1538

pyu1538 commented Jun 10, 2020

Copy link
Copy Markdown
Contributor Author

Doing so will prevent the kernel from using cuDNN version of GRU, defaulting to the generic implementation. That in turn will severely slow down the training (assuming you're using GPU for the training).

Got it.
I trained it without GPU, so I didn't feel slow down. RNNoise demo is also trained by "relu", it's better to use exact same model for comparison.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants