Skip to content

Commit 3aa2493

Browse files
committed
added word for clarity
1 parent 9cb4062 commit 3aa2493

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/methods.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,7 @@ _Papers:_
6161

6262
```{eval-rst}
6363
.. note::
64-
The two parameters ``original_ln_before`` and ``original_ln_after`` inside bottleneck adapters control both the addition of the residual input and the application of the pretrained layer norm. If the original model does not apply a layer norm function at a specific position of the forward function (e.g after the FFN layer), the bottleneck parameters of the adapter set at that same position will only control the application of the residual input.
64+
The two parameters ``original_ln_before`` and ``original_ln_after`` inside bottleneck adapters control both the addition of the residual input and the application of the pretrained layer norm. If the original model does not apply a layer norm function at a specific position of the forward function (e.g after the FFN layer), the two bottleneck parameters of the adapter set at that same position will only control the application of the residual input.
6565
```
6666

6767
## Language Adapters - Invertible Adapters

0 commit comments

Comments
 (0)