Lin Blog

Thinking will not overcome fear but action will.

transformer-Xl阅读笔记

transformer-Xl

Model In order to apply Transformer or self-attention tovlanguage modeling, the central problem is how to train a Transformer to effectively encode an arbitrarily long context into a fixed size re...

Posted by BY 黄梓林 on February 21, 2020

attention is all you need阅读笔记

attention is all you need

transformer结构 transformer 由 encoder 以及 decoder 组成 encoder encoder 由6层完全相同的结构组成，每层包括两部分：a multi-head self-attention mechanism + positionwise fully connected feed-forward network 因为每层的输出都要进行残差...

Posted by BY 黄梓林 on February 21, 2020

xlnet代码学习

xlnet

xlnet建模函数 查找对应词的嵌入向量 def embedding_lookup(x, n_token, d_embed, initializer, use_tpu=True, scope='embedding', reuse=None, dtype=tf.float32): """TPU and GPU embedding_lookup ...

Posted by BY 黄梓林 on February 20, 2020

tensorflow常用函数

tf学习

TensorFlow 代码中遇到的tf函数 tf.variable_scope tf.get_variable 共享变量 tf.Session() Session提供了Operation执行和Tensor求值的环境 tf.nn.embedding_lookup 主要是选取一个张量里面索引对应的元素 tf.einsum 进行矩阵运算 tf.gfile.ListDirector...

Posted by BY 黄梓林 on February 20, 2020

My First Post

Hello World, Hello Blog

Hey 这是我的第一篇博客。 希望以后我的博客能够充实起来。

Posted by BY 黄梓林 on February 3, 2020

FEATURED TAGS
python 机器阅读理解 机器学习
ABOUT ME

Goals determine what you going to be!

✉️ 756983026@qq.com

FRIENDS