DaNing
Pytorch实现: VAE Pytorch实现: VAE
本文前置知识: VAE基本原理: 详见变分自编码器入门. Pytorch实现: VAE本文是VAE的Pytorch版本实现, 并在末尾做了VAE的生成可视化. 本文的代码已经放到了Colab上, 打开设置GPU就可以复现(需要科学上
2021-07-10
Introduction: Variational Auto - Encoder Introduction: Variational Auto - Encoder
Introduction: Variational Auto - Encoder变分自动编码器(VAE, Variational Auto - Encoder)是一种基于自编码器结构的深度生成模型. 本文对VAE更深层次的数学原理没有探讨,
2021-07-09
知识蒸馏: Distilling the Knowledge in a Neural Network 知识蒸馏: Distilling the Knowledge in a Neural Network
Distilling the Knowledge in a Neural Network本文是论文Distilling the Knowledge in a Neural Network的阅读笔记和个人理解. Basic Idea现有机器学
2021-07-03
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
本文前置知识: BERT: 详见ELMo, GPT, BERT. ALBERT: A Lite BERT for Self-supervised Learning of Language Representations本文是论文AL
2021-06-29
UniLM: Unified Language Model Pre-training for Natural Language Understanding and Generation UniLM: Unified Language Model Pre-training for Natural Language Understanding and Generation
本文前置知识: BERT: 详见ELMo, GPT, BERT. UniLM: Unified Language Model Pre-training for Natural Language Understanding and G
2021-06-18
MASS: Masked Sequence to Sequence Pre - training for Language Generation MASS: Masked Sequence to Sequence Pre - training for Language Generation
本文前置知识; BERT: 详见ELMo, GPT, BERT. Transformer: 详见Transformer精讲. MASS: Masked Sequence to Sequence Pre-training for La
2021-06-08
SpanBERT: Improving Pre-training by Representing and Predicting Spans SpanBERT: Improving Pre-training by Representing and Predicting Spans
本文前置知识: BERT: 详见ELMo, GPT, BERT. SpanBERT: Improving Pre-training by Representing and Predicting Spans本文是论文SpanBERT:
2021-05-13
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding
本文前置知识: BERT: 详见ELMo, GPT, BERT. StructBERT: Incorporating Language Structures into Pre-training for Deep Language U
2021-05-04
BART和mBART BART和mBART
本文前置知识: Transformer: 详见Transformer精讲. BERT, GPT: 详见ELMo, GPT, BERT. BART和mBART本文是如下论文的阅读笔记和个人理解: BART: Denoising
2021-04-26
GAKE: Graph Aware Knowledge Embedding GAKE: Graph Aware Knowledge Embedding
GAKE: Graph Aware Knowledge Embedding本文是论文GAKE: Graph Aware Knowledge Embedding的阅读笔记和个人理解. Basic Idea在现有的KGE方法中, 都是基于三元组
2021-04-18
HAKE: Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction HAKE: Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction
本文前置知识: RotatE: 详见RotatE: Relational Rotation in Complex Vector Space Learning Hierarchy-Aware Knowledge Graph Embed
2021-04-11
ReInceptionE: Relation-Aware Inception Network with Joint Local-Global Structural Information for KGE ReInceptionE: Relation-Aware Inception Network with Joint Local-Global Structural Information for KGE
ReInceptionE: Relation-Aware Inception Network with Joint Local-Global Structural Information for KGE本文是论文ReInceptionE:
2021-04-10
4 / 11