ALBERT: A Lite BERT for Self-supervised Learning of Language Representations本文前置知识: BERT: 详见ELMo, GPT, BERT. ALBERT: A Lite BERT for Self-supervised Learning of Language Representations本文是论文AL2021-06-29 深度学习NLP BERT UniLM: Unified Language Model Pre-training for Natural Language Understanding and Generation本文前置知识: BERT: 详见ELMo, GPT, BERT. UniLM: Unified Language Model Pre-training for Natural Language Understanding and G2021-06-18 深度学习NLP BERT MASS: Masked Sequence to Sequence Pre - training for Language Generation本文前置知识; BERT: 详见ELMo, GPT, BERT. Transformer: 详见Transformer精讲. MASS: Masked Sequence to Sequence Pre-training for La2021-06-08 深度学习NLP BERT SpanBERT: Improving Pre-training by Representing and Predicting Spans本文前置知识: BERT: 详见ELMo, GPT, BERT. SpanBERT: Improving Pre-training by Representing and Predicting Spans本文是论文SpanBERT:2021-05-13 深度学习NLP BERT StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding本文前置知识: BERT: 详见ELMo, GPT, BERT. StructBERT: Incorporating Language Structures into Pre-training for Deep Language U2021-05-04 深度学习NLP BART和mBART本文前置知识: Transformer: 详见Transformer精讲. BERT, GPT: 详见ELMo, GPT, BERT. BART和mBART本文是如下论文的阅读笔记和个人理解: BART: Denoising2021-04-26 深度学习NLP GAKE: Graph Aware Knowledge EmbeddingGAKE: Graph Aware Knowledge Embedding本文是论文GAKE: Graph Aware Knowledge Embedding的阅读笔记和个人理解. Basic Idea在现有的KGE方法中, 都是基于三元组2021-04-18 知识图谱KGE HAKE: Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction本文前置知识: RotatE: 详见RotatE: Relational Rotation in Complex Vector Space Learning Hierarchy-Aware Knowledge Graph Embed2021-04-11 知识图谱KGE ReInceptionE: Relation-Aware Inception Network with Joint Local-Global Structural Information for KGEReInceptionE: Relation-Aware Inception Network with Joint Local-Global Structural Information for KGE本文是论文ReInceptionE:2021-04-10 知识图谱KGE GNN CNN KBAT: Learning Attention-based Embeddings for Relation Prediction in KGs本文前置知识: GAT: 详见图神经网络入门. Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs本文是论文Learning2021-04-04 知识图谱KGE GNN CompGCN: Composition-based Multi-Relational Graph Convolutional Networks本文前置知识: GCN: 详见图神经网络入门 R - GCN: 详见R - GCN: Modeling Relational Data with Graph Convolutional Networks Composition-ba2021-04-03 知识图谱KGE GNN KEQA: Knowledge Graph Embedding Based Question AnsweringKnowledge Graph Embedding Based Question Answering本文是论文Knowledge Graph Embedding Based Question Answering的阅读笔记和个人理解. Bas2021-03-30 知识图谱KBQA