BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
arXiv:1810.04805 · 30 repos reference this paper in their README
We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers. As a result, the pre-trained BERT model can be fine-tuned with just one additional output layer to create state-of-the-art models for a wide range of tasks, such as question answering and language inference, without substantial task-specific architecture modifications. BERT is conceptually simple and empirically powerful. It obtains new state-of-the-art results on eleven natural language processing tasks, including pushing the GLUE score to 80.5% (7.7% point absolute improvement), MultiNLI accuracy to 86.7% (4.6% absolute improvement), SQuAD v1.1 question answering Test F1 to 93.2 (1.5 point absolute improvement) and SQuAD v2.0 Test F1 to 83.1 (5.1 point absolute improvement).
UVA-DSA/EMS-Pipeline
34
·
·
Intelligent Cognitive Assistant for Emergency Medical Services (CognitiveEMS)
legacyai/tf-transformers
85
·
·
State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).
Bowen-n/MCBG
22
·
·
Source code of Malware Classification by Learning Semantic and Structural Features of Control Flow…
In-Medias-Res-Wagnerhof-net/Vorbereitung
1
·
·
Source Code für das das Projekt einer semantischen Suche für das Gesamtwerk von Kant.
Turkish-Word-Embeddings/Word-Embeddings-Repository-for-Turkish
29
·
·
Code for "A Comprehensive Analysis of Static Word Embeddings for Turkish". Expert Systems with…
mlwithme/BertWithPretrained
603
·
·
An implementation of the BERT model and its related downstream tasks based on the PyTorch…
sagorbrur/bangla-bert
84
·
·
Bangla-Bert is a pretrained bert model for Bengali language
Beomi/KcBERT
497
·
🤗 Pretrained BERT model & WordPiece tokenizer trained on Korean Comments 한국어 댓글로 프리트레이닝한 BERT 모델과…
khalidsaifullaah/BERTify
36
·
·
An easy-to-use Python module that helps you to extract the BERT embeddings for a large text dataset…
s-nlp/rudetoxifier
50
·
·
Code and data of "Methods for Detoxification of Texts for the Russian Language" paper
