Back to .md Directory

natural language processing

Curates a list of seminal NLP papers, resources, and a reading group archive with links and summaries.

May 2, 2026
0 downloads
0 views
ai
View source

What this file does

Curates a list of seminal NLP papers, resources, and a reading group archive with links and summaries.

When to use it

  • Building a personal or team reading list for NLP topics
  • Organizing a paper reading group with presentation links
  • Quickly finding landmark papers in areas like parsing, MT, or language modeling

Assumes this stack

JAXFlax

natural language processing

Flaxformer: transformer architectures in JAX/Flax

Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance

Part-of-speech Tagging

https://github.com/ashishpatel26/500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code

Parsing

Named Entity Recognition

Coreference Resolution

Sentiment Analysis

Natural Logic/Inference

Machine Translation

Semantic Parsing

Question Answering/Reading Comprehension

Natural Language Generation/Summarization

Dialogue Systems

Interactive Learning

Language Modelling

Miscellanea

Deep learning Paper Reading Meeting Archive

This page is an archive of the Deep Learning Paper Reading Meeting. If you would like to attend the meeting or have any questions, Write in the GitHub issue table or email us at 'tfkeras@kakao.com'

TasksPaperLinkPerformance Index
NLPAttention is all you needYoutube<br> PaperNLP
NLPBERTYoutube <br> paperNLP, Laguage representation
NLPERNIEYoutube <br> paperNLP, Laguage representation
NLPRoBERTaYoutube <br> paperNLP, Laguage representation
NLPXLNETYoutube <br> paperNLP, Laguage representation
NLPSentenceBertYoutube
NLPDefending Against neural fake newsYoutube
NLPTransformerXLYoutube <br> blog
NLPUnderstanding back translation at scaleYoutube <br> blog
NLPDeep Contextualized Word RepresentationsYoutube
NLPUniviersal LM Fine-tuning for text classificationYoutube
NLPSubword-level Word Vector Representations for KoreanYoutube
NLPA Decomposable Attention Model for Natural Language InferenceYoutube
NLPReformerYoutube
NLPNeural Machine Translation by Jointly Learning to Align and TranslateYoutube
NLPELECTRAYoutube
NLPSBERT_WKYoutube
NLPRevealing the Dark Secrets of BERTYoutube
NLPPEGASUSYoutube
NLPDocument-level Neural Machine Translation with Inter-Sentence AttentionYoutube
NLPPhrase-Based & Neural Unsupervised MachineYoutube
NLPBARTYoutube
NLPBAEYoutube
NLPA Generative Model for Joint Natural Language Understanding and GenerationYoutube
NLPLearning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-TrainingYoutube
NLPGraph Attention NetworksYoutube
NLPSwitch TransformersYoutube
NLPDeText: A Deep Text Ranking Framework with BERTYoutube
NLPFace book Chat bot , Blender botYoutube
NLPExtracting Training Data from Large Language ModelsYoutube
NLPLongformer: The Long-Document TransformerYoutube
NLPVisualizing and Measuring the Geometry of BERTYoutube
NLPEncode, Tag, Realize HighPrecision Text EditingYoutube
NLPmultimodal transformer for unaligned multimodal language sequencesYoutube
NLPSCGPT : Few-shot Natural Language Generation for Task-Oriented DialogYoutube
NLPColBERT: Efficient and Effective Passage Search viaContextualized Late Interaction over BERTYoutube
NLPRestoring and Mining the Records ofthe Joseon Dynasty via Neural LanguageModeling and Machine TranslationYoutube
NLPImproving Factual Completeness and Consistency of Image to Text Radiology Report GenerationYoutube
NLPFinBERTYoutube
NLPLayoutLM: Pre-training of Text and Layout for Document Image UnderstandingYoutube
NLPQuery Suggestions as Summarization inExploratory SearchYoutube
NLPH-Transformer-1D Paper : Fast One Dimensional Hierarchical Attention For SequencesYoutube
NLPEnd-to-End Progressive Multi-Task Learning Framework for Medical Named Entity Recognition and NormalizationYoutube
NLPDISEASES : Text mining and data integration of disease–gene associationsYoutube
NLPRoFormer: Enhanced Transformer with Rotary Position EmbeddingYoutube
NLPA Multiscale Visualization of Attention in the Transformer ModelYoutube
NLPCAST: Enhancing Code Summarization with Hierarchical Splitting and Reconstruction of Abstract Syntax TreesYoutube
NLPMERL:Multimodal Event Representation Learning in Heterogeneous Embedding SpacesYoutube
NLPBig Bird - Transformers for Longer SequencesYoutube
NLPDecoding-Enhanced BERT with Disentangled AttentionYoutube
NLPSentiPrompt: Sentiment Knowledge Enhanced Prompt-Tuning for Aspect-Based Sentiment AnalysisYoutube
NLPIMPROVING BERT FINE-TUNING VIA SELF-ENSEMBLE AND SELF-DISTILL ATIONYoutube
NLPACHIEVING HUMAN PARITY ON VISUAL QUESTION ANSWERINGYoutube
NLPDeep Encoder, Shallow Decoder: Reevaluating non- autoregressive machine translationYoutube
NLPLaMDA : Language Models for Dialog ApplicationsYoutube
VisionYOLOYoutube <br> paperObject detection
VisionYOLO-v2Youtube
VisionResnetYoutube <br> paperImage classification
VisionGANYoutube
VisionImage Style Transfer Using CNNYoutube
VisionSINGANYoutube
VisionFCNYoutube
VisionDeepLabV3Youtube
VisionUnetYoutube <br> paper
VisionCyCADAYoutube
VisionD-SNEYoutube
VisionFaster-RCNNYoutube
VisionWeakly Supervised Object DetectionWith Segmentation CollaborationYoutube
VisionDon't Judge an Object by Its Context: Learning to Overcome Contextual BiasYoutube
Visiondata efficient image recognition with contrastive predictive codingYoutube
VisionDeep Feature Consistent Variational AutoencoderYoutube
VisionAttention Branch Network: Learning of Attention Mechanism for Visual ExplanationYoutube
VisionRELATION-SHAPE CONVOLUTIONAL NEURAL NETWORK FOR POINT CLOUD ANALYSISYoutube
VisionEfficientNetYoutube
VisionDeep Clustering for Unsupervised Learning of Visual FeaturesYoutube
VisionBoosting Few-shot visual learning with self-supervisionYoutube
VisionRethinking Pre-training and Self-trainingYoutube
VisionBYOL : Bootstrap Your Own LatentYoutube
VisionDeep Image PriorYoutube
VisionObject-Centric Learning with Slot AttentionYoutube
VisionYolo V4Youtube
VisionDynamic Routing Between CapsulesYoutube
VisionSemi-Supervised Classification with Graph Convolutional NetworkYoutube
VisionGenerative Pretraining from PixelsYoutube
VisionMaskFlownetYoutube
VisionAdversarial Robustness through Local LinearizationYoutube
VisionLocating Objects Without Bounding BoxesYoutube
VisionTraining data-efficient image transformers & distillation through attentionYoutube
VisionWhat Makes Training Multi-modalClassification Networks Hard?Youtube
Vision2020 CVPR Meta-Transfer Learning for Zero-Shot Super-ResolutionYoutube
Vision2020 ACCV Patch SVDD: Patch-level SVDD for Anomaly Detection and SegmentationYoutube
VisionStyle GANYoutube
VisionHighPerformance Large Scale ImageRecognition Without NormalizationYoutube
VisionFocal Loss for Dense Object DetectionYoutube
VisionEditing in Style : Uncovering the Local Semantics of GANsYoutube
VisionEfficient Net 2Youtube
VisionStyle ClipYoutube
VisionSwin TransformerYoutube
VisionNBDT : Neural-backed Decision TreeYoutube
Vision[2020 CVPR] Efficient DETYoutube
VisionMLP - MIXER : An all-MLP Architecture for VisionYoutube
VisionYou Only Look at One Sequence: Rethinking Transformer in Vision through Object DetectionYoutube
VisionVideo Prediction ! Hierarchical Long-term Video Frame Prediction without SupervisionYoutube
VisionClosed-Form Factorization of Latent Semantics in GANsYoutube
VisionYOLOR : You Only Learn One Representation: Unified Network for Multiple TasksYoutube
VisionStyleSpace AnalysisYoutube
VisionRepresentative graph neural networkYoutube
VisionYOLOXYoutube
VisionJoint Contrastive Learning with Infinite PossibilitiesYoutube
VisionAuto Deep Lab - Hierarchical Neural Architecture Search for Semantic Image SegmentationYoutube
VisionExplaining in style training a gan to explain a classifier in stylespaceYoutube
VisionEnd-to-End Semi-Supervised Object Detection with Soft TeacherYoutube
VisionUnderstanding Dimensional Collapse in Contrastive Self Supervised LearningYoutube
VisionEncoding in Style: a Style Encoder for Image-to-Image TranslationYoutube
VisionDetection in Crowded Scenes: One Proposal, Multiple PredictionsYoutube
VisionA Normalized Gaussian Wasserstein Distance for Tiny Object DetectionYoutube
VisionSiamese Neural network for one-shot image recognitionYoutube
VisionGrounded Language-Image Pre-trainingYoutube
VisionTransfer Learning for Pose Estimation of Illustrated CharactersYoutube
VisionSparse - RCNN paper explainedYoutube
Recommend SystemMatrix Factorization Technique for Recommender SystemYoutube <br> paperRecommendation system
Recommend SystemCollaborative Filtering for Implicit Feedback DatasetYoutube
SpeechA comparison of S2S models for speech recognitionYoutube <br> paperSpeech Recognition
FundamentalRAdamYoutube <br> blog <br> paperRegularization
FundamentalStacked Auto Encoder for the P300 Component DetectionYoutube
FundamentalA survey on Image Data Augmentation for DLYoutube <br>paperData augmentation
FundamentalTraining Confidence-calibrated classifiers for detecting out of distribution samplesYoutube
FundamentalAdamWYoutube <br> blog
FundamentalStarganYoutube
FundamentalDrop-outYoutube
FundamentalBLEU - a Method for Automatic Evaluation of Machine TranslationYoutube
Fundamentalt-SNEYoutube
FundamentalGpipeYoutube
Fundamentalexplainable aiYoutube
FundamentalTAPASYoutube
FundamentalLearning both Weights and Connections for Efficient Neural NetworksYoutube
FundamentalReVACNNYoutube
FundamentalTHE LOTTERY TICKET HYPOTHESIS: FINDING SPARSE, TRAINABLE NEURAL NETWORKSYoutube
FundamentalALPHAGO : Mastering the game of Go with Deep Neural Networks and Tree SearchYoutube
FundamentalA_BASELINE_FOR_FEW_SHOT_IMAGE_CLASSIFICATIONYoutube
FundamentalSharp Minima Can Generalize For Deep NetsYoutube
FundamentalPediatric Sleep Stage Classification Using Multi-Domain Hybrid Neural NetworksYoutube
FundamentalPruning from ScratchYoutube
FundamentalDo We Need Zero Training Loss After Achieving Zero Training Error?Youtube
FundamentalDeep Recurrent Q-Learning for Partially Observable MDPsYoutube
FundamentalLarge Margin Deep Networks for ClassificationYoutube
Fundamentalgenerating wikipedia by summarizing long sequencesYoutube
FundamentalPlug and Play Language Models: A Simple Approach to Controlled Text GenerationYoutube
FundamentalWhat Uncertainties Do We Need in Bayesian DeepLearning for Computer Vision?Youtube
FundamentalKREDYoutube
FundamentalEarly Stopping as nonparametric VariationalYoutube
FundamentalSharpness Aware Minimization for efficeintly improving generalizationYoutube
FundamentalNeural Graph Collaborative FilteringYoutube
FundamentalRestricting the Flow: Information Bottlenecks for AttributionYoutube
FundamentalReal world Anomaly Detection in Surveillance VideosYoutube
FundamentalDeep learning model to 2Bit Quantization?! BRECQ Paper review (2021 ICLR)Youtube
FundamentalDeep sets (2017 NIPS)Youtube
FundamentalStyleGAN2Youtube
FundamentalSOTA - Beyond Synthetic Noise:Deep Learning on Controlled Noisy LabelsYoutube
FundamentalDeep Reinforcement Learning for Online Advertising Impression in Recommender SystemsYoutube
FundamentalLongformer: The Long-Document TransformerYoutube
Fundamentalsoft actor criticYoutube
FundamentalLoss Function Discovery for Object Detection Via Convergence- Simulation Driven SearchYoutube
Fundamental[2021 ICLR] The Deep Bootstrap Framework:Good Online Learners are good Offline GeneralizersYoutube
FundamentalMeta HINYoutube
FundamentalWhen Vision Transformers Outperform ResNets without Pretraining or Strong Data AugmentationsYoutube
FundamentalSelf similarity Student for Partial Label Histopathology Image SegmentationYoutube
FundamentalANALYSING MATHEMATICAL REASONING ABILITIES OF NEURAL MODELSYoutube
FundamentalSelf-training Improves Pre-training for Natural Language UnderstandingYoutube
FundamentalPreference Amplification in Recommender SystemsYoutube
FundamentalDo We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain AdaptationYoutube
FundamentalEvaluating Classifiers by Mean of Test Data with Noisy LabelsYoutube
FundamentalProgressive Identification of True Labels for Partial-Label LearningYoutube
FundamentalFine-grained Interest Matching For Neural News RecommendationYoutube
FundamentalAdversarial Reinforced Learning for Unsupervised Domain AdaptationYoutube
FundamentalNeural Tangent Kernel - Convergence and Generalization in neural NetworkYoutube
FundamentalIntriguing Properties of Contrastive LossesYoutube
FundamentalGrokking: Generalization Beyond Overfitting on Small Algorithmic DatasetsYoutube
FundamentalTransformer Interpretability Beyond Attention VisualizationYoutube
FundamentalHow does unlabeled data improve generalization in self-training?Youtube
FundamentalRainbow: Combining Improvements in Deep Reinforcement LearningYoutube

What's inside

16 topic sections with paper references and TLDRs, plus a table of 40+ reading group entries with YouTube links

Change this for your project

  • Replace tfkeras@kakao.com with your own contact email
  • Replace the GitHub issue table reference with your own issue tracker link

Where it goes

Save in docs/ or the repository root. Gives agents and new contributors a map of the codebase.

Worth borrowing

  • Grouping papers by subfield with one-line TLDRs for quick scanning
  • Using a table to track reading group sessions with paper title and video link

Related Documents