Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

Collections

Discover the best community collections!

Collections including paper arxiv:2001.08361

250 Years of America, 250 Open AI Milestones

For the 250th birthday of the USA: the 250 most important American open models, datasets, papers and Spaces, ranked from #1 down. Happy 4th of July!

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 134
PyTorch: An Imperative Style, High-Performance Deep Learning Library

Paper • 1912.01703 • Published Dec 3, 2019 • 2
google-bert/bert-base-uncased

Fill-Mask • 0.1B • Updated Feb 19, 2024 • 104M • • 2.72k
openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 13.7M • 3.38k

Toolkit - AI Papers

Neural Machine Translation by Jointly Learning to Align and Translate

Paper • 1409.0473 • Published Sep 1, 2014 • 7
Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 134
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 32
Hierarchical Reasoning Model

Paper • 2506.21734 • Published Jun 26, 2025 • 54

Scaling Laws 📏

Scaling Autoregressive Models for Content-Rich Text-to-Image Generation

Paper • 2206.10789 • Published Jun 22, 2022 • 4
Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

Paper • 2401.00448 • Published Dec 31, 2023 • 31
Training Compute-Optimal Large Language Models

Paper • 2203.15556 • Published Mar 29, 2022 • 12
Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10

LLM-Alignment Papers

Concrete Problems in AI Safety

Paper • 1606.06565 • Published Jun 21, 2016 • 1
The Off-Switch Game

Paper • 1611.08219 • Published Nov 24, 2016 • 1
Learning to summarize from human feedback

Paper • 2009.01325 • Published Sep 2, 2020 • 4
Truthful AI: Developing and governing AI that does not lie

Paper • 2110.06674 • Published Oct 13, 2021 • 1

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 134
Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10
RoFormer: Enhanced Transformer with Rotary Position Embedding

Paper • 2104.09864 • Published Apr 20, 2021 • 18
LoRA Learns Less and Forgets Less

Paper • 2405.09673 • Published May 15, 2024 • 90

Foundational & Modern AI Research (Curated)

A curated selection of foundational and modern AI research papers that meaningfully influence how real-world AI systems are designed, evaluated, and g

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 134
Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10
Training Compute-Optimal Large Language Models

Paper • 2203.15556 • Published Mar 29, 2022 • 12
Analogy Generation by Prompting Large Language Models: A Case Study of InstructGPT

Paper • 2210.04186 • Published Oct 9, 2022

Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10
Running

602

Scaling test-time compute

📈

602

Boost LLM answers with flexible test‑time search strategies

Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10
Scaling Laws for Autoregressive Generative Modeling

Paper • 2010.14701 • Published Oct 28, 2020 • 1
Training Compute-Optimal Large Language Models

Paper • 2203.15556 • Published Mar 29, 2022 • 12
A Survey on Data Selection for Language Models

Paper • 2402.16827 • Published Feb 26, 2024 • 4

STaR: Bootstrapping Reasoning With Reasoning

Paper • 2203.14465 • Published Mar 28, 2022 • 9
Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10
Byte Latent Transformer: Patches Scale Better Than Tokens

Paper • 2412.09871 • Published Dec 13, 2024 • 109
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Paper • 2501.12948 • Published Jan 22, 2025 • 458

Ilya's papers for Carmack

Ilya Sutskever: "If you really learn all of these, you’ll know 90% of what matters today." Full list: https://punkx.org/jackdoe/30.html

Recurrent Neural Network Regularization

Paper • 1409.2329 • Published Sep 8, 2014 • 1
Pointer Networks

Paper • 1506.03134 • Published Jun 9, 2015 • 1
Order Matters: Sequence to sequence for sets

Paper • 1511.06391 • Published Nov 19, 2015 • 1
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism

Paper • 1811.06965 • Published Nov 16, 2018 • 1

250 Years of America, 250 Open AI Milestones

For the 250th birthday of the USA: the 250 most important American open models, datasets, papers and Spaces, ranked from #1 down. Happy 4th of July!

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 134
PyTorch: An Imperative Style, High-Performance Deep Learning Library

Paper • 1912.01703 • Published Dec 3, 2019 • 2
google-bert/bert-base-uncased

Fill-Mask • 0.1B • Updated Feb 19, 2024 • 104M • • 2.72k
openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 13.7M • 3.38k

Foundational & Modern AI Research (Curated)

A curated selection of foundational and modern AI research papers that meaningfully influence how real-world AI systems are designed, evaluated, and g

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 134
Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10
Training Compute-Optimal Large Language Models

Paper • 2203.15556 • Published Mar 29, 2022 • 12
Analogy Generation by Prompting Large Language Models: A Case Study of InstructGPT

Paper • 2210.04186 • Published Oct 9, 2022

Toolkit - AI Papers

Neural Machine Translation by Jointly Learning to Align and Translate

Paper • 1409.0473 • Published Sep 1, 2014 • 7
Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 134
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 32
Hierarchical Reasoning Model

Paper • 2506.21734 • Published Jun 26, 2025 • 54

Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10
Running

602

Scaling test-time compute

📈

602

Boost LLM answers with flexible test‑time search strategies

Scaling Laws 📏

Scaling Autoregressive Models for Content-Rich Text-to-Image Generation

Paper • 2206.10789 • Published Jun 22, 2022 • 4
Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

Paper • 2401.00448 • Published Dec 31, 2023 • 31
Training Compute-Optimal Large Language Models

Paper • 2203.15556 • Published Mar 29, 2022 • 12
Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10

Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10
Scaling Laws for Autoregressive Generative Modeling

Paper • 2010.14701 • Published Oct 28, 2020 • 1
Training Compute-Optimal Large Language Models

Paper • 2203.15556 • Published Mar 29, 2022 • 12
A Survey on Data Selection for Language Models

Paper • 2402.16827 • Published Feb 26, 2024 • 4

LLM-Alignment Papers

Concrete Problems in AI Safety

Paper • 1606.06565 • Published Jun 21, 2016 • 1
The Off-Switch Game

Paper • 1611.08219 • Published Nov 24, 2016 • 1
Learning to summarize from human feedback

Paper • 2009.01325 • Published Sep 2, 2020 • 4
Truthful AI: Developing and governing AI that does not lie

Paper • 2110.06674 • Published Oct 13, 2021 • 1

STaR: Bootstrapping Reasoning With Reasoning

Paper • 2203.14465 • Published Mar 28, 2022 • 9
Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10
Byte Latent Transformer: Patches Scale Better Than Tokens

Paper • 2412.09871 • Published Dec 13, 2024 • 109
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Paper • 2501.12948 • Published Jan 22, 2025 • 458

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 134
Scaling Laws for Neural Language Models

Paper • 2001.08361 • Published Jan 23, 2020 • 10
RoFormer: Enhanced Transformer with Rotary Position Embedding

Paper • 2104.09864 • Published Apr 20, 2021 • 18
LoRA Learns Less and Forgets Less

Paper • 2405.09673 • Published May 15, 2024 • 90

Ilya's papers for Carmack

Ilya Sutskever: "If you really learn all of these, you’ll know 90% of what matters today." Full list: https://punkx.org/jackdoe/30.html

Recurrent Neural Network Regularization

Paper • 1409.2329 • Published Sep 8, 2014 • 1
Pointer Networks

Paper • 1506.03134 • Published Jun 9, 2015 • 1
Order Matters: Sequence to sequence for sets

Paper • 1511.06391 • Published Nov 19, 2015 • 1
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism

Paper • 1811.06965 • Published Nov 16, 2018 • 1

Previous
1
2
Next

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs