Actions

Discover

Best AI Research Paper?

Submit your groundbreaking AI research paper for a chance to be recognized as the best in the field. Papers will be judged on innovation, impact, and clarity.

Judge Entries

AustinHatfield_1

#1 Ranked Submission

Best AI Research Paper?

Attention Is All You Need

This paper introduces the Transformer, a novel neural network architecture abandoning recurrence and convolutions entirely in favor of self-attention mechanisms. This design allows for significantly greater parallelization and reduced training time. The model, consisting of an encoder-decoder structure utilizing multi-head scaled dot-product attention and positional encodings, achieves state-of-the-art performance on …

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, Illia Polosukhin

https://arxiv.org/abs/1706.03762

AustinHatfield_1

#2 Ranked Submission

Best AI Research Paper?

ImageNet Classification with Deep Convolutional Neural Networks

This paper presents a large, deep convolutional neural network (CNN) that achieved groundbreaking results on the ImageNet LSVRC-2010 and 2012 image classification challenges. The architecture comprises five convolutional layers and three fully-connected layers, utilizing ReLU activation functions for faster training. Key techniques employed include training across multiple GPUs via model …

Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton

https://proceedings.neurips.cc/paper/2012/hash/c399862d3b9d6b76c8436e924a68c45b-Abstract.html

AustinHatfield_1

#3 Ranked Submission

Best AI Research Paper?

Variational Lossy Autoencoder

This paper introduces the Variational Lossy Autoencoder (VLAE), a generative model combining Variational Autoencoders (VAEs) with powerful neural autoregressive models (like PixelCNN or RNNs) for both the prior and decoder distributions. The key idea is to learn global representations by designing the decoder with a local receptive field, forcing the …

Xi Chen, Diederik P. Kingma, Tim Salimans, Yan Duan, Prafulla Dhariwal, John Schulman, Ilya Sutskever, Pieter Abbeel

https://arxiv.org/abs/1611.02731

AustinHatfield_1

#4 Ranked Submission

Best AI Research Paper?

The Unreasonable Effectiveness of Recurrent Neural Networks

This article highlights the surprising power and simplicity of Recurrent Neural Networks (RNNs). It discusses RNNs' ability to handle sequential data of variable lengths by maintaining a hidden state that captures past information. The core mechanics, including hidden state updates via matrix multiplications and non-linearities, are explained, along with the …

Andrej Karpathy

http://karpathy.github.io/2015/05/21/rnn-effectiveness/

AustinHatfield_1

#5 Ranked Submission

Best AI Research Paper?

A Simple Neural Network Module for Relational Reasoning

This paper introduces Relation Networks (RNs), a simple, plug-and-play neural network module designed specifically for relational reasoning. RNs operate on sets of object representations, explicitly computing pairwise relations using a function g θ and aggregating these relations with another function f ϕ to infer higher-order relationships. The effectiveness …

Adam Santoro, David Raposo, David G.T. Barrett, Mateusz Malinowski, Razvan Pascanu, Peter Battaglia, Timothy Lillicrap

https://arxiv.org/abs/1706.01427

Trending Contests