Most Popular
1500 questions
31
votes
3 answers
Can BERT be used for sentence generating tasks?
I am a new learner in NLP. I am interested in the sentence generating task. As far as I am concerned, one state-of-the-art method is the CharRNN, which uses RNN to generate a sequence of words.
However, BERT has come out several weeks ago and is…

ch271828n
- 413
- 1
- 4
- 11
31
votes
2 answers
How is a deep neural network different from other neural networks?
How is a neural network having the "deep" adjective actually distinguished from other similar networks?

kenorb
- 10,483
- 3
- 44
- 94
31
votes
7 answers
Is artificial intelligence vulnerable to hacking?
The paper The Limitations of Deep Learning in Adversarial Settings explores how neural networks might be corrupted by an attacker who can manipulate the data set that the neural network trains with. The authors experiment with a neural network meant…

Surya Sg
- 495
- 4
- 13
31
votes
2 answers
What is sample efficiency, and how can importance sampling be used to achieve it?
For instance, the title of this paper reads: "Sample Efficient Actor-Critic with Experience Replay".
What is sample efficiency, and how can importance sampling be used to achieve it?

Gokul NC
- 463
- 1
- 4
- 7
31
votes
5 answers
Is it possible to train a neural network as new classes are given?
I would like to train a neural network (NN) where the output classes are not (all) defined from the start. More and more classes will be introduced later based on incoming data. This means that, every time I introduce a new class, I would need to…

Fr_nkenstien
- 457
- 1
- 4
- 10
31
votes
3 answers
Where can I find the proof of the universal approximation theorem?
The Wikipedia article for the universal approximation theorem cites a version of the universal approximation theorem for Lebesgue-measurable functions from this conference paper. However, the paper does not include the proofs of the theorem. Does…

Leroy Od
- 475
- 1
- 4
- 4
30
votes
4 answers
Is Lisp still being used to tackle AI problems?
I know that language of Lisp was used early on when working on artificial intelligence problems. Is it still being used today for significant work? If not, is there a new language that has taken its place as the most common one being used for work…

WilliamKF
- 2,513
- 1
- 25
- 31
30
votes
4 answers
Can neural networks be used to prove conjectures?
Imagine I have a list (in a computer-readable form) of all problems (or statements) and proofs that math relies on.
Could I train a neural network in such a way that, for example, I enter a problem and it generates a proof for it?
Of course, those…

Max Mustermann Junior
- 301
- 3
- 3
30
votes
4 answers
What are the current theories on the development of a conscious AI?
What are the current theories on the development of a conscious AI? Is anyone even trying to develop a conscious AI?
Is it possible that consciousness is an emergent phenomenon, that is, once we put enough complexity into our system, it will become…

Micky-D
- 401
- 4
- 3
30
votes
2 answers
What are "bottlenecks" in neural networks?
What are "bottlenecks" in the context of neural networks?
This term is mentioned, for example, in this TensorFlow article, which also uses the term "bottleneck values". How does one calculate bottleneck values? How do these values help image…

Anurag Singh
- 411
- 1
- 5
- 11
30
votes
7 answers
How can an AI train itself if no one is telling it if its answer is correct or wrong?
I am a programmer but not in the field of AI. A question constantly confuses me is that how can an AI be trained if we human beings are not telling it its calculation is correct?
For example, news usually said something like "company A has a large…
user31556
30
votes
9 answers
What is the actual quality of machine translations?
As an AI layman, till today I am confused by the promised and achieved improvements of automated translation.
My impression is: there is still a very, very far way to go. Or are there other explanations why the automated translations (offered and…

Hans-Peter Stricker
- 891
- 1
- 8
- 21
30
votes
1 answer
What is the Bellman operator in reinforcement learning?
In mathematics, the word operator can refer to several distinct but related concepts. An operator can be defined as a function between two vector spaces, it can be defined as a function where the domain and the codomain are the same, or it can be…

nbro
- 40,472
- 12
- 105
- 192
29
votes
4 answers
Can a neural network be used to predict the next pseudo random number?
Is it possible to feed a neural network the output from a random number generator and expect it learn the hashing (or generator) function, so that it can predict what will be the next generated pseudo-random number?
Does something like this already…

AshTyson
- 401
- 1
- 4
- 4
29
votes
4 answers
Why is ChatGPT bad at math?
As opposed to How does ChatGPT know math?, I've been seeing some things floating around the Twitterverse about how ChatGPT can actually be very bad at math. For instance, I asked it "If it takes 5 machines 5 minutes to make 5 devices, how long would…

Mithical
- 2,905
- 5
- 27
- 39