Most Popular
1500 questions
40
votes
4 answers
What is the concept of the technological singularity?
I've heard the idea of the technological singularity, what is it and how does it relate to Artificial Intelligence? Is this the theoretical point where Artificial Intelligence machines have progressed to the point where they grow and learn on their…

WilliamKF
- 2,513
- 1
- 25
- 31
40
votes
6 answers
Is the Turing Test, or any of its variants, a reliable test of artificial intelligence?
The Turing Test was the first test of artificial intelligence and is now a bit outdated. The Total Turing Test aims to be a more modern test which requires a much more sophisticated system. What techniques can we use to identify an artificial…

Rob Murray
- 501
- 5
- 8
39
votes
7 answers
Is the "Chinese room" an explanation of how ChatGPT works?
Sorry if this question makes no sense. I'm a software developer but know very little about AI.
Quite a while ago, I read about the Chinese room, and the person inside who has had a lot of training/instructions how to combine symbols, and, as a…

Guntram Blohm
- 501
- 1
- 3
- 7
39
votes
3 answers
Why is Lisp such a good language for AI?
I've heard before from computer scientists and from researchers in the area of AI that that Lisp is a good language for research and development in artificial intelligence.
Does this still apply, with the proliferation of neural networks and deep…

Alecto Irene Perez
- 599
- 1
- 6
- 10
38
votes
5 answers
What is the difference between latent and embedding spaces?
In general, the word "latent" means "hidden" and "to embed" means "to incorporate". In machine learning, the expressions "hidden (or latent) space" and "embedding space" occur in several contexts. More specifically, an embedding can refer to a…

nbro
- 40,472
- 12
- 105
- 192
37
votes
6 answers
Why do CNN's sometimes make highly confident mistakes, and how can one combat this problem?
I trained a simple CNN on the MNIST database of handwritten digits to 99% accuracy. I'm feeding in a bunch of handwritten digits, and non-digits from a document.
I want the CNN to report errors, so I set a threshold of 90% certainty below which my…

Alexander Soare
- 1,339
- 2
- 11
- 27
36
votes
1 answer
Meaning of roles in the API of GPT-4/ChatGPT (system/user/assistant)
In the API of GPT-4 and ChatGPT, the prompt for a chat conversation is a list of messages, each marked as one of three roles: system, user or assistant.*
I understand which information this represents - but what does the model with that…

Volker Siegel
- 717
- 1
- 6
- 17
36
votes
1 answer
What is the "temperature" in the GPT models?
What does the temperature parameter mean when talking about the GPT models?
I know that a higher temperature value means more randomness, but I want to know how randomness is introduced.
Does temperature mean we add noise to the weights/activations…

Tom Dörr
- 483
- 1
- 4
- 7
36
votes
2 answers
How can Transformers handle arbitrary length input?
The transformer, introduced in the paper Attention Is All You Need, is a popular new neural network architecture that is commonly viewed as an alternative to recurrent neural networks, like LSTMs and GRUs.
However, having gone through the paper, as…

chessprogrammer
- 2,890
- 2
- 15
- 26
36
votes
7 answers
What are examples of promising AI/ML techniques that are computationally intractable?
To produce tangible results in the field of AI/ML, one must take theoretical results under the lens of computational complexity.
Indeed, minimax effectively solves any two-person "board game" with win/loss conditions, but the algorithm quickly…

k.c. sayz 'k.c sayz'
- 2,091
- 10
- 26
35
votes
6 answers
Is it possible to train the neural network to solve math equations?
I'm aware that neural networks are probably not designed to do that, however asking hypothetically, is it possible to train the deep neural network (or similar) to solve math equations?
So given the 3 inputs: 1st number, operator sign represented by…

kenorb
- 10,483
- 3
- 44
- 94
35
votes
8 answers
Is a switch from R to Python worth it?
I just finished a 1-year Data Science master's program where we were taught R. I found that Python is more popular and has a larger community in AI.
What are the advantages that Python may have over R in terms of features applicable to the field of…

ItsMeMario
- 503
- 1
- 4
- 6
34
votes
6 answers
How does an AI like ChatGPT answer a question in a subject which it may not know?
After seeing StackOverflow's banning of ChatGPT, I explored it out of curiosity. It's marvellous as it can write code by itself!
Later to check if it knows chess as well like Google-Deepmind's AlphaZero AI, I asked below questions:
Me: Does openai…

iammilind
- 443
- 1
- 3
- 9
33
votes
5 answers
How can I deal with images of variable dimensions when doing image segmentation?
I'm facing the problem of having images of different dimensions as inputs in a segmentation task. Note that the images do not even have the same aspect ratio.
One common approach that I found in general in deep learning is to crop the images, as it…

MattSt
- 597
- 1
- 5
- 12
33
votes
4 answers
How to find the optimal number of neurons per layer?
When you're writing your algorithm, how do you know how many neurons you need per single layer? Are there any methods for finding the optimal number of them, or is it a rule of thumb?

kenorb
- 10,483
- 3
- 44
- 94