British - Psychologist | December 6, 1947 -
Now that neural nets work, industry and government have started calling neural nets AI. And the people in AI who spent all their life mocking neural nets and saying they'd never do anything are now happy to call them AI and try and get some of the money.
Geoffrey Hinton
LifeWorkMoneyGovernmentHappy
The pooling operation used in convolutional neural networks is a big mistake, and the fact that it works so well is a disaster.
MistakeDisasterBigUsedWellFact
In a sensibly organised society, if you improve productivity, there is room for everybody to benefit.
SocietyYouImproveRoomBenefit
I get very excited when we discover a way of making neural networks better - and when that's closely related to how the brain works.
BrainBetterWayExcitedGetMaking
I had a stormy graduate career, where every week we would have a shouting match. I kept doing deals where I would say, 'Okay, let me do neural nets for another six months, and I will prove to you they work.' At the end of the six months, I would say, 'Yeah, but I am almost there. Give me another six months.'
WorkI AmMeEndDoingYou
The brain has about ten thousand parameters for every second of experience. We do not really have much experience about how systems like that work or how to make them be so good at finding structure in data.
WorkGoodExperienceBrainDataTen
Most people in AI, particularly the younger ones, now believe that if you want a system that has a lot of knowledge in, like an amount of knowledge that would take millions of bits to quantify, the only way to get a good system with all that knowledge in it is to make it learn it. You are not going to be able to put it in by hand.
GoodKnowledgePeopleBelieveLearn
We now think of internal representation as great big vectors, and we do not think of logic as the paradigm for how to get things to work. We just think you can have these great big neural nets that learn, and so, instead of programming, you are just going to get them to learn everything.
WorkGreatThinkLearnLogicYou
The paradigm for intelligence was logical reasoning, and the idea of what an internal representation would look like was it would be some kind of symbolic structure. That has completely changed with these big neural nets.
IntelligenceLookKindStructureBig
In the brain, you have connections between the neurons called synapses, and they can change. All your knowledge is stored in those synapses.
ChangeKnowledgeBrainConnections
In science, you can say things that seem crazy, but in the long run, they can turn out to be right. We can get really good evidence, and in the end, the community will come around.
GoodCommunityScienceCrazyEnd
My father was an entomologist who believed in continental drift. In the early '50s, that was regarded as nonsense. It was in the mid-'50s that it came back. Someone had thought of it 30 or 40 years earlier named Alfred Wegener, and he never got to see it come back.
FatherThoughtSomeoneBackEarly
Copyright © 2024 QuotesDict Geoffrey Hinton quotes