Lazy vs Eager Learning

Question

I wish to better understand the difference between lazy and eager learning. I am having difficulty conceptualising what the "abstraction" refers to between the two.

According to the text book I am reading it says, "The distinction between easy learners and lazy learners is based on when the algorithm abstracts from the data."

A lazy learner delays abstracting from the data until it is asked to make a prediction while an eager learner abstracts away from the data during training and uses this abstraction to make predictions rather than directly compare queries with instances in the dataset.

I understand that KNN algorithm loads all the data into memory so depending on the size of the dataset, the computing requirements could be enormous as well as the fact it's a non-parametric algorithm so there is no training to find parameters, the classification is done on a per query requirement??

Pretty much, but don't forget that $k$ is a hyperparameter you can optimize. — Emre, May 18 '17 at 06:07

score 16 · Answer 1 · edited Jun 16 '20 at 11:08

16

Lazy learner:

Just store Data set without learning from it
Start classifying data when it receive Test data
So it takes less time learning and more time classifying data

Eager learner:

When it receive data set it starts classifying (learning)
Then it does not wait for test data to learn
So it takes long time learning and less time classifying data

Hint : In supervised learning

Some examples are :

Lazy : K - Nearest Neighbour, Case - Based Reasoning

Eager : Decision Tree, Naive Bayes, Artificial Neural Networks

edited Jun 16 '20 at 11:08

Community

1

answered Nov 05 '18 at 12:13

EbraHim Eldesoki

161
1
5

It will be good if you can give some examples of lazy and eager learners. – rnso Dec 05 '18 at 17:11
If you means by examples the algorithms .lazy :k-nearest neighbor, Case-based reasoning...Eager : Decision Tree, Naive Bayes, Artificial Neural Networks – EbraHim Eldesoki Dec 12 '18 at 15:58
Good information. Thanks. Can be added to the answer above. – rnso Dec 13 '18 at 02:01
is DBSCAN a lazy learner? – Nipun Thennakoon Jan 21 '20 at 11:16
@NipunSampath: Using the original algorithm it is a lazy learner. – Make42 Jul 02 '20 at 13:23
KNN does not make any assumptions on the underlying data distribution but relies on item feature similarity. It uses a database in which the data points are separated into several clusters to make inferences for new samples. – Purushothaman Srikanth Sep 11 '21 at 10:34

Lazy vs Eager Learning

1 Answers1

Hint : In supervised learning

Linked