How can I determine if an input sentence is consistent with a certain subject?

Question

For example, suppose I am given the following dataset.

| Subject       | User input           | Output |
|---------------|----------------------|--------|
| Dog ownership | I own a dog          | Yes    |
| Dog ownership | My dog is called Joe | Yes    |
| Dog ownership | I don't have a dog   | No     |

In the examples above, the subject "dog ownership" is consistent with the input sentences "I own a dog" and "My dog is called Joe" (because, if your dog is called Joe, then you also own a dog).

score 2 · Answer 1 · edited Mar 14 '20 at 19:02

2

If you have lots of training data, ANN's (deep learning) could quite possibly get you there. But I have a hunch you might also get some mileage out of using something like a rule induction approach. Maybe something like CN2. I'd suggest at least reading up on those and see if you can see a way to apply that to your system.

edited Mar 14 '20 at 19:02

nbro

40,472
12
105
192

answered Jul 21 '17 at 19:57

mindcrime

3,757
1
14
29

The thing is that I don't have enough training data for ANN's, but I'm starting to think that I will need it. Since it will require a big amount of effort, I was waiting to be sure that getting this big set of data is the solution. – bleand Jul 22 '17 at 14:54

score 1 · Answer 2 · answered Jul 20 '17 at 13:28

1

If you have collection of data or information, then you would like to ask questions about this data and machine should answer you.

I think you need first, data mining to export the meaning and relations in this data, then you can build your expert system that will answer you.

answered Jul 20 '17 at 13:28

Mohammad Alabed

141
3

I do have some training data. Do you know any particular algorithm that could work? – bleand Jul 20 '17 at 15:00

score 0 · Answer 3 · edited Mar 14 '20 at 19:04

Neural networks are the one thing I would not recommend. Your problem fits into the domain of predicate calculus, with some basic pattern recognition of the input sentences (assuming you only accept a certain type of sentences). You can do that without the need for masses of data.

First, transform your statement into a canonical representation, probably using first-order logic and simple pattern matching/string matching. For example,

I own a dog 

X own/owns a/an Y  

owns(I, dog)

Here you have a pattern "X own(s) a(n) Y", which you recognise in your user input. You then have a predicate owns(X, Y), which you add to your database of statements. This database you can then query. For example, Do I own a cat? could fit a question pattern Do/Does X own(s) a(n) Y?, and you can search for own(I, cat) in your DB; you will not find it, so the answer is "No". If the question is "Do I own a dog?" you will find owns(I, dog) in your database and you can reply "Yes".

This is all rather 'old' technology, but I think you will find that you will get decent results much quicker than with machine learning or statistical methods, especially if you have not much data to begin with.

A further branch to look into would be expert systems. If you're thinking in terms of programming languages, then Prolog would be well suited for this, but any language should do, really.

How can I determine if an input sentence is consistent with a certain subject?

3 Answers3