Let $A\in \mathbb{n\times n}$ be a symmetric matrix. Let $x\in \mathbb{R}^{n\times 1}$ be an unknown vector.
The problem is $$\min \limits_x x^TAx.$$
Since $A$ is an input, I am not sure
1 it is positive semidefinite (the objective is convex);
2 or it is negative semidefinite (the objective is concave);
3 or indefinite (the objective is neither concave nor convex. )
Case 1 is simple. In Case 2, the minimum is infinite. So people may say it is not well defined. Could any one tell me how should I handle case 3? Is its minimum infinite?
If I change the problem to,
$$\min \limits_x x^TAx$$
where $x\in C$, $C$ is a convex set. For example $\sum\limits_i^n x_i=1$; or $|x_i|\le 1$. Is there any way to find $\arg\min\limits_x x^TAx$?