Questions tagged [convex-analysis]

Convex analysis is the study of properties of convex sets and convex functions. For questions about optimization of convex functions over convex sets, please use the (convex-optimization) tag.

Convex analysis is the study of properties of convex sets and convex functions.

Formally, a set $S$ is convex if, for all $x, y \in S$ and $t \in [0,1]$, $tx + (1-t)y \in S$. Intuitively, this says that for any two points in $S$, the line segment connecting those points is also in $S$.

Formally, a function $f: S \to \mathbb{R}$ defined on a convex set $S$ is convex, if for all $x,y \in S$ and $t \in [0,1]$, $f(tx + (1-t)y) \leq t f(x) + (1-t) f(y)$. Intuitively, this says that, for any two points on the graph of $f$, the line segment connecting those points lies above the graph of $f$.

Some of the more important results in convex analysis include Carathéodory's Theorem, Jensen's Inequality, Minkowski's Theorem, and the supporting hyperplane theorem.

9641 questions
50
votes
2 answers

Is the composition of $n$ convex functions itself a convex function?

Is a set of convex functions closed under composition? I don't necessarily need a proof, but a reference would be greatly appreciated.
37
votes
2 answers

Unit Ball with p-norm

I am having trouble understanding the definition of p-norm unit ball. What I know is that for infinity (maximum norm), then it will shape as a square. I need a "click" to understand this, can someone be so kind to explain this to me in simple…
dresden
  • 1,073
  • 2
  • 11
  • 19
32
votes
2 answers

How to determine whether a function of many variables is convex or non-convex?

A function $f$ is convex if $$f(\theta x + (1 − \theta)y) \leq \theta f(x) + (1 − \theta)f(y)$$ for all $x, y \in \mathcal{D}(f)$, the domain of $f$, and $\theta \in [0, 1]$. How do I determine whether a function of many variables is convex or…
Nob Jame
  • 355
29
votes
4 answers

Are affineness and convexity equivalent?

In reading about convex optimization, the author states that all convex sets are affine. Are affineness and convexity equivalent? If I understand, both definitions incorporate the notion that a set is affine/convex iff for every two points in the…
analysisj
  • 2,700
29
votes
7 answers

Is every monotone map the gradient of a convex function?

Recently in a seminar someone mentioned that monotone maps are equivalent to gradients of scalar convex functions, but it's not clear to me why this is true. One direction of the equivalence is straightforward but the other is not (as far as I can…
Nick Alger
  • 18,844
26
votes
3 answers

How to check convexity?

How can I know the function $$f(x,y)=\frac{y^2}{xy+1}$$ with $x>0$,$y>0$ is convex or not?
24
votes
2 answers

Is linear function convex or concave?

I was wondering if linear function is convex or concave? For example f(x)=x, is function whose second derivate is 0 so we cant tell anything using this criteria. Can someone help?
21
votes
1 answer

About the strictly convexity of log-sum-exp function

The log-sum-exp function $f: \; \mathbb R^n \to \mathbb R$ is defined by $$f(x)=\ln \left (e^{x_1}+\cdots + e^{x_n} \right).$$ It is well-known that this function is convex, but I wonder that whether or not $f$ is strictly convex? Thank you for any…
Richkent
  • 1,151
20
votes
4 answers

Show that $\max$ function on $\mathbb R^n$ is convex

I am reading the book Convex Optimization, and I don't understand why a $\max$ function is convex. The function is defined as: $$f(x) = \max(x_1, x_2, \dots, x_n)$$ The book offers the proof shown below: for $0 \leq \theta \leq 1$ $$\begin{aligned}…
hklel
  • 533
19
votes
1 answer

Is the sum of convex functions on different domains convex?

On the same domain, the sum of convex functions is convex (e.g. $f(x) + g(x)$ is convex if $f(x)$ and $g(x)$ are convex). However, I don't know that this is true for the sum of convex functions on different domains. For example, let $f(x) | x \in…
Supasate
  • 333
19
votes
4 answers

Disjoint convex sets that are not strictly separated

Question 2.23 out of Boyd & Vanderberghe's Convex Optimization: Give an example of two closed convex sets that are disjoint but cannot be strictly separated. The obvious idea is to take something like unbounded sets which are disjoint but approach…
BoB
  • 591
17
votes
1 answer

A function is convex if and only if its epigraph is convex

Given a function $f : \mathbb{R}^{n} \to \mathbb{R}$, its epigraph is defined as follows $$ \operatorname{epi} f = \left\{ (x,t) \in \mathbb{R}^{n+1}: x \in \mathbb{R}^{n}, t \geq f(x) \right\} $$ Could someone please help me prove that a function…
Very23
  • 315
  • 1
  • 2
  • 8
17
votes
3 answers

Proof of convexity of $f(x)=x^2$

I know that a function is convex if the following inequality is true: $$\lambda f(x_1) + (1-\lambda)f(x_2) \ge f(\lambda x_1 + (1-\lambda)x_2)$$ for $\lambda \in [0, 1]$ and $f(\cdot)$ is defined on positive real numbers. If $f(x)=x^2$, I can write…
groove
  • 281
17
votes
2 answers

For what functions $f(x)$ is $f(x)f(y)$ convex?

For which functions $f\colon [0,1] \to [0,1]$ is the function $g(x,y)=f(x)f(y)$ convex over $(x,y) \in [0,1]\times [0,1]$ ? Is there a nice characterization of such functions $f$? The obvious examples are exponentials of the form $e^{ax+b}$ and…
sd234
  • 467
16
votes
1 answer

How do you prove $x^2$ is convex using only the definition of convexity?

I apologize beforehand if this is an extremely easy question, I have very limited experience with proving convexity statements. Also, the reason that I choose such a simple example before tackling harder ones is that, if I cannot prove this one,…
1
2 3
69 70