If your really want a formal definition. You can take their Taylor expansion as their definition.
Moreover, There is only $1$ pair of such functions satisfies your requirements. If $f'=-g, g'=f, f(0)=1,g(0)=0$. Then, we have $f''+f=0$. You can show that the only solution of this equation is $f(x)=A\cos(x)+B\sin(x)$. Similarly, $g'+g=0$ and $g(x)=A'\cos(x)+B'\sin(x)$.
By your additional requirements, we have $g(0)=0$, i.e $A'=0$ and $g(x)=B' \sin(x)$; $f(0)=1$ i.e $A=1$ and $f(x)=\cos(x)+B\sin(x)$. Also since $f'=-g$, $g'=f$, we have $f'(0)=0, g'(0)=1$. Thus, $B=0$ and $B'=1$. Done.
Hint for showing unique solution of $f''+f=0$: Show the derivative of $f(x)\cos(x)-f'(x)\sin(x)$ and the derivative of $f(x)\sin(x)+f'(x)\cos(x)$ are identically $0$