Make sure your points are arranged clockwise. Set them up like so.
$\begin {bmatrix} x_1 & y_1\\x_2&y_2\\x_3&y_3\\x_4&y_4 \end{bmatrix}$
By the shoelace algorithm the area of the quadrilateral $A=
x_1 y_2 + x_2 y_3 + x_3 y_4 + x_4 y_1 - y_1 x_2 - y_2 x_3 - y_3x_4 - y_4 x_1$
What are we doing... we multiply down and to the right (looping around at the bottom to the top) and add up the products. And then we multiply up and to the right and add up the products. Do you see why this is described as shoelaces?
If they are counterclockwise then you will get the negative of the area. And if you are "twisted up," i.e. $(x_1,y_1)$ is diagonal from $(x_2,y_2)$ then you have nothing relevant.
Let's call the new point $(x_a,y_a)$
Now shoelace through 5 points.
$\begin {bmatrix} x_1 & y_1\\x_2&y_2\\x_3&y_3\\x_4&y_4\\x_a&y_a\end{bmatrix}$
If the area the 5-gon is greater, then the added point is outside the 5-gon.
if the area of the 5-gon is less than your quadrilateral, you are not done quite yet. If this is a programming task, program it to swap $(x_a,y_a)$ through the different rows of the matrix. i.e.
$\begin {bmatrix} x_1 & y_1\\x_2&y_2\\x_3&y_3\\x_a&y_a\\x_4&y_4\end{bmatrix},
\begin {bmatrix} x_1 & y_1\\x_2&y_2\\x_a&y_a\\x_3&y_3\\x_4&y_4\end{bmatrix},
\begin {bmatrix} x_1 & y_1\\x_a&y_a\\x_2&y_2\\x_3&y_3\\x_4&y_4\end{bmatrix}$
And if the area no matter how you position $(x_a, y_a),$ the area is less than the area of the quadrilateral, then $(x_a,y_a)$ is inside the figure.