This is Exercise 1.50b in Fulton's Algebraic Curves. It's a follow up to showing that algebraic elements form a subfield. I found similar questions MSE, but with stronger hypothesis.
By module-finite extension we mean that $L$ is finitely-generated as a $K$-module.
My attempt: take $r\in R$ and let $\rho\in L$ be its inverse in the field $L$. I tried to show that $\rho \in R$, since we know that will happen.
By $K\subset L$ a finitely generated extension we mean that there are $l_1,\dots l_n$ in $L$ such that $r\in R$ can written as $r = l_1k_1+\dots+l_n k_n$.
When $r = l_jk_j$ we have $l_j = rk_j^{-1}\in L$, so $\rho = k_j^{-1}l_j^{-1}\in R$. This strategy blowed off really hard when the above equation for $r$ had two or more terms.