I have seen in different old posts on this site that $X:= \mathbf{A}^1(k) \backslash \{ 0 \}$ is an algebraic set. They give a polynomial map $ V(xy-1) \to X $ by defining $(t,1/t) \mapsto t$, and then they claim that this is an isomorphism. However, the inverse is not a $\textbf{polynomial}$ map. I am not sure about the reasoning after the claim.
However, I actually think that $X$ is not an algebraic set if $k$ is infinite. My question is to check if the following reasoning is right.
Assume the contrary. Note that $X$ is homeomorphic to $X \times \{ 0\}$, thus $X$ is algebraic in $\mathbf{A}^1(k)$ iff $W:= X \times \{0\}$ is algebraic in $\mathbf{A}^2(k)$. Thus by assumption $W = V(f_1,...,f_t)$.
Note that $V(f_1,...,f_t)\cap V(y)$ is an infinite set (namely equal to $W$; $k$ is infinite). Notice that actually $(a,b) \in V(f_1,...,f_t)\cap V(y)$ iff $b = 0$ and $a$ is zero of all the $f_i(x,y)$'s. This can be equivalently stated as looking at zeros of $f_i(x,0)$, because $y$ has to be zero. However, $k[x]$ is a domain so any $\textbf{non-zero}$ polynomial has finitely many zeros, in particular the cardinality of $V(f_1,...,f_t) \cap V(y)$ should be finite. This is can only be the case if $y \mid f_i$ for all $i$, but then $(0,0) \in V(f_1,...,f_t) = W$. This is a contradiction. So $W$ is not algebraic and therefore $X$ cannot be algebraic.