$Y$ is known as the Hadamard product of $A$ and $B$, and there is no simple way to find it from $A$ and $B$ in general. (If you don't believe me, set $A = B = e^x$.) The closest thing I know to a formula is (with all the analytic caveats that makes everything converge)
$$Y(r) = \frac{1}{2\pi } \int_0^{2\pi} A(e^{i \theta}) B(re^{-i \theta}) d \theta$$
which follows by Parseval's theorem. If $A$ and $B$ are sufficiently simple (for example if they are rational functions) then it is possible to evaluate this integral, but in general there's not much you can do; $Y$ can be much more complicated than $A$ or $B$. (Another idea is to write the above as a contour integral, and if the integrand ends up being meromorphic you can try to use the residue theorem.)
Computing Hadamard products is a special case of computing the diagonal of a two-variable generating function, a problem which I describe with a few examples here using the residue theorem.
(Of course for very special $A$ it is possible to say more, e.g. when $a_k$ is a polynomial in $k$.)