Let $O$ be a circle of convergence with center $z_o$ and radius $R = \vert z^*-z_o\vert = 1.$ The goal is to find where the following sums converge inside $O$.
$$A.\:\: \sum\frac{z^n}{n^2}$$
$$B.\:\: \sum\frac{z^n}{n}$$
$$C.\:\: \sum z^n$$ Let $z^*-z_o = z$ be a complex number. For $A$, $$\biggl|\frac{z^n}{n^2}\biggr| = \biggl|\frac{r^n(\cos(n\theta)+i\sin(n\theta))}{n^2}\biggr|\leq\frac{1}{n^2}$$ hence, $$\biggl|\sum\frac{z^n}{n^2}\biggr|\leq\sum\biggl|\frac{z^n}{n^2}\biggr|\leq\sum\frac{1}{n^2}$$ As $n$ approaches $\infty$, the rightmost part of the last inequality converges since this is a sum of infinite geometric series. Hence $A$ converges absolutely for all $|z|\leq1$ and the sum also converges in an ordinary sense. Using the same process, it follows that $C$ converges everywhere inside $O$ except at $z = 1$.
Finally for $B$, two notable cases $z=1$ and $z=-1$ immediately came to my mind,
$$\biggl|\sum\frac{z^n}{n}\biggr|=\sum\frac{1}{n}=1+\frac{1}{2}+\frac{1}{3}...\qquad \text{when}\quad z=1$$
$$\biggl|\sum\frac{z^n}{n}\biggr|=\left|\sum\frac{(-1)^n}{n}\right|=\left|-1+\frac{1}{2}-\frac{1}{3}...\right|\qquad \text{when}\quad z=-1$$ Although absolute convergence don't exist for both sums, the latter will still converge (sum of alternating harmonic series converges) Other than this, I don't know where in $O$ the sum converge absolutely. Luckily in here Determining precisely where $\sum_{n=1}^\infty\frac{z^n}{n}$ converges? ,one user used Dirichlet's test (I'm not so familiar with this probably I'll ask something about this too later.) The most crucial part of his answer is this :$$\left|\sum_{n=1}^Nz^{ n }\right|=\left|\frac{z-z^{N+1}}{1-z}\right|\leq\frac{2}{|1-z|}$$ and concluded that only when $z\neq1$ all the conditions of Dirichlet's Test are satisfied.
But why is it that $$\sum_{n=1}^N z^{n} = \frac{z-z^{N+1}}{1-z}\:\:?$$ If $z$ is a real then it will become the sum of geometric series but is this true for complex numbers as well?
Finally if I apply Dirichlet's test to $A$ using the same process with $B$ done by the user from the link, clearly with ${a_n}=\frac{1}{n^2},\, a_1\geq a_2\geq\cdots$ and $\,\lim_{n\to\infty}a_n=0$. But then again from $B$, $\left|\sum_{n=1}^Nz^{ n }\right|$ is only convergent when $z\neq1$.
To summarize it all, my observations are the following:
So far, we looked for values of $z$ for which the sums are absolutely convergent. If they are absolutely convergent to those values of $z$, then they are convergent in the ordinary sense for those values as well. Absolute convergence implies convergence. However, the converse is not true.
In the case $B$, we saw that if $|z|=1$ may it be $+1,-1$ or even $|z^*-z_o|=1$ like $$ \sqrt\frac{1}{2}+\sqrt\frac{1}{2}i, $$ the sum doesn't converge absolutely. But this does not imply that the series doesn't strictly converge in an ordinary sense for these values except at $z=1$(as demonstrated by Dirichlet's Test).
For my questions:
What happens if there are sums for which absolute convergence don't exist but ordinary convergence exist? How can we determine the values for which they are convergent?
Is $\sum_{n=1}^N z^{n} = \frac{z-z^{N+1}}{1-z}$ true for complex numbers?
Why Dirichlet's Test failed in finding values of $z$ for which $A$ is convergent. That is $z=1$ should be excluded contradictory to $|z|\leq1$ (again absolute convergence implies ordinary convergence).
I apologize for making this too long. These sums were taken from the book Advanced Engineering Mathematics By Kreyzig page 682. IMO, the author did not properly elaborate how these sums converge/diverge nor did he give helpful illustrations. This is hard for me since I don't have proper knowledge about complex analysis/real analysis so I decided to put this here to ease the pain in my head. I expect many errors above and I also hope I will get clear answers from my questions. Thank you for reading.