Regarding the first question:
A and B are married. They have two kids. One of them is a girl. What
is the probability that the other kid is also a girl?
This is a classical problem in probability. What makes this question confusing is the fact that the question is ambiguous since there may be no such thing as "the other kid".
Suppose a couple has two children, call then $\mathcal{X}$ and $\mathcal{Y}$. When you say "one of them is a girl" two possible interpretations are:
#1 Someone told me the couple has at least one girl but I don't know if both children are girls, if $\mathcal{X}$ is a girl, or if $\mathcal{Y}$ is a girl; the possible cases are GG, GB, BG. I want to compute the probability that both of the couple's children are girls (GG).
or
#2 Someone told me $\mathcal{X}$ is a girl but I don't know if $\mathcal{Y}$ is a boy or a girl; the possible cases are GG, GB. I want to compute the probability that $\mathcal{Y}$ is also a girl (GG).
Now, you can answer each of these questions using, for example, expressions for conditional probabilities (the answers to interpretations #1 and #2 are 1/3 and 1/2, respectively). However, if you are left with a feeling of "sure, I see how you can obtain that result but why isn't my answer correct?" read on.
Interpretation #1:
(This is the one I find interestingly confusing.)
When you first think about the problem you might use the following (incorrect) reasoning:
I know at least one of the children is a girl, what is the probability
that the other child (the child of unknown gender) is also a girl? well,
shouldn't it be 1/2? I mean, the other child can be a boy or a girl
regardless... right?
One of the problems with this reasoning is that there is no such thing as "the child of unknown gender" (therefore, there is no such thing as "the other child"). In fact, you do not know either of the children's genders (in this interpretation both children have unknown gender!). All you know is that there is a girl in there somewhere, but you do not know which of the two children is the girl. How can you hope to compute the probability that the other child (the child of unknown gender) is a girl if there is no such thing as "the child of unknown gender"? In fact, if you happen to know that $\mathcal{X}$ (or $\mathcal{Y}$) is a girl then you are using a different interpretation of the question (interpretation #2).
The other problem with this reasoning is related to independence. As people have pointed out, given the added overarching assumption that there is at least one girl, "$\mathcal{X}$'s gender" and "$\mathcal{Y}$'s gender" are not independent random variables. This is easy to see since, for example, if $\mathcal{X}$ is a boy then $\mathcal{Y}$ is forced to be a girl with probability 1 (not 1/2). This lack of independence is the reason why you can't say that one of the two children is a boy or girl independently/regardless of the other.
Formal Derivation of Answer to Interpretation #1:
Using the formula for conditional probabilities we have
\begin{align*}
P\big(\text{Both are Girls } \big| \text{ At Least One Girl}\big)&=\frac{P\Big(\big(\text{Both are Girls}\big)\cap\big(\text{At Least One Girl}\big)\Big)}{P\big(\text{At Least One Girl}\big)}\\
&=\frac{P\big(\text{Both are Girls}\big)}{P\big(\text{At Least One Girl}\big)}\\
&= \frac{1/4}{3/4}=\frac{1}{3}.
\end{align*}
Interpretation #2:
I don't think there is anything confusing about this interpretation. You know the $\mathcal{X}$ is a girl and $\mathcal{Y}$ can be a girl or a boy independently of $\mathcal{X}$. In this case, the random variables "$\mathcal{X}$'s gender" and "$\mathcal{Y}$'s gender" are not linked by any added overarching assumption and are independent.
Formal Derivation of Answer to Interpretation #2:
Using the independence of the second child's gender relative to the first child's gender:
\begin{align*}
P\big(\text{Second is a Girl } \big| {\text{ First is a Girl}}\big)=P\big(\text{Second is a Girl}\big)=\frac{1}{2}.
\end{align*}
Regarding the second question:
Now A and B have 4 children and all of them are boys. B is pregnant.
So what is the probability that A and B are gifted with a baby girl?
Is it 1/2 or there will be some conditional probability?
The answer is that the next child's gender is independent of the first four children's genders (by assumption), this is because there is no added overarching assumption involving the next child. The answer is then simply $1/2$. (This is just like in Interpretation #2.)