I was trying to make sense of the Limit of a Composite function and (through stack exchange) found that: If $\lim_{u\to b} f(u) = c$ and $\lim_{x\to a} g(x) = b$, then $\lim_{x\to a} f(g(x)) = c$, as long as f(x) is continuous at b. This, I can make sense of.
However, looking at the proof given on ProofWiki (https://proofwiki.org/wiki/Limit_of_Composite_Function), it is stated that this condition of continuity does not need to be met as long as "for some open interval $I$ containing $\xi$, it is true that $g(x)\neq \eta$ for any $x\in I$ except possibly $x=\xi$" where "$\xi$" refers to "$a$" and "$\eta$" refers to "$b$" above.
Why is this the case? I understand that this is necessary for the proof and for the result to hold, but can anyone offer an explanation as to why satisfying this condition ensures that the result holds in a more conceptual/general sense? There is likely some aspect of limits of composite functions that I'm failing to picture here. I can't pin-point it, but maybe it has to do with the limit with $g(x) \to b$ approaching from above or below?