Others have already answered, but perhaps it would be useful to have at least one of the answers target the elementary calculus level.
Recall the 3-part definition of "$f(x)$ is continuous at $x=a$" from elementary calculus:
1. $\;f(a)$ is defined
2. $\;\lim\limits_{x \rightarrow a}f(x)$ exists
3. $\;\lim\limits_{x \rightarrow a}f(x) = f(a)$
Suppose the #2 holds and let's consider the possibilities.
If #1 also holds, then either #3 holds or #3 doesn't hold. If #3 holds, then the function is continuous at $x=a.$ If #3 doesn't hold, then the function is not continuous at $x=a,$ but the failure is simply due to the fact that "we picked the wrong value" in defining $f(a).$ [The "wrong value" could arise from a formula or from a piecewise definition format.] In this second case, if we simply change the function in a very trivial way by defining $f(a)$ to be whatever number $\;\lim\limits_{x \rightarrow a}f(x)$ is, then we can turn the function into a continuous function. Another way of looking at it is, thinking of a function as a certain collection of ordered pairs, if we replace the single ordered pair $(a,\,f(a))$ with the ordered pair $\left(a, \; \lim\limits_{x \rightarrow a}f(x)\,\right),$ then the result will be a continuous function. This is not what you're asking about, but it's closely related. You'll sometimes hear things like "redefine the function at a certain point so that it becomes continuous" to describe this process.
Now suppose #1 doesn't hold. Then, of course, there is no chance for #3 to hold. However, still assuming that #2 holds, then all we have to do to get all three conditions to hold is to define the function $f(x)$ so that, when $x=a,$ the value is $\lim\limits_{x \rightarrow a}f(x).$ This is an example of what is meant by a continuous extension. There are other ways a function can be a continuous extension, but probably the most basic way (and likely about the only way you'll see in elementary calculus) is that you have a function that is not defined at some point (maybe more than one point), but the limit of the function exists at that point(s), so if you simply define (like how you define a piecewise defined function) the function to be whatever its limit is at that point(s), then you'll get a continuous function, and this continuous function is called a continuous extension of the original function.
To find examples and explanations on the internet at the elementary calculus level, try googling the phrase "continuous extension" (or variations of it, such as "extension by continuity") simultaneously with the phrase "ap calculus". The reason for using "ap calculus" instead of just "calculus" is to ensure that advanced stuff is filtered out. The word "calculus" is often used for some really advanced topics that have little relation to what's in an elementary calculus course, but "ap calculus" is pretty specific to elementary calculus content.