The formulas in parts (a) and (b) define linear transformations on the vector space $P_2$ of polynomials of degree at most 2. The question is asking you to write down a matrix representation of these linear transformations. However, the question is incomplete as stated: to write down the matrix that represents a linear transformation, you need to know bases of both the domain and codomain of the linear transformation.
In this case, your instructor probably intends for you to use the standard basis $\left\{1, x, x^2\right\}$ (for both the domain and the codomain, which in this case are identical).
Now, to determine the matrix that represents $S$ in part (a), for example, all you need to do is determine how $S$ acts on the basis elements. Note that $S(1)=1$, $S(x)=2x+2$, and $S(x^2)=(2x+2)^2=4x^2+8x+4$. You ought to be able to use this information to write down the matrix representation of $S$ with respect to the standard basis.