"Set intersection corresponds to conjunction" can be made precise as follows: For any one-place properties $P_0$, $P_1$, and $P_2$ and sets $S_0$, $S_1$, and $S_2$ such that $P_i$ has extension $S_i$, $S_2 = S_0 \cap S_1$ if and only if $\forall x, P_2(x) \leftrightarrow P_0(x) \land P_1(x)$; and similarly for union and disjunction.
In the same way, as you suggest, "$S_1 \subset S_0$" corresponds to "$\forall x, P_1(x) \rightarrow P_0(x)$". Then, for any one-place properties $P_0$ and $P_1$ with extensions $S_0$ and $S_1$, $S_1 \in \mathcal{P}(S_0)$ if and only if $\forall x, P_1(x) \rightarrow P_0(x)$. This is a correspondence between a set-theoretic and a logical statement, but not the same kind of correspondence as the earlier ones, since the set-theoretic statement is "$S_1 \in \mathcal{P}(S_0)$" not "$S_1 = \mathcal{P}(S_0)$".
You could also say that $\mathcal{P}(S_0)$ corresponds to the class of one-place properties $P$ such that $\forall x, P(x) \rightarrow P_0(x)$. Again, this is not the same kind of correspondence as the earlier ones.
To get a correspondence of the earlier kind, you have to allow quantification over properties. Then you might be able to say something like "'$S_1 = \mathcal{P}(S_0)$' corresponds to '$\forall P, P_1(P) \leftrightarrow (\forall x, P(x) \rightarrow P_0(x))$'". You probably shouldn't try saying anything like that though unless you've gone deeper into logic than Epps will take you (and certainly deeper than I've gone).
More broadly, the case of power sets is different from that of conjunction and disjunction because it involves explicitly forming a set of sets; but whereas forming sets of sets is possible in the simplest forms of set theory, forming properties of properties is not possible in the simplest forms of mathematical logic.