Assume we have no electronic or mechanical device that assists us in doing the calculations and we are short of time and paper so that we want to avoid excessive calculations by pencil and paper and our mental arithmetic skills are rather limited than I would propose the following way to calculate the value:
$$(k-1)^4+k^4+(k+1)^4=3k^4+2 {4\choose 2}k^2+2=3k^4+12k^2+2=:f(k)$$
Then
$$\sum_{k=-3}^{10} k^4\\=2\sum_{k=1}^{3}k^4+\sum_{k=4}^{6}k^4+\sum_{k=7}^{9}k^4+10^4\\
=2f(2)+f(5)+f(8)+10000$$
For the following calculation note that $5^4=25^2$ can be easily calculated, because
of the well known trick that to square a number with the decimal representation $(a5)_{10}$ we calculate $a(a+1)$ and append the digits $25$ on the resulting decimal number. So to calculate $25^2$ we calculate $2\cdot3=6$ and append $25$ to $6$ and get $625$. We also need $2^{12}$ which is also simple because $2^{12}=2^2\cdot 2^{10}=4\cdot1024$ and $1024$ should be be known at least if one has attended a course in computer science.
$$
=2(3\cdot16+12\cdot4+2)+(3\cdot625+12\cdot25+2)+(3\cdot4096+12\cdot64+2)\\
=3(32+625+4096)+12(8+25+64)+8+10000\\
=(4653\cdot3+12\cdot 97+8+10000)\\
=13959+12(100-3)+10008\\
=23967+1200-36\\
=25131$$
To get the requested number we have to multiply this by $2$, but this is left to the reader.