You want an associative magic square. The "up one and right obe" method gives you that, but to get a correct associative square you also need to fill the elements in a different order.
Rules for an associative square:
The central element is 13, which is the average of all the elements.
Every pair of elements that has the center as the midpoint should add up to twice this average, meaning 26. For instance, in a solution I derived (which I will not give directly because I expect it to be downvoted and deleted, based on the question history), I have 1 on the far right of the third row. Then on the far left of that row so the 13 in the center is the midpoint, I must render 26-1=25.
With these rules in mind:
Start with the center element 13 and fill in the remaining odd numbers first, bearing in mind that 1 has to be opposite 25, 3 opposite 23, etc, with 13 as the midpoint between these pairs.
Avoid having the middle three elements of columns 2 and 4, and the middle three elements of rows 2 and 4, add up to 39. If the square is to follow the associativity rules, you can't have the remaining two elements add up to 26 in any row or column except the third one that has 13 in the center.
Once you're satisfied with the odd elements, fill in even elements in column 2 that will make it add up to 65, then put even elements in column 4 to satisfy rule 2 and keep the square associative. Do the same with rows 2 and 4.
If all goes well, you should then be able to handle the four corner squares with no further problems. Maybe you'll still need multiple trials, I don't know because on my first attempt following this procedure I succeeded.
Good luck!