We start working with the Ring $R=\left(\mathbb{Z}/p\mathbb{Z}\right)\left[x\right]/\left(x^{3}-1\right)$, $p$ prime, i.e. degree two polynomials with coefficients modulo $p$ modulo $x^{3}-1$. As $x^{3}-1=\left(x-1\right)\left(x^{2}+x+1\right)$, we choose a subset of $R$, $S\subset R$, and a public value, $z\in\mathbb{Z}/p\mathbb{Z},\ z\neq0$, $P\in S,\ P\equiv-z\left(mod\ x-1\right)$.
We can define the transpose operation of elements of $S$ as swaping the $x$ coefficient with the $x^{2}$one of the corresponding polynomial, so $\left(ax^{2}+bx+c\right)^{T}=bx^{2}+ax+c$.
Now, we define a function $f:S\times S\mapsto S$, as $f\left(A,B\right)=\left(xA^{T}+z\right)\left(xB^{T}+z\right)-zx$. It's null element is $-zx$ and $f$ is a closed map of $S$, so $A,B\in S,\ f\left(A,B\right)\in S$.
Next, we define a series as follows:
$A,B\in S,\ s_{0}=A,\ s_{1}=B,\ s_{n}=f\left(s_{n-2},s_{n-1}\right)$
And for a given element of the series,$s_{n}$, a value $r_{n}=f\left(s_{n},A\right)$
The question is
Taking into account that the function $f$ is not associative, how difficult is, knowing $B$ and $r_{n}$, recover the value of a secret $A$. As an example of sizes let's say $n=256,\ p\sim2^{128}$.
This problem can lead to a cryptosystem described in this two documents:
https://drive.google.com/open?id=1OGnFfooWASVCD1Iw_hVwvHYgqMGGE5nH
https://drive.google.com/open?id=1OeKh_ZJF-i7_KzWFRv8jodk3YkXe2qyv