consider reference implementation as a backend?

[yhmtsai]

current reference implementation is not in backend.
Some implementations seem to be unnecessary to other backend for example lookup in scaled view.
I think considering the reference as a backend and only keeping the shared conceptual part out of backend should be a good way