I love many things about Emacs, but its movement system (and key bindings) isn't one of them. It's just not for me.
I would like to remove all Emacs key bindings, including ones by external modes, and redefine them with a tool such as General as I go along.
I would also like to keep my evil bindings, so I can basically use Emacs with Vim key bindings.
I found this question, but it doesn't answer this scenario in full.