Performance issues using go-eldoc

Question

The Problem

Performance issues when point is inside/on a symbol go-eldoc/gocode has info for.

Based on my interaction with emacs I would guess that the problem has something to do with gocode being queried on the main thread, and taking to long to respond. Is this correct thinking? Is there something wrong with my configuration?

The Environment

Using https://github.com/syohex/emacs-go-eldoc with

go get -u github.com/stamblerre/gocode https://github.com/stamblerre/gocode

as the gocode implementation on my machine for the module support

Using use-package https://github.com/jwiegley/use-package to load it

(use-package go-mode
  :defer 2
  :mode "\\.go\\'")

(use-package go-eldoc
  :defer 2
  :hook (go-mode . go-eldoc-setup))

Part of the problem seems that the gocode version I am using is slow, but it still should not hang/lag while moving around or typing.