You don’t need to remove anything. Emacs has a system called Autoloading that has a list of functions and what file they are defined in, and only loads the file when the function is called. This means that most of the functions you see in that list are things that are not yet fully loaded. They will only be fully loaded the first time you use them.
This may help.
If on Windows, change package-gnupghome-dir to use /c/ instead of c:/
Run gpg to get the new public key (if on Windows, in MingW64 shell)
$ gpg --homedir /c/Users/micha/AppData/Roaming/.emacs.d/elpa/gnupg --receive-keys 066DAFCB81E42C40
gpg: /c/Users/micha/AppData/Roaming/.emacs.d/elpa/gnupg/trustdb.gpg: trustdb created
gpg: key ...