I had the same problem and I fixed it changing the "q" keybinding in magit-mode-map to run (magit-mode-bury-buffer t), which kills the buffer when burying it

To test it within the current session:

(define-key magit-mode-map 
   (kbd "q") 
   (lambda() (interactive) (magit-mode-bury-buffer t)))

You can add it to your startup config with use-package

(use-package magit
   :ensure t
   :config (define-key magit-mode-map 
             (kbd "q") 
             (lambda() (interactive) (magit-mode-bury-buffer t)))
   

I had the same problem and I fixed it changing the "q" keybinding in magit-mode-map to run (magit-mode-bury-buffer t), which kills the buffer when burying it

To test it within the current session:

(define-key magit-mode-map 
   (kbd "q") 
   (lambda() (interactive) (magit-mode-bury-buffer t)))

You can add it to your startup config with use-package

(use-package magit
   :ensure t
   :config (define-key magit-mode-map 
             (kbd "q") 
             (lambda() (interactive) (magit-mode-bury-buffer t))))