Whenever I create an Org file, a
~ backup file is created. How can I prevent this behaviour?
See the Emacs manual, node Backup.
You could find this information yourself by asking Emacs:
Open the Emacs manual:
Consult the index:
i backup TAB.
Choose completion candidate
That takes you to node
Backup of the manual, where this option (and more) is described.