automatically include subfolder of org files?

Question

My team is using a big single org-mode file to manage our research notes but some people are complaining that the file is getting too big too manage and the git conflicts are becoming a pain.

The docs say to use links to manage multiple .org files, like a wiki, but that also suffers from the git conflict problem (now when two people add a file, their link suffers the conflict) plus it's a massive pain to maintain the links.

Is there a way to automatically include a subfolder of .org files in a main file, or (as a fallback) automatically generate the table of files to include? Order is not important but I suppose lexicographic ordering of the filenames would be useful.

Ideally, I'd like to be able to compile out the entire document to one readable HTML page so links out to separate documents is very much sub-optimal.

Answer 1

Babel can generate Org code. Try evaluating a Babel block on export that generates the +#INCLUDE: statements for you.

#+BEGIN_SRC sh :results raw drawer
for f in $(find /path/to/files/ -name "*.org"); do
    echo "#+INCLUDE: " $f
done
#+END_SRC

Generates:

#+RESULTS:
:RESULTS:
#+INCLUDE:  /path/to/files/A.org
#+INCLUDE:  /path/to/files/Bsubdir/foo.org
#+INCLUDE:  /path/to/files/C.org
:END:

Answer 2

It seems like including other files could be what you want. It is a way to include other files in an org-file (could be other org-files or other file types), but when exporting it will all be exported as a single document.