You don’t need to use .kopiaignore files - instead you can define policies at all those directories that exclude specific files in them:
$ kopia policy set --add-ignore '*' ~/Downloads /tmp
Setting policy for jarek@jareks-mbp:/Users/jarek/Downloads
- adding "*" to "ignore rules"
Setting policy for jarek@jareks-mbp:/tmp
- adding "*" to "ignore rules"