Git config : Can I use different pagers for different commands?

Question

I am happy with Git bash as is, and with less as a pager.

But I want to see line numbers only in some cases (option -N to less in the case of show or other commands that will show file contents), and otherwise use the same other options to less in all cases.

Is this possible in a simple way ?