Also note that, in the above example, M-x global-text-scale-adjust or C-x C-M-= does affect the font size of the line numbers.

It is as if the line numbers are no longer part of the current buffer when they inherit fixed-pitch.

Thanks
Jake