On a Mac there are key combos for many diacritical marks, but since you--like me--are on a Windows machine, the best I have found is to copy paste from Windows's Character Map utility, although I figure there are probably easier ways.

Take a look at PopChar for Windows. https://www.ergonis.com/products/popcharwin/

You can also do it from the text menu (NOT the lyrics menu) with Insert > Symbol...

Thank you both. I'm using the character map accessed from run/charmap and it's working pretty well. I'll check out PopChar later. 

On Windows 11:

Win + '.' (Period)

Go to Symbols Tab (5th from Left, Second from Right).  It looks like various symbol icons in 2x2 grid.

Go to "Latin Symbols" Tab

Select the character you want to insert.  When you click it, it is inserted into the document at current cursor position.

Voilá ;-)

This is the preferred method of doing this since Windows 10 (IIRC).  Won't work on earlier versions of Windows (definitely not Windows 7).  It's faster than accessing them via the Character Map utility.