Since getting my new laptop I have needed to press " twice to get a double quote displayed - very frustrating.  Today I decided to solve this problem so here goes... 

NB: My new laptop is Windows 11 which makes a difference to the instructions.  So best of luck ...

Search for Settings > Time and language > Language & region .. working with

:: English (Australia) click on ... (to select Language options)
Scroll down to find Installed keyboard and [Add a keyboard] and you are looking for US Qwerty
then REMOVE others (in particular "United States-International")

Now restart your computer and you will (hopefully) find all key functioning correctly.