You can select the cursor shape of a profile in Windows Terminal to be Vintage, Bar (default), Underscore, Double underscore, Filled box, or Empty box.
If you select the Vintage cursor, you can set its height from 25 to 100 percent.
This tutorial will show you how to cursor shape of Windows Terminal profiles for your account in Windows 10.