Go to settings -> personalization -> taskbar. There are many different options for the display of the taskbar on multiple monitor setups.
Edit: I misunderstood and windows is dumb. You can only have the taskbar on your main display or all displays. You can make your second monitor the main display to have your taskbar appear there.