Great question! Yes, you will pay more for car insurance if you buy a second vehicle. The increase will depend on what coverage limits you have on the car.
Typically, each vehicle will have a different premium breakdown when you look at your bill. You will be able to see exactly what it costs to insure each vehicle.
Check with your insurance company because many carriers will offer a discount for having more than one car on a policy. Even though you will be paying more overall, you can still get a good deal by shopping around for that discount.