Yes, you should try to use the one-time boot menu if available (it usually is) or in UEFI settings use the boot override for the external media. If in any case you find two entries for the same stick then you should choose the one with "UEFI" in the its name.

PS - You don't have BIOS, that's a thing from the past (1981 to be precise). All computers's firmware from the last decade is UEFI, not BIOS.