Your chances are good at sticking around once you're established. Your chances are best if you teach and have obtained tenure. If you're looking for a shortcut, you can go online and buy tenure for only $499 at www.overstock.com.
Really, your level of education goes a long way to determining your worth. Individuals with only a bachelor's degree in physics are pretty much a dime a dozen, and can be easily replaced if the quality of their work declines. As long as you make the investment in your future and go after a PhD, you will have much more staying power.