On the default (sterile light) theme, the search bar disappears when you browse the albums how do you make the search bar consistent across all pages?

Modify the theme to include it on the other pages.

Is it in the theme options or am i going to have modify the css style template?

Neither, you have to modify the theme files. Please see the theming tutorial.