There is also the issue that other factors can keep you tied to a bank. Like having a mortgage there and getting a discount on home owner insurance for it, as well as getting a discount on the mortgage interest for banking with them.
Changing banks is easy when it's just about cash in a savings account. Not so easy in other cases.