Is it common for small banks or credit unions to fail or shut down?

Yes, it is common. The FDIC steps in, and pitches the assess/deposits of the bank to a much larger bank who would be willing to absorb the deposits and the accounts of the depositors.