Right, except it isn't a physical object like cash is, it can't be stolen from your person like cash can, and most people keep nearly all of their 'cash' in electronic accounts anyway.
It's not just theft protection though. Bitcoin provides protection from forms of fraud which specifically use mechanisms in a currency or transaction system, like chargebacks on PayPal (a ubiquitous form of fraud), or fake Western Union payments.