The fact that the transactions are public is a separate issue vs. whether they are anonymous.

The reason people think Bitcoin is anonymous is because they think that identities cannot be linked to the addresses involved in the public transactions.