Atleast once your tax office wants some details, using an exchange without KYC requirements could net you some trouble. Doesn't really fix that Bitcoin is at best pseudonymous, not anonymous. If any of your addresses is linked to your bank account, then your identity is linked to your wallet.