Is there a way I can still use attributes yet escape these unsavory characters? What's the most efficient way of solving this?

You need to escape the ampersand as &, the double quote as ", the less-than as < and the greater-than as >.
Use an API that does the escaping for you, for instance with the .NET framework there is XmlWriter.