Edit or remove the default signature
Should have the ability to change or remove the "Sent from OWA for Android" signature tag that is pre-populated when composing new messages.
On the phone open the OWA app, open up the folders (three horizontal lines) and click on the tool gear icon on the right and then select "Options" and then "Email Signature". You can then edit it there. Took me a while to find it.