Andre Edwards, 50 - who was born a man and was known as Andrew - said her bosses and passengers could not cope with her bizarre lifestyle.
She said: "It's not easy when people shout things at you and call you vile names."
Before ... as Andrew
Manchester Evening News Syndication
But yesterday bosses insisted Andre was fired after customers complained about HER "bad attitude" - and for upsetting staff by criticising their appearance.
Andre is undergoing "gender re-alignment" after getting hormone replacement pills on the internet, but hopes to have a sex change operation next year.
She has already had electrolysis to get rid of facial hair.
She said: "When I went for the job I explained about the gender issues and they said, 'As long as you can drive, we don't care'.
"It was a real boost for me because acceptance breeds confidence. This time last year I wouldn't have dreamt of wearing bright nail polish or anything like that.
Complaints ... taxi business
"But when I started I was ostracised by some of the other drivers.
"Most people were fine but there were always whispers and some people wouldn't talk to me."
However Phil Briggs, owner of Leyland Taxis in Leyland, Lancs, said they had received "a great deal" of complaints about Andre.
He said: "My philosophy is that you have to give someone a chance. But we had to let her go.
"She upset a number of staff with comments about their weight and I had customers say that her attitude towards the public was appalling."
One worker said Andre called her haircut "dreadful".
Mr Briggs added: "It has nothing to do with appearance or lifestyle."