Winning battles will increase your Prestige, but defeats will reduce your Prestige. The more troops you lose in battle, the more your Prestige will suffer. 

 
You can also increase your Prestige in the following ways: training troops, building fortifications, demobilizing troops, healing troops wounded in battle, etc. 

 
Construct and upgrade buildings and resource production sites.