Answer
Teminal voltage of battery will increase.
Work Step by Step
When the load resistance will be increased, current will decrease and also value of $Ir$ will decrease.
Since terminal voltage is given as
$V_t = \epsilon - Ir$
when $Ir$ will decrease with $\epsilon$ constant, value of $V_t $ will increase