Answer
$A^{-1}BA=\left[\begin{array}{c c} 14& 26&-8\\ -3& -7/3&7/3\\ 18& 80/3&-35/3\end{array} \right]$
Work Step by Step
Using a graphing calculator (see attached picture), we get:
$A^{-1}BA=\left[\begin{array}{c c} 14& 26&-8\\ -3& -7/3&7/3\\ 18& 80/3&-35/3\end{array} \right]$