Exact Tensor Network Ansatz For Strongly Interacting Systems