That is true, but not the whole story. Johnson had no more love for the North (or frankly, for the USA as a constitutional entity) than most of the other southerners, but he hated the plantation owners in western Tennessee and the political upper class in Nashville even more. He certainly had no interest in ending slavery except as a way to stick it to the rich folks, and when it came time for pardons after the war, his only goal was to make the wealthy grovel for them; he didn’t really object to former Confederates resuming their places of privilege as long as they sucked up to him for once.
While his impeachment proceedings were, to be fair, pretty much trumped up charges, he was by most accounts pretty much a drunken wreck in the last year or so of his presidency, and while probably no one could have co-existed with that Republican Congress after Lincoln’s death, Johnson was singularly ill-equipped to do so.
Whether his botching of Reconstruction is worse than Jackson’s near-genocide of Native Americans is perhaps a worthy argument, though I tend to find Johnson overall much less horrible than Jackson, all things considered, even though Jackson was quite smart, had very coherent if often (to me) rather objectionable constitutional views, and at the very least was virulently opposed to disunion as well.