With a manual transmition it seems to tick off all of our boxes. It's light, reliable, fun to drive and can be flat towed.
We used to tow a Outback manual, until we drove it a few times in Houston "rush hour" >:( traffic. It was gone pretty quickly.
Won't own a SUV auto trans even if towable 4 down. Subaru is a good choice. While most all SUV are available with diesels and manual transmissions, very few are now imported to the U.S. We love our RAV4 for your reasons but 2005 was the last year imported with manual trans. Unfortunate.
Pierce
We tow 2013 Outback over 2 years now- does great. I like having the higher ground clearance-it is better on rougher roads, campgrounds etc. Also easier to get in and out of as we get older. If it holds all the stuff you want, feels good for you, then do it.