My in-laws used to live near Brive. Climate, housing and people meet all your requirements, but transport was a right bugger. Spectacular landscape, wonderful views. They had a large 4-bedroom house with multi-car garage, basement with huge workshop + climate-controlled wine cellar, outside kitchen (covered with cookers and bbq), pool with poolhouse and 5 acres of woodland. I think they sold it for about 400k euros.
I believe Cahors has decent air connections. That's not so far away.