3 day trip to Sequoia from L.A.

Hello! We are a couple with a 3 year old kid, going to stay 3 days in L.A. before flying to Seattle. I was wondering if it's a good idea to stay 3 more days in L.A. and use them to go see the Sequoias. Please have in mind that we can not do the full trip (3:50h) without stopping, as the kid gets tired of being in the car.

My idea is to drive to Three Rivers one day (any recommendations on the way?), do a guided day visit next day with Sequoia Tours or similar (they pick us up in Three Rivers), seeing the most important and easy landmarks (again, no long hikes with the kid), and then the third day drive back to L.A.

Is it a good idea? Or are we going to miss too much? I am open to any recomendations!