The American manufactured ones are still held to the same strict quality standards as their Japanese counterparts. Made in Japan will always be better, but the American cars seem to do well for Toyota. My 2020 Camry TRD was made in Kentucky and so far for the first 20k miles it has done well. 

Had a 2018 XSE Camry. Was a great car, was US built, didn't see any build quality issues, wish I still had it...And you'll pay more the the ES350 just 'cause of the badge.

At the end of the day it's going to be Toyota quality so built in USA should be and is totally fine. I would say go with the Camry since it will be less expensive to buy and less expensive when it comes to parts and repairs compared to the Lexus. If you plan on buying a used from 2018 or later I would suggest considering brand new too because in this current market with some cars new is more worth it.

Toyota builds good cars in the USA, not as good as the ones in Japan but still good. Between the Camry and Lexus, I would save the cash and buy the Camry XSE, since, from a powertrain perspective, they are almost identical and as they age you will spend less money on repairs with the Camry vs the ES 350. Also, I think the Camry XSE looks cooler than the Lexus ES unless you maybe buy the F sport model which is much more expensive. 

Toyota builds good cars in the USA, not as good as the ones in Japan but still good. Between the Camry and Lexus, I would save the cash and buy the Camry XSE, since, from a powertrain perspective, they are almost identical and as they age you will spend less money on repairs with the Camry vs the ES 350. Also, I think the Camry XSE looks cooler than the Lexus ES unless you maybe buy the F sport model which is much more expensive.