There is no doubt you will pick a fault somewhere - when I move a pick up knobs and a jack between basses, there is a difference.
If I change the neck on the bass between wood and graphite, there is a difference all else being the same.
No doubt you’ll trot out I’d have screwed it differently or the strings are 3 hours older and been restrung so they sound different blah blah blah.....
There will be a a difference between species, within each species there will be a difference depending on growing conditions etc. How they piece together you are correct is another variable. It’s a spectrum with overlap.
It’s 2 separate questions being merged for the sake of point proving.
Is there a difference - yes, even the most ardent would not disagree - this is an absolute
Does it make a noticeable difference - possibly but not to everyone.
Does it play and sound how you like - if it’s no, is that because it’s rubbish or because there is a certain combination of things/tonewoods that you consistently don’t like - if that’s the case then it does make a difference