The Multiple Matches Problem This post is just focused on one question. If a scientific procedure finds multiple matches, when it should only find one match, is that a good thing?
For instance, let’s say we have an existing DNA testing procedure, Procedure A, that collects DNA from a crime scene, and compares it to a database of DNA of suspected criminals and looks for a match. And this procedure has proven good. Now, there is a new proposed Procedure B, that would be half as expensive. So, to test it, we take the DNA from known crime samples, each of which only contained DNA from one man (as proven by Procedure A) and try Procedure B on it. Procedure B may report:
Scenario 1: Only one match found, of a Mr. Jones.
Scenario 2: Two matches found, of a Mr. Jones and a Mr. Smith.
With this information alone, which scenario would bolster Procedure B best?
Clearly, it is scenario 1. Of course, to be fully bolster, we would have to check to see if Mr. Jones was the same match found when Procedure A was used.
But if it turned out that scenario 2 is what played out, that is bad for Procedure B. One of those results has to be false. We must have at least one false positive. And that is bad.
And if we had not 2 matches but 10 matches, that would be very bad. It would mean, if this was the typical result over many test samples, at least 9 in 10 of all matches are false positive. Maybe 10 of 10. Switching to Procedure B would clearly be unacceptable.
Clearly getting multiple matches is bad, because we have discovered that the proposed procedure generates false positives. That is never good.
We have essentially the same problem with the BBN tests of 1978. Looking at BBN’s Exhibit F-367, if we use the standard that 0.6 is good enough to be considered a match, then the results for the sound impulse at 145.15, we get a match for the following shots:
Test | Beginning Time of | Zap. | Zap. | Microphone Array | Rifle | Target | Correlation | Strong | Fluke |
ID | First impulse on | Frame | Frame | and | Location | Location | Coefficient** |
| Tape Segments (sec) | BBN | Thomas | (Channel Numbers) |
|
L | 145.15 | 304 | 313 | 3 ( 4 ) | KNOLL | 3 | 0.8 | Strong |
M | 145.15 | 304 | 313 | 3 ( 7 ) | TSBD* | 4 | 0.7 | | Fluke |
N | 145.15 | 304 | 313 | 3 ( 8 ) | TSBD | 2 | 0.7 | | Fluke |
|
So, we learn from this, that at 145.15, timed to the nearest one hundredth of a second, there was a shot from the Grassy Knoll and a shot from the TSBD. Actually, it appears there were three shots, two shots from the TSBD aimed at Target 2 and Target 4 and one shot from the Grassy Knoll fired at Target 3.
This is bad. We have at least two false positives. It means that there is at least a 2 in 3 chance that an acoustic match is a false positive.
Questions for Mr. Griffith, or anyone else:
Question 1:
Why would find a match for a shot at 145.15 for:
A shot from the Grassy Knoll at Target 3, recorded near 3 ( 4 )
A shot from the TSBD at Target 4, recorded near 3 ( 7 )
A shot from the TSBD at Target 2, recorded near 3 ( 8 )
Be considered a superior result to only finding one match:
A shot from the Grassy Knoll at Target 3, recorded near 3 ( 4 )
Question 2:
Is finding multiple matches a good thing or a bad thing, when looking for matches? For both DNA and Acoustic tests on just one shot?
Question 3:
Do you deny that the BBN’s Exhibit F-367 generated false positives?
Question 4:
Is the correlation coefficient for the shot at 140.32 of 6 an honest result? Or did Robert Blakey pressure Dr. Barger to falsify the data that he reported to the BBN?
Question 5:
If Dr. Barger did not falsify his data, why shouldn’t the low correlation coefficient disqualify the shot at 140.32? And indeed, there are many other several problems with the BBN data. I just used the sound impulse at 145.15 as one example.
Now, to be fair, most of these problems disappear if one demands a higher standard. If one says a correlation coefficient of 0.6, or even 0.7 is not good enough to be considered a match. But then we have to throw out the alleged fifth shot of Dr. Thomas because we have to be logically consistent. We can’t say a correlation coefficient of 0.6 is considered good enough to consider 140.32 to be Dr. Thomas’s fifth shot, while at the same time the stronger correlation coefficient of 0.7 to be considered
not good enough for the shot 145.15.
And, I should stress, that adopting the strict 0.8 standard causes most “Multiple Matches” problems to disappear, but not all of them. That still leaves us with 6 matches for the 4 shots and so at least two of them have to be false positives.
Will Mr. Griffith dodge these 5 simple questions? Stay tuned to find out.