The role of experience in hypothesis verification phase of diagnosis

John Brush jebrush at ME.COM
Tue Jun 26 18:29:43 UTC 2018


Exactly.
The whole point of a Bayesian approach is that you have to account for both the base rate of a diagnosis and the strength of new evidence supporting or refuting that diagnosis.
John

John E. Brush, Jr., M.D., FACC
Professor of Medicine
Eastern Virginia Medical School
Sentara Cardiology Specialists
844 Kempsville Road, Suite 204
Norfolk, VA 23502
757-261-0700
Cell: 757-477-1990
jebrush at me.com




On Jun 26, 2018, at 2:06 PM, Sittig, Dean F <Dean.F.Sittig at UTH.TMC.EDU> wrote:

The power of the Bayesian method is in helping put the evidence into context. If we would take your example say of a positive pregnancy test which I would venture carries a likelihood ratio of 10 or more. If your patient and the purported source of the sample is a male then the a priori probability of a positive pregnancy test is zero. Therefore using bayes’ formula one should treat the positive pregnancy result as most likely an error rather than the first case of male pregnancy in the history of mankind. 

Dean
Sent from my iPhone

On Jun 26, 2018, at 10:34 AM, Jain, Bimal P.,M.D. <BJAIN at PARTNERS.ORG <mailto:BJAIN at PARTNERS.ORG>> wrote:

> Thanks Dr. Elias for your comments.
> I agree in general with your description of the diagnostic process in an office setting.
> The point I am making in my hypothesis verification paper is that if a highly informative test result with likelihood ratio greater  than 10 is observed in a patient, then the definitive diagnosis of a disease in this patient is validated by our experience of the accuracy of this diagnosis in practically every patient seen by us regardless of prior probability.
> For example, if we suspect hypothyroidism  in a patient with fatigue seen in office and find elevated TSH, the definitive diagnosis of hypothyroidism would be validated by our experience of the accuracy of this diagnosis in other patients regardless of prior probability seen by us in the past.
> I would like to point out the correct technical meaning of the term ‘likely’ employed in your opening sentence by substituting ‘disease’ for ‘hypothesis’ and ‘test result’ for evidence.
> The likelihood of a disease given a test result is proportional to the probability of a test result given the disease.
> For example, the likelihood of acute MI given acute EKG changes is proportional to the probability of acute EKG changes given acute MI.
> Thus it is customary to speak of how likely acute MI is, given acute EKG changes.
> As far as I know, the term likely or likelihood is not used to refer to frequency of a test result given a disease.
> The correct term would be probability of test result given a disease.
> In Bayesian analysis, we are assessing probability of a disease given the test result.
> The likelihood of a disease given the test result is known to us which is employed as part of likelihood ratio in Bayesian analysis.
>  
> Bimal
>  
> From: Elias Peter [mailto:pheski69 at GMAIL.COM <mailto:pheski69 at GMAIL.COM>] 
> Sent: Wednesday, June 20, 2018 9:07 PM
> To: IMPROVEDX at LIST.IMPROVEDIAGNOSIS.ORG <mailto:IMPROVEDX at LIST.IMPROVEDIAGNOSIS.ORG>
> Subject: Re: [IMPROVEDX] The role of experience in hypothesis verification phase of diagnosis
>  
>         External Email - Use Caution        
> 
> I have several comments to make.
>  
> First, I see Bayesian assessments as telling us how likely it would be for that evidence given a hypothesis, not how likely the hypothesis is given the evidence. A recent article offered a wonderful analogy I wish I had heard years ago: given a dog (test result) we can be pretty certain there are four legs (the evidence), but given four legs (the evidence) we need much more information to know if we are dealing with a dog, camel, or turtle.
>  
> Second, I think it is a mistake - or at least, too narrow a framing - to see diagnosis as an event rather than a process. This may reflect my 40 years in primary care, as I have noticed during my career that clinicians who work in settings like intensive care units or acute trauma centers have a very different process when caring for undiagnosed patients. In primary care (and in many specialties that deal mostly with chronic illness) it is often that one is best and most efficient making a diagnosis over time rather than during a single encounter. In this setting, it is unusual to be in the position of having a patient with a clinical snapshot (I don’t say picture, because it really IS a snapshot, obtained relatively quickly and in a limited context) and then having to make a diagnosis based on a test result. 
>  
> Third, at least in primary care, a very substantial number of diagnoses are made by a clinical picture over time (natural history). We don’t have a diagnostic ‘test’ for anxiety, depression, most of the causes of low back pain, most of the causes of headache, most of the causes of fatigue…   In these settings the process is something like this:
> Are there any things I can’t miss, right now, in this visit, without putting the patient at immediate risk?
> If so, what can I do to determine their presence or absence.
> If not, how do I remember this list and refer back to it if the picture changes?
> What are the most likely causes of what I am seeing and hearing?
> Are there any likely causes of what I am seeing and hearing that I can easily and efficiently prove or disprove?
> Have a conversation with the patient about the diagnostic possibilities, the degree of certainty and uncertainty.
> Ascertain what part of the clinical picture the patient is most concerned about. (Some patients want a diagnosis and some want treatment and some want both, depending on the setting.)
> Given that we have a collection of possibilities of varying severity and frequency and likelihood and we know what the patient’s preferences are (because we asked her and listened), what is a reasonable approach to managing the problem, including but not limited to:
> Work on diagnosis, hold off on treatment?
> Work on diagnosis, treat symptoms?
> Treat symptoms and observe the course. (Here natural history is ‘the test’ we are using, but it doesn’t have a ‘result’ in the sense of Q waves or blood sugar or potassium.)
> Not treat symptoms and observe the course.
> Trial and error - treat something and see if it works.
>  
> Very few of my patients with back pain or headaches or fever have any ‘tests’ done. In primary care, depending on the patient context, fatigue may be best diagnosed by history and a brief exam - though there are settings where tests are clearly essential. I doubt that more than 2 patients a day needed a ’test’ in the sense that is being discussed in these threads. (My daily volume was 18-20 on a bad day, 16 on a good day.)
>  
>  
> My point here is that framing the diagnostic process around how one interprets a test result considers a very limited piece of the diagnostic universe. It is important when it is germane - when I present to an ED poorly responsive and hypotensive, I want the test results to be properly and quickly evaluated. However, from my PCP, patient, and caregiver perspectives I think this is a tiny part of the diagnostic universe and not easily generalized across the broad landscape of medicine. I am much more interested in and concerned about ways to improve the diagnostic process in the 90% (or more) of circumstances where the results of ‘a test’ are unlikely to be definitive. Of course, that reflects my 40 years in the primary care front line where ambiguity is part of the air we breathe.
>  
> Peter
>  
>  
>  
>  
>  
>  
> On 2018.06.20, at 12:46 PM, Jain, Bimal P.,M.D. <BJAIN at PARTNERS.ORG <mailto:BJAIN at PARTNERS.ORG>> wrote:
>  
> In this attached paper, I discuss that experience plays an important role in validating the verification of a diagnostic hypothesis by a test result. As our experience is gained from a heterogenous population of patients with varying prior probabilities, this validation is represented by a confidence and not by a Bayesian argument.
> Please review and comment on this paper.
> Thanks.
>  
> Bimal
>  
> Bimal P Jain MD
> Northshore Medical Center
> Lynn MA 01904.
>  
>  
> 
> Address messages to: IMPROVEDX at LIST.IMPROVEDIAGNOSIS.ORG <mailto:IMPROVEDX at LIST.IMPROVEDIAGNOSIS.ORG>
> 
> To unsubscribe from IMPROVEDX: click the following link:
> http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?SUBED1=IMPROVEDX&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__list.improvediagnosis.org_scripts_wa-2DIMPDIAG.exe-3FSUBED1-3DIMPROVEDX-26A-3D1&d=DwMGaQ&c=6vgNTiRn9_pqCD9hKx9JgXN1VapJQ8JVoF8oWH1AgfQ&r=sPJ6cvqFFdxFqFrb97KoyYk0NuBfdKf4oSNscarc_mU&m=E6WpLIP2dL0CaUhGmpXjTpCsmMZvOj9-vXjvEpuxOMI&s=UC6m7-gNeF8DD6Ip1OB48-9yR_yh9MAUBPtK2yvBifA&e=>
>  
> or send email to: IMPROVEDX-SIGNOFF-REQUEST at LIST.IMPROVEDIAGNOSIS.ORG <mailto:IMPROVEDX-SIGNOFF-REQUEST at LIST.IMPROVEDIAGNOSIS.ORG>
> 
> Visit the searchable archives or adjust your subscription at: http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?INDEX <https://urldefense.proofpoint.com/v2/url?u=http-3A__list.improvediagnosis.org_scripts_wa-2DIMPDIAG.exe-3FINDEX&d=DwMGaQ&c=6vgNTiRn9_pqCD9hKx9JgXN1VapJQ8JVoF8oWH1AgfQ&r=sPJ6cvqFFdxFqFrb97KoyYk0NuBfdKf4oSNscarc_mU&m=E6WpLIP2dL0CaUhGmpXjTpCsmMZvOj9-vXjvEpuxOMI&s=XUgWXpPJsHcEMC7AK4gC-esFzNMRYo6fPvzWSB4kZeY&e=>
>  
> 
> Moderator:David Meyers, Board Member, Society for Improving Diagnosis in Medicine
> 
> To learn more about SIDM visit:
> http://www.improvediagnosis.org/ <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.improvediagnosis.org_&d=DwMGaQ&c=6vgNTiRn9_pqCD9hKx9JgXN1VapJQ8JVoF8oWH1AgfQ&r=sPJ6cvqFFdxFqFrb97KoyYk0NuBfdKf4oSNscarc_mU&m=E6WpLIP2dL0CaUhGmpXjTpCsmMZvOj9-vXjvEpuxOMI&s=lnv_r8pxoT6s2ODaX_NBXd7M_UoM9YXhvFhLsTEH9W4&e=>
>  
> <The role of experience in the hypothesis verification phase of diagnosis.pdf>
>  
>  
> 
> Address messages to: IMPROVEDX at LIST.IMPROVEDIAGNOSIS.ORG <mailto:IMPROVEDX at LIST.IMPROVEDIAGNOSIS.ORG>
> 
> To unsubscribe from IMPROVEDX: click the following link:
> http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?SUBED1=IMPROVEDX&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__list.improvediagnosis.org_scripts_wa-2DIMPDIAG.exe-3FSUBED1-3DIMPROVEDX-26A-3D1&d=DwMGaQ&c=6vgNTiRn9_pqCD9hKx9JgXN1VapJQ8JVoF8oWH1AgfQ&r=sPJ6cvqFFdxFqFrb97KoyYk0NuBfdKf4oSNscarc_mU&m=E6WpLIP2dL0CaUhGmpXjTpCsmMZvOj9-vXjvEpuxOMI&s=UC6m7-gNeF8DD6Ip1OB48-9yR_yh9MAUBPtK2yvBifA&e=>
> or send email to: IMPROVEDX-SIGNOFF-REQUEST at LIST.IMPROVEDIAGNOSIS.ORG <mailto:IMPROVEDX-SIGNOFF-REQUEST at LIST.IMPROVEDIAGNOSIS.ORG>
> 
> Visit the searchable archives or adjust your subscription at: http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?INDEX <https://urldefense.proofpoint.com/v2/url?u=http-3A__list.improvediagnosis.org_scripts_wa-2DIMPDIAG.exe-3FINDEX&d=DwMGaQ&c=6vgNTiRn9_pqCD9hKx9JgXN1VapJQ8JVoF8oWH1AgfQ&r=sPJ6cvqFFdxFqFrb97KoyYk0NuBfdKf4oSNscarc_mU&m=E6WpLIP2dL0CaUhGmpXjTpCsmMZvOj9-vXjvEpuxOMI&s=XUgWXpPJsHcEMC7AK4gC-esFzNMRYo6fPvzWSB4kZeY&e=>
> 
> Moderator:David Meyers, Board Member, Society for Improving Diagnosis in Medicine
> 
> To learn more about SIDM visit:
> http://www.improvediagnosis.org/ <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.improvediagnosis.org_&d=DwMGaQ&c=6vgNTiRn9_pqCD9hKx9JgXN1VapJQ8JVoF8oWH1AgfQ&r=sPJ6cvqFFdxFqFrb97KoyYk0NuBfdKf4oSNscarc_mU&m=E6WpLIP2dL0CaUhGmpXjTpCsmMZvOj9-vXjvEpuxOMI&s=lnv_r8pxoT6s2ODaX_NBXd7M_UoM9YXhvFhLsTEH9W4&e=>
> 
> The information in this e-mail is intended only for the person to whom it is
> addressed. If you believe this e-mail was sent to you in error and the e-mail
> contains patient information, please contact the Partners Compliance HelpLine at
> http://www.partners.org/complianceline <http://www.partners.org/complianceline> . If the e-mail was sent to you in error
> but does not contain patient information, please contact the sender and properly
> dispose of the e-mail.
> 
> 
> 
> Address messages to: IMPROVEDX at LIST.IMPROVEDIAGNOSIS.ORG <mailto:IMPROVEDX at LIST.IMPROVEDIAGNOSIS.ORG>
> 
> To unsubscribe from IMPROVEDX: click the following link:
> http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?SUBED1=IMPROVEDX&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__list.improvediagnosis.org_scripts_wa-2DIMPDIAG.exe-3FSUBED1-3DIMPROVEDX-26A-3D1&d=DwMGaQ&c=6vgNTiRn9_pqCD9hKx9JgXN1VapJQ8JVoF8oWH1AgfQ&r=sPJ6cvqFFdxFqFrb97KoyYk0NuBfdKf4oSNscarc_mU&m=E6WpLIP2dL0CaUhGmpXjTpCsmMZvOj9-vXjvEpuxOMI&s=UC6m7-gNeF8DD6Ip1OB48-9yR_yh9MAUBPtK2yvBifA&e=>
> 
> or send email to: IMPROVEDX-SIGNOFF-REQUEST at LIST.IMPROVEDIAGNOSIS.ORG <mailto:IMPROVEDX-SIGNOFF-REQUEST at LIST.IMPROVEDIAGNOSIS.ORG>
> 
> Visit the searchable archives or adjust your subscription at: http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?INDEX <http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?INDEX>
> 
> 
> Moderator:David Meyers, Board Member, Society for Improving Diagnosis in Medicine
> 
> To learn more about SIDM visit:
> http://www.improvediagnosis.org/ <http://www.improvediagnosis.org/>
> 


Address messages to: IMPROVEDX at LIST.IMPROVEDIAGNOSIS.ORG <mailto:IMPROVEDX at list.improvediagnosis.org>

To unsubscribe from IMPROVEDX: click the following link:
http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?SUBED1=IMPROVEDX&A=1 <http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?SUBED1=IMPROVEDX&A=1>

or send email to: IMPROVEDX-SIGNOFF-REQUEST at LIST.IMPROVEDIAGNOSIS.ORG <mailto:IMPROVEDX-SIGNOFF-REQUEST at list.improvediagnosis.org>

Visit the searchable archives or adjust your subscription at: http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?INDEX <http://list.improvediagnosis.org/scripts/wa-IMPDIAG.exe?INDEX>


Moderator:David Meyers, Board Member, Society for Improving Diagnosis in Medicine

To learn more about SIDM visit:
http://www.improvediagnosis.org/ <http://www.improvediagnosis.org/>






Moderator: David Meyers, Board Member, Society to Improve Diagnosis in Medicine


HTML Version:
URL: <../attachments/20180626/00cbb074/attachment.html>


More information about the Test mailing list