Diagnostic Markers as Shortcut Cues
Calipers, annotations, and machine overlays as predictive artifacts, and what removing them changes.
Core question and definition
What information does an ultrasound annotation add, and is that information appropriate for the task a model is supposed to perform?
Diagnostic markers here mean calipers, measurement values, arrows, text, and display overlays added during an examination. They are records of clinical work. They are not tissue findings, although they may identify a finding or encode an examiner’s interpretation.
The distinction is about provenance and timing. A caliper can locate a suspected lesion, a measurement can influence management, and a diagnostic phrase can summarize a conclusion reached using more evidence than the exported frame contains. None of those functions establishes that a model has recognized the underlying morphology.
Annotations are not inherently illegitimate inputs. A tool that organizes completed reports can legitimately use documentation. A tool presented as independently recognizing disease from an initial image has a different information boundary.
Key concepts
Separate tissue, acoustic effects, and added graphics
An exported ultrasound image can combine several kinds of information.
| Image component | How it originates | What it can mean |
|---|---|---|
| Gallbladder wall and lumen | Tissue interacting with the ultrasound beam | Anatomy and possible disease manifestations |
| Posterior shadow or comet-tail echoes | Acoustic propagation and returning echoes | Potentially useful evidence about an anatomical source |
| Caliper endpoints and measurement text | An examiner’s measurement operation | Selected structure, plane, endpoints, and recorded size |
| Anatomical or diagnostic text | Documentation | Orientation, interpretation, indication, or prior information |
| Depth scale and display settings | Acquisition and rendering | Spatial context and technical conditions |
| Machine or institutional identifiers | Equipment and workflow | Source of the examination |
The word “artifact” can obscure these differences. A posterior shadow is an acoustic artifact that may help identify a stone. An arrow is an added graphic. Removing both because neither is a literal depiction of tissue would erase clinically useful information.
Likewise, location does not settle the issue. A measurement symbol may lie inside a lesion; a diagnostically relevant shadow may lie outside it.
Why a wall measurement requires clinical interpretation
A wall measurement assumes that the relevant boundaries are identifiable, that the plane represents the structure appropriately, and that the endpoints correspond to the intended anatomical interfaces.
Distension changes the geometry. A contracted gallbladder can appear thick-walled without the same pathological meaning as a thick wall in an adequately distended organ. An oblique section can blur or broaden a boundary. Limited resolution can merge adjacent interfaces.
The displayed value is therefore conditional on how the measurement was made. Additional decimal places do not recover an unresolved boundary. A visibly precise number can coexist with substantial uncertainty about where the endpoints should be placed.
Most importantly, thickness is not etiology. Inflammation can add edema, systemic congestion can add interstitial fluid, benign remodelling can thicken muscle and create intramural spaces, and neoplastic infiltration can alter the wall. A caliper documents a dimension shared by several mechanisms.
What a lesion measurement leaves out
A polypoid appearance describes a projection into the lumen. It does not by itself distinguish a cholesterol-related pseudopolyp, a neoplastic polyp, or material such as adherent sludge that mimics an attached lesion.
The clinical interpretation also depends on:
- The relationship to the wall and the width or character of the attachment.
- Whether the surrounding wall is separately abnormal.
- Echogenicity and internal architecture under adequate settings.
- Posterior acoustic behavior.
- Mobility when relevant evidence is available.
- The rest of the examination and the clinical context.
A single length measurement compresses this information. Two findings with similar displayed dimensions can have different structures and different implications. Conversely, measurements from different planes can describe the same lesion differently without proving biological change.
A model that reads the displayed measurement may be using a clinically relevant summary. Whether that is appropriate depends on the stated task, and its performance should not be described as independent measurement from tissue pixels.
Annotation location can contain prior clinical judgment
An examiner usually places a caliper after deciding which structure warrants measurement. The chosen location can therefore provide localization that an automatic detection system would otherwise need to perform.
A tightly framed, measured lesion differs informationally from an unselected survey view. The former already contains human work: finding the organ, identifying an abnormality, choosing a representative plane, and deciding what to document.
This is not necessarily wrongdoing or poor clinical practice. It becomes a validity problem when the human contribution is omitted from the description of the AI task.
Examples of different claims include:
| Claimed task | What annotation may already supply |
|---|---|
| Locate any gallbladder lesion | The examiner’s selected location |
| Measure an identified lesion | The endpoints and recorded dimension |
| Recognize suspicious morphology | A diagnostic phrase or targeted documentation pattern |
| Organize completed examinations | Information legitimately available in the completed record |
The model’s apparent capability must be interpreted relative to what has already been supplied.
Timing separates available evidence from leaked conclusions
An examination unfolds over time. An operator surveys anatomy, identifies an area of concern, obtains additional views, measures it, and records an interpretation. The order is not identical in every examination, but later documentation can depend on earlier recognition.
A retrospective image collection may contain only the final selected frames. If the intended assistance occurs earlier, those frames can contain information that would not yet be available.
This is a form of task mismatch and can become label leakage. Diagnostic text may directly reveal the target. More indirectly, a particular measurement convention may correlate with referral status or a suspected disease category.
An anatomical label, however, need not reveal the diagnosis. A scale can be necessary to interpret size. The correct distinction is what the information means, when it becomes available, and what the system claims to infer.
A graphic can obscure the finding it documents
A caliper endpoint may cover a narrow attachment, an inner-wall interface, or a small internal echo. Text can cover adjacent tissue needed to judge extension or posterior acoustic behavior.
This creates two simultaneous facts:
- The annotation can supply clinical information.
- The annotation can conceal image information.
The concealed area is not automatically unimportant because an examiner successfully interpreted the complete examination. The examiner may have seen a live sequence or additional views that the dataset does not include.
A region obscured by a graphic should not receive a confident image-level label merely because pathology later established the diagnosis. Pathology answers a tissue question; it does not restore the missing depiction in that exported image.
Why annotation status is not a controlled clinical comparison
Images carrying annotations and images without them may differ in clinical purpose, disease spectrum, depth, magnification, focal position, and selection. One group may contain targeted lesion documentation, while the other contains routine survey frames.
A difference between these groups can therefore have several explanations. It may reflect a graphic, a more informative view, different patients, or an operator’s earlier interpretation. Annotation status alone does not isolate those possibilities.
Even within a diagnosis category, severity and visibility can differ. “Both are benign” does not make a clearly depicted cholesterol pseudopolyp equivalent to indeterminate mural thickening. Broad diagnostic matching does not equal matching of clinical evidence.
This is why a simple comparison by annotation status is preliminary evidence, not a complete account of model behavior.
Removal changes the available image
Different removal operations answer different image-processing problems.
| Operation | Information it may remove or alter | Remaining limitation |
|---|---|---|
| Cropping | Graphics, surrounding anatomy, depth context, posterior acoustics | A narrower image can represent a different clinical question. |
| Masking | Graphic pixels and any anatomy beneath them | The mask introduces an artificial pattern and leaves missing evidence. |
| Inpainting | The appearance of the obscured region | Plausible replacement pixels are not recovered tissue observations. |
| Resizing or re-encoding | Scale, fine texture, edge sharpness, compression | Appearance changes can extend beyond the intended graphic. |
Published image-manipulation arguments require attention to control edits and comparable disruption. Otherwise an apparent effect of “cleaning” can arise from the image damage or reconstruction procedure itself.
A cleaned-looking image is therefore not automatically a more valid clinical input. Image realism, preservation of evidence, and suitability for the intended task are separate judgments.
Why inpainting cannot establish what was underneath
Suppose a graphic covers a small portion of a wall boundary. Several underlying tissue appearances could have produced exactly the same exported image once that portion was covered.
An inpainting system chooses a completion using surrounding pixels and learned image regularities. Those regularities can make the output visually coherent. They do not identify which of the possible underlying appearances was actually present.
The distinction is particularly important for subtle findings. Filling a small gap with a smooth boundary can erase apparent irregularity; filling it with texture can introduce apparent tissue. Either may look reasonable.
An available original acquisition provides observational evidence that a synthetic completion does not. Additional clinical views may clarify anatomy, but they do not retroactively prove every pixel in a reconstructed frame. Generated content should not become the reference for whether the original tissue had a finding.
Removing visible text does not remove acquisition history
An image may still carry the machine’s rendering characteristics, the operator’s framing, the selected probe, or a characteristic set of saved views. Exported pixel data and separately stored metadata also need not contain identical information.
Consequently, a dataset can be free of obvious identifying labels and still be distinguishable by site. It can be free of calipers and still reflect which lesions were measured or investigated most closely.
This is a conceptual limit on cleanup claims. Removal of an obvious cue is not proof that all care-process information has disappeared, nor proof that the remaining image is clinically sufficient.
Worked reasoning: an annotated wall lesion
Consider a hypothetical exported frame showing a broad-based projection, a displayed dimension, and a caliper endpoint covering part of the attachment. A separate clinical record calls the lesion benign.
The justified reading proceeds in layers.
What is directly visible? A projection and part of its surrounding wall. The obscured attachment cannot be fully assessed in this frame.
What does the annotation add? A selected target and a recorded measurement. It also establishes that someone performed a measurement, not why the lesion is benign.
What does the clinical label add? That depends on its source. Histopathology, a radiologist’s impression, and stability on follow-up support different statements.
What would a smooth reconstruction establish? Only that a plausible image can be generated. It would not establish a smooth original attachment.
What would correct classification establish? Agreement with the chosen reference for this example. It would not by itself reveal which information produced the answer.
This reasoning preserves uncertainty at the appropriate level instead of letting one confident part of the record certify all the others.
Consequences of getting the distinction wrong
If documentation is mistaken for independently recognized anatomy, performance can be overstated for earlier or less specialized settings. If cleanup destroys legitimate acoustic evidence, the input can become less clinically interpretable.
If an obscured interface is reconstructed and treated as observed, the model and reviewer may both receive false reassurance. If every annotation is treated as contamination regardless of intended use, useful clinical context may be discarded unnecessarily.
The downstream costs depend on the action: missed characterization of a concerning lesion, unnecessary repeat examination, inappropriate referral, or misplaced confidence in an automated measurement.
Revision checklist
| Question | Answer to retain |
|---|---|
| Does a caliper have a tissue substrate? | No; it records a measurement operation on a selected structure. |
| Does a precise displayed number establish a precise boundary? | No; resolution, plane, and endpoint uncertainty remain. |
| Is all information outside the lesion a shortcut? | No; posterior acoustics and spatial context can be clinically relevant. |
| Can annotation be a legitimate input? | Yes, if its meaning and timing fit the intended task. |
| What work may annotation already encode? | Localization, selection, measurement, and interpretation. |
| Are annotation-status groups automatically comparable? | No; patients, views, and examination purposes can differ. |
| Does inpainting recover tissue truth? | No; it supplies a plausible completion of missing evidence. |
| Does cleanup remove site information? | Not necessarily; acquisition and rendering signatures can remain. |
| What must a clinical label not do? | Certify a feature that is not depicted in the supplied image. |
Why it matters for my work
Diagnostic documentation and sonographic evidence are different inputs to a clinical claim. In the ontology, Clinical assessability limits Clinical evidence reliance, while Gallbladder disease sets requirements for the inputs and task. Acoustic propagation can produce a useful Finding; an added graphic records human work and must be interpreted according to that role.
What I have not resolved
- Which parts of an exported examination were available at the intended decision point?
- Which clinically relevant structures are obscured or lost during export?
- Where does the available reference support a diagnosis without supporting the claimed image finding?
Sources: General ultrasound image-formation and gallbladder-imaging teaching, including Feldman, Katyal, and Blackwood’s discussion of US artifacts and Gupta and colleagues’ discussion of wall thickening. The annotation examples are conceptual illustrations, not results from a local model or dataset. These are study notes for research purposes, not clinical guidance.
Related study notes
- Clinical Workflow and Task Definition for Gallbladder AIDeciding which decision a model supports, and letting that decide the label, the metric, and the design.
- Clinical Feature Annotation and Multi-Task LearningBuilding supervision from structured sonographic findings rather than the diagnosis alone.
- Clinical Knowledge-Guided Representation LearningUsing echogenicity, texture, margin, wall features, and anatomical context as domain priors.
- Shortcut Learning and Confounding in Gallbladder UltrasoundThe confounders specific to this problem, and telling a sonographic finding from an acquisition correlate.
- Auditing Explanation Faithfulness in Gallbladder ModelsHow the evidence a diagnostic model exposes can be checked against clinical information assessed separately from it.
Related paper reviews
- AI for Radiographic COVID-19 Detection Selects Shortcuts Over SignalNature Machine Intelligence
- SilverLining: Data-First Mitigation of Spatial and Spectral Shortcuts Without Introducing New ConfoundersWACV 2026
- Post hoc Explanations May Be Ineffective for Detecting Unknown Spurious CorrelationICLR 2022