Editing Visual Grounding (section)

== <span style="color: #FFFFFF;">Understanding</span> ==
Visual grounding requires simultaneously understanding language semantics and visual scene structure, then aligning them. This is fundamentally harder than either task alone — it requires knowing what "the woman on the left in the red dress" means (language), identifying all relevant visual regions (vision), and matching the description to the correct region (grounding).

'''Two-stage vs. end-to-end''': Early grounding systems used two stages:
# generate region proposals (Selective Search, RPN),
# rank proposals by language-visual similarity. Modern end-to-end systems (MDETR, Grounding DINO) jointly process image and text, generating grounded outputs in one forward pass. End-to-end approaches outperform two-stage but require more data and training.

'''Grounding DINO''': The current standard for open-vocabulary grounding. Combines DINO (a strong visual backbone) with language-conditioned attention. Given an image and any text query, it outputs bounding boxes for described objects. Crucially, it generalizes to objects not seen during training — "open vocabulary" — making it vastly more flexible than fixed-category detectors.

'''SAM + language''': SAM can segment any object from a bounding box or point prompt. Combining Grounding DINO (detect → bounding box) with SAM (box → precise segmentation mask) gives a powerful open-vocabulary segmentation pipeline. LangSAM makes this combination accessible in a few lines of code.

'''Multimodal LLMs and grounding''': GPT-4V, LLaVA, and Qwen-VL can discuss image regions conversationally. However, precise bounding box output requires specialized models. The field is rapidly moving toward unified models that can both ground (output boxes) and reason (generate text about grounded regions) in a single framework (e.g., Qwen2-VL, InternVL2).
</div>

<div style="background-color: #8B0000; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">