Abstract
This work introduces a fine-grained table retrieval framework for grounding large
language models in heterogeneous, open-domain relational data. Instead of encoding a query as a single vector, the approach decomposes natural
language queries into semantic components and embeds each independently, enabling
more precise matching of compositional query intent. These representations are used in a staged retrieval pipeline with component-level
search, connectivity-aware grouping, and reranking. Experiments on three TARGET benchmark corpora show consistent improvements in capped recall@k and stronger alignment between query intent and tabular structure over dense retrieval baselines, particularly for longer and more complex queries and when using lightweight embedding models.