The paper argues that text prompts struggle with fine-grained and referential intent, and models how GUI interactions such as clicking and brushing can combine with prompts in human-GenAI systems.

The paper argues that text prompts struggle with fine-grained and referential intent, and models how GUI interactions such as clicking and brushing can combine with prompts in human-GenAI systems