Skip to content

Google Research Blog company blog

ScreenAI: A visual LLM for UI and visually-situated language understanding

research.google

Read on research.google → Discuss on HN (40) Archived copy

Points: 262
HN comments: 40
Submissions: 1
Cited by: 0 commenters

AI & Machine Learning Web & Frontend 2024

On Hacker News

Submitted	Title on HN	Points	Comments
Apr 9, 2024	ScreenAI: A visual LLM for UI and visually-situated language understanding by gfortaine	262	40

More from Google Research Blog

All 29 posts →

A return to hand-written notes by learning to read and write

2024595 points181 comments AI & Machine Learning details

Google Titans architecture, helping AI have long-term memory

2025587 points186 commentscited by 3AI & Machine Learning details

TurboQuant: Redefining AI efficiency with extreme compression

2026576 points166 commentscited by 7AI & Machine Learning details

Accelerating scientific breakthroughs with an AI co-scientist

2025371 points196 commentscited by 4AI & Machine Learning details

Hard-braking events as indicators of road segment crash risk

2026370 points563 comments AI & Machine Learning details

Learn Your Way: Reimagining Textbooks with Generative AI

2025359 points236 comments AI & Machine Learning details

Related posts from the same era

Bing: “I will not harm you unless you harm me first”

Simon Willison20233,363 points1,673 commentscited by 6 details

GPT-4o

OpenAI Blog20243,138 points2,366 commentscited by 16 details

Open source AI is the path forward

Meta Newsroom20242,360 points887 commentscited by 5 details

My AI skeptic friends are all nuts

Fly.io Blog20252,356 points2,826 commentscited by 13 details

Claude 3.7 Sonnet and Claude Code

Anthropic20252,127 points963 commentscited by 6 details

Claude 4

Anthropic20252,013 points1,170 comments details