From Kitchen to Gym: Mobile Screens Revolutionize Home Scenarios with Google’s Help

Subtitle: Project Astra and Real-Time Translation Reshape Cooking, Fitness, and Remote Work

Google’s experimental "Project Astra" vision technology—demoed at I/O 2024—is poised to integrate with mobile smart screens. By combining camera input, environmental sensing, and Gemini’s multimodal AI, devices can now guide users through tasks like correcting yoga poses or suggesting recipe tweaks based on scanned ingredients. For instance, when moved to the kitchen, a smart screen auto-switches to cooking mode, overlaying tutorial videos and timers.

Simultaneously, real-time translation advances bridge language gaps. Samsung’s Galaxy S24 series (using Google’s APIs) allows 13-language voice translation during calls, though latency remains a challenge. Mobile screens like Hisense’s 27X7N mitigate this with dedicated NPUs for faster AI processing. As remote work and hybrid lifestyles grow, analysts predict "context-aware mobility" will drive the next wave of upgrades