JSConf JP

Frontend Beyond the Screen: Where AI Agent Is A User

SessionTrack CEnglish

For years, frontend engineering has focused on building interfaces for people to interact with applications through screens. We learned to design for different interaction models, from mouse and keyboard to screen readers and voice control.

Now with AI agents comes another interaction model. Instead of navigating buttons and forms, they can increasingly interact with applications through structured capabilities such as WebMCP and other agent interfaces. So what does good frontend design look like when not every interaction goes through the UI?

In this session, we'll explore how accessibility principles provide a useful foundation for thinking about agent experiences, and why frontend engineering is becoming more important rather than less. Through practical demos and experiments, we'll compare human, assistive technology, and agent interactions with the same application, and discuss what this means for interface design, UX validation, testing, and the future of frontend development.