# Research & Publications — Deepak Akkil

> Publications (newest first), patents, and articles by Deepak Akkil, Research Scientist at Emergence AI. This is the Markdown copy of https://www.deepakakkil.com/research.

Also available as [JSON](https://www.deepakakkil.com/publications.json) and [BibTeX](https://www.deepakakkil.com/publications.bib). Author names are abbreviated as on the page; "et al." marks a shortened author list. The full record is on [Google Scholar](https://scholar.google.com/citations?user=Iu6CSBgAAAAJ).

## Publications (34)

### 2026

- **Emergence World: Adversarial Stress-Testing of Long-Horizon Multi-Agent Systems.** D Akkil, T Abuelsaad, K Vikram, M Pace, A Vempaty, S Beotra, R Kokku, et al. *arXiv preprint arXiv:2609.17320*, 2026. [Paper](https://arxiv.org/abs/2609.17320)
- **Emergence World: A Platform for Evaluating Long-Horizon Multi-Agent Autonomy.** D Akkil, R Kokku, K Vikram, T Abuelsaad, A Vempaty, S Nitta. *arXiv preprint arXiv:2606.08367*, 2026. [Paper](https://arxiv.org/abs/2606.08367)
- **Emergence WebVoyager: Toward Consistent and Transparent Evaluation of (Web) Agents in The Wild.** D Akkil, M Allaham, A Raj, T Abuelsaad, R Kokku. *arXiv preprint arXiv:2603.29020*, 2026. [Paper](https://arxiv.org/abs/2603.29020)
- **Navigating the Future: A Design Fiction Study on User Perceptions of Next-Gen LLM-Based Voice Interaction.** B Thankachan, D Akkil, S Rahman, K Jokinen, M Turunen. *Multimodal Technologies and Interaction 10(3), 31*, 2026. [Paper](https://doi.org/10.3390/mti10030031)

### 2024

- **Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems.** T Abuelsaad, D Akkil, P Dey, A Jagmohan, A Vempaty, R Kokku. *arXiv preprint arXiv:2407.13032*, 2024. [Paper](https://arxiv.org/abs/2407.13032) · [Code](https://github.com/EmergenceAI/Agent-E)
  We present Agent-E, a state-of-the-art autonomous web navigation agent with hierarchical architecture that outperforms existing agents by 10-30% on the WebVoyager benchmark.
- **MathViz-E: A case-study in domain-specialized tool-using agents.** A Bulusu, B Man, A Jagmohan, A Vempaty, J Mari-Wyka, D Akkil. *arXiv preprint arXiv:2407.17544*, 2024. [Paper](https://arxiv.org/abs/2407.17544)

### 2022

- **Toward a real-time index of pupillary activity as an indicator of cognitive load.** G Jayawardena, Y Jayawardana, S Jayarathna, J Högström, T Papa, D Akkil, et al. *Procedia Computer Science 207, 1331-1340*, 2022. [Paper](https://www.sciencedirect.com/science/article/pii/S1877050922011929)

### 2020

- **Gaze interaction with vibrotactile feedback: Review and design guidelines.** J Rantala, P Majaranta, J Kangas, P Isokoski, D Akkil, O Špakov, et al. *Human–Computer Interaction 35 (1), 1-39*, 2020. [Paper](https://www.tandfonline.com/doi/full/10.1080/07370024.2018.1522352)
- **Gaze-based kinaesthetic interaction for virtual reality.** Z Li, D Akkil, R Raisamo. *Interacting with Computers 32 (1), 17-32*, 2020. [Paper](https://academic.oup.com/iwc/article/32/1/17/5912912)
- **The impact of control-display gain in kinesthetic search.** Z Li, D Akkil, R Raisamo. *International Conference on Human Haptic Sensing and Touch Enabled Computer Applications*, 2020. [Paper](https://link.springer.com/chapter/10.1007/978-3-030-58147-3_40)

### 2019

- **Gaze augmented hand-based kinesthetic interaction: What you see is what you feel.** Z Li, D Akkil, R Raisamo. *IEEE Transactions on Haptics 12 (2), 114-127*, 2019. [Paper](https://ieeexplore.ieee.org/document/8620297)

### 2018

- **I see what you see: gaze awareness in mobile video collaboration.** D Akkil, B Thankachan, P Isokoski. *ACM Symposium on Eye Tracking Research & Applications*, 2018. [Paper](https://dl.acm.org/doi/10.1145/3204493.3204542)
- **Comparison of gaze and mouse pointers for video-based collaborative physical task.** D Akkil, P Isokoski. *Interacting with Computers 30 (6), 524-542*, 2018. [Paper](https://academic.oup.com/iwc/article/30/6/524/5145632)
- **Where the streets have no name: a field trip in the wild.** B Thankachan, S Sharma, T Gross, D Akkil, M Turunen, S Mehrotra, et al. *Interactions 25 (3), 56-60*, 2018. [Paper](https://dl.acm.org/doi/10.1145/3194351)

### 2017

- **Vibrotactile stimulation of the head enables faster gaze gestures.** J Kangas, J Rantala, D Akkil, P Isokoski, P Majaranta, R Raisamo. *International Journal of Human-Computer Studies 98, 62-71*, 2017. [Paper](https://www.sciencedirect.com/science/article/pii/S1071581916301100)
- **Gaze awareness in agent-based early-childhood learning application.** D Akkil, P Dey, D Salian, N Rajput. *IFIP Conference on Human-Computer Interaction*, 2017. [Paper](https://link.springer.com/chapter/10.1007/978-3-319-67687-6_30)
- **Little bear–a gaze aware learning companion for early childhood learners.** D Akkil, P Dey, N Rajput. *IFIP Conference on Human-Computer Interaction*, 2017. [Paper](https://link.springer.com/chapter/10.1007/978-3-319-67687-6_28)

### 2016

- **GazeTorch: enabling gaze awareness in collaborative physical tasks.** D Akkil, JM James, P Isokoski, J Kangas. *CHI Conference Extended Abstracts*, 2016. [Paper](https://dl.acm.org/doi/10.1145/2851581.2892370)
- **Feedback for smooth pursuit gaze tracking based control.** J Kangas, O Špakov, P Isokoski, D Akkil, J Rantala, R Raisamo. *Augmented Human International Conference*, 2016. [Paper](https://dl.acm.org/doi/10.1145/2875194.2875213)
- **Evaluation of HeadTurn: An interaction technique using the gaze and head turns.** T Nukarinen, J Kangas, O Špakov, P Isokoski, D Akkil, J Rantala, et al. *Nordic Conference on Human-Computer Interaction*, 2016. [Paper](https://dl.acm.org/doi/10.1145/2971485.2971495)
- **PursuitAdjuster: an exploration into the design space of smooth pursuit-based widgets.** O Špakov, P Isokoski, J Kangas, D Akkil, P Majaranta. *ACM Symposium on Eye Tracking Research & Applications*, 2016. [Paper](https://dl.acm.org/doi/10.1145/2857491.2857522)
- **Gaze augmentation in egocentric video improves awareness of intention.** D Akkil, P Isokoski. *CHI Conference on Human Factors in Computing Systems*, 2016. [Paper](https://dl.acm.org/doi/10.1145/2858036.2858127)
- **Accuracy of interpreting pointing gestures in egocentric view.** D Akkil, P Isokoski. *ACM International Joint Conference on Pervasive and Ubiquitous Computing*, 2016. [Paper](https://dl.acm.org/doi/10.1145/2968219.2968287)
- **User expectations of everyday gaze interaction on smartglasses.** D Akkil, A Lucero, J Kangas, T Jokela, M Salmimaa, R Raisamo. *Nordic Conference on Human-Computer Interaction*, 2016. [Paper](https://dl.acm.org/doi/10.1145/2971485.2971496)
- **Haptic feedback in eye typing.** P Majaranta, P Isokoski, J Rantala, O Špakov, D Akkil, J Kangas, et al. *Journal of Eye Movement Research 9 (1)*, 2016. [Paper](https://bop.unibe.ch/JEMR/article/view/2413)
- **Comparison of three implementations of HeadTurn: a multimodal interaction technique with gaze and head turns.** O Špakov, P Isokoski, J Kangas, J Rantala, D Akkil, R Raisamo. *ACM International Conference on Multimodal Interaction*, 2016. [Paper](https://dl.acm.org/doi/10.1145/2993148.2993177)
- **Both fingers and head are acceptable in sensing tactile feedback of gaze gestures.** J Kangas, J Rantala, D Akkil, P Isokoski, P Majaranta, R Raisamo. *International Conference on Human Haptic Sensing and Touch Enabled Computer Applications*, 2016. [Paper](https://link.springer.com/chapter/10.1007/978-3-319-42324-1_33)

### 2015

- **Glance awareness and gaze interaction in smartwatches.** D Akkil, J Kangas, J Rantala, P Isokoski, O Spakov, R Raisamo. *CHI Conference Extended Abstracts*, 2015. [Paper](https://dl.acm.org/doi/10.1145/2702613.2732816)
- **Haptic feedback of gaze gestures with glasses: localization accuracy and effectiveness.** J Rantala, J Kangas, P Isokoski, D Akkil, O Špakov, R Raisamo. *ACM International Joint Conference on Pervasive and Ubiquitous Computing*, 2015. [Paper](https://dl.acm.org/doi/10.1145/2800835.2804328)

### 2014

- **Gaze gestures and haptic feedback in mobile devices.** J Kangas, D Akkil, J Rantala, P Isokoski, P Majaranta, R Raisamo. *CHI Conference on Human Factors in Computing Systems*, 2014. [Paper](https://dl.acm.org/doi/10.1145/2556288.2557040)
- **Glasses with haptic feedback of gaze gestures.** J Rantala, J Kangas, D Akkil, P Isokoski, R Raisamo. *CHI'14 Extended Abstracts*, 2014. [Paper](https://dl.acm.org/doi/10.1145/2559206.2581160)
- **TraQuMe: a tool for measuring the gaze tracking quality.** D Akkil, P Isokoski, J Kangas, J Rantala, R Raisamo. *Symposium on Eye Tracking Research and Applications*, 2014. [Paper](https://dl.acm.org/doi/10.1145/2578153.2578192)
- **Using gaze gestures with haptic feedback on glasses.** J Kangas, D Akkil, J Rantala, P Isokoski, P Majaranta, R Raisamo. *Nordic Conference on Human-Computer Interaction*, 2014. [Paper](https://dl.acm.org/doi/10.1145/2639189.2639225)
- **Delayed haptic feedback to gaze gestures.** J Kangas, J Rantala, D Akkil, P Isokoski, P Majaranta, R Raisamo. *International Conference on Human Haptic Sensing and Touch Enabled Computer Applications*, 2014. [Paper](https://link.springer.com/chapter/10.1007/978-3-662-44196-1_12)

## Patents

### Granted (4)

- **Context-sensitive customization of remote-control unit.** US12,229,354, 2025. Inventors: D Akkil, P Dey, R Kokku, SS Ponoth, HI Alonso, S O'Hara, SV Nitta. Assignee: IBM. [Patent](https://patents.google.com/patent/US12229354)
  System and method for context-sensitive customization of remote control units based on user preferences and environmental factors.
- **Content transfer among remote-control units and integrated output devices.** US12,425,460, 2025. Inventors: D Akkil, P Dey, R Kokku, SS Ponoth, HI Alonso, S O'Hara, SV Nitta. Assignee: IBM. [Patent](https://patents.google.com/patent/US12425460)
  Methods for seamless content transfer between remote control units and integrated output devices.
- **Digital assistant and method for voice-based interactive communication based on detected user gaze indicating attention.** US11,699,439, 2023. Inventors: E George-Svahn, S Pateriya, O Kurt, D Akkil. Assignee: Tobii AB. [Patent](https://patents.google.com/patent/US11699439B2/en)
  Method for voice-based interactive communication using a digital assistant with attention detection via gaze tracking, speaker detection, and intelligent feedback.
- **System and method for determining reference gaze data.** US12,527,474, 2026. Inventors: H Andersson, D Akkil. Assignee: Tobii AB. [Patent](https://patents.google.com/patent/US12527474B2/en)
  System and method for determining accurate reference gaze data for eye tracking calibration.

### Pending (2)

- **Intelligent web-based task planning and execution.** US App. 18/625,088, 2025. Inventors: A Jagmohan, P Dey, SV Nitta, R Kokku, A Vempaty, T Abuelsaad, D Akkil. Assignee: IBM. [Application](https://patents.google.com/patent/US20250265522A1/en)
  System for intelligent web-based task planning and autonomous execution using AI agents.
- **Decoupled secure data handling for generative AI applications.** US App. 19/196,391, 2026. Inventors: T Abuelsaad, D Akkil, R Kokku, P Dey. Assignee: Merlyn Mind. [Application](https://patents.google.com/patent/US20260154450A1/en)
  Methods for preserving sensitive data privacy while AI systems perform online tasks.

## Blog & Insights

- [Trust by Design: Our UX Principles for Building Trustable Data Agents](https://www.emergence.ai/blog/trust-by-design-our-ux-principles-for-building-trustable-data-agents) (2026-02-26): Five UX principles for trustworthy data agents: thinking aloud, collaborating with users, surfacing assumptions, explaining analytical logic, and reusing human-verified workflows.
- [Agent-E SOTA Results on WebVoyager Benchmark](https://www.emergence.ai/blog/jsvmb600tlkv80ll3ixuf5idgpd7vd) (2024-07-18): We're excited to share that Agent-E has achieved state-of-the-art results on the WebVoyager benchmark, outperforming existing text and multi-modal web agents by 10-30%.
- [Distilling the Web for Multi-Agent Automation](https://www.emergence.ai/blog/uacc2lfygofrtetmwtdr3l6nblfs3t?rq=distil) (2024-06-15): Exploring advanced DOM distillation and denoising methods that enable LLMs to better understand and interact with web pages.
- [100 Years of Eye-Gaze Tracking](https://medium.com/gaze-tracking/100-years-of-eye-tracking-c121f48c6b55) (2019-07-19): The technology of eye gaze tracking has gone through over a century of research and development. Exploring its journey from invasive devices requiring anaesthesia to mainstream AR/VR tech.
