Hiromu Yakura

Hiromu Yakura

Ph.D. in Computer Science (HCI, Machine Learning)

Publications

* denotes equal contribution. You can also find my articles on my Google Scholar profile.

Refereed Journals

  1. Riku Arakawa*, Kiyosu Maeda*, and Hiromu Yakura*. ConverSearch: Supporting Experts in Human Behavior Analysis of Conversational Videos with a Multimodal Scene Search Tool. ACM Transactions on Interactive Intelligent Systems, To appear. [arXiv]
  2. Hiromu Yakura. Evaluating Large Language Models’ Ability Using a Psychiatric Screening Tool Based on Metaphor and Sarcasm Scenarios. Journal of Intelligence, Vol. 12, No. 7, pp. 70:1-70:11, July 2024. [DOI] [arXiv]
  3. Riku Arakawa, Hiromu Yakura, Vimal Mollyn, Suzanne Nie, Emma Russell, Dustin P. Demeo, Haarika A. Reddy, Alexander K. Maytin, Bryan T. Carroll, Jill Fain Lehman, and Mayank Goel. PrISM-Tracker: A Framework for Multimodal Procedure Tracking using Wearable Sensors and State Transition Information with User-Driven Handling of Errors and Uncertainty. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 6, No. 4, pp. 156:1-156:27, January 2023. [DOI]
  4. Hiromu Yakura, Tomoyasu Nakano, and Masataka Goto. An Automated System Recommending Background Music to Listen to While Working. User Modeling and User-Adapted Interaction, Vol. 32, pp. 355-388, May 2022. [DOI]
  5. Hiromu Yakura, Kento Watanabe, and Masataka Goto. Self-Supervised Contrastive Learning for Singing Voices. IEEE/ACM Transactions on Audio, Speech and Language Processing, Vol. 30, pp. 1614-1623, April 2022. [DOI] [Code]
  6. Riku Arakawa* and Hiromu Yakura*. Reaction or Speculation: Building Computational Support for Users in Catching-Up Series Based on an Emerging Media Consumption Phenomenon. Proceedings of the ACM on Human-Computer Interaction, Vol. 5, No. CSCW1, pp. 151:1-151:28, April 2021. [DOI]
  7. Hiromu Yakura, Shinnosuke Shinozaki, Reon Nishimura, Yoshihiro Oyama, and Jun Sakuma. Neural Malware Analysis with Attention Mechanism. Computers & Security, Vol. 87, No. 101592, November 2019. [DOI]

Peer-Reviewed International Conferences

  1. Riku Arakawa, Hiromu Yakura, Mayank Goel. PrISM-Observer: Intervention Agent to Help Users Perform Everyday Procedures Sensed using a Smartwatch. Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (ACM UIST 2024), No. 15, October 2024. [DOI] [arXiv]
  2. Riku Arakawa* and Hiromu Yakura*. Coaching Copilot: Blended Form of an LLM-Powered Chatbot and a Human Coach to Effectively Support Self-Reflection for Leadership Growth. Proceedings of the 2024 ACM Conference on Conversational User Interfaces (ACM CUI 2024), No. 1, July 2024. [DOI] [arXiv]
  3. Hiromu Yakura and Masataka Goto. IteraTTA: An Interface for Exploring Both Text Prompts and Audio Priors in Generating Music with Text-to-Audio Models. Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), pp.129-137, November 2023. [Project Page] [arXiv]
  4. Riku Arakawa*, Hiromu Yakura*, and Masataka Goto. CatAIyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Models. Proceedings of the 2023 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2023), No. 157, April 2023. [DOI] [arXiv]
  5. Yuki Koike, Hiroyuki Katsura, Hiromu Yakura, and Yuma Kurogome. SLOPT: Bandit Optimization Framework for Mutation-Based Fuzzing. Proceedings of the 38th Annual Computer Security Applications Conference (ACSAC 2022), pp. 519-533, December 2022. [DOI] [arXiv]
  6. Riku Arakawa*, Hiromu Yakura*, and Sosuke Kobayashi. VocabEncounter: NMT-powered Vocabulary Learning by Presenting Computer-Generated Usages of Foreign Words into Users’ Daily Lives. Proceedings of the 2022 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2022), No. 6, April 2022. [DOI]
  7. Riku Arakawa*, Hiromu Yakura*, and Masataka Goto. BeParrot: Efficient Interface for Transcribing Unclear Speech via Respeaking. Proceedings of the 27th ACM International Conference on Intelligent User Interface (ACM IUI 2022), pp. 832-840, March 2022. [DOI]
  8. Hiromu Yakura, Yuki Koyama, and Masataka Goto. Tool- and Domain-Agnostic Parameterization of Style Transfer Effects Leveraging Pretrained Perceptual Metrics. Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI 2021), pp. 1208-1216, August 2021. [Project Page] [DOI] [arXiv]
  9. Hiromu Yakura. No More Handshaking: How have COVID-19 pushed the expansion of computer-mediated communication in Japanese idol culture?. Proceedings of the 2021 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2021), No. 645, May 2021. [DOI] [arXiv]
  10. Riku Arakawa* and Hiromu Yakura*. Mindless Attractor: A False-Positive Resistant Intervention for Drawing Attention Using Auditory Perturbation. Proceedings of the 2021 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2021), No. 99, May 2021. [DOI] [arXiv]
  11. Hiromu Yakura and Masataka Goto. Enhancing Participation Experience in VR Live Concerts by Improving Motions of Virtual Audience Avatars. Proceedings of the 19th IEEE International Symposium on Mixed and Augmented Reality (IEEE ISMAR 2020), pp. 555-565, November 2020. [DOI]
  12. Riku Arakawa* and Hiromu Yakura*. Mimicker-in-the-Browser: A Novel Interaction Using Mimicry to Augment the Browsing Experience. Proceedings of the 22nd ACM International Conference on Multimodal Interaction (ACM ICMI 2020), pp. 351-360, October 2020. [DOI]
  13. Riku Arakawa* and Hiromu Yakura*. INWARD: A Computer-Supported Tool for Video-Reflection Improves Efficiency and Effectiveness in Executive Coaching. Proceedings of the 2020 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2020), No. 574, April 2020. [DOI]
  14. Hiromu Yakura, Youhei Akimoto, and Jun Sakuma. Generate (non-software) Bugs to Fool Classifiers. Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI 2020), pp. 1070-1078, April 2020. [Project Page] [DOI] [arXiv] [Code]
  15. Hiromu Yakura and Jun Sakuma. Robust Audio Adversarial Example for a Physical Attack. Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI 2019), pp. 5334-5441, August 2019. [Project Page] [DOI] [arXiv] [Code]
  16. Riku Arakawa* and Hiromu Yakura*. REsCUE: A framework for REal-time feedback on behavioral CUEs using multimodal anomaly detection. Proceedings of the 2019 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2019), No. 572, May 2019. [DOI] [arXiv]
  17. Hiromu Yakura, Shinnosuke Shinozaki, Reon Nishimura, Yoshihiro Oyama, and Jun Sakuma. Malware Analysis of Imaged Binary Samples by Convolutional Neural Network with Attention Mechanism. Proceedings of the 8th ACM Conference on Data and Application Security and Privacy (ACM CODASPY 2018), pp. 127-134, Match 2018. [DOI]
  18. Hiromu Yakura, Tomoyasu Nakano, and Masataka Goto. FocusMusicRecommender: A System for Recommending Music to Listen to While Working. Proceedings of the 23rd ACM International Conference on Intelligent User Interface (ACM IUI 2018), pp. 7-18, March 2018. [DOI]

Peer-Reviewed International Workshops

  1. Riku Arakawa* and Hiromu Yakura*. AI for human assessment: What do professional assessors need?. Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (ACM CHI 2023 Case Study), No. 378, April 2023. [DOI]
  2. Riku Arakawa* and Hiromu Yakura*. Human-AI communication for human-human communication: Applying interpretable unsupervised anomaly detection to executive coaching. Proceedings of the IJCAI Workshop on Communication in Human-AI Interaction (IJCAI CHAI 2022), 6 pages, July 2022. [arXiv]
  3. Riku Arakawa* and Hiromu Yakura*. AI for human assessment: What do professional assessors need?. Proceedings of the ACM CHI Workshop on Trust and Reliance in AI-Human Teams (CHI TRAIT 2022), 6 pages, April 2022. [arXiv]

Other Publications

  1. Hiromu Yakura. Failure-Resistant Intelligent Interaction for Reliable Human-AI Collaboration. Proceedings of the 2023 AAAI Conference on Artificial Intelligence Special Programs (AAAI 2023 Doctoral Consortium), pp. 16141-16142, September 2023. [DOI]
  2. Hiromu Yakura. A Generative Framework for Designing Interactions to Overcome the Gaps between Humans and Imperfect AIs Instead of Improving the Accuracy of the AIs. Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (ACM CHI 2023 Doctoral Consortium), No. 479, April 2023. [DOI]
  3. Hiromu Yakura, Shinnosuke Shinozaki, Reon Nishimura, Yoshihiro Oyama, and Jun Sakuma. Malware Analysis of Imaged Binary Samples by Convolutional Neural Network with Attention Mechanism. Proceedings of 10th ACM Workshop on Artificial Intelligence and Security (AISec 2017) - Poster, pp. 55-56, November 2017. [DOI]

Dissertations

  1. Hiromu Yakura. Interaction Design for Reconciling Off-The-Shelf Machine Learning Models with Open-Ended User Needs. Ph.D. Dissertation, March 2024. [Paper]
  2. Hiromu Yakura. Peripheral Intelligent Interaction: A novel interaction design presenting media contents to the peripheral area of a user’s consciousness with machine learning. Master’s Thesis, March 2021.

Invited Talks

  1. Hiromu Yakura. Human-Informed Machine Learning Models and Interactions, The 27th Information-Based Induction Sciences Workshop (IBIS 2024), November 2024. [Slide].
  2. Hiromu Yakura. How to make good use of AI technologies: Clarifying the Boundary between Humans and Machines, Tsukuba Conference 2021, September 2021. [Slide]
  3. Hiromu Yakura and Jun Sakuma. Audio Adversarial Example in the Physical World, The 14th International Workshop on Security (IWSEC 2019), August 2019.