Ushiku Yoshitaka 牛久祥孝

Researcher Number	10784142
Other IDs
Affiliation (Current)	2025: オムロンサイニックエックス株式会社, リサーチアドミニストレイティブディビジョン, プリンシパルインベスティゲーター
Affiliation (based on the past Project Information) *help	2019 – 2025: オムロンサイニックエックス株式会社, リサーチアドミニストレイティブディビジョン, プリンシパルインベスティゲーター 2017 – 2018: 東京大学, 大学院情報理工学系研究科, 講師
Review Section/Research Field	Except Principal Investigator Medium-sized Section 61:Human informatics and related fields / Multimedia database
Keywords	Except Principal Investigator 自然言語処理 / デザイン / 生成AI / 情景内文字 / 文字 / 機械学習 / 文字認識 / 文字科学 / 大規模言語モデル / マルチモーダル … More / タイポグラフィー / 障碍者支援 / 教育 / 認知心理 / 古典籍 / フォントデザイン / コミュニケーション / ロボティクス / クロスモーダル処理 / マルチメディア情報処理 / 画像、文章、音声等認識 / 画像記述 / 深層学習 / 印象 / フォント / 文字工学 Less

視覚的自然言語処理の創出
- Principal Investigator
  
  内田誠一
- Project Period (FY)
  2025 – 2027
- Research Category
  
  Grant-in-Aid for Scientific Research (A)
- Review Section
  
  Medium-sized Section 61:Human informatics and related fields
- Research Institution
  Kyushu University
文字を介した視覚的コミュニケーション基盤の創成
- Principal Investigator
  
  内田誠一
- Project Period (FY)
  2022 – 2024
- Research Category
  
  Grant-in-Aid for Scientific Research (A)
- Review Section
  
  Medium-sized Section 61:Human informatics and related fields
- Research Institution
  Kyushu University
Development of Motion Generation Technology to Realize Robots that Perform Various Tasks according to Natural Language Instructions
- Principal Investigator
  
  Hashimoto Atsushi
- Project Period (FY)
  2021 – 2023
- Research Category
  
  Grant-in-Aid for Scientific Research (A)
- Review Section
  
  Medium-sized Section 61:Human informatics and related fields
- Research Institution
  OMRON SINIC X Corporation
From Text Engineering to Text Science
- Principal Investigator
  
  Uchida Seiichi
- Project Period (FY)
  2017 – 2021
- Research Category
  
  Grant-in-Aid for Scientific Research (S)
- Research Field
  
  Multimedia database
- Research Institution
  Kyushu University
文字科学 ― 文字の機能の多面的解明
- Principal Investigator
  
  内田誠一
- Project Period (FY)
  2017
- Research Category
  
  Grant-in-Aid for Scientific Research (A)
- Research Field
  
  Multimedia database
- Research Institution
  Kyushu University

All 2024 2023 2022 2021 2020 2019 2018

All Journal Article Presentation Book

[Book] コンピュータビジョン2018
- Author(s)
  米谷竜、斎藤英雄、池畑諭、牛久祥孝、内山英昭、内海ゆづ子、小野峻佑、片岡裕雄、金崎朝子、川西康友、齋藤真樹、櫻田健、高橋康輔、松井勇佑
- Total Pages
  272
- Publisher
  共立出版
- ISBN
  9784320123571
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posters2024
- Author(s)
  Hao Wang, Shohei Tanaka, Yoshitaka Ushiku
- Journal Title
  
  CVPR Workshop on Graphic Design Understanding and Generation
  
  Volume: -
- Peer Reviewed
- Data Source
  KAKENHI-PROJECT-22H00540
[Journal Article] Recipe Generation from Unsegmented Cooking Videos2024
- Author(s)
  Nishimura Taichi、Hashimoto Atsushi、Ushiku Yoshitaka、Kameko Hirotaka、Mori Shinsuke
- Journal Title
  
  ACM Transactions on Multimedia Computing, Communications, and Applications
  
  Volume: -
- DOI
  10.1145/3649137
- Peer Reviewed / Open Access
- Data Source
  KAKENHI-PROJECT-21H04910
[Journal Article] State-aware video procedural captioning2023
- Author(s)
  Nishimura Taichi、Hashimoto Atsushi、Ushiku Yoshitaka、Kameko Hirotaka、Mori Shinsuke
- Journal Title
  
  Multimedia Tools and Applications
  
  Volume: 82 Issue: 24 Pages: 37273-37301
- DOI
  10.1007/s11042-023-14774-7
- Peer Reviewed
- Data Source
  KAKENHI-PROJECT-21H04910
[Journal Article] BioVL2: An Egocentric Biochemical Video-and-Language Dataset2022
- Author(s)
  Nishimura Taichi、Sakoda Kojiro、Ushiku Atsushi、Hashimoto Atsushi、Okuda Natsuko、Ono Fumihito、Kameko Hirotaka、Mori Shinsuke
- Journal Title
  
  Journal of Natural Language Processing
  
  Volume: 29 Issue: 4 Pages: 1106-1137
- DOI
  10.5715/jnlp.29.1106
- ISSN
  1340-7619, 2185-8314
- Language
  Japanese
- Data Source
  KAKENHI-PROJECT-21H04910
[Journal Article] Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows2022
- Author(s)
  Keisuke Shirai, Atsushi Hashimoto, Taichi Nishimura, Hirotaka Kameko, Shuhei Kurita, Yoshitaka Ushiku, and Shinsuke Mori
- Journal Title
  
  Proceedings of the 29th International Conference on Computational Linguistics
  
  Volume: なし Pages: 3570-3577
- Peer Reviewed / Open Access
- Data Source
  KAKENHI-PROJECT-22H00540
[Journal Article] Divergence Optimization for Noisy Universal Domain Adaptation2021
- Author(s)
  Qing Yu, Atsushi Hashimoto, Yoshitaka Ushiku
- Journal Title
  
  IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR2021)
  
  Volume: -
- Peer Reviewed / Open Access / Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] Denoising Pseudo-Captions in Unsupervised Image Captioning2021
- Author(s)
  Ukyo Honda, Yoshitaka, Ushiku, Atsushi Hashimoto, Taro Watanabe, Yuji Matsumoto
- Journal Title
  
  The 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL2021)
  
  Volume: -
- Peer Reviewed
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] Divergence Optimization for Noisy Universal Domain Adaptation2021
- Author(s)
  Qing Yu, Atsushi Hashimoto, and Yoshitaka Ushiku
- Journal Title
  
  The IEEE Conference on Computer Vision and Pattern Recognition
  
  Volume: -
- Peer Reviewed / Open Access / Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] State-aware Video Procedural Captioning2021
- Author(s)
  Nishimura Taichi、Hashimoto Atsushi、Ushiku Yoshitaka、Kameko Hirotaka、Mori Shinsuke
- Journal Title
  
  Proc. of ACM Multimedia
  
  Volume: - Pages: 1766-1774
- DOI
  10.1145/3474085.3475322
- Peer Reviewed
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] Removing Word-Level Spurious Alignment between Images and Pseudo-Captions in Unsupervised Image Captioning2021
- Author(s)
  Honda Ukyo、Ushiku Yoshitaka、Hashimoto Atsushi、Watanabe Taro、Matsumoto Yuji
- Journal Title
  
  The Conference of the European Chapter of the Association for Computational Linguistics
  
  Volume: -
- DOI
  10.18653/v1/2021.eacl-main.323
- Peer Reviewed / Open Access
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] Structure-Aware Procedural Text Generation From an Image Sequence2020
- Author(s)
  T. Nishimura, A. Hashimoto, Y. Ushiku, H. Kameko, Y. Yamakata and S. Mori
- Journal Title
  
  IEEE Access
  
  Volume: 9 Pages: 2125-2141
- DOI
  10.1109/access.2020.3043452
- Peer Reviewed / Open Access
- Data Source
  KAKENHI-PROJECT-18K11425, KAKENHI-PROJECT-17H06100
[Journal Article] Generating Easy-to-understand Referring Expressions for Target Identifications2020
- Author(s)
  Mikihiro TANAKA, Takayuki ITAMOCHI, Kenichi NARIOKA, Ikuro SATO, Yoshitaka USHIKU, Tatsuya HARADA
- Journal Title
  
  NIHON GAZO GAKKAISHI (Journal of the Imaging Society of Japan)
  
  Volume: 59 Issue: 6 Pages: 591-600
- DOI
  10.11370/isj.59.591
- NAID
  130007952863
- ISSN
  1344-4425, 1880-4675
- Year and Date
  2020-12-10
- Language
  English
- Peer Reviewed
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] Class-distinct and class-mutual image generation with GANs2019
- Author(s)
  Takuhiro Kaneko, Yoshitaka Ushiku, and Tatsuya Harada
- Journal Title
  
  British Machine Vision Conference (BMVC 2019
  
  Volume: -
- Peer Reviewed
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] Label-Noise Robust Generative Adversarial Networks2019
- Author(s)
  Takuhiro Kaneko, Yoshitaka Ushiku, Tatsuya Harada
- Journal Title
  
  Proc. IEEE Conference on Computer Vision and Pattern Recognition
  
  Volume: －
- Peer Reviewed
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] Label-noise robust generative adversarial networks2019
- Author(s)
  Takuhiro Kaneko, Yoshitaka Ushiku, and Tatsuya Harada
- Journal Title
  
  IEEE/CVF Conference on Computer Vision and Pattern Recognition
  
  Volume: -
- Peer Reviewed / Open Access
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] Generating Easy-to-Understand Referring Expressions for Target Identifications2019
- Author(s)
  Mikihiro Tanaka, Takayuki Itamochi, Kenichi Narioka, Ikuro Sato, Yoshitaka Ushiku, and Tatsuya Harada
- Journal Title
  
  IEEE/CVF International Conference on Computer Vision
  
  Volume: -
- NAID
  130007952863
- Peer Reviewed / Open Access
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] 視覚・言語融合の最前線2018
- Author(s)
  牛久祥孝 (著, 編集), 山口正隆 (著), 福井啓 (著), 中山英樹 (著), 齋藤真樹 (著), 吉川友也 (著), 重藤優太郎 (著), 竹内彰一 (著)
- Journal Title
  
  映像情報メディア学会誌
  
  Volume: 72.5
- Data Source
  KAKENHI-PROJECT-17H06100
[Journal Article] 画像/動画の高精度キャプション生成技術2018
- Author(s)
  牛久祥孝
- Journal Title
  
  光学
  
  Volume: 47
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] PolarDB: Formula-driven Dataset for Pre-training Trajectory Encoders2024
- Author(s)
  Sota Miyamoto, Takuma Yagi, Yuto Makimoto, Mahiro Ukai, Yoshitaka Ushiku, Atsushi Hashimoto, Nakamasa Inoue
- Organizer
  International Conference on Acoustics, Speech, and Signal Processing
- Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-21H04910
[Presentation] 調理作業理解のための言語資源付き固定視点映像データセットの構築2024
- Author(s)
  橋本敦史, 前田航希, 平澤寅庄, 原島純, Rybicki Leszek, 深澤祐援, 牛久祥孝
- Organizer
  人工知能学会全国大会
- Data Source
  KAKENHI-PROJECT-21H04910
[Presentation] Vision-Language Interpreter for Robot Task Planning2024
- Author(s)
  Keisuke Shirai, Cristian C. Beltran-Hernandez, Masashi Hamaya, Atsushi Hashimoto, Shohei Tanaka, Kento Kawaharazuka, Kazutoshi Tanaka, Yoshitaka Ushiku, and Shinsuke Mori
- Organizer
  International Conference on Robotics and Automation
- Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-21H04910
[Presentation] 手の軌道特徴を用いた一人称視点料理動画における詳細動作認識2023
- Author(s)
  宮本蒼太, 八木拓真, 牛久祥孝, 橋本敦史, 井上中順
- Organizer
  電子情報通信学会PRMU研究会
- Data Source
  KAKENHI-PROJECT-21H04910
[Presentation] Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows2022
- Author(s)
  Keisuke Shirai, Atsushi Hashimoto, Taichi Nishimura, Hirotaka Kameko, Shuhei Kurita, Yoshitaka Ushiku, and Shinsuke Mori
- Organizer
  The 29th International Conference on Computational Linguistics
- Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-22H00540
[Presentation] Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows2022
- Author(s)
  Keisuke Shirai, Atsushi Hashimoto, Taichi Nishimura, Hirotaka Kameko, Shuhei Kurita, Yoshitaka Ushiku, Shinsuke Mori
- Organizer
  COLING2022
- Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-21H04910
[Presentation] Cross-modal Representation Learning for Understanding Manufacturing Procedure2022
- Author(s)
  Atsushi Hashimoto, Taichi Nishimura, Yoshitaka Ushiku, Hirotaka Kameko, Shinsuke Mori
- Organizer
  HCII2022
- Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-21H04910
[Presentation] レシピ分野における動作対象の状態変化を考慮したデータセットの構築と検索モデルの提案2022
- Author(s)
  白井圭佑, 橋本敦史, 牛久祥孝, 栗田修平, 亀甲博貴, 森信介
- Organizer
  言語処理学会第28回年次大会
- Data Source
  KAKENHI-PROJECT-21H04910
[Presentation] Egocentric Biochemical Video-and-Language Dataset2021
- Author(s)
  Nishimura Taichi、Sakoda Kojiro、Hashimoto Atsushi、Ushiku Yoshitaka、Tanaka Natsuko、Ono Fumihito、Kameko Hirotaka、Mori Shinsuke
- Organizer
  The 4th Workshop on Closing the Loop Between Vision and Language in conjunction with ICCV2021
- Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-21H04910
[Presentation] State-aware Video Procedural Captioning2021
- Author(s)
  Nishimura Taichi、Hashimoto Atsushi、Ushiku Yoshitaka、Kameko Hirotaka、Mori Shinsuke
- Organizer
  The 29th ACM International Conference on Multimedia
- Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-21H04910
[Presentation] Challenges of Integrating Vision and Language.2021
- Author(s)
  Yoshitaka Ushiku
- Organizer
  International Display Workshops
- Invited / Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] Multimodal Understanding: Vision and Language, and its Beyond2021
- Author(s)
  Yoshitaka Ushiku
- Organizer
  International Workshop on Frontiers of Computer Vision
- Invited / Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] マルチモーダル理解～Vision and Languageとその先へ2021
- Author(s)
  牛久祥孝
- Organizer
  京都大学学術情報メディアセンターセミナー
- Invited
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] Deep Learning for Natural Language Processing and Computer Vision2019
- Author(s)
  Yoshitaka Ushiku
- Organizer
  Asian Conference on Machine Learning (ACML)
- Invited / Int'l Joint Research
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] 深層学習によるビジョン＆ランゲ―ジの世界2019
- Author(s)
  牛久祥孝
- Organizer
  ビジョン技術の実利用ワークショップ(ViEW)
- Invited
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] Collecting Relation-Aware Video Captions2019
- Author(s)
  Mayu Otani, Kazuhiro Ota, Yuta Nakashima, Esa Rahtu, Janne Heikkila, and Yoshitaka Ushiku
- Organizer
  画像の認識・理解シンポジウム(MIRU)
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] 画像・映像理解と自然言語への架け橋2019
- Author(s)
  牛久祥孝
- Organizer
  情報処理学会連続セミナー第3回
- Invited
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] 多様なデータへのキャプションを自動で生成する技術の創出2019
- Author(s)
  牛久祥孝
- Organizer
  情報科学技術フォーラム(FIT)
- Invited
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] 機械学習による生成技術とその応用展開2018
- Author(s)
  牛久祥孝
- Organizer
  ISID エンジニアリングフォーラム 2018
- Invited
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] Deep Learningによる視覚・言語融合の最前線2018
- Author(s)
  牛久祥孝
- Organizer
  精密工学会画像応用技術専門委員会
- Invited
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] 機械学習による生成技術とその応用展開2018
- Author(s)
  牛久祥孝
- Organizer
  ITOC機械学習セミナーシリーズ
- Invited
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] 視覚と対話の融合研究2018
- Author(s)
  牛久祥孝
- Organizer
  人工知能学会言語・音声理解と対話処理研究会(SIG-SLUD)
- Invited
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] Deep Learningによる視覚・言語融合の最前線2018
- Author(s)
  牛久祥孝
- Organizer
  NLP若手の会 (YANS) 第13回シンポジウム
- Invited
- Data Source
  KAKENHI-PROJECT-17H06100
[Presentation] 情景内文字情報を考慮した画像説明文生成2018
- Author(s)
  川口維文, 牛久祥孝, 内田誠一
- Organizer
  電子情報通信学会パターン認識・メディア理解研究会
- Data Source
  KAKENHI-PROJECT-17H06100

1. Uchida Seiichi (70315125)

# of Collaborated Projects: 4 results

# of Collaborated Products: 1 results
2. 柳井啓司 (20301179)

# of Collaborated Projects: 3 results

# of Collaborated Products: 0 results
3. 中山英樹 (00643305)

# of Collaborated Projects: 2 results

# of Collaborated Products: 0 results
4. Hashimoto Atsushi (80641753)

# of Collaborated Projects: 1 results

# of Collaborated Products: 11 results
5. 井上中順 (10733397)

# of Collaborated Projects: 1 results

# of Collaborated Products: 2 results
6. 濱屋政志 (10869176)

# of Collaborated Projects: 1 results

# of Collaborated Products: 1 results
7. 松原崇充 (20508056)

# of Collaborated Projects: 1 results

# of Collaborated Products: 0 results
8. 森信介 (90456773)

# of Collaborated Projects: 1 results

# of Collaborated Products: 8 results
9. ベルトランエルナンデスクリスティアンカミロ (30984017)

# of Collaborated Projects: 1 results

# of Collaborated Products: 1 results
10. VON・DRIGALSKI FELIX (90869215)

# of Collaborated Projects: 1 results

# of Collaborated Products: 0 results
11. 北本朝展 (00300707)

# of Collaborated Projects: 1 results

# of Collaborated Products: 0 results
12. 大町真一郎 (30250856)

# of Collaborated Projects: 1 results

# of Collaborated Products: 0 results
13. 塩入諭 (70226091)

# of Collaborated Projects: 1 results

# of Collaborated Products: 0 results
14. 黄瀬浩一 (80224939)

# of Collaborated Projects: 1 results

# of Collaborated Products: 0 results
15. 岩村雅一 (80361129)

# of Collaborated Projects: 1 results

# of Collaborated Products: 0 results
16. 山本和明 (90249433)

# of Collaborated Projects: 1 results

# of Collaborated Products: 0 results
17. 荒瀬由紀 (00747165)

# of Collaborated Projects: 1 results

# of Collaborated Products: 0 results
18. 山肩洋子

# of Collaborated Projects: 0 results

# of Collaborated Products: 1 results

Ushiku Yoshitaka 牛久 祥孝

Research Projects

Research Products

Co-Researchers

視覚的自然言語処理の創出

Principal Investigator

Project Period (FY)

Research Category

Review Section

Research Institution

文字を介した視覚的コミュニケーション基盤の創成

Principal Investigator

Project Period (FY)

Research Category

Review Section

Research Institution

Development of Motion Generation Technology to Realize Robots that Perform Various Tasks according to Natural Language Instructions

Principal Investigator

Project Period (FY)

Research Category

Review Section

Research Institution

From Text Engineering to Text Science

Principal Investigator

Project Period (FY)

Research Category

Research Field

Research Institution

文字科学 ― 文字の機能の多面的解明

Principal Investigator

Project Period (FY)

Research Category

Research Field

Research Institution

[Book] コンピュータビジョン2018

Author(s)

Total Pages

Publisher

ISBN

Data Source

[Journal Article] SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posters2024

Author(s)

Journal Title

Data Source

[Journal Article] Recipe Generation from Unsegmented Cooking Videos2024

Author(s)

Journal Title

DOI

Data Source

[Journal Article] State-aware video procedural captioning2023

Author(s)

Journal Title

DOI

Data Source

[Journal Article] BioVL2: An Egocentric Biochemical Video-and-Language Dataset2022

Author(s)

Journal Title

DOI

ISSN

Language

Data Source

[Journal Article] Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows2022

Author(s)

Journal Title

Data Source

[Journal Article] Divergence Optimization for Noisy Universal Domain Adaptation2021

Author(s)

Journal Title

Data Source

[Journal Article] Denoising Pseudo-Captions in Unsupervised Image Captioning2021

Author(s)

Journal Title

Data Source

[Journal Article] Divergence Optimization for Noisy Universal Domain Adaptation2021

Author(s)

Journal Title

Data Source

[Journal Article] State-aware Video Procedural Captioning2021

Author(s)

Journal Title

Ushiku Yoshitaka 牛久祥孝