Google Research ICASSP 2020 Technical Participation

ICASSP 2020 Technical Participation Google Research Affiliated Authors are ​Bolded A Streaming On-Device End-to-End Model Surpassing Server-Side Conventional Model Quality and Latency Tara N. Sainath, Yanzhang He, Bo Li, Arun Narayanan, Ruoming Pang, Antoine Bruguier, Shuo-yiin Chang, Wei Li, Raziel Alvarez, Zhifeng Chen, Chung-Cheng Chiu, David Garcia, Alex Gruenstein, Ke Hu, Minho Jin, Anjuli Kannan, Qiao Liang, Ian McGraw, Cal Peyser, Rohit Prabhavalkar, Golan Pundak, David Rybach, Yuan Shangguan, Yash Sheth, Trevor Strohman, Mirko Visontai, Yonghui Wu, Yu Zhang, Ding Zhao Session TU1.I: End-to-end Speech Recognition I: Streaming Session Time: Tuesday, 05 May, 11:30 - 13:30 CEST Presentation Time: Tuesday, 05 May, 11:30 - 11:50 CEST Link to Paper Towards Fast and Accurate Streaming End-to-End ASR Bo Li, Shuo-Yiin Chang, Tara N. Sainath, Ruoming Pang, Yanzhang He, Trevor Strohman, Yonghui Wu Session TU1.I: End-to-end Speech Recognition I: Streaming Session Time: Tuesday, 05 May, 11:30 - 13:30 CEST Presentation Time: Tuesday, 05 May, 12:10 - 12:30 CEST Link to Paper Pitch Estimation via Self-Supervision Beat Gfeller, Christian Frank, Dominik Roblek, Matt Sharifi, Marco Tagliasacchi, Mihajlo Velimirovic Session TU1.I: Applications​ in Speech and Audio Session Time: Tuesday, 05 May, 11:30 - 13:30 CEST Presentation Time: Tuesday, 05 May, 11:30 - 13:30 CEST Link to Paper Joint Phoneme-Grapheme Model for End-to-End Speech Recognition Yotaro Kubo, Michiel Bacchiani Session TU2.I: End-to-end Speech Recognition II: New Models Session Time: Tuesday, 05 May, 16:30 - 18:30 CEST Presentation Time: Tuesday, 05 May, 16:30 - 16:50 CEST Link to Paper End-to-End Multi-Talker Overlapping Speech Recognition Anshuman Tripathi, Han Lu, Hasim Sak Session TU2.I: End-to-end Speech Recognition II: New Models Session Time: Tuesday, 0​5 May, 16:30 - 18:30 CEST Presentation Time: Tuesday, 05 May, 17:10 - 17:30 CEST Link to Paper

Hybrid Autoregressive Transducer (HAT) Ehsan Variani, David Rybach, Cyril Allauzen, Michael Riley Session TU2.I: End-to-end Speech Recognition II: New Models Session Time: Tuesday, 05 May, 16:30 - 18:30 CEST Presentation Time: Tuesday, 05 May, 17:50 - 18:10 CEST Link to Paper Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function Iulia M. Comsa, Krzysztof Potempa, Luca Versari, Thomas Fischbacher, Andrea Gesmundo, Jyrki Alakuijala Session TU2.I: Spike-based Neuromorphic Information Representation, Processing and Learning Session Time: Tuesday, 05 May, 16:30 - 18:30 CEST Presentation Time: Tuesday, 05 May, 16:50 - 17:10 CEST Link to Paper Generating Diverse and Natural Text-to-Speech Samples using a Quantized Fine-grained VAE and Autoregressive Prosody Prior Guangzhi Sun,​ Yu Zhang, Ron J. Weiss, Yuan Cao, Heiga Zen, Andrew Rosenberg, Bhuvana Ramabhadran, Yonghui Wu Session TU2.I: Machine Learning for Speech Synthesis I Session Time: Tuesday, 05 May, 16:30 - 18:30 CEST Presentation Time: Tuesday, 05 May, 16:30 - 18:30 CEST Link to Paper Robust Low Rate Speech Coding Based on Cloned Networks and Wavenet Felicia S. C. Lim, W. Bastiaan Kleijn, Michael Chinen, Jan Skoglund Session TU2.I: Speech Analysis and Coding Session Time: Tuesday, 05 May, 16:30 - 18:30 CEST Presentation Time: Tuesday, 05 May, 16:30 - 18:30 CEST Link to Paper Location-Relative Attention Mechanisms for Robust Long-Form Speech Synthesis Eric Battenberg, RJ Skerry-Ryan, Soroosh Mariooryad, Daisy Stanton, David Kao, Matt Shannon, Tom Bagby Session WE1.I: Speech Synthesis and Voice Conversion I Session Time: Wednesday, 06 May, 09:00 - 11:00 CEST Presentation Time: Wednesday, 06 May, 10:00 - 10:20 CEST Link to Paper SpecAugment on Large Scale Datasets Daniel S. Park, Yu Zhang, Chung-Cheng Chiu, Youzheng Chen, Bo Li, William Chan, Quoc V. Le, Yonghui Wu Session WE1.I: Speech Recognition: Acoustic Modelling I Session Time: Wednesday, 06 May, 09:00 - 11:00 CEST Presentation Time: Wednesday, 06 May, 09:00 - 11:00 CEST Link to Paper

Improving Universal Sound Separation Using Sound Classification Efthymios Tzinis, Scott Wisdom, John R. Hershey, Aren Jansen, Daniel P. W. Ellis Session WE2.I: Audio and Speech Source Separation Session Time: Wednesday, 06 May, 11:30 - 13:30 CEST Presentation Time: Wednesday, 06 May, 11:50 - 12:10 CEST Link to Paper Fully-Hierarchical Fine-Grained Prosody Modeling for Interpretable Speech Synthesis Guangzhi Sun, Yu Zhang, Ron J. Weiss, Yuan Cao, Heiga Zen, Yonghui Wu Session WE2.I: Speech Synthesis and Voice Conversion II Session Time: Wednesday, 06 May, 11:30 - 13:30 CEST Presentation Time: Wednesday, 06 May, 11:30 - 11:50 CEST Link to Paper End-to-End Multi-person Audio/Visual Automatic Speech Recognition Otavio Braga, Takaki Makino, Olivier Siohan, Hank Liao Session WE2.I: Robust Speech Recognition Session Time: Wednesday, 06 May, 11:30 - 13:30 CEST Presentation Time: Wednesday, 06 May, 11:30 - 13:30 CEST Link to Paper Coincidence, Categorization, and Consolidation: Learning to Recognize Sounds with Minimal Supervision Aren Jansen, Daniel P. W. Ellis, Shawn Hershey, R. Channing Moore, Manoj Plakal, Ashok C. Popat, Rif A. Saurous Session WE3.I: Classification of Acoustic Scenes and Events Session Time: Wednesday, 06 May, 16:30 - 18:30 CEST Presentation Time: Wednesday, 06 May, 16:30 - 16:50 CEST Link to Paper Improving Speech Recognition Using Consistent Predictions on Synthesized Speech Gary Wang, Andrew Rosenberg, Zhehuai Chen, Yu Zhang, Bhuvana Ramabhadran, Yonghui Wu, Pedro Moreno Session WE3.I: End-to-end Speech Recognition III: General Topics Session Time: Wednesday, 06 May, 16:30 - 18:30 CEST Presentation Time: Wednesday, 06 May, 16:30 - 18:30 CEST Link to Paper RNN-Transducer with Stateless Prediction Network Mohammadreza Ghodsi, Xiaofeng Liu, James Apfel, Rodrigo Cabrera, Eugene Weinstein Session WE3.I: End-to-end Speech Recognition III: General Topics Session Time: Wednesday, 06 May, 16:30 - 18:30 CEST Presentation Time: Wednesday, 06 May, 16:30 - 18:30 CEST Link to Paper An Attention-Based Joint Acoustic and Text On-Device End-to-End Model Tara N. Sainath, Ruoming Pang, Ron J. Weiss, Yanzhang He, Chung-Cheng Chiu, Trevor Strohman Session WE3.I: End-to-end Speech Recognition III: General Topics Session Time: Wednesday, 06 May, 16:30 - 18:30 CEST Presentation Time: Wednesday, 06 May, 16:30 - 18:30 CEST

Link to Paper Re-Translation Strategies for Long Form, Simultaneous, Spoken Language Translation Naveen Arivazhagan, Colin Cherry, Te I, Wolfgang Macherey, Pallavi Baljekar, George Foster Session TH1.I: Spoken Language Translation Session Time: Thursday, 07 May, 09:00 - 11:00 CEST Presentation Time: Thursday, 07 May, 10:00 - 10:20 CEST Link to Paper Speech Sentiment Analysis via Pre-Trained Features from End-to-End ASR Models Zhiyun Lu, Liangliang Cao, Yu Zhang, Chung-Cheng Chiu, James Fan Session TH1.I: Emotion Session Time: Thursday, 07 May, 09:00 - 11:00 CEST Presentation Time: Thursday, 07 May, 09:00 - 11:00 CEST Link to Paper Large-Scale Weakly-Supervised Content Embeddings for Music Recommendation and Tagging Qingqing Huang, Aren Jansen, Li Zhang, Daniel P. W. Ellis, Rif A. Saurous, John Anderson Session TH3.I: Session 3H: Processing of Highly complex, Heterogeneous, High-dimension data Session Time: Thursday, 07 May, 16:30 - 18:30 CEST Presentation Time: Thursday, 07 May, 17:50 - 18:10 CEST Link to Paper Low-Rank Gradient Approximation for Memory-Efficient On-Device Training of Deep Neural Network Mary Gooneratne, Khe Chai Sim, Petr Zadrazil, Andreas Kabel, Francoise Beaufays, Giovanni Motta Session TH3.I: Industry Session on Large-Scale Distributed Learning Strategies Session Time: Thursday, 07 May, 16:30 - 18:30 CEST Presentation Time: Thursday, 07 May, 16:30 - 16:50 CEST Link to Paper BBAND Index: A No-Reference Banding Artifact Predictor Zh ​ engzhong Tu, Jessie Lin, Yilin Wang, Balu Adsumilli, A ​ lan C. Bovik Session TH3.I: Perception and Quality Models Session Time: Thursday, 07 May, 16:30 - 18:30 CEST Presentation Time: Thursday, 07 May, 16:30 - 18:30 CEST Link to Paper AVA Active Speaker: An Audio-Visual Dataset for Active Speaker Detection Joseph Roth, Sourish Chaudhuri, Ondrej Klejch, Radhika Marvin, Andrew Gallagher, Liat Kaver, Sharadh Ramaswamy, Arkadiusz Stopczynski, Cordelia Schmid, Zhonghua Xi, Caroline Pantofaru Session TH3.I: Multimedia Signal Processing Session Time: Thursday, 07 May, 16:30 - 18:30 CEST Presentation Time: Thursday, 07 May, 16:30 - 18:30 CEST Link to Paper

Algorithmic Exploration of American English Dialects Alëna Aksënova, Antoine Bruguier, Amanda Ritchart-Scott, Uri Mendlovic Session TH3.I: Speech Production Session Time: Thursday, 07 May, 16:30 - 18:30 CEST Presentation Time: Thursday, 07 May, 16:30 - 18:30 CEST Link to Paper INDYLSTMS: Independently Recurrent LSTMS Pedro Gonnet, Thomas Deselaers Session FR1.I: Deep Neural Network Structures Session Time: Friday, 08 May, 08:00 - 10:00 CEST Presentation Time: Friday, 08 May, 09:20 - 09:40 CEST Link to Paper Training Keyword Spotters with Limited and Synthesized Speech Data James Lin, Kevin Kilgour, Dominik Roblek, Matthew Sharifi Session FR1.I: Word Spotting Session Time: Friday, 08 May, 08:00 - 10:00 CEST Presentation Time: Friday, 08 May, 08:00 - 10:00 CEST Link to Paper Performance Study of a Convolutional Time-Domain Audio Separation Network for Real-Time Speech Denoising Samuel Sonning, Christian Schüldt, Hakan Erdogan, Scott Wisdom Session FR2.I: Signal Enhancement and Restoration II Session Time: Friday, 08 May, 11:45 - 13:45 CEST Presentation Time: Friday, 08 May, 11:45 - 13:45 CEST Link to Paper Language-agnostic Multilingual Modeling Arindrima Datta, Bhuvana Ramabhadran, Jesse Emond, Anjuli Kannan, Brian Roark Session FR2.I: Multilingual Processing of Language Session Time: Friday, 08 May, 11:45 - 13:45 CEST Presentation Time: Friday, 08 May, 11:45 - 13:45 CEST Link to Paper ESPNET-TTS: Unified, Reproducible, and Integratable Open Source End-to-End Text-to-Speech Toolkit Tomoki Hayashi, Ryuichi Yamamoto, Katsuki Inoue, Takenori Yoshimura, Shinji Watanabe, Tomoki Toda, Kazuya Takeda,​ ​Yu Zhang​, Xu ​ Tan Session FR2.I: Machine Learning for Speech Synthesis III Session Time: Friday, 08 May, 11:45 - 13:45 CEST Presentation Time: Friday, 08 May, 11:45 - 13:45 CEST Link to Paper An Adaptive Linear Estimator Based Approach to Bi-Directional Motion Compensated Prediction Bohan Li, J ​ ingning Han,​ Kenneth Rose Session FR3.I: Image/Video Coding II Session Time: Friday, 08 May, 15:15 - 17:15 CEST Presentation Time: Friday, 08 May, 15:15 - 15:35 CEST Link to Paper

Whosecough: In-the-Wild Cougher Verification Using Multitask Learning Matt Whitehill, ​Jake Garrison,​ Shwetak Patel Session FR3.I: Audio, Speech and Music Analysis Session Time: Friday, 08 May, 15:15 - 17:15 CEST Presentation Time: Friday, 08 May, 15:15 - 17:15 CEST Link to Paper Improving Proper Noun Recognition in End-to-End ASR by Customization of the MWER Loss Criterion Cal Peyser, Tara N. Sainath, Golan Pundak Session FR3.I: Large Vocabulary Continuous Speech Recognition and Search Session Time: Friday, 08 May, 15:15 - 17:15 CEST Presentation Time: Friday, 08 May, 15:15 - 17:15 CEST Link to Paper Deliberation Model Based Two-Pass End-to-End Speech Recognition Ke Hu, Tara N. Sainath, Ruoming Pang, Rohit Prabhavalkar Session FR3.I: Large Vocabulary Continuous Speech Recognition and Search Session Time: Friday, 08 May, 15:15 - 17:15 CEST Presentation Time: Friday, 08 May, 15:15 - 17:15 CEST Link to Paper Incorporating Written Domain Numeric Grammars into End-to-End Contextual Speech Recognition Systems for Improved Recognition of Numeric Sequences Ben Haynor, Petar Aleksic Session FR3.I: Large Vocabulary Continuous Speech Recognition and Search Session Time: Friday, 08 May, 15:15 - 17:15 CEST Presentation Time: Friday, 08 May, 15:15 - 17:15 CEST Link to Paper Multistate Encoding with End-to-End Speech RNN Transducer Network Zelin Wu, Bo Li, Yu Zhang, Petar S. Aleksic, Tara N. Sainath Session FR3.I: Large Vocabulary Continuous Speech Recognition and Search Session Time: Friday, 08 May, 15:15 - 17:15 CEST Presentation Time: Friday, 08 May, 15:15 - 17:15 CEST Link to Paper Neural Oracle Search on N-Best Hypotheses Ehsan Variani, Tongzhou Chen, James Apfel, Bhuvana Ramabhadran, Seungji Lee, Pedro Moreno Session FR3.I: Large Vocabulary Continuous Speech Recognition and Search Session Time: Friday, 08 May, 15:15 - 17:15 CEST Presentation Time: Friday, 08 May, 15:15 - 17:15 CEST Link to Paper Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss Qian Zhang, Han Lu, Hasim Sak, Anshuman Tripathi, Erik McDermott, Stephen Koo, Shankar Kumar Session FR3.I: Large Vocabulary Continuous Speech Recognition and Search Session Time: Friday, 08 May, 15:15 - 17:15 CEST

Presentation Time: Friday, 08 May, 15:15 - 17:15 CEST Link to Paper Learning to Detect Keyword Parts and Whole by Smoothed Max Pooling Hyun-Jin Park, Patrick Violette, Niranjan Subrahmanya Session FR3.I: Speech Recognition: General Topics Session Time: Friday, 08 May, 15:15 - 17:15 CEST Presentation Time: Friday, 08 May, 15:15 - 17:15 CEST Link to Paper

Panel Signal Processing for Extended Reality Organizer: ​Gustavo Hernandez Abrego Speaker:​ Daniel Filip Friday, May 8, 17:15 – 18:15 CEST

Session Chairs TU2.I: End-to-end Speech Recognition II: New Models Session Chair: ​Tara Sainath Session Type: Lecture Time: Tuesday, 5 May, 16:30 - 18:30 CEST WE1.I: Speech Enhancement II: Single Channel Sessi​on Chair: ​John Hershey Session Type: Lecture Time: Wednesday, 6 May, 09:00 - 11:00 CEST WE1.I: Speech Recognition: Acoustic Modelling I Session Chair: ​Rohit Prabhavalkar Session Type: Poster Time: Wednesday, 6 May, 09:00 - 11:00 CEST WE2.I: Audio and Speech Source Separation Session Chair:​ Scott Wisdom Session Type: Lecture Time: Wednesday, 6 May, 11:30 - 13:30 CEST TH2.I: Speech Separation and Extraction III Session Chair: ​Hakan Erdogan Session Type: Poster Time: Thursday, 7 May, 11:30 - 13:30 CEST TH3.I: Industry Session on Large-Scale Distributed Learning Strategies Session Chair: B ​ huvana Ramabhadran Session Type: Lecture

Time: Thursday, 7 May, 16:30 - 18:30 CEST FR2.I: Machine Learning for Speech Synthesis III Session Chair: Y ​ u Zhang Session Type: Poster Time: Friday, 8 May, 11:45 - 13:45 CEST FR2.I: Speech Recognition: Acoustic Modelling II Session Chairs: A ​ run Narayanan Session Type: Poster Time: Friday, 8 May, 11:45 - 13:45 CEST

Plenary Conversational Systems and the Marriage of Speech and Language Mari Ostendorf Friday, 8 May, 10:30 - 11:30 CEST