Joel Shor

I'm a Google / Verily AI researcher working in AI for Social Good. I'm focused on healthcare, accessibility, and speech.

Email / Google Scholar / Patents


Some projects:

Research on Inflammatory Bowel Disease

  • Developing product to detect and classify polyps in realtime

  • Custom video compression for preserving medically relevant video content (NeurIPS 2022 workshop paper: Medical imaging meets NeurIPS)

  • Superresolution and video compression patents

  • Exploring metabolomic data as a disease predictor

DeepConsensus sequence transformers for PacBio Circular Consensus Sequencing data

Covid-19 Forecasting in Japan and the US

  • Launched a 28-day Covid19 public forecast for Japan. Used by top government policymakers to shape Japan’s Covid response. Seen by millions of people worldwide [paper, blog post]

  • Work won VLED Award for enhancing public good with Big Data, received “Feats of Engineering” award from Google Cloud, and I was recognized with a “Citizen Awards: Collaboration Category

  • “Visiting Researcher” at Japan’s top-ranked research university, Keio University, in the school of Medicine, to investigate the reliability of large-scale surveys in helping model the spread of COVID-19 [announcement]

Non-text aspects of speech

  • Created many novel representations for paralinguistic speech [blog post, Interspeech papers 1, 2, code, models]

  • Uses include fake audio detection (patent), cough detection (patent), and disordered speech detection [paper], and tracking mental wellbeing (patents 2x). Many external academic and start-up collaborators

  • State-of-the-art paralinguistic representations, applied to better understanding emotion, user intent, and medically-impacted speakers [papers ex. 1, 2, 3, 4, 5], in ex. ICASSP, Interspeech, and IEEE Signal Processing [patents ex 1, 2, 3]

  • Work successfully ported to the open source Hugging Face (github)

Accessibility for speech

  • Co-creator and former tech lead of project Euphonia, which gives patients who lost their voice back the ability to speak with their original voice

  • Announced at Google I/O 2018 [blog post, paper, Google I/O video, documentary video] and mentioned in Google’s 2018 “Letter to the Founders

Co-create of TensorFlow GAN, an open-source library for easily training and evaluating Generative Adversarial Networks

Invited talks

  • (2022-10) Google research conference

  • (2022-04) Tech talk at Boston University’s Math & Statistics department

  • (2022-04) Tech talk at Boston University’s Mathematical Association of America

  • (2022-04) Tech talk at MIT’s Department of Electrical Engineering & Computer Science course 6.345/HST.728

  • (2022-03) Tech Talk at Boston University (link)

  • (2022-02) Co-presenter at the 4th Conference of the Japan Society of Colon Examination in Hokkaido [poster]

  • (2022-02) National Institute of Informations (NII), Japan

  • (2021-12) MIT CSAIL’s Spoken Language Systems Group


Education

  • Princeton BA in Mathematics

  • Manfred Memorial Manfred Pyka Memorial Physics Prize