Show notes

Show notes

The Shape of Things to Come podcast series

The Shape of Things to Come podcast series

Show notes

Show notes

Show notes

Show notes

Show notes

Show notes: https://www.microsoft.com/en-us/research/podcast/ai-testing-and-evaluation-reflections/

Show notes

Show notes

Show notes

Show notes

Read the paper

Get started with Azure AI Foundry Labs

Read the paper

Read the paper

Learn more:

Verus: A Practical Foundation for Systems Verification | Publication, November 2024

SuperBench: Improving Cloud AI Infrastructure Reliability with Proactive Validation | Publication, July 2024

BitNet: Scaling 1-bit Transformers for Large Language Models | Publication, October 2023

Read the paper

Get datasets and codes

Read the paper

Get the code

Read the paper

Get the dataset

Read the paper

Get the Trellis BMA code: GitHub - microsoft/TrellisBMA: Trellis BMA: coded trace reconstruction on IDS channels for DNA storage

Read the paper

Get the code

Learn more:

• As Generative Models Improve, People Adapt Their Prompts | Publication, July 2024
• AI, Cognition, and the Economy (AICE) | Initiative page

Read the paper

Read the paper

In this episode, Angela Busheska, an undergraduate engineering student at Lafayette College, talks to Senior Researcher Vaishnavi Ranganathan, about her work on TerraTrace, a platform that brings together statistics and large language models to track land use over time for agricultural and forestry applications. Busheska discusses the personal loss that drew her to climate activism, the chain of events that led to a memorable face-to-face meeting with Microsoft’s chief sustainability officer, and her advice for going after the internship you want and making the experience count.

Learn more:

• TerraTrace | GitHub repo
• Project FarmVibes | Project homepage
• Project FoodVibes | Project homepage

The Find My Things story is an example of research at Microsoft enhancing Microsoft products and services. To try the Find My Things tool, download the free, publicly available Seeing AI app.

Learn more:

• Find My Things: Personalized Accessibility through Teachable AI for People who are Blind or Low Vision | Publication, May 2024
• Understanding Personalized Accessibility through Teachable AI: Designing and Evaluating Find My Things for People who are Blind or Low Vision | Publication, October 2023
• Teachable AI Experiences (Tai X) | Project page
• PeopleLens | Publication, June 2021
• ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognition | Publication, October 2021
• Collaborators: Teachable AI with Cecily Morrison and Karolina Pakėnaitė | Microsoft Research Podcast, December 2023

Learn more:

• Avenues: The World School — Golden Record 2.0
• Project homepage
• Golden Record: Overview
• NASA Science
• Project Silica
• Project homepage
• Sealed in glass
• Microsoft Unlocked innovation story, 2023
• Optics for the cloud: storage in the zettabyte era with Dr. Ant Rowstron and Mark Russinovich
• Microsoft Research Podcast, November 2019
• Project Silica proof of concept stores Warner Bros. ‘Superman’ movie on quartz glass
• Microsoft Source blog, November 2019

Learn more:

• Microsoft Premonition
• Project Eclipse
• Project PRISM
• 3D Telemedicine
• Jacdac
• Audio Devices

Learn more:

• AI, Cognition, and the Economy (AICE) | Initiative page
• Ideas: Designing AI for people with Abigail Sellen | Microsoft Research Podcast, May 2024

Learn more:

• AI Controller Interface: Generative AI with a lightweight, LLM-integrated VM (blog)
• AICI: Prompts as (Wasm) Programs (GitHub)

Read the paper

Get the code

Read the paper

Learn more:

• Recyclable vitrimer-based printed circuit boards for sustainable electronics | Nature Sustainability, April 2024
• Microsoft Climate Research Initiative
• Microsoft Research AI for Science
• Storing digital data in synthetic DNA with Dr. Karin Strauss | Microsoft Research Podcast, October 2018

Learn more:

• Solving Max-Min Fair Resource Allocations Quickly on Large Graphs | Publication, February 2024
• Finding Adversarial Inputs for Heuristics using Multi-level Optimization | Publication, February 2024
• MetaOpt: Examining, explaining, and improving heuristic performance | Microsoft Research blog, January 2024
• A Holistic View of AI-driven Network Incident Management | Publication, October 2023
• Behnaz Arzani: Painting, storytelling, and other hobbies | Microsoft Research bio page

Learn more:

• Weishung Liu at Microsoft Research
• Watch For | Project page
• Developer Tech Minutes: Watch For | Video, 2021

Learn more:

• AI, Cognition, and the Economy (AICE) 
• Responsible AI Principles and Approach | Microsoft AI  
• The Rise of the AI Co-Pilot: Lessons for Design from Aviation and Beyond 
• The Myth of the Paperless Office

Learn more:

• WindSeer: Real-time volumetric wind prediction over complex terrain aboard a small uncrewed aerial vehicle

Learn more:

• Jacki O'Neill at Microsoft Research
• Microsoft Research Africa (formerly MARI)

Read the paper

Get the code & dataset

Learn more:

• AI Frontiers - Microsoft Research
• Responsible AI Principles and Approach | Microsoft AI

Read the paper

Learn more:

• The State and Fate of Linguistic Diversity and Inclusion in the NLP World | Publication, July 2020
• Project VeLLM | Project page
• Kahani: Visual Storytelling | Project page
• Kahani: Visual Storytelling through Culturally Nuanced Images | Microsoft Research Forum | Episode 1, January 2024
• Teachers in India help Microsoft Research design AI tool for creating great classroom content | Microsoft Research blog, October 2023
• Digital Labor: Project Karya | Project page
• Village by village, creating the building blocks for AI tools with work that also educates | Microsoft Source Asia blog, February 2024

Learn more:

• AI and Microsoft Research | Focus Area
• Evaluating Cognitive Maps and Planning in Large Language Models with CogEval | Publication, October 2023
• Imitating Human Behaviour with Diffusion Models | Publication, May 2023
• Navigates Like Me: Understanding How People Evaluate Human-Like AI in Video Games | Publication, April 2023
• Navigation Turing Test (NTT): Learning to Evaluate Human-Like Navigation | Publication, July 2021
• Predictive Representations in Hippocampal and Prefrontal Hierarchies | Publication, January 2022
• The successor representation in human reinforcement learning | Publication, September 2017
• Encoding of Prospective Tasks in the Human Prefrontal Cortex under Varying Task Loads | Publication, October 2013

Read the paper

Read the paper

Learn more:

• Nicole Forsgren at Microsoft Research
• Nicole Forsgren website
• Quantifying the impact of developer experience | Microsoft Azure Blog, January 2024
• Yes, good DevEx increases productivity. Here is the data. | GitHub blog, January 2024
• Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations | Book, 2018

Learn more:

• Ivan Tashev at Microsoft Research
• Distributed Meetings: A Meeting Capture and Broadcasting System | Publication, December 2002
• Research Collection: The Unseen History of Audio and Acoustics Research at Microsoft | Microsoft Research blog, August 2020 

Learn more:

• The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction | Publication, December 2023
• LASER code on GitHub

In this Microsoft Research Podcast series, AI scientist and engineer Ashley Llorens hosts conversations with his collaborators and colleagues about what these models—and the models that will come next—mean for our approach to creating, understanding, and deploying AI, its applications in areas such as healthcare and education, and its potential to benefit humanity.

This episode features Technical Fellow Christopher Bishop, who leads a global team of researchers and engineers working to help accelerate scientific discovery by merging machine learning and the natural sciences. Llorens and Bishop explore the state of deep learning; Bishop’s new textbook Deep Learning: Foundations and Concepts, his third and a writing collaboration with his son; and a potential future in which “super copilots” accessible via natural language and drawing on a variety of tools, like those that can simulate the fundamental equations of nature, are empowering scientists in their pursuit of breakthrough.

Learn more:

• Deep Learning: Foundations and Concepts | Textbook, 2023
• Pattern Recognition and Machine Learning | Textbook, 2006
• Neural Networks for Pattern Recognition | Textbook, 1995

In this episode, Senior Principal Research Manager Tao Qin and Senior Researcher Lijun Wu discuss “FABind: Fast and Accurate Protein-Ligand Binding.” The paper, accepted at the 2023 Conference on Neural Information Processing Systems (NeurIPS), introduces a new method for predicting the binding structures of proteins and ligands during drug development. The method demonstrates improved speed and accuracy over current methods.

Learn more:

• FABind: Fast and Accurate Protein-Ligand Binding
• FABind code on GitHub

In this episode, Principal Researcher Alessandro Sordoni joins host Gretchen Huizinga to discuss “Joint Prompt Optimization of Stacked LLMs using Variational Inference.” In the paper, which was accepted at the 2023 Conference on Neural Information Processing Systems (NeurIPS), Sordoni and his coauthors introduce Deep Language Networks, or DLNs, an architecture that treats large language models as layers within a network and natural language prompts as each layer’s learnable parameters.

Read the paper

In this episode, Xing Xie, a Senior Principal Research Manager of Microsoft Research Asia, joins host Dr. Gretchen Huizinga to discuss “Evaluating General-Purpose AI with Psychometrics.” As AI capabilities move from task specific to more general purpose, the paper explores psychometrics, a subfield of psychology, as an alternative to traditional methods for evaluating model performance and for supporting consistent and reliable systems.

Read the paper: Evaluating General-Purpose AI with Psychometrics

In this episode, Dr. Gretchen Huizinga speaks with Cecily Morrison, MBE, a Senior Principal Research Manager at Microsoft Research, and Karolina Pakėnaitė, who also goes by Caroline, a PhD student and member of the citizen design team working with Morrison on the research project Find My Things. An AI phone application designed to help people who are blind or have low vision locate their personal items, Find My Things is an example of a broader research approach known as Teachable AI. Morrison and Pakėnaitė explore the Teachable AI goal of empowering people to make an AI experience work for them. They also discuss how “designing for one” when it comes to inclusive design leads to innovative solutions and what they learned about optimizing these types of systems for real-world use (spoiler: it’s not necessarily more or higher-quality data).

Learn more:

• Teachable AI Experiences (Tai X) | Project page
• Understanding Personalized Accessibility through Teachable AI: Designing and Evaluating Find My Things for People who are Blind or Low Vision | Publication, October 2023
• Microsoft Inclusive Design | Inclusive design resource center
• DeafBlind Everest Project | Karolina (Caroline) Pakėnaitė personal website

In this episode, Shrey Jain, a Technical Project Manager at Microsoft Research, and Dr. Zoë Hitzig, a junior fellow at the Harvard Society of Fellows, discuss their work on contextual confidence, which presents a framework to understand and more meaningfully address the increasingly sophisticated challenges generative AI poses to communication.

Read the paper

Across his time at Microsoft, Desney Tan, Managing Director of Microsoft Research Redmond, has had the experience of shepherding research ideas into products multiple times, and much like the trajectory of research, his life journey has been far from linear. In this episode, Tan shares how he moved to the United States from Singapore as a teenager, how his self-described “brashness” as a Microsoft intern helped shift the course of his career, and how human impact has been a guiding force in his work.

In this episode, Andy Gordon, a Partner Research Manager, and Carina Negreanu, a Senior Researcher, both at Microsoft Research, join host Dr. Gretchen Huizinga to discuss “Co-audit: Tools to help humans double-check AI-generated content.” This paper brings together current understanding of generative AI performance to explore the need and context for tools to help people using the technology find and fix mistakes in AI output.

View the paper

Ranveer Chandra is Managing Director of Research for Industry and CTO of Agri-Food. He is also Head of Networking Research at Microsoft Research Redmond. His work in systems and networking is helping to bring more internet connectivity to more people and is yielding tools designed to help farmers increase food production more affordably and sustainably. In this episode, he shares what it was like growing up in Jamshedpur, India; why he focuses his efforts in the areas he does; and where the joy in his work comes from.

Learn more:

• Ranveer Chandra at Microsoft Research
• FarmBeats: AI, Edge & IoT for Agriculture
• Project FarmVibes
• 6G | Space

In this episode, Dr. Sheng Zhang, a Senior Researcher at Microsoft Research, joins host Dr. Gretchen Huizinga to discuss “UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition.” In this paper, Zhang and his coauthors present mission-focused instruction tuning, a method for distilling large language models into smaller, more efficient ones for a broad application class. Their UniversalNER models achieved state-of-the-art performance in named entity recognition, an important natural language processing (NLP) task. Model distillation has the potential to make NLP and other capabilities more accessible, particularly in specialized domains such as biomedicine, which could benefit from more resource-efficient and transparent options. 

Learn more:

• View the paper
• UniversalNER project website with demo
• Code on GitHub
• Dataset and models on Hugging Face

In this episode, PhD students Jennifer Scurrell and Alejandro Cuevas talk to Senior Researcher Dr. Madeleine Daepp. They discuss the internship culture at Microsoft Research, from opportunities to connect with researchers they admire over coffee to the teamwork they say helped make it possible for them to succeed in the fast-paced environment of industry, and the impact they hope to have with their work. 

Learn more:

• Automated Interviewer or Augmented Survey? Collecting Social Data with Large Language Models | Publication, September 2023 

In this Microsoft Research Podcast series, AI scientist and engineer Ashley Llorens hosts conversations with his collaborators and colleagues about what these models—and the models that will come next—mean for our approach to creating, understanding, and deploying AI, its applications in areas such as healthcare and education, and its potential to benefit humanity.

This episode features Partner Research Manager Hanna Wallach, whose research into fairness, accountability, transparency, and ethics in AI and machine learning has helped inform the use of AI in Microsoft products and services for years. Wallach describes how she and a team of applied scientists expanded their tools for measuring fairness-related harms in AI systems to address harmful content more broadly during their involvement in the deployment of Bing Chat; her interest in filtering, a technique for mitigating harms that she describes as widely used but not often talked about; and the cross-company collaboration that brings policy, engineering, and research together to evolve and execute the Microsoft approach to developing and deploying AI responsibly.

Learn more: 

Microsoft AI: Responsible AI Principles and Approach  

AI and Microsoft Research 

In this Microsoft Research Podcast series, AI scientist and engineer Ashley Llorens hosts conversations with his collaborators and colleagues about what these models—and the models that will come next—mean for our approach to creating, understanding, and deploying AI, its applications in areas such as healthcare and education, and its potential to benefit humanity.

This episode features Senior Principal Research Manager Ahmed H. Awadallah, whose work improving the efficiency of large-scale AI models and efforts to help move advancements in the space from research to practice have put him at the forefront of this new era of AI. Awadallah discusses the shift in dynamics between model size and amount—and quality—of data when it comes to model training; the recently published paper “Orca: Progressive Learning from Complex Explanation Traces of GPT-4,” which further explores the use of large-scale AI models to improve the performance of smaller, less powerful ones; and the need for better evaluation strategies, particularly as we move into a future in which Awadallah hopes to see gains in these models’ ability to continually learn.

Learn more:

• Orca: Progressive Learning from Complex Explanation Traces of GPT-4, June 2023 
• Textbooks Are All You Need II: phi-1.5 technical report, September 2023
• AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation Framework, August 2023 
• LIDA: Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Models, March 2023
• AI Explainer: Foundation models ​and the next era of AI, March 2023 
• AI and Microsoft Research

In this episode, PhD students Anunay Kulshrestha and Karan Newatia talk to Senior Cryptographer Josh Benaloh about their work this summer on ElectionGuard, a free, open-source toolkit that enables voters to verify that their votes have been accurately counted. Kulshrestha and Newatia discuss their contributions to extending ElectionGuard to mail-in voting and rank-choice voting, respectively; what is needed for widespread adoption of the verifiable election technology; and why they’d recommend a Microsoft internship to other students.

(Editor’s note: After its design and development by Microsoft, ElectionGuard is now part of the newly formed nonprofit Election Technology Initiative, which will join with Microsoft to further ElectionGuard’s growth and help advance its adoption.)

Learn more

• ElectionGuard | Project page
• The next frontier in elections: Microsoft supports the Council of State Governments’ Election Technology Initiative | Microsoft On the Issues blog, July 2023
• Security and Cryptography | Group page

In this Microsoft Research Podcast series, AI scientist and engineer Ashley Llorens hosts conversations with his collaborators and colleagues about what these models—and the models that will come next—mean for our approach to creating, understanding, and deploying AI, its applications in areas such as healthcare and education, and its potential to benefit humanity.

This episode features Sriram Rajamani, Distinguished Scientist and Managing Director of Microsoft Research India. Rajamani talks about how the lab’s work is being influenced by today’s rapidly advancing AI. One example? The development of a conversational agent in India capable of providing information about governmental agricultural programs in farmers’ natural language, particularly significant in a country with more than 30 languages, including 22 government-recognized languages. It’s an application Microsoft CEO Satya Nadella described as the “mic drop moment” of his trip to the lab early this year.

Learn more

• AI4Bhārat | Organization homepage
• MEGA: Multilingual Evaluation of Generative AI | Publication, May 2023
• AI and Microsoft Research | Learn more about the breadth of AI research at Microsoft

In this episode, Dr. Gretchen Huizinga talks with Microsoft Health Futures Senior Director Javier Alvarez and Dr. Raj Jena, a radiation oncologist at Addenbrooke’s hospital, part of Cambridge University Hospitals in the United Kingdom, about Project InnerEye, a Microsoft Research effort that applies machine learning to medical image analysis. The pair shares how a 10-plus-year collaborative journey—and a combination of research and good software engineering—has resulted in the hospital’s creation of an AI system that is helping to decrease the time cancer patients have to wait to begin treatment. Alvarez and Jena chart the path of their collaboration in AI-assisted medical imaging, from Microsoft Research’s initiation of Project InnerEye and its decision to make the resulting research tools available in open source to Addenbrooke’s subsequent testing and validation of these tools to meet the regulatory requirements for use in a clinical setting. They also discuss supporting clinician productivity—and ultimately patient outcomes—and the important role patients play in incorporating AI into healthcare.

Learn more:

• Project InnerEye | Project page
• How AI is helping to shrink waiting times for NHS cancer patients | Microsoft News Centre UK blog post, June 2023
• Accounting for past imaging studies: Enhancing radiology AI and reporting | Microsoft Research blog, June 2023
• Microsoft Health Futures | Lab page
• Biomedical Imaging | Research group page
• Evaluation of Deep Learning to Augment Image Guided Radiotherapy for Head and Neck and Prostate Cancers | JAMA publication, November 2020

In this episode of the podcast, Dr. Gretchen Huizinga welcomes Principal Researcher Dr. Jina Suh and Principal Applied and Data Science Manager Dr. Shamsi Iqbal to the show to discuss their most recent work together, a research project aimed at developing data-driven tools to support organizational leaders and executives in their decision-making. The longtime collaborators explore how a long history of collaboration helps them thrive in their work to help workplaces thrive, how their relationship has evolved over the years, particularly with Iqbal’s move from the research side to the product side, and how research and product can align to achieve impact.

Learn more:

• HUE: Human Understanding and Empathy | Project page
• Microsoft Viva | Product page

In the world of gaming, Haiyan Zhang has situated herself where research meets real-world challenges, helping to bring product teams and researchers together to elevate the player experience with the latest AI advances even before the job became official with the creation of her current role, General Manager of Gaming AI. In this episode, she talks with host Dr. Gretchen Huizinga about the variety of expertise needed to avoid the discomfort experienced by players when they encounter a humanlike character displaying inhuman behavior, the potential for generative AI to make gaming better for both players and creators, and the games she grew up playing and what she plays now.

Learn more:

• Game Intelligence | Group page
• Project Paidia | Project page
• TrueSkill™ Ranking System | Project page
• TrueMatch Matchmaking System | Project page
• Grounded Conversational Characters | Project page

In this episode, host Dr. Gretchen Huizinga welcomes Dr. Spencer Fowers, a member of the Special Projects Technical Staff at Microsoft Research, and Dr. Kwame Darko, a plastic surgeon in the reconstructive plastic surgery and burns center in Ghana’s Korle Bu Teaching Hospital. The two are among a group working to make specialized medical care more widely available, especially to those in remote or underserved communities. They share how their 3D telecommunication technology helps bring patients and doctors together when being in the same room isn’t an easy option and how the experience is supporting greater patient satisfaction, allowing more time for surgeons to prepare for surgery, and making the assembly of a super team of medical experts from around the globe more feasible.

Learn more:

• 3D telemedicine brings better care to underserved and rural communities, even across continents | Microsoft Research Blog, May 2023
• Microsoft’s Holoportation Communications Technology: Facilitating 3D Telemedicine | Microsoft Research video, May 2023
• Participatory Development of a 3D Telemedicine system during Covid: the future of remote consultations | Journal of Plastic, Reconstructive & Aesthetic Surgery, October 2022
• 3D Telemedicine | Project page
• Holoportation | Project page
• Korle Bu Teaching Hospital

In this episode, Microsoft Principal Researcher Dr. Bichlien Nguyen and Dr. David Kwabi, Assistant Professor of Mechanical Engineering at the University of Michigan, join host Dr. Gretchen Huizinga to talk about how their respective research interests—and those of their larger teams—are converging to develop renewable energy storage systems. They specifically explore their work in flow batteries and how machine learning can help more effectively search the vast organic chemistry space to identify compounds with properties just right for storing waterpower and other renewables for a not rainy day. The bonus? These new compounds may just help advance carbon capture, too.

Learn more

• Microsoft Climate Research Initiative
• Project Zerix
• Project Carbonix
• Kwabi Lab, University of Michigan
• Understanding capacity fade in organic redox-flow batteries by combining spectroscopy with statistical inference techniques

In this Microsoft Research Podcast series, AI scientist and engineer Ashley Llorens hosts conversations with his collaborators and colleagues about what these new models—and the models that will come next—mean for our approach to creating, understanding, and deploying AI, its applications in areas such as health care and education, and its potential to benefit humanity.

This episode features Senior Principal Researcher Emre Kiciman and Principal Researcher Amit Sharma, whose paper “Causal Reasoning and Large Language Models: Opening a New Frontier for Causality” examines the causal capabilities of large language models (LLMs) and their implications. Kiciman and Sharma break down the study of cause and effect; recount their respective ongoing journeys with GPT-3.5 and GPT-4—from their preconceptions to where they are now—and share their views of a future in which LLMs help bring together different modes of reasoning in the practice of causal inference and make causal methods easier to adopt.

Learn more

• Causal Reasoning and Large Language Models: Opening a New Frontier for Causality | Publication, April 2023
• The AI Revolution in Medicine: GPT-4 and Beyond | Book by Peter Lee, April 2023
• AI and Microsoft Research | Learn more about the breadth of AI research at Microsoft

In this inaugural episode, host Dr. Gretchen Huizinga talks with GitHub Staff Product Manager Kasia Sitkiewicz and Protocol Labs Research Scientist Petar Maymounkov about how their collaboration on Gov4git, a governance tool for decentralized, open-source cooperation, is helping to lay the foundation for a future in which everyone can collaborate more efficiently, transparently, and easily and in the ways that meet the unique desires and needs of their respective communities. They discuss the governance features that make Gov4git more suitable for serving a broader range of communities than today’s public blockchains and the open-source book project allowing them to test the potential and limitations of the work.

https://www.microsoft.com/research

In this Microsoft Research Podcast series, AI scientist and engineer Ashley Llorens hosts conversations with his collaborators and colleagues about what these new models—and the models that will come next—mean for our approach to creating, understanding, and deploying AI, its applications in areas such as health care and education, and its potential to benefit humanity.

The third episode features Ece Kamar, deputy lab director at Microsoft Research Redmond. Kamar draws on decades of experience in AI research and an opportunity she and Microsoft colleagues had to evaluate and experiment with GPT-4 prior to its release in discussing the capabilities and limitations of today’s large-scale models. She explores the short-term mitigation techniques she and her team are using to make these models viable components of the AI systems that give them purpose and shares the long-term research questions that will help maximize their value. 

https://www.microsoft.com/research

In this new Microsoft Research Podcast series, AI scientist and engineer Ashley Llorens hosts conversations with his collaborators and colleagues about what these new models—and the models that will come next—mean for our approach to creating, understanding, and deploying AI, its applications in areas such as health care and education, and its potential to benefit humanity.

The second episode features Peter Lee, head of Microsoft Research. Lee was among a group within Microsoft to have early access to GPT-4 for evaluation and experimentation. Here, he applies his philosophy of tackling research from what will be inevitably true at a future point in time to this current moment. He also explores the differences that may make integrating today’s AI advancements into health care more attainable, a topic he expands on in the soon-to-be-released book The AI Revolution in Medicine: GPT-4 and Beyond and the New England Journal of Medicine article "Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine."

https://www.microsoft.com/research

In this new Microsoft Research Podcast series, AI scientist and engineer Ashley Llorens hosts conversations with his collaborators and colleagues about what these new models—and the models that will come next—mean for our approach to creating, understanding, and deploying AI, its applications in areas such as health care and education, and its potential to benefit humanity.

The first episode features Sébastien Bubeck, who leads the Machine Learning Foundations group at Microsoft Research in Redmond. He and his collaborators conducted an extensive evaluation of GPT-4 while it was in development, and have published their findings in a paper that explores its capabilities and limitations—noting that it shows “sparks” of artificial general intelligence.

https://www.microsoft.com/research

In the world of gaming, Haiyan Zhang has situated herself where research meets real-world challenges, helping to bring product teams and researchers together to elevate the player experience with the latest AI advances even before the job became official with the creation of her current role, General Manager of Gaming AI. In this episode, she talks with host Dr. Gretchen Huizinga about the variety of expertise needed to avoid the discomfort experienced by players when they encounter a humanlike character displaying inhuman behavior, the potential for generative AI to make gaming better for both players and creators, and the games she grew up playing and what she plays now.

Learn more

• Game Intelligence | Group page
• Project Paidia | Project page
• TrueSkill™ Ranking System | Project page
• TrueMatch Matchmaking System | Project page
• Grounded Conversational Characters | Project page

In this episode of the series, Dr. Gray and Dr. Sasha Costanza-Chock, scholar, designer, and activist, explore design justice, a framework for analyzing design’s power to perpetuate—or take down—structural inequality and a community of practice dedicated to creating a more equitable and sustainable world through inclusive, thoughtful, and respectful design processes. They also discuss how critical thinkers and makers from social movements have influenced technology design and science and technology studies (STS), how challenging the assumptions that drive who tech is built for will create better experiences for most of the planet, and how a deck of tarot-inspired cards is encouraging radically wonderful sociotechnical futures.

https://www.microsoft.com/research

https://www.microsoft.com/research

https://www.microsoft.com/research

In this episode of The New Future of Work series, Chief Scientist Jaime Teevan and Senior Principal Researcher Siddharth Suri explore the many ways people were impacted by work shifts during the COVID-19 pandemic. They talk about how race, gender, income, and other factors are indicative of how people have fared and what this means for the future of work. The researchers discuss the importance of examining potential hidden consequences—and patience—when using short-term data to make long-term decisions, emphasizing aspects of burnout and innovation. Topics covered in this wide-ranging conversation include benefits of commutes and a silver lining in the shift to remote and hybrid work—the movement of more innovative jobs out of large metro areas, creating momentum for greater opportunity in diverse locations. The research that Siddharth Suri describes in this podcast was jointly done with Hana Wolf of LinkedIn.

https://www.microsoft.com/research

In this episode of The New Future of Work series, Chief Scientist Jaime Teevan and Principal User Research Manager Ginger Hudson share how people evolved their home office setups throughout the COVID-19 pandemic, and they explore how information workers used various devices and peripherals to put their best self forward as the shift to remote work quickly unfolded. They also talk about what an “anatomy of hybrid work” might look like and some considerations for making a hybrid model of work sustainable in the long term, including the expansion of workspaces to outdoor environments.

https://www.microsoft.com/research

In this episode of the podcast, Chief Scientist Jaime Teevan and Senior User Research Manager Matt Brodsky examine how the level of IT support available during the shift, including the ability to provide hardware and software, made the difference between laying off staff and weathering the challenges brought on by the pandemic. They also explore why remote work came with a spike in phishing threats, what the biggest thorn in the sides of IT administrators has been this past year, and where opportunities exist to prepare to keep up with tech advances and tackle future disruptions.

https://www.microsoft.com/research

In this episode, Chris Bishop, Lab Director of Microsoft Research Cambridge, welcomes renowned machine learning researcher Max Welling to the Microsoft Research team as head of the new Amsterdam lab. Connecting over their shared physics background and vision for molecular simulation, Bishop and Welling explore several fascinating topics, including a future in which machine learning and quantum computing will be used in tandem to model molecules, the power of machine learning to provide “on demand” data in this space, and goals for the first year and beyond at the Amsterdam lab.

https://www.microsoft.com/research

In this episode of The New Future of Work series, Chief Scientist Jaime Teevan and Principal Productivity Engineer Brian Houck discuss what the massive shift to remote work meant for developers—both employees of Microsoft and customers using Microsoft developer platforms to support their work. They’ll talk about how taking a holistic approach to developer productivity can benefit both efficiency and happiness, with an emphasis on the important role social connections and processes play in a field often thought of as an isolated endeavor. They also explore pros and cons of everyday developer tasks, like code review and whiteboarding, being done in a hybrid work setting.

https://www.microsoft.com/research

In this episode of The New Future of Work series of the podcast, Chief Scientist Jaime Teevan and Senior Research Economist Sonia Jaffe delve into the “Personal Productivity and Well-Being” chapter of the report, beginning with why measuring productivity isn’t as easy as just observing output or counting hours worked. They also explore how people already working from home helped them better understand how people adjusted to remote work, the diversity in experiences among workers, and how we can be better coworkers to our remote colleagues whether we’re working from home or not.

https://www.microsoft.com/research

In this episode of The New Future of Work series of the podcast, Chief Scientist Jaime Teevan and Abigail Sellen, Deputy Lab Director at Microsoft Research Cambridge in the United Kingdom, explore the dynamics of meetings and collaborations in the context of remote work. They specifically address the difference between weak and strong ties in our professional networks and why both matter to employee and company success. They also break down the phenomenon of video fatigue and share ways in which remote meetings may actually have the advantage.

https://www.microsoft.com/research

In this episode of The New Future of Work series of the podcast, Chief Scientist Jaime Teevan and Director of Applied Science Brent Hecht of the Experiences and Devices group in Microsoft share how an internal SharePoint document led to what they believe is the largest collection of research on the pandemic’s impact on work. They’ll discuss the role of research during times of disruption, the widening scope of productivity tools, why going back to work two to three days a week is ideal, and what else companies should keep in mind as they decide on new work models.

https://www.microsoft.com/research

In this episode, Senior Principal Researcher Hunt Allcott talks with Postdoctoral Researcher Evan Rose about Allcott’s work exploring the everyday decisions people face, like buying fuel-efficient cars or taking out payday loans, and how a clearer understanding of these decisions can shape meaningful public policy. Allcott shares how his and others’ research shows that policy can often have complex outcomes resulting in hidden benefits and drawbacks, as in the case of taxes on sugary beverages. The researchers also discuss why individuals often feel the competing motivations of making bad versus good decisions—a tension that often lies front-and-center in scenarios primed for behavioral public economics research.

https://www.microsoft.com/research

Interviewed by Senior Principal Researcher Hunt Allcott, Economist David Rothschild discusses how the news media has evolved alongside social media and the internet, from story development to distribution of news via aggregators and wire services. Rothschild illuminates how and where people are consuming news and shares some of the strategies he’s seeing news outlets use to appeal to their audiences. He also covers research insights into media bias, misinformation, and how this knowledge could inform the future of news for the better. In addition, the researchers talk about Rothschild’s work with Project Ratio, which looks at how the news ecosystem impacts public opinion and political polarization while providing a multi-faceted approach to understanding these outcomes through data and infrastructure.

https://www.microsoft.com/research

In this episode, Senior Principal Researcher Dr. Hunt Allcott speaks with Microsoft Research New England office mate and Senior Principal Researcher Dr. Greg Lewis. Together, they cover the connection between causal machine learning and economics research, the motivations of buyers and sellers on e-commerce platforms, and how ad targeting and data practices could evolve to foster a more symbiotic relationship between customers and businesses. They also discuss EconML, a Python package for estimating heterogeneous treatment effects that Lewis has worked on as part of the ALICE (Automated Learning and Intelligence for Causation and Economics) project at Microsoft Research.

https://www.microsoft.com/research

In this episode, Dr. Hunt Allcott, Senior Principal Researcher at Microsoft Research New England, talks with Dr. Evan Rose, Postdoctoral Researcher, whom Allcott describes as “one of the most engaging and talented researchers in applied microeconomics today.” They’ll discuss how Rose’s experience teaching adult learners at San Quentin State Prison has resonated throughout his research, and they’ll delve into what his and others’ work is uncovering about the criminal justice system today, including the effects of incarceration and parole, impacts of ban-the-box hiring practices, and racial disparities and discrimination.

In this episode, Senior Principal Research Manager Andy Gordon, who leads the Calc Intelligence team at Microsoft Research, and Senior Principal Researcher Simon Peyton Jones provide an inside account of the journey Excel has taken as a programming language, including the expansion of data types that has unlocked greater functionality and the release of the LAMBDA function, which makes the Excel formula language Turing-complete. They’ll talk specifically about how research has influenced Excel and vice versa, programming as a human-computer interaction challenge, and a future in which Excel is the first language for budding programmers and a tool for incorporating probabilistic reasoning into our decision-making.

https://www.microsoft.com/research

Today, Dr. Stefan Saroiu, a Senior Principal Researcher in MSR’s Mobility and Networking group, explains why DRAM remains vulnerable to Rowhammer attacks today, even after several years of mitigation efforts, and then tells us how a new approach involving bespoke extensibility mechanisms for DRAM might finally hammer Rowhammer in the fight to keep data safe and secure.

Today, Dr. Bragg gives us an insightful overview of the field and talks about the unique challenges and opportunities of building systems that expand access to information in line with the needs and desires of the deaf and signing community.

https://www.microsoft.com/research

https://www.microsoft.com/research

Today, he tells us how he’s using reinforcement learning and HAIbrid algorithms to tap the best of both human and machine intelligence and develop AI that’s minimally disruptive, synergistic with human solutions, and safe.

Kevin Scott has embraced many roles over the course of his illustrious career in technology: software developer, engineering executive, researcher, angel investor, philanthropist, and now, Chief Technology Officer of Microsoft. But perhaps no role suits him so well – or has so fundamentally shaped all the others – as his self-described role of “all-around geek.”

Today, in a wide-ranging interview, Kevin shares his insights on both the history and the future of computing, talks about how his impulse to celebrate the extraordinary people “behind the tech” led to an eponymous non-profit organization and a podcast, and… reveals the superpower he got when he was in grad school.

https://www.microsoft.com/research

You may not know who Dr. Andrew Fitzgibbon is, but if you’ve watched a TV show or movie in the last two decades, you’ve probably seen some of his work. An expert in 3D computer vision and graphics, and head of the new All Data AI group at Microsoft Research Cambridge, Dr. Fitzgibbon was instrumental in the development of Boujou, an Emmy Award-winning 3D camera tracker that lets filmmakers place virtual props, like the floating candles in Hogwarts School for Witchcraft and Wizardry, into live-action footage. But that was just his warm-up act.

On today’s podcast, Dr. Fitzgibbon tells us what he’s been working on since the Emmys in 2002, including body- and hand-tracking for powerhouse Microsoft technologies like Kinect for Xbox 360 and HoloLens, explains how research on dolphins helped build mathematical models for the human hand, and reminds us, once again, that the “secret sauce” to most innovation is often just good, old-fashioned hard work.

https://www.microsoft.com/research

Emotions are fundamental to human interaction, but in a world where humans are increasingly interacting with AI systems, Dr. Mary Czerwinski, Principal Researcher and Research Manager of the Visualization and Interaction for Business and Entertainment group at Microsoft Research, believes emotions may be fundamental to our interactions with machines as well. And through her team’s work in affective computing, the quest to bring Artificial Emotional Intelligence – or AEI – to our computers may be closer than we think.

Today, Dr. Czerwinski tells us how a cognitive psychologist found her way into the research division of the world’s largest software company, suggests that rather than trying to be productive 24/7, we should aim for Emotional Homeostasis instead, and tells us how, if we do it right, our machines could become a sort of “emotional at-work DJ,” sensing and responding to our emotional states, and helping us to become happier and more productive at the same time.

We hear a lot these days about “AI for good” and the efforts of many companies to harness the power of artificial intelligence to solve some of our biggest environmental challenges. It’s rare, however, that you find a company willing to bring its environmental bona fides all the way to the C Suite. Well, meet Dr. Lucas Joppa. A former environmental and computer science researcher at MSR who was tapped in 2017 to become the company’s first Chief Environmental Scientist, Dr. Joppa is now the Chief Environmental Officer at Microsoft, another first, and is responsible for managing the company’s overall environmental sustainability efforts from operations to policy to technology.

Today, Dr. Joppa shares how his love for nature and the joy of discovery actually helped shape his career path, and tells us all about AI for Earth, a multi-year, multi-million dollar initiative to deploy the full scale of Microsoft’s products, policies and partnerships across four key areas of agriculture, water, biodiversity and climate, and transform the way society monitors, models, and ultimately manages Earth’s natural resources.

On today’s episode, neuroscientist and virtual reality researcher, Dr. Mar Gonzalez Franco, talks about her work in VR, explains how avatars can help increase our empathy and reduce our biases via role play, and addresses the misconceptions that exist between the immersive experiences of virtual reality and psychedelic drugs.

Today, Dr. Bernstein talks about his pioneering work in databases over the years and tells us all about Project Orleans, a distributed systems programming framework that makes life easier for programmers who aren’t distributed systems experts. He also talks about the future of database systems in a cloud scale world, and reveals where he finds his research sweet spot along the academic industrial spectrum.

https://www.microsoft.com/research

We were fortunate to catch up with Brad who, late on a Friday afternoon, sat down with me in the booth to talk about his new book, Tools and Weapons: The Promise and the Peril of the Digital Age, and revealed the top ten tech policy issues he believes will shape our own century’s roaring 20s. He also gave us a peek inside the life of a person the New York Times has described a “de facto ambassador for the technology industry at large” – himself!

https://www.microsoft.com/research

Today, Rangan talks about how three big trends have changed the way Microsoft is building – and sharing – AI stacks across product groups. He also tells us about Project Turing, an internal deep learning moonshot that aims to harness the resources of the web and bring the power of deep learning to a search box near you.

https://www.microsoft.com/research

On today’s podcast, Dr. Arzani tells us why it’s so hard to identify and resolve networking problems and then explains how content-aware, or domain-customized, auto ML frameworks might help. She also tells us what she means when she says she wants to get humans out of the loop, and reveals how a competitive streak and a comment from her high school principal set her on the path to a career in high tech research.

https://www.microsoft.com/research

Today, Gavin takes us on a guided tour of the research engineering landscape and the engineering pipeline, recounting some of Central Engineering’s greatest hits. He also explains how the lab determines which projects get engineering resources, and reveals how one of his own projects ended up in the Museum of Modern Art.

https://www.microsoft.com/research

Today, Dr. Lee talks about how MSR’s advances in healthcare technology are impacting the business of Microsoft Healthcare. He also explains how promising innovations like precision medicine, conversational chatbots and Azure’s API for data interoperability may make healthcare better and more efficient in the future.

https://www.microsoft.com/research

On today’s podcast, Dr. Dey talks about how his latest work in meta-reasoning helps improve modular system pipelines and how imitation learning hits the ML sweet spot between supervised and reinforcement learning. He also explains how neural architecture search helps enlighten the “dark arts” of neural network training and reveals how boredom, an old robot and a several “book runs” between India and the US led to a rewarding career in research.

https://www.microsoft.com/research

On today’s podcast, Dr. Kossmann reflects on his life as a database researcher and tells us how Socrates, an innovative database-as-a-service architecture, is re-envisioning traditional database design. He also reveals the five superpowers of Microsoft Research and how we can improve science… with marketing.

https://www.microsoft.com/research

Today, Dr. Bhattacharya tells us all about Scheduler, Microsoft’s virtual personal assistant, and how her team is using machine learning to put the “I” in intelligent PDAs. She also talks about how understanding different levels of automation can help us set the right expectations for our experience with AI, and explains how, in the workplace of the future, we might actually achieve more by doing less.

https://www.microsoft.com/research

Today, Dr. Amershi talks about life at the intersection of AI and HCI and does a little AI myth-busting. She also gives us an overview of what – and who – it takes to build responsible AI systems and reveals how a personal desire to make her own life easier may make your life easier too.

https://www.microsoft.com/research

Today, Dr. Gao gives us an overview of the deep learning landscape and talks about his latest work on Multi-task Deep Neural Networks, Unified Language Modeling and vision-language pre-training. He also unpacks the science behind task-oriented dialog systems as well as social chatbots like Microsoft Xiaoice, and gives us some great book recommendations along the way!

https://www.microsoft.com/research

Today, Dr. Rajamani talks about the unique challenges and opportunities of leading MSR’s research efforts in India and what it takes to build a robust research ecosystem in a country of huge disparities. He also dispels some preconceptions about poor and marginalized populations and explains why ‘frugal innovation’ may be one key to solving societal scale problems.

https://www.microsoft.com/research

Machine learning is a powerful tool that enables computers to learn by observing the world, recognizing patterns and self-training via experience. Much like humans. But while machines perform well when they can extract knowledge from large amounts of labeled data, their learning outcomes remain vastly inferior to humans when data is limited. That’s why Dr. Patrice Simard, Distinguished Engineer and head of the Machine Teaching group at Microsoft, is using actual teachers to help machines learn, and enable them to extract knowledge from humans rather than just data.

Today, Dr. Simard tells us why he believes any task you can teach to a human, you should be able to teach to a machine; explains how machines can exploit the human ability to decompose and explain concepts to train ML models more efficiently and less expensively; and gives us an innovative vision of how, when a human teacher and a machine learning model work together in a real-time interactive process, domain experts can leverage the power of machine learning without machine learning expertise.

If you’re in software development, Dr. Tom Zimmermann, a senior researcher at Microsoft Research in Redmond, wants you to be more productive, and he’s here to help. How, you might ask? Well, while productivity can be hard to measure, his research in the Empirical Software Engineering group is attempting to do just that by using insights from actual data, rather than just gut feelings, to improve the software development process.

On today’s podcast, Dr. Zimmermann talks about why we need to rethink productivity in software engineering, explains why work environments matter, tells us how AI and machine learning are impacting traditional software workflows, and reveals the difference between a typical day and a good day in the life of a software developer, and what it would take to make a good day typical!

Today, Dr. Langford explains why online reinforcement learning is critical to solving machine learning and how moving from the current foundation of a Markov decision process toward a contextual bandit future might be part of the solution. Rafah Hosn talks about why it’s important, from a business perspective, to move RL agents out of simulated environments and into the open world, and gives us an under-the-hood look at the product side of MSR’s “research, incubate, transfer” process, focusing on real world reinforcement learning which, at Microsoft, is now called Azure Cognitive Services Personalizer.

Today, Dr. Bubeck explains the difficulty of the multi-armed bandit problem in the context of a parameter- and data-rich online world. He also discusses a host of topics from randomness and convex optimization to metrical task systems and log n competitiveness to the surprising connection between Gaussian kernels and what he calls some of the most beautiful objects in mathematics.

Dr. Christopher Bishop is quite a fellow. Literally. Fellow of the Royal Academy of Engineering. Fellow of Darwin College in Cambridge, England. Fellow of the Royal Society of Edinburgh. Fellow of The Royal Society. Microsoft Technical Fellow. And one of the nicest fellows you’re likely to meet! He’s also Director of the Microsoft Research lab in Cambridge, where he oversees a world-class portfolio of research and development endeavors in machine learning and AI.

Today, Dr. Bishop talks about the past, present and future of AI research, explains the No Free Lunch Theorem, talks about the modern view of machine learning (or how he learned to stop worrying and love uncertainty), and tells how the real excitement in the next few years will be the growth in our ability to create new technologies not by programming machines but by teaching them to learn.

https://www.microsoft.com/research

On today’s podcast, Dr. Nushi talks about what it takes to develop collaborative AI systems and unpacks the unique challenges machine learning engineers face in their version of the software development cycle. She also reveals why understanding the “terrain of failure” can help researchers develop AI systems that perform as well in the real world as they do in the lab.

https://www.microsoft.com/research

Today, Dr. Bachman gives us an overview of the machine learning landscape and tells us why it’s been so difficult to sort through noise and get to useful information. He also talks about his ongoing work on Deep InfoMax, a novel approach to self-supervised learning, and reveals what a conversation about ML classification problems has to do with Harrison Ford’s face.

https://www.microsoft.com/research

Today, Gurdeep and Ashish discuss life at the intersection of machine learning, simulation and autonomous systems, and talk about the challenges we face as we transition from a world of automation to a world of autonomy. They also tell us about Game of Drones, an exciting new drone racing competition where the goal is to imbue flying robots with human-level perception and decision making skills… on the fly.

https://www.microsoft.com/research

Today, Dr. Gulwani gives us an overview of the exciting “now” and promising future of program synthesis; reveals some fascinating new applications and technical advances; tells us the story behind the creation of Excel’s popular Flash Fill feature (and how a Flash Fill Fail elicited a viral tweet that paved the way for new domain investments); and shares a heartwarming story of how human empathy facilitated an “ah-ha math moment” in the life of a child, and what that might mean to computer scientists, educators and even tech companies in the future.

https://www.microsoft.com/research

On today’s podcast, Tom and Teddy talk about physical computing through platforms like MakeCode, a simplified programming environment that makes it easier for young people – and other computer science neophytes – to start coding with programmable microcontrollers. They also tell us all about Project Brookdale, where they did a collaborative fashion show that gave emerging designers the tools to embed technology in their garments and produce wearables you’d actually want to be seen in!

https://www.microsoft.com/research

Today, Ant and Mark discuss their roles in the development of new optical technologies, like Project Silica, for cloud-scale storage demands, and talk about the Optics for the Cloud Research Alliance, an exciting new collaboration between academic researchers and MSR. They also explain how just the right mix of innovation and engineering can make the cloud more powerful and less expensive to use and, at the same time, deliver “forever” storage that’s both dishwasher and microwave safe!

https://www.microsoft.com/research

On today’s podcast, Jenny and Asta talk about life at the intersection of art and science; tell us why the Artist in Residence program pushes the boundaries of technology in unexpected ways; and reveal their vision of the future of bio-inspired, human-centered, AI-infused architecture.

https://www.microsoft.com/research

On today’s podcast, Dr. Mansour gives us a brief history of conversational machines at Microsoft; tells us all about LUIS, one of the first Microsoft products to deploy machine teaching concepts in real world verticals; and explains how an unlikely combination of engineering skills, science skills, entrepreneurial skills – and not taking no for an answer – helped make automated customer engagement and business functions more powerful, more accessible and more intelligent!

https://www.microsoft.com/research

On today’s podcast, Dr. Costello gives us a battlefield update in the ongoing crypto wars; talks about different approaches to post quantum cryptography and explains why he believes isogeny-based primitives are among the most promising; and reassures us that, as long as the battle goes on, cryptographers will continue to work very hard on the very hard math they hope will protect us from hackers and attackers, even in the age of quantum computers. https://www.microsoft.com/research

On today’s podcast, Jina shares her passion for creating technologies that promote emotional resilience and mental health; gives us an inside look at an innovative research collaboration that aims to improve collaborative care for cancer patients with depression; and tells us an emotional story of how, on the brink of quitting her job, she found inspiration to get back in the game and begin a new career in research for human well-being. https://www.microsoft.com/research

Today, Mark talks about his love of mathematics and his desire to solve big, crazy, core knowledge sized problems; tells us all about MMLSpark and how it’s being used by organizations like the Snow Leopard Trust and the Metropolitan Museum of Art; and reveals how the persuasive advice of a really smart big sister helped launch an exciting career in AI research and development.

https://www.microsoft.com/research

On today’s podcast, Dr. Ofek talks about the unique challenges and opportunities of augmented and virtual reality from both a technical and social perspective; tells us why he believes AR and VR have the potential to be truly revolutionary, particularly for people with disabilities; explains why, while we’re doing pretty well in the virtual worlds of sight and sound, our sense of virtual touch remains a bit more elusive; and reveals how, if he and his colleagues are wildly successful, it won’t be that long before we’re living in a whole new world of extension, expansion, enhancement and equality.https://www.microsoft.com/research

Today, Dr. Dumais tells us how the landscape of information retrieval has evolved over the past twenty years; reminds us that queries don’t fall from the sky but are grounded in the context of real people, real events and real time; talks about her current interest in non-web-based search (or how I can easily put my hands on my own digital belongings) and reveals what apples and Michael Jordan have in common with search research.https://www.microsoft.com/research

Today, Dr. Broll gives us an overview of the work he did and the experience he had as a Microsoft AI Resident, talks about his passion for making complex concepts easier and more accessible to novices and young learners, and tells us how growing up on a dairy farm in rural Minnesota helped prepare him for a life in computer science solving some of the toughest problems in AI.

https://www.microsoft.com/research

Today, Dr. Cutrell gives us an overview of his work in the disability and inclusive design space, explains the vital importance of interdisciplinarity – a fancy way of saying many ways of thinking and many ways of knowing – and tells us how a dumb phone beat a smart tablet in rural India… and what that meant to researchers.

https://www.microsoft.com/research

On today’s podcast, Dr. Saarikivi tells us all about CHET, gives us an overview of some of his other projects, including Parasail, a novel approach to parallelizing seemingly sequential applications, and tells us how a series of unconventional educational experiences shaped his view of himself, and his career as a researcher. https://www.microsoft.com/research

On today’s podcast, Dr. Hazen talks about why reading comprehension is so hard for machines, gives us an inside look at the technical approaches applied researchers and their engineering colleagues are using to tackle the problem, and shares the story of how an a-ha moment with a Rubik’s Cube inspired a career in computer science and a quest to teach computers to answer complex, text-based questions in the real world.

https://microsoft.com/research

Today, Dr. Ananthanarayanan tells us all about Video Analytics for Vision Zero (an award-winning “killer app” that aims to reduce traffic-related fatalities to zero), gives us a wide-angle view of his work in geo-distributed data analytics and client-cloud networking, and explains how the duration and difficulty of a Test Cricket match provides an invaluable lesson for success in life and research.

https://www.microsoft.com/research

Today, Dr. Riche shares her passion for the art of data driven storytelling, reveals the two superpowers of data visualization, gives us an inside look at some innovative projects designed to help us th(ink) with digital ink, and tells the story of how a young woman with an artist’s heart headed into computer science, took a detour to the beach, paid for it with research and ended up with a rewarding career that brings both art and computing together.

https://www.microsoft.com/research

https://www.microsoft.com/research

https://www.microsoft.com/research

On today’s podcast, Dr. Gehrke frames the new, cloud-powered work world as a fast paced, widely-distributed workplace that demands real-time decision-making and collaboration – and explains how products like Microsoft Teams are meeting those demands – and tells us, both directly and indirectly, about the future of work, which for Microsoft, involves a pivot from an app-centric approach to a people-centric approach where, by using an AI-infused productivity suite coupled with the power of the cloud, we can essentially “hire Microsoft” to help us get our work done.

https://www.microsoft.com/research

Today, Dr. Zhou talks about systems and networking research in an era of unprecedented systems complexity and what happens when old assumptions don’t apply to new systems, explains how projects like CloudBrain are taking aim at real-time troubleshooting to address cloud-scale, network-related problems like “gray failure,” and tells us why he believes now is the most exciting time to be a systems and networking researcher.

On today’s podcast, Chris and Phil discuss their respective roles in Microsoft’s gaming ecosystem, revealing a sort of “enrichment pipeline” that flows all the way from researcher to developer to gamer. They also give us an inside look at the close collaboration between the world-class research organization of MSR and the world-class gaming franchise of Xbox, highlighting Microsoft’s unique ability to deliver the tools, talent and resources that fuel innovation and help shape the future of gaming.http://www.microsoft.com/research

On today’s podcast, Dr. Fitzgibbon tells us what he’s been working on since the Emmys in 2002, including body- and hand-tracking for powerhouse Microsoft technologies like Kinect for Xbox 360 and HoloLens, explains how research on dolphins helped build mathematical models for the human hand, and reminds us, once again, that the “secret sauce” to most innovation is often just good, old-fashioned hard work.

On today’s podcast, Dr. Iqbal tells us about her work in the field of micro-productivity, a line of research that takes aim at the short spurts of time she calls micro-moments that we otherwise might have considered too short to get anything useful done. She also explains why distraction can be good for us and gives us some advice on how to make the most of our cognitive resources, whether by setting aside time to tackle big tasks in the traditional way or by breaking them down into micro-tasks… and “outsourcing” them to ourselves!

Today, Dr. Simard tells us why he believes any task you can teach to a human, you should be able to teach to a machine; explains how machines can exploit the human ability to decompose and explain concepts to train ML models more efficiently and less expensively; and gives us an innovative vision of how, when a human teacher and a machine learning model work together in a real-time interactive process, domain experts can leverage the power of machine learning without machine learning expertise.

On today’s podcast, Dr. Zimmermann talks about why we need to rethink productivity in software engineering, explains why work environments matter, tells us how AI and machine learning are impacting traditional software workflows, and reveals the difference between a typical day and a good day in the life of a software developer, and what it would take to make a good day typical!

On today’s podcast, Dr. Huang talks about his role as Microsoft’s Chief Speech Scientist, gives us some inside details on the latest milestones in speech and language technology, and explains how mastering speech recognition, translation and conversation will move machines further along the path from “perceptive AI” to “cognitive AI” and that much closer to truly human intelligence.

Today, Dr. Langford explains why online reinforcement learning is critical to solving machine learning and how moving from the current foundation of a Markov decision process toward a contextual bandit future might be part of the solution. Rafah Hosn talks about why it’s important, from a business perspective, to move RL agents out of simulated environments and into the open world, and gives us an under-the-hood look at the product side of MSR’s “research, incubate, transfer” process, focusing on real world reinforcement learning which, at Microsoft, is now called Azure Cognitive Services Personalizer.

On today’s podcast, we get to hang out with both Dr. Hinckley and Dr. Morris as they talk about life at the intersection of hardware, software and human potential, discuss how computers can enhance human lives, especially in some of the most marginalized populations, and share their unique approaches to designing and building technologies that really work for people and for society.

Today, Dr. Ramachandra gives us an overview of the historic trade-offs between declarative and imperative programming paradigms, tells us some fantastic stories, including The Tale of Two Engineers and The UDF Story, Parts 1 and 2, and introduces us to Froid – that’s F-R-O-I-D, not the Austrian psychoanalyst – which is an extensible, language-agnostic framework for optimizing imperative functions in databases, offering the benefits of UDFs without sacrificing performance.

Today, Dr. Joppa shares how his love for nature and the joy of discovery actually helped shape his career path, and tells us all about AI for Earth, a multi-year, multi-million dollar initiative to deploy the full scale of Microsoft’s products, policies and partnerships across four key areas of agriculture, water, biodiversity and climate, and transform the way society monitors, models, and ultimately manages Earth’s natural resources.

Dr. Marc Pollefeys is a Professor of Computer Science at ETH Zurich, a Partner Director of Science for Microsoft, and the Director of a new Microsoft Mixed Reality and AI lab in Switzerland. He’s a leader in the field of computer vision research, but it’s hard to pin down whether his work is really about the future of computer vision, or about a vision of future computers. Arguably, it’s both!

On today’s podcast, Dr. Pollefeys brings us up to speed on the latest in computer vision research, including his innovative work with Azure Spatial Anchors, tells us how devices like Kinect and HoloLens may have cut their teeth in gaming, but turned out to be game changers for both research and industrial applications, and explains how, while it’s still early days now, in the future, you’re much more likely to put your computer on your head than on your desk or your lap.

On today’s podcast, Ann tells us all about life in the extreme constraint design lane, explains what a PALS is, and tells us some incredibly entertaining stories about how the eye tracking technology behind the Eye Controlled Wheelchair and the Hands-Free Music Project has made its way from Microsoft’s campus to some surprising events around the country, including South by Southwest and Mardi Gras.

You may have heard the phrase, necessity is the mother of invention, but for Dr. Nicolo Fusi, a researcher at the Microsoft Research lab in Cambridge, Massachusetts, the mother of his invention wasn’t so much necessity as it was boredom: the special machine learning boredom of manually fine-tuning models and hyper-parameters that can eat up tons of human and computational resources, but bring no guarantee of a good result. His solution? Automate machine learning with a meta-model that figures out what other models are doing, and then predicts how they’ll work on a given dataset.

On today’s podcast, Dr. Fusi gives us an inside look at Automated Machine Learning – Microsoft’s version of the industry’s AutoML technology – and shares the story of how an idea he had while working on a gene editing problem with CRISPR/Cas9 turned into a bit of a machine learning side quest and, ultimately, a surprisingly useful instantiation of Automated Machine Learning – now a feature of Azure Machine Learning – that reduces dependence on intuition and takes some of the tedium out of data science at the same time.

Today, Dr. Raghuvanshi talks about the unique challenges of simulating realistic sound on a budget (both money and CPU), explains how classic ideas in concert hall acoustics need a fresh take for complex games like Gears of War, reveals the computational secret sauce you need to deliver the right sound at the right time, and tells us about Project Triton, an acoustic system that models how real sound waves behave in 3-D game environments to makes us believe with our ears as well as our eyes.

Today, Dr. Phillips talks about the challenges and rewards inherent in reverse engineering biological systems to see how they perform information processing. He also explains what we can learn from stressed out bacteria, and tells us about Station B, a new end-to-end platform his team is working on that aims to reduce the trial and error nature of lab experiments and help scientists turn biological cells into super-factories that could solve some of the most challenging problems in medicine, agriculture, the environment and more.

You know those people who work behind the scenes to make sure nothing bad happens to you, and if they’re really good, you never know who they are because nothing bad happens to you? Well, meet one of those people. Dr. Brian LaMacchia is a Distinguished Engineer and he heads up the Security and Cryptography Group at Microsoft Research. It’s his job to make sure – using up-to-the-minute math – that you’re safe and secure online, both now, and in the post-quantum world to come.Today, Dr. LaMacchia gives us an inside look at the world of cryptography and the number theory behind it, explains what happens when good algorithms go bad, and tells us why, even though cryptographically relevant quantum computers are still decades away, we need to start developing quantum-resistant algorithms right now.

Today, Dr. Benaloh gives us a brief but fascinating history of elections, explains how the trade-offs among privacy, security and verifiability make the relatively easy math of elections such a hard problem for the internet, and tells the story of how the University of Michigan fight song forced the cancellation of an internet voting pilot.

Today, Dr. El Asri talks about the particular challenges she and other scientists face in building sophisticated dialogue systems that lay the foundation for talking machines. She also explains how reinforcement learning, in the form of a text game generator called TextWorld, is helping us get there, and relates a fascinating story from more than fifty years ago that reveals some of the safeguards necessary to ensure that when we design machines specifically to pass the Turing test, we design them in an ethical and responsible way.

On today’s podcast, Dr. Varma tells us all about extreme classification (including where in the world you might actually run into 10 or 100 million options), reveals how his Parabel and Slice algorithms are making high quality recommendations in milliseconds, and proves, with both his life and his work, that being blind need not be a barrier to extreme accomplishment.

On today’s podcast, Haiyan talks about her unique “brain hack” approach to the human-centered design process, and discusses a wide range of projects, from the connected play experience of Zanzibar, to Fizzyo, which turns laborious breathing exercises for children with cystic fibrosis into a video game, to Project Emma, an application of haptic vibration technology that, somewhat curiously, offsets the effects of tremors caused by Parkinson’s disease.

Today, Dr. Malvar recalls his early years at a fledgling Microsoft Research, talks about the exciting work he oversees now, explains why designing with the user is as important as designing for the user, and tells us how a challenge from an ex-football player with ALS led to a prize winning hackathon project and produced the core technology that allows you to type on a keyboard without your hands and drive a wheelchair with your eyes.

On today’s podcast, Dr. Morrison gives us an overview of what she calls the “pillars” of inclusive design, shares how her research is positively impacting people with health issues and disabilities, and tells us how having a child born with blindness put her in touch with a community of people she would otherwise never have met, and on the path to developing Project Torino, an inclusive physical programming language for children with visual impairments.

Today, Dr. Bennett brings us up to speed on the science of contextually intelligent assistants, explains how what we think our machines can do actually shapes what we expect them to do, and shares how current research in machine learning and data science is helping machines reason on our behalf in the quest to help us find the right information effortlessly.

Today, Dr. Protzenko talks about what’s wrong with software (and why it’s vitally important to get it right), explains why there are so many programming languages (and tells us about a few he’s been working on), and finally, acts as our digital Sherpa for Project Everest, an assault on software integrity and confidentiality that aims to build and deploy a verified HTTPS stack.

Today, Dr. Peyton Jones shares his passion for functional programming research, reveals how a desire to help other researchers write and present better turned him into an unlikely YouTube star, and explains why, at least in the world of programming languages, purity is embarrassing, laziness is cool, and success should be avoided at all costs.

On today’s podcast, Amos Miller answers burning questions like how do you make a microwave accessible, what’s the cocktail party effect, and how do you hear a landmark? He also talks about how researchers are exploring the untapped potential of 3D audio in virtual and augmented reality applications, and explains how, in the end, his work is not so much about making technology more accessible, but using technology to make life more accessible.

Today, Dr. Bubeck explains the difficulty of the multi-armed bandit problem in the context of a parameter- and data-rich online world. He also discusses a host of topics from randomness and convex optimization to metrical task systems and log n competitiveness to the surprising connection between Gaussian kernels and what he calls some of the most beautiful objects in mathematics.

Today, Dr. Bishop talks about the past, present and future of AI research, explains the No Free Lunch Theorem, talks about the modern view of machine learning (or how he learned to stop worrying and love uncertainty), and tells how the real excitement in the next few years will be the growth in our ability to create new technologies not by programming machines but by teaching them to learn.

Today, Dr. McDuff talks about why we need computers to understand us, outlines the pros and cons of designing emotionally sentient agents, explains the technology behind CardioLens, a pair of augmented reality glasses that can take your heartrate by looking at your face, and addresses the challenges of maintaining trust and privacy when we’re surrounded by devices that want to know not just what we’re doing, but how we’re feeling.

On today’s podcast, Dr. Tashev gives us an overview of the quest for better sound processing and speech enhancement, tells us about the latest innovations in 3D audio, and explains why the research behind audio processing technology is, thanks to variations in human perception, equal parts science, art and craft.

On today’s podcast, Dr. Hon gives us a brief history of MSR Asia, from its humble beginnings to its significant role in the AI boom today, talks about MSR Asia’s unique talent pipeline, shares his vision for the complementary roles of machine intelligence and human wisdom, and explains why, he believes, the more progress we make in AI, the better we understand ourselves.

On today’s podcast, Dr. Strauss talks about life at the intersection of computer science and biology which, for many, is more like the intersection of science fiction and science, and explains how the unique properties of DNA could eventually enable us to store really big data in really small places for a really long time.