About google's approach to research publication by Jeff Dean

1. About Google's approach to research publication
I understand the concern over Timnit Gebru’s resignation from Google. She’s done a great deal
to move the field forward with her research. I wanted to share the email I sent to Google
Research and some thoughts on our research process.
Here’s the email I sent to the Google Research team on Dec. 3, 2020:
Hi everyone,
I’m sure many of you have seen that Timnit Gebru is no longer working at Google. This
is a difficult moment, especially given the important research topics she was involved in,
and how deeply we care about responsible AI research as an org and as a company.
Because there’s been a lot of speculation and misunderstanding on social media, I
wanted to share more context about how this came to pass, and assure you we’re here
to support you as you continue the research you’re all engaged in.
Timnit co-authored a paper with four fellow Googlers as well as some external
collaborators that needed to go through our review process (as is the case with all
externally submitted papers). We’ve approved dozens of papers that Timnit and/or the
other Googlers have authored and then published, but as you know, papers often require
changes during the internal review process (or are even deemed unsuitable for
submission). Unfortunately, this particular paper was only shared with a day’s notice
before its deadline — we require two weeks for this sort of review — and then instead of
awaiting reviewer feedback, it was approved for submission and submitted.
A cross functional team then reviewed the paper as part of our regular process and the
authors were informed that it didn’t meet our bar for publication and were given feedback
about why. It ignored too much relevant research — for example, it talked about the
environmental impact of large models, but disregarded subsequent research showing
much greater efficiencies. Similarly, it raised concerns about bias in language models,
but didn’t take into account recent research to mitigate these issues. We acknowledge
that the authors were extremely disappointed with the decision that Megan and I
ultimately made, especially as they’d already submitted the paper.
Timnit responded with an email requiring that a number of conditions be met in order for
her to continue working at Google, including revealing the identities of every person who
Megan and I had spoken to and consulted as part of the review of the paper and the
exact feedback. Timnit wrote that if we didn’t meet these demands, she would leave
Google and work on an end date. We accept and respect her decision to resign from
Google.

2. Given Timnit's role as a respected researcher and a manager in our Ethical AI team, I
feel badly that Timnit has gotten to a place where she feels this way about the work
we’re doing. I also feel badly that hundreds of you received an email just this week from
Timnit telling you to stop work on critical DEI programs. Please don’t. I understand the
frustration about the pace of progress, but we have important work ahead and we need
to keep at it.
I know we all genuinely share Timnit’s passion to make AI more equitable and inclusive.
No doubt, wherever she goes after Google, she’ll do great work and I look forward to
reading her papers and seeing what she accomplishes.
Thank you for reading and for all the important work you continue to do.
-Jeff
I’ve also received questions about our research and review process, so I wanted to share more
here. I'm going to be talking with our research teams, especially those on the Ethical AI team
and our many other teams focused on responsible AI, so they know that we strongly support
these important streams of research. And to be clear, we are deeply committed to continuing
our research on topics that are of particular importance to individual and intellectual diversity --
from unfair social and technical bias in ML models, to the paucity of representative training data,
to involving social context in AI systems. That work is critical and I want our research programs
to deliver more work on these topics -- not less.
In my email above, I detailed some of what happened with this particular paper. But let me give
a better sense of the overall research review process. It’s more than just a single approver or
immediate research peers; it’s a process where we engage a wide range of researchers, social
scientists, ethicists, policy & privacy advisors, and human rights specialists from across
Research and Google overall. These reviewers ensure that, for example, the research we
publish paints a full enough picture and takes into account the latest relevant research we’re
aware of, and of course that it adheres to our AI Principles.
Those research review processes have helped improve many of our publications and research
applications. While more than 1,000 projects each year turn into published papers, there are
also many that don’t end up in a publication. That’s okay, and we can still carry forward
constructive parts of a project to inform future work. There are many ways we share our
research; e.g. publishing a paper, open-sourcing code or models or data or colabs, creating
demos, working directly on products, etc.
This paper surveyed valid concerns with large language models, and in fact many teams at
Google are actively working on these issues. We’re engaging the authors to ensure their input
informs the work we’re doing, and I’m confident it will have a positive impact on many of our
research and product efforts.

3. But the paper itself had some important gaps that prevented us from being comfortable putting
Google affiliation on it. For example, it didn’t include important findings on how models can be
made more efficient and actually reduce overall environmental impact, and it didn’t take into
account some recent work at Google and elsewhere on mitigating bias in language models.
Highlighting risks without pointing out methods for researchers and developers to understand
and mitigate those risks misses the mark on helping with these problems. As always, feedback
on paper drafts generally makes them stronger when they ultimately appear.
We have a strong track record of publishing work that challenges the status quo -- for example,
we’ve had more than 200 publications focused on responsible AI development in the last year
alone. Just a few examples of research we’re engaged in that tackles challenging issues:
● Measuring and reducing gendered correlations in pre-trained NLP models
● Evading Deepfake-Image Detectors with White- and Black-Box Attacks
● Extending the Machine Learning Abstraction Boundary: A Complex Systems Approach
to Incorporate Societal Context
● CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims
● What Does AI Mean for Smallholder Farmers? A Proposal for Farmer-Centered AI
Research [forthcoming]
● SoK: Hate, Harassment, and the Changing Landscape of Online Abuse
● Accelerating eye movement research via accurate and affordable smartphone eye
tracking
● The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks
● Assessing the impact of coordinated COVID-19 exit strategies across Europe
● Practical Compositional Fairness: Understanding Fairness in Multi-Component Ranking
Systems
I’m proud of the way Google Research provides the flexibility and resources to explore many
avenues of research. Sometimes those avenues run perpendicular to one another. This is by
design. The exchange of diverse perspectives, even contradictory ones, is good for science
and good for society. It’s also good for Google. That exchange has enabled us not only to
tackle ambitious problems, but to do so responsibly.
Our aim is to rival peer-reviewed journals in terms of the rigor and thoughtfulness in how we
review research before publication. To give a sense of that rigor, this blog post captures some
of the detail in one facet of review, which is when a research topic has broad societal
implications and requires particular AI Principles review -- though it isn’t the full story of how we
evaluate all of our research, it gives a sense of the detail involved:
https://blog.google/technology/ai/update-work-ai-responsible-innovation/
We’re actively working on improving our paper review processes, because we know that too
many checks and balances can become cumbersome. We will always prioritize ensuring our
research is responsible and high-quality, but we’re working to make the process as streamlined
as we can so it’s more of a pleasure doing research here.

4. A final, important note -- we evaluate the substance of research separately from who’s doing it.
But to ensure our research reflects a fuller breadth of global experiences and perspectives in
the first place, we’re also committed to making sure Google Research is a place where every
Googler can do their best work. We’re pushing hard on our efforts to improve representation
and inclusiveness across Google Research, because we know this will lead to better research
and a better experience for everyone here.