11–13 Dec 2025
Asia/Tokyo timezone

Feedback Style and Engineer Productivity

12 Dec 2025, 10:45
45m
"Hall A1 (330)" (Toranomon Hills Mori Tower)

"Hall A1 (330)"

Toranomon Hills Mori Tower

LPC Refereed Track LPC Refereed Track

Speakers

Calvin Jahnke (Princeton University) Carolyn Tsao (Microsoft Research) Gabor Nyeki

Description

This paper studies how a maintainer's tone when giving feedback to engineers affects individual productivity and output quality. We construct a novel panel dataset that links software engineers and maintainers to their email communications and code contributions on the largest open source software project, the Linux kernel. We identify tones used in the emails (e.g., toxic, polite, encouraging) using natural language processing and machine learning techniques. Additionally, to control for the informativeness of feedback, we fine-tune a large language model (GPT-2) and use the token probabilities it generates to construct measures of entropy and surprisal. We find a strong negative relationship between toxicity and engineer productivity. Using an instrumental variables design to address endogeneity in a maintainer's choice of tone, we find that receiving toxic feedback from a maintainer reduces the likelihood that an engineer completes a programming task, increases the amount of time to task completion, and decreases the likelihood that an engineer completes more tasks in the next 30 days.

Primary authors

Calvin Jahnke (Princeton University) Carolyn Tsao (Microsoft Research) Gabor Nyeki

Presentation materials

There are no materials yet.