The effects of remote work on collaboration among information workers

Probably not a substantial claim: may not pass S3 (load-bearing).

Nearly every American who was able to work from home did so during the pandemic.

“nearly every American that was able to work from home did so 4”

• cites [4] Dingel, J. I. & Neiman, B. How many jobs can be done at home? J. Public Econ. 189, 104235 (2020). sourcePartly supported

  The Introduction estimates that 37% of US jobs can be done entirely at home, and Related literature and real-time measures reports a survey finding that 35% of US respondents worked entirely from home in May 2020. Those similar aggregate figures do not establish that nearly every American whose job was feasible from home actually worked from home; the paper does not track that overlap. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

Classified as probably not a substantial claim. May combine two claims.

Recent analyses of telemetry and survey data show that the pandemic affected both the who and the how of collaboration in information firms, with workers spending less time in meetings, communicating more by email, collaborating more with strong ties, and exhibiting more siloed and less stable communication patterns.

“Recent analyses of telemetry and survey data show that the pandemic has affected both the who and the how of collaboration in information firms-while working remotely during the pandemic, workers are spending less time in meetings 35 , communicating more by email 35 , collaborating more with their strong ties as opposed to their weak ties 36 , and exhibiting patterns of communication that are more”

• cites [35] DeFilippis, E., Impink, S., Singell, M., Polzer, J. T. & Sadun, R. Collaborating During Coronavirus: The Impact of COVID-19 on the Nature of Work. Working Paper 21-006 (Harvard Business School Organizational Behavior Unit, 2020). sourceSupported
• cites [36] Bernstein, E., Blunden, H., Brodsky, A., Sohn, W. & Waber, B. The implications of working without an office. Harvard Business Review (15 July 2020); https://hbr.org/2020/07/the-implications-of-working-without-an-officeNot checked yet

  Not checked in the free run.

• cites [37] Larson, J. et al. Dynamic silos: modularity in intra-organizational communication networks before and during the COVID-19 pandemic. Preprint at https://arxiv.org/abs/2104.00641 (2021). sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing).

Changes in collaboration patterns may reduce the quality of workers' output.

“and reduce the quality of workers' output 11,23 .”

• cites [11] Uzzi, B. & Spiro, J. Collaboration and creativity: the small world problem. Am. J. Sociol. 111, 447–504 (2005). sourceNot checked — no full text of the source
• cites [23] Soda, G. B., Mannucci, P. V. & Burt, R. Networks, creativity, and time: staying creative through brokerage and network rejuvenation. Acad. Manage. J. https://doi.org/10.5465/amj.2019.1209 (2021). sourcePartly supported

  The Theoretical Contributions section acknowledges that adding new collaborators can disrupt coordination and routines, and says new ties benefit creativity only when paired with suitable network structures and content. It does not establish that changes in collaboration patterns reduce workers’ output quality generally; its findings concern creative outcomes in a specific collaborative setting. (LLM, conf=0.82)

  Experimental — accuracy not yet measured

May combine two claims.

For the remaining 82% of US Microsoft employees, the shift to firm-wide remote work induced variation in both their own remote work status and the remote work status of their coworkers.

“For the remaining 82% of US Microsoft employees, the shift to firm-wide remote work induced variation in both their own remote work status and in the remote work status of their coworkers.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

May combine two claims.

Large changes were observed in the average shares of monthly collaboration hours spent with cross-group ties, bridging ties, weak ties and added ties, which all decreased precipitously between February and June.

“we did observe large changes in the average shares of monthly collaboration hours spent with cross-group ties, bridging ties, weak ties and added ties, which all decreased precipitously between February and June.”

May combine two claims.

There was a decrease in synchronous communication and an increase in asynchronous communication.

“there was a decrease in synchronous communication and an increase in asynchronous communication.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

May combine two claims.

For the 18% of US Microsoft employees already remote from collaborators, the shift to firm-wide remote work did not change their own remote work status but did induce variation in the share of colleagues working remotely.

“For this subset of employees, the shift to firm-wide remote work did not cause a change in their own remote work status, but did induce variation in the share of their colleagues who were working remotely.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

May combine two claims.

Remote work caused employees to communicate more through media that are more asynchronous, sending more emails and many more IMs.

“remote work caused employees to communicate more through media that are more asynchronous-sending more emails and many more IMs.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

May combine two claims.

The network became more static, with fewer ties added and deleted per month.

“Furthermore, the network became more static, with fewer ties added and deleted per month.”

May combine two claims.

For unscheduled call hours, meeting hours, total video/audio hours and IMs sent, considerable increases were observed around the time of the switch to firm-wide remote work, and these increases were sustained through the data timespan.

“For unscheduled call hours, meeting hours, total video/audio hours and IMs sent, we observed considerable increases around the time of the switch to firm-wide remote work; these increases are sustained through our data timespan.”

May combine two claims.

Of the added ties observed in June 2020, 40% existed in at least one month between January 2020 and May 2020, whereas the remaining 60% did not.

“Of the added ties we observed in June 2020, 40% existed in at least one month between January 2020 and May 2020, whereas the remaining 60% did not.”

May combine two claims.

The change in email volume is much smaller and shorter-lived.

“The change in email volume is much smaller and shorter-lived.”

May combine two claims.

Shifting to firm-wide remote work caused the collaboration network to become more heavily siloed, with fewer ties that cut across formal business units or bridge structural holes in Microsoft's informal collaboration network.

“Our results suggest that shifting to firm-wide remote work caused the collaboration network to become more heavily siloed-with fewer ties that cut across formal business units or bridge structural holes in Microsoft's informal collaboration network”

• AssumptionThe authors state this as an assumption: The time series for treated and untreated workers would have evolved in parallel absent the treatment for both treatment variables.
• AssumptionThe authors state this as an assumption: The timing of the switch to remote work is independent of employees' outcomes (strict exogeneity).
• AssumptionThe authors state this as an assumption: Workers' remote work status before the pandemic and the percentage of workers' colleagues that work remotely before the pandemic are independent of how they are affected by the pandemic.
• AssumptionThe authors state this as an assumption: Conditional on the CEM procedure, employees' pre-pandemic remote work status and the percentage of colleagues working remotely were independent of the effects of ego remote work and collaborator remote work on their work outcomes.
• AssumptionThe authors state this as an assumption: Ego remote work effects, collaborator remote work effects and non-remote-work-related COVID-19 effects are additively separable.

Classified as probably not a substantial claim. May combine two claims.

Most employees transitioned to WFH during the week of 1 March 2020, although the analysis omits the month of March as a transition period.

“Most employees transitioned to WFH during the week of 1 March 2020, although our analysis omits the month of March as a transition period.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Many technology companies have announced longer-term or permanent remote work policies that will enable at least some employees to work remotely after the pandemic.

“Many technology companies, such as Twitter, Facebook, Square, Box, Slack and Quora, have taken this shift one step further by announcing longer term and, in some cases permanent, remote work policies that will enable at least some employees to work remotely, even after the pandemic 5,6”

• cites [5] Benveniste, A. These companies’ workers may never go back to the office. CNN (18 October 2020); https://cnn.it/3jIobzJNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [6] McLean, R. These companies plan to make working from home the new normal. As in forever. CNN (25 June 2020); https://cnn.it/3ebJU27Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Firm-wide remote work caused the collaboration network to become more siloed, both in a formal sense and in an informal sense.

“also suggest that firm-wide remote work caused the collaboration network to become more siloed, both in a formal sense and in an informal sense.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

May combine two claims.

These analyses, like much previous research on remote work, virtual teams and telecommuting, are non-causal and unable to separate the effects of remote work from pandemic-related confounding factors.

“these analyses, like much of the previous research on remote work, virtual teams and telecommuting, are non-causal 31 and are therefore unable to separate the effects of remote work from the effects of pandemic-related confounding factors”

• cites [31] Allen, T. D., Golden, T. D. & Shockley, K. M. How effective is telecommuting? Assessing the status of our scientific findings. Psychol. Sci. Publ. Int. 16, 40–68 (2015). sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing).

For firms, certain network configurations are associated with the production of high-quality creative output.

“For firms, certain network configurations are associated with the production of high-quality creative output 11”

• cites [11] Uzzi, B. & Spiro, J. Collaboration and creativity: the small world problem. Am. J. Sociol. 111, 447–504 (2005). sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing).

The efficacy with which a given tie can transfer or provide access to novel information depends on its strength.

“Conditional on a given network position or configuration, the efficacy with which a given tie can transfer or provide access to novel information depends on its strength.”

May combine two claims.

Firm-wide remote work caused the collaboration network of workers to become more static and siloed, with fewer bridges between disparate parts.

“firm-wide remote work caused the collaboration network of workers to become more static and siloed, with fewer bridges between disparate parts.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Media synchronicity theory proposes that asynchronous communication channels are better suited for conveying information and synchronous channels are better suited for converging on the meaning of information.

“media synchronicity theory 28 proposes that asynchronous communication channels (such as email) are better suited for conveying information and synchronous channels (such as video calls) are better suited for converging on the meaning of information.”

• cites [28] Dennis, A. R., Fuller, R. M. & Valacich, J. S. Media, tasks, and communication processes: a theory of media synchronicity. MIS Q. 32, 575–600 (2008). sourceNot checked — no full text of the source

May combine two claims.

Firm-wide remote work caused an overall decrease in the number of cross-group interactions and the fraction of attention paid to groups other than one's own.

“In other words, firm-wide remote work caused an overall decrease in the number of cross-group interactions and the fraction of attention paid to groups other than one's own.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

Probably not a substantial claim: may not pass S3 (load-bearing).

There is a competitive advantage to successfully engaging in knowledge transfer within an organization.

“there is a competitive advantage to successfully engaging in the practice of 'knowledge transfer, ' in which experiences from one set of people within an organization are transferred to and used by another set of people within that same organization 12”

• cites [12] Argote, L. & Ingram, P. Knowledge transfer: a basis for competitive advantage in firms. Organ. Behav. Hum. Dec. Process. 82, 150–169 (2000). sourceNot checked — no full text of the source

Classified as probably not a substantial claim. May combine two claims.

The performance of workers is affected not only by network structure and tie strength but also by the temporal dynamics of the network.

“Previous research has also shown that the performance of workers is affected not only by the structure of the network and the strength of their ties, but also by the temporal dynamics of the network.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Two people connected by a strong tie can often transfer information more easily, trust one another, cooperate, and expend effort to ensure recently transferred knowledge is understood and utilized.

“Two people connected by a strong tie can often transfer information more easily (as they are more likely to share a common perspective), to trust one another, to cooperate with one another, and to expend effort to ensure that recently transferred knowledge is well understood and can be utilized 10,[13][14][15]”

• cites [10] Reagans, R. & McEvily, B. Network structure and knowledge transfer: the effects of cohesion and range. Admin. Sci. Q. 48, 240–267 (2003). sourceNot checked — no full text of the source
• cites [13] Hansen, M. T. The search-transfer problem: the role of weak ties in sharing knowledge across organization subunits. Admin. Sci. Q. 44, 82–111 (1999). sourceNot checked — no full text of the source
• cites [14] Krackhardt, D. The strength of strong ties. in Networks in the Knowledge Economy (Oxford Univ. Press, 2003).Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based).

Remote work eliminates in-person communication.

“Remote work obviously eliminates in-person communication”

Classified as probably not a substantial claim. May combine two claims.

The model specification decomposes the overall effects of firm-wide remote work into ego remote work and collaborator remote work effects, providing insight into possible impacts of mixed-mode and hybrid work.

“as our model specification decomposes the overall effects of firm-wide remote work into ego remote work and collaborator remote work effects, our results also provide some insight into the possible impacts of remote work policies such as mixed-mode work and hybrid work.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Media richness theory posits that richer communication channels, such as in-person interaction, are best suited to communicating complex information and ideas.

“media richness theory 26,27 posits that richer communication channels, such as in-person interaction, are best suited to communicating complex information and ideas.”

• cites [26] Lengel, R. H. & Daft, R. L. An Exploratory Analysis of the Relationship Between Media Richness and Managerial Information Processing. Technical Report (Texas A&M Univ. Department of Management, 1984).Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [27] Daft, R. L. & Lengel, R. H. Organizational information requirements, media richness and structural design. Manage. Sci. 32, 554–571 (1986). sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing).

Being a conduit through which non-redundant information flows by bridging structural holes can have additional benefits for individuals.

“being a conduit through which such information flows by bridging 'structural holes' 9 in the organization can have additional benefits for individuals 10”

• cites [9] Burt, R. S. Structural holes and good ideas. Am. J. Sociol. 110, 349–399 (2004). sourceNot checked — no full text of the source
• cites [10] Reagans, R. & McEvily, B. Network structure and knowledge transfer: the effects of cohesion and range. Admin. Sci. Q. 48, 240–267 (2003). sourceNot checked — no full text of the source

Classified as probably not a substantial claim. May combine two claims.

People benefit from changing their network position, adding new ties, and reconnecting with dormant ties.

“people also benefit from changing their network position [20][21][22] , adding new ties 23,24 and reconnecting with dormant ties 25”

• cites [20] Kneeland, M. K. Network Churn: A Theoretical and Empirical Consideration of a Dynamic Process on Performance. PhD thesis, New York University (2019).Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [21] Kumar, P. & Zaheer, A. Ego-network stability and innovation in alliances. Acad. Manage. J. 62, 691–716 (2019). sourceNot checked — no full text of the source
• cites [22] Burt, R. S. & Merluzzi, J. Network oscillation. Acad. Manage. Discov. 2, 368–391 (2016). sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing).

The benefits of different types of ties vary with their age.

“the benefits of different types of ties vary with their age 19”

• cites [19] Baum, J. A., McEvily, B. & Rowley, T. J. Better with age? Tie longevity and the performance implications of bridging and closure. Organ. Sci. 23, 529–546 (2012). sourceNot checked — no full text of the source

May combine two claims.

Given no statistically significant effect of remote work on the number of colleagues with whom workers collaborate, firm-wide remote work caused workers to substitute ties that were not connected to one another for those that were.

“this result suggests that, on average, firm-wide remote work caused workers to substitute ties that were not connected to one another for those that were.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

Probably not a substantial claim: may not pass S3 (load-bearing).

In-person and phone/video communication are more strongly associated with positive team performance than email and instant message communication.

“in-person and phone/video communication are more strongly associated with positive team performance than email and instant message (IM) communication 30”

• cites [30] Pentland, A. The new science of building great teams. Harvard Bus. Rev. 90, 60–69 (2012).Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

Media richness theory, media synchronicity theory and previous empirical studies suggest that these communication media choices may make it more difficult for workers to convey and/or converge on the meaning of complex information.

“Media richness theory, media synchronicity theory and previous empirical studies all suggest that these communication media choices may make it more difficult for workers to convey and/or converge on the meaning of complex information.”

May combine two claims.

The shift to firm-wide remote work may have reduced the benefits of network dynamics by making the collaboration network of workers more static, with individuals adding and deleting fewer ties from month-to-month and spending less time with newly added ties.

“individuals added and deleted fewer ties from month-to-month and spent less time with newly added ties.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

Probably not a substantial claim: may not pass S3 (load-bearing).

Establishing a rapport, an important precursor to knowledge transfer, is impeded by email use.

“previous research has shown that establishing a rapport, which is an important precursor to knowledge transfer, is impeded by email use 29”

• cites [29] Morris, M., Nadler, J., Kurtzberg, T. & Thompson, L. Schmooze or lose: social friction and lubrication in e-mail negotiations. Group Dyn. Theor. Res. Pract. 6, 89–100 (2002). sourceNot checked — no full text of the source

May combine two claims.

Weak ties require less time and energy to maintain and are more likely to provide access to new, non-redundant information.

“weak ties require less time and energy to maintain 8,16 and are more likely to provide access to new, non-redundant information 8,17,18”

• cites [8] Granovetter, M. The strength of weak ties. Am. J. Sociol. 78, 1360–1380 (1973). sourceNot checked — no full text of the source
• cites [16] McFadyen, M. A. & Cannella Jr, A. A. Social capital and knowledge creation: diminishing returns of the number and strength of exchange relationships. Acad. Manage. J. 47, 735–746 (2004). sourceNot checked — no full text of the source
• cites [17] Granovetter, M. The strength of weak ties: a network theory revisited. in Social Structure and Network Analysis 105–130 (Sage, 1982). sourceNot checked — no full text of the source

May combine two claims.

As remote work was mandatory during the pandemic, the study is able to quantify the effects of firm-wide remote work, which are most relevant for firms considering a transition to an all-remote workforce.

“As remote work was mandatory during the pandemic, we are able to quantify the effects of firm-wide remote work, which are most relevant for firms considering a transition to an all-remote workforce.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

May combine two claims.

Firm-wide remote work caused workers to have fewer bridging ties and to spend less time with their remaining bridging ties.

“The fact that firm-wide remote work caused workers to have fewer bridging ties, and to spend less time with their remaining bridging ties”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

May combine two claims.

The modified DiD model extends the standard DiD model by estimating causal effects of changes in two treatment variables and by introducing additional identifying assumptions such that causal inferences are possible in the presence of an additional shock concurrent with the treatment shocks.

“Our modified DiD model extends the standard DiD model by estimating the causal effects of changes in two different treatment variables (one's own remote work status and the remote work status of one's colleagues) and by introducing additional identifying assumptions such that it is possible to draw causal inferences in the presence of an additional shock (in our case, the non-WFH-related aspects”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.
• AssumptionThe authors state this as an assumption: The non-WFH-related aspects of COVID-19 affect both treated and untreated units in a way that the modified difference-in-differences model can account for.

Probably not a substantial claim: may not pass S3 (load-bearing).

Network topology, including the strength of ties, has an important role in the success of both individuals and organizations.

“Previous research has shown that network topology, including the strength of ties, has an important role in the success of both individuals and organizations.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

For individuals, it is beneficial to have access to new, non-redundant information through connections to different parts of an organization's formal organizational chart and through connections to different parts of an organization's informal communication network.

“For individuals, it is beneficial to have access to new, non-redundant information through connections to different parts of an organization's formal organizational chart and through connections to different parts of an organization's informal communication network 8”

• cites [8] Granovetter, M. The strength of weak ties. Am. J. Sociol. 78, 1360–1380 (1973). sourceNot checked — no full text of the source

May combine two claims.

Different portions of the network, which became less interconnected, also became more intraconnected.

“In other words, different portions of the network, which became less interconnected, also became more intraconnected.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

May combine two claims.

The communication media that workers used were less synchronous and less 'rich' (for example, email and IM).

“Not only were the communication media that workers used less synchronous, but they were also less 'rich' (for example, email and IM).”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

There are multiple high-profile cases of firms such as IBM and Yahoo! enacting, but ultimately rescinding, flexible remote work policies before COVID-19, presumably due to the impacts of these policies on communication and collaboration.

“There are multiple high-profile cases of firms such as IBM and Yahoo! enacting, but ultimately rescinding, flexible remote work policies before COVID-19, presumably due to the impacts of these policies on communication and collaboration 61,62 .”

• cites [61] Swisher, K. Physically together: here’s the internal Yahoo no-work-from-home memo for remote workers and maybe more. All Things (22 February 2013).Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [62] Simons, J. IBM, a pioneer of remote work, calls workers back to the office. Wall Street Journal (18 May 2017).Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

It is possible that the long-term effects of firm-wide remote work are different from the short-term effects measured over three months.

“Second, the period of time over which we measured the causal effects of remote work are quite short (three months), and it is possible that the long-term effects of firm-wide remote work are different.”

Probably not a substantial claim: may not pass S4 (based).

The ability to make causal claims is predicated on the validity of the modified DiD framework's identifying assumptions: parallel trends, conditional exogeneity after matching and additively separable effects.

“Finally, our ability to make causal claims is predicated on the validity of our modified DiD framework's identifying assumptions: parallel trends, conditional exogeneity after matching and additively separable effects.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Changes in collaboration patterns may impede the transfer of knowledge.

“Previous research suggests that these changes in collaboration patterns may impede the transfer of knowledge 10,12,13”

• cites [10] Reagans, R. & McEvily, B. Network structure and knowledge transfer: the effects of cohesion and range. Admin. Sci. Q. 48, 240–267 (2003). sourceNot checked — no full text of the source
• cites [12] Argote, L. & Ingram, P. Knowledge transfer: a basis for competitive advantage in firms. Organ. Behav. Hum. Dec. Process. 82, 150–169 (2000). sourceNot checked — no full text of the source
• cites [13] Hansen, M. T. The search-transfer problem: the role of weak ties in sharing knowledge across organization subunits. Admin. Sci. Q. 44, 82–111 (1999). sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The effects of firm-wide remote work on collaboration networks and communication media usage may interact and exacerbate one another.

“Third, our analysis treats the effects of firm-wide remote work on peoples' collaboration networks and communication media usage as separate, whereas these two types of effects may interact and exacerbate one another.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

The impacts of network structure and communication media choice on performance are likely contingent on a number of factors, including the type of task a given team/organization is trying to complete.

“Even if we were able to measure productivity and innovation, the impacts of network structure and communication media choice on performance are likely contingent on a number of factors, including the type of task a given team/organization is trying to complete [56][57][58][59] .”

• cites [56][57][58]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Firm-wide remote work ossified workers' ego networks, made the network more fragmented and made each fragment more clustered.

“our results suggest that firm-wide remote work ossified workers' ego networks, made the network more fragmented and made each fragment more clustered.”

• AssumptionThe authors state this as an assumption: The identifying assumptions of the modified difference-in-differences model are satisfied or plausible.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Changes to workers' communication networks and media will affect productivity and innovation.

“although we believe that changes to workers' communication networks and media will affect productivity and innovation”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

The effects observed on workers' collaboration and communication patterns will impact productivity and, in the long-term, innovation.

“We expect that the effects we observe on workers' collaboration and communication patterns will impact productivity and, in the long-term, innovation.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

On the basis of these examples, one might conclude that the current enthusiasm for remote work may not ultimately translate into a long-lasting shift to remote work for the majority of firms.

“On the basis of these examples, one might conclude that the current enthusiasm for remote work may not ultimately translate into a long-lasting shift to remote work for the majority of firms.”

Classified as probably not a substantial claim. May combine two claims.

Steps were taken to verify the plausibility of the identifying assumptions and the robustness of results was tested with an alternative matching procedure.

“Although we have taken steps to verify the plausibility of these assumptions and tested the robustness of our results to an alternative matching procedure 60 (details of which are provided in the Methods), they are assumptions nonetheless.”

• cites [60] Athey, S., Mobius, M. M. & Pál, J. The impact of aggregators on Internet news consumption. Preprint at SSRN https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2897960 (2017).Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

In June 2020, both employees who were and were not working remotely before the COVID-19 pandemic were in the same potential outcome state (firm-wide remote work), and therefore matching on time-varying behavioural outcomes improves the credibility of the identifying assumptions.

“However, in June 2020, both employees who were and were not working remotely before the COVID-19 pandemic were in the same potential outcome state (firm-wide remote work), and therefore matching on time-varying behavioural outcomes improves the credibility of our identifying assumptions.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

This research was reviewed and classified as exempt by the MIT Committee on the Use of Humans as Experimental Subjects (MIT's Institutional Review Board), because the research was secondary use research involving the use of de-identified data.

“This research was reviewed and classified as exempt by the Massachusetts institute of Technology (MIT) Committee on the Use of Humans as Experimental Subjects (that is, MIT's Institutional Review Board), because the research was secondary use research involving the use of de-identified data.”

• AssumptionRests on an assumption: The use of the data is compliant with US employee privacy laws.
• AssumptionRests on an assumption: Microsoft provides employees with appropriate notice of its use of Workplace Analytics, and sets strict controls over the collection and use of such data.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Since the study includes all U.S. employees whose behavior is recorded by Workplace Analytics, the sample is by definition representative.

“Since we study all U.S. employees whose behavior is recorded by Workplace Analytics, our sample is by definition representative.”

• AssumptionRests on an assumption: Workplace Analytics is widely adopted within Microsoft.

Probably not a substantial claim: may not pass S3 (load-bearing).

To test robustness, the main DiD specification was re-estimated on an alternate matched sample constructed using a more extensive matching procedure.

“To test the robustness of our analysis, we re-estimate our main DiD specification on an alternate matched sample of employees who worked remotely before the COVID-19 pandemic, which is constructed using a more extensive matching procedure introduced in ref. 60 .”

• cites [60] Athey, S., Mobius, M. M. & Pál, J. The impact of aggregators on Internet news consumption. Preprint at SSRN https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2897960 (2017).Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

To make the strict exogeneity assumption more plausible, the CEM procedure was used.

“To make this identifying assumption more plausible, we use the CEM procedure described below.”

Classified as probably not a substantial claim.

Viewing the shift to remote work as a natural experiment in which some workers were already working remotely before the pandemic enables separation of the effects of firm-wide remote work from other pandemic-related confounding factors.

“Viewing this shift as a natural experiment in which some workers were already working remotely before the pandemic enables us to separate the effects of firm-wide remote work from other pandemic-related confounding factors.”

• AssumptionRests on an assumption: The COVID-19 pandemic caused a rapid shift to full-time remote work for many information workers.

Probably not a substantial claim: may not pass S3 (load-bearing).

Participants were not allocated into experimental groups since the study was observational.

“Participants were not allocated into experimental groups since our study was observational.”

Classified as probably not a substantial claim.

The ability to causally identify both ATTs is predicated on a number of identifying assumptions, some standard in DiD analyses and some specific to the research setting.

“Our ability to causally identify both ATTs is predicated on a number of identifying assumptions, some of which are standard in DiD analyses and some of which are specific to our research setting.”

May combine two claims.

In a standard matched DiD analysis, control and treatment units would be matched on the basis of pretreatment behaviour; this type of matching is not appropriate in this context because employees who did and did not work remotely before the COVID-19 pandemic are by definition in different potential outcome states in February.

“In a standard matched DiD analysis, control and treatment units would be matched on the basis of pretreatment behaviour.This type of matching is not appropriate in our context, given that employees who did and did not work remotely before the COVID-19 pandemic are by definition in different potential outcome states in February.”

May combine two claims.

The study uses quantitative quasi-experimental data (emails, calendars, instant messages, video/audio calls, and workweek hours) from 61,182 US Microsoft employees over the first six months of 2020 to estimate the causal effects of firm-wide remote work on collaboration and communication.

“Here, we use rich data on the emails, calendars, instant messages, video/audio calls and workweek hours of 61,182 US Microsoft employees over the first six months of 2020 to estimate the causal effects of firm-wide remote work on collaboration and communication.”

• Also stated in: § Study description · plain

  “This study uses quantitative quasi-experimental data to measure the effects of remote work on information workers' collaboration and communication practices.”

May combine two claims.

During the COVID-19 pandemic, workers and firms have invested in the physical and human capital required to support remote work and innovation has shifted toward new technologies that support remote work.

“However, during the COVID-19 pandemic, workers and firms have invested in the physical and human capital required to support remote work 63 and innovation has shifted toward new technologies that support remote work 64 .”

• cites [63] Barrero, J. M., Bloom, N. & Davis, S. J. Why working from home will stick. Working Paper (Univ. Chicago, Becker Friedman Institute for Economics, 2020). sourceNot checked — no full text of the source
• cites [64] Bloom, N., Davis, S. J. & Zhestkova, Y. COVID-19 shifted patent applications toward technologies that support working from home. Working Paper (Univ. Chicago, Becker Friedman Institute for Economics, 2020). sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S4 (based).

Provided that any differences in how the two groups would have evolved in the absence of the pandemic or how they are affected by the pandemic are entirely explained by the employee characteristics matched on, then the CEM-based results are valid.

“In other words, provided that any differences in how the two groups would have evolved in the absence of the pandemic or how they are affected by the pandemic are entirely explained by the employee characteristics we match on, then the CEM-based results are valid.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

For analyses using coarsened exact matching, employees for whom there are no matches are excluded, resulting in 105 Microsoft employees being excluded from these analyses.

“For our analyses that use coarsened exact matching, employees for whom there are no matches (i.e., they are 'treatment' employees in a bucket with no 'control' employees or vice-versa) are excluded from our analysis.This results in 105 Microsoft employees being excluded from these analyses.”

Classified as probably not a substantial claim.

Standard errors are clustered at the team level.

“s.e.values are clustered at the team level.”

Classified as probably not a substantial claim. May combine two claims.

Observations are weighted using coarsened exact matching (CEM) weights, and standard errors are clustered at the level of an employee's manager.

“Observations are weighted using coarsened exact matching (CEM) weights, and standard errors are clustered at the level of an employee's manager.”

May combine two claims.

In all cases, the time series appear to move in parallel both before the transition to remote work and once the transition concluded, suggesting the identifying assumption is reasonable.

“In all cases, the time series appear to move in parallel both before the transition to remote work, and once the transition to remote work concluded, suggesting that this identifying assumption is reasonable.”

Probably not a substantial claim: may not pass S3 (load-bearing).

For privacy reasons, the authors do not have access to demographic variables such as age and gender.

“For privacy reasons, we do not have access to demographic variables such as age and gender.”