The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Flash Organizations: Crowdsourcing Complex Work by Structuring Crowds As Organizations
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Likely outcomes of the growing capability of learning algorithms include their ability to assemble high-functioning teams by matching expertise, the flagging of individuals who cause bottlenecks or are not working to expectation, the performance of quality control and task rerouting, and finally the dynamic reconfiguration of roles and workflows (Faraj et al., 2018; Valentine et al., 2017).”
From Working and organizing in the age of the learning algorithm (2018) · cites this paper as Valentine et al., 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Dilemmas in a general theory of planning
Rittel, H. W. J., & Webber, M. M. (1973) · Policy Sciences · doi:10.1007/bf01405730 · Cited by 16,338 · cited 1×
“Open-ended and complex goals are not easily adapted to microtask workflows because it is difficult to articulate, modularize, and pre-specify all possible actions needed to achieve them [71, 80].”
BackgroundDeci, E. L., Koestner, R., & Ryan, R. M. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.6.627 · Cited by 7,176 · cited 1×
“In exchange for these benefits, flash organizations face the additional costs of negotiating contracts, motivation crowding [18], and paying for labor.”
BackgroundOrlikowski, W. J. (2000) · Organization Science · doi:10.1287/orsc.11.4.404.14600 · Cited by 4,760
Differentiation and Integration in Complex Organizations
Lawrence, P. R., & Lorsch, J. W. (1967) · Administrative Science Quarterly · doi:10.2307/2391211 · Cited by 3,937 · cited 2×
“No organizational form is perfect for all situations [52], and flash organizations are better suited for situations where these tradeoffs matter less.”
BackgroundWhat Makes Teams Work: Group Effectiveness Research from the Shop Floor to the Executive Suite
Cohen, S. G., & Bailey, D. E. (1997) · Journal of Management · doi:10.1177/014920639702300303 · Cited by 3,526
The interdisciplinary study of coordination
Malone, T. W., & Crowston, K. (1994) · ACM Computing Surveys · doi:10.1145/174666.174668 · Cited by 3,504
Awareness and coordination in shared workspaces
Dourish, P., & Bellotti, V. (1992) · Proceedings of the 1992 ACM conference on Computer-supported cooperative work - CSCW '92 · doi:10.1145/143457.143468 · Cited by 2,550 · cited 1×
“We designed our system using best practices for virtual coordination, such as loosely coupled work structures [35, 64], situational awareness [20, 27], current state visualization [10, 57], and rich communication tools [64].”
MethodResnick, P., Kuwabara, K., Zeckhauser, R., & Friedman, E. (2000) · Communications of the ACM · doi:10.1145/355112.355122 · Cited by 2,190
Olson, G. M., & Olson, J. S. (2000) · Human–Computer Interaction · doi:10.1207/s15327051hci1523_4 · Cited by 1,983 · cited 2×
“Many of the features afforded by collocated work, such as information exchange [65] and shared context [14], are difficult to replicate in distributed and online environments.”
BackgroundMethod
Research works printed but not linked: 66
- 10.1609/hcomp.v1i1.13081 · DOI
- 10.1287/orsc.1050.0149 · DOI · Paper page
- 10.1145/2047196.2047201 · DOI · Paper page
- Jeffrey P. Bigham , Michael S. Bernstein , and Eytan Adar . 2015. Human-Computer Interaction and Collective Intelligence . In Handbook of Collective Intelligence . MIT Press , 57--84. Jeffrey P. Bigham, Michael S. Bernstein, and Eytan Adar. 2015. Human-Computer Interaction and Collective Intelligence. In Handbook of Collective Intelligence. MIT Press, 57--84.
- 10.2307/3069401 · DOI · Paper page
- 10.2307/2393807 · DOI · Paper page
- 10.1016/S1071-5819(03)00024-7 · DOI · Paper page
- 10.1145/2858036.2858512 · DOI
- 10.1145/2470654.2466265 · DOI
- 10.1287/orsc.12.3.346.10098 · DOI · Paper page
- Peng Dai , Mausam, and Daniel S. Weld . 2010. Decision-Theoretic Control of Crowd-Sourced Workflows . In Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence (AAAI-10) . 1168--1174. Peng Dai, Mausam, and Daniel S. Weld. 2010. Decision-Theoretic Control of Crowd-Sourced Workflows. In Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence (AAAI-10). 1168--1174.
- 10.1093/qje/qjt002 · DOI · Paper page
- 10.5465/AMR.2007.26586086 · DOI · Paper page
- 10.1145/2984511.2984532 · DOI
- 10.2307/2657345 · DOI · Paper page
- 10.1145/2984511.2984542 · DOI
- 10.1145/2818048.2819942 · DOI
- 10.1145/175222.175230 · DOI · Paper page
- 10.1023/A:1021271517844 · DOI · Paper page
- 10.14778/2824032.2824062 · DOI
- J. Richard Hackman . 1987. The Design of Work Teams . In Handbook of Organizational Behavior, Jay W . Lorsch (Ed.). Prentice Hall , Englewood Cliffs, NJ . J. Richard Hackman. 1987. The Design of Work Teams. In Handbook of Organizational Behavior, Jay W. Lorsch (Ed.). Prentice Hall, Englewood Cliffs, NJ.
- 10.1145/2858036.2858364 · DOI
- Kieran Healy and Alan Schussman . 2003. The ecology of open-source software development. Unpublished manuscript , January 29 ( 2003 ), 2003. Kieran Healy and Alan Schussman. 2003. The ecology of open-source software development. Unpublished manuscript, January 29 (2003), 2003.
- 10.1145/2441776.2441893 · DOI
- 10.1080/19416520.2011.586108 · DOI
- 10.1145/1180875.1180928 · DOI
- John J. Horton , Leonard N. Stern , and Joseph M . Golden . 2015 . Reputation Inflation : Evidence from an Online Labor Market . (2015). John J. Horton, Leonard N. Stern, and Joseph M. Golden. 2015. Reputation Inflation: Evidence from an Online Labor Market. (2015).
- Jeff Howe . 2008 . Crowdsourcing: How the power of the crowd is driving the future of business. Century. Jeff Howe. 2008. Crowdsourcing: How the power of the crowd is driving the future of business. Century.
- 10.1287/mnsc.1080.0921 · DOI · Paper page
- 10.1145/2470654.2470742 · DOI · Paper page
- Daniel Katz and Robert Kahn . 1978. The Social Psychology of Organizations . John Wiley & Sons , New York . Daniel Katz and Robert Kahn. 1978. The Social Psychology of Organizations. John Wiley & Sons, New York.
- 10.1145/2047196.2047202 · DOI · Paper page
- 10.1145/2145204.2145354 · DOI · Paper page
- 10.1109/MIC.2012.72 · DOI
- 10.1145/2702123.2702565 · DOI
- 10.1145/2380116.2380122 · DOI
- 10.1145/2047196.2047200 · DOI
- 10.1145/2501988.2502057 · DOI
- 10.1145/2642918.2647349 · DOI
- 10.1609/aaai.v25i1.8092 · DOI
- Yvonna S. Lincoln and Egon G . Guba . 1985 . Naturalistic inquiry. Vol. 75 . Sage . Yvonna S. Lincoln and Egon G. Guba. 1985. Naturalistic inquiry. Vol. 75. Sage.
- 10.1145/1866029.1866040 · DOI · Paper page
- 10.1145/1880071.1880073 · DOI
- 10.1145/2531602.2531663 · DOI · Paper page
- 10.1109/TSE.2002.1000449 · DOI · Paper page
- 10.1145/2702123.2702553 · DOI · Paper page
- 10.1145/2858036.2858169 · DOI
- 10.1016/j.orgdyn.2012.03.008 · DOI
- 10.1080/19416520903047533 · DOI · Paper page
- 10.1145/2567788 · DOI
- 10.1126/science.1205869 · DOI
- 10.1145/2441776.2441784 · DOI
- 10.1145/2642918.2647409 · DOI
- 10.1145/2702123.2702508 · DOI · Paper page
- 10.1145/2998181.2998300 · DOI
- 10.7551/mitpress/9780262017251.001.0001 · DOI
- 10.1126/science.1153539 · DOI
- 10.1145/2858036.2858121 · DOI
- 10.1145/2858036.2858108 · DOI
- 10.1287/orsc.2014.0947 · DOI
- Vasilis Verroios and Michael S . Bernstein . 2014 . Context Trees : Crowdsourcing Global Understanding from Local Views. In Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP '14). AAAI Press , 210--219. Vasilis Verroios and Michael S. Bernstein. 2014. Context Trees: Crowdsourcing Global Understanding from Local Views. In Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP '14). AAAI Press, 210--219.
- Max Weber , Alexander Morell Henderson, and Talcott Parsons . 1947 . The theory of social and economic organization. Oxford University Press . Max Weber, Alexander Morell Henderson, and Talcott Parsons. 1947. The theory of social and economic organization. Oxford University Press.
- 10.1086/466942 · DOI · Paper page
- 10.1145/2818048.2820025 · DOI
- 10.1145/2207676.2207708 · DOI
- 10.1287/orsc.1120.0744 · DOI
Cited by
Working and organizing in the age of the learning algorithm
Faraj, S., Pachidi, S., & Sayegh, K. (2018) · Information and Organization · doi:10.1016/j.infoandorg.2018.02.005 · Cited by 929
Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Holstein, K., Wortman Vaughan, J., Daumé, H., Dudik, M., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300830 · Cited by 777
Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions
Alkhatib, A., & Bernstein, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300760 · Cited by 188
Self-citationWomen (Still) Ask For Less: Gender Differences in Hourly Rate in an Online Labor Marketplace
Foong, E., Vincent, N., Hecht, B., & Gerber, E. M. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274322 · Cited by 80
Whose AI Dream? In search of the aspiration in data annotation.
Wang, D., Prabhat, S., & Sambasivan, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502121 · Cited by 70
Do, H. J., Kong, H.-K., Tetali, P., Lee, J., & Bailey, B. P. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579532 · Cited by 32
Spektor, F., Fox, S. E., Awumey, E., Begleiter, B., Kulkarni, C., Stringam, B., Riordan, C. A., Rho, H. J., Akridge, H., & Forlizzi, J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579466 · Cited by 29
Labor, Capital, and Machine: Toward a Labor Process Theory for HCI
Qin, Y., & Cheon, E. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791147 · Cited by 2
Metadata
- Authors
- Valentine, M. A., Retelny, D., To, A., Rahmati, N., Doshi, T., & Bernstein, M. S.
- Affiliations
- Stanford University, Stanford, CA, USA
- Carnegie Mellon University, Pittsburgh, PA, USA
- Stanford University, Palo Alto, CA, USA
- Venue
- Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2017-05-02
- Pages
- 3523-3537
- Cited by
- 123
- References
- 16
- Funders
- National Science Foundation (IIS-1351131)
- Stanford Interdisciplinary Graduate Fellowship
- Stanford Cyber Initiative
- Accenture Technology Labs
- Microsoft Research
- Stanford Institute for Research in the Social Sciences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
