Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 227

The DOI matches its Crossref record.

Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work

· 2012

Abstract

Constraint can spur creativity. Approaching the 26th anniversary of the CSCW conference, we were asked to move the submission deadline two months earlier to reduce the reviewing conflict with CHI 2012. In response, we used the additional time to innovate and to increase participation while maintaining or increasing quality, by allowing authors to revise and resubmit their papers and notes. Conference attendees and proceedings readers will ultimately assess the outcome, but overall the feedback from associate chairs, reviewers and authors has been very positive. Submissions increased 57% from CSCW 2011 to a record 290 papers and 125 notes. We increased the program committee to 67 associate chairs (ACs) to handle them; 21 were women and 20 were from outside North America. They comprised representatives from computer science, social media and social networks, psychology, anthropology, software engineering, management, and design. Fifty were from universities. Our process most resembled a journal special issue, with a submission deadline, a team of four reviewers, and one revision cycle under a firm time constraint (in this case five weeks). Each submission was assigned to two committee members, designated AC-Coordinator and ACReviewer. Each AC assigned one external reviewer. In the first round, each paper or note was blind-reviewed by the AC-Reviewer and the two external reviewers. Reviewers assessed the likelihood that it could be revised within one month to be acceptable. Based on the outcomes, submissions were considered 'conditional accept' (CA, 8.7%), 'revise=resubmit' (RR, 46.5%) or 'reject' (44.8%). In general, papers that received one or more positive assessments were offered the opportunity to revise. Papers that had no positive assessment in the first round were rejected. We based this decision on an analysis of CSCW 2011 data, which revealed that submissions that did not get an advocate in the initial reviewing had 0% chance of acceptance. Sixty percent of CSCW 2011 submissions had no advocate, compared to 45% of CSCW 2012 submissions. The difference is that the CSCW 2012 submissions had a month in which they could be improved. By immediately rejecting the 45% that had no chance, we streamlined and focused the process, and reduced the number of reviews per submission despite the revision cycle. The AC Coordinator relied on the reviews in providing written guidance to authors on how to revise RRs. Authors of RR and CA submissions had five weeks to prepare a revision and an explanation of how they had addressed reviewer concerns. Resubmissions of RRs underwent a full second review from the same four-reviewer team; most CAs were checked by just one AC. Reviewing teams were strongly encouraged to resolve decisions prior to the program committee meeting and indeed, only 6% of initial submissions had to be discussed in the meeting. The program committee split into two subgroups followed by a plenary session to make the final decisions. 127 papers and 37 notes, 39.5% of initial submissions, reached acceptable quality through revision. This is almost twice the number presented in any previous CSCW, in part due to record submissions. ACs and reviewers nominated papers and notes for consideration for Best Paper awards; 4 were selected, with 17 awarded Honorable Mention. The accepted work represents diverse topics. Relatively new topics for CSCW include crowdsourcing, civic engagement, and social media; more traditional CSCW topics include distributed work, coordination, ethnography, and collaborative software development. This collaborative effort was an example of computer supported cooperative work. The entire CSCW community provided input throughout the process-many ideas and changes came from outside of the committee. Committee members had to adapt to new ways of working. Our analysis indicates that the work required of reviewers and associate chairs did not exceed that of past years, and authors benefited from two rounds of feedback from committed ACs and reviewers. Our goal was to maintain a high quality threshold while enabling more papers to reach that threshold. We believe there are many benefits to a review process with more opportunity for constructive interaction between reviewers and authors. Authors benefit by learning more about the CSCW culture, and by producing papers that are better than they could have produced on their own. Reviewers benefit by seeing their work lead to improved papers. The community benefits, because more of its members are successful at producing high quality research each year. As a community, we must consider new ways to assess conference quality-when a larger volume of high quality work is produced, older metrics no longer hold. Considering the fraction of submitted work that is of low quality to be a measure of conference quality is backwards. We need new measures of process quality and the resulting quality of accepted work. Through continued innovation, CSCW will r

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/2145204

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cited by

Metadata

Publisher
ACM
Published
2012-02-11
OpenAlex
W4243584581
Cited by
227
References
0
Type
paratext
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.