For all our friends and colleagues preparing for, and recovering from these catastrophes, our hearts and minds are with you. Watching the news reports and hearing many of the stories coming out of the Caribbean and southern U.S. is truly gut-wrenching. In the past few days, we have received several inquiries about the possibility of a deadline extension for CHI 2018 Papers. Obviously, for those affected by these storms, the preparation of CHI submissions has taken a backseat to much more immediate needs, and we wanted to respond more generally for the whole community.
While we are deeply sympathetic to the disruption these storms have caused, we cannot move the deadline. The CHI papers process is a massive, complex, and somewhat fragile thing—the timing tolerance in going from submissions to reviews to the conference in April is literally on the order of a day or two, and any delays would jeopardize the technical program in Montréal. We have checked to see if there are any creative things we can do, but we are so close to the deadline that there just isn’t any way for us to change the process at this point. We are deeply sorry—we know how important CHI is for students, scholars and professionals in our community and these tragedies hit the whole community.
We hope that all those affected are safe and managing the aftermath with their loved ones. We stand with you and hope to see you all in Montréal next spring.
Ed Cutrell, Anind Dey & m.c. schraefel, CHI 2018 Papers Chairs
Anna Cox & Mark Perry, CHI 2018 Technical Program Chairs
At CHI 2018, the theme will be engage. The technical and social programs at CHI will provide several ways for attendees to engage in discussion. One of these is through the curated Panels & Fireside Chats Venue. We are inviting stimulating panel submissions that inspire new ideas, are innovative in approach, and likely to engage the conference attendees.
One change this year is that we are welcoming a range of formats for the presentation of panels. They can take the form of a traditional panel of discussants with a moderator, a fireside chat in which an individual gets interviewed by a moderator, or a roundtable in which the moderator(s) pose the questions to the audience for discussion. Our goal is to facilitate discussion – panels that propose a series of mini presentations are not what we are looking for. We would like you to be creative in proposing a format for your panels and welcome new ideas!
The deadline for submissions to the Panels & Fireside Chats venue is January 15, 2017, but we welcome ideas for high-profile plenary session panels and fireside chats at any time. If you have ideas for a high-profile panel, fireside chat, or roundtable discussion that would be of interest to a broad range of CHI attendees, please contact the venue’s co-chairs (firstname.lastname@example.org) and/or the conference co-chairs (email@example.com) with your ideas as soon as possible.
Panels & Fireside Chats Chairs
Parmit Chilana, Simon Fraser University, Canada
Julie Kientz, University of Washington, USA
Regan Mandryk, University of Saskatchewan, Canada
Mark Hancock, University of Waterloo, Canada
We’re making some changes to the papers reviewing and submission process this year, and thought it would be useful to communicate this and the reasons for these changes to the community. There are two main differences to the ways that we’ll be handling things this year – paper reviewing and paper length. We’ll document these changes below, but we feel strongly that these are necessary for sustaining the conference over the long term, ensuring the quality of the research presented, providing an equitable playing field for authors, and helping us – the CHI community – to work more effectively.
Two Reviewers plus AC review
Last year, we hit two key issues in the reviewing process: 1) finding 3 external qualified reviewers (a problem that has been developing over a long time); 2) having many AC’s overburdened with 2AC reviews that are required in a very short time. The following set of changes addresses both these issues:
- Two external reviews
- Each AC (1AC and 2AC) to identify ONE reviewer per paper
- The 2AC writes a full, expert review of each assigned paper, for a total of 3 expert reviews per paper (thus, 2 external, one from committee)
- The 1AC acts as a managing editor for their assigned papers. They will not be providing an independent review, but rather will manage the external reviewers, author a metareview summarizing important elements from the 3 expert reviews, and manage the process for the accept/reject decision
- Where there is a difference of X in std deviation in reviews (where X is to be determined) a 3AC is assigned to provide an additional review. This process will be jointly managed by the 1AC and subcommittee chairs (SCs)
- The SCs will load balance the 3rd AC assignments so that no 3AC has more than a few additional papers to review.
Only 2 external reviews By having only two rather than three external reviews, we reduce the pressure on the reviewer pool by a third.
Both ACs find an external reviewer By having the primary and secondary AC each add ONE reviewer, we mitigate the risk of the 1AC determining the fate of a paper by having more full reviewer control of a paper.
2AC full review This has three benefits: 1) Authors receive a full review from an expert who is serving on the committee, is privy to full discussions about the paper, and this feedback is provided prior to the rebuttal phase; 2) We keep separate the roles of expert reviews and editorial management–that is, the 1AC will not be responsible for both a personal evaluation as well as the interpretation of external reviews (metareview) to make a decision; and 3) We improve the predictability of the workload for 2ACs. This addresses a key issue from last year, where some 2ACs had one or two papers to review and other had 6-8, after the first round of reviews were complete, all due in the span of about a week while they were also managing their own metareviews.
3AC trigger By having the std deviation of scores automatically trigger the involvement of a 3AC, we further mitigate 1AC having control of the fate of the paper.
3AC bullpen By uncoupling the link between the paper and 2AC after the initial reviewer assignment, we can address a key issue from last year: load balancing of 2nd AC reviews. We can now reduce overload on individual ACs, and additional papers can be more evenly distributed. This should allow ACs to manage their own time more effectively, as well as enabling them to focus on improving the review process. This redistribution is a new role for the SC’s, and we’ll be working with them to understand what this entails.
Variable Length Papers (aka “no more notes”)
Over the past five years, a number of SIGCHI venues have been moving from a Full Paper and Note submission model, simply to “variable length” (4 to 10 pages plus references). We are moving to this model for CHI 2018. We strongly believe that papers should be at a length that is suitable for their contribution, and there is some evidence to show that the binary Notes/Papers distinction is not supporting shorter papers; e.g., in 2017 the mean acceptance rate for Papers was 25% while for Notes it was 14.6%. Of course, another advantage of variable length is that CHI authors would not need to distinguish their contribution as “only a note” vs having “a paper” at CHI.
One challenge of variable length papers is planning for presentations at CHI. In prior years, Notes were given roughly half the time for presentations as full Papers. It is plausible that shorter papers may not require the same amount of time as longer papers, but how this should be determined is still under consideration. Session planning involves many variables, not least the number of accepted papers, so as a result, the presentation time allotted for different paper lengths will be determined after the PC meeting, once we know more about the numbers and spread of accepted papers.
We will be tracking how this change to paper length impacts both submissions and acceptance rates. As we shift to “variable length” this year, we will chart statistics on how many people take advantage of a shorter paper length and track how reviewers respond to length (particularly for shorter papers). A core question here is whether such a shift will improve the ratio of shorter papers being accepted. As Papers Chairs, we will work with SC’s to monitor how discussions of papers less than the maximum length are managed in review and at the PC meeting to ensure that papers of different lengths are handled fairly and equitably.
At CHI 2018, the theme will be engage. Our focus will be to engage with people, to engage with technology, to engage with newcomers, to engage with world-class research, to engage with your community of designers, researchers, and practitioners… to engage with CHI!
As organizers, our goal is to engage with the larger CHI community throughout the planning process and to be transparent about the decisions that we make. As such, we will be using this space to post articles on how we have made decisions and also to solicit input from all of you!
Comments are open and can be signed or anonymous. They aren’t moderated and we hope to keep it this way, so please be respectful and professional in communicating your opinions, which we look forward to hearing.
Regan Mandryk, University of Saskatchewan, Canada
Mark Hancock, University of Waterloo, Canada
Assistants to General Chairs
Max Birk, University of Saskatchewan, Canada
Cayley MacArthur, University of Waterloo, Canada
Technical Program Chairs
Mark Perry, Brunel University London, UK
Anna Cox, University College London, UK
Assistant to the Technical Program Chairs
Frederik Brudy, University College London, UK
Marta Cecchinato, University College London, UK