Should we apply high standards to those, who speak about high standards?

This workshop therefore aims to examine how concerns with harmful impacts should affect the way the research community develops its research agendas, conducts its research, evaluates its research contributions, and handles the publication and dissemination of its findings. This event complements other NeurIPS workshops this year (e.g., [17] [18]) devoted to normative issues in AI and builds on others from years past (e.g., [19] [20] [21]), but adopts a distinct focus on the ethics of research practice and the ethical obligations of researchers.

Challenges of AI research practice and responsible publication: What practices are appropriate for the responsible development, conduct, and dissemination of AI research? How can we ensure wide-spread adoption?

- Surveys of responsible research practice in AI research, including common practices around data collection, crowdsourced labeling, documentation and reporting requirements, declaration of conflict of interest, etc. [25] [26] [27] [28]

- Limitations and benefits of the conference-based publication format, peer review, and other characteristics of AI publication norms, including alternative proposals (e.g., gated or staged release) [29] [30] [31]

Nevertheless, to preserve the integrity of the review process, we must ultimately defer to the reviews that we’ve received.

It’s the other way round — one of the PCs’ role is to handle complaints and deal with reviewing mistakes. It is the responsibility of the PC not to defer to reviews which are problematic or make false claims. The oversight of the PC of the reviewing process is it’s integral part. A PC in this situation has many options, e.g. asking for an independent opinion, asking the metareview to reconsider in the light of the facts brought up by the authors.

Unclear if this is relevant to the workshop topic. They do no novel work.
Reviews we got
Meta-review: low novelty and insufficient literature review — in particular, not citing past literature making similar claim
Meta-review

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store