This is certainly description for the different sorts of paper at COLING 2018

This is certainly description for the different sorts of paper at COLING 2018

it is vital to select the right paper kind in order to assist get high quality reviews for the work. Remember that all paper kinds utilize the template that is same download your message and LaTeX templates right here: coling2018.zip

Computationally-aided analysis that is linguistic

The main focus of the paper kind is new insight that is linguistic. It could take the type of an empirical study of some linguistic plagiarism checker event, or of a theoretical outcome of a linguistically-relevant system that is formal.

  1. Relevance: Is this paper highly relevant to COLING?
  2. Readability/clarity: Through the real means the paper is created, could you inform exactly exactly what research question had been addressed, that which was done and just why, and exactly how the outcome relate genuinely to the research concern?
  3. Originality: How initial and revolutionary could be the research described? Originality might be within the linguistic concern being addressed, into the methodology put on the linguistic concern, or in the blend of this two.
  4. Technical correctness/soundness: could be the extensive research described in the paper theoretically sound and proper? Is one to trust the claims associated with the paper—are they sustained by the analysis or experiments consequently they are the results precisely interpreted?
  5. Reproducibility: can there be detail that is sufficient some body in the same industry to reproduce/replicate the outcome? n/a for many kinds of theoretical results
  6. Data/code access: could be the data/code (as appropriate) open to the investigation community or perhaps is here a reason that is compelling why this is simply not feasible?
  7. Generalizability: Does the paper show exactly exactly how the outcomes generalize, either by deepening our knowledge of some system that is linguistic basic or by showing methodology that may be placed on other dilemmsince too? n/a for several forms of theoretical results
  8. Significant contrast: Does the paper clearly spot the described utilize respect to current literature? Will it be clear both what exactly is novel within the extensive research presented and just how it develops on previous work?
  9. Substance: Does this paper have sufficient substance for a full-length paper, or would it not reap the benefits of further development?
  10. General recommendation: there are lots of submissions that are good for slots at COLING 2018; essential can it be to feature this 1? Will people learn great deal by looking over this paper or seeing it presented? Please be decisive—it is much better to change from other reviewers rather than grade every thing at the center.

NLP engineering test paper

This paper kind fits the majority of submissions at current CL and NLP conferences.

  1. Relevance: Is this paper highly relevant to COLING?
  2. Readability/clarity: Through the method the paper is written, are you able to inform what research concern ended up being addressed, that which was done and just why, and just how the outcomes relate solely to the investigation concern?
    1. Could it be clear what the authors’ hypothesis is? What exactly is it? A text input reponse
    2. Will it be clear the way the writers have actually tested their theory? y/n
  3. Originality: How initial and revolutionary may be the extensive research described? Remember that originality could involve an innovative new method or a brand new task, or it might lie when you look at the careful analysis of what goes on whenever an understood strategy is placed on a known task (in which the pairing is novel) or perhaps into the careful analysis of what goes on whenever a understood strategy is put on an understood task in a language that is new.
  4. Technical correctness/soundness: could be the extensive research described in the paper theoretically sound and proper? Is one to trust the claims for the paper—are they sustained by the analysis or experiments and are usually the total results precisely interpreted?
    1. Will it be clear how the outcomes confirm/refute the theory, or will be the results inconclusive?
    2. Perform some writers explain how a outcomes follow from their theory (rather than state, other feasible confounding element)?
    3. Would be the datasets utilized plainly described and therefore are they suitable for testing the hypothesis as mentioned?
  5. Reproducibility: can there be detail that is sufficient somebody in identical industry to reproduce/replicate the outcomes?
  6. Data/code supply: could be the data/code (as appropriate) open to the investigation community or perhaps is here a compelling explanation provided why it is not feasible?
  7. Error analysis: Does the paper provide an error that is thoughtful, which searches for linguistic patterns within the kinds of mistakes produced by the system(s) assessed and sheds light on either avenues for future work or the way to obtain the strengths/weaknesses associated with systems?
  8. Significant contrast: Does the paper clearly put the described utilize respect to current literary works? Could it be clear both what exactly is novel within the research presented and just how it develops on previous work?
  9. Substance: performs this paper have sufficient substance for the paper that is full-length or would it not take advantage of further work?
  10. General suggestion: there are numerous submissions that are good for slots at COLING 2018; essential could it be to feature that one? Will people learn lot by scanning this paper or seeing it presented? Please be decisive—it is much better to vary from other reviewers rather than grade every thing at the center.