Legal Question Answering Competition: Call for Participation

Competition on Legal Information Extraction/Entailment (COLIEE) ,
run in association with Workshop on Juris-informatics (JURISIN) 2016
November 14-16, 2016, Raiosha Building, Keio University Kanagawa, Japan

As an associated event of JURISIN 2016, we are happy to announce a
Competition of Legal Information Extraction and Entailment (COLIEE-2016),
derived from Japanese bar exams. This competition’s purpose is to answer
“Yes” or “No” to Questions of Legal Bar Exams.

There are three tasks in the competition; One is to extract articles from
Japanese civil codes which contribute to solving a bar exam yes/no question;
the second task is to check entailment of a question from given civil code
article(s), and answer ‘Yes’ or ‘No’; and the third is to combine the first
and second tasks. If we could combine these methods, we could solve a bar
exam question as a whole. We also provide various NLP tools’ outputs for
training data to help your information retrieval and textual entailment.

Detailed description can be found in the URL below.

All the data are available both in Japanese and English (translation from
Japanese bar exams and civil code). And you can choose either (or both) of
them to accomplish the above tasks.

The intention is to build a community of practice regarding legal Textual
Entailment and Question Answering, so that the adoption and adaptation of
general methods from a variety of fields is considered, and that
participants share their approaches, problems, and results.

We require participants to submit a paper on their method and experimental
results to JURISIN 2016 workshop in accordance with an instruction
specified at and to present the paper at
the special session of JURISIN 2016.

These papers will be reviewed in the same way of usual submission to JURISIN
2016 and extended versions could be submitted to an LNAI post-proceeding of
JSAI-IsAI2016 (the name of symposium in which JURISIN 2016 is included). The
selected paper will be published in the LNAI post-proceedings.

Important dates:
June 30, 2016 Dry run data release.
June 30, 2016 Task Registration Due.
August 1, 2016 Formal run data release.
August 10, 2016 Formal run submission due.
August 26, 2016 Paper submission due.
November 14-16, 2016 JURISIN Workshop with COLIEE-2016 & assessment
returned to participants

Application Details:
Organizations wishing to participate in JURISIN 2016 should respond to this
call for participation by submitting an application. To apply, submit the
application and memorandums of the following URL to .


Memorandum for Japanese Data

Memorandum for English Data

We will send an acknowledgement to the email address supplied in the form
once we have processed the form.

Task coordinators:
Mi-Young Kim, University of Alberta, Canada
Randy Goebel, University of Alberta, Canada
Ken Satoh, National Institute of Informatics, Japan
Yoshinobu Kano, Shizuoka University, Japan

Leave a Reply

Your email address will not be published. Required fields are marked *