Call for Participation

We introduce a new shared task for challenge, aiming to benchmark semi-supervised and reinforced task-oriented dialog systems, built for automated customer-service for mobile operators. The task consists of two tracks:
  • Information extraction from dialog transcripts (Track 1)
  • Task-oriented dialog systems (Track 2)
  • An important feature for this shared task is that we release around 100K dialogs (in Chinese), which come from real-world dialog transcripts between real users and customer-service staffs from China Mobile, with privacy information anonymized. We call this dataset as MCSD (mobile customer-service dialog) dataset, which differs from existing TOD datasets in both size and nature significantly.

    To the best of our knowledge, MCSD is not only the largest publicly available multi-domain TOD dataset, but also consists of real-life human-to-human data (namely collected in real-world scenarios). For comparison, the widely used MultiWOZ dataset consists of 10K dialogs and is in fact simulated data (namely collected in a Wizard-of-Oz simulated game).
    We provide a schema, and only 10K dialogs are labeled by crowdsourcing, while the remaining 90K dialogs are unlabeled. The teams are required to use this mix of labeled and unlabeled data to train information extraction models (Track 1), which could provide a knowledge base for Track 2, and train TOD systems (Track 2), which could work as customer-service bots. The teams can choose to participate in Track 1 or Track 2, or both.
  • Challenge Description: v1 (April 19, 2022)
  • Challenge Registration: Please fill the form (English form, Chinese form) and send to seretod2022 (at) gmail (dot) com to complete the registration. Registration deadline: May 31, 2022.
  • You are welcome to scan the following QR code to join the WeChat group (in Chinese), where we will distribute messages relevant to the Challenge.
  • Important Dates

    Please refer to here!

    Challenge Organizers

  • Zhijian Ou, Tsinghua University
  • Junlan Feng, China Mobile
  • Juanzi Li, Tsinghua University
  • Yakun Li, Tsinghua University
  • Hong Liu, Tsinghua University
  • Hao Peng, Tsinghua University
  • Yi Huang, China Mobile
  • Jiangjiang Zhao, China Mobile
  • Contact

    For any questions, please feel free to contact: seretod2022 (at) gmail (dot) com