|
<!DOCTYPE html>
|
|
<html lang="en">
|
<head>
|
<meta charset="utf-8" />
|
<meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="generator" content="Docutils 0.18.1: http://docutils.sourceforge.net/" />
|
|
|
<!-- Licensed under the Apache 2.0 License -->
|
<link rel="stylesheet" type="text/css" href="_static/fonts/open-sans/stylesheet.css" />
|
<!-- Licensed under the SIL Open Font License -->
|
<link rel="stylesheet" type="text/css" href="_static/fonts/source-serif-pro/source-serif-pro.css" />
|
<link rel="stylesheet" type="text/css" href="_static/css/bootstrap.min.css" />
|
<link rel="stylesheet" type="text/css" href="_static/css/bootstrap-theme.min.css" />
|
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
|
<title>Rules — MULTI-PARTY MEETING TRANSCRIPTION CHALLENGE 2.0</title>
|
<link rel="stylesheet" type="text/css" href="_static/pygments.css" />
|
<link rel="stylesheet" type="text/css" href="_static/guzzle.css" />
|
<script data-url_root="./" id="documentation_options" src="_static/documentation_options.js"></script>
|
<script src="_static/jquery.js"></script>
|
<script src="_static/underscore.js"></script>
|
<script src="_static/_sphinx_javascript_frameworks_compat.js"></script>
|
<script src="_static/doctools.js"></script>
|
<script src="_static/sphinx_highlight.js"></script>
|
<link rel="index" title="Index" href="genindex.html" />
|
<link rel="search" title="Search" href="search.html" />
|
<link rel="next" title="Organizers" href="Organizers.html" />
|
<link rel="prev" title="Baseline" href="Baseline.html" />
|
|
|
|
</head><body>
|
<div class="related" role="navigation" aria-label="related navigation">
|
<h3>Navigation</h3>
|
<ul>
|
<li class="right" style="margin-right: 10px">
|
<a href="genindex.html" title="General Index"
|
accesskey="I">index</a></li>
|
<li class="right" >
|
<a href="Organizers.html" title="Organizers"
|
accesskey="N">next</a> |</li>
|
<li class="right" >
|
<a href="Baseline.html" title="Baseline"
|
accesskey="P">previous</a> |</li>
|
<li class="nav-item nav-item-0"><a href="index.html">MULTI-PARTY MEETING TRANSCRIPTION CHALLENGE 2.0</a> »</li>
|
<li class="nav-item nav-item-this"><a href="">Rules</a></li>
|
</ul>
|
</div>
|
<div class="container-wrapper">
|
|
<div id="mobile-toggle">
|
<a href="#"><span class="glyphicon glyphicon-align-justify" aria-hidden="true"></span></a>
|
</div>
|
<div id="left-column">
|
<div class="sphinxsidebar"><a href="
|
index.html" class="text-logo">MULTI-PARTY MEETING TRANSCRIPTION CHALLENGE 2.0</a>
|
<div class="sidebar-block">
|
<div class="sidebar-wrapper">
|
<div id="main-search">
|
<form class="form-inline" action="search.html" method="GET" role="form">
|
<div class="input-group">
|
<input name="q" type="text" class="form-control" placeholder="Search...">
|
</div>
|
<input type="hidden" name="check_keywords" value="yes" />
|
<input type="hidden" name="area" value="default" />
|
</form>
|
</div>
|
</div>
|
</div>
|
<div class="sidebar-block">
|
<div class="sidebar-toc">
|
|
|
<p class="caption" role="heading"><span class="caption-text">Contents:</span></p>
|
<ul class="current">
|
<li class="toctree-l1"><a class="reference internal" href="Introduction.html">Introduction</a><ul>
|
<li class="toctree-l2"><a class="reference internal" href="Introduction.html#call-for-participation">Call for participation</a></li>
|
<li class="toctree-l2"><a class="reference internal" href="Introduction.html#timeline-aoe-time">Timeline(AOE Time)</a></li>
|
<li class="toctree-l2"><a class="reference internal" href="Introduction.html#guidelines">Guidelines</a></li>
|
</ul>
|
</li>
|
<li class="toctree-l1"><a class="reference internal" href="Dataset.html">Datasets</a><ul>
|
<li class="toctree-l2"><a class="reference internal" href="Dataset.html#overview-of-training-data">Overview of training data</a></li>
|
<li class="toctree-l2"><a class="reference internal" href="Dataset.html#detail-of-alimeeting-corpus">Detail of AliMeeting corpus</a></li>
|
<li class="toctree-l2"><a class="reference internal" href="Dataset.html#get-the-data">Get the data</a></li>
|
</ul>
|
</li>
|
<li class="toctree-l1"><a class="reference internal" href="Track_setting_and_evaluation.html">Track & Evaluation</a><ul>
|
<li class="toctree-l2"><a class="reference internal" href="Track_setting_and_evaluation.html#speaker-attributed-asr">Speaker-Attributed ASR</a></li>
|
<li class="toctree-l2"><a class="reference internal" href="Track_setting_and_evaluation.html#evaluation-metric">Evaluation metric</a></li>
|
<li class="toctree-l2"><a class="reference internal" href="Track_setting_and_evaluation.html#sub-track-arrangement">Sub-track arrangement</a></li>
|
</ul>
|
</li>
|
<li class="toctree-l1"><a class="reference internal" href="Baseline.html">Baseline</a><ul>
|
<li class="toctree-l2"><a class="reference internal" href="Baseline.html#overview">Overview</a></li>
|
<li class="toctree-l2"><a class="reference internal" href="Baseline.html#quick-start">Quick start</a></li>
|
<li class="toctree-l2"><a class="reference internal" href="Baseline.html#baseline-results">Baseline results</a></li>
|
</ul>
|
</li>
|
<li class="toctree-l1 current"><a class="current reference internal" href="#">Rules</a></li>
|
<li class="toctree-l1"><a class="reference internal" href="Organizers.html">Organizers</a></li>
|
<li class="toctree-l1"><a class="reference internal" href="Contact.html">Contact</a></li>
|
</ul>
|
|
|
</div>
|
</div>
|
|
</div>
|
</div>
|
<div id="right-column">
|
|
<div role="navigation" aria-label="breadcrumbs navigation">
|
<ol class="breadcrumb">
|
<li><a href="index.html">Docs</a></li>
|
|
<li>Rules</li>
|
</ol>
|
</div>
|
|
<div class="document clearer body">
|
|
<section id="rules">
|
<h1>Rules<a class="headerlink" href="#rules" title="Permalink to this heading">¶</a></h1>
|
<p>All participants should adhere to the following rules to be eligible for the challenge.</p>
|
<ul class="simple">
|
<li><p>Data augmentation is allowed on the original training dataset, including, but not limited to, adding noise or reverberation, speed perturbation and tone change.</p></li>
|
<li><p>Participants are permitted to use the Eval set for model training, but it is not allowed to use the Test set for this purpose. Instead, the Test set should only be utilized for parameter tuning and model selection. Any use of the Test-2023 dataset that violates these rules is strictly prohibited, including but not limited to the use of the Test set for fine-tuning or training the model.</p></li>
|
<li><p>If the cpCER of the two systems on the Test dataset are the same, the system with lower computation complexity will be judged as the superior one.</p></li>
|
<li><p>If the forced alignment is used to obtain the frame-level classification label, the forced alignment model must be trained on the basis of the data allowed by the corresponding sub-track.</p></li>
|
<li><p>Shallow fusion is allowed to the end-to-end approaches, e.g., LAS, RNNT and Transformer, but the training data of the shallow fusion language model can only come from the transcripts of the allowed training dataset.</p></li>
|
<li><p>The right of final interpretation belongs to the organizer. In case of special circumstances, the organizer will coordinate the interpretation.</p></li>
|
</ul>
|
</section>
|
|
|
</div>
|
|
<div class="footer-relations">
|
|
<div class="pull-left">
|
<a class="btn btn-default" href="Baseline.html" title="previous chapter (use the left arrow)">Baseline</a>
|
</div>
|
|
<div class="pull-right">
|
<a class="btn btn-default" href="Organizers.html" title="next chapter (use the right arrow)">Organizers</a>
|
</div>
|
</div>
|
<div class="clearer"></div>
|
|
</div>
|
<div class="clearfix"></div>
|
</div>
|
<div class="related" role="navigation" aria-label="related navigation">
|
<h3>Navigation</h3>
|
<ul>
|
<li class="right" style="margin-right: 10px">
|
<a href="genindex.html" title="General Index"
|
>index</a></li>
|
<li class="right" >
|
<a href="Organizers.html" title="Organizers"
|
>next</a> |</li>
|
<li class="right" >
|
<a href="Baseline.html" title="Baseline"
|
>previous</a> |</li>
|
<li class="nav-item nav-item-0"><a href="index.html">MULTI-PARTY MEETING TRANSCRIPTION CHALLENGE 2.0</a> »</li>
|
<li class="nav-item nav-item-this"><a href="">Rules</a></li>
|
</ul>
|
</div>
|
<script type="text/javascript">
|
$("#mobile-toggle a").click(function () {
|
$("#left-column").toggle();
|
});
|
</script>
|
<script type="text/javascript" src="_static/js/bootstrap.js"></script>
|
<div class="footer">
|
© Copyright 2023, Speech Lab, Alibaba Group; ASLP Group, Northwestern Polytechnical University. Created using <a href="http://sphinx.pocoo.org/">Sphinx</a>.
|
</div>
|
</body>
|
</html>
|
