Full Code of TUT-ARG/sed_eval for AI

master 0cb1b6d11cee cached
283 files
4.3 MB
1.1M tokens
325 symbols
1 requests
Download .txt
Showing preview only (4,570K chars total). Download the full file or copy to clipboard to get everything.
Repository: TUT-ARG/sed_eval
Branch: master
Commit: 0cb1b6d11cee
Files: 283
Total size: 4.3 MB

Directory structure:
gitextract_rwh6jdyn/

├── .coveragerc
├── .gitignore
├── .travis.yml
├── CODE_OF_CONDUCT.md
├── CONTRIBUTING.md
├── LICENSE.txt
├── README.rst
├── docs/
│   ├── .buildinfo
│   ├── .nojekyll
│   ├── _modules/
│   │   ├── index.html
│   │   └── sed_eval/
│   │       ├── audio_tag.html
│   │       ├── io.html
│   │       ├── metric.html
│   │       ├── scene.html
│   │       ├── sound_event.html
│   │       ├── test.html
│   │       └── util/
│   │           ├── event_list.html
│   │           ├── event_matching.html
│   │           ├── event_roll.html
│   │           └── scene_list.html
│   ├── _sources/
│   │   ├── audio_tag.rst.txt
│   │   ├── changelog.rst.txt
│   │   ├── generated/
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.evaluate.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.reset.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.rst.txt
│   │   │   ├── sed_eval.io.load_event_list.rst.txt
│   │   │   ├── sed_eval.io.load_file_pair_list.rst.txt
│   │   │   ├── sed_eval.io.load_scene_list.rst.txt
│   │   │   ├── sed_eval.metric.accuracy.rst.txt
│   │   │   ├── sed_eval.metric.accuracy2.rst.txt
│   │   │   ├── sed_eval.metric.balanced_accuracy.rst.txt
│   │   │   ├── sed_eval.metric.deletion_rate.rst.txt
│   │   │   ├── sed_eval.metric.equal_error_rate.rst.txt
│   │   │   ├── sed_eval.metric.error_rate.rst.txt
│   │   │   ├── sed_eval.metric.f_measure.rst.txt
│   │   │   ├── sed_eval.metric.insertion_rate.rst.txt
│   │   │   ├── sed_eval.metric.precision.rst.txt
│   │   │   ├── sed_eval.metric.recall.rst.txt
│   │   │   ├── sed_eval.metric.sensitivity.rst.txt
│   │   │   ├── sed_eval.metric.specificity.rst.txt
│   │   │   ├── sed_eval.metric.substitution_rate.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.evaluate.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.reset.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_class_wise.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_parameters.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.results.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.results_overall_metrics.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.evaluate.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.reset.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_class_wise.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_overall.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_parameters.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.results.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.results_overall_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.evaluate.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.reset.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_overall.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.rst.txt
│   │   │   ├── sed_eval.test.mcnemar.rst.txt
│   │   │   ├── sed_eval.util.event_list.filter_event_list.rst.txt
│   │   │   ├── sed_eval.util.event_list.max_event_offset.rst.txt
│   │   │   ├── sed_eval.util.event_list.unique_event_labels.rst.txt
│   │   │   ├── sed_eval.util.event_list.unique_files.rst.txt
│   │   │   ├── sed_eval.util.event_matching.bipartite_match.rst.txt
│   │   │   ├── sed_eval.util.event_roll.event_list_to_event_roll.rst.txt
│   │   │   ├── sed_eval.util.event_roll.match_event_roll_lengths.rst.txt
│   │   │   ├── sed_eval.util.event_roll.pad_event_roll.rst.txt
│   │   │   └── sed_eval.util.scene_list.unique_scene_labels.rst.txt
│   │   ├── glossary.rst.txt
│   │   ├── index.rst.txt
│   │   ├── install.rst.txt
│   │   ├── io.rst.txt
│   │   ├── metric.rst.txt
│   │   ├── scene.rst.txt
│   │   ├── sound_event.rst.txt
│   │   ├── test.rst.txt
│   │   ├── tutorial.rst.txt
│   │   └── util.rst.txt
│   ├── _static/
│   │   ├── basic.css
│   │   ├── css/
│   │   │   ├── badge_only.css
│   │   │   └── theme.css
│   │   ├── doctools.js
│   │   ├── jquery-3.1.0.js
│   │   ├── jquery.js
│   │   ├── js/
│   │   │   └── theme.js
│   │   ├── pygments.css
│   │   ├── searchtools.js
│   │   ├── theme_overrides.css
│   │   ├── underscore-1.3.1.js
│   │   ├── underscore.js
│   │   └── websupport.js
│   ├── audio_tag.html
│   ├── changelog.html
│   ├── generated/
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.evaluate.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.reset.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics.html
│   │   ├── sed_eval.io.load_event_list.html
│   │   ├── sed_eval.io.load_file_pair_list.html
│   │   ├── sed_eval.io.load_scene_list.html
│   │   ├── sed_eval.metric.accuracy.html
│   │   ├── sed_eval.metric.accuracy2.html
│   │   ├── sed_eval.metric.balanced_accuracy.html
│   │   ├── sed_eval.metric.deletion_rate.html
│   │   ├── sed_eval.metric.equal_error_rate.html
│   │   ├── sed_eval.metric.error_rate.html
│   │   ├── sed_eval.metric.f_measure.html
│   │   ├── sed_eval.metric.insertion_rate.html
│   │   ├── sed_eval.metric.precision.html
│   │   ├── sed_eval.metric.recall.html
│   │   ├── sed_eval.metric.sensitivity.html
│   │   ├── sed_eval.metric.specificity.html
│   │   ├── sed_eval.metric.substitution_rate.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.evaluate.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.reset.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_class_wise.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_parameters.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.results.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.results_overall_metrics.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.evaluate.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.reset.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_class_wise.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_overall.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_parameters.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.results.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.results_overall_metrics.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.evaluate.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.reset.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_overall.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics.html
│   │   ├── sed_eval.test.mcnemar.html
│   │   ├── sed_eval.util.event_list.filter_event_list.html
│   │   ├── sed_eval.util.event_list.max_event_offset.html
│   │   ├── sed_eval.util.event_list.unique_event_labels.html
│   │   ├── sed_eval.util.event_list.unique_files.html
│   │   ├── sed_eval.util.event_matching.bipartite_match.html
│   │   ├── sed_eval.util.event_roll.event_list_to_event_roll.html
│   │   ├── sed_eval.util.event_roll.match_event_roll_lengths.html
│   │   ├── sed_eval.util.event_roll.pad_event_roll.html
│   │   └── sed_eval.util.scene_list.unique_scene_labels.html
│   ├── genindex.html
│   ├── glossary.html
│   ├── index.html
│   ├── install.html
│   ├── io.html
│   ├── metric.html
│   ├── objects.inv
│   ├── py-modindex.html
│   ├── scene.html
│   ├── search.html
│   ├── searchindex.js
│   ├── sound_event.html
│   ├── test.html
│   ├── tutorial.html
│   └── util.html
├── documentation/
│   ├── Makefile
│   ├── README.md
│   ├── requirements.txt
│   └── source/
│       ├── __init__.py
│       ├── _static/
│       │   ├── .nojekyll
│       │   └── theme_overrides.css
│       ├── audio_tag.rst
│       ├── changelog.rst
│       ├── conf.py
│       ├── glossary.rst
│       ├── index.rst
│       ├── install.rst
│       ├── io.rst
│       ├── metric.rst
│       ├── scene.rst
│       ├── sound_event.rst
│       ├── test.rst
│       ├── tutorial.rst
│       └── util.rst
├── evaluators/
│   ├── README.md
│   ├── scene_eval.py
│   └── sound_event_eval.py
├── requirements.txt
├── sed_eval/
│   ├── __init__.py
│   ├── audio_tag.py
│   ├── io.py
│   ├── metric.py
│   ├── scene.py
│   ├── sound_event.py
│   ├── test.py
│   └── util/
│       ├── __init__.py
│       ├── event_list.py
│       ├── event_matching.py
│       ├── event_roll.py
│       └── scene_list.py
├── setup.cfg
├── setup.py
└── tests/
    ├── README.md
    ├── data/
    │   ├── audio_tagging/
    │   │   ├── estimated.txt
    │   │   └── reference.txt
    │   ├── scene/
    │   │   ├── estimated_a.txt
    │   │   ├── estimated_b.txt
    │   │   ├── file_list.txt
    │   │   ├── fold1_estimated.txt
    │   │   ├── fold1_reference.txt
    │   │   ├── fold2_estimated.txt
    │   │   ├── fold2_reference.txt
    │   │   ├── fold3_estimated.txt
    │   │   ├── fold3_reference.txt
    │   │   ├── fold4_estimated.txt
    │   │   ├── fold4_reference.txt
    │   │   ├── fold5_estimated.txt
    │   │   ├── fold5_reference.txt
    │   │   └── reference.txt
    │   └── sound_event/
    │       ├── audioset1.txt
    │       ├── audioset1_detected.txt
    │       ├── binary1.txt
    │       ├── binary1_detected.txt
    │       ├── binary2.txt
    │       ├── binary2_detected.txt
    │       ├── binary3.txt
    │       ├── binary3_detected.txt
    │       ├── binary4.txt
    │       ├── binary4_detected.txt
    │       ├── binary5.txt
    │       ├── binary5_detected.txt
    │       ├── file_list.txt
    │       ├── file_list_audioset.txt
    │       ├── file_list_binary.txt
    │       ├── mini_detected_a.txt
    │       ├── mini_detected_b.txt
    │       ├── mini_reference.txt
    │       ├── office_snr0_high_v2.txt
    │       ├── office_snr0_high_v2_detected.txt
    │       ├── office_snr0_med_v2.txt
    │       ├── office_snr0_med_v2_detected.txt
    │       ├── street_fold1_detected.txt
    │       └── street_fold1_reference.txt
    ├── test_audio_tag.py
    ├── test_io.py
    ├── test_metric.py
    ├── test_scene.py
    ├── test_sound_event.py
    ├── test_test.py
    └── test_util.py

================================================
FILE CONTENTS
================================================

================================================
FILE: .coveragerc
================================================
[report]
omit =
    */python?.?/*
    */site-packages/nose/*

================================================
FILE: .gitignore
================================================
*.py[co]

# Packages
*.egg
*.egg-info
dist
build
eggs
parts
bin
var
sdist
develop-eggs
.installed.cfg

# Installer logs
pip-log.txt

# Unit test / coverage reports
.coverage
.tox

#Translations
*.mo

#Mr Developer
.mr.developer.cfg

# OS generated files #
.DS_Store
.DS_Store?
._*
.Spotlight-V100
.Trashes
ehthumbs.db
Thumbs.db
*~


# Vim

# PyCharm
.idea

# cover
tests/cover/*
tests/_dev/*
.coverage
.coverage.*

# Sphinx
#docs/generated/

tests/dcase2016/*

.nfs*
tests/*.zip
tests/DCASE2016-baseline-system-python*
tests/dev/
documentation/source/generated/
documentation/build/

================================================
FILE: .travis.yml
================================================
language:
    - python

python:
    - "2.7"
    - "3.5"
    - "3.6"

cache:
  pip: true
  bundler: true

notifications:
  email: false

before_install:
    - "sudo apt-get install -qq python-scipy"

# command to install dependencies
install:
    - "pip install -r requirements.txt"
    - "pip install python-coveralls"
    - "pip install coveralls"
    - "pip install nose"
    - "pip install scikit-learn"
    - "pip install 'joblib==0.11' --force-reinstall"
    - "python setup.py develop"

# command to run tests
script:
    - "nosetests --with-coverage --cover-erase --cover-package=sed_eval -v -w tests/"

after_success:
    - "coveralls"
    - "python setup.py develop --uninstall"

after_failure:
    - "python setup.py develop --uninstall"

================================================
FILE: CODE_OF_CONDUCT.md
================================================
# Contributor Covenant Code of Conduct

## Our Pledge

In the interest of fostering an open and welcoming environment, we as contributors and maintainers pledge to making participation in our project and our community a harassment-free experience for everyone, regardless of age, body size, disability, ethnicity, gender identity and expression, level of experience, nationality, personal appearance, race, religion, or sexual identity and orientation.

## Our Standards

Examples of behavior that contributes to creating a positive environment include:

* Using welcoming and inclusive language
* Being respectful of differing viewpoints and experiences
* Gracefully accepting constructive criticism
* Focusing on what is best for the community
* Showing empathy towards other community members

Examples of unacceptable behavior by participants include:

* The use of sexualized language or imagery and unwelcome sexual attention or advances
* Trolling, insulting/derogatory comments, and personal or political attacks
* Public or private harassment
* Publishing others' private information, such as a physical or electronic address, without explicit permission
* Other conduct which could reasonably be considered inappropriate in a professional setting

## Our Responsibilities

Project maintainers are responsible for clarifying the standards of acceptable behavior and are expected to take appropriate and fair corrective action in response to any instances of unacceptable behavior.

Project maintainers have the right and responsibility to remove, edit, or reject comments, commits, code, wiki edits, issues, and other contributions that are not aligned to this Code of Conduct, or to ban temporarily or permanently any contributor for other behaviors that they deem inappropriate, threatening, offensive, or harmful.

## Scope

This Code of Conduct applies both within project spaces and in public spaces when an individual is representing the project or its community. Examples of representing a project or community include using an official project e-mail address, posting via an official social media account, or acting as an appointed representative at an online or offline event. Representation of a project may be further defined and clarified by project maintainers.

## Enforcement

Instances of abusive, harassing, or otherwise unacceptable behavior may be reported by contacting the project team at toni.heittola@tut.fi. The project team will review and investigate all complaints, and will respond in a way that it deems appropriate to the circumstances. The project team is obligated to maintain confidentiality with regard to the reporter of an incident. Further details of specific enforcement policies may be posted separately.

Project maintainers who do not follow or enforce the Code of Conduct in good faith may face temporary or permanent repercussions as determined by other members of the project's leadership.

## Attribution

This Code of Conduct is adapted from the [Contributor Covenant][homepage], version 1.4, available at [http://contributor-covenant.org/version/1/4][version]

[homepage]: http://contributor-covenant.org
[version]: http://contributor-covenant.org/version/1/4/


================================================
FILE: CONTRIBUTING.md
================================================
Contributing
============

How to contribute
-----------------

The preferred way to contribute to `sed_eval` is to fork the 
[main repository](https://github.com/TUT-ARG/sed_eval) on
GitHub:

1. Fork the [project repository](https://github.com/TUT-ARG/sed_eval):
   click on the 'Fork' button near the top of the page. This creates
   a copy of the code under your account on the GitHub server.

2. Clone this copy to your local disk:

        git clone git@github.com:[YOUR_LOGIN]/sed_eval.git
        cd sed_eval 

3. Create a branch to hold your changes:

        git checkout -b my-new-feature

   and start making changes. You should never work in the ``master`` branch directly. 

4. Work on this copy on your computer using Git to do the version
   control. When you're done editing, do:

        git add [MODIFIED FILES]
        git commit

   to record your changes in Git, then push them to GitHub with:

        git push -u origin my-new-feature

Finally, go to the web page of the your fork of the sed_eval repo,
and click 'Pull request' to send your changes to the maintainers for
review. This will send an email to the committers.

More information about this kind of process can be found in 
[Git documentation](http://git-scm.com/documentation).

You should check that your contribution complies with the
following rules before submitting a pull request:

- All public methods should have informative docstrings
- Code should be sufficiently commented
- For major new features there should be also an unittest  

You should check for common programming errors with the following
tools:

-  Check unittests:

        pip install nose coverage
        cd tests/
        nosetests -v --with-coverage --cover-erase --cover-html --cover-package=sed_eval --nocapture

-  There should be no major pyflakes warnings, check with:

        pip install pyflakes
        pyflakes path/to/module.py

-  There should be no major PEP8 warnings, check with:

        pip install pep8
        pep8 path/to/module.py

Creating an issue
-----------------

We use Github issues to track all bugs and feature requests; feel free to
open an issue if you have found a bug or wish to see a new feature implemented.

It is recommended to check that your issue complies with the
following rules before submitting:

-  Verify that your issue is not being currently addressed by other
   [issues](https://github.com/TUT-ARG/sed_eval/issues?q=)
   or [pull requests](https://github.com/TUT-ARG/sed_eval/pulls?q=).

-  Please ensure all code snippets and error messages are formatted in
   appropriate code blocks.
   See [Creating and highlighting code blocks](https://help.github.com/articles/creating-and-highlighting-code-blocks).

-  Please include your operating system type and version number, as well
   as your Python, numpy, and dcase_util versions. You can get this
   information with following code:

    import platform; print(platform.platform())
    import sys; print("Python", sys.version)
    import numpy; print("NumPy", numpy.__version__)
    

Documentation
-------------

You can edit the documentation using any text editor and then generate
the HTML output by typing ``make html`` from the docs/ directory.
The resulting HTML files will be placed in docs/ and are viewable 
in a web browser. See the README file in the documentation/ directory for more information.

Note
----
This document is based on contribution instructions for [LibROSA](https://github.com/librosa/librosa).


================================================
FILE: LICENSE.txt
================================================
The MIT License (MIT)

Copyright (c) 2016 Tampere University of Technology

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in
all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
THE SOFTWARE.

================================================
FILE: README.rst
================================================
sed_eval - Evaluation toolbox for Sound Event Detection
=======================================================

.. image:: https://travis-ci.org/TUT-ARG/sed_eval.svg?branch=master
    :target: https://travis-ci.org/TUT-ARG/sed_eval

.. image:: https://coveralls.io/repos/github/TUT-ARG/sed_eval/badge.svg?branch=master 
    :target: https://coveralls.io/github/TUT-ARG/sed_eval?branch=master

.. image:: https://img.shields.io/pypi/v/sed_eval.svg
    :target: https://pypi.python.org/pypi/sed_eval

.. image:: https://img.shields.io/badge/license-MIT-blue.svg
    :target: https://opensource.org/licenses/MIT

sed_eval is an open source Python toolbox which provides a standardized, 
and transparent way to evaluate sound event detection systems. 

Authors

- Toni Heittola (toni.heittola@tut.fi, `GitHub <https://github.com/toni-heittola>`_, `<http://www.cs.tut.fi/~heittolt/>`_)
- Annamaria Mesaros (annamaria.mesaros@tut.fi, `<http://www.cs.tut.fi/~mesaros/>`_)

Documentation
=============

See http://tut-arg.github.io/sed_eval for manual and tutorials.

Installation instructions
=========================

The latest stable release is available on PyPI, and you can install with pip::

    pip install sed_eval

Alternatively you can download or clone toolbox and use ``pip`` to handle dependencies::

    unzip sed_eval.zip
    pip install -e sed_eval


or::

    git clone https://github.com/TUT-ARG/sed_eval.git
    pip install -e sed_eval


Dependencies
------------

The toolbox is tested to work with Python 2.7 and Python 3.6.

- numpy >= 1.7.0
- dcase_util >= 0.2.4

Citing
======

If you use sed_eval in a research project, please cite the following paper:

Annamaria Mesaros, Toni Heittola, and Tuomas Virtanen, "Metrics for polyphonic sound event detection", Applied Sciences, 6(6):162, 2016 [`HTML <http://www.mdpi.com/2076-3417/6/6/162>`_][`PDF <http://www.mdpi.com/2076-3417/6/6/162/pdf>`_]

License
=======

Code released under `the MIT license <https://github.com/TUT-ARG/sed_eval/tree/master/LICENSE.txt>`_.


================================================
FILE: docs/.buildinfo
================================================
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
config: 950eb7edc6fd5559b7dbbc2ae8b0df21
tags: 645f666f9bcd5a90fca523b33c5a78b7


================================================
FILE: docs/.nojekyll
================================================


================================================
FILE: docs/_modules/index.html
================================================


<!DOCTYPE html>
<!--[if IE 8]><html class="no-js lt-ie9" lang="en" > <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js" lang="en" > <!--<![endif]-->
<head>
  <meta charset="utf-8">
  
  <meta name="viewport" content="width=device-width, initial-scale=1.0">
  
  <title>Overview: module code &mdash; sed_eval 0.1 documentation</title>
  

  
  
  
  

  

  
  
    

  

  
  
    <link rel="stylesheet" href="../_static/css/theme.css" type="text/css" />
  

  
    <link rel="stylesheet" href="../_static/theme_overrides.css" type="text/css" />
  

  
        <link rel="index" title="Index"
              href="../genindex.html"/>
        <link rel="search" title="Search" href="../search.html"/>
    <link rel="top" title="sed_eval 0.1 documentation" href="../index.html"/> 

  
  <script src="../_static/js/modernizr.min.js"></script>

</head>

<body class="wy-body-for-nav" role="document">

   
  <div class="wy-grid-for-nav">

    
    <nav data-toggle="wy-nav-shift" class="wy-nav-side">
      <div class="wy-side-scroll">
        <div class="wy-side-nav-search">
          

          
            <a href="../index.html" class="icon icon-home"> sed_eval
          

          
            
            <img src="../_static/sed_eval_logo.png" class="logo" />
          
          </a>

          

          
<div role="search">
  <form id="rtd-search-form" class="wy-form" action="../search.html" method="get">
    <input type="text" name="q" placeholder="Search docs" />
    <input type="hidden" name="check_keywords" value="yes" />
    <input type="hidden" name="area" value="default" />
  </form>
</div>

          
        </div>

        <div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="main navigation">
          
            
            
              
            
            
              <ul>
<li class="toctree-l1"><a class="reference internal" href="../install.html">Installation instructions</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../install.html#using-pip">Using pip</a></li>
<li class="toctree-l2"><a class="reference internal" href="../install.html#using-setyp-py">Using <code class="docutils literal"><span class="pre">setyp.py</span></code></a></li>
<li class="toctree-l2"><a class="reference internal" href="../install.html#requirements">Requirements</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../tutorial.html">Tutorial</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../tutorial.html#sed-eval-evaluation-toolbox-for-sound-event-detection"><code class="docutils literal"><span class="pre">sed_eval</span></code> &#8211; Evaluation toolbox for Sound Event Detection</a></li>
<li class="toctree-l2"><a class="reference internal" href="../tutorial.html#quickstart-using-the-evaluators">Quickstart: Using the evaluators</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../tutorial.html#sound-event-detection">Sound event detection</a></li>
<li class="toctree-l3"><a class="reference internal" href="../tutorial.html#acoustic-scene-classification">Acoustic scene classification</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../tutorial.html#quickstart-using-sed-eval-in-python-code">Quickstart: Using <code class="docutils literal"><span class="pre">sed_eval</span></code> in Python code</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../tutorial.html#id1">Sound event detection</a></li>
<li class="toctree-l3"><a class="reference internal" href="../tutorial.html#id2">Acoustic scene classification</a></li>
</ul>
</li>
</ul>
</li>
</ul>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../sound_event.html">Sound Event Detection</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../sound_event.html#intermediate-statistics">Intermediate statistics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#segment-based">Segment-based</a></li>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#event-based">Event-based</a></li>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#averaging">Averaging</a></li>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#cross-validation">Cross-validation</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../sound_event.html#implemented-metrics">Implemented metrics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#precision-recall-and-f-score">Precision, Recall and F-score</a></li>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#sensitivity-and-specificity">Sensitivity and specificity</a></li>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#accuracy">Accuracy</a></li>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#balanced-accuracy">Balanced accuracy</a></li>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#error-rate">Error Rate</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../sound_event.html#module-sed_eval.sound_event">Code</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#segment-based-metrics">Segment based metrics</a><ul>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.html">sed_eval.sound_event.SegmentBasedMetrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.evaluate.html">sed_eval.sound_event.SegmentBasedMetrics.evaluate</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.results.html">sed_eval.sound_event.SegmentBasedMetrics.results</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_overall.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_overall</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.SegmentBasedMetrics.reset.html">sed_eval.sound_event.SegmentBasedMetrics.reset</a></li>
</ul>
</li>
<li class="toctree-l3"><a class="reference internal" href="../sound_event.html#event-based-metrics">Event based metrics</a><ul>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.html">sed_eval.sound_event.EventBasedMetrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.evaluate.html">sed_eval.sound_event.EventBasedMetrics.evaluate</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.results.html">sed_eval.sound_event.EventBasedMetrics.results</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.results_overall_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_overall_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.result_report_parameters.html">sed_eval.sound_event.EventBasedMetrics.result_report_parameters</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.result_report_overall.html">sed_eval.sound_event.EventBasedMetrics.result_report_overall</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.result_report_class_wise.html">sed_eval.sound_event.EventBasedMetrics.result_report_class_wise</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average.html">sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l4"><a class="reference internal" href="../generated/sed_eval.sound_event.EventBasedMetrics.reset.html">sed_eval.sound_event.EventBasedMetrics.reset</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../sound_event.html#rerefences">Rerefences</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../scene.html">Acoustic Scene Classification</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../scene.html#metrics">Metrics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.scene.SceneClassificationMetrics.html">sed_eval.scene.SceneClassificationMetrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.scene.SceneClassificationMetrics.evaluate.html">sed_eval.scene.SceneClassificationMetrics.evaluate</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.scene.SceneClassificationMetrics.results.html">sed_eval.scene.SceneClassificationMetrics.results</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.scene.SceneClassificationMetrics.results_overall_metrics.html">sed_eval.scene.SceneClassificationMetrics.results_overall_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics.html">sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics.html">sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.scene.SceneClassificationMetrics.result_report_parameters.html">sed_eval.scene.SceneClassificationMetrics.result_report_parameters</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.scene.SceneClassificationMetrics.result_report_class_wise.html">sed_eval.scene.SceneClassificationMetrics.result_report_class_wise</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average.html">sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.scene.SceneClassificationMetrics.reset.html">sed_eval.scene.SceneClassificationMetrics.reset</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../audio_tag.html">Audio Tagging</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../audio_tag.html#metrics">Metrics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.audio_tag.AudioTaggingMetrics.html">sed_eval.audio_tag.AudioTaggingMetrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.audio_tag.AudioTaggingMetrics.evaluate.html">sed_eval.audio_tag.AudioTaggingMetrics.evaluate</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.audio_tag.AudioTaggingMetrics.results.html">sed_eval.audio_tag.AudioTaggingMetrics.results</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics.html">sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics.html">sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics.html">sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters.html">sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise.html">sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average.html">sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.audio_tag.AudioTaggingMetrics.reset.html">sed_eval.audio_tag.AudioTaggingMetrics.reset</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../metric.html">Metrics</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.f_measure.html">sed_eval.metric.f_measure</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.precision.html">sed_eval.metric.precision</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.recall.html">sed_eval.metric.recall</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.accuracy.html">sed_eval.metric.accuracy</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.accuracy2.html">sed_eval.metric.accuracy2</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.balanced_accuracy.html">sed_eval.metric.balanced_accuracy</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.sensitivity.html">sed_eval.metric.sensitivity</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.specificity.html">sed_eval.metric.specificity</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.error_rate.html">sed_eval.metric.error_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.substitution_rate.html">sed_eval.metric.substitution_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.deletion_rate.html">sed_eval.metric.deletion_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.insertion_rate.html">sed_eval.metric.insertion_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.metric.equal_error_rate.html">sed_eval.metric.equal_error_rate</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../test.html">Tests</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.test.mcnemar.html">sed_eval.test.mcnemar</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../util.html">Utilities</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../util.html#event-list-operations">Event list operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.util.event_list.unique_event_labels.html">sed_eval.util.event_list.unique_event_labels</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.util.event_list.unique_files.html">sed_eval.util.event_list.unique_files</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.util.event_list.filter_event_list.html">sed_eval.util.event_list.filter_event_list</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.util.event_list.max_event_offset.html">sed_eval.util.event_list.max_event_offset</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../util.html#event-roll-operations">Event roll operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.util.event_roll.event_list_to_event_roll.html">sed_eval.util.event_roll.event_list_to_event_roll</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.util.event_roll.pad_event_roll.html">sed_eval.util.event_roll.pad_event_roll</a></li>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.util.event_roll.match_event_roll_lengths.html">sed_eval.util.event_roll.match_event_roll_lengths</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../util.html#scene-list-operations">Scene list operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.util.scene_list.unique_scene_labels.html">sed_eval.util.scene_list.unique_scene_labels</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../util.html#event-matching-operations">Event matching operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../generated/sed_eval.util.event_matching.bipartite_match.html">sed_eval.util.event_matching.bipartite_match</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../io.html">I/O</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.io.load_event_list.html">sed_eval.io.load_event_list</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.io.load_scene_list.html">sed_eval.io.load_scene_list</a></li>
<li class="toctree-l2"><a class="reference internal" href="../generated/sed_eval.io.load_file_pair_list.html">sed_eval.io.load_file_pair_list</a></li>
</ul>
</li>
</ul>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../glossary.html">Glossary</a></li>
<li class="toctree-l1"><a class="reference internal" href="../changelog.html">Changes</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../changelog.html#v0-2-0">v0.2.0</a></li>
<li class="toctree-l2"><a class="reference internal" href="../changelog.html#v0-1-4">v0.1.4</a></li>
<li class="toctree-l2"><a class="reference internal" href="../changelog.html#v0-1-3">v0.1.3</a></li>
<li class="toctree-l2"><a class="reference internal" href="../changelog.html#v0-1-2">v0.1.2</a></li>
<li class="toctree-l2"><a class="reference internal" href="../changelog.html#v0-1-1">v0.1.1</a></li>
<li class="toctree-l2"><a class="reference internal" href="../changelog.html#v0-1-0">v0.1.0</a></li>
</ul>
</li>
</ul>

            
          
        </div>
      </div>
    </nav>

    <section data-toggle="wy-nav-shift" class="wy-nav-content-wrap">

      
      <nav class="wy-nav-top" role="navigation" aria-label="top navigation">
        
          <i data-toggle="wy-nav-top" class="fa fa-bars"></i>
          <a href="../index.html">sed_eval</a>
        
      </nav>


      
      <div class="wy-nav-content">
        <div class="rst-content">
          















<div role="navigation" aria-label="breadcrumbs navigation">

  <ul class="wy-breadcrumbs">
    
      <li><a href="../index.html">Docs</a> &raquo;</li>
        
      <li>Overview: module code</li>
    
    
      <li class="wy-breadcrumbs-aside">
        
            
        
      </li>
    
  </ul>

  
  <hr/>
</div>
          <div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
           <div itemprop="articleBody">
            
  <h1>All modules for which code is available</h1>
<ul><li><a href="sed_eval/audio_tag.html">sed_eval.audio_tag</a></li>
<li><a href="sed_eval/io.html">sed_eval.io</a></li>
<li><a href="sed_eval/metric.html">sed_eval.metric</a></li>
<li><a href="sed_eval/scene.html">sed_eval.scene</a></li>
<li><a href="sed_eval/sound_event.html">sed_eval.sound_event</a></li>
<li><a href="sed_eval/test.html">sed_eval.test</a></li>
<li><a href="sed_eval/util/event_list.html">sed_eval.util.event_list</a></li>
<li><a href="sed_eval/util/event_matching.html">sed_eval.util.event_matching</a></li>
<li><a href="sed_eval/util/event_roll.html">sed_eval.util.event_roll</a></li>
<li><a href="sed_eval/util/scene_list.html">sed_eval.util.scene_list</a></li>
</ul>

           </div>
           <div class="articleComments">
            
           </div>
          </div>
          <footer>
  

  <hr/>

  <div role="contentinfo">
    <p>
        &copy; Copyright 2018, Toni Heittola et al..

    </p>
  </div> 

</footer>

        </div>
      </div>

    </section>

  </div>
  


  

    <script type="text/javascript">
        var DOCUMENTATION_OPTIONS = {
            URL_ROOT:'../',
            VERSION:'0.1',
            COLLAPSE_INDEX:false,
            FILE_SUFFIX:'.html',
            HAS_SOURCE:  true,
            SOURCELINK_SUFFIX: '.txt'
        };
    </script>
      <script type="text/javascript" src="../_static/jquery.js"></script>
      <script type="text/javascript" src="../_static/underscore.js"></script>
      <script type="text/javascript" src="../_static/doctools.js"></script>
      <script type="text/javascript" src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script>

  

  
  
    <script type="text/javascript" src="../_static/js/theme.js"></script>
  

  
  
  <script type="text/javascript">
      jQuery(function () {
          SphinxRtdTheme.StickyNav.enable();
      });
  </script>
   

</body>
</html>

================================================
FILE: docs/_modules/sed_eval/audio_tag.html
================================================


<!DOCTYPE html>
<!--[if IE 8]><html class="no-js lt-ie9" lang="en" > <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js" lang="en" > <!--<![endif]-->
<head>
  <meta charset="utf-8">
  
  <meta name="viewport" content="width=device-width, initial-scale=1.0">
  
  <title>sed_eval.audio_tag &mdash; sed_eval 0.1 documentation</title>
  

  
  
  
  

  

  
  
    

  

  
  
    <link rel="stylesheet" href="../../_static/css/theme.css" type="text/css" />
  

  
    <link rel="stylesheet" href="../../_static/theme_overrides.css" type="text/css" />
  

  
        <link rel="index" title="Index"
              href="../../genindex.html"/>
        <link rel="search" title="Search" href="../../search.html"/>
    <link rel="top" title="sed_eval 0.1 documentation" href="../../index.html"/>
        <link rel="up" title="Module code" href="../index.html"/> 

  
  <script src="../../_static/js/modernizr.min.js"></script>

</head>

<body class="wy-body-for-nav" role="document">

   
  <div class="wy-grid-for-nav">

    
    <nav data-toggle="wy-nav-shift" class="wy-nav-side">
      <div class="wy-side-scroll">
        <div class="wy-side-nav-search">
          

          
            <a href="../../index.html" class="icon icon-home"> sed_eval
          

          
            
            <img src="../../_static/sed_eval_logo.png" class="logo" />
          
          </a>

          

          
<div role="search">
  <form id="rtd-search-form" class="wy-form" action="../../search.html" method="get">
    <input type="text" name="q" placeholder="Search docs" />
    <input type="hidden" name="check_keywords" value="yes" />
    <input type="hidden" name="area" value="default" />
  </form>
</div>

          
        </div>

        <div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="main navigation">
          
            
            
              
            
            
              <ul>
<li class="toctree-l1"><a class="reference internal" href="../../install.html">Installation instructions</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../install.html#using-pip">Using pip</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../install.html#using-setyp-py">Using <code class="docutils literal"><span class="pre">setyp.py</span></code></a></li>
<li class="toctree-l2"><a class="reference internal" href="../../install.html#requirements">Requirements</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../tutorial.html">Tutorial</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../tutorial.html#sed-eval-evaluation-toolbox-for-sound-event-detection"><code class="docutils literal"><span class="pre">sed_eval</span></code> &#8211; Evaluation toolbox for Sound Event Detection</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorial.html#quickstart-using-the-evaluators">Quickstart: Using the evaluators</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#sound-event-detection">Sound event detection</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#acoustic-scene-classification">Acoustic scene classification</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorial.html#quickstart-using-sed-eval-in-python-code">Quickstart: Using <code class="docutils literal"><span class="pre">sed_eval</span></code> in Python code</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#id1">Sound event detection</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#id2">Acoustic scene classification</a></li>
</ul>
</li>
</ul>
</li>
</ul>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../../sound_event.html">Sound Event Detection</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#intermediate-statistics">Intermediate statistics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#segment-based">Segment-based</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#event-based">Event-based</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#averaging">Averaging</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#cross-validation">Cross-validation</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#implemented-metrics">Implemented metrics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#precision-recall-and-f-score">Precision, Recall and F-score</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#sensitivity-and-specificity">Sensitivity and specificity</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#accuracy">Accuracy</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#balanced-accuracy">Balanced accuracy</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#error-rate">Error Rate</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#module-sed_eval.sound_event">Code</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#segment-based-metrics">Segment based metrics</a><ul>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.html">sed_eval.sound_event.SegmentBasedMetrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.evaluate.html">sed_eval.sound_event.SegmentBasedMetrics.evaluate</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results.html">sed_eval.sound_event.SegmentBasedMetrics.results</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_overall.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_overall</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.reset.html">sed_eval.sound_event.SegmentBasedMetrics.reset</a></li>
</ul>
</li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#event-based-metrics">Event based metrics</a><ul>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.html">sed_eval.sound_event.EventBasedMetrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.evaluate.html">sed_eval.sound_event.EventBasedMetrics.evaluate</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results.html">sed_eval.sound_event.EventBasedMetrics.results</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results_overall_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_overall_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.result_report_parameters.html">sed_eval.sound_event.EventBasedMetrics.result_report_parameters</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.result_report_overall.html">sed_eval.sound_event.EventBasedMetrics.result_report_overall</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.result_report_class_wise.html">sed_eval.sound_event.EventBasedMetrics.result_report_class_wise</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average.html">sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.reset.html">sed_eval.sound_event.EventBasedMetrics.reset</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#rerefences">Rerefences</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../scene.html">Acoustic Scene Classification</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../scene.html#metrics">Metrics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.html">sed_eval.scene.SceneClassificationMetrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.evaluate.html">sed_eval.scene.SceneClassificationMetrics.evaluate</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.results.html">sed_eval.scene.SceneClassificationMetrics.results</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.results_overall_metrics.html">sed_eval.scene.SceneClassificationMetrics.results_overall_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics.html">sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics.html">sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.result_report_parameters.html">sed_eval.scene.SceneClassificationMetrics.result_report_parameters</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.result_report_class_wise.html">sed_eval.scene.SceneClassificationMetrics.result_report_class_wise</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average.html">sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.reset.html">sed_eval.scene.SceneClassificationMetrics.reset</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../audio_tag.html">Audio Tagging</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../audio_tag.html#metrics">Metrics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.html">sed_eval.audio_tag.AudioTaggingMetrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.evaluate.html">sed_eval.audio_tag.AudioTaggingMetrics.evaluate</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results.html">sed_eval.audio_tag.AudioTaggingMetrics.results</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics.html">sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics.html">sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics.html">sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters.html">sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise.html">sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average.html">sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.reset.html">sed_eval.audio_tag.AudioTaggingMetrics.reset</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../metric.html">Metrics</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.f_measure.html">sed_eval.metric.f_measure</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.precision.html">sed_eval.metric.precision</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.recall.html">sed_eval.metric.recall</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.accuracy.html">sed_eval.metric.accuracy</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.accuracy2.html">sed_eval.metric.accuracy2</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.balanced_accuracy.html">sed_eval.metric.balanced_accuracy</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.sensitivity.html">sed_eval.metric.sensitivity</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.specificity.html">sed_eval.metric.specificity</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.error_rate.html">sed_eval.metric.error_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.substitution_rate.html">sed_eval.metric.substitution_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.deletion_rate.html">sed_eval.metric.deletion_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.insertion_rate.html">sed_eval.metric.insertion_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.equal_error_rate.html">sed_eval.metric.equal_error_rate</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../test.html">Tests</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.test.mcnemar.html">sed_eval.test.mcnemar</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../util.html">Utilities</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../util.html#event-list-operations">Event list operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_list.unique_event_labels.html">sed_eval.util.event_list.unique_event_labels</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_list.unique_files.html">sed_eval.util.event_list.unique_files</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_list.filter_event_list.html">sed_eval.util.event_list.filter_event_list</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_list.max_event_offset.html">sed_eval.util.event_list.max_event_offset</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../util.html#event-roll-operations">Event roll operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_roll.event_list_to_event_roll.html">sed_eval.util.event_roll.event_list_to_event_roll</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_roll.pad_event_roll.html">sed_eval.util.event_roll.pad_event_roll</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_roll.match_event_roll_lengths.html">sed_eval.util.event_roll.match_event_roll_lengths</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../util.html#scene-list-operations">Scene list operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.scene_list.unique_scene_labels.html">sed_eval.util.scene_list.unique_scene_labels</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../util.html#event-matching-operations">Event matching operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_matching.bipartite_match.html">sed_eval.util.event_matching.bipartite_match</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../io.html">I/O</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.io.load_event_list.html">sed_eval.io.load_event_list</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.io.load_scene_list.html">sed_eval.io.load_scene_list</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.io.load_file_pair_list.html">sed_eval.io.load_file_pair_list</a></li>
</ul>
</li>
</ul>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../../glossary.html">Glossary</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">Changes</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-2-0">v0.2.0</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-1-4">v0.1.4</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-1-3">v0.1.3</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-1-2">v0.1.2</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-1-1">v0.1.1</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-1-0">v0.1.0</a></li>
</ul>
</li>
</ul>

            
          
        </div>
      </div>
    </nav>

    <section data-toggle="wy-nav-shift" class="wy-nav-content-wrap">

      
      <nav class="wy-nav-top" role="navigation" aria-label="top navigation">
        
          <i data-toggle="wy-nav-top" class="fa fa-bars"></i>
          <a href="../../index.html">sed_eval</a>
        
      </nav>


      
      <div class="wy-nav-content">
        <div class="rst-content">
          















<div role="navigation" aria-label="breadcrumbs navigation">

  <ul class="wy-breadcrumbs">
    
      <li><a href="../../index.html">Docs</a> &raquo;</li>
        
          <li><a href="../index.html">Module code</a> &raquo;</li>
        
      <li>sed_eval.audio_tag</li>
    
    
      <li class="wy-breadcrumbs-aside">
        
            
        
      </li>
    
  </ul>

  
  <hr/>
</div>
          <div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
           <div itemprop="articleBody">
            
  <h1>Source code for sed_eval.audio_tag</h1><div class="highlight"><pre>
<span></span><span class="ch">#!/usr/bin/env python</span>
<span class="c1"># -*- coding: utf-8 -*-</span>
<span class="sd">&quot;&quot;&quot;</span>
<span class="sd">Metrics</span>
<span class="sd">-------</span>

<span class="sd">Main functions:</span>

<span class="sd">* :func:`sed_eval.audio_tag.AudioTaggingMetrics.evaluate`: Calculate intermediate values for evaluation and accumulate them.</span>
<span class="sd">* :func:`sed_eval.audio_tag.AudioTaggingMetrics.results`: Calculate and return all metrics.</span>
<span class="sd">* :func:`sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics`: Calculate and return overall metrics (micro-averaged).</span>
<span class="sd">* :func:`sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics`: Calculate and return class-wise metrics.</span>
<span class="sd">* :func:`sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics`: Calculate and return class-wise average metrics (macro-averaged).</span>

<span class="sd">Function :func:`sed_eval.audio_tag.AudioTaggingMetrics.evaluate` takes as a parameter tag lists,</span>
<span class="sd">(use :func:`dcase_util.containers.MetaDataContainer` to read them from a file), and probability lists (use :func:`dcase_util.containers.ProbabilityContainer` to read them from a file).</span>

<span class="sd">Usage example:</span>

<span class="sd">.. code-block:: python</span>
<span class="sd">    :linenos:</span>

<span class="sd">    import sed_eval</span>
<span class="sd">    import dcase_util</span>

<span class="sd">    reference_tag_list = dcase_util.containers.MetaDataContainer([</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test1.wav&#39;,</span>
<span class="sd">            &#39;tags&#39;: &#39;cat,dog&#39;</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test2.wav&#39;,</span>
<span class="sd">            &#39;tags&#39;: &#39;dog&#39;</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test3.wav&#39;,</span>
<span class="sd">            &#39;tags&#39;: &#39;bird,cat&#39;</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test4.wav&#39;,</span>
<span class="sd">            &#39;tags&#39;: &#39;cat&#39;</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test5.wav&#39;,</span>
<span class="sd">            &#39;tags&#39;: &#39;bird,speech&#39;</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test6.wav&#39;,</span>
<span class="sd">            &#39;tags&#39;: &#39;dog,speech&#39;</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test7.wav&#39;,</span>
<span class="sd">            &#39;tags&#39;: &#39;speech&#39;</span>
<span class="sd">        },</span>
<span class="sd">    ])</span>

<span class="sd">    estimated_tag_probabilities = dcase_util.containers.ProbabilityContainer([</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test1.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;bird&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.2</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test1.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;cat&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.99</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test1.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;dog&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.88</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test1.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;speech&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.01</span>
<span class="sd">        },</span>

<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test2.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;bird&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.1</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test2.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;cat&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.3</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test2.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;dog&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.8</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test2.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;speech&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.1</span>
<span class="sd">        },</span>


<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test3.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;bird&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.7</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test3.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;cat&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.6</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test3.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;dog&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.4</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test3.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;speech&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.3</span>
<span class="sd">        },</span>

<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test4.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;bird&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.323</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test4.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;cat&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.6</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test4.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;dog&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.56</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test4.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;speech&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.4</span>
<span class="sd">        },</span>


<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test5.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;bird&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.8</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test5.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;cat&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.7</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test5.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;dog&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.45</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test5.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;speech&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.43</span>
<span class="sd">        },</span>


<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test6.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;bird&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.9</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test6.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;cat&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.53</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test6.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;dog&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.83</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test6.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;speech&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.95</span>
<span class="sd">        },</span>


<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test7.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;bird&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.2</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test7.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;cat&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.2</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test7.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;dog&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.89</span>
<span class="sd">        },</span>
<span class="sd">        {</span>
<span class="sd">            &#39;filename&#39;: &#39;test7.wav&#39;,</span>
<span class="sd">            &#39;label&#39;: &#39;speech&#39;,</span>
<span class="sd">            &#39;probability&#39;: 0.45</span>
<span class="sd">        },</span>
<span class="sd">    ])</span>

<span class="sd">    estimated_tag_list = dcase_util.containers.MetaDataContainer()</span>
<span class="sd">    for file in estimated_tag_probabilities.unique_files:</span>
<span class="sd">        k = estimated_tag_probabilities.filter(filename=file)</span>
<span class="sd">        tags = []</span>
<span class="sd">        for item in k:</span>
<span class="sd">            if item.probability &gt; 0.5:</span>
<span class="sd">                tags.append(item.label)</span>

<span class="sd">        estimated_tag_list.append(</span>
<span class="sd">            {</span>
<span class="sd">                &#39;filename&#39;: file,</span>
<span class="sd">                &#39;tags&#39;: tags</span>
<span class="sd">            }</span>
<span class="sd">        )</span>

<span class="sd">    tag_evaluator = sed_eval.audio_tag.AudioTaggingMetrics(</span>
<span class="sd">        tags=reference_tag_list.unique_tags</span>
<span class="sd">    )</span>

<span class="sd">    tag_evaluator.evaluate(</span>
<span class="sd">        reference_tag_list=reference_tag_list,</span>
<span class="sd">        estimated_tag_list=estimated_tag_list,</span>
<span class="sd">        estimated_tag_probabilities=estimated_tag_probabilities</span>
<span class="sd">    )</span>
<span class="sd">    print(tag_evaluator)</span>


<span class="sd">.. autosummary::</span>
<span class="sd">    :toctree: generated/</span>

<span class="sd">    AudioTaggingMetrics</span>
<span class="sd">    AudioTaggingMetrics.evaluate</span>
<span class="sd">    AudioTaggingMetrics.results</span>
<span class="sd">    AudioTaggingMetrics.results_overall_metrics</span>
<span class="sd">    AudioTaggingMetrics.results_class_wise_metrics</span>
<span class="sd">    AudioTaggingMetrics.results_class_wise_average_metrics</span>
<span class="sd">    AudioTaggingMetrics.result_report_parameters</span>
<span class="sd">    AudioTaggingMetrics.result_report_class_wise</span>
<span class="sd">    AudioTaggingMetrics.result_report_class_wise_average</span>
<span class="sd">    AudioTaggingMetrics.reset</span>

<span class="sd">&quot;&quot;&quot;</span>

<span class="kn">from</span> <span class="nn">__future__</span> <span class="k">import</span> <span class="n">absolute_import</span>
<span class="kn">import</span> <span class="nn">numpy</span>
<span class="kn">from</span> <span class="nn">.</span> <span class="k">import</span> <span class="n">metric</span>
<span class="kn">import</span> <span class="nn">dcase_util</span>


<div class="viewcode-block" id="AudioTaggingMetrics"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.html#sed_eval.audio_tag.AudioTaggingMetrics">[docs]</a><span class="k">class</span> <span class="nc">AudioTaggingMetrics</span><span class="p">:</span>
<div class="viewcode-block" id="AudioTaggingMetrics.__init__"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.html#sed_eval.audio_tag.AudioTaggingMetrics.__init__">[docs]</a>    <span class="k">def</span> <span class="nf">__init__</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">tags</span><span class="o">=</span><span class="kc">None</span><span class="p">):</span>
        <span class="bp">self</span><span class="o">.</span><span class="n">tag_label_list</span> <span class="o">=</span> <span class="n">tags</span>

        <span class="bp">self</span><span class="o">.</span><span class="n">overall</span> <span class="o">=</span> <span class="p">{</span>
            <span class="s1">&#39;Ncorr&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Nref&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Nsys&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Ntp&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Ntn&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Nfp&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Nfn&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
        <span class="p">}</span>

        <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span> <span class="o">=</span> <span class="p">{}</span>
        <span class="bp">self</span><span class="o">.</span><span class="n">y_true</span> <span class="o">=</span> <span class="p">{}</span>
        <span class="bp">self</span><span class="o">.</span><span class="n">y_pred</span> <span class="o">=</span> <span class="p">{}</span>
        <span class="bp">self</span><span class="o">.</span><span class="n">y_pred_score</span> <span class="o">=</span> <span class="p">{}</span>

        <span class="k">for</span> <span class="n">label</span> <span class="ow">in</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_label_list</span><span class="p">:</span>
            <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">label</span><span class="p">]</span> <span class="o">=</span> <span class="p">{</span>
                <span class="s1">&#39;Nref&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
                <span class="s1">&#39;Nsys&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
                <span class="s1">&#39;Ntp&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
                <span class="s1">&#39;Ntn&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
                <span class="s1">&#39;Nfp&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
                <span class="s1">&#39;Nfn&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="p">}</span>
            <span class="bp">self</span><span class="o">.</span><span class="n">y_true</span><span class="p">[</span><span class="n">label</span><span class="p">]</span> <span class="o">=</span> <span class="p">[]</span>
            <span class="bp">self</span><span class="o">.</span><span class="n">y_pred</span><span class="p">[</span><span class="n">label</span><span class="p">]</span> <span class="o">=</span> <span class="p">[]</span>
            <span class="bp">self</span><span class="o">.</span><span class="n">y_pred_score</span><span class="p">[</span><span class="n">label</span><span class="p">]</span> <span class="o">=</span> <span class="p">[]</span>

        <span class="bp">self</span><span class="o">.</span><span class="n">ui</span> <span class="o">=</span> <span class="n">dcase_util</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">FancyStringifier</span><span class="p">()</span></div>

    <span class="k">def</span> <span class="nf">__str__</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;Print result reports&quot;&quot;&quot;</span>

        <span class="n">output</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">section_header</span><span class="p">(</span><span class="s1">&#39;Audio tagging metrics&#39;</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
        <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">result_report_parameters</span><span class="p">()</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
        <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">result_report_overall</span><span class="p">()</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
        <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">result_report_class_wise_average</span><span class="p">()</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
        <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">result_report_class_wise</span><span class="p">()</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>

        <span class="k">return</span> <span class="n">output</span>

<div class="viewcode-block" id="AudioTaggingMetrics.evaluate"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.evaluate.html#sed_eval.audio_tag.AudioTaggingMetrics.evaluate">[docs]</a>    <span class="k">def</span> <span class="nf">evaluate</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">reference_tag_list</span><span class="p">,</span> <span class="n">estimated_tag_list</span><span class="o">=</span><span class="kc">None</span><span class="p">,</span> <span class="n">estimated_tag_probabilities</span><span class="o">=</span><span class="kc">None</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;Evaluate estimated against reference</span>

<span class="sd">        Parameters</span>
<span class="sd">        ----------</span>

<span class="sd">        reference_tag_list : list of dict or dcase_util.containers.MetaDataContainer</span>
<span class="sd">            Reference tag list</span>

<span class="sd">        estimated_tag_list : list of dict or dcase_util.containers.MetaDataContainer</span>
<span class="sd">            Estimated tag list</span>

<span class="sd">        estimated_tag_probabilities : list of dict or dcase_util.containers.ProbabilityContainer</span>
<span class="sd">            Estimated tag probabilities</span>

<span class="sd">        Returns</span>
<span class="sd">        -------</span>
<span class="sd">        self</span>

<span class="sd">        &quot;&quot;&quot;</span>

        <span class="k">if</span> <span class="n">estimated_tag_list</span> <span class="ow">is</span> <span class="kc">None</span> <span class="ow">and</span> <span class="n">estimated_tag_probabilities</span> <span class="ow">is</span> <span class="kc">None</span><span class="p">:</span>
            <span class="k">raise</span> <span class="ne">ValueError</span><span class="p">(</span><span class="s2">&quot;Nothing to evaluate, give at least estimated_tag_list or estimated_tag_probabilities&quot;</span><span class="p">)</span>

        <span class="c1"># Make sure reference_tag_list is dcase_util.containers.MetaDataContainer</span>
        <span class="k">if</span> <span class="ow">not</span> <span class="nb">isinstance</span><span class="p">(</span><span class="n">reference_tag_list</span><span class="p">,</span> <span class="n">dcase_util</span><span class="o">.</span><span class="n">containers</span><span class="o">.</span><span class="n">MetaDataContainer</span><span class="p">):</span>
            <span class="n">reference_tag_list</span> <span class="o">=</span> <span class="n">dcase_util</span><span class="o">.</span><span class="n">containers</span><span class="o">.</span><span class="n">MetaDataContainer</span><span class="p">(</span><span class="n">reference_tag_list</span><span class="p">)</span>

        <span class="c1"># Make sure estimated_tag_list is dcase_util.containers.MetaDataContainer</span>
        <span class="k">if</span> <span class="n">estimated_tag_list</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
            <span class="k">if</span> <span class="ow">not</span> <span class="nb">isinstance</span><span class="p">(</span><span class="n">estimated_tag_list</span><span class="p">,</span> <span class="n">dcase_util</span><span class="o">.</span><span class="n">containers</span><span class="o">.</span><span class="n">MetaDataContainer</span><span class="p">):</span>
                <span class="n">estimated_tag_list</span> <span class="o">=</span> <span class="n">dcase_util</span><span class="o">.</span><span class="n">containers</span><span class="o">.</span><span class="n">MetaDataContainer</span><span class="p">(</span><span class="n">estimated_tag_list</span><span class="p">)</span>

        <span class="c1"># Make sure estimated_tag_probabilities is dcase_util.containers.ProbabilityContainer</span>
        <span class="k">if</span> <span class="n">estimated_tag_probabilities</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
            <span class="k">if</span> <span class="ow">not</span> <span class="nb">isinstance</span><span class="p">(</span><span class="n">estimated_tag_probabilities</span><span class="p">,</span> <span class="n">dcase_util</span><span class="o">.</span><span class="n">containers</span><span class="o">.</span><span class="n">ProbabilityContainer</span><span class="p">):</span>
                <span class="n">estimated_tag_probabilities</span> <span class="o">=</span> <span class="n">dcase_util</span><span class="o">.</span><span class="n">containers</span><span class="o">.</span><span class="n">ProbabilityContainer</span><span class="p">(</span><span class="n">estimated_tag_probabilities</span><span class="p">)</span>

        <span class="n">y_true</span> <span class="o">=</span> <span class="p">[]</span>
        <span class="n">y_pred</span> <span class="o">=</span> <span class="p">[]</span>

        <span class="c1"># Go though reference and estimated list label by label, and file by file</span>
        <span class="k">for</span> <span class="n">label</span> <span class="ow">in</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_label_list</span><span class="p">:</span>
            <span class="k">for</span> <span class="n">filename</span> <span class="ow">in</span> <span class="n">reference_tag_list</span><span class="o">.</span><span class="n">unique_files</span><span class="p">:</span>
                <span class="n">reference_item</span> <span class="o">=</span> <span class="n">reference_tag_list</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">filename</span><span class="o">=</span><span class="n">filename</span><span class="p">)[</span><span class="mi">0</span><span class="p">]</span>

                <span class="c1"># Populate y_true based on reference_item</span>
                <span class="k">if</span> <span class="n">label</span> <span class="ow">in</span> <span class="n">reference_item</span><span class="o">.</span><span class="n">tags</span><span class="p">:</span>
                    <span class="bp">self</span><span class="o">.</span><span class="n">y_true</span><span class="p">[</span><span class="n">label</span><span class="p">]</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="mi">1</span><span class="p">)</span>
                    <span class="n">y_true</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="mi">1</span><span class="p">)</span>

                <span class="k">else</span><span class="p">:</span>
                    <span class="bp">self</span><span class="o">.</span><span class="n">y_true</span><span class="p">[</span><span class="n">label</span><span class="p">]</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="mi">0</span><span class="p">)</span>
                    <span class="n">y_true</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="mi">0</span><span class="p">)</span>

                <span class="k">if</span> <span class="n">estimated_tag_list</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                    <span class="c1"># Evaluate based on estimated tags</span>

                    <span class="n">estimated_item</span> <span class="o">=</span> <span class="n">estimated_tag_list</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">filename</span><span class="o">=</span><span class="n">filename</span><span class="p">)[</span><span class="mi">0</span><span class="p">]</span>

                    <span class="k">if</span> <span class="ow">not</span> <span class="n">estimated_item</span><span class="p">:</span>
                        <span class="k">raise</span> <span class="ne">ValueError</span><span class="p">(</span>
                            <span class="s2">&quot;Not all reference files estimated, please check [</span><span class="si">{file}</span><span class="s2">]&quot;</span><span class="o">.</span><span class="n">format</span><span class="p">(</span>
                                <span class="n">file</span><span class="o">=</span><span class="n">filename</span>
                            <span class="p">)</span>
                        <span class="p">)</span>
                    <span class="c1"># Store nref</span>
                    <span class="k">if</span> <span class="n">label</span> <span class="ow">in</span> <span class="n">reference_item</span><span class="o">.</span><span class="n">tags</span><span class="p">:</span>
                        <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">label</span><span class="p">][</span><span class="s1">&#39;Nref&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="mi">1</span>

                    <span class="c1"># Populate y_pred based estimated_item</span>
                    <span class="k">if</span> <span class="n">label</span> <span class="ow">in</span> <span class="n">estimated_item</span><span class="o">.</span><span class="n">tags</span><span class="p">:</span>
                        <span class="bp">self</span><span class="o">.</span><span class="n">y_pred</span><span class="p">[</span><span class="n">label</span><span class="p">]</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="mi">1</span><span class="p">)</span>
                        <span class="n">y_pred</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="mi">1</span><span class="p">)</span>
                        <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">label</span><span class="p">][</span><span class="s1">&#39;Nsys&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="mi">1</span>

                    <span class="k">else</span><span class="p">:</span>
                        <span class="bp">self</span><span class="o">.</span><span class="n">y_pred</span><span class="p">[</span><span class="n">label</span><span class="p">]</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="mi">0</span><span class="p">)</span>
                        <span class="n">y_pred</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="mi">0</span><span class="p">)</span>

                    <span class="c1"># Accumulate intermediate values</span>
                    <span class="c1"># True positives (TP)</span>
                    <span class="k">if</span> <span class="n">label</span> <span class="ow">in</span> <span class="n">reference_item</span><span class="o">.</span><span class="n">tags</span> <span class="ow">and</span> <span class="n">label</span> <span class="ow">in</span> <span class="n">estimated_item</span><span class="o">.</span><span class="n">tags</span><span class="p">:</span>
                        <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">label</span><span class="p">][</span><span class="s1">&#39;Ntp&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="mi">1</span>

                    <span class="c1"># True negatives (TN)</span>
                    <span class="k">if</span> <span class="n">label</span> <span class="ow">not</span> <span class="ow">in</span> <span class="n">reference_item</span><span class="o">.</span><span class="n">tags</span> <span class="ow">and</span> <span class="n">label</span> <span class="ow">not</span> <span class="ow">in</span> <span class="n">estimated_item</span><span class="o">.</span><span class="n">tags</span><span class="p">:</span>
                        <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">label</span><span class="p">][</span><span class="s1">&#39;Ntn&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="mi">1</span>

                    <span class="c1"># False positives (FP)</span>
                    <span class="k">if</span> <span class="n">label</span> <span class="ow">not</span> <span class="ow">in</span> <span class="n">reference_item</span><span class="o">.</span><span class="n">tags</span> <span class="ow">and</span> <span class="n">label</span> <span class="ow">in</span> <span class="n">estimated_item</span><span class="o">.</span><span class="n">tags</span><span class="p">:</span>
                        <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">label</span><span class="p">][</span><span class="s1">&#39;Nfp&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="mi">1</span>

                    <span class="c1"># False negatives (FN)</span>
                    <span class="k">if</span> <span class="n">label</span> <span class="ow">in</span> <span class="n">reference_item</span><span class="o">.</span><span class="n">tags</span> <span class="ow">and</span> <span class="n">label</span> <span class="ow">not</span> <span class="ow">in</span> <span class="n">estimated_item</span><span class="o">.</span><span class="n">tags</span><span class="p">:</span>
                        <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">label</span><span class="p">][</span><span class="s1">&#39;Nfn&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="mi">1</span>

                <span class="k">if</span> <span class="n">estimated_tag_probabilities</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                    <span class="c1"># Evaluate based on per tag probabilities</span>

                    <span class="n">estimated_item</span> <span class="o">=</span> <span class="n">estimated_tag_probabilities</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">filename</span><span class="o">=</span><span class="n">filename</span><span class="p">,</span> <span class="n">label</span><span class="o">=</span><span class="n">label</span><span class="p">)[</span><span class="mi">0</span><span class="p">]</span>
                    <span class="bp">self</span><span class="o">.</span><span class="n">y_pred_score</span><span class="p">[</span><span class="n">label</span><span class="p">]</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="nb">float</span><span class="p">(</span><span class="n">estimated_item</span><span class="p">[</span><span class="s1">&#39;probability&#39;</span><span class="p">]))</span>

        <span class="k">if</span> <span class="n">estimated_tag_list</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
            <span class="c1"># Evaluate based on estimated tags</span>

            <span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Nref&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="nb">sum</span><span class="p">(</span><span class="n">y_true</span><span class="p">)</span>
            <span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Nsys&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="nb">sum</span><span class="p">(</span><span class="n">y_pred</span><span class="p">)</span>

            <span class="n">y_true</span> <span class="o">=</span> <span class="n">numpy</span><span class="o">.</span><span class="n">array</span><span class="p">(</span><span class="n">y_true</span><span class="p">)</span>
            <span class="n">y_pred</span> <span class="o">=</span> <span class="n">numpy</span><span class="o">.</span><span class="n">array</span><span class="p">(</span><span class="n">y_pred</span><span class="p">)</span>

            <span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Ntp&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="nb">sum</span><span class="p">(</span><span class="n">y_pred</span> <span class="o">+</span> <span class="n">y_true</span> <span class="o">&gt;</span> <span class="mi">1</span><span class="p">)</span>
            <span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Ntn&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="nb">sum</span><span class="p">(</span><span class="n">y_pred</span> <span class="o">+</span> <span class="n">y_true</span> <span class="o">==</span> <span class="mi">0</span><span class="p">)</span>
            <span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Nfp&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="nb">sum</span><span class="p">(</span><span class="n">y_pred</span> <span class="o">-</span> <span class="n">y_true</span> <span class="o">&gt;</span> <span class="mi">0</span><span class="p">)</span>
            <span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Nfn&#39;</span><span class="p">]</span> <span class="o">+=</span> <span class="nb">sum</span><span class="p">(</span><span class="n">y_true</span> <span class="o">-</span> <span class="n">y_pred</span> <span class="o">&gt;</span> <span class="mi">0</span><span class="p">)</span>

        <span class="k">return</span> <span class="bp">self</span></div>

<div class="viewcode-block" id="AudioTaggingMetrics.reset"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.reset.html#sed_eval.audio_tag.AudioTaggingMetrics.reset">[docs]</a>    <span class="k">def</span> <span class="nf">reset</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;Reset internal state</span>
<span class="sd">        &quot;&quot;&quot;</span>
        <span class="bp">self</span><span class="o">.</span><span class="n">overall</span> <span class="o">=</span> <span class="p">{</span>
            <span class="s1">&#39;Nref&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Nsys&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Ntp&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Ntn&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Nfp&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="s1">&#39;Nfn&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
        <span class="p">}</span>

        <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span> <span class="o">=</span> <span class="p">{}</span>
        <span class="k">for</span> <span class="n">label</span> <span class="ow">in</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_label_list</span><span class="p">:</span>
            <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">label</span><span class="p">]</span> <span class="o">=</span> <span class="p">{</span>
                <span class="s1">&#39;Nref&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
                <span class="s1">&#39;Nsys&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
                <span class="s1">&#39;Ntp&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
                <span class="s1">&#39;Ntn&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
                <span class="s1">&#39;Nfp&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
                <span class="s1">&#39;Nfn&#39;</span><span class="p">:</span> <span class="mf">0.0</span><span class="p">,</span>
            <span class="p">}</span>

        <span class="k">return</span> <span class="bp">self</span></div>

    <span class="c1"># Results</span>
<div class="viewcode-block" id="AudioTaggingMetrics.results"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results.html#sed_eval.audio_tag.AudioTaggingMetrics.results">[docs]</a>    <span class="k">def</span> <span class="nf">results</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;All metrics</span>

<span class="sd">        Returns</span>
<span class="sd">        -------</span>
<span class="sd">        dict</span>
<span class="sd">            results in a dictionary format</span>

<span class="sd">        &quot;&quot;&quot;</span>

        <span class="n">results</span> <span class="o">=</span> <span class="p">{</span>
            <span class="s1">&#39;overall&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">results_overall_metrics</span><span class="p">(),</span>
            <span class="s1">&#39;class_wise&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">results_class_wise_metrics</span><span class="p">(),</span>
            <span class="s1">&#39;class_wise_average&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">results_class_wise_average_metrics</span><span class="p">(),</span>
        <span class="p">}</span>

        <span class="k">return</span> <span class="n">results</span></div>

<div class="viewcode-block" id="AudioTaggingMetrics.results_overall_metrics"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics.html#sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics">[docs]</a>    <span class="k">def</span> <span class="nf">results_overall_metrics</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;Overall metrics</span>

<span class="sd">        Returns</span>
<span class="sd">        -------</span>
<span class="sd">        dict</span>
<span class="sd">            results in a dictionary format</span>

<span class="sd">        &quot;&quot;&quot;</span>

        <span class="c1"># F-measure</span>
        <span class="k">if</span> <span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Nref&#39;</span><span class="p">]</span> <span class="o">&gt;</span> <span class="mi">0</span><span class="p">:</span>
            <span class="n">precision</span> <span class="o">=</span> <span class="n">metric</span><span class="o">.</span><span class="n">precision</span><span class="p">(</span>
                <span class="n">Ntp</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Ntp&#39;</span><span class="p">],</span>
                <span class="n">Nsys</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Nsys&#39;</span><span class="p">]</span>
            <span class="p">)</span>

            <span class="n">recall</span> <span class="o">=</span> <span class="n">metric</span><span class="o">.</span><span class="n">recall</span><span class="p">(</span>
                <span class="n">Ntp</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Ntp&#39;</span><span class="p">],</span>
                <span class="n">Nref</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Nref&#39;</span><span class="p">]</span>
            <span class="p">)</span>

            <span class="n">f_measure</span> <span class="o">=</span> <span class="n">metric</span><span class="o">.</span><span class="n">f_measure</span><span class="p">(</span>
                <span class="n">precision</span><span class="o">=</span><span class="n">precision</span><span class="p">,</span>
                <span class="n">recall</span><span class="o">=</span><span class="n">recall</span>
            <span class="p">)</span>

        <span class="k">else</span><span class="p">:</span>
            <span class="n">precision</span> <span class="o">=</span> <span class="kc">None</span>
            <span class="n">recall</span> <span class="o">=</span> <span class="kc">None</span>
            <span class="n">f_measure</span> <span class="o">=</span> <span class="kc">None</span>

        <span class="n">y_true</span> <span class="o">=</span> <span class="p">[]</span>
        <span class="n">y_score</span> <span class="o">=</span> <span class="p">[]</span>
        <span class="k">for</span> <span class="n">tag_id</span><span class="p">,</span> <span class="n">tag_label</span> <span class="ow">in</span> <span class="nb">enumerate</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">tag_label_list</span><span class="p">):</span>
            <span class="n">y_true</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">y_true</span><span class="p">[</span><span class="n">tag_label</span><span class="p">]</span>
            <span class="n">y_score</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">y_pred_score</span><span class="p">[</span><span class="n">tag_label</span><span class="p">]</span>

        <span class="k">if</span> <span class="n">y_score</span><span class="p">:</span>
            <span class="n">eer</span> <span class="o">=</span> <span class="n">metric</span><span class="o">.</span><span class="n">equal_error_rate</span><span class="p">(</span>
                <span class="n">y_true</span><span class="o">=</span><span class="n">y_true</span><span class="p">,</span>
                <span class="n">y_score</span><span class="o">=</span><span class="n">y_score</span>
            <span class="p">)</span>

        <span class="k">else</span><span class="p">:</span>
            <span class="n">eer</span> <span class="o">=</span> <span class="kc">None</span>

        <span class="k">return</span> <span class="p">{</span>
                <span class="s1">&#39;count&#39;</span><span class="p">:</span> <span class="p">{</span>
                    <span class="s1">&#39;Nref&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Nref&#39;</span><span class="p">],</span>
                    <span class="s1">&#39;Nsys&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Nsys&#39;</span><span class="p">],</span>
                <span class="p">},</span>
                <span class="s1">&#39;f_measure&#39;</span><span class="p">:</span> <span class="p">{</span>
                    <span class="s1">&#39;f_measure&#39;</span><span class="p">:</span> <span class="n">f_measure</span><span class="p">,</span>
                    <span class="s1">&#39;precision&#39;</span><span class="p">:</span> <span class="n">precision</span><span class="p">,</span>
                    <span class="s1">&#39;recall&#39;</span><span class="p">:</span> <span class="n">recall</span><span class="p">,</span>
                <span class="p">},</span>
                <span class="s1">&#39;eer&#39;</span><span class="p">:</span> <span class="p">{</span>
                    <span class="s1">&#39;eer&#39;</span><span class="p">:</span> <span class="n">eer</span>
                <span class="p">}</span>

        <span class="p">}</span></div>

<div class="viewcode-block" id="AudioTaggingMetrics.results_class_wise_metrics"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics.html#sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics">[docs]</a>    <span class="k">def</span> <span class="nf">results_class_wise_metrics</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;Class-wise metrics</span>

<span class="sd">        Returns</span>
<span class="sd">        -------</span>
<span class="sd">        dict</span>
<span class="sd">            results in a dictionary format</span>

<span class="sd">        &quot;&quot;&quot;</span>

        <span class="n">results</span> <span class="o">=</span> <span class="p">{}</span>
        <span class="k">for</span> <span class="n">tag_id</span><span class="p">,</span> <span class="n">tag_label</span> <span class="ow">in</span> <span class="nb">enumerate</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">tag_label_list</span><span class="p">):</span>
            <span class="k">if</span> <span class="n">tag_label</span> <span class="ow">not</span> <span class="ow">in</span> <span class="n">results</span><span class="p">:</span>
                <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">]</span> <span class="o">=</span> <span class="p">{}</span>

            <span class="c1"># Counts</span>
            <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;count&#39;</span><span class="p">]</span> <span class="o">=</span> <span class="p">{</span>
                <span class="s1">&#39;Nref&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Nref&#39;</span><span class="p">],</span>
                <span class="s1">&#39;Nsys&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Nsys&#39;</span><span class="p">],</span>
                <span class="s1">&#39;Ntp&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Ntp&#39;</span><span class="p">],</span>
                <span class="s1">&#39;Ntn&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Ntn&#39;</span><span class="p">],</span>
                <span class="s1">&#39;Nfp&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Nfp&#39;</span><span class="p">],</span>
                <span class="s1">&#39;Nfn&#39;</span><span class="p">:</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Nfn&#39;</span><span class="p">],</span>
            <span class="p">}</span>

            <span class="c1"># Equal error rate</span>
            <span class="k">if</span> <span class="bp">self</span><span class="o">.</span><span class="n">y_pred_score</span><span class="p">[</span><span class="n">tag_label</span><span class="p">]:</span>
                <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">]</span> <span class="o">=</span> <span class="p">{</span>
                    <span class="s1">&#39;eer&#39;</span><span class="p">:</span> <span class="n">metric</span><span class="o">.</span><span class="n">equal_error_rate</span><span class="p">(</span>
                        <span class="n">y_true</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">y_true</span><span class="p">[</span><span class="n">tag_label</span><span class="p">],</span>
                        <span class="n">y_score</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">y_pred_score</span><span class="p">[</span><span class="n">tag_label</span><span class="p">]</span>
                    <span class="p">)</span>
                <span class="p">}</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">]</span> <span class="o">=</span> <span class="p">{</span>
                    <span class="s1">&#39;eer&#39;</span><span class="p">:</span> <span class="kc">None</span>
                <span class="p">}</span>

            <span class="c1"># F-measure</span>
            <span class="k">if</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Nref&#39;</span><span class="p">]</span> <span class="o">&gt;</span> <span class="mi">0</span><span class="p">:</span>

                <span class="n">precision</span> <span class="o">=</span> <span class="n">metric</span><span class="o">.</span><span class="n">precision</span><span class="p">(</span>
                    <span class="n">Ntp</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Ntp&#39;</span><span class="p">],</span>
                    <span class="n">Nsys</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Nsys&#39;</span><span class="p">]</span>
                <span class="p">)</span>

                <span class="n">recall</span> <span class="o">=</span> <span class="n">metric</span><span class="o">.</span><span class="n">recall</span><span class="p">(</span>
                    <span class="n">Ntp</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Ntp&#39;</span><span class="p">],</span>
                    <span class="n">Nref</span><span class="o">=</span><span class="bp">self</span><span class="o">.</span><span class="n">tag_wise</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;Nref&#39;</span><span class="p">]</span>
                <span class="p">)</span>

                <span class="n">f_measure</span> <span class="o">=</span> <span class="n">metric</span><span class="o">.</span><span class="n">f_measure</span><span class="p">(</span><span class="n">precision</span><span class="o">=</span><span class="n">precision</span><span class="p">,</span> <span class="n">recall</span><span class="o">=</span><span class="n">recall</span><span class="p">)</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">precision</span> <span class="o">=</span> <span class="kc">None</span>
                <span class="n">recall</span> <span class="o">=</span> <span class="kc">None</span>
                <span class="n">f_measure</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">]</span> <span class="o">=</span> <span class="p">{</span>
                <span class="s1">&#39;f_measure&#39;</span><span class="p">:</span> <span class="n">f_measure</span><span class="p">,</span>
                <span class="s1">&#39;precision&#39;</span><span class="p">:</span> <span class="n">precision</span><span class="p">,</span>
                <span class="s1">&#39;recall&#39;</span><span class="p">:</span> <span class="n">recall</span><span class="p">,</span>
            <span class="p">}</span>

        <span class="k">return</span> <span class="n">results</span></div>

<div class="viewcode-block" id="AudioTaggingMetrics.results_class_wise_average_metrics"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics.html#sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics">[docs]</a>    <span class="k">def</span> <span class="nf">results_class_wise_average_metrics</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;Class-wise averaged metrics</span>

<span class="sd">        Returns</span>
<span class="sd">        -------</span>
<span class="sd">        dict</span>
<span class="sd">            results in a dictionary format</span>

<span class="sd">        &quot;&quot;&quot;</span>

        <span class="n">class_wise_results</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">results_class_wise_metrics</span><span class="p">()</span>

        <span class="n">class_wise_eer</span> <span class="o">=</span> <span class="p">[]</span>
        <span class="n">class_wise_fmeasure</span> <span class="o">=</span> <span class="p">[]</span>
        <span class="n">class_wise_precision</span> <span class="o">=</span> <span class="p">[]</span>
        <span class="n">class_wise_recall</span> <span class="o">=</span> <span class="p">[]</span>

        <span class="k">for</span> <span class="n">class_label</span> <span class="ow">in</span> <span class="n">class_wise_results</span><span class="p">:</span>
            <span class="k">if</span> <span class="n">class_wise_results</span><span class="p">[</span><span class="n">class_label</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">class_wise_eer</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="n">class_wise_results</span><span class="p">[</span><span class="n">class_label</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">])</span>

            <span class="k">if</span> <span class="n">class_wise_results</span><span class="p">[</span><span class="n">class_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">class_wise_fmeasure</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="n">class_wise_results</span><span class="p">[</span><span class="n">class_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">])</span>
                <span class="n">class_wise_precision</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="n">class_wise_results</span><span class="p">[</span><span class="n">class_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;precision&#39;</span><span class="p">])</span>
                <span class="n">class_wise_recall</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="n">class_wise_results</span><span class="p">[</span><span class="n">class_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;recall&#39;</span><span class="p">])</span>

        <span class="k">if</span> <span class="n">class_wise_eer</span><span class="p">:</span>
            <span class="n">eer</span> <span class="o">=</span> <span class="nb">float</span><span class="p">(</span><span class="n">numpy</span><span class="o">.</span><span class="n">nanmean</span><span class="p">(</span><span class="n">class_wise_eer</span><span class="p">))</span>

        <span class="k">else</span><span class="p">:</span>
            <span class="n">eer</span> <span class="o">=</span> <span class="kc">None</span>

        <span class="k">if</span> <span class="n">class_wise_fmeasure</span><span class="p">:</span>
            <span class="n">f_measure</span> <span class="o">=</span> <span class="nb">float</span><span class="p">(</span><span class="n">numpy</span><span class="o">.</span><span class="n">nanmean</span><span class="p">(</span><span class="n">class_wise_fmeasure</span><span class="p">))</span>

        <span class="k">else</span><span class="p">:</span>
            <span class="n">f_measure</span> <span class="o">=</span> <span class="kc">None</span>

        <span class="k">if</span> <span class="n">class_wise_precision</span><span class="p">:</span>
            <span class="n">precision</span> <span class="o">=</span> <span class="nb">float</span><span class="p">(</span><span class="n">numpy</span><span class="o">.</span><span class="n">nanmean</span><span class="p">(</span><span class="n">class_wise_precision</span><span class="p">))</span>

        <span class="k">else</span><span class="p">:</span>
            <span class="n">precision</span> <span class="o">=</span> <span class="kc">None</span>

        <span class="k">if</span> <span class="n">class_wise_recall</span><span class="p">:</span>
            <span class="n">recall</span> <span class="o">=</span> <span class="nb">float</span><span class="p">(</span><span class="n">numpy</span><span class="o">.</span><span class="n">nanmean</span><span class="p">(</span><span class="n">class_wise_recall</span><span class="p">))</span>

        <span class="k">else</span><span class="p">:</span>
            <span class="n">recall</span> <span class="o">=</span> <span class="kc">None</span>

        <span class="k">return</span> <span class="p">{</span>
            <span class="s1">&#39;eer&#39;</span><span class="p">:</span> <span class="p">{</span>
                <span class="s1">&#39;eer&#39;</span><span class="p">:</span> <span class="n">eer</span>
            <span class="p">},</span>
            <span class="s1">&#39;f_measure&#39;</span><span class="p">:</span> <span class="p">{</span>
                <span class="s1">&#39;f_measure&#39;</span><span class="p">:</span> <span class="n">f_measure</span><span class="p">,</span>
                <span class="s1">&#39;precision&#39;</span><span class="p">:</span> <span class="n">precision</span><span class="p">,</span>
                <span class="s1">&#39;recall&#39;</span><span class="p">:</span> <span class="n">recall</span><span class="p">,</span>
            <span class="p">}</span>
        <span class="p">}</span></div>

    <span class="c1"># Reports</span>
<div class="viewcode-block" id="AudioTaggingMetrics.result_report_parameters"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters.html#sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters">[docs]</a>    <span class="k">def</span> <span class="nf">result_report_parameters</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;Report metric parameters</span>

<span class="sd">        Returns</span>
<span class="sd">        -------</span>
<span class="sd">        str</span>
<span class="sd">            result report in string format</span>

<span class="sd">        &quot;&quot;&quot;</span>

        <span class="n">output</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">data</span><span class="p">(</span><span class="n">field</span><span class="o">=</span><span class="s1">&#39;Tags&#39;</span><span class="p">,</span> <span class="n">value</span><span class="o">=</span><span class="nb">len</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">tag_label_list</span><span class="p">))</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
        <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">data</span><span class="p">(</span><span class="n">field</span><span class="o">=</span><span class="s1">&#39;Evaluated units&#39;</span><span class="p">,</span> <span class="n">value</span><span class="o">=</span><span class="nb">int</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">overall</span><span class="p">[</span><span class="s1">&#39;Nref&#39;</span><span class="p">]))</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>

        <span class="k">return</span> <span class="n">output</span></div>

    <span class="k">def</span> <span class="nf">result_report_overall</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;Report overall results</span>

<span class="sd">        Returns</span>
<span class="sd">        -------</span>
<span class="sd">        str</span>
<span class="sd">            result report in string format</span>

<span class="sd">        &quot;&quot;&quot;</span>

        <span class="n">results</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">results_overall_metrics</span><span class="p">()</span>

        <span class="n">output</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">section_header</span><span class="p">(</span><span class="s1">&#39;Overall metrics (micro-average)&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">2</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>

        <span class="k">if</span> <span class="s1">&#39;f_measure&#39;</span> <span class="ow">in</span> <span class="n">results</span> <span class="ow">and</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">]:</span>

            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">f_measure</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">f_measure</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;precision&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">precision</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;precision&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">precision</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;recall&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">recall</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;recall&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">recall</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">line</span><span class="p">(</span><span class="s1">&#39;F-measure&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">2</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">data</span><span class="p">(</span><span class="n">field</span><span class="o">=</span><span class="s1">&#39;F-measure (F1)&#39;</span><span class="p">,</span> <span class="n">value</span><span class="o">=</span><span class="n">f_measure</span><span class="p">,</span> <span class="n">unit</span><span class="o">=</span><span class="s1">&#39;%&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">4</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">data</span><span class="p">(</span><span class="n">field</span><span class="o">=</span><span class="s1">&#39;Precision&#39;</span><span class="p">,</span> <span class="n">value</span><span class="o">=</span><span class="n">precision</span><span class="p">,</span> <span class="n">unit</span><span class="o">=</span><span class="s1">&#39;%&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">4</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">data</span><span class="p">(</span><span class="n">field</span><span class="o">=</span><span class="s1">&#39;Recall&#39;</span><span class="p">,</span> <span class="n">value</span><span class="o">=</span><span class="n">recall</span><span class="p">,</span> <span class="n">unit</span><span class="o">=</span><span class="s1">&#39;%&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">4</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>

        <span class="k">if</span> <span class="s1">&#39;eer&#39;</span> <span class="ow">in</span> <span class="n">results</span> <span class="ow">and</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;eer&#39;</span><span class="p">]:</span>
            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;eer&#39;</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">eer</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;eer&#39;</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">eer</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">line</span><span class="p">(</span><span class="s1">&#39;Equal error rate&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">2</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">data</span><span class="p">(</span><span class="n">field</span><span class="o">=</span><span class="s1">&#39;Equal error rate (EER)&#39;</span><span class="p">,</span> <span class="n">value</span><span class="o">=</span><span class="n">eer</span><span class="p">,</span> <span class="n">unit</span><span class="o">=</span><span class="s1">&#39;%&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">4</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>

        <span class="k">return</span> <span class="n">output</span>

<div class="viewcode-block" id="AudioTaggingMetrics.result_report_class_wise_average"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average.html#sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average">[docs]</a>    <span class="k">def</span> <span class="nf">result_report_class_wise_average</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;Report class-wise averages</span>

<span class="sd">        Returns</span>
<span class="sd">        -------</span>
<span class="sd">        str</span>
<span class="sd">            result report in string format</span>

<span class="sd">        &quot;&quot;&quot;</span>

        <span class="n">results</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">results_class_wise_average_metrics</span><span class="p">()</span>

        <span class="n">output</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">section_header</span><span class="p">(</span><span class="s1">&#39;Class-wise average metrics (macro-average)&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">2</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>

        <span class="k">if</span> <span class="s1">&#39;f_measure&#39;</span> <span class="ow">in</span> <span class="n">results</span> <span class="ow">and</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">]:</span>
            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">f_measure</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">f_measure</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;precision&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">precision</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;precision&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">precision</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;recall&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">recall</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;recall&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">recall</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">line</span><span class="p">(</span><span class="s1">&#39;F-measure&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">2</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">data</span><span class="p">(</span><span class="n">field</span><span class="o">=</span><span class="s1">&#39;F-measure (F1)&#39;</span><span class="p">,</span> <span class="n">value</span><span class="o">=</span><span class="n">f_measure</span><span class="p">,</span> <span class="n">unit</span><span class="o">=</span><span class="s1">&#39;%&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">4</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">data</span><span class="p">(</span><span class="n">field</span><span class="o">=</span><span class="s1">&#39;Precision&#39;</span><span class="p">,</span> <span class="n">value</span><span class="o">=</span><span class="n">precision</span><span class="p">,</span> <span class="n">unit</span><span class="o">=</span><span class="s1">&#39;%&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">4</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">data</span><span class="p">(</span><span class="n">field</span><span class="o">=</span><span class="s1">&#39;Recall&#39;</span><span class="p">,</span> <span class="n">value</span><span class="o">=</span><span class="n">recall</span><span class="p">,</span> <span class="n">unit</span><span class="o">=</span><span class="s1">&#39;%&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">4</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>

        <span class="k">if</span> <span class="s1">&#39;eer&#39;</span> <span class="ow">in</span> <span class="n">results</span> <span class="ow">and</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;eer&#39;</span><span class="p">]:</span>
            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;eer&#39;</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">eer</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="s1">&#39;eer&#39;</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">eer</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">line</span><span class="p">(</span><span class="s1">&#39;Equal error rate&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">2</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">data</span><span class="p">(</span><span class="n">field</span><span class="o">=</span><span class="s1">&#39;Equal error rate (EER)&#39;</span><span class="p">,</span> <span class="n">value</span><span class="o">=</span><span class="n">eer</span><span class="p">,</span> <span class="n">unit</span><span class="o">=</span><span class="s1">&#39;%&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">4</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>

        <span class="k">return</span> <span class="n">output</span></div>

<div class="viewcode-block" id="AudioTaggingMetrics.result_report_class_wise"><a class="viewcode-back" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise.html#sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise">[docs]</a>    <span class="k">def</span> <span class="nf">result_report_class_wise</span><span class="p">(</span><span class="bp">self</span><span class="p">):</span>
        <span class="sd">&quot;&quot;&quot;Report class-wise results</span>

<span class="sd">        Returns</span>
<span class="sd">        -------</span>
<span class="sd">        str</span>
<span class="sd">            result report in string format</span>

<span class="sd">        &quot;&quot;&quot;</span>

        <span class="n">results</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">results_class_wise_metrics</span><span class="p">()</span>

        <span class="n">output</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">section_header</span><span class="p">(</span><span class="s1">&#39;Class-wise metrics&#39;</span><span class="p">,</span> <span class="n">indent</span><span class="o">=</span><span class="mi">2</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
        <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">row</span><span class="p">(</span>
            <span class="s1">&#39;Tag&#39;</span><span class="p">,</span> <span class="s1">&#39;Nref&#39;</span><span class="p">,</span> <span class="s1">&#39;Nsys&#39;</span><span class="p">,</span> <span class="s1">&#39;F-score&#39;</span><span class="p">,</span> <span class="s1">&#39;Pre&#39;</span><span class="p">,</span> <span class="s1">&#39;Rec&#39;</span><span class="p">,</span> <span class="s1">&#39;EER&#39;</span><span class="p">,</span>
            <span class="n">widths</span><span class="o">=</span><span class="p">[</span><span class="mi">20</span><span class="p">,</span> <span class="mi">12</span><span class="p">,</span> <span class="mi">12</span><span class="p">,</span> <span class="mi">12</span><span class="p">,</span> <span class="mi">12</span><span class="p">,</span> <span class="mi">12</span><span class="p">,</span> <span class="mi">12</span><span class="p">],</span>
            <span class="n">separators</span><span class="o">=</span><span class="p">[</span><span class="kc">True</span><span class="p">,</span> <span class="kc">False</span><span class="p">,</span> <span class="kc">True</span><span class="p">,</span> <span class="kc">False</span><span class="p">,</span> <span class="kc">False</span><span class="p">,</span> <span class="kc">True</span><span class="p">,</span> <span class="kc">False</span><span class="p">],</span>
            <span class="n">indent</span><span class="o">=</span><span class="mi">4</span>
        <span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>
        <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">row</span><span class="p">(</span><span class="s1">&#39;-&#39;</span><span class="p">,</span> <span class="s1">&#39;-&#39;</span><span class="p">,</span> <span class="s1">&#39;-&#39;</span><span class="p">,</span> <span class="s1">&#39;-&#39;</span><span class="p">,</span> <span class="s1">&#39;-&#39;</span><span class="p">,</span> <span class="s1">&#39;-&#39;</span><span class="p">,</span> <span class="s1">&#39;-&#39;</span><span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>

        <span class="k">for</span> <span class="n">tag_label</span> <span class="ow">in</span> <span class="bp">self</span><span class="o">.</span><span class="n">tag_label_list</span><span class="p">:</span>
            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">f_measure</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">f_measure</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;precision&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">precision</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;precision&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">precision</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;recall&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">recall</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;f_measure&#39;</span><span class="p">][</span><span class="s1">&#39;recall&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">recall</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="k">if</span> <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">]</span> <span class="ow">is</span> <span class="ow">not</span> <span class="kc">None</span><span class="p">:</span>
                <span class="n">eer</span> <span class="o">=</span> <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">][</span><span class="s1">&#39;eer&#39;</span><span class="p">]</span> <span class="o">*</span> <span class="mi">100</span>

            <span class="k">else</span><span class="p">:</span>
                <span class="n">eer</span> <span class="o">=</span> <span class="kc">None</span>

            <span class="n">output</span> <span class="o">+=</span> <span class="bp">self</span><span class="o">.</span><span class="n">ui</span><span class="o">.</span><span class="n">row</span><span class="p">(</span>
                <span class="n">tag_label</span><span class="p">,</span>
                <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;count&#39;</span><span class="p">][</span><span class="s1">&#39;Nref&#39;</span><span class="p">],</span>
                <span class="n">results</span><span class="p">[</span><span class="n">tag_label</span><span class="p">][</span><span class="s1">&#39;count&#39;</span><span class="p">][</span><span class="s1">&#39;Nsys&#39;</span><span class="p">],</span>
                <span class="n">f_measure</span><span class="p">,</span>
                <span class="n">precision</span><span class="p">,</span>
                <span class="n">recall</span><span class="p">,</span>
                <span class="n">eer</span><span class="p">,</span>
                <span class="n">types</span><span class="o">=</span><span class="p">[</span><span class="s1">&#39;str&#39;</span><span class="p">,</span> <span class="s1">&#39;int&#39;</span><span class="p">,</span> <span class="s1">&#39;int&#39;</span><span class="p">,</span> <span class="s1">&#39;float1_percentage&#39;</span><span class="p">,</span> <span class="s1">&#39;float1&#39;</span><span class="p">,</span> <span class="s1">&#39;float1&#39;</span><span class="p">,</span> <span class="s1">&#39;float1_percentage&#39;</span><span class="p">]</span>
            <span class="p">)</span> <span class="o">+</span> <span class="s1">&#39;</span><span class="se">\n</span><span class="s1">&#39;</span>

        <span class="k">return</span> <span class="n">output</span></div></div>
</pre></div>

           </div>
           <div class="articleComments">
            
           </div>
          </div>
          <footer>
  

  <hr/>

  <div role="contentinfo">
    <p>
        &copy; Copyright 2018, Toni Heittola et al..

    </p>
  </div> 

</footer>

        </div>
      </div>

    </section>

  </div>
  


  

    <script type="text/javascript">
        var DOCUMENTATION_OPTIONS = {
            URL_ROOT:'../../',
            VERSION:'0.1',
            COLLAPSE_INDEX:false,
            FILE_SUFFIX:'.html',
            HAS_SOURCE:  true,
            SOURCELINK_SUFFIX: '.txt'
        };
    </script>
      <script type="text/javascript" src="../../_static/jquery.js"></script>
      <script type="text/javascript" src="../../_static/underscore.js"></script>
      <script type="text/javascript" src="../../_static/doctools.js"></script>
      <script type="text/javascript" src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script>

  

  
  
    <script type="text/javascript" src="../../_static/js/theme.js"></script>
  

  
  
  <script type="text/javascript">
      jQuery(function () {
          SphinxRtdTheme.StickyNav.enable();
      });
  </script>
   

</body>
</html>

================================================
FILE: docs/_modules/sed_eval/io.html
================================================


<!DOCTYPE html>
<!--[if IE 8]><html class="no-js lt-ie9" lang="en" > <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js" lang="en" > <!--<![endif]-->
<head>
  <meta charset="utf-8">
  
  <meta name="viewport" content="width=device-width, initial-scale=1.0">
  
  <title>sed_eval.io &mdash; sed_eval 0.1 documentation</title>
  

  
  
  
  

  

  
  
    

  

  
  
    <link rel="stylesheet" href="../../_static/css/theme.css" type="text/css" />
  

  
    <link rel="stylesheet" href="../../_static/theme_overrides.css" type="text/css" />
  

  
        <link rel="index" title="Index"
              href="../../genindex.html"/>
        <link rel="search" title="Search" href="../../search.html"/>
    <link rel="top" title="sed_eval 0.1 documentation" href="../../index.html"/>
        <link rel="up" title="Module code" href="../index.html"/> 

  
  <script src="../../_static/js/modernizr.min.js"></script>

</head>

<body class="wy-body-for-nav" role="document">

   
  <div class="wy-grid-for-nav">

    
    <nav data-toggle="wy-nav-shift" class="wy-nav-side">
      <div class="wy-side-scroll">
        <div class="wy-side-nav-search">
          

          
            <a href="../../index.html" class="icon icon-home"> sed_eval
          

          
            
            <img src="../../_static/sed_eval_logo.png" class="logo" />
          
          </a>

          

          
<div role="search">
  <form id="rtd-search-form" class="wy-form" action="../../search.html" method="get">
    <input type="text" name="q" placeholder="Search docs" />
    <input type="hidden" name="check_keywords" value="yes" />
    <input type="hidden" name="area" value="default" />
  </form>
</div>

          
        </div>

        <div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="main navigation">
          
            
            
              
            
            
              <ul>
<li class="toctree-l1"><a class="reference internal" href="../../install.html">Installation instructions</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../install.html#using-pip">Using pip</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../install.html#using-setyp-py">Using <code class="docutils literal"><span class="pre">setyp.py</span></code></a></li>
<li class="toctree-l2"><a class="reference internal" href="../../install.html#requirements">Requirements</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../tutorial.html">Tutorial</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../tutorial.html#sed-eval-evaluation-toolbox-for-sound-event-detection"><code class="docutils literal"><span class="pre">sed_eval</span></code> &#8211; Evaluation toolbox for Sound Event Detection</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorial.html#quickstart-using-the-evaluators">Quickstart: Using the evaluators</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#sound-event-detection">Sound event detection</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#acoustic-scene-classification">Acoustic scene classification</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorial.html#quickstart-using-sed-eval-in-python-code">Quickstart: Using <code class="docutils literal"><span class="pre">sed_eval</span></code> in Python code</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#id1">Sound event detection</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#id2">Acoustic scene classification</a></li>
</ul>
</li>
</ul>
</li>
</ul>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../../sound_event.html">Sound Event Detection</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#intermediate-statistics">Intermediate statistics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#segment-based">Segment-based</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#event-based">Event-based</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#averaging">Averaging</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#cross-validation">Cross-validation</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#implemented-metrics">Implemented metrics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#precision-recall-and-f-score">Precision, Recall and F-score</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#sensitivity-and-specificity">Sensitivity and specificity</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#accuracy">Accuracy</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#balanced-accuracy">Balanced accuracy</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#error-rate">Error Rate</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#module-sed_eval.sound_event">Code</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#segment-based-metrics">Segment based metrics</a><ul>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.html">sed_eval.sound_event.SegmentBasedMetrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.evaluate.html">sed_eval.sound_event.SegmentBasedMetrics.evaluate</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results.html">sed_eval.sound_event.SegmentBasedMetrics.results</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_overall.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_overall</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.reset.html">sed_eval.sound_event.SegmentBasedMetrics.reset</a></li>
</ul>
</li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#event-based-metrics">Event based metrics</a><ul>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.html">sed_eval.sound_event.EventBasedMetrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.evaluate.html">sed_eval.sound_event.EventBasedMetrics.evaluate</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results.html">sed_eval.sound_event.EventBasedMetrics.results</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results_overall_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_overall_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.result_report_parameters.html">sed_eval.sound_event.EventBasedMetrics.result_report_parameters</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.result_report_overall.html">sed_eval.sound_event.EventBasedMetrics.result_report_overall</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.result_report_class_wise.html">sed_eval.sound_event.EventBasedMetrics.result_report_class_wise</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average.html">sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.reset.html">sed_eval.sound_event.EventBasedMetrics.reset</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#rerefences">Rerefences</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../scene.html">Acoustic Scene Classification</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../scene.html#metrics">Metrics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.html">sed_eval.scene.SceneClassificationMetrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.evaluate.html">sed_eval.scene.SceneClassificationMetrics.evaluate</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.results.html">sed_eval.scene.SceneClassificationMetrics.results</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.results_overall_metrics.html">sed_eval.scene.SceneClassificationMetrics.results_overall_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics.html">sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics.html">sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.result_report_parameters.html">sed_eval.scene.SceneClassificationMetrics.result_report_parameters</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.result_report_class_wise.html">sed_eval.scene.SceneClassificationMetrics.result_report_class_wise</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average.html">sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.scene.SceneClassificationMetrics.reset.html">sed_eval.scene.SceneClassificationMetrics.reset</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../audio_tag.html">Audio Tagging</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../audio_tag.html#metrics">Metrics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.html">sed_eval.audio_tag.AudioTaggingMetrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.evaluate.html">sed_eval.audio_tag.AudioTaggingMetrics.evaluate</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results.html">sed_eval.audio_tag.AudioTaggingMetrics.results</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics.html">sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics.html">sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics.html">sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters.html">sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise.html">sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average.html">sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.audio_tag.AudioTaggingMetrics.reset.html">sed_eval.audio_tag.AudioTaggingMetrics.reset</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../metric.html">Metrics</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.f_measure.html">sed_eval.metric.f_measure</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.precision.html">sed_eval.metric.precision</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.recall.html">sed_eval.metric.recall</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.accuracy.html">sed_eval.metric.accuracy</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.accuracy2.html">sed_eval.metric.accuracy2</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.balanced_accuracy.html">sed_eval.metric.balanced_accuracy</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.sensitivity.html">sed_eval.metric.sensitivity</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.specificity.html">sed_eval.metric.specificity</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.error_rate.html">sed_eval.metric.error_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.substitution_rate.html">sed_eval.metric.substitution_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.deletion_rate.html">sed_eval.metric.deletion_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.insertion_rate.html">sed_eval.metric.insertion_rate</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.metric.equal_error_rate.html">sed_eval.metric.equal_error_rate</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../test.html">Tests</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.test.mcnemar.html">sed_eval.test.mcnemar</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../util.html">Utilities</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../util.html#event-list-operations">Event list operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_list.unique_event_labels.html">sed_eval.util.event_list.unique_event_labels</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_list.unique_files.html">sed_eval.util.event_list.unique_files</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_list.filter_event_list.html">sed_eval.util.event_list.filter_event_list</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_list.max_event_offset.html">sed_eval.util.event_list.max_event_offset</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../util.html#event-roll-operations">Event roll operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_roll.event_list_to_event_roll.html">sed_eval.util.event_roll.event_list_to_event_roll</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_roll.pad_event_roll.html">sed_eval.util.event_roll.pad_event_roll</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_roll.match_event_roll_lengths.html">sed_eval.util.event_roll.match_event_roll_lengths</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../util.html#scene-list-operations">Scene list operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.scene_list.unique_scene_labels.html">sed_eval.util.scene_list.unique_scene_labels</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../util.html#event-matching-operations">Event matching operations</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../generated/sed_eval.util.event_matching.bipartite_match.html">sed_eval.util.event_matching.bipartite_match</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../io.html">I/O</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.io.load_event_list.html">sed_eval.io.load_event_list</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.io.load_scene_list.html">sed_eval.io.load_scene_list</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../generated/sed_eval.io.load_file_pair_list.html">sed_eval.io.load_file_pair_list</a></li>
</ul>
</li>
</ul>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../../glossary.html">Glossary</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../changelog.html">Changes</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-2-0">v0.2.0</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-1-4">v0.1.4</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-1-3">v0.1.3</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-1-2">v0.1.2</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-1-1">v0.1.1</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../changelog.html#v0-1-0">v0.1.0</a></li>
</ul>
</li>
</ul>

            
          
        </div>
      </div>
    </nav>

    <section data-toggle="wy-nav-shift" class="wy-nav-content-wrap">

      
      <nav class="wy-nav-top" role="navigation" aria-label="top navigation">
        
          <i data-toggle="wy-nav-top" class="fa fa-bars"></i>
          <a href="../../index.html">sed_eval</a>
        
      </nav>


      
      <div class="wy-nav-content">
        <div class="rst-content">
          















<div role="navigation" aria-label="breadcrumbs navigation">

  <ul class="wy-breadcrumbs">
    
      <li><a href="../../index.html">Docs</a> &raquo;</li>
        
          <li><a href="../index.html">Module code</a> &raquo;</li>
        
      <li>sed_eval.io</li>
    
    
      <li class="wy-breadcrumbs-aside">
        
            
        
      </li>
    
  </ul>

  
  <hr/>
</div>
          <div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
           <div itemprop="articleBody">
            
  <h1>Source code for sed_eval.io</h1><div class="highlight"><pre>
<span></span><span class="ch">#!/usr/bin/env python</span>
<span class="c1"># -*- coding: utf-8 -*-</span>
<span class="sd">&quot;&quot;&quot;</span>
<span class="sd">I/O</span>
<span class="sd">==================</span>
<span class="sd">Functions for loading annotations from files in various formats.</span>

<span class="sd">.. autosummary::</span>
<span class="sd">    :toctree: generated/</span>

<span class="sd">    load_event_list</span>
<span class="sd">    load_scene_list</span>
<span class="sd">    load_file_pair_list</span>

<span class="sd">&quot;&quot;&quot;</span>

<span class="kn">from</span> <span class="nn">__future__</span> <span class="k">import</span> <span class="n">absolute_import</span>
<span class="kn">import</span> <span class="nn">csv</span>
<span class="kn">import</span> <span class="nn">dcase_util</span>


<div class="viewcode-block" id="load_event_list"><a class="viewcode-back" href="../../generated/sed_eval.io.load_event_list.html#sed_eval.io.load_event_list">[docs]</a><span class="k">def</span> <span class="nf">load_event_list</span><span class="p">(</span><span class="n">filename</span><span class="p">,</span> <span class="o">**</span><span class="n">kwargs</span><span class="p">):</span>
    <span class="sd">&quot;&quot;&quot;Load event list from csv formatted text-file</span>

<span class="sd">    Supported formats (see more `dcase_util.containers.MetaDataContainer.load()` method):</span>

<span class="sd">    - [event onset (float &gt;= 0)][delimiter][event offset (float &gt;= 0)]</span>
<span class="sd">    - [event onset (float &gt;= 0)][delimiter][event offset (float &gt;= 0)][delimiter][label]</span>
<span class="sd">    - [filename][delimiter][event onset (float &gt;= 0)][delimiter][event offset (float &gt;= 0)][delimiter][event label]</span>
<span class="sd">    - [filename][delimiter][scene_label][delimiter][event onset (float &gt;= 0)][delimiter][event offset (float &gt;= 0)][delimiter][event label]</span>
<span class="sd">    - [filename]</span>

<span class="sd">    Supported delimiters: ``,``, ``;``, ``tab``</span>

<span class="sd">    Example of event list file::</span>

<span class="sd">        21.64715	23.00552	alert</span>
<span class="sd">        36.91184	38.27021	alert</span>
<span class="sd">        69.72575	71.09029	alert</span>
<span class="sd">        63.53990	64.89827	alert</span>
<span class="sd">        84.25553	84.83920	alert</span>
<span class="sd">        20.92974	21.82661	clearthroat</span>
<span class="sd">        28.39992	29.29679	clearthroat</span>
<span class="sd">        80.47837	81.95937	clearthroat</span>
<span class="sd">        44.48363	45.96463	clearthroat</span>
<span class="sd">        78.13073	79.05953	clearthroat</span>
<span class="sd">        15.17031	16.27235	cough</span>
<span class="sd">        20.54931	21.65135	cough</span>
<span class="sd">        27.79964	28.90168	cough</span>
<span class="sd">        75.45959	76.32490	cough</span>
<span class="sd">        70.81708	71.91912	cough</span>
<span class="sd">        21.23203	22.55902	doorslam</span>
<span class="sd">        7.546220	9.014880	doorslam</span>
<span class="sd">        34.11303	35.04183	doorslam</span>
<span class="sd">        45.86001	47.32867	doorslam</span>


<span class="sd">    Parameters</span>
<span class="sd">    ----------</span>
<span class="sd">    filename : str</span>
<span class="sd">        Path to the csv-file</span>

<span class="sd">    Returns</span>
<span class="sd">    -------</span>
<span class="sd">    list of dict</span>
<span class="sd">        Event list</span>

<span class="sd">    &quot;&quot;&quot;</span>

    <span class="k">return</span> <span class="n">dcase_util</span><span class="o">.</span><span class="n">containers</span><span class="o">.</span><span class="n">MetaDataContainer</span><span class="p">()</span><span class="o">.</span><span class="n">load</span><span class="p">(</span><span class="n">filename</span><span class="o">=</span><span class="n">filename</span><span class="p">,</span> <span class="o">**</span><span class="n">kwargs</span><span class="p">)</span></div>


<div class="viewcode-block" id="load_scene_list"><a class="viewcode-back" href="../../generated/sed_eval.io.load_scene_list.html#sed_eval.io.load_scene_list">[docs]</a><span class="k">def</span> <span class="nf">load_scene_list</span><span class="p">(</span><span class="n">filename</span><span class="p">,</span> <span class="o">**</span><span class="n">kwargs</span><span class="p">):</span>
    <span class="sd">&quot;&quot;&quot;Load scene list from csv formatted text-file</span>

<span class="sd">    Supported formats (see more `dcase_util.containers.MetaDataContainer.load()` method):</span>

<span class="sd">    - [filename][delimiter][scene label]</span>
<span class="sd">    - [filename][delimiter][segment start (float &gt;= 0)][delimiter][segment stop (float &gt;= 0)][delimiter][scene label]</span>

<span class="sd">    Supported delimiters: ``,``, ``;``, ``tab``</span>

<span class="sd">    Example of scene list file::</span>

<span class="sd">        scenes_stereo/supermarket09.wav	supermarket</span>
<span class="sd">        scenes_stereo/tubestation10.wav	tubestation</span>
<span class="sd">        scenes_stereo/quietstreet08.wav	quietstreet</span>
<span class="sd">        scenes_stereo/restaurant05.wav	restaurant</span>
<span class="sd">        scenes_stereo/busystreet05.wav	busystreet</span>
<span class="sd">        scenes_stereo/openairmarket04.wav	openairmarket</span>
<span class="sd">        scenes_stereo/quietstreet01.wav	quietstreet</span>
<span class="sd">        scenes_stereo/supermarket05.wav	supermarket</span>
<span class="sd">        scenes_stereo/openairmarket01.wav	openairmarket</span>

<span class="sd">    Parameters</span>
<span class="sd">    ----------</span>
<span class="sd">    filename : str</span>
<span class="sd">        Path to the csv-file</span>

<span class="sd">    Returns</span>
<span class="sd">    -------</span>
<span class="sd">    list of dict</span>
<span class="sd">        Scene list</span>

<span class="sd">    &quot;&quot;&quot;</span>

    <span class="k">return</span> <span class="n">dcase_util</span><span class="o">.</span><span class="n">containers</span><span class="o">.</span><span class="n">MetaDataContainer</span><span class="p">()</span><span class="o">.</span><span class="n">load</span><span class="p">(</span><span class="n">filename</span><span class="o">=</span><span class="n">filename</span><span class="p">,</span> <span class="o">**</span><span class="n">kwargs</span><span class="p">)</span></div>


<div class="viewcode-block" id="load_file_pair_list"><a class="viewcode-back" href="../../generated/sed_eval.io.load_file_pair_list.html#sed_eval.io.load_file_pair_list">[docs]</a><span class="k">def</span> <span class="nf">load_file_pair_list</span><span class="p">(</span><span class="n">filename</span><span class="p">):</span>
    <span class="sd">&quot;&quot;&quot;Load file pair list csv formatted text-file</span>

<span class="sd">    Format is [reference_file][delimiter][estimated_file]</span>

<span class="sd">    Supported delimiters: ``,``, ``;``, ``tab``</span>

<span class="sd">    Example of file-list::</span>

<span class="sd">        office_snr0_high_v2.txt	office_snr0_high_v2_detected.txt</span>
<span class="sd">        office_snr0_med_v2.txt	office_snr0_med_v2_detected.txt</span>

<span class="sd">    Parameters</span>
<span class="sd">    ----------</span>
<span class="sd">    filename : str</span>
<span class="sd">        Path to the csv-file</span>

<span class="sd">    Returns</span>
<span class="sd">    -------</span>
<span class="sd">    file_list: list</span>
<span class="sd">        File pair dicts in a list</span>

<span class="sd">    &quot;&quot;&quot;</span>

    <span class="n">data</span> <span class="o">=</span> <span class="p">[]</span>

    <span class="n">input_file</span> <span class="o">=</span> <span class="nb">open</span><span class="p">(</span><span class="n">filename</span><span class="p">,</span> <span class="s1">&#39;rt&#39;</span><span class="p">)</span>

    <span class="k">try</span><span class="p">:</span>
        <span class="n">dialect</span> <span class="o">=</span> <span class="n">csv</span><span class="o">.</span><span class="n">Sniffer</span><span class="p">()</span><span class="o">.</span><span class="n">sniff</span><span class="p">(</span><span class="n">input_file</span><span class="o">.</span><span class="n">readline</span><span class="p">(),</span> <span class="p">[</span><span class="s1">&#39;,&#39;</span><span class="p">,</span> <span class="s1">&#39;;&#39;</span><span class="p">,</span> <span class="s1">&#39;</span><span class="se">\t</span><span class="s1">&#39;</span><span class="p">])</span>

    <span class="k">except</span> <span class="n">csv</span><span class="o">.</span><span class="n">Error</span><span class="p">:</span>
        <span class="k">raise</span> <span class="ne">ValueError</span><span class="p">(</span><span class="s1">&#39;Unknown delimiter in file [</span><span class="si">{file}</span><span class="s1">].&#39;</span><span class="o">.</span><span class="n">format</span><span class="p">(</span><span class="n">file</span><span class="o">=</span><span class="n">filename</span><span class="p">))</span>

    <span class="n">input_file</span><span class="o">.</span><span class="n">seek</span><span class="p">(</span><span class="mi">0</span><span class="p">)</span>  

    <span class="k">for</span> <span class="n">row</span> <span class="ow">in</span> <span class="n">csv</span><span class="o">.</span><span class="n">reader</span><span class="p">(</span><span class="n">input_file</span><span class="p">,</span> <span class="n">dialect</span><span class="p">):</span>
        <span class="k">if</span> <span class="nb">len</span><span class="p">(</span><span class="n">row</span><span class="p">)</span> <span class="o">==</span> <span class="mi">2</span><span class="p">:</span>
            <span class="n">data</span><span class="o">.</span><span class="n">append</span><span class="p">(</span>
                <span class="p">{</span>
                    <span class="s1">&#39;reference_file&#39;</span><span class="p">:</span> <span class="n">row</span><span class="p">[</span><span class="mi">0</span><span class="p">],</span>
                    <span class="s1">&#39;estimated_file&#39;</span><span class="p">:</span> <span class="n">row</span><span class="p">[</span><span class="mi">1</span><span class="p">]</span>
                <span class="p">}</span>
            <span class="p">)</span>

        <span class="k">else</span><span class="p">:</span>
            <span class="k">raise</span> <span class="ne">ValueError</span><span class="p">(</span><span class="s1">&#39;Unknown file pair list format in file [</span><span class="si">{file}</span><span class="s1">].&#39;</span><span class="o">.</span><span class="n">format</span><span class="p">(</span><span class="n">file</span><span class="o">=</span><span class="n">filename</span><span class="p">))</span>

    <span class="n">input_file</span><span class="o">.</span><span class="n">close</span><span class="p">()</span>

    <span class="k">return</span> <span class="n">data</span></div>

</pre></div>

           </div>
           <div class="articleComments">
            
           </div>
          </div>
          <footer>
  

  <hr/>

  <div role="contentinfo">
    <p>
        &copy; Copyright 2018, Toni Heittola et al..

    </p>
  </div> 

</footer>

        </div>
      </div>

    </section>

  </div>
  


  

    <script type="text/javascript">
        var DOCUMENTATION_OPTIONS = {
            URL_ROOT:'../../',
            VERSION:'0.1',
            COLLAPSE_INDEX:false,
            FILE_SUFFIX:'.html',
            HAS_SOURCE:  true,
            SOURCELINK_SUFFIX: '.txt'
        };
    </script>
      <script type="text/javascript" src="../../_static/jquery.js"></script>
      <script type="text/javascript" src="../../_static/underscore.js"></script>
      <script type="text/javascript" src="../../_static/doctools.js"></script>
      <script type="text/javascript" src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script>

  

  
  
    <script type="text/javascript" src="../../_static/js/theme.js"></script>
  

  
  
  <script type="text/javascript">
      jQuery(function () {
          SphinxRtdTheme.StickyNav.enable();
      });
  </script>
   

</body>
</html>

================================================
FILE: docs/_modules/sed_eval/metric.html
================================================


<!DOCTYPE html>
<!--[if IE 8]><html class="no-js lt-ie9" lang="en" > <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js" lang="en" > <!--<![endif]-->
<head>
  <meta charset="utf-8">
  
  <meta name="viewport" content="width=device-width, initial-scale=1.0">
  
  <title>sed_eval.metric &mdash; sed_eval 0.1 documentation</title>
  

  
  
  
  

  

  
  
    

  

  
  
    <link rel="stylesheet" href="../../_static/css/theme.css" type="text/css" />
  

  
    <link rel="stylesheet" href="../../_static/theme_overrides.css" type="text/css" />
  

  
        <link rel="index" title="Index"
              href="../../genindex.html"/>
        <link rel="search" title="Search" href="../../search.html"/>
    <link rel="top" title="sed_eval 0.1 documentation" href="../../index.html"/>
        <link rel="up" title="Module code" href="../index.html"/> 

  
  <script src="../../_static/js/modernizr.min.js"></script>

</head>

<body class="wy-body-for-nav" role="document">

   
  <div class="wy-grid-for-nav">

    
    <nav data-toggle="wy-nav-shift" class="wy-nav-side">
      <div class="wy-side-scroll">
        <div class="wy-side-nav-search">
          

          
            <a href="../../index.html" class="icon icon-home"> sed_eval
          

          
            
            <img src="../../_static/sed_eval_logo.png" class="logo" />
          
          </a>

          

          
<div role="search">
  <form id="rtd-search-form" class="wy-form" action="../../search.html" method="get">
    <input type="text" name="q" placeholder="Search docs" />
    <input type="hidden" name="check_keywords" value="yes" />
    <input type="hidden" name="area" value="default" />
  </form>
</div>

          
        </div>

        <div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="main navigation">
          
            
            
              
            
            
              <ul>
<li class="toctree-l1"><a class="reference internal" href="../../install.html">Installation instructions</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../install.html#using-pip">Using pip</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../install.html#using-setyp-py">Using <code class="docutils literal"><span class="pre">setyp.py</span></code></a></li>
<li class="toctree-l2"><a class="reference internal" href="../../install.html#requirements">Requirements</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../tutorial.html">Tutorial</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../tutorial.html#sed-eval-evaluation-toolbox-for-sound-event-detection"><code class="docutils literal"><span class="pre">sed_eval</span></code> &#8211; Evaluation toolbox for Sound Event Detection</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorial.html#quickstart-using-the-evaluators">Quickstart: Using the evaluators</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#sound-event-detection">Sound event detection</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#acoustic-scene-classification">Acoustic scene classification</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorial.html#quickstart-using-sed-eval-in-python-code">Quickstart: Using <code class="docutils literal"><span class="pre">sed_eval</span></code> in Python code</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#id1">Sound event detection</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../tutorial.html#id2">Acoustic scene classification</a></li>
</ul>
</li>
</ul>
</li>
</ul>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../../sound_event.html">Sound Event Detection</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#intermediate-statistics">Intermediate statistics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#segment-based">Segment-based</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#event-based">Event-based</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#averaging">Averaging</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#cross-validation">Cross-validation</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#implemented-metrics">Implemented metrics</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#precision-recall-and-f-score">Precision, Recall and F-score</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#sensitivity-and-specificity">Sensitivity and specificity</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#accuracy">Accuracy</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#balanced-accuracy">Balanced accuracy</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#error-rate">Error Rate</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../sound_event.html#module-sed_eval.sound_event">Code</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#segment-based-metrics">Segment based metrics</a><ul>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.html">sed_eval.sound_event.SegmentBasedMetrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.evaluate.html">sed_eval.sound_event.SegmentBasedMetrics.evaluate</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results.html">sed_eval.sound_event.SegmentBasedMetrics.results</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics.html">sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_overall.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_overall</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average.html">sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.SegmentBasedMetrics.reset.html">sed_eval.sound_event.SegmentBasedMetrics.reset</a></li>
</ul>
</li>
<li class="toctree-l3"><a class="reference internal" href="../../sound_event.html#event-based-metrics">Event based metrics</a><ul>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.html">sed_eval.sound_event.EventBasedMetrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.evaluate.html">sed_eval.sound_event.EventBasedMetrics.evaluate</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results.html">sed_eval.sound_event.EventBasedMetrics.results</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results_overall_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_overall_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics.html">sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics</a></li>
<li class="toctree-l4"><a class="reference internal" href="../../generated/s
Download .txt
gitextract_rwh6jdyn/

├── .coveragerc
├── .gitignore
├── .travis.yml
├── CODE_OF_CONDUCT.md
├── CONTRIBUTING.md
├── LICENSE.txt
├── README.rst
├── docs/
│   ├── .buildinfo
│   ├── .nojekyll
│   ├── _modules/
│   │   ├── index.html
│   │   └── sed_eval/
│   │       ├── audio_tag.html
│   │       ├── io.html
│   │       ├── metric.html
│   │       ├── scene.html
│   │       ├── sound_event.html
│   │       ├── test.html
│   │       └── util/
│   │           ├── event_list.html
│   │           ├── event_matching.html
│   │           ├── event_roll.html
│   │           └── scene_list.html
│   ├── _sources/
│   │   ├── audio_tag.rst.txt
│   │   ├── changelog.rst.txt
│   │   ├── generated/
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.evaluate.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.reset.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics.rst.txt
│   │   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.rst.txt
│   │   │   ├── sed_eval.io.load_event_list.rst.txt
│   │   │   ├── sed_eval.io.load_file_pair_list.rst.txt
│   │   │   ├── sed_eval.io.load_scene_list.rst.txt
│   │   │   ├── sed_eval.metric.accuracy.rst.txt
│   │   │   ├── sed_eval.metric.accuracy2.rst.txt
│   │   │   ├── sed_eval.metric.balanced_accuracy.rst.txt
│   │   │   ├── sed_eval.metric.deletion_rate.rst.txt
│   │   │   ├── sed_eval.metric.equal_error_rate.rst.txt
│   │   │   ├── sed_eval.metric.error_rate.rst.txt
│   │   │   ├── sed_eval.metric.f_measure.rst.txt
│   │   │   ├── sed_eval.metric.insertion_rate.rst.txt
│   │   │   ├── sed_eval.metric.precision.rst.txt
│   │   │   ├── sed_eval.metric.recall.rst.txt
│   │   │   ├── sed_eval.metric.sensitivity.rst.txt
│   │   │   ├── sed_eval.metric.specificity.rst.txt
│   │   │   ├── sed_eval.metric.substitution_rate.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.evaluate.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.reset.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_class_wise.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_parameters.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.results.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.results_overall_metrics.rst.txt
│   │   │   ├── sed_eval.scene.SceneClassificationMetrics.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.evaluate.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.reset.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_class_wise.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_overall.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_parameters.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.results.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.results_overall_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.EventBasedMetrics.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.evaluate.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.reset.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_overall.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics.rst.txt
│   │   │   ├── sed_eval.sound_event.SegmentBasedMetrics.rst.txt
│   │   │   ├── sed_eval.test.mcnemar.rst.txt
│   │   │   ├── sed_eval.util.event_list.filter_event_list.rst.txt
│   │   │   ├── sed_eval.util.event_list.max_event_offset.rst.txt
│   │   │   ├── sed_eval.util.event_list.unique_event_labels.rst.txt
│   │   │   ├── sed_eval.util.event_list.unique_files.rst.txt
│   │   │   ├── sed_eval.util.event_matching.bipartite_match.rst.txt
│   │   │   ├── sed_eval.util.event_roll.event_list_to_event_roll.rst.txt
│   │   │   ├── sed_eval.util.event_roll.match_event_roll_lengths.rst.txt
│   │   │   ├── sed_eval.util.event_roll.pad_event_roll.rst.txt
│   │   │   └── sed_eval.util.scene_list.unique_scene_labels.rst.txt
│   │   ├── glossary.rst.txt
│   │   ├── index.rst.txt
│   │   ├── install.rst.txt
│   │   ├── io.rst.txt
│   │   ├── metric.rst.txt
│   │   ├── scene.rst.txt
│   │   ├── sound_event.rst.txt
│   │   ├── test.rst.txt
│   │   ├── tutorial.rst.txt
│   │   └── util.rst.txt
│   ├── _static/
│   │   ├── basic.css
│   │   ├── css/
│   │   │   ├── badge_only.css
│   │   │   └── theme.css
│   │   ├── doctools.js
│   │   ├── jquery-3.1.0.js
│   │   ├── jquery.js
│   │   ├── js/
│   │   │   └── theme.js
│   │   ├── pygments.css
│   │   ├── searchtools.js
│   │   ├── theme_overrides.css
│   │   ├── underscore-1.3.1.js
│   │   ├── underscore.js
│   │   └── websupport.js
│   ├── audio_tag.html
│   ├── changelog.html
│   ├── generated/
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.evaluate.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.reset.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics.html
│   │   ├── sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics.html
│   │   ├── sed_eval.io.load_event_list.html
│   │   ├── sed_eval.io.load_file_pair_list.html
│   │   ├── sed_eval.io.load_scene_list.html
│   │   ├── sed_eval.metric.accuracy.html
│   │   ├── sed_eval.metric.accuracy2.html
│   │   ├── sed_eval.metric.balanced_accuracy.html
│   │   ├── sed_eval.metric.deletion_rate.html
│   │   ├── sed_eval.metric.equal_error_rate.html
│   │   ├── sed_eval.metric.error_rate.html
│   │   ├── sed_eval.metric.f_measure.html
│   │   ├── sed_eval.metric.insertion_rate.html
│   │   ├── sed_eval.metric.precision.html
│   │   ├── sed_eval.metric.recall.html
│   │   ├── sed_eval.metric.sensitivity.html
│   │   ├── sed_eval.metric.specificity.html
│   │   ├── sed_eval.metric.substitution_rate.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.evaluate.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.reset.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_class_wise.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.result_report_parameters.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.results.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics.html
│   │   ├── sed_eval.scene.SceneClassificationMetrics.results_overall_metrics.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.evaluate.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.reset.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_class_wise.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_overall.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.result_report_parameters.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.results.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics.html
│   │   ├── sed_eval.sound_event.EventBasedMetrics.results_overall_metrics.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.evaluate.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.reset.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_overall.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics.html
│   │   ├── sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics.html
│   │   ├── sed_eval.test.mcnemar.html
│   │   ├── sed_eval.util.event_list.filter_event_list.html
│   │   ├── sed_eval.util.event_list.max_event_offset.html
│   │   ├── sed_eval.util.event_list.unique_event_labels.html
│   │   ├── sed_eval.util.event_list.unique_files.html
│   │   ├── sed_eval.util.event_matching.bipartite_match.html
│   │   ├── sed_eval.util.event_roll.event_list_to_event_roll.html
│   │   ├── sed_eval.util.event_roll.match_event_roll_lengths.html
│   │   ├── sed_eval.util.event_roll.pad_event_roll.html
│   │   └── sed_eval.util.scene_list.unique_scene_labels.html
│   ├── genindex.html
│   ├── glossary.html
│   ├── index.html
│   ├── install.html
│   ├── io.html
│   ├── metric.html
│   ├── objects.inv
│   ├── py-modindex.html
│   ├── scene.html
│   ├── search.html
│   ├── searchindex.js
│   ├── sound_event.html
│   ├── test.html
│   ├── tutorial.html
│   └── util.html
├── documentation/
│   ├── Makefile
│   ├── README.md
│   ├── requirements.txt
│   └── source/
│       ├── __init__.py
│       ├── _static/
│       │   ├── .nojekyll
│       │   └── theme_overrides.css
│       ├── audio_tag.rst
│       ├── changelog.rst
│       ├── conf.py
│       ├── glossary.rst
│       ├── index.rst
│       ├── install.rst
│       ├── io.rst
│       ├── metric.rst
│       ├── scene.rst
│       ├── sound_event.rst
│       ├── test.rst
│       ├── tutorial.rst
│       └── util.rst
├── evaluators/
│   ├── README.md
│   ├── scene_eval.py
│   └── sound_event_eval.py
├── requirements.txt
├── sed_eval/
│   ├── __init__.py
│   ├── audio_tag.py
│   ├── io.py
│   ├── metric.py
│   ├── scene.py
│   ├── sound_event.py
│   ├── test.py
│   └── util/
│       ├── __init__.py
│       ├── event_list.py
│       ├── event_matching.py
│       ├── event_roll.py
│       └── scene_list.py
├── setup.cfg
├── setup.py
└── tests/
    ├── README.md
    ├── data/
    │   ├── audio_tagging/
    │   │   ├── estimated.txt
    │   │   └── reference.txt
    │   ├── scene/
    │   │   ├── estimated_a.txt
    │   │   ├── estimated_b.txt
    │   │   ├── file_list.txt
    │   │   ├── fold1_estimated.txt
    │   │   ├── fold1_reference.txt
    │   │   ├── fold2_estimated.txt
    │   │   ├── fold2_reference.txt
    │   │   ├── fold3_estimated.txt
    │   │   ├── fold3_reference.txt
    │   │   ├── fold4_estimated.txt
    │   │   ├── fold4_reference.txt
    │   │   ├── fold5_estimated.txt
    │   │   ├── fold5_reference.txt
    │   │   └── reference.txt
    │   └── sound_event/
    │       ├── audioset1.txt
    │       ├── audioset1_detected.txt
    │       ├── binary1.txt
    │       ├── binary1_detected.txt
    │       ├── binary2.txt
    │       ├── binary2_detected.txt
    │       ├── binary3.txt
    │       ├── binary3_detected.txt
    │       ├── binary4.txt
    │       ├── binary4_detected.txt
    │       ├── binary5.txt
    │       ├── binary5_detected.txt
    │       ├── file_list.txt
    │       ├── file_list_audioset.txt
    │       ├── file_list_binary.txt
    │       ├── mini_detected_a.txt
    │       ├── mini_detected_b.txt
    │       ├── mini_reference.txt
    │       ├── office_snr0_high_v2.txt
    │       ├── office_snr0_high_v2_detected.txt
    │       ├── office_snr0_med_v2.txt
    │       ├── office_snr0_med_v2_detected.txt
    │       ├── street_fold1_detected.txt
    │       └── street_fold1_reference.txt
    ├── test_audio_tag.py
    ├── test_io.py
    ├── test_metric.py
    ├── test_scene.py
    ├── test_sound_event.py
    ├── test_test.py
    └── test_util.py
Download .txt
SYMBOL INDEX (325 symbols across 28 files)

FILE: docs/_static/doctools.js
  function highlight (line 69) | function highlight(node) {

FILE: docs/_static/jquery-3.1.0.js
  function DOMEval (line 77) | function DOMEval( code, doc ) {
  function isArrayLike (line 528) | function isArrayLike( obj ) {
  function Sizzle (line 760) | function Sizzle( selector, context, results, seed ) {
  function createCache (line 899) | function createCache() {
  function markFunction (line 917) | function markFunction( fn ) {
  function assert (line 926) | function assert( fn ) {
  function addHandle (line 948) | function addHandle( attrs, handler ) {
  function siblingCheck (line 963) | function siblingCheck( a, b ) {
  function createInputPseudo (line 989) | function createInputPseudo( type ) {
  function createButtonPseudo (line 1000) | function createButtonPseudo( type ) {
  function createDisabledPseudo (line 1011) | function createDisabledPseudo( disabled ) {
  function createPositionalPseudo (line 1039) | function createPositionalPseudo( fn ) {
  function testContext (line 1062) | function testContext( context ) {
  function setFilters (line 2118) | function setFilters() {}
  function toSelector (line 2189) | function toSelector( tokens ) {
  function addCombinator (line 2199) | function addCombinator( matcher, combinator, base ) {
  function elementMatcher (line 2261) | function elementMatcher( matchers ) {
  function multipleContexts (line 2275) | function multipleContexts( selector, contexts, results ) {
  function condense (line 2284) | function condense( unmatched, map, filter, context, xml ) {
  function setMatcher (line 2305) | function setMatcher( preFilter, selector, matcher, postFilter, postFinde...
  function matcherFromTokens (line 2398) | function matcherFromTokens( tokens ) {
  function matcherFromGroupMatchers (line 2456) | function matcherFromGroupMatchers( elementMatchers, setMatchers ) {
  function winnow (line 2798) | function winnow( elements, qualifier, not ) {
  function sibling (line 3094) | function sibling( cur, dir ) {
  function createOptions (line 3170) | function createOptions( options ) {
  function Identity (line 3395) | function Identity( v ) {
  function Thrower (line 3398) | function Thrower( ex ) {
  function adoptValue (line 3402) | function adoptValue( value, resolve, reject ) {
  function resolve (line 3494) | function resolve( depth, deferred, handler, special ) {
  function completed (line 3860) | function completed() {
  function Data (line 3959) | function Data() {
  function dataAttr (line 4128) | function dataAttr( elem, key, data ) {
  function adjustCSS (line 4448) | function adjustCSS( elem, prop, valueParts, tween ) {
  function getDefaultDisplay (line 4513) | function getDefaultDisplay( elem ) {
  function showHide (line 4536) | function showHide( elements, show ) {
  function getAll (line 4637) | function getAll( context, tag ) {
  function setGlobalEval (line 4654) | function setGlobalEval( elems, refElements ) {
  function buildFragment (line 4670) | function buildFragment( elems, context, scripts, selection, ignored ) {
  function returnTrue (line 4793) | function returnTrue() {
  function returnFalse (line 4797) | function returnFalse() {
  function safeActiveElement (line 4803) | function safeActiveElement() {
  function on (line 4809) | function on( elem, types, selector, data, fn, one ) {
  function manipulationTarget (line 5518) | function manipulationTarget( elem, content ) {
  function disableScript (line 5529) | function disableScript( elem ) {
  function restoreScript (line 5533) | function restoreScript( elem ) {
  function cloneCopyEvent (line 5545) | function cloneCopyEvent( src, dest ) {
  function fixInput (line 5580) | function fixInput( src, dest ) {
  function domManip (line 5593) | function domManip( collection, args, callback, ignored ) {
  function remove (line 5683) | function remove( elem, selector, keepData ) {
  function computeStyleTests (line 5976) | function computeStyleTests() {
  function curCSS (line 6050) | function curCSS( elem, name, computed ) {
  function addGetHookIf (line 6097) | function addGetHookIf( conditionFn, hookFn ) {
  function vendorPropName (line 6133) | function vendorPropName( name ) {
  function setPositiveNumber (line 6152) | function setPositiveNumber( elem, value, subtract ) {
  function augmentWidthOrHeight (line 6164) | function augmentWidthOrHeight( elem, name, extra, isBorderBox, styles ) {
  function getWidthOrHeight (line 6208) | function getWidthOrHeight( elem, name, extra ) {
  function Tween (line 6516) | function Tween( elem, options, prop, end, easing ) {
  function raf (line 6639) | function raf() {
  function createFxNow (line 6647) | function createFxNow() {
  function genFx (line 6655) | function genFx( type, includeWidth ) {
  function createTween (line 6675) | function createTween( value, prop, animation ) {
  function defaultPrefilter (line 6689) | function defaultPrefilter( elem, props, opts ) {
  function propFilter (line 6860) | function propFilter( props, specialEasing ) {
  function Animation (line 6897) | function Animation( elem, properties, options ) {
  function getClass (line 7588) | function getClass( elem ) {
  function buildParams (line 8213) | function buildParams( prefix, obj, traditional, add ) {
  function addToPrefiltersOrTransports (line 8359) | function addToPrefiltersOrTransports( structure ) {
  function inspectPrefiltersOrTransports (line 8393) | function inspectPrefiltersOrTransports( structure, options, originalOpti...
  function ajaxExtend (line 8422) | function ajaxExtend( target, src ) {
  function ajaxHandleResponses (line 8442) | function ajaxHandleResponses( s, jqXHR, responses ) {
  function ajaxConvert (line 8500) | function ajaxConvert( s, response, jqXHR, isSuccess ) {
  function done (line 9013) | function done( status, nativeStatusText, responses, headers ) {
  function getWindow (line 9738) | function getWindow( elem ) {

FILE: docs/_static/jquery.js
  function p (line 2) | function p(a,b){b=b||d;var c=b.createElement("script");c.text=a,b.head.a...
  function w (line 2) | function w(a){var b=!!a&&"length"in a&&a.length,c=r.type(a);return"funct...
  function ga (line 2) | function ga(a,b,d,e){var f,h,j,k,l,o,r,s=b&&b.ownerDocument,w=b?b.nodeTy...
  function ha (line 2) | function ha(){var a=[];function b(c,e){return a.push(c+" ")>d.cacheLengt...
  function ia (line 2) | function ia(a){return a[u]=!0,a}
  function ja (line 2) | function ja(a){var b=n.createElement("fieldset");try{return!!a(b)}catch(...
  function ka (line 2) | function ka(a,b){var c=a.split("|"),e=c.length;while(e--)d.attrHandle[c[...
  function la (line 2) | function la(a,b){var c=b&&a,d=c&&1===a.nodeType&&1===b.nodeType&&a.sourc...
  function ma (line 2) | function ma(a){return function(b){var c=b.nodeName.toLowerCase();return"...
  function na (line 2) | function na(a){return function(b){var c=b.nodeName.toLowerCase();return(...
  function oa (line 2) | function oa(a){return function(b){return"label"in b&&b.disabled===a||"fo...
  function pa (line 2) | function pa(a){return ia(function(b){return b=+b,ia(function(c,d){var e,...
  function qa (line 2) | function qa(a){return a&&"undefined"!=typeof a.getElementsByTagName&&a}
  function ra (line 2) | function ra(){}
  function sa (line 2) | function sa(a){for(var b=0,c=a.length,d="";b<c;b++)d+=a[b].value;return d}
  function ta (line 2) | function ta(a,b,c){var d=b.dir,e=b.next,f=e||d,g=c&&"parentNode"===f,h=x...
  function ua (line 2) | function ua(a){return a.length>1?function(b,c,d){var e=a.length;while(e-...
  function va (line 2) | function va(a,b,c){for(var d=0,e=b.length;d<e;d++)ga(a,b[d],c);return c}
  function wa (line 2) | function wa(a,b,c,d,e){for(var f,g=[],h=0,i=a.length,j=null!=b;h<i;h++)(...
  function xa (line 2) | function xa(a,b,c,d,e,f){return d&&!d[u]&&(d=xa(d)),e&&!e[u]&&(e=xa(e,f)...
  function ya (line 2) | function ya(a){for(var b,c,e,f=a.length,g=d.relative[a[0].type],h=g||d.r...
  function za (line 2) | function za(a,b){var c=b.length>0,e=a.length>0,f=function(f,g,h,i,k){var...
  function D (line 2) | function D(a,b,c){if(r.isFunction(b))return r.grep(a,function(a,d){retur...
  function J (line 2) | function J(a,b){while((a=a[b])&&1!==a.nodeType);return a}
  function L (line 2) | function L(a){var b={};return r.each(a.match(K)||[],function(a,c){b[c]=!...
  function M (line 2) | function M(a){return a}
  function N (line 2) | function N(a){throw a}
  function O (line 2) | function O(a,b,c){var d;try{a&&r.isFunction(d=a.promise)?d.call(a).done(...
  function g (line 2) | function g(b,c,d,e){return function(){var h=this,i=arguments,j=function(...
  function R (line 2) | function R(){d.removeEventListener("DOMContentLoaded",R),a.removeEventLi...
  function U (line 3) | function U(){this.expando=r.expando+U.uid++}
  function Z (line 3) | function Z(a,b,c){var d;if(void 0===c&&1===a.nodeType)if(d="data-"+b.rep...
  function da (line 3) | function da(a,b,c,d){var e,f=1,g=20,h=d?function(){return d.cur()}:funct...
  function fa (line 3) | function fa(a){var b,c=a.ownerDocument,d=a.nodeName,e=ea[d];return e?e:(...
  function ga (line 3) | function ga(a,b){for(var c,d,e=[],f=0,g=a.length;f<g;f++)d=a[f],d.style&...
  function la (line 3) | function la(a,b){var c="undefined"!=typeof a.getElementsByTagName?a.getE...
  function ma (line 3) | function ma(a,b){for(var c=0,d=a.length;c<d;c++)V.set(a[c],"globalEval",...
  function oa (line 3) | function oa(a,b,c,d,e){for(var f,g,h,i,j,k,l=b.createDocumentFragment(),...
  function ta (line 3) | function ta(){return!0}
  function ua (line 3) | function ua(){return!1}
  function va (line 3) | function va(){try{return d.activeElement}catch(a){}}
  function wa (line 3) | function wa(a,b,c,d,e,f){var g,h;if("object"==typeof b){"string"!=typeof...
  function Ca (line 3) | function Ca(a,b){return r.nodeName(a,"table")&&r.nodeName(11!==b.nodeTyp...
  function Da (line 3) | function Da(a){return a.type=(null!==a.getAttribute("type"))+"/"+a.type,a}
  function Ea (line 3) | function Ea(a){var b=Aa.exec(a.type);return b?a.type=b[1]:a.removeAttrib...
  function Fa (line 3) | function Fa(a,b){var c,d,e,f,g,h,i,j;if(1===b.nodeType){if(V.hasData(a)&...
  function Ga (line 3) | function Ga(a,b){var c=b.nodeName.toLowerCase();"input"===c&&ha.test(a.t...
  function Ha (line 3) | function Ha(a,b,c,d){b=g.apply([],b);var e,f,h,i,j,k,l=0,m=a.length,n=m-...
  function Ia (line 3) | function Ia(a,b,c){for(var d,e=b?r.filter(b,a):a,f=0;null!=(d=e[f]);f++)...
  function b (line 3) | function b(){if(i){i.style.cssText="box-sizing:border-box;position:relat...
  function Ma (line 3) | function Ma(a,b,c){var d,e,f,g,h=a.style;return c=c||La(a),c&&(g=c.getPr...
  function Na (line 3) | function Na(a,b){return{get:function(){return a()?void delete this.get:(...
  function Ta (line 3) | function Ta(a){if(a in Sa)return a;var b=a[0].toUpperCase()+a.slice(1),c...
  function Ua (line 3) | function Ua(a,b,c){var d=_.exec(b);return d?Math.max(0,d[2]-(c||0))+(d[3...
  function Va (line 3) | function Va(a,b,c,d,e){for(var f=c===(d?"border":"content")?4:"width"===...
  function Wa (line 3) | function Wa(a,b,c){var d,e=!0,f=La(a),g="border-box"===r.css(a,"boxSizin...
  function Xa (line 3) | function Xa(a,b,c,d,e){return new Xa.prototype.init(a,b,c,d,e)}
  function ab (line 3) | function ab(){Za&&(a.requestAnimationFrame(ab),r.fx.tick())}
  function bb (line 3) | function bb(){return a.setTimeout(function(){Ya=void 0}),Ya=r.now()}
  function cb (line 3) | function cb(a,b){var c,d=0,e={height:a};for(b=b?1:0;d<4;d+=2-b)c=aa[d],e...
  function db (line 3) | function db(a,b,c){for(var d,e=(gb.tweeners[b]||[]).concat(gb.tweeners["...
  function eb (line 3) | function eb(a,b,c){var d,e,f,g,h,i,j,k,l="width"in b||"height"in b,m=thi...
  function fb (line 3) | function fb(a,b){var c,d,e,f,g;for(c in a)if(d=r.camelCase(c),e=b[d],f=a...
  function gb (line 3) | function gb(a,b,c){var d,e,f=0,g=gb.prefilters.length,h=r.Deferred().alw...
  function mb (line 4) | function mb(a){return a.getAttribute&&a.getAttribute("class")||""}
  function xb (line 4) | function xb(a,b,c,d){var e;if(r.isArray(b))r.each(b,function(b,e){c||tb....
  function Jb (line 4) | function Jb(a){return function(b,c){"string"!=typeof b&&(c=b,b="*");var ...
  function Kb (line 4) | function Kb(a,b,c,d){var e={},f=a===Gb;function g(h){var i;return e[h]=!...
  function Lb (line 4) | function Lb(a,b){var c,d,e=r.ajaxSettings.flatOptions||{};for(c in b)voi...
  function Mb (line 4) | function Mb(a,b,c){var d,e,f,g,h=a.contents,i=a.dataTypes;while("*"===i[...
  function Nb (line 4) | function Nb(a,b,c,d){var e,f,g,h,i,j={},k=a.dataTypes.slice();if(k[1])fo...
  function A (line 4) | function A(b,c,d,h){var j,m,n,v,w,x=c;k||(k=!0,i&&a.clearTimeout(i),e=vo...
  function Sb (line 4) | function Sb(a){return r.isWindow(a)?a:9===a.nodeType&&a.defaultView}

FILE: docs/_static/js/theme.js
  function s (line 1) | function s(o,u){if(!n[o]){if(!t[o]){var a=typeof require=="function"&&re...
  function ThemeNav (line 5) | function ThemeNav () {

FILE: docs/_static/searchtools.js
  function splitQuery (line 307) | function splitQuery(query) {
  function pulse (line 381) | function pulse() {
  function displayNextItem (line 513) | function displayNextItem() {

FILE: docs/_static/underscore-1.3.1.js
  function eq (line 669) | function eq(a, b, stack) {

FILE: docs/_static/underscore.js
  function q (line 8) | function q(a,c,d){if(a===c)return a!==0||1/a==1/c;if(a==null||c==null)re...

FILE: docs/_static/websupport.js
  function init (line 47) | function init() {
  function initEvents (line 52) | function initEvents() {
  function setComparator (line 107) | function setComparator() {
  function initComparator (line 127) | function initComparator() {
  function show (line 147) | function show(id) {
  function hide (line 168) | function hide(id) {
  function getComments (line 181) | function getComments(id) {
  function addComment (line 216) | function addComment(form) {
  function appendComments (line 275) | function appendComments(comments, ul) {
  function insertComment (line 290) | function insertComment(comment) {
  function acceptComment (line 320) | function acceptComment(id) {
  function deleteComment (line 335) | function deleteComment(id) {
  function showProposal (line 369) | function showProposal(id) {
  function hideProposal (line 375) | function hideProposal(id) {
  function showProposeChange (line 381) | function showProposeChange(id) {
  function hideProposeChange (line 390) | function hideProposeChange(id) {
  function toggleCommentMarkupBox (line 398) | function toggleCommentMarkupBox(id) {
  function handleReSort (line 403) | function handleReSort(link) {
  function handleVote (line 426) | function handleVote(link) {
  function openReply (line 488) | function openReply(id) {
  function closeReply (line 516) | function closeReply(id) {
  function sortComments (line 530) | function sortComments(comments) {
  function getChildren (line 542) | function getChildren(ul, recursive) {
  function createCommentDiv (line 555) | function createCommentDiv(comment) {
  function renderTemplate (line 593) | function renderTemplate(template, context) {
  function showError (line 610) | function showError(message) {

FILE: documentation/source/conf.py
  class Mock (line 151) | class Mock(MagicMock):
    method __getattr__ (line 153) | def __getattr__(cls, name):

FILE: evaluators/scene_eval.py
  function process_arguments (line 63) | def process_arguments(argv):
  function main (line 89) | def main(argv):

FILE: evaluators/sound_event_eval.py
  function process_arguments (line 69) | def process_arguments(argv):
  function main (line 94) | def main(argv):

FILE: sed_eval/audio_tag.py
  class AudioTaggingMetrics (line 259) | class AudioTaggingMetrics:
    method __init__ (line 260) | def __init__(self, tags=None):
    method __str__ (line 293) | def __str__(self):
    method evaluate (line 304) | def evaluate(self, reference_tag_list, estimated_tag_list=None, estima...
    method reset (line 423) | def reset(self):
    method results (line 449) | def results(self):
    method results_overall_metrics (line 467) | def results_overall_metrics(self):
    method results_class_wise_metrics (line 530) | def results_class_wise_metrics(self):
    method results_class_wise_average_metrics (line 597) | def results_class_wise_average_metrics(self):
    method result_report_parameters (line 659) | def result_report_parameters(self):
    method result_report_overall (line 674) | def result_report_overall(self):
    method result_report_class_wise_average (line 725) | def result_report_class_wise_average(self):
    method result_report_class_wise (line 775) | def result_report_class_wise(self):

FILE: sed_eval/io.py
  function load_event_list (line 22) | def load_event_list(filename, **kwargs):
  function load_scene_list (line 73) | def load_scene_list(filename, **kwargs):
  function load_file_pair_list (line 110) | def load_file_pair_list(filename):

FILE: sed_eval/metric.py
  function precision (line 31) | def precision(Ntp, Nsys, eps=numpy.spacing(1)):
  function recall (line 61) | def recall(Ntp, Nref, eps=numpy.spacing(1)):
  function f_measure (line 91) | def f_measure(precision, recall, beta=1.0):
  function sensitivity (line 122) | def sensitivity(Ntp, Nfn, eps=numpy.spacing(1)):
  function specificity (line 149) | def specificity(Ntn, Nfp, eps=numpy.spacing(1)):
  function balanced_accuracy (line 176) | def balanced_accuracy(sensitivity, specificity, factor=0.5):
  function accuracy (line 203) | def accuracy(Ntp, Ntn, Nfp, Nfn, eps=numpy.spacing(1)):
  function accuracy_corr (line 234) | def accuracy_corr(Ncorr, N, eps=numpy.spacing(1)):
  function accuracy2 (line 259) | def accuracy2(Ntp, Nfp, Nfn, eps=numpy.spacing(1)):
  function substitution_rate (line 294) | def substitution_rate(Nref, Nsubstitutions, eps=numpy.spacing(1)):
  function deletion_rate (line 319) | def deletion_rate(Nref, Ndeletions, eps=numpy.spacing(1)):
  function insertion_rate (line 344) | def insertion_rate(Nref, Ninsertions, eps=numpy.spacing(1)):
  function error_rate (line 369) | def error_rate(substitution_rate_value=0.0, deletion_rate_value=0.0, ins...
  function equal_error_rate (line 396) | def equal_error_rate(y_true, y_score, eps=numpy.spacing(1)):

FILE: sed_eval/scene.py
  class SceneClassificationMetrics (line 161) | class SceneClassificationMetrics:
    method __init__ (line 162) | def __init__(self, scene_labels=None):
    method __enter__ (line 182) | def __enter__(self):
    method __exit__ (line 185) | def __exit__(self, type, value, traceback):
    method __str__ (line 188) | def __str__(self):
    method evaluate (line 198) | def evaluate(self, reference_scene_list, estimated_scene_list=None, es...
    method reset (line 289) | def reset(self):
    method result_report_parameters (line 307) | def result_report_parameters(self):
    method result_report_class_wise (line 322) | def result_report_class_wise(self):
    method result_report_class_wise_average (line 356) | def result_report_class_wise_average(self):
    method results (line 377) | def results(self):
    method results_overall_metrics (line 395) | def results_overall_metrics(self):
    method results_class_wise_metrics (line 415) | def results_class_wise_metrics(self):
    method results_class_wise_average_metrics (line 443) | def results_class_wise_average_metrics(self):
    method class_wise_accuracy (line 466) | def class_wise_accuracy(self, scene_label):

FILE: sed_eval/sound_event.py
  class SoundEventMetrics (line 238) | class SoundEventMetrics(object):
    method __init__ (line 242) | def __init__(self,
    method result_report_overall (line 262) | def result_report_overall(self):
    method result_report_class_wise_average (line 309) | def result_report_class_wise_average(self):
    method result_report_class_wise (line 356) | def result_report_class_wise(self):
    method overall_f_measure (line 432) | def overall_f_measure(self):
    method overall_error_rate (line 435) | def overall_error_rate(self):
    method overall_accuracy (line 438) | def overall_accuracy(self, factor=0.5):
    method class_wise_count (line 442) | def class_wise_count(self, event_label):
    method class_wise_f_measure (line 445) | def class_wise_f_measure(self, event_label):
    method class_wise_error_rate (line 448) | def class_wise_error_rate(self, event_label):
    method class_wise_accuracy (line 451) | def class_wise_accuracy(self, event_label):
    method results_overall_metrics (line 455) | def results_overall_metrics(self):
    method results_class_wise_metrics (line 471) | def results_class_wise_metrics(self):
    method results_class_wise_average_metrics (line 493) | def results_class_wise_average_metrics(self):
    method results (line 579) | def results(self):
  class SegmentBasedMetrics (line 596) | class SegmentBasedMetrics(SoundEventMetrics):
    method __init__ (line 597) | def __init__(self,
    method __enter__ (line 659) | def __enter__(self):
    method __exit__ (line 662) | def __exit__(self, type, value, traceback):
    method __str__ (line 665) | def __str__(self):
    method evaluate (line 676) | def evaluate(self, reference_event_list, estimated_event_list, evaluat...
    method reset (line 817) | def reset(self):
    method overall_f_measure (line 847) | def overall_f_measure(self):
    method overall_error_rate (line 881) | def overall_error_rate(self):
    method overall_accuracy (line 919) | def overall_accuracy(self, factor=0.5):
    method class_wise_count (line 965) | def class_wise_count(self, event_label):
    method class_wise_f_measure (line 980) | def class_wise_f_measure(self, event_label):
    method class_wise_error_rate (line 1014) | def class_wise_error_rate(self, event_label):
    method class_wise_accuracy (line 1045) | def class_wise_accuracy(self, event_label, factor=0.5):
    method result_report_parameters (line 1086) | def result_report_parameters(self):
  class EventBasedMetrics (line 1108) | class EventBasedMetrics(SoundEventMetrics):
    method __init__ (line 1109) | def __init__(self,
    method __enter__ (line 1203) | def __enter__(self):
    method __exit__ (line 1206) | def __exit__(self, type, value, traceback):
    method __str__ (line 1209) | def __str__(self):
    method evaluate (line 1233) | def evaluate(self, reference_event_list, estimated_event_list):
    method reset (line 1577) | def reset(self):
    method validate_onset (line 1604) | def validate_onset(reference_event, estimated_event, t_collar=0.200):
    method validate_offset (line 1633) | def validate_offset(reference_event, estimated_event, t_collar=0.200, ...
    method overall_f_measure (line 1671) | def overall_f_measure(self):
    method overall_error_rate (line 1705) | def overall_error_rate(self):
    method class_wise_count (line 1743) | def class_wise_count(self, event_label):
    method class_wise_f_measure (line 1758) | def class_wise_f_measure(self, event_label):
    method class_wise_error_rate (line 1792) | def class_wise_error_rate(self, event_label):
    method result_report_parameters (line 1824) | def result_report_parameters(self):

FILE: sed_eval/test.py
  function mcnemar (line 15) | def mcnemar(reference, estimated_a, estimated_b):

FILE: sed_eval/util/event_list.py
  function filter_event_list (line 15) | def filter_event_list(event_list, scene_label=None, event_label=None, fi...
  function unique_files (line 46) | def unique_files(event_list):
  function unique_event_labels (line 78) | def unique_event_labels(event_list):
  function max_event_offset (line 106) | def max_event_offset(event_list):

FILE: sed_eval/util/event_matching.py
  function bipartite_match (line 7) | def bipartite_match(graph):

FILE: sed_eval/util/event_roll.py
  function event_list_to_event_roll (line 13) | def event_list_to_event_roll(source_event_list, event_label_list=None, t...
  function pad_event_roll (line 74) | def pad_event_roll(event_roll, length):
  function match_event_roll_lengths (line 99) | def match_event_roll_lengths(event_roll_a, event_roll_b, length=None):

FILE: sed_eval/util/scene_list.py
  function unique_scene_labels (line 11) | def unique_scene_labels(scene_list):

FILE: tests/test_audio_tag.py
  function test_direct_use (line 12) | def test_direct_use():
  function test_direct_use2 (line 241) | def test_direct_use2():
  function test_parameters_1 (line 451) | def test_parameters_1():

FILE: tests/test_io.py
  function test_load_event_list (line 9) | def test_load_event_list():
  function test_load_scene_list (line 53) | def test_load_scene_list():
  function test_load_file_pair_list (line 69) | def test_load_file_pair_list():

FILE: tests/test_metric.py
  function test_precision (line 9) | def test_precision():
  function test_recall (line 15) | def test_recall():
  function test_f_measure (line 21) | def test_f_measure():
  function test_sensitivity (line 29) | def test_sensitivity():
  function test_specificity (line 35) | def test_specificity():
  function test_balanced_accuracy (line 41) | def test_balanced_accuracy():
  function test_substitution_rate (line 47) | def test_substitution_rate():
  function test_deletion_rate (line 53) | def test_deletion_rate():
  function test_insertion_rate (line 59) | def test_insertion_rate():
  function test_error_rate (line 65) | def test_error_rate():

FILE: tests/test_scene.py
  function test_direct_use (line 11) | def test_direct_use():
  function test_direct_use2 (line 72) | def test_direct_use2():
  function test_parameters_1 (line 138) | def test_parameters_1():

FILE: tests/test_sound_event.py
  function test_parameters_1 (line 12) | def test_parameters_1():
  function test_parameters_2 (line 29) | def test_parameters_2():
  function test_parameters_3 (line 45) | def test_parameters_3():
  function test_parameters_4 (line 62) | def test_parameters_4():
  function test_dcase_style (line 79) | def test_dcase_style():
  function test_dcase_style2 (line 127) | def test_dcase_style2():
  function test_binary (line 166) | def test_binary():
  function test_audioset (line 245) | def test_audioset():
  function test_direct_use_segment (line 293) | def test_direct_use_segment():
  function test_direct_use_event (line 365) | def test_direct_use_event():
  function test_event_matching (line 436) | def test_event_matching():
  function test_empty_system_output_handling (line 759) | def test_empty_system_output_handling():

FILE: tests/test_test.py
  function test_mcnemar (line 10) | def test_mcnemar():

FILE: tests/test_util.py
  function test_unique_event_labels (line 103) | def test_unique_event_labels():
  function test_max_event_offset (line 107) | def test_max_event_offset():
  function test_unique_scene_labels (line 111) | def test_unique_scene_labels():
  function test_event_list_to_event_roll (line 115) | def test_event_list_to_event_roll():
  function test_pad_event_roll (line 153) | def test_pad_event_roll():
  function test_match_event_roll_lengths (line 160) | def test_match_event_roll_lengths():
Condensed preview — 283 files, each showing path, character count, and a content snippet. Download the .json file or copy for the full structured content (4,775K chars).
[
  {
    "path": ".coveragerc",
    "chars": 60,
    "preview": "[report]\nomit =\n    */python?.?/*\n    */site-packages/nose/*"
  },
  {
    "path": ".gitignore",
    "chars": 582,
    "preview": "*.py[co]\n\n# Packages\n*.egg\n*.egg-info\ndist\nbuild\neggs\nparts\nbin\nvar\nsdist\ndevelop-eggs\n.installed.cfg\n\n# Installer logs\n"
  },
  {
    "path": ".travis.yml",
    "chars": 747,
    "preview": "language:\n    - python\n\npython:\n    - \"2.7\"\n    - \"3.5\"\n    - \"3.6\"\n\ncache:\n  pip: true\n  bundler: true\n\nnotifications:\n"
  },
  {
    "path": "CODE_OF_CONDUCT.md",
    "chars": 3217,
    "preview": "# Contributor Covenant Code of Conduct\n\n## Our Pledge\n\nIn the interest of fostering an open and welcoming environment, w"
  },
  {
    "path": "CONTRIBUTING.md",
    "chars": 3491,
    "preview": "Contributing\n============\n\nHow to contribute\n-----------------\n\nThe preferred way to contribute to `sed_eval` is to fork"
  },
  {
    "path": "LICENSE.txt",
    "chars": 1098,
    "preview": "The MIT License (MIT)\n\nCopyright (c) 2016 Tampere University of Technology\n\nPermission is hereby granted, free of charge"
  },
  {
    "path": "README.rst",
    "chars": 2033,
    "preview": "sed_eval - Evaluation toolbox for Sound Event Detection\n=======================================================\n\n.. imag"
  },
  {
    "path": "docs/.buildinfo",
    "chars": 230,
    "preview": "# Sphinx build info version 1\n# This file hashes the configuration used when building these files. When it is not found,"
  },
  {
    "path": "docs/.nojekyll",
    "chars": 0,
    "preview": ""
  },
  {
    "path": "docs/_modules/index.html",
    "chars": 23527,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_modules/sed_eval/audio_tag.html",
    "chars": 119587,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_modules/sed_eval/io.html",
    "chars": 34699,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_modules/sed_eval/metric.html",
    "chars": 54277,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_modules/sed_eval/scene.html",
    "chars": 75794,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_modules/sed_eval/sound_event.html",
    "chars": 266928,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_modules/sed_eval/test.html",
    "chars": 29302,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_modules/sed_eval/util/event_list.html",
    "chars": 35159,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_modules/sed_eval/util/event_matching.html",
    "chars": 34924,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_modules/sed_eval/util/event_roll.html",
    "chars": 38341,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_modules/sed_eval/util/scene_list.html",
    "chars": 26730,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/_sources/audio_tag.rst.txt",
    "chars": 240,
    "preview": ".. _audio_tag:\n\nAudio Tagging\n=============\n\nThe goal of audio tagging is to assign tags (one or many) to audio signal. "
  },
  {
    "path": "docs/_sources/changelog.rst.txt",
    "chars": 552,
    "preview": "Changes\n=======\n\nv0.2.0\n------\n\n- Audio tagging evaluator class added\n- Equal error rate metric added\n- Meta data readin"
  },
  {
    "path": "docs/_sources/generated/sed_eval.audio_tag.AudioTaggingMetrics.evaluate.rst.txt",
    "chars": 180,
    "preview": "sed_eval.audio_tag.AudioTaggingMetrics.evaluate\n===============================================\n\n.. currentmodule:: sed_"
  },
  {
    "path": "docs/_sources/generated/sed_eval.audio_tag.AudioTaggingMetrics.reset.rst.txt",
    "chars": 171,
    "preview": "sed_eval.audio_tag.AudioTaggingMetrics.reset\n============================================\n\n.. currentmodule:: sed_eval.a"
  },
  {
    "path": "docs/_sources/generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise.rst.txt",
    "chars": 228,
    "preview": "sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise\n========================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average.rst.txt",
    "chars": 252,
    "preview": "sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average\n================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters.rst.txt",
    "chars": 228,
    "preview": "sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters\n========================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.audio_tag.AudioTaggingMetrics.results.rst.txt",
    "chars": 177,
    "preview": "sed_eval.audio_tag.AudioTaggingMetrics.results\n==============================================\n\n.. currentmodule:: sed_ev"
  },
  {
    "path": "docs/_sources/generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics.rst.txt",
    "chars": 258,
    "preview": "sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics\n=============================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics.rst.txt",
    "chars": 234,
    "preview": "sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics\n======================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics.rst.txt",
    "chars": 225,
    "preview": "sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics\n========================================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.audio_tag.AudioTaggingMetrics.rst.txt",
    "chars": 779,
    "preview": "sed_eval.audio_tag.AudioTaggingMetrics\n======================================\n\n.. currentmodule:: sed_eval.audio_tag\n\n.."
  },
  {
    "path": "docs/_sources/generated/sed_eval.io.load_event_list.rst.txt",
    "chars": 122,
    "preview": "sed_eval.io.load_event_list\n===========================\n\n.. currentmodule:: sed_eval.io\n\n.. autofunction:: load_event_li"
  },
  {
    "path": "docs/_sources/generated/sed_eval.io.load_file_pair_list.rst.txt",
    "chars": 134,
    "preview": "sed_eval.io.load_file_pair_list\n===============================\n\n.. currentmodule:: sed_eval.io\n\n.. autofunction:: load_"
  },
  {
    "path": "docs/_sources/generated/sed_eval.io.load_scene_list.rst.txt",
    "chars": 122,
    "preview": "sed_eval.io.load_scene_list\n===========================\n\n.. currentmodule:: sed_eval.io\n\n.. autofunction:: load_scene_li"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.accuracy.rst.txt",
    "chars": 113,
    "preview": "sed_eval.metric.accuracy\n========================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction:: accuracy"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.accuracy2.rst.txt",
    "chars": 116,
    "preview": "sed_eval.metric.accuracy2\n=========================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction:: accuracy2"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.balanced_accuracy.rst.txt",
    "chars": 140,
    "preview": "sed_eval.metric.balanced_accuracy\n=================================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.deletion_rate.rst.txt",
    "chars": 128,
    "preview": "sed_eval.metric.deletion_rate\n=============================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction:: delet"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.equal_error_rate.rst.txt",
    "chars": 137,
    "preview": "sed_eval.metric.equal_error_rate\n================================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction::"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.error_rate.rst.txt",
    "chars": 119,
    "preview": "sed_eval.metric.error_rate\n==========================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction:: error_rate"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.f_measure.rst.txt",
    "chars": 116,
    "preview": "sed_eval.metric.f_measure\n=========================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction:: f_measure"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.insertion_rate.rst.txt",
    "chars": 131,
    "preview": "sed_eval.metric.insertion_rate\n==============================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction:: ins"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.precision.rst.txt",
    "chars": 116,
    "preview": "sed_eval.metric.precision\n=========================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction:: precision"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.recall.rst.txt",
    "chars": 107,
    "preview": "sed_eval.metric.recall\n======================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction:: recall"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.sensitivity.rst.txt",
    "chars": 122,
    "preview": "sed_eval.metric.sensitivity\n===========================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction:: sensitivi"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.specificity.rst.txt",
    "chars": 122,
    "preview": "sed_eval.metric.specificity\n===========================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction:: specifici"
  },
  {
    "path": "docs/_sources/generated/sed_eval.metric.substitution_rate.rst.txt",
    "chars": 140,
    "preview": "sed_eval.metric.substitution_rate\n=================================\n\n.. currentmodule:: sed_eval.metric\n\n.. autofunction"
  },
  {
    "path": "docs/_sources/generated/sed_eval.scene.SceneClassificationMetrics.evaluate.rst.txt",
    "chars": 189,
    "preview": "sed_eval.scene.SceneClassificationMetrics.evaluate\n==================================================\n\n.. currentmodule:"
  },
  {
    "path": "docs/_sources/generated/sed_eval.scene.SceneClassificationMetrics.reset.rst.txt",
    "chars": 180,
    "preview": "sed_eval.scene.SceneClassificationMetrics.reset\n===============================================\n\n.. currentmodule:: sed_"
  },
  {
    "path": "docs/_sources/generated/sed_eval.scene.SceneClassificationMetrics.result_report_class_wise.rst.txt",
    "chars": 237,
    "preview": "sed_eval.scene.SceneClassificationMetrics.result_report_class_wise\n====================================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average.rst.txt",
    "chars": 261,
    "preview": "sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average\n============================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.scene.SceneClassificationMetrics.result_report_parameters.rst.txt",
    "chars": 237,
    "preview": "sed_eval.scene.SceneClassificationMetrics.result_report_parameters\n====================================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.scene.SceneClassificationMetrics.results.rst.txt",
    "chars": 186,
    "preview": "sed_eval.scene.SceneClassificationMetrics.results\n=================================================\n\n.. currentmodule:: "
  },
  {
    "path": "docs/_sources/generated/sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics.rst.txt",
    "chars": 267,
    "preview": "sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics\n==========================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics.rst.txt",
    "chars": 243,
    "preview": "sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics\n==================================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.scene.SceneClassificationMetrics.results_overall_metrics.rst.txt",
    "chars": 234,
    "preview": "sed_eval.scene.SceneClassificationMetrics.results_overall_metrics\n======================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.scene.SceneClassificationMetrics.rst.txt",
    "chars": 863,
    "preview": "sed_eval.scene.SceneClassificationMetrics\n=========================================\n\n.. currentmodule:: sed_eval.scene\n\n"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.evaluate.rst.txt",
    "chars": 180,
    "preview": "sed_eval.sound_event.EventBasedMetrics.evaluate\n===============================================\n\n.. currentmodule:: sed_"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.reset.rst.txt",
    "chars": 171,
    "preview": "sed_eval.sound_event.EventBasedMetrics.reset\n============================================\n\n.. currentmodule:: sed_eval.s"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.result_report_class_wise.rst.txt",
    "chars": 228,
    "preview": "sed_eval.sound_event.EventBasedMetrics.result_report_class_wise\n========================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average.rst.txt",
    "chars": 252,
    "preview": "sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average\n================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.result_report_overall.rst.txt",
    "chars": 219,
    "preview": "sed_eval.sound_event.EventBasedMetrics.result_report_overall\n==========================================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.result_report_parameters.rst.txt",
    "chars": 228,
    "preview": "sed_eval.sound_event.EventBasedMetrics.result_report_parameters\n========================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.results.rst.txt",
    "chars": 177,
    "preview": "sed_eval.sound_event.EventBasedMetrics.results\n==============================================\n\n.. currentmodule:: sed_ev"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics.rst.txt",
    "chars": 258,
    "preview": "sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics\n=============================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics.rst.txt",
    "chars": 234,
    "preview": "sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics\n======================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.results_overall_metrics.rst.txt",
    "chars": 225,
    "preview": "sed_eval.sound_event.EventBasedMetrics.results_overall_metrics\n========================================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.EventBasedMetrics.rst.txt",
    "chars": 1147,
    "preview": "sed_eval.sound_event.EventBasedMetrics\n======================================\n\n.. currentmodule:: sed_eval.sound_event\n\n"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.evaluate.rst.txt",
    "chars": 186,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics.evaluate\n=================================================\n\n.. currentmodule:: "
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.reset.rst.txt",
    "chars": 177,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics.reset\n==============================================\n\n.. currentmodule:: sed_ev"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise.rst.txt",
    "chars": 234,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise\n======================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average.rst.txt",
    "chars": 258,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average\n=============================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_overall.rst.txt",
    "chars": 225,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics.result_report_overall\n========================================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters.rst.txt",
    "chars": 234,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters\n======================================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.results.rst.txt",
    "chars": 183,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics.results\n================================================\n\n.. currentmodule:: se"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics.rst.txt",
    "chars": 264,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics\n============================================"
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics.rst.txt",
    "chars": 240,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics\n===================================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics.rst.txt",
    "chars": 231,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics\n======================================================="
  },
  {
    "path": "docs/_sources/generated/sed_eval.sound_event.SegmentBasedMetrics.rst.txt",
    "chars": 1108,
    "preview": "sed_eval.sound_event.SegmentBasedMetrics\n========================================\n\n.. currentmodule:: sed_eval.sound_eve"
  },
  {
    "path": "docs/_sources/generated/sed_eval.test.mcnemar.rst.txt",
    "chars": 104,
    "preview": "sed_eval.test.mcnemar\n=====================\n\n.. currentmodule:: sed_eval.test\n\n.. autofunction:: mcnemar"
  },
  {
    "path": "docs/_sources/generated/sed_eval.util.event_list.filter_event_list.rst.txt",
    "chars": 167,
    "preview": "sed_eval.util.event_list.filter_event_list\n==========================================\n\n.. currentmodule:: sed_eval.util."
  },
  {
    "path": "docs/_sources/generated/sed_eval.util.event_list.max_event_offset.rst.txt",
    "chars": 164,
    "preview": "sed_eval.util.event_list.max_event_offset\n=========================================\n\n.. currentmodule:: sed_eval.util.ev"
  },
  {
    "path": "docs/_sources/generated/sed_eval.util.event_list.unique_event_labels.rst.txt",
    "chars": 173,
    "preview": "sed_eval.util.event_list.unique_event_labels\n============================================\n\n.. currentmodule:: sed_eval.u"
  },
  {
    "path": "docs/_sources/generated/sed_eval.util.event_list.unique_files.rst.txt",
    "chars": 152,
    "preview": "sed_eval.util.event_list.unique_files\n=====================================\n\n.. currentmodule:: sed_eval.util.event_list"
  },
  {
    "path": "docs/_sources/generated/sed_eval.util.event_matching.bipartite_match.rst.txt",
    "chars": 173,
    "preview": "sed_eval.util.event_matching.bipartite_match\n============================================\n\n.. currentmodule:: sed_eval.u"
  },
  {
    "path": "docs/_sources/generated/sed_eval.util.event_roll.event_list_to_event_roll.rst.txt",
    "chars": 188,
    "preview": "sed_eval.util.event_roll.event_list_to_event_roll\n=================================================\n\n.. currentmodule:: "
  },
  {
    "path": "docs/_sources/generated/sed_eval.util.event_roll.match_event_roll_lengths.rst.txt",
    "chars": 188,
    "preview": "sed_eval.util.event_roll.match_event_roll_lengths\n=================================================\n\n.. currentmodule:: "
  },
  {
    "path": "docs/_sources/generated/sed_eval.util.event_roll.pad_event_roll.rst.txt",
    "chars": 158,
    "preview": "sed_eval.util.event_roll.pad_event_roll\n=======================================\n\n.. currentmodule:: sed_eval.util.event_"
  },
  {
    "path": "docs/_sources/generated/sed_eval.util.scene_list.unique_scene_labels.rst.txt",
    "chars": 173,
    "preview": "sed_eval.util.scene_list.unique_scene_labels\n============================================\n\n.. currentmodule:: sed_eval.u"
  },
  {
    "path": "docs/_sources/glossary.rst.txt",
    "chars": 1210,
    "preview": "Glossary\n========\n\n.. glossary::\n    acoustic scene\n        Descriptor for surrounding audio environment, for example \"o"
  },
  {
    "path": "docs/_sources/index.rst.txt",
    "chars": 1830,
    "preview": "``sed_eval`` - Evaluation toolbox for Sound Event Detection\n===========================================================\n"
  },
  {
    "path": "docs/_sources/install.rst.txt",
    "chars": 1130,
    "preview": ".. _install:\n\nInstallation instructions\n=========================\n\nUsing pip\n---------\n\nThe latest stable release is ava"
  },
  {
    "path": "docs/_sources/io.rst.txt",
    "chars": 37,
    "preview": ".. _io:\n\n.. automodule:: sed_eval.io\n"
  },
  {
    "path": "docs/_sources/metric.rst.txt",
    "chars": 72,
    "preview": ".. _metric:\n\nMetrics\n==================\n\n.. automodule:: sed_eval.metric"
  },
  {
    "path": "docs/_sources/scene.rst.txt",
    "chars": 468,
    "preview": ".. _scene:\n\nAcoustic Scene Classification\n=============================\n\nThe goal of acoustic scene classification is to"
  },
  {
    "path": "docs/_sources/sound_event.rst.txt",
    "chars": 5763,
    "preview": ".. _sound_event:\n\nSound Event Detection\n=====================\n\nThe task of sound event detection involves locating and c"
  },
  {
    "path": "docs/_sources/test.rst.txt",
    "chars": 53,
    "preview": ".. _test:\n\nTests\n=====\n\n.. automodule:: sed_eval.test"
  },
  {
    "path": "docs/_sources/tutorial.rst.txt",
    "chars": 13981,
    "preview": "Tutorial\n========\n\n.. _sed_eval:\n\n``sed_eval`` -- Evaluation toolbox for Sound Event Detection\n-------------------------"
  },
  {
    "path": "docs/_sources/util.rst.txt",
    "chars": 41,
    "preview": ".. _util:\n\n.. automodule:: sed_eval.util\n"
  },
  {
    "path": "docs/_static/basic.css",
    "chars": 10199,
    "preview": "/*\n * basic.css\n * ~~~~~~~~~\n *\n * Sphinx stylesheet -- basic theme.\n *\n * :copyright: Copyright 2007-2016 by the Sphinx"
  },
  {
    "path": "docs/_static/css/badge_only.css",
    "chars": 3354,
    "preview": ".fa:before{-webkit-font-smoothing:antialiased}.clearfix{*zoom:1}.clearfix:before,.clearfix:after{display:table;content:"
  },
  {
    "path": "docs/_static/css/theme.css",
    "chars": 110995,
    "preview": "*{-webkit-box-sizing:border-box;-moz-box-sizing:border-box;box-sizing:border-box}article,aside,details,figcaption,figur"
  },
  {
    "path": "docs/_static/doctools.js",
    "chars": 8166,
    "preview": "/*\n * doctools.js\n * ~~~~~~~~~~~\n *\n * Sphinx JavaScript utilities for all documentation.\n *\n * :copyright: Copyright 20"
  },
  {
    "path": "docs/_static/jquery-3.1.0.js",
    "chars": 263767,
    "preview": "/*eslint-disable no-unused-vars*/\n/*!\n * jQuery JavaScript Library v3.1.0\n * https://jquery.com/\n *\n * Includes Sizzle.j"
  },
  {
    "path": "docs/_static/jquery.js",
    "chars": 86351,
    "preview": "/*! jQuery v3.1.0 | (c) jQuery Foundation | jquery.org/license */\n!function(a,b){\"use strict\";\"object\"==typeof module&&\""
  },
  {
    "path": "docs/_static/js/theme.js",
    "chars": 6477,
    "preview": "require=(function e(t,n,r){function s(o,u){if(!n[o]){if(!t[o]){var a=typeof require==\"function\"&&require;if(!u&&a)return"
  },
  {
    "path": "docs/_static/pygments.css",
    "chars": 4395,
    "preview": ".highlight .hll { background-color: #ffffcc }\n.highlight  { background: #eeffcc; }\n.highlight .c { color: #408090; font-"
  },
  {
    "path": "docs/_static/searchtools.js",
    "chars": 25370,
    "preview": "/*\n * searchtools.js_t\n * ~~~~~~~~~~~~~~~~\n *\n * Sphinx JavaScript utilities for the full-text search.\n *\n * :copyright:"
  },
  {
    "path": "docs/_static/theme_overrides.css",
    "chars": 246,
    "preview": "p {\n    text-align: justify;\n    text-justify: inter-word;\n}\n\n.caption-text{\n    text-align: center;\n    font-size: 16px"
  },
  {
    "path": "docs/_static/underscore-1.3.1.js",
    "chars": 35168,
    "preview": "//     Underscore.js 1.3.1\n//     (c) 2009-2012 Jeremy Ashkenas, DocumentCloud Inc.\n//     Underscore is freely distribu"
  },
  {
    "path": "docs/_static/underscore.js",
    "chars": 12140,
    "preview": "// Underscore.js 1.3.1\n// (c) 2009-2012 Jeremy Ashkenas, DocumentCloud Inc.\n// Underscore is freely distributable under "
  },
  {
    "path": "docs/_static/websupport.js",
    "chars": 25351,
    "preview": "/*\n * websupport.js\n * ~~~~~~~~~~~~~\n *\n * sphinx.websupport utilities for all documentation.\n *\n * :copyright: Copyrigh"
  },
  {
    "path": "docs/audio_tag.html",
    "chars": 50643,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/changelog.html",
    "chars": 24430,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.audio_tag.AudioTaggingMetrics.evaluate.html",
    "chars": 24988,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.audio_tag.AudioTaggingMetrics.html",
    "chars": 28602,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.audio_tag.AudioTaggingMetrics.reset.html",
    "chars": 23903,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise.html",
    "chars": 24667,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_class_wise_average.html",
    "chars": 24632,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.audio_tag.AudioTaggingMetrics.result_report_parameters.html",
    "chars": 24674,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.audio_tag.AudioTaggingMetrics.results.html",
    "chars": 24401,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_average_metrics.html",
    "chars": 24736,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.audio_tag.AudioTaggingMetrics.results_class_wise_metrics.html",
    "chars": 24683,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.audio_tag.AudioTaggingMetrics.results_overall_metrics.html",
    "chars": 24557,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.io.load_event_list.html",
    "chars": 27249,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.io.load_file_pair_list.html",
    "chars": 25015,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.io.load_scene_list.html",
    "chars": 26599,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.accuracy.html",
    "chars": 24693,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.accuracy2.html",
    "chars": 25271,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.balanced_accuracy.html",
    "chars": 24784,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.deletion_rate.html",
    "chars": 24585,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.equal_error_rate.html",
    "chars": 24895,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.error_rate.html",
    "chars": 24633,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.f_measure.html",
    "chars": 24585,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.insertion_rate.html",
    "chars": 24592,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.precision.html",
    "chars": 24620,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.recall.html",
    "chars": 24588,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.sensitivity.html",
    "chars": 24709,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.specificity.html",
    "chars": 24683,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.metric.substitution_rate.html",
    "chars": 24613,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.scene.SceneClassificationMetrics.evaluate.html",
    "chars": 25157,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.scene.SceneClassificationMetrics.html",
    "chars": 28825,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.scene.SceneClassificationMetrics.reset.html",
    "chars": 23988,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.scene.SceneClassificationMetrics.result_report_class_wise.html",
    "chars": 24746,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.scene.SceneClassificationMetrics.result_report_class_wise_average.html",
    "chars": 24711,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.scene.SceneClassificationMetrics.result_report_parameters.html",
    "chars": 24753,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.scene.SceneClassificationMetrics.results.html",
    "chars": 24480,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.scene.SceneClassificationMetrics.results_class_wise_average_metrics.html",
    "chars": 24815,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.scene.SceneClassificationMetrics.results_class_wise_metrics.html",
    "chars": 24762,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.scene.SceneClassificationMetrics.results_overall_metrics.html",
    "chars": 24636,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.evaluate.html",
    "chars": 24726,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.html",
    "chars": 35876,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.reset.html",
    "chars": 23987,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.result_report_class_wise.html",
    "chars": 24532,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.result_report_class_wise_average.html",
    "chars": 24501,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.result_report_overall.html",
    "chars": 24485,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.result_report_parameters.html",
    "chars": 24704,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.results.html",
    "chars": 24295,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_average_metrics.html",
    "chars": 24603,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.results_class_wise_metrics.html",
    "chars": 24558,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.EventBasedMetrics.results_overall_metrics.html",
    "chars": 24435,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.evaluate.html",
    "chars": 25080,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.html",
    "chars": 33126,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.reset.html",
    "chars": 24091,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise.html",
    "chars": 24564,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_class_wise_average.html",
    "chars": 24533,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_overall.html",
    "chars": 24517,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.result_report_parameters.html",
    "chars": 24738,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.results.html",
    "chars": 24327,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_average_metrics.html",
    "chars": 24635,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.results_class_wise_metrics.html",
    "chars": 24590,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.sound_event.SegmentBasedMetrics.results_overall_metrics.html",
    "chars": 24467,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.test.mcnemar.html",
    "chars": 24407,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.util.event_list.filter_event_list.html",
    "chars": 24929,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.util.event_list.max_event_offset.html",
    "chars": 24604,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.util.event_list.unique_event_labels.html",
    "chars": 24448,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.util.event_list.unique_files.html",
    "chars": 24545,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.util.event_matching.bipartite_match.html",
    "chars": 24835,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.util.event_roll.event_list_to_event_roll.html",
    "chars": 25076,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.util.event_roll.match_event_roll_lengths.html",
    "chars": 25106,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.util.event_roll.pad_event_roll.html",
    "chars": 24720,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/generated/sed_eval.util.scene_list.unique_scene_labels.html",
    "chars": 24629,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/genindex.html",
    "chars": 46520,
    "preview": "\n\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class="
  },
  {
    "path": "docs/glossary.html",
    "chars": 24970,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/index.html",
    "chars": 28097,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/install.html",
    "chars": 27425,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/io.html",
    "chars": 24805,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/metric.html",
    "chars": 28027,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/py-modindex.html",
    "chars": 24367,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/scene.html",
    "chars": 37370,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/search.html",
    "chars": 22811,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/searchindex.js",
    "chars": 30129,
    "preview": "Search.setIndex({docnames:[\"audio_tag\",\"changelog\",\"generated/sed_eval.audio_tag.AudioTaggingMetrics\",\"generated/sed_eva"
  },
  {
    "path": "docs/sound_event.html",
    "chars": 92620,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/test.html",
    "chars": 23930,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/tutorial.html",
    "chars": 64921,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "docs/util.html",
    "chars": 28596,
    "preview": "\n\n<!DOCTYPE html>\n<!--[if IE 8]><html class=\"no-js lt-ie9\" lang=\"en\" > <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\""
  },
  {
    "path": "documentation/Makefile",
    "chars": 7747,
    "preview": "# Makefile for Sphinx documentation\n#\n\n# You can set these variables from the command line.\nSPHINXOPTS    =\nSPHINXBUILD "
  },
  {
    "path": "documentation/README.md",
    "chars": 310,
    "preview": "Documentation\n=============\n\nThis directory contains Sphinx documentation sources. To compile document, run \n\n    make h"
  },
  {
    "path": "documentation/requirements.txt",
    "chars": 85,
    "preview": "sphinx>=1.5.1\nsphinx_rtd_theme>=0.1.9\nnumpydoc>=0.6.0\nsphinx_bootstrap_theme >= 0.6.5"
  }
]

// ... and 83 more files (download for full content)

About this extraction

This page contains the full source code of the TUT-ARG/sed_eval GitHub repository, extracted and formatted as plain text for AI agents and large language models (LLMs). The extraction includes 283 files (4.3 MB), approximately 1.1M tokens, and a symbol index with 325 extracted functions, classes, methods, constants, and types. Use this with OpenClaw, Claude, ChatGPT, Cursor, Windsurf, or any other AI tool that accepts text input. You can copy the full output to your clipboard or download it as a .txt file.

Extracted by GitExtract — free GitHub repo to text converter for AI. Built by Nikandr Surkov.

Copied to clipboard!