[
  {
    "path": ".gitignore",
    "content": "__pycache__"
  },
  {
    "path": "LICENSE",
    "content": "MIT License\n\nCopyright (c) [year] [fullname]\n\nPermission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the \"Software\"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.\n"
  },
  {
    "path": "README.md",
    "content": "# 🔎 KURE: Korea University Retrieval Embedding model\n\n## Update Logs\n- 2024.12.21: [🤗 KURE-v1](https://huggingface.co/nlpai-lab/KURE-v1), [MTEB-ko-retrieval Leaderboard](https://github.com/nlpai-lab/KURE?tab=readme-ov-file#mteb-ko-retrieval-leaderboard) 공개\n- 2024.10.02: [🤗 KoE5](https://huggingface.co/nlpai-lab/KoE5), [🤗 ko-triplet-v1.0](https://huggingface.co/datasets/nlpai-lab/ko-triplet-v1.0) 공개\n\n---\n\n<br>\n\nKURE는 고려대학교 [NLP & AI 연구실](http://nlp.korea.ac.kr/)과 [HIAI 연구소](http://hiai.korea.ac.kr)가 개발한 한국어 특화 임베딩 모델입니다.\n\nKURE를 공개합니다.  \n<br/>\n\n## KURE 모델 실행 코드\n### sentence-transformers로 실행\n```bash\npip install sentence-transformers\n```\n\n아래 예제 코드로 실행해볼 수 있습니다.\n\n```python\nfrom sentence_transformers import SentenceTransformer\n\n# Download from the 🤗 Hub\n\nmodel = SentenceTransformer(\"nlpai-lab/KURE-v1\")\n# model = SentenceTransformer(\"nlpai-lab/KoE5\")\n\n# Run inference\nsentences = [\n    '헌법과 법원조직법은 어떤 방식을 통해 기본권 보장 등의 다양한 법적 모색을 가능하게 했어',\n    '4. 시사점과 개선방향 앞서 살펴본 바와 같이 우리 헌법과 ｢법원조직 법｣은 대법원 구성을 다양화하여 기본권 보장과 민주주의 확립에 있어 다각적인 법적 모색을 가능하게 하는 것을 근본 규범으로 하고 있다. 더욱이 합의체로서의 대법원 원리를 채택하고 있는 것 역시 그 구성의 다양성을 요청하는 것으로 해석된다. 이와 같은 관점에서 볼 때 현직 법원장급 고위법관을 중심으로 대법원을 구성하는 관행은 개선할 필요가 있는 것으로 보인다.',\n    '연방헌법재판소는 2001년 1월 24일 5:3의 다수견해로 「법원조직법」 제169조 제2문이 헌법에 합치된다는 판결을 내렸음 ○ 5인의 다수 재판관은 소송관계인의 인격권 보호, 공정한 절차의 보장과 방해받지 않는 법과 진실 발견 등을 근거로 하여 텔레비전 촬영에 대한 절대적인 금지를 헌법에 합치하는 것으로 보았음 ○ 그러나 나머지 3인의 재판관은 행정법원의 소송절차는 특별한 인격권 보호의 이익도 없으며, 텔레비전 공개주의로 인해 법과 진실 발견의 과정이 언제나 위태롭게 되는 것은 아니라면서 반대의견을 제시함 ○ 왜냐하면 행정법원의 소송절차에서는 소송당사자가 개인적으로 직접 심리에 참석하기보다는 변호사가 참석하는 경우가 많으며, 심리대상도 사실문제가 아닌 법률문제가 대부분이기 때문이라는 것임 □ 한편, 연방헌법재판소는 「연방헌법재판소법」(Bundesverfassungsgerichtsgesetz: BVerfGG) 제17a조에 따라 제한적이나마 재판에 대한 방송을 허용하고 있음 ○ 「연방헌법재판소법」 제17조에서 「법원조직법」 제14절 내지 제16절의 규정을 준용하도록 하고 있지만, 녹음이나 촬영을 통한 재판공개와 관련하여서는 「법원조직법」과 다른 내용을 규정하고 있음',\n]\nembeddings = model.encode(sentences)\nprint(embeddings.shape)\n# [3, 1024]\n\n# Get the similarity scores for the embeddings\nsimilarities = model.similarity(embeddings, embeddings)\nprint(similarities)\n# Results for KURE-v1\n# tensor([[1.0000, 0.6967, 0.5306],\n#         [0.6967, 1.0000, 0.4427],\n#         [0.5306, 0.4427, 1.0000]])\n\n# Results for KoE5\n# tensor([[1.0000, 0.6721, 0.3897],\n#        [0.6721, 1.0000, 0.3740],\n#        [0.3897, 0.3740, 1.0000]])\n```\n\n<br/>\n\n## MTEB-ko-retrieval Leaderboard\n[MTEB](https://github.com/embeddings-benchmark/mteb)에 등록된 모든 Korean Retrieval Benchmark에 대한 평가를 진행하였습니다.\n### Korean Retrieval Benchmark\n- [Ko-StrategyQA](https://huggingface.co/datasets/taeminlee/Ko-StrategyQA): 한국어 ODQA multi-hop 검색 데이터셋 (StrategyQA 번역)\n- [AutoRAGRetrieval](https://huggingface.co/datasets/yjoonjang/markers_bm): 금융, 공공, 의료, 법률, 커머스 5개 분야에 대해, pdf를 파싱하여 구성한 한국어 문서 검색 데이터셋\n- [MIRACLRetrieval](https://huggingface.co/datasets/miracl/miracl): Wikipedia 기반의 한국어 문서 검색 데이터셋\n- [PublicHealthQA](https://huggingface.co/datasets/xhluca/publichealth-qa): 의료 및 공중보건 도메인에 대한 한국어 문서 검색 데이터셋\n- [BelebeleRetrieval](https://huggingface.co/datasets/facebook/belebele): FLORES-200 기반의 한국어 문서 검색 데이터셋\n- [MrTidyRetrieval](https://huggingface.co/datasets/mteb/mrtidy): Wikipedia 기반의 한국어 문서 검색 데이터셋\n- [MultiLongDocRetrieval](https://huggingface.co/datasets/Shitao/MLDR): 다양한 도메인의 한국어 장문 검색 데이터셋\n- [XPQARetrieval](https://huggingface.co/datasets/jinaai/xpqa): 다양한 도메인의 한국어 문서 검색 데이터셋\n\n### Evaluation code\n`evaluate.py`에 모델을 추가하여 mteb를 활용한 평가를 진행할 수 있습니다.\n```bash\ncd eval\npip install -r requirements.txt\npython evaluate.py\n```\n\n### Leaderboard\nstreamlit을 통해 모든 모델의 모든 태스크에 대한 평가 결과를 시각화합니다.\n```bash\nstreamlit run leaderboard.py\n```\n\n아래는 모든 모델의, 모든 벤치마크 데이터셋에 대한 평균 결과입니다.\n자세한 결과는 `eval/results`폴더에서 확인하실 수 있습니다.\n### Top-k 1\n| Model                                   | Average Recall | Average Precision | Average NDCG | Average F1 |\n|-----------------------------------------|----------------------|------------------------|-------------------|-----------------|\n| **nlpai-lab/KURE-v1**                   | **0.52640**          | **0.60551**            | **0.60551**       | **0.55784**     |\n| dragonkue/BGE-m3-ko                     | 0.52361              | 0.60394                | 0.60394           | 0.55535         |\n| BAAI/bge-m3                             | 0.51778              | 0.59846                | 0.59846           | 0.54998         |\n| Snowflake/snowflake-arctic-embed-l-v2.0 | 0.51246              | 0.59384                | 0.59384           | 0.54489         |\n| nlpai-lab/KoE5                          | 0.50157              | 0.57790                | 0.57790           | 0.53178         |\n| intfloat/multilingual-e5-large          | 0.50052              | 0.57727                | 0.57727           | 0.53122         |\n| jinaai/jina-embeddings-v3               | 0.48287              | 0.56068                | 0.56068           | 0.51361         |\n| BAAI/bge-multilingual-gemma2            | 0.47904              | 0.55472                | 0.55472           | 0.50916         |\n| intfloat/multilingual-e5-large-instruct | 0.47842              | 0.55435                | 0.55435           | 0.50826         |\n| intfloat/multilingual-e5-base           | 0.46950              | 0.54490                | 0.54490           | 0.49947         |\n| intfloat/e5-mistral-7b-instruct         | 0.46772              | 0.54394                | 0.54394           | 0.49781         |\n| Alibaba-NLP/gte-multilingual-base       | 0.46469              | 0.53744                | 0.53744           | 0.49353         |\n| Alibaba-NLP/gte-Qwen2-7B-instruct       | 0.46633              | 0.53625                | 0.53625           | 0.49429         |\n| openai/text-embedding-3-large           | 0.44884              | 0.51688                | 0.51688           | 0.47572         |\n| Salesforce/SFR-Embedding-2_R            | 0.43748              | 0.50815                | 0.50815           | 0.46504         |\n| upskyy/bge-m3-korean                    | 0.43125              | 0.50245                | 0.50245           | 0.45945         |\n| jhgan/ko-sroberta-multitask             | 0.33788              | 0.38497                | 0.38497           | 0.35678         |\n\n### Top-k 3\n| Model                                   | Average Recall | Average Precision | Average NDCG | Average F1 |\n|-----------------------------------------|----------------------|------------------------|-------------------|-----------------|\n| **nlpai-lab/KURE-v1**                   | **0.68678**          | **0.28711**            | **0.65538**       | **0.39835**     |\n| dragonkue/BGE-m3-ko                     | 0.67834              | 0.28385                | 0.64950           | 0.39378         |\n| BAAI/bge-m3                             | 0.67526              | 0.28374                | 0.64556           | 0.39291         |\n| Snowflake/snowflake-arctic-embed-l-v2.0 | 0.67128              | 0.28193                | 0.64042           | 0.39072         |\n| intfloat/multilingual-e5-large          | 0.65807              | 0.27777                | 0.62822           | 0.38423         |\n| nlpai-lab/KoE5                          | 0.65174              | 0.27329                | 0.62369           | 0.37882         |\n| BAAI/bge-multilingual-gemma2            | 0.64415              | 0.27416                | 0.61105           | 0.37782         |\n| jinaai/jina-embeddings-v3               | 0.64116              | 0.27165                | 0.60954           | 0.37511         |\n| intfloat/multilingual-e5-large-instruct | 0.64353              | 0.27040                | 0.60790           | 0.37453         |\n| Alibaba-NLP/gte-multilingual-base       | 0.63744              | 0.26404                | 0.59695           | 0.36764         |\n| Alibaba-NLP/gte-Qwen2-7B-instruct       | 0.63163              | 0.25937                | 0.59237           | 0.36263         |\n| intfloat/multilingual-e5-base           | 0.62099              | 0.26144                | 0.59179           | 0.36203         |\n| intfloat/e5-mistral-7b-instruct         | 0.62087              | 0.26144                | 0.58917           | 0.36188         |\n| openai/text-embedding-3-large           | 0.61035              | 0.25356                | 0.57329           | 0.35270         |\n| Salesforce/SFR-Embedding-2_R            | 0.60001              | 0.25253                | 0.56346           | 0.34952         |\n| upskyy/bge-m3-korean                    | 0.59215              | 0.25076                | 0.55722           | 0.34623         |\n| jhgan/ko-sroberta-multitask             | 0.46930              | 0.18994                | 0.43293           | 0.26696         |\n\n### Top-k 5\n| Model                                   | Average Recall | Average Precision | Average NDCG | Average F1 |\n|-----------------------------------------|----------------------|------------------------|-------------------|-----------------|\n| **nlpai-lab/KURE-v1**                   | **0.73851**          | **0.19130**            | **0.67479**       | **0.29903**     |\n| dragonkue/BGE-m3-ko                     | 0.72517              | 0.18799                | 0.66692           | 0.29401         |\n| BAAI/bge-m3                             | 0.72954              | 0.18975                | 0.66615           | 0.29632         |\n| Snowflake/snowflake-arctic-embed-l-v2.0 | 0.72962              | 0.18875                | 0.66236           | 0.29542         |\n| nlpai-lab/KoE5                          | 0.70820              | 0.18287                | 0.64499           | 0.28628         |\n| intfloat/multilingual-e5-large          | 0.70124              | 0.18316                | 0.64402           | 0.28588         |\n| BAAI/bge-multilingual-gemma2            | 0.70258              | 0.18556                | 0.63338           | 0.28851         |\n| jinaai/jina-embeddings-v3               | 0.69933              | 0.18256                | 0.63133           | 0.28505         |\n| intfloat/multilingual-e5-large-instruct | 0.69018              | 0.17838                | 0.62486           | 0.27933         |\n| Alibaba-NLP/gte-multilingual-base       | 0.69365              | 0.17789                | 0.61896           | 0.27879         |\n| intfloat/multilingual-e5-base           | 0.67250              | 0.17406                | 0.61119           | 0.27247         |\n| Alibaba-NLP/gte-Qwen2-7B-instruct       | 0.67447              | 0.17114                | 0.60952           | 0.26943         |\n| intfloat/e5-mistral-7b-instruct         | 0.67449              | 0.17484                | 0.60935           | 0.27349         |\n| openai/text-embedding-3-large           | 0.66365              | 0.17004                | 0.59389           | 0.26677         |\n| Salesforce/SFR-Embedding-2_R            | 0.65622              | 0.17018                | 0.58494           | 0.26612         |\n| upskyy/bge-m3-korean                    | 0.65477              | 0.17015                | 0.58073           | 0.26589         |\n| jhgan/ko-sroberta-multitask             | 0.53136              | 0.13264                | 0.45879           | 0.20976         |\n\n### Top-k 10\n| Model                                   | Average Recall | Average Precision | Average NDCG | Average F1 |\n|-----------------------------------------|----------------------|------------------------|-------------------|-----------------|\n| **nlpai-lab/KURE-v1**                   | **0.79682**          | **0.10624**            | **0.69473**       | **0.18524**     |\n| dragonkue/BGE-m3-ko                     | 0.78450              | 0.10492                | 0.68748           | 0.18288         |\n| BAAI/bge-m3                             | 0.79195              | 0.10592                | 0.68723           | 0.18456         |\n| Snowflake/snowflake-arctic-embed-l-v2.0 | 0.78669              | 0.10462                | 0.68189           | 0.18260         |\n| intfloat/multilingual-e5-large          | 0.75902              | 0.10147                | 0.66370           | 0.17693         |\n| nlpai-lab/KoE5                          | 0.75296              | 0.09937                | 0.66012           | 0.17369         |\n| BAAI/bge-multilingual-gemma2            | 0.76153              | 0.10364                | 0.65330           | 0.18003         |\n| jinaai/jina-embeddings-v3               | 0.76277              | 0.10240                | 0.65290           | 0.17843         |\n| intfloat/multilingual-e5-large-instruct | 0.74851              | 0.09888                | 0.64451           | 0.17283         |\n| Alibaba-NLP/gte-multilingual-base       | 0.75631              | 0.09938                | 0.64025           | 0.17363         |\n| Alibaba-NLP/gte-Qwen2-7B-instruct       | 0.74092              | 0.09607                | 0.63258           | 0.16847         |\n| intfloat/multilingual-e5-base           | 0.73512              | 0.09717                | 0.63216           | 0.16977         |\n| intfloat/e5-mistral-7b-instruct         | 0.73795              | 0.09777                | 0.63076           | 0.17078         |\n| openai/text-embedding-3-large           | 0.72946              | 0.09571                | 0.61670           | 0.16739         |\n| Salesforce/SFR-Embedding-2_R            | 0.71662              | 0.09546                | 0.60589           | 0.16651         |\n| upskyy/bge-m3-korean                    | 0.71895              | 0.09583                | 0.60258           | 0.16712         |\n| jhgan/ko-sroberta-multitask             | 0.61225              | 0.07826                | 0.48687           | 0.13757         |\n<br/>\n\n## Training Details\n- KURE-v1은 [BAAI/bge-m3](https://huggingface.co/BAAI/bge-m3)를 기반으로 fine-tuning된 모델입니다.\n- KoE5는 [intfloat/multilingual-e5-large](https://huggingface.co/intfloat/multilingual-e5-large)를 기반으로 fine-tuning된 모델입니다.\n\n### Training Data\n**KURE-v1**\n- 한국어 query-document-hard_negative(5개) 데이터 쌍 \n- 약 2,000,000 examples\n\n**KoE5**\n- [ko-triplet-v1.0](https://huggingface.co/datasets/nlpai-lab/ko-triplet-v1.0)\n- 한국어 query-document-hard_negative(1개) 데이터 쌍 (open data)\n- 약 700,000+ examples\n\n### Training Procedure\n**KURE-v1**\n- loss: [CachedGISTEmbedLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cachedgistembedloss)\n- batch size: 4096\n- learning rate: 2e-05\n- epochs: 1\n\n**KoE5**\n- loss: [CachedMultipleNegativesRankingLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cachedmultiplenegativesrankingloss)\n- batch size: 512\n- learning rate: 1e-05\n- epochs: 1\n\n<br/>\n\n## 주의사항\n- KoE5 사용 시, prefix를 붙여 주어야 합니다. (query: {query}, passage: {document})\n  \n## License\n- ```MIT```\n\n## Citation\nIf you find our paper or models helpful, please consider cite as follows:\n```text\n@inproceedings{jang2025kure,\n  title={KURE: Embedding Model for Korean-Specific Retrieval},\n  author={Jang, Youngjoon and Son, Junyoung and Lee, Taemin and Hong, Seongtae and Park, JeongBae and Lim, Heuiseok},\n  booktitle={Annual Conference on Human and Language Technology},\n  pages={129--134},\n  year={2025},\n  organization={Human and Language Technology}\n},\n\n@inproceedings{jang2024koe5,\n  title={KoE5: A New Dataset and Model for Improving Korean Embedding Performance},\n  author={Jang, Youngjoon and Son, Junyoung and Park, Chanjun and Choi, Soonwoo and Lee, Byeonggoo and Lee, Taemin and Lim, Heuiseok},\n  booktitle={Annual Conference on Human and Language Technology},\n  pages={239--244},\n  year={2024},\n  organization={Human and Language Technology}\n}\n```\n"
  },
  {
    "path": "README_EN.md",
    "content": "# 🔎 KURE: Korea University Retrieval Embedding model\n\n## Update Logs\n- 2024.12.21: [🤗 KURE-v1](https://huggingface.co/nlpai-lab/KURE-v1) and the [MTEB-ko-retrieval Leaderboard](https://github.com/nlpai-lab/KURE/blob/main/README_EN.md#mteb-ko-retrieval-leaderboard) have been released.\n- 2024.10.02: [🤗 KoE5](https://huggingface.co/nlpai-lab/KoE5) and [🤗 ko-triplet-v1.0](https://huggingface.co/datasets/nlpai-lab/ko-triplet-v1.0) have been released.\n\n---\n\n<br>\n\nKURE is a Korean-specific embedding model developed by Korea University's [NLP & AI Lab](http://nlp.korea.ac.kr/) and [HIAI Research Institute](http://hiai.korea.ac.kr).\n\nWe are excited to release KURE.\n<br/>\n\n## How to Use KURE Models\n### With sentence-transformers\n```bash\npip install sentence-transformers\n```\n\nYou can run the model with the following example code.\n\n```python\nfrom sentence_transformers import SentenceTransformer\n\n# Download from the 🤗 Hub\n\nmodel = SentenceTransformer(\"nlpai-lab/KURE-v1\")\n# model = SentenceTransformer(\"nlpai-lab/KoE5\")\n\n# Run inference\nsentences = [\n    '헌법과 법원조직법은 어떤 방식을 통해 기본권 보장 등의 다양한 법적 모색을 가능하게 했어',\n    '4. 시사점과 개선방향 앞서 살펴본 바와 같이 우리 헌법과 ｢법원조직 법｣은 대법원 구성을 다양화하여 기본권 보장과 민주주의 확립에 있어 다각적인 법적 모색을 가능하게 하는 것을 근본 규범으로 하고 있다. 더욱이 합의체로서의 대법원 원리를 채택하고 있는 것 역시 그 구성의 다양성을 요청하는 것으로 해석된다. 이와 같은 관점에서 볼 때 현직 법원장급 고위법관을 중심으로 대법원을 구성하는 관행은 개선할 필요가 있는 것으로 보인다.',\n    '연방헌법재판소는 2001년 1월 24일 5:3의 다수견해로 「법원조직법」 제169조 제2문이 헌법에 합치된다는 판결을 내렸음 ○ 5인의 다수 재판관은 소송관계인의 인격권 보호, 공정한 절차의 보장과 방해받지 않는 법과 진실 발견 등을 근거로 하여 텔레비전 촬영에 대한 절대적인 금지를 헌법에 합치하는 것으로 보았음 ○ 그러나 나머지 3인의 재판관은 행정법원의 소송절차는 특별한 인격권 보호의 이익도 없으며, 텔레비전 공개주의로 인해 법과 진실 발견의 과정이 언제나 위태롭게 되는 것은 아니라면서 반대의견을 제시함 ○ 왜냐하면 행정법원의 소송절차에서는 소송당사자가 개인적으로 직접 심리에 참석하기보다는 변호사가 참석하는 경우가 많으며, 심리대상도 사실문제가 아닌 법률문제가 대부분이기 때문이라는 것임 □ 한편, 연방헌법재판소는 「연방헌법재판소법」(Bundesverfassungsgerichtsgesetz: BVerfGG) 제17a조에 따라 제한적이나마 재판에 대한 방송을 허용하고 있음 ○ 「연방헌법재판소법」 제17조에서 「법원조직법」 제14절 내지 제16절의 규정을 준용하도록 하고 있지만, 녹음이나 촬영을 통한 재판공개와 관련하여서는 「법원조직법」과 다른 내용을 규정하고 있음',\n]\nembeddings = model.encode(sentences)\nprint(embeddings.shape)\n# [3, 1024]\n\n# Get the similarity scores for the embeddings\nsimilarities = model.similarity(embeddings, embeddings)\nprint(similarities)\n# Results for KURE-v1\n# tensor([[1.0000, 0.6967, 0.5306],\n#         [0.6967, 1.0000, 0.4427],\n#         [0.5306, 0.4427, 1.0000]])\n\n# Results for KoE5\n# tensor([[1.0000, 0.6721, 0.3897],\n#        [0.6721, 1.0000, 0.3740],\n#        [0.3897, 0.3740, 1.0000]])\n```\n\n<br/>\n\n## MTEB-ko-retrieval Leaderboard\nWe evaluated our models on all Korean Retrieval Benchmarks registered in [MTEB](https://github.com/embeddings-benchmark/mteb).\n### Korean Retrieval Benchmark\n- [Ko-StrategyQA](https://huggingface.co/datasets/taeminlee/Ko-StrategyQA): Korean ODQA multi-hop retrieval dataset (Translated from StrategyQA).\n- [AutoRAGRetrieval](https://huggingface.co/datasets/yjoonjang/markers_bm): A Korean document retrieval dataset constructed by parsing PDFs from 5 domains: finance, public, medical, legal, and commerce.\n- [MIRACLRetrieval](https://huggingface.co/datasets/miracl/miracl): Wikipedia-based Korean document retrieval dataset.\n- [PublicHealthQA](https://huggingface.co/datasets/xhluca/publichealth-qa): Korean document retrieval dataset for the medical and public health domains.\n- [BelebeleRetrieval](https://huggingface.co/datasets/facebook/belebele): FLORES-200 based Korean document retrieval dataset.\n- [MrTidyRetrieval](https://huggingface.co/datasets/mteb/mrtidy): Wikipedia-based Korean document retrieval dataset.\n- [MultiLongDocRetrieval](https://huggingface.co/datasets/Shitao/MLDR): Korean long-document retrieval dataset from various domains.\n- [XPQARetrieval](https://huggingface.co/datasets/jinaai/xpqa): Korean document retrieval dataset from various domains.\n\n### Evaluation code\nYou can add a model to `evaluate.py` to evaluate it using MTEB.\n```bash\ncd eval\npip install -r requirements.txt\npython evaluate.py\n```\n\n### Leaderboard\nWe visualize the evaluation results for all models on all tasks via streamlit.\n```bash\nstreamlit run leaderboard.py\n```\n\nBelow are the average results for all models across all benchmark datasets.\nDetailed results can be found in the `eval/results` folder.\n\n### Top-k 1\n| Model                                   | Average Recall | Average Precision | Average NDCG | Average F1 |\n|-----------------------------------------|----------------------|------------------------|-------------------|-----------------|\n| **nlpai-lab/KURE-v1**                   | **0.52640**          | **0.60551**            | **0.60551**       | **0.55784**     |\n| dragonkue/BGE-m3-ko                     | 0.52361              | 0.60394                | 0.60394           | 0.55535         |\n| BAAI/bge-m3                             | 0.51778              | 0.59846                | 0.59846           | 0.54998         |\n| Snowflake/snowflake-arctic-embed-l-v2.0 | 0.51246              | 0.59384                | 0.59384           | 0.54489         |\n| nlpai-lab/KoE5                          | 0.50157              | 0.57790                | 0.57790           | 0.53178         |\n| intfloat/multilingual-e5-large          | 0.50052              | 0.57727                | 0.57727           | 0.53122         |\n| jinaai/jina-embeddings-v3               | 0.48287              | 0.56068                | 0.56068           | 0.51361         |\n| BAAI/bge-multilingual-gemma2            | 0.47904              | 0.55472                | 0.55472           | 0.50916         |\n| intfloat/multilingual-e5-large-instruct | 0.47842              | 0.55435                | 0.55435           | 0.50826         |\n| intfloat/multilingual-e5-base           | 0.46950              | 0.54490                | 0.54490           | 0.49947         |\n| intfloat/e5-mistral-7b-instruct         | 0.46772              | 0.54394                | 0.54394           | 0.49781         |\n| Alibaba-NLP/gte-multilingual-base       | 0.46469              | 0.53744                | 0.53744           | 0.49353         |\n| Alibaba-NLP/gte-Qwen2-7B-instruct       | 0.46633              | 0.53625                | 0.53625           | 0.49429         |\n| openai/text-embedding-3-large           | 0.44884              | 0.51688                | 0.51688           | 0.47572         |\n| Salesforce/SFR-Embedding-2_R            | 0.43748              | 0.50815                | 0.50815           | 0.46504         |\n| upskyy/bge-m3-korean                    | 0.43125              | 0.50245                | 0.50245           | 0.45945         |\n| jhgan/ko-sroberta-multitask             | 0.33788              | 0.38497                | 0.38497           | 0.35678         |\n\n### Top-k 3\n| Model                                   | Average Recall | Average Precision | Average NDCG | Average F1 |\n|-----------------------------------------|----------------------|------------------------|-------------------|-----------------|\n| **nlpai-lab/KURE-v1**                   | **0.68678**          | **0.28711**            | **0.65538**       | **0.39835**     |\n| dragonkue/BGE-m3-ko                     | 0.67834              | 0.28385                | 0.64950           | 0.39378         |\n| BAAI/bge-m3                             | 0.67526              | 0.28374                | 0.64556           | 0.39291         |\n| Snowflake/snowflake-arctic-embed-l-v2.0 | 0.67128              | 0.28193                | 0.64042           | 0.39072         |\n| intfloat/multilingual-e5-large          | 0.65807              | 0.27777                | 0.62822           | 0.38423         |\n| nlpai-lab/KoE5                          | 0.65174              | 0.27329                | 0.62369           | 0.37882         |\n| BAAI/bge-multilingual-gemma2            | 0.64415              | 0.27416                | 0.61105           | 0.37782         |\n| jinaai/jina-embeddings-v3               | 0.64116              | 0.27165                | 0.60954           | 0.37511         |\n| intfloat/multilingual-e5-large-instruct | 0.64353              | 0.27040                | 0.60790           | 0.37453         |\n| Alibaba-NLP/gte-multilingual-base       | 0.63744              | 0.26404                | 0.59695           | 0.36764         |\n| Alibaba-NLP/gte-Qwen2-7B-instruct       | 0.63163              | 0.25937                | 0.59237           | 0.36263         |\n| intfloat/multilingual-e5-base           | 0.62099              | 0.26144                | 0.59179           | 0.36203         |\n| intfloat/e5-mistral-7b-instruct         | 0.62087              | 0.26144                | 0.58917           | 0.36188         |\n| openai/text-embedding-3-large           | 0.61035              | 0.25356                | 0.57329           | 0.35270         |\n| Salesforce/SFR-Embedding-2_R            | 0.60001              | 0.25253                | 0.56346           | 0.34952         |\n| upskyy/bge-m3-korean                    | 0.59215              | 0.25076                | 0.55722           | 0.34623         |\n| jhgan/ko-sroberta-multitask             | 0.46930              | 0.18994                | 0.43293           | 0.26696         |\n\n### Top-k 5\n| Model                                   | Average Recall | Average Precision | Average NDCG | Average F1 |\n|-----------------------------------------|----------------------|------------------------|-------------------|-----------------|\n| **nlpai-lab/KURE-v1**                   | **0.73851**          | **0.19130**            | **0.67479**       | **0.29903**     |\n| dragonkue/BGE-m3-ko                     | 0.72517              | 0.18799                | 0.66692           | 0.29401         |\n| BAAI/bge-m3                             | 0.72954              | 0.18975                | 0.66615           | 0.29632         |\n| Snowflake/snowflake-arctic-embed-l-v2.0 | 0.72962              | 0.18875                | 0.66236           | 0.29542         |\n| nlpai-lab/KoE5                          | 0.70820              | 0.18287                | 0.64499           | 0.28628         |\n| intfloat/multilingual-e5-large          | 0.70124              | 0.18316                | 0.64402           | 0.28588         |\n| BAAI/bge-multilingual-gemma2            | 0.70258              | 0.18556                | 0.63338           | 0.28851         |\n| jinaai/jina-embeddings-v3               | 0.69933              | 0.18256                | 0.63133           | 0.28505         |\n| intfloat/multilingual-e5-large-instruct | 0.69018              | 0.17838                | 0.62486           | 0.27933         |\n| Alibaba-NLP/gte-multilingual-base       | 0.69365              | 0.17789                | 0.61896           | 0.27879         |\n| intfloat/multilingual-e5-base           | 0.67250              | 0.17406                | 0.61119           | 0.27247         |\n| Alibaba-NLP/gte-Qwen2-7B-instruct       | 0.67447              | 0.17114                | 0.60952           | 0.26943         |\n| intfloat/e5-mistral-7b-instruct         | 0.67449              | 0.17484                | 0.60935           | 0.27349         |\n| openai/text-embedding-3-large           | 0.66365              | 0.17004                | 0.59389           | 0.26677         |\n| Salesforce/SFR-Embedding-2_R            | 0.65622              | 0.17018                | 0.58494           | 0.26612         |\n| upskyy/bge-m3-korean                    | 0.65477              | 0.17015                | 0.58073           | 0.26589         |\n| jhgan/ko-sroberta-multitask             | 0.53136              | 0.13264                | 0.45879           | 0.20976         |\n\n### Top-k 10\n| Model                                   | Average Recall | Average Precision | Average NDCG | Average F1 |\n|-----------------------------------------|----------------------|------------------------|-------------------|-----------------|\n| **nlpai-lab/KURE-v1**                   | **0.79682**          | **0.10624**            | **0.69473**       | **0.18524**     |\n| dragonkue/BGE-m3-ko                     | 0.78450              | 0.10492                | 0.68748           | 0.18288         |\n| BAAI/bge-m3                             | 0.79195              | 0.10592                | 0.68723           | 0.18456         |\n| Snowflake/snowflake-arctic-embed-l-v2.0 | 0.78669              | 0.10462                | 0.68189           | 0.18260         |\n| intfloat/multilingual-e5-large          | 0.75902              | 0.10147                | 0.66370           | 0.17693         |\n| nlpai-lab/KoE5                          | 0.75296              | 0.09937                | 0.66012           | 0.17369         |\n| BAAI/bge-multilingual-gemma2            | 0.76153              | 0.10364                | 0.65330           | 0.18003         |\n| jinaai/jina-embeddings-v3               | 0.76277              | 0.10240                | 0.65290           | 0.17843         |\n| intfloat/multilingual-e5-large-instruct | 0.74851              | 0.09888                | 0.64451           | 0.17283         |\n| Alibaba-NLP/gte-multilingual-base       | 0.75631              | 0.09938                | 0.64025           | 0.17363         |\n| Alibaba-NLP/gte-Qwen2-7B-instruct       | 0.74092              | 0.09607                | 0.63258           | 0.16847         |\n| intfloat/multilingual-e5-base           | 0.73512              | 0.09717                | 0.63216           | 0.16977         |\n| intfloat/e5-mistral-7b-instruct         | 0.73795              | 0.09777                | 0.63076           | 0.17078         |\n| openai/text-embedding-3-large           | 0.72946              | 0.09571                | 0.61670           | 0.16739         |\n| Salesforce/SFR-Embedding-2_R            | 0.71662              | 0.09546                | 0.60589           | 0.16651         |\n| upskyy/bge-m3-korean                    | 0.71895              | 0.09583                | 0.60258           | 0.16712         |\n| jhgan/ko-sroberta-multitask             | 0.61225              | 0.07826                | 0.48687           | 0.13757         |\n<br/>\n\n## Training Details\n- KURE-v1 is a model fine-tuned from [BAAI/bge-m3](https://huggingface.co/BAAI/bge-m3).\n- KoE5 is a model fine-tuned from [intfloat/multilingual-e5-large](https://huggingface.co/intfloat/multilingual-e5-large).\n\n### Training Data\n**KURE-v1**\n- Korean query-document-hard_negative(5) pairs\n- Approx. 2,000,000 examples\n\n**KoE5**\n- [ko-triplet-v1.0](https://huggingface.co/datasets/nlpai-lab/ko-triplet-v1.0)\n- Korean query-document-hard_negative(1) pairs (open data)\n- Approx. 700,000+ examples\n\n### Training Procedure\n**KURE-v1**\n- loss: [CachedGISTEmbedLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cachedgistembedloss)\n- batch size: 4096\n- learning rate: 2e-05\n- epochs: 1\n\n**KoE5**\n- loss: [CachedMultipleNegativesRankingLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cachedmultiplenegativesrankingloss)\n- batch size: 512\n- learning rate: 1e-05\n- epochs: 1\n\n<br/>\n\n## Important Notes\n- When using KoE5, you must add a prefix for each input: (e.g., `query: {query}`, `passage: {document}`)\n  \n## License\n- ```MIT```\n\n## Citation\nIf you find our paper or models helpful, please consider citing them as follows:\n```text\n@misc{KURE,\n  publisher = {Youngjoon Jang, Junyoung Son, Taemin Lee},\n  year = {2024},\n  url = {https://github.com/nlpai-lab/KURE}\n},\n\n@misc{KoE5,\n  author = {NLP & AI Lab and Human-Inspired AI research},\n  title = {KoE5: A New Dataset and Model for Improving Korean Embedding Performance},\n  year = {2024},\n  publisher = {Youngjoon Jang, Junyoung Son, Taemin Lee},\n  journal = {GitHub repository},\n  howpublished = {\\url{https://drive.google.com/file/d/1wB02XGFH5v18iJYSYB0oJkWFYxH0ftoJ/view}},\n}\n```\n```\n"
  },
  {
    "path": "eval/evaluate.py",
    "content": "\"\"\"Benchmarking all datasets constituting the MTEB Korean leaderboard & average scores\"\"\"\nfrom __future__ import annotations\n\nimport os\nimport logging\nfrom multiprocessing import Process, current_process\nimport torch\n\nfrom sentence_transformers import SentenceTransformer\nfrom sentence_transformers.models import StaticEmbedding\n\nimport mteb\nfrom mteb import MTEB, get_tasks\nfrom mteb.encoder_interface import PromptType\nfrom mteb.models.sentence_transformer_wrapper import SentenceTransformerWrapper\nfrom mteb.models.instruct_wrapper import instruct_wrapper\n\nimport argparse\nfrom dotenv import load_dotenv\nfrom setproctitle import setproctitle\nimport traceback\nimport logging\n\nload_dotenv() # for OPENAI\n\nparser = argparse.ArgumentParser(description=\"Extract contexts\")\nparser.add_argument('--quantize', default=False, type=bool, help='quantize embeddings')\nargs = parser.parse_args()\n\nlogging.basicConfig(level=logging.INFO)\n\nlogger = logging.getLogger(\"main\")\n\nTASK_LIST_CLASSIFICATION = []\n\nTASK_LIST_CLUSTERING = []\n\nTASK_LIST_PAIR_CLASSIFICATION = []\n\nTASK_LIST_RERANKING = []\n\nTASK_LIST_RETRIEVAL = [\n    \"Ko-StrategyQA\",\n    \"AutoRAGRetrieval\",\n    \"MIRACLRetrieval\", # 시간이 오래 걸림 주의\n    \"PublicHealthQA\",\n    \"BelebeleRetrieval\",\n    \"MrTidyRetrieval\", # 시간이 오래 걸림 주의\n    \"MultiLongDocRetrieval\",\n    \"XPQARetrieval\",\n    \"Tatoeba\"\n]\n\nTASK_LIST_STS = []\n\nTASK_LIST = (\n    TASK_LIST_CLASSIFICATION\n    + TASK_LIST_CLUSTERING\n    + TASK_LIST_PAIR_CLASSIFICATION\n    + TASK_LIST_RERANKING\n    + TASK_LIST_RETRIEVAL\n    + TASK_LIST_STS\n)\n\n# MIRACL, MrTidy는 평가 시 시간이 오래 걸리기 때문에, 태스크별로 나누어 multiprocessing으로 평가합니다.\n# 필요 시 GPU 번호를 다르게 조정해 주세요.\nTASK_LIST_RETRIEVAL_GPU_MAPPING = {\n    0: [\n        \"Ko-StrategyQA\",\n        \"AutoRAGRetrieval\",\n        \"PublicHealthQA\",\n        \"BelebeleRetrieval\",\n        \"XPQARetrieval\",\n        \"MultiLongDocRetrieval\",\n    ],\n    1: [\"MIRACLRetrieval\"],\n    2: [\"MrTidyRetrieval\"],\n}\n\nmodel_names = [\n    # my_model_directory\n]\nmodel_names = [\n    # \"Salesforce/SFR-Embedding-2_R\", # 4096\n    # \"Alibaba-NLP/gte-Qwen2-7B-instruct\", # 8192\n    # \"BAAI/bge-multilingual-gemma2\", # 8192\n    # \"intfloat/e5-mistral-7b-instruct\", # 32768\n    # \"intfloat/multilingual-e5-large-instruct\", # 512\n    # \"openai/text-embedding-3-large\", # 8191\n    # \"Alibaba-NLP/gte-multilingual-base\", \n    # \"intfloat/multilingual-e5-base\", # 512\n    # \"intfloat/multilingual-e5-large\", # 512\n    # \"jinaai/jina-embeddings-v3\", # 8192\n    # \"jhgan/ko-sroberta-multitask\", # 128\n    # \"BAAI/bge-m3\", # 8192\n    # \"nlpai-lab/KoE5\", # 512\n    # \"dragonkue/BGE-m3-ko\", # 8192\n    # \"Snowflake/snowflake-arctic-embed-l-v2.0\", # 8192,\n    # \"nlpai-lab/KURE-v1\", # 8192,\n    \"nomic-ai/nomic-embed-text-v2-moe\"\n] + model_names\n\ndef evaluate_model(model_name, gpu_id, tasks):\n    try:\n        # Set the environment variable for the specific GPU\n        os.environ[\"CUDA_VISIBLE_DEVICES\"] = str(gpu_id)\n        \n        model = None\n        if not os.path.exists(model_name): # hf에 등록된 모델의 경우\n            if \"m2v\" in model_name: # model2vec의 경우: 모델명에 m2v를 포함시켜주어야 model2vec 모델로 인식합니다.\n                static_embedding = StaticEmbedding.from_model2vec(model_name)\n                model = SentenceTransformer(modules=[static_embedding], model_kwargs={\"attn_implementation\": \"sdpa\"})\n            else:\n                if model_name == \"nlpai-lab/KoE5\" or model_name == \"KU-HIAI-ONTHEIT/ontheit-large-v1_1\" :\n                    # mE5 기반의 모델이므로, 해당 프롬프트를 추가시킵니다.\n                    model_prompts = {\n                        PromptType.query.value: \"query: \",\n                        PromptType.passage.value: \"passage: \",\n                    }\n                    model = SentenceTransformerWrapper(model=model_name, model_prompts=model_prompts, model_kwargs={\"attn_implementation\": \"sdpa\"})\n                elif model_name == \"nomic-ai/nomic-embed-text-v2-moe\":\n                    model_prompts = {\n                        PromptType.query.value: \"search_query: \",\n                        PromptType.passage.value: \"search_document: \",\n                    }\n                    model = SentenceTransformerWrapper(model=model_name, model_prompts=model_prompts, model_kwargs={\"attn_implementation\": \"sdpa\"}, trust_remote_code=True)\n                elif model_name == \"BAAI/bge-multilingual-gemma2\":\n                     # mbge-gemma2의 경우, mteb에서 지원하지 않습니다. 따라서, instruct_wrapper를 사용합니다.\n                    instruction_template = '<instruct>{instruction}\\n<query>'\n                    model = instruct_wrapper(\n                            model_name_or_path=model_name,\n                            instruction_template=instruction_template,\n                            attn=\"cccc\",\n                            pooling_method=\"lasttoken\",\n                            mode=\"embedding\",\n                            torch_dtype=torch.float16,\n                            normalized=True,\n                    )\n                elif model_name == \"Snowflake/snowflake-arctic-embed-l-v2.0\":\n                    # mteb에서 Snowflake 모델을 지원하지 않으므로, Snowflake에서 사용하는 \"query: \" prefix를 임의로 추가합니다.\n                    model_prompts = {\n                        PromptType.query.value: \"query: \",\n                    }\n                    model = SentenceTransformerWrapper(model=model_name, model_prompts=model_prompts, model_kwargs={\"attn_implementation\": \"sdpa\"})\n                else:\n                    # mteb에 등록된 모델의 경우, 프롬프트/prefix 등을 포함하여 평가할 수 있습니다. 등록되지 않은 경우, sentence-transformer를 사용하여 불러옵니다.\n                    model = mteb.get_model(model_name)\n        else: # 직접 학습한 모델의 경우\n            file_name = os.path.join(model_name, \"model.safetensors\")\n            if os.path.exists(file_name):\n                if \"m2v\" in model_name: # model2vec의 경우: 모델명에 m2v를 포함시켜주어야 model2vec 모델로 인식합니다.\n                    static_embedding = StaticEmbedding.from_model2vec(model_name)\n                    model = SentenceTransformer(modules=[static_embedding], model_kwargs={\"attn_implementation\": \"sdpa\"})\n                else:\n                    model = mteb.get_model(model_name, model_kwargs={\"attn_implementation\": \"sdpa\"})\n\n        if model:\n            setproctitle(f\"{model_name}-{gpu_id}\")\n            print(f\"Running tasks: {tasks} / {model_name} on GPU {gpu_id} in process {current_process().name}\")\n            evaluation = MTEB(\n                tasks=get_tasks(tasks=tasks, languages=[\"kor-Kore\", \"kor-Hang\", \"kor_Hang\"])\n            )\n            # 48GB VRAM 기준 적합한 batch sizes\n            if \"multilingual-e5\" in model_name or \"KoE5\" in model_name or \"ontheit\" in model_name or \"nomic\" in model_name:\n                batch_size = 512\n            elif \"jina\" in model_name:\n                batch_size = 8\n            elif \"bge-m3\" in model_name or \"Snowflake\" in model_name:\n                batch_size = 32\n            elif \"gemma2\" in model_name:\n                batch_size = 256 \n            elif \"Salesforce\" in model_name:\n                batch_size = 128\n            else:\n                batch_size = 64\n\n            if args.quantize: # quantized model의 경우\n                evaluation.run(\n                    model,\n                    output_folder=f\"results/{model_name}-quantized\",\n                    encode_kwargs={\"batch_size\": batch_size, \"precision\": \"binary\"},\n                )\n            else:\n                evaluation.run(\n                    model,\n                    output_folder=f\"results/{model_name}\",\n                    encode_kwargs={\"batch_size\": batch_size},\n                )\n    except Exception as ex:\n        print(ex)\n        traceback.print_exc()\n\nif __name__ == \"__main__\":\n    processes = []\n    for gpu_id, tasks in TASK_LIST_RETRIEVAL_GPU_MAPPING.items():\n        for model_name in model_names:\n            p = Process(target=evaluate_model, args=(model_name, gpu_id, tasks))\n            p.start()\n            processes.append(p)\n\n    for p in processes:\n        p.join()\n"
  },
  {
    "path": "eval/leaderboard.py",
    "content": "import streamlit as st\nimport os\nimport json\nimport pandas as pd\n\nst.set_page_config(layout=\"wide\")\n\n\ndef app():\n    data = {}\n    avg_data = {}  # average score를 저장하기 위한 dictionary\n    tasks = [\n        \"Ko-StrategyQA\",\n        \"AutoRAGRetrieval\",\n        \"MIRACLRetrieval\",\n        \"PublicHealthQA\",\n        \"BelebeleRetrieval\",\n        \"MrTidyRetrieval\",\n        \"MultiLongDocRetrieval\",\n        \"XPQARetrieval\"\n    ]\n    top_k_types = [\"top1\", \"top3\", \"top5\", \"top10\"]\n\n    score_types = {\n        \"top1\": [\"recall_at_1\", \"precision_at_1\", \"ndcg_at_1\"],\n        \"top3\": [\"recall_at_3\", \"precision_at_3\", \"ndcg_at_3\"],\n        \"top5\": [\"recall_at_5\", \"precision_at_5\", \"ndcg_at_5\"],\n        \"top10\": [\"recall_at_10\", \"precision_at_10\", \"ndcg_at_10\"],\n    }\n\n    # 각 작업에 대한 데이터를 초기화\n    for task in tasks:\n        data[task] = {top_k: [] for top_k in top_k_types}\n\n    root_dir = \"results\"\n\n    # 데이터가 저장되어 있는 디렉토리의 모든 하위 폴더를 순회하면서 json 파일을 읽습니다.\n    for subdir, dirs, files in os.walk(root_dir):\n        for file in files:\n            for task in tasks:\n                if file == task + \".json\":\n                    with open(os.path.join(subdir, file)) as f:\n                        d = json.load(f)\n                        for top_k in top_k_types:\n                            results = {}\n                            for score in score_types[top_k]:\n                                if \"dev\" in d[\"scores\"] and \"test\" not in d[\"scores\"]:\n                                    results[score] = d[\"scores\"][\"dev\"][0][score]\n                                elif \"test\" in d[\"scores\"] and \"dev\" not in d[\"scores\"]:\n                                    results[score] = d[\"scores\"][\"test\"][0][score]\n                                else:\n                                    # dev, test를 모두 가지고 있는 평가 데이터셋을 위함\n                                    results[score] = (d[\"scores\"][\"dev\"][0][score] + d[\"scores\"][\"test\"][0][score]) / 2\n\n                            # f1 score 직접 계산\n                            f1_score = (\n                                2 * (results[score_types[top_k][1]] * results[score_types[top_k][0]]) / (results[score_types[top_k][1]]+ results[score_types[top_k][0]])\n                                if (results[score_types[top_k][1]]+ results[score_types[top_k][0]])> 0\n                                else 0\n                            )\n\n                            data[task][top_k].append(\n                                (\n                                    os.path.relpath(subdir, root_dir),\n                                    results[score_types[top_k][0]],\n                                    results[score_types[top_k][1]],\n                                    results[score_types[top_k][2]],\n                                    f1_score,\n                                )\n                            )\n\n    # 각 작업에 대해 top1, top3, top5, top10 점수 표시\n    for task in tasks:\n        st.markdown(f\"# {task}\")\n        for top_k in top_k_types:\n            st.markdown(f\"## {top_k.capitalize()} Scores\")\n            df = pd.DataFrame(\n                data[task][top_k],\n                columns=[\n                    \"Subdir\",\n                    f\"Recall_{top_k}\",\n                    f\"Precision_{top_k}\",\n                    f\"NDCG_{top_k}\",\n                    f\"F1_{top_k}\",\n                ],\n            )\n            df = df.sort_values(by=f\"NDCG_{top_k}\", ascending=False)\n            st.dataframe(df, use_container_width=True)\n\n            # 각 모델의 평균 점수 계산\n            for subdir, recall, precision, ndcg, f1 in data[task][top_k]:\n                if subdir not in avg_data:\n                    avg_data[subdir] = {\n                        k: [[], [], [], []] for k in top_k_types\n                    } \n                avg_data[subdir][top_k][0].append(recall)\n                avg_data[subdir][top_k][1].append(precision)\n                avg_data[subdir][top_k][2].append(ndcg)\n                avg_data[subdir][top_k][3].append(f1)\n\n    # 각 모델 별 평균 점수 계산 후 출력\n    st.markdown(\"# Average Scores\")\n    for top_k in top_k_types:\n        avg_results = []\n        for model in avg_data:\n            recall_avg = (\n                sum(avg_data[model][top_k][0]) / len(avg_data[model][top_k][0])\n                if avg_data[model][top_k][0]\n                else 0\n            )\n            precision_avg = (\n                sum(avg_data[model][top_k][1]) / len(avg_data[model][top_k][1])\n                if avg_data[model][top_k][1]\n                else 0\n            )\n            ndcg_avg = (\n                sum(avg_data[model][top_k][2]) / len(avg_data[model][top_k][2])\n                if avg_data[model][top_k][2]\n                else 0\n            )\n            f1_avg = (\n                sum(avg_data[model][top_k][3]) / len(avg_data[model][top_k][3])\n                if avg_data[model][top_k][3]\n                else 0\n            )\n            avg_results.append([model, recall_avg, precision_avg, ndcg_avg, f1_avg])\n\n        avg_df = pd.DataFrame(\n            avg_results,\n            columns=[\n                \"Model\",\n                f\"Average Recall_{top_k}\",\n                f\"Average Precision_{top_k}\",\n                f\"Average NDCG_{top_k}\",\n                f\"Average F1_{top_k}\",\n            ],\n        )\n        avg_df = avg_df.sort_values(by=f\"Average NDCG_{top_k}\", ascending=False)\n        st.markdown(f\"## {top_k.capitalize()} Average Scores\")\n        st.dataframe(avg_df, use_container_width=True)\n\n\nif __name__ == \"__main__\":\n    app()"
  },
  {
    "path": "eval/requirements.txt",
    "content": "mteb\npython-dotenv\nstreamlit\nsetproctitle"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-Qwen2-7B-instruct/Alibaba-NLP__gte-Qwen2-7B-instruct/e26182b2122f4435e8b3ebecbf363990f409b45b/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 846.0815389156342,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.76682,\n        \"map_at_1\": 0.60526,\n        \"map_at_10\": 0.71514,\n        \"map_at_100\": 0.71846,\n        \"map_at_1000\": 0.71854,\n        \"map_at_20\": 0.71719,\n        \"map_at_3\": 0.69444,\n        \"map_at_5\": 0.7019,\n        \"mrr_at_1\": 0.6052631578947368,\n        \"mrr_at_10\": 0.7151350598719021,\n        \"mrr_at_100\": 0.7184641134066749,\n        \"mrr_at_1000\": 0.7185366086944813,\n        \"mrr_at_20\": 0.7171920671920672,\n        \"mrr_at_3\": 0.6944444444444446,\n        \"mrr_at_5\": 0.7019005847953218,\n        \"nauc_map_at_1000_diff1\": 0.7644331655442053,\n        \"nauc_map_at_1000_max\": 0.006603581947104919,\n        \"nauc_map_at_1000_std\": -0.37084270701564565,\n        \"nauc_map_at_100_diff1\": 0.7644201027610169,\n        \"nauc_map_at_100_max\": 0.0067126570840267364,\n        \"nauc_map_at_100_std\": -0.37090267941427896,\n        \"nauc_map_at_10_diff1\": 0.762543492536473,\n        \"nauc_map_at_10_max\": 0.016618337725207714,\n        \"nauc_map_at_10_std\": -0.36230366527185476,\n        \"nauc_map_at_1_diff1\": 0.8065079498138608,\n        \"nauc_map_at_1_max\": -0.008481292674104184,\n        \"nauc_map_at_1_std\": -0.3152574052168019,\n        \"nauc_map_at_20_diff1\": 0.7647616354525286,\n        \"nauc_map_at_20_max\": 0.010913309413363433,\n        \"nauc_map_at_20_std\": -0.3693593056765434,\n        \"nauc_map_at_3_diff1\": 0.749148318778548,\n        \"nauc_map_at_3_max\": -0.013924305023451019,\n        \"nauc_map_at_3_std\": -0.39203803015117983,\n        \"nauc_map_at_5_diff1\": 0.7599115394000969,\n        \"nauc_map_at_5_max\": -0.008945775041782456,\n        \"nauc_map_at_5_std\": -0.38416486703433883,\n        \"nauc_mrr_at_1000_diff1\": 0.7644331655442053,\n        \"nauc_mrr_at_1000_max\": 0.006603581947104919,\n        \"nauc_mrr_at_1000_std\": -0.37084270701564565,\n        \"nauc_mrr_at_100_diff1\": 0.7644201027610169,\n        \"nauc_mrr_at_100_max\": 0.0067126570840267364,\n        \"nauc_mrr_at_100_std\": -0.37090267941427896,\n        \"nauc_mrr_at_10_diff1\": 0.762543492536473,\n        \"nauc_mrr_at_10_max\": 0.016618337725207714,\n        \"nauc_mrr_at_10_std\": -0.36230366527185476,\n        \"nauc_mrr_at_1_diff1\": 0.8065079498138608,\n        \"nauc_mrr_at_1_max\": -0.008481292674104184,\n        \"nauc_mrr_at_1_std\": -0.3152574052168019,\n        \"nauc_mrr_at_20_diff1\": 0.7647616354525286,\n        \"nauc_mrr_at_20_max\": 0.010913309413363433,\n        \"nauc_mrr_at_20_std\": -0.3693593056765434,\n        \"nauc_mrr_at_3_diff1\": 0.749148318778548,\n        \"nauc_mrr_at_3_max\": -0.013924305023451019,\n        \"nauc_mrr_at_3_std\": -0.39203803015117983,\n        \"nauc_mrr_at_5_diff1\": 0.7599115394000969,\n        \"nauc_mrr_at_5_max\": -0.008945775041782456,\n        \"nauc_mrr_at_5_std\": -0.38416486703433883,\n        \"nauc_ndcg_at_1000_diff1\": 0.7622350239005066,\n        \"nauc_ndcg_at_1000_max\": 0.017371318088600977,\n        \"nauc_ndcg_at_1000_std\": -0.37321055393166663,\n        \"nauc_ndcg_at_100_diff1\": 0.7619593636566969,\n        \"nauc_ndcg_at_100_max\": 0.01972561053123169,\n        \"nauc_ndcg_at_100_std\": -0.37452959411278264,\n        \"nauc_ndcg_at_10_diff1\": 0.7575322927973843,\n        \"nauc_ndcg_at_10_max\": 0.07021633482084594,\n        \"nauc_ndcg_at_10_std\": -0.3375267305826439,\n        \"nauc_ndcg_at_1_diff1\": 0.8065079498138608,\n        \"nauc_ndcg_at_1_max\": -0.008481292674104184,\n        \"nauc_ndcg_at_1_std\": -0.3152574052168019,\n        \"nauc_ndcg_at_20_diff1\": 0.7652290444346898,\n        \"nauc_ndcg_at_20_max\": 0.048815872410838686,\n        \"nauc_ndcg_at_20_std\": -0.36658508429606196,\n        \"nauc_ndcg_at_3_diff1\": 0.7321065045076984,\n        \"nauc_ndcg_at_3_max\": -0.01155970025952776,\n        \"nauc_ndcg_at_3_std\": -0.4161891854409051,\n        \"nauc_ndcg_at_5_diff1\": 0.7516239012254612,\n        \"nauc_ndcg_at_5_max\": -6.352015603966895e-05,\n        \"nauc_ndcg_at_5_std\": -0.39852520659387436,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 0.7224066624409552,\n        \"nauc_precision_at_100_max\": 0.35752776970742256,\n        \"nauc_precision_at_100_std\": -0.5637901180614636,\n        \"nauc_precision_at_10_diff1\": 0.7309271500210811,\n        \"nauc_precision_at_10_max\": 0.6817757315332228,\n        \"nauc_precision_at_10_std\": 0.00574347193803287,\n        \"nauc_precision_at_1_diff1\": 0.8065079498138608,\n        \"nauc_precision_at_1_max\": -0.008481292674104184,\n        \"nauc_precision_at_1_std\": -0.3152574052168019,\n        \"nauc_precision_at_20_diff1\": 0.8293909916468436,\n        \"nauc_precision_at_20_max\": 0.7008965455883202,\n        \"nauc_precision_at_20_std\": -0.2706904285228724,\n        \"nauc_precision_at_3_diff1\": 0.6681562238166904,\n        \"nauc_precision_at_3_max\": -0.00047679284331604674,\n        \"nauc_precision_at_3_std\": -0.5075608401380758,\n        \"nauc_precision_at_5_diff1\": 0.7204265059450241,\n        \"nauc_precision_at_5_max\": 0.046535938023941965,\n        \"nauc_precision_at_5_std\": -0.4530486350784987,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.7224066624409369,\n        \"nauc_recall_at_100_max\": 0.35752776970737554,\n        \"nauc_recall_at_100_std\": -0.5637901180615443,\n        \"nauc_recall_at_10_diff1\": 0.7309271500210796,\n        \"nauc_recall_at_10_max\": 0.6817757315332232,\n        \"nauc_recall_at_10_std\": 0.005743471938036119,\n        \"nauc_recall_at_1_diff1\": 0.8065079498138608,\n        \"nauc_recall_at_1_max\": -0.008481292674104184,\n        \"nauc_recall_at_1_std\": -0.3152574052168019,\n        \"nauc_recall_at_20_diff1\": 0.8293909916468486,\n        \"nauc_recall_at_20_max\": 0.700896545588321,\n        \"nauc_recall_at_20_std\": -0.27069042852286784,\n        \"nauc_recall_at_3_diff1\": 0.6681562238166918,\n        \"nauc_recall_at_3_max\": -0.0004767928433143103,\n        \"nauc_recall_at_3_std\": -0.5075608401380753,\n        \"nauc_recall_at_5_diff1\": 0.7204265059450234,\n        \"nauc_recall_at_5_max\": 0.04653593802394211,\n        \"nauc_recall_at_5_std\": -0.45304863507849813,\n        \"ndcg_at_1\": 0.60526,\n        \"ndcg_at_10\": 0.76682,\n        \"ndcg_at_100\": 0.78099,\n        \"ndcg_at_1000\": 0.78225,\n        \"ndcg_at_20\": 0.77376,\n        \"ndcg_at_3\": 0.72128,\n        \"ndcg_at_5\": 0.73524,\n        \"precision_at_1\": 0.60526,\n        \"precision_at_10\": 0.09298,\n        \"precision_at_100\": 0.00991,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04781,\n        \"precision_at_3\": 0.26608,\n        \"precision_at_5\": 0.16667,\n        \"recall_at_1\": 0.60526,\n        \"recall_at_10\": 0.92982,\n        \"recall_at_100\": 0.99123,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.95614,\n        \"recall_at_3\": 0.79825,\n        \"recall_at_5\": 0.83333\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-Qwen2-7B-instruct/Alibaba-NLP__gte-Qwen2-7B-instruct/e26182b2122f4435e8b3ebecbf363990f409b45b/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 537.1708543300629,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.94808,\n        \"map_at_1\": 0.91444,\n        \"map_at_10\": 0.93774,\n        \"map_at_100\": 0.93854,\n        \"map_at_1000\": 0.93856,\n        \"map_at_20\": 0.93803,\n        \"map_at_3\": 0.93426,\n        \"map_at_5\": 0.93648,\n        \"mrr_at_1\": 0.9144444444444444,\n        \"mrr_at_10\": 0.9377385361552029,\n        \"mrr_at_100\": 0.9385426232247298,\n        \"mrr_at_1000\": 0.9385570215532866,\n        \"mrr_at_20\": 0.9380331489498157,\n        \"mrr_at_3\": 0.9342592592592593,\n        \"mrr_at_5\": 0.9364814814814815,\n        \"nauc_map_at_1000_diff1\": 0.9341587574819448,\n        \"nauc_map_at_1000_max\": 0.7978508469331898,\n        \"nauc_map_at_1000_std\": -0.1247788227834717,\n        \"nauc_map_at_100_diff1\": 0.9341510130917275,\n        \"nauc_map_at_100_max\": 0.7978982067470314,\n        \"nauc_map_at_100_std\": -0.12453847765211529,\n        \"nauc_map_at_10_diff1\": 0.9344160375639369,\n        \"nauc_map_at_10_max\": 0.7999522285999181,\n        \"nauc_map_at_10_std\": -0.12061906912864259,\n        \"nauc_map_at_1_diff1\": 0.9313119187068765,\n        \"nauc_map_at_1_max\": 0.7544472334388295,\n        \"nauc_map_at_1_std\": -0.19743655037772562,\n        \"nauc_map_at_20_diff1\": 0.934104227715159,\n        \"nauc_map_at_20_max\": 0.7991964531277118,\n        \"nauc_map_at_20_std\": -0.12080639055631145,\n        \"nauc_map_at_3_diff1\": 0.9355558185715604,\n        \"nauc_map_at_3_max\": 0.8014531634249938,\n        \"nauc_map_at_3_std\": -0.14484948909140807,\n        \"nauc_map_at_5_diff1\": 0.9333012116411193,\n        \"nauc_map_at_5_max\": 0.7994864612511658,\n        \"nauc_map_at_5_std\": -0.1304815803872555,\n        \"nauc_mrr_at_1000_diff1\": 0.9341587574819448,\n        \"nauc_mrr_at_1000_max\": 0.7978508469331898,\n        \"nauc_mrr_at_1000_std\": -0.1247788227834717,\n        \"nauc_mrr_at_100_diff1\": 0.9341510130917275,\n        \"nauc_mrr_at_100_max\": 0.7978982067470314,\n        \"nauc_mrr_at_100_std\": -0.12453847765211529,\n        \"nauc_mrr_at_10_diff1\": 0.9344160375639369,\n        \"nauc_mrr_at_10_max\": 0.7999522285999181,\n        \"nauc_mrr_at_10_std\": -0.12061906912864259,\n        \"nauc_mrr_at_1_diff1\": 0.9313119187068765,\n        \"nauc_mrr_at_1_max\": 0.7544472334388295,\n        \"nauc_mrr_at_1_std\": -0.19743655037772562,\n        \"nauc_mrr_at_20_diff1\": 0.934104227715159,\n        \"nauc_mrr_at_20_max\": 0.7991964531277118,\n        \"nauc_mrr_at_20_std\": -0.12080639055631145,\n        \"nauc_mrr_at_3_diff1\": 0.9355558185715604,\n        \"nauc_mrr_at_3_max\": 0.8014531634249938,\n        \"nauc_mrr_at_3_std\": -0.14484948909140807,\n        \"nauc_mrr_at_5_diff1\": 0.9333012116411193,\n        \"nauc_mrr_at_5_max\": 0.7994864612511658,\n        \"nauc_mrr_at_5_std\": -0.1304815803872555,\n        \"nauc_ndcg_at_1000_diff1\": 0.9344502542270329,\n        \"nauc_ndcg_at_1000_max\": 0.8043530829653767,\n        \"nauc_ndcg_at_1000_std\": -0.10775125619222786,\n        \"nauc_ndcg_at_100_diff1\": 0.9344072352372144,\n        \"nauc_ndcg_at_100_max\": 0.8055734617052932,\n        \"nauc_ndcg_at_100_std\": -0.10129337761974706,\n        \"nauc_ndcg_at_10_diff1\": 0.9356156657712474,\n        \"nauc_ndcg_at_10_max\": 0.8171392419913772,\n        \"nauc_ndcg_at_10_std\": -0.07482350219227087,\n        \"nauc_ndcg_at_1_diff1\": 0.9313119187068765,\n        \"nauc_ndcg_at_1_max\": 0.7544472334388295,\n        \"nauc_ndcg_at_1_std\": -0.19743655037772562,\n        \"nauc_ndcg_at_20_diff1\": 0.9344540935531565,\n        \"nauc_ndcg_at_20_max\": 0.8146097937010235,\n        \"nauc_ndcg_at_20_std\": -0.07418267112495723,\n        \"nauc_ndcg_at_3_diff1\": 0.936819790095856,\n        \"nauc_ndcg_at_3_max\": 0.8178989129857199,\n        \"nauc_ndcg_at_3_std\": -0.13242670021197311,\n        \"nauc_ndcg_at_5_diff1\": 0.9321587219670335,\n        \"nauc_ndcg_at_5_max\": 0.8148177822979191,\n        \"nauc_ndcg_at_5_std\": -0.10319206027442693,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9346405228757582,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.9346405228757582,\n        \"nauc_precision_at_10_diff1\": 0.9482570806100177,\n        \"nauc_precision_at_10_max\": 0.9679686689490625,\n        \"nauc_precision_at_10_std\": 0.36248573503474296,\n        \"nauc_precision_at_1_diff1\": 0.9313119187068765,\n        \"nauc_precision_at_1_max\": 0.7544472334388295,\n        \"nauc_precision_at_1_std\": -0.19743655037772562,\n        \"nauc_precision_at_20_diff1\": 0.9379084967320215,\n        \"nauc_precision_at_20_max\": 0.9702769996887645,\n        \"nauc_precision_at_20_std\": 0.4604419545596087,\n        \"nauc_precision_at_3_diff1\": 0.9424992219109852,\n        \"nauc_precision_at_3_max\": 0.8935444548189662,\n        \"nauc_precision_at_3_std\": -0.07892416225750032,\n        \"nauc_precision_at_5_diff1\": 0.923332295881318,\n        \"nauc_precision_at_5_max\": 0.9042258878860141,\n        \"nauc_precision_at_5_std\": 0.06276584707956435,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.934640522875857,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.934640522875857,\n        \"nauc_recall_at_10_diff1\": 0.9482570806100225,\n        \"nauc_recall_at_10_max\": 0.9679686689490574,\n        \"nauc_recall_at_10_std\": 0.3624857350347621,\n        \"nauc_recall_at_1_diff1\": 0.9313119187068765,\n        \"nauc_recall_at_1_max\": 0.7544472334388295,\n        \"nauc_recall_at_1_std\": -0.19743655037772562,\n        \"nauc_recall_at_20_diff1\": 0.9379084967320268,\n        \"nauc_recall_at_20_max\": 0.97027699968877,\n        \"nauc_recall_at_20_std\": 0.4604419545596044,\n        \"nauc_recall_at_3_diff1\": 0.9424992219109841,\n        \"nauc_recall_at_3_max\": 0.893544454818967,\n        \"nauc_recall_at_3_std\": -0.07892416225749478,\n        \"nauc_recall_at_5_diff1\": 0.9233322958813207,\n        \"nauc_recall_at_5_max\": 0.9042258878860211,\n        \"nauc_recall_at_5_std\": 0.06276584707957272,\n        \"ndcg_at_1\": 0.91444,\n        \"ndcg_at_10\": 0.94808,\n        \"ndcg_at_100\": 0.95193,\n        \"ndcg_at_1000\": 0.95223,\n        \"ndcg_at_20\": 0.949,\n        \"ndcg_at_3\": 0.94086,\n        \"ndcg_at_5\": 0.94492,\n        \"precision_at_1\": 0.91444,\n        \"precision_at_10\": 0.098,\n        \"precision_at_100\": 0.00998,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04917,\n        \"precision_at_3\": 0.32,\n        \"precision_at_5\": 0.194,\n        \"recall_at_1\": 0.91444,\n        \"recall_at_10\": 0.98,\n        \"recall_at_100\": 0.99778,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98333,\n        \"recall_at_3\": 0.96,\n        \"recall_at_5\": 0.97\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.95397,\n        \"map_at_1\": 0.91778,\n        \"map_at_10\": 0.94328,\n        \"map_at_100\": 0.94402,\n        \"map_at_1000\": 0.94402,\n        \"map_at_20\": 0.9439,\n        \"map_at_3\": 0.9387,\n        \"map_at_5\": 0.94204,\n        \"mrr_at_1\": 0.9177777777777778,\n        \"mrr_at_10\": 0.9432760141093474,\n        \"mrr_at_100\": 0.9440192855380678,\n        \"mrr_at_1000\": 0.944022209514676,\n        \"mrr_at_20\": 0.9438995324516478,\n        \"mrr_at_3\": 0.9387037037037037,\n        \"mrr_at_5\": 0.9420370370370371,\n        \"nauc_map_at_1000_diff1\": 0.9379736356471905,\n        \"nauc_map_at_1000_max\": 0.818228835537799,\n        \"nauc_map_at_1000_std\": -0.3568158538211896,\n        \"nauc_map_at_100_diff1\": 0.9379768753993101,\n        \"nauc_map_at_100_max\": 0.8182383297830593,\n        \"nauc_map_at_100_std\": -0.35674498481109457,\n        \"nauc_map_at_10_diff1\": 0.9371832681770706,\n        \"nauc_map_at_10_max\": 0.8194699100005315,\n        \"nauc_map_at_10_std\": -0.3534046804367552,\n        \"nauc_map_at_1_diff1\": 0.9365016276781002,\n        \"nauc_map_at_1_max\": 0.7871400812577283,\n        \"nauc_map_at_1_std\": -0.3898352133646259,\n        \"nauc_map_at_20_diff1\": 0.9380057116884054,\n        \"nauc_map_at_20_max\": 0.8186263215762201,\n        \"nauc_map_at_20_std\": -0.3552421679266783,\n        \"nauc_map_at_3_diff1\": 0.9384134318379933,\n        \"nauc_map_at_3_max\": 0.8234983822330538,\n        \"nauc_map_at_3_std\": -0.36390165330986185,\n        \"nauc_map_at_5_diff1\": 0.9376907312445761,\n        \"nauc_map_at_5_max\": 0.8229708283739466,\n        \"nauc_map_at_5_std\": -0.3448556632450642,\n        \"nauc_mrr_at_1000_diff1\": 0.9379736356471905,\n        \"nauc_mrr_at_1000_max\": 0.818228835537799,\n        \"nauc_mrr_at_1000_std\": -0.3568158538211896,\n        \"nauc_mrr_at_100_diff1\": 0.9379768753993101,\n        \"nauc_mrr_at_100_max\": 0.8182383297830593,\n        \"nauc_mrr_at_100_std\": -0.35674498481109457,\n        \"nauc_mrr_at_10_diff1\": 0.9371832681770706,\n        \"nauc_mrr_at_10_max\": 0.8194699100005315,\n        \"nauc_mrr_at_10_std\": -0.3534046804367552,\n        \"nauc_mrr_at_1_diff1\": 0.9365016276781002,\n        \"nauc_mrr_at_1_max\": 0.7871400812577283,\n        \"nauc_mrr_at_1_std\": -0.3898352133646259,\n        \"nauc_mrr_at_20_diff1\": 0.9380057116884054,\n        \"nauc_mrr_at_20_max\": 0.8186263215762201,\n        \"nauc_mrr_at_20_std\": -0.3552421679266783,\n        \"nauc_mrr_at_3_diff1\": 0.9384134318379933,\n        \"nauc_mrr_at_3_max\": 0.8234983822330538,\n        \"nauc_mrr_at_3_std\": -0.36390165330986185,\n        \"nauc_mrr_at_5_diff1\": 0.9376907312445761,\n        \"nauc_mrr_at_5_max\": 0.8229708283739466,\n        \"nauc_mrr_at_5_std\": -0.3448556632450642,\n        \"nauc_ndcg_at_1000_diff1\": 0.9382191754421236,\n        \"nauc_ndcg_at_1000_max\": 0.8224201913320449,\n        \"nauc_ndcg_at_1000_std\": -0.34630458284754967,\n        \"nauc_ndcg_at_100_diff1\": 0.9384049804187261,\n        \"nauc_ndcg_at_100_max\": 0.8229542601540525,\n        \"nauc_ndcg_at_100_std\": -0.3422555904085183,\n        \"nauc_ndcg_at_10_diff1\": 0.9357447204568637,\n        \"nauc_ndcg_at_10_max\": 0.829222262177988,\n        \"nauc_ndcg_at_10_std\": -0.3281301084025004,\n        \"nauc_ndcg_at_1_diff1\": 0.9365016276781002,\n        \"nauc_ndcg_at_1_max\": 0.7871400812577283,\n        \"nauc_ndcg_at_1_std\": -0.3898352133646259,\n        \"nauc_ndcg_at_20_diff1\": 0.9386644241730514,\n        \"nauc_ndcg_at_20_max\": 0.8257288395033384,\n        \"nauc_ndcg_at_20_std\": -0.3312173812179968,\n        \"nauc_ndcg_at_3_diff1\": 0.9388035548318442,\n        \"nauc_ndcg_at_3_max\": 0.8379465154015449,\n        \"nauc_ndcg_at_3_std\": -0.3444570338354112,\n        \"nauc_ndcg_at_5_diff1\": 0.9374737365012075,\n        \"nauc_ndcg_at_5_max\": 0.8384461172346422,\n        \"nauc_ndcg_at_5_std\": -0.30419406475924055,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.9138266417678141,\n        \"nauc_precision_at_10_max\": 0.93191721132897,\n        \"nauc_precision_at_10_std\": -0.0321350762527383,\n        \"nauc_precision_at_1_diff1\": 0.9365016276781002,\n        \"nauc_precision_at_1_max\": 0.7871400812577283,\n        \"nauc_precision_at_1_std\": -0.3898352133646259,\n        \"nauc_precision_at_20_diff1\": 0.967320261437914,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 0.5262605042016776,\n        \"nauc_precision_at_3_diff1\": 0.9404408227937671,\n        \"nauc_precision_at_3_max\": 0.9062756415697625,\n        \"nauc_precision_at_3_std\": -0.24736157089098976,\n        \"nauc_precision_at_5_diff1\": 0.9352240896358476,\n        \"nauc_precision_at_5_max\": 0.9526143790849654,\n        \"nauc_precision_at_5_std\": 0.01713352007468603,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 1.0,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 1.0,\n        \"nauc_recall_at_10_diff1\": 0.9138266417678085,\n        \"nauc_recall_at_10_max\": 0.9319172113289713,\n        \"nauc_recall_at_10_std\": -0.03213507625271808,\n        \"nauc_recall_at_1_diff1\": 0.9365016276781002,\n        \"nauc_recall_at_1_max\": 0.7871400812577283,\n        \"nauc_recall_at_1_std\": -0.3898352133646259,\n        \"nauc_recall_at_20_diff1\": 0.9673202614379001,\n        \"nauc_recall_at_20_max\": 1.0,\n        \"nauc_recall_at_20_std\": 0.5262605042016953,\n        \"nauc_recall_at_3_diff1\": 0.9404408227937675,\n        \"nauc_recall_at_3_max\": 0.9062756415697596,\n        \"nauc_recall_at_3_std\": -0.24736157089098623,\n        \"nauc_recall_at_5_diff1\": 0.9352240896358568,\n        \"nauc_recall_at_5_max\": 0.9526143790849627,\n        \"nauc_recall_at_5_std\": 0.017133520074696214,\n        \"ndcg_at_1\": 0.91778,\n        \"ndcg_at_10\": 0.95397,\n        \"ndcg_at_100\": 0.95691,\n        \"ndcg_at_1000\": 0.95704,\n        \"ndcg_at_20\": 0.95622,\n        \"ndcg_at_3\": 0.94507,\n        \"ndcg_at_5\": 0.95104,\n        \"precision_at_1\": 0.91778,\n        \"precision_at_10\": 0.09867,\n        \"precision_at_100\": 0.00999,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04978,\n        \"precision_at_3\": 0.32111,\n        \"precision_at_5\": 0.19556,\n        \"recall_at_1\": 0.91778,\n        \"recall_at_10\": 0.98667,\n        \"recall_at_100\": 0.99889,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.99556,\n        \"recall_at_3\": 0.96333,\n        \"recall_at_5\": 0.97778\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.92939,\n        \"map_at_1\": 0.87778,\n        \"map_at_10\": 0.91394,\n        \"map_at_100\": 0.91475,\n        \"map_at_1000\": 0.91478,\n        \"map_at_20\": 0.91456,\n        \"map_at_3\": 0.90759,\n        \"map_at_5\": 0.9127,\n        \"mrr_at_1\": 0.8777777777777778,\n        \"mrr_at_10\": 0.9139395943562613,\n        \"mrr_at_100\": 0.9147527793478226,\n        \"mrr_at_1000\": 0.9147804033940741,\n        \"mrr_at_20\": 0.9145571747606064,\n        \"mrr_at_3\": 0.9075925925925927,\n        \"mrr_at_5\": 0.912703703703704,\n        \"nauc_map_at_1000_diff1\": 0.9034621090151944,\n        \"nauc_map_at_1000_max\": 0.8166056541545396,\n        \"nauc_map_at_1000_std\": -0.04958063210793317,\n        \"nauc_map_at_100_diff1\": 0.9034260698542368,\n        \"nauc_map_at_100_max\": 0.8166661124959635,\n        \"nauc_map_at_100_std\": -0.04932797829928419,\n        \"nauc_map_at_10_diff1\": 0.9032733282636335,\n        \"nauc_map_at_10_max\": 0.8176267163973103,\n        \"nauc_map_at_10_std\": -0.046047883529355904,\n        \"nauc_map_at_1_diff1\": 0.9129032258064524,\n        \"nauc_map_at_1_max\": 0.7948743587514139,\n        \"nauc_map_at_1_std\": -0.0959960003477958,\n        \"nauc_map_at_20_diff1\": 0.9033278279584531,\n        \"nauc_map_at_20_max\": 0.8168441424897516,\n        \"nauc_map_at_20_std\": -0.04894110672076424,\n        \"nauc_map_at_3_diff1\": 0.8994646682977531,\n        \"nauc_map_at_3_max\": 0.8155491427278718,\n        \"nauc_map_at_3_std\": -0.05738561942402418,\n        \"nauc_map_at_5_diff1\": 0.9023811940876922,\n        \"nauc_map_at_5_max\": 0.8159936946768515,\n        \"nauc_map_at_5_std\": -0.04821727179963084,\n        \"nauc_mrr_at_1000_diff1\": 0.9034621090151944,\n        \"nauc_mrr_at_1000_max\": 0.8166056541545396,\n        \"nauc_mrr_at_1000_std\": -0.04958063210793317,\n        \"nauc_mrr_at_100_diff1\": 0.9034260698542368,\n        \"nauc_mrr_at_100_max\": 0.8166661124959635,\n        \"nauc_mrr_at_100_std\": -0.04932797829928419,\n        \"nauc_mrr_at_10_diff1\": 0.9032733282636335,\n        \"nauc_mrr_at_10_max\": 0.8176267163973103,\n        \"nauc_mrr_at_10_std\": -0.046047883529355904,\n        \"nauc_mrr_at_1_diff1\": 0.9129032258064524,\n        \"nauc_mrr_at_1_max\": 0.7948743587514139,\n        \"nauc_mrr_at_1_std\": -0.0959960003477958,\n        \"nauc_mrr_at_20_diff1\": 0.9033278279584531,\n        \"nauc_mrr_at_20_max\": 0.8168441424897516,\n        \"nauc_mrr_at_20_std\": -0.04894110672076424,\n        \"nauc_mrr_at_3_diff1\": 0.8994646682977531,\n        \"nauc_mrr_at_3_max\": 0.8155491427278718,\n        \"nauc_mrr_at_3_std\": -0.05738561942402418,\n        \"nauc_mrr_at_5_diff1\": 0.9023811940876922,\n        \"nauc_mrr_at_5_max\": 0.8159936946768515,\n        \"nauc_mrr_at_5_std\": -0.04821727179963084,\n        \"nauc_ndcg_at_1000_diff1\": 0.9025162201523518,\n        \"nauc_ndcg_at_1000_max\": 0.8210647790377918,\n        \"nauc_ndcg_at_1000_std\": -0.033259752555848905,\n        \"nauc_ndcg_at_100_diff1\": 0.9019832601650294,\n        \"nauc_ndcg_at_100_max\": 0.822705958126526,\n        \"nauc_ndcg_at_100_std\": -0.025706848528490346,\n        \"nauc_ndcg_at_10_diff1\": 0.901289557068697,\n        \"nauc_ndcg_at_10_max\": 0.8284852301803537,\n        \"nauc_ndcg_at_10_std\": -0.006171497791011456,\n        \"nauc_ndcg_at_1_diff1\": 0.9129032258064524,\n        \"nauc_ndcg_at_1_max\": 0.7948743587514139,\n        \"nauc_ndcg_at_1_std\": -0.0959960003477958,\n        \"nauc_ndcg_at_20_diff1\": 0.901386120900766,\n        \"nauc_ndcg_at_20_max\": 0.8251101196933834,\n        \"nauc_ndcg_at_20_std\": -0.018990543647164154,\n        \"nauc_ndcg_at_3_diff1\": 0.8937606553985863,\n        \"nauc_ndcg_at_3_max\": 0.8227786405631717,\n        \"nauc_ndcg_at_3_std\": -0.032438022169551876,\n        \"nauc_ndcg_at_5_diff1\": 0.8991524294049409,\n        \"nauc_ndcg_at_5_max\": 0.8244725886241099,\n        \"nauc_ndcg_at_5_std\": -0.010211310284992422,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.85585901027076,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.8068394024276223,\n        \"nauc_precision_at_10_diff1\": 0.8851762927393119,\n        \"nauc_precision_at_10_max\": 0.9416433239962604,\n        \"nauc_precision_at_10_std\": 0.42265795206971,\n        \"nauc_precision_at_1_diff1\": 0.9129032258064524,\n        \"nauc_precision_at_1_max\": 0.7948743587514139,\n        \"nauc_precision_at_1_std\": -0.0959960003477958,\n        \"nauc_precision_at_20_diff1\": 0.8761042878689921,\n        \"nauc_precision_at_20_max\": 0.947209653091999,\n        \"nauc_precision_at_20_std\": 0.4398836457660034,\n        \"nauc_precision_at_3_diff1\": 0.8670494864612496,\n        \"nauc_precision_at_3_max\": 0.8558543417366978,\n        \"nauc_precision_at_3_std\": 0.08870214752567777,\n        \"nauc_precision_at_5_diff1\": 0.8773109243697506,\n        \"nauc_precision_at_5_max\": 0.8860255213196399,\n        \"nauc_precision_at_5_std\": 0.2848428260192923,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8558590102707876,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.8068394024276523,\n        \"nauc_recall_at_10_diff1\": 0.8851762927393169,\n        \"nauc_recall_at_10_max\": 0.9416433239962636,\n        \"nauc_recall_at_10_std\": 0.4226579520697196,\n        \"nauc_recall_at_1_diff1\": 0.9129032258064524,\n        \"nauc_recall_at_1_max\": 0.7948743587514139,\n        \"nauc_recall_at_1_std\": -0.0959960003477958,\n        \"nauc_recall_at_20_diff1\": 0.8761042878690056,\n        \"nauc_recall_at_20_max\": 0.9472096530920127,\n        \"nauc_recall_at_20_std\": 0.4398836457660057,\n        \"nauc_recall_at_3_diff1\": 0.8670494864612522,\n        \"nauc_recall_at_3_max\": 0.8558543417366946,\n        \"nauc_recall_at_3_std\": 0.08870214752567522,\n        \"nauc_recall_at_5_diff1\": 0.8773109243697501,\n        \"nauc_recall_at_5_max\": 0.8860255213196395,\n        \"nauc_recall_at_5_std\": 0.28484282601929706,\n        \"ndcg_at_1\": 0.87778,\n        \"ndcg_at_10\": 0.92939,\n        \"ndcg_at_100\": 0.93337,\n        \"ndcg_at_1000\": 0.93397,\n        \"ndcg_at_20\": 0.93163,\n        \"ndcg_at_3\": 0.91708,\n        \"ndcg_at_5\": 0.92626,\n        \"precision_at_1\": 0.87778,\n        \"precision_at_10\": 0.09767,\n        \"precision_at_100\": 0.00996,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04928,\n        \"precision_at_3\": 0.31481,\n        \"precision_at_5\": 0.19333,\n        \"recall_at_1\": 0.87778,\n        \"recall_at_10\": 0.97667,\n        \"recall_at_100\": 0.99556,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98556,\n        \"recall_at_3\": 0.94444,\n        \"recall_at_5\": 0.96667\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-Qwen2-7B-instruct/Alibaba-NLP__gte-Qwen2-7B-instruct/e26182b2122f4435e8b3ebecbf363990f409b45b/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 9451.070049762726,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.8108,\n        \"map_at_1\": 0.49102,\n        \"map_at_10\": 0.76711,\n        \"map_at_100\": 0.77193,\n        \"map_at_1000\": 0.77217,\n        \"map_at_20\": 0.7704,\n        \"map_at_3\": 0.72297,\n        \"map_at_5\": 0.75609,\n        \"mrr_at_1\": 0.7567567567567568,\n        \"mrr_at_10\": 0.8184329418704417,\n        \"mrr_at_100\": 0.8199197488873609,\n        \"mrr_at_1000\": 0.820035921652267,\n        \"mrr_at_20\": 0.8191797589412719,\n        \"mrr_at_3\": 0.8124999999999999,\n        \"mrr_at_5\": 0.816216216216216,\n        \"nauc_map_at_1000_diff1\": 0.5860412800077854,\n        \"nauc_map_at_1000_max\": 0.5688615375646618,\n        \"nauc_map_at_1000_std\": 0.14232936442918717,\n        \"nauc_map_at_100_diff1\": 0.5862654281094708,\n        \"nauc_map_at_100_max\": 0.5693298489926267,\n        \"nauc_map_at_100_std\": 0.14289907790694886,\n        \"nauc_map_at_10_diff1\": 0.58259296969473,\n        \"nauc_map_at_10_max\": 0.5700053608148513,\n        \"nauc_map_at_10_std\": 0.1378994523753573,\n        \"nauc_map_at_1_diff1\": 0.632693918726285,\n        \"nauc_map_at_1_max\": 0.19506800049379597,\n        \"nauc_map_at_1_std\": -0.11312532728724334,\n        \"nauc_map_at_20_diff1\": 0.5849545323148008,\n        \"nauc_map_at_20_max\": 0.5699622379553662,\n        \"nauc_map_at_20_std\": 0.14174612526369168,\n        \"nauc_map_at_3_diff1\": 0.5695775561789569,\n        \"nauc_map_at_3_max\": 0.5001255236964945,\n        \"nauc_map_at_3_std\": 0.058437237332709745,\n        \"nauc_map_at_5_diff1\": 0.5759990071437616,\n        \"nauc_map_at_5_max\": 0.5586872929226386,\n        \"nauc_map_at_5_std\": 0.10931034514013828,\n        \"nauc_mrr_at_1000_diff1\": 0.6709973477564796,\n        \"nauc_mrr_at_1000_max\": 0.6282079865303426,\n        \"nauc_mrr_at_1000_std\": 0.2182570851932003,\n        \"nauc_mrr_at_100_diff1\": 0.6711170760242097,\n        \"nauc_mrr_at_100_max\": 0.628458884294849,\n        \"nauc_mrr_at_100_std\": 0.21873771212546203,\n        \"nauc_mrr_at_10_diff1\": 0.6708764756266502,\n        \"nauc_mrr_at_10_max\": 0.6309082959700567,\n        \"nauc_mrr_at_10_std\": 0.22073367752871997,\n        \"nauc_mrr_at_1_diff1\": 0.6512317513672372,\n        \"nauc_mrr_at_1_max\": 0.4938058683502111,\n        \"nauc_mrr_at_1_std\": 0.043607255153568676,\n        \"nauc_mrr_at_20_diff1\": 0.6708019682498405,\n        \"nauc_mrr_at_20_max\": 0.6295377015786073,\n        \"nauc_mrr_at_20_std\": 0.21860680581568911,\n        \"nauc_mrr_at_3_diff1\": 0.6749605035448772,\n        \"nauc_mrr_at_3_max\": 0.6308357607971359,\n        \"nauc_mrr_at_3_std\": 0.2123955334390889,\n        \"nauc_mrr_at_5_diff1\": 0.6707744820554383,\n        \"nauc_mrr_at_5_max\": 0.6326256995891799,\n        \"nauc_mrr_at_5_std\": 0.22072942902869305,\n        \"nauc_ndcg_at_1000_diff1\": 0.6193636658978984,\n        \"nauc_ndcg_at_1000_max\": 0.630697544541978,\n        \"nauc_ndcg_at_1000_std\": 0.2386622609694652,\n        \"nauc_ndcg_at_100_diff1\": 0.6249180286049728,\n        \"nauc_ndcg_at_100_max\": 0.6433073743489643,\n        \"nauc_ndcg_at_100_std\": 0.2567146683561388,\n        \"nauc_ndcg_at_10_diff1\": 0.6136536266134186,\n        \"nauc_ndcg_at_10_max\": 0.6489710228693197,\n        \"nauc_ndcg_at_10_std\": 0.24420829169202138,\n        \"nauc_ndcg_at_1_diff1\": 0.6512317513672372,\n        \"nauc_ndcg_at_1_max\": 0.4938058683502111,\n        \"nauc_ndcg_at_1_std\": 0.043607255153568676,\n        \"nauc_ndcg_at_20_diff1\": 0.6187284093130772,\n        \"nauc_ndcg_at_20_max\": 0.6481730608510515,\n        \"nauc_ndcg_at_20_std\": 0.24951834109610457,\n        \"nauc_ndcg_at_3_diff1\": 0.5955050016913125,\n        \"nauc_ndcg_at_3_max\": 0.5693055062275632,\n        \"nauc_ndcg_at_3_std\": 0.13404496786641223,\n        \"nauc_ndcg_at_5_diff1\": 0.6018163792854944,\n        \"nauc_ndcg_at_5_max\": 0.629072716288407,\n        \"nauc_ndcg_at_5_std\": 0.19753897996008837,\n        \"nauc_precision_at_1000_diff1\": -0.344189042020911,\n        \"nauc_precision_at_1000_max\": 0.06475013447391754,\n        \"nauc_precision_at_1000_std\": 0.23917858332558542,\n        \"nauc_precision_at_100_diff1\": -0.23914321934560318,\n        \"nauc_precision_at_100_max\": 0.1849182738696575,\n        \"nauc_precision_at_100_std\": 0.32206416448630437,\n        \"nauc_precision_at_10_diff1\": -0.16380898142137407,\n        \"nauc_precision_at_10_max\": 0.2985983037666543,\n        \"nauc_precision_at_10_std\": 0.33963783741465275,\n        \"nauc_precision_at_1_diff1\": 0.6512317513672372,\n        \"nauc_precision_at_1_max\": 0.4938058683502111,\n        \"nauc_precision_at_1_std\": 0.043607255153568676,\n        \"nauc_precision_at_20_diff1\": -0.18782381198510406,\n        \"nauc_precision_at_20_max\": 0.25344887941275157,\n        \"nauc_precision_at_20_std\": 0.3301393828208045,\n        \"nauc_precision_at_3_diff1\": -0.03798706450288487,\n        \"nauc_precision_at_3_max\": 0.41546117059530224,\n        \"nauc_precision_at_3_std\": 0.2841280644973789,\n        \"nauc_precision_at_5_diff1\": -0.11961371289466115,\n        \"nauc_precision_at_5_max\": 0.34773826390289747,\n        \"nauc_precision_at_5_std\": 0.3053693435767689,\n        \"nauc_recall_at_1000_diff1\": 0.6975728443917598,\n        \"nauc_recall_at_1000_max\": 0.9852414530686907,\n        \"nauc_recall_at_1000_std\": 0.9563648851837822,\n        \"nauc_recall_at_100_diff1\": 0.7357693746397532,\n        \"nauc_recall_at_100_max\": 0.970368714583283,\n        \"nauc_recall_at_100_std\": 0.8305978541126534,\n        \"nauc_recall_at_10_diff1\": 0.630960245824474,\n        \"nauc_recall_at_10_max\": 0.8657233835111986,\n        \"nauc_recall_at_10_std\": 0.5369361718154417,\n        \"nauc_recall_at_1_diff1\": 0.632693918726285,\n        \"nauc_recall_at_1_max\": 0.19506800049379597,\n        \"nauc_recall_at_1_std\": -0.11312532728724334,\n        \"nauc_recall_at_20_diff1\": 0.6587733846215134,\n        \"nauc_recall_at_20_max\": 0.9010277052483276,\n        \"nauc_recall_at_20_std\": 0.608188922151966,\n        \"nauc_recall_at_3_diff1\": 0.5766836091129506,\n        \"nauc_recall_at_3_max\": 0.6032568623874444,\n        \"nauc_recall_at_3_std\": 0.1834427343207938,\n        \"nauc_recall_at_5_diff1\": 0.5898441814477909,\n        \"nauc_recall_at_5_max\": 0.7572960798154303,\n        \"nauc_recall_at_5_std\": 0.34333987643488223,\n        \"ndcg_at_1\": 0.75676,\n        \"ndcg_at_10\": 0.8108,\n        \"ndcg_at_100\": 0.82549,\n        \"ndcg_at_1000\": 0.83146,\n        \"ndcg_at_20\": 0.81772,\n        \"ndcg_at_3\": 0.7644,\n        \"ndcg_at_5\": 0.79491,\n        \"precision_at_1\": 0.75676,\n        \"precision_at_10\": 0.16318,\n        \"precision_at_100\": 0.0176,\n        \"precision_at_1000\": 0.00185,\n        \"precision_at_20\": 0.08412,\n        \"precision_at_3\": 0.45946,\n        \"precision_at_5\": 0.30811,\n        \"recall_at_1\": 0.49102,\n        \"recall_at_10\": 0.87588,\n        \"recall_at_100\": 0.92891,\n        \"recall_at_1000\": 0.9676,\n        \"recall_at_20\": 0.89667,\n        \"recall_at_3\": 0.77636,\n        \"recall_at_5\": 0.838\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-Qwen2-7B-instruct/Alibaba-NLP__gte-Qwen2-7B-instruct/e26182b2122f4435e8b3ebecbf363990f409b45b/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 529443.3452823162,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.53375,\n        \"map_at_1\": 0.32154,\n        \"map_at_10\": 0.44673,\n        \"map_at_100\": 0.46751,\n        \"map_at_1000\": 0.46925,\n        \"map_at_20\": 0.45789,\n        \"map_at_3\": 0.40325,\n        \"map_at_5\": 0.42409,\n        \"mrr_at_1\": 0.5023474178403756,\n        \"mrr_at_10\": 0.6107105596542215,\n        \"mrr_at_100\": 0.6154599409080139,\n        \"mrr_at_1000\": 0.6155662638623027,\n        \"mrr_at_20\": 0.6140300142709334,\n        \"mrr_at_3\": 0.5829420970266039,\n        \"mrr_at_5\": 0.5989045383411579,\n        \"nauc_map_at_1000_diff1\": 0.36031682483777533,\n        \"nauc_map_at_1000_max\": 0.45390972288889114,\n        \"nauc_map_at_1000_std\": 0.13734187164243297,\n        \"nauc_map_at_100_diff1\": 0.3600105915368106,\n        \"nauc_map_at_100_max\": 0.4542942414546183,\n        \"nauc_map_at_100_std\": 0.13738385626349392,\n        \"nauc_map_at_10_diff1\": 0.37024010443796035,\n        \"nauc_map_at_10_max\": 0.45045624061818007,\n        \"nauc_map_at_10_std\": 0.11853986467680915,\n        \"nauc_map_at_1_diff1\": 0.4706687514348616,\n        \"nauc_map_at_1_max\": 0.3785598180609727,\n        \"nauc_map_at_1_std\": 0.019557004686001363,\n        \"nauc_map_at_20_diff1\": 0.36274647010544186,\n        \"nauc_map_at_20_max\": 0.4536888030295927,\n        \"nauc_map_at_20_std\": 0.12753823479536147,\n        \"nauc_map_at_3_diff1\": 0.38115606736353363,\n        \"nauc_map_at_3_max\": 0.4144717952993478,\n        \"nauc_map_at_3_std\": 0.09752636322817537,\n        \"nauc_map_at_5_diff1\": 0.37467387847101574,\n        \"nauc_map_at_5_max\": 0.43567861778923944,\n        \"nauc_map_at_5_std\": 0.10313974453104882,\n        \"nauc_mrr_at_1000_diff1\": 0.2852977064023687,\n        \"nauc_mrr_at_1000_max\": 0.398570864440513,\n        \"nauc_mrr_at_1000_std\": 0.20335934910198356,\n        \"nauc_mrr_at_100_diff1\": 0.2853112466469182,\n        \"nauc_mrr_at_100_max\": 0.39850219473785614,\n        \"nauc_mrr_at_100_std\": 0.20357699621251318,\n        \"nauc_mrr_at_10_diff1\": 0.2858037102372598,\n        \"nauc_mrr_at_10_max\": 0.39935268233483895,\n        \"nauc_mrr_at_10_std\": 0.20273336747754533,\n        \"nauc_mrr_at_1_diff1\": 0.35781125255772933,\n        \"nauc_mrr_at_1_max\": 0.3817075728005826,\n        \"nauc_mrr_at_1_std\": 0.15291749551166287,\n        \"nauc_mrr_at_20_diff1\": 0.28526035685683987,\n        \"nauc_mrr_at_20_max\": 0.399936960823763,\n        \"nauc_mrr_at_20_std\": 0.20434386179383293,\n        \"nauc_mrr_at_3_diff1\": 0.2894201723559571,\n        \"nauc_mrr_at_3_max\": 0.3844481810664284,\n        \"nauc_mrr_at_3_std\": 0.20303269450222397,\n        \"nauc_mrr_at_5_diff1\": 0.28541917051266164,\n        \"nauc_mrr_at_5_max\": 0.40044268989170173,\n        \"nauc_mrr_at_5_std\": 0.19709143657059006,\n        \"nauc_ndcg_at_1000_diff1\": 0.3077962815159766,\n        \"nauc_ndcg_at_1000_max\": 0.46609651208669883,\n        \"nauc_ndcg_at_1000_std\": 0.21539275920415737,\n        \"nauc_ndcg_at_100_diff1\": 0.3016914461573391,\n        \"nauc_ndcg_at_100_max\": 0.4713105342695115,\n        \"nauc_ndcg_at_100_std\": 0.2263944047923428,\n        \"nauc_ndcg_at_10_diff1\": 0.32321710435700557,\n        \"nauc_ndcg_at_10_max\": 0.4674512727191553,\n        \"nauc_ndcg_at_10_std\": 0.16902846173636296,\n        \"nauc_ndcg_at_1_diff1\": 0.35781125255772933,\n        \"nauc_ndcg_at_1_max\": 0.3817075728005826,\n        \"nauc_ndcg_at_1_std\": 0.15291749551166287,\n        \"nauc_ndcg_at_20_diff1\": 0.3012113569809693,\n        \"nauc_ndcg_at_20_max\": 0.47150220023564965,\n        \"nauc_ndcg_at_20_std\": 0.18771797034660115,\n        \"nauc_ndcg_at_3_diff1\": 0.3344897853051733,\n        \"nauc_ndcg_at_3_max\": 0.41103017207276366,\n        \"nauc_ndcg_at_3_std\": 0.16543980238878778,\n        \"nauc_ndcg_at_5_diff1\": 0.32596617209752865,\n        \"nauc_ndcg_at_5_max\": 0.44257031745396613,\n        \"nauc_ndcg_at_5_std\": 0.15271626934313168,\n        \"nauc_precision_at_1000_diff1\": -0.19240298740616193,\n        \"nauc_precision_at_1000_max\": -0.09319519616564716,\n        \"nauc_precision_at_1000_std\": 0.19996903865573903,\n        \"nauc_precision_at_100_diff1\": -0.20633671484264068,\n        \"nauc_precision_at_100_max\": -0.005120399255030897,\n        \"nauc_precision_at_100_std\": 0.29184767615959145,\n        \"nauc_precision_at_10_diff1\": -0.1063489415799065,\n        \"nauc_precision_at_10_max\": 0.24302859238436084,\n        \"nauc_precision_at_10_std\": 0.2998399174212745,\n        \"nauc_precision_at_1_diff1\": 0.35781125255772933,\n        \"nauc_precision_at_1_max\": 0.3817075728005826,\n        \"nauc_precision_at_1_std\": 0.15291749551166287,\n        \"nauc_precision_at_20_diff1\": -0.18982635217381524,\n        \"nauc_precision_at_20_max\": 0.15302492246844374,\n        \"nauc_precision_at_20_std\": 0.30148495252965213,\n        \"nauc_precision_at_3_diff1\": 0.051384039218975025,\n        \"nauc_precision_at_3_max\": 0.3415094720366865,\n        \"nauc_precision_at_3_std\": 0.3050973666769741,\n        \"nauc_precision_at_5_diff1\": -0.05159355651665696,\n        \"nauc_precision_at_5_max\": 0.2895404001134896,\n        \"nauc_precision_at_5_std\": 0.2870935784123534,\n        \"nauc_recall_at_1000_diff1\": -0.02540042414067673,\n        \"nauc_recall_at_1000_max\": 0.6914512479556674,\n        \"nauc_recall_at_1000_std\": 0.6952669376653589,\n        \"nauc_recall_at_100_diff1\": 0.06431828985652863,\n        \"nauc_recall_at_100_max\": 0.49768612041645394,\n        \"nauc_recall_at_100_std\": 0.5235483628705813,\n        \"nauc_recall_at_10_diff1\": 0.21299696608876725,\n        \"nauc_recall_at_10_max\": 0.46908580333257077,\n        \"nauc_recall_at_10_std\": 0.20166417606311324,\n        \"nauc_recall_at_1_diff1\": 0.4706687514348616,\n        \"nauc_recall_at_1_max\": 0.3785598180609727,\n        \"nauc_recall_at_1_std\": 0.019557004686001363,\n        \"nauc_recall_at_20_diff1\": 0.11674748568996735,\n        \"nauc_recall_at_20_max\": 0.4664820858052285,\n        \"nauc_recall_at_20_std\": 0.24984091736066763,\n        \"nauc_recall_at_3_diff1\": 0.2913781914497467,\n        \"nauc_recall_at_3_max\": 0.3799568988978954,\n        \"nauc_recall_at_3_std\": 0.13544116333758804,\n        \"nauc_recall_at_5_diff1\": 0.25704180765800555,\n        \"nauc_recall_at_5_max\": 0.43482488959261517,\n        \"nauc_recall_at_5_std\": 0.12481012511593734,\n        \"ndcg_at_1\": 0.50235,\n        \"ndcg_at_10\": 0.53375,\n        \"ndcg_at_100\": 0.59893,\n        \"ndcg_at_1000\": 0.61892,\n        \"ndcg_at_20\": 0.55959,\n        \"ndcg_at_3\": 0.48512,\n        \"ndcg_at_5\": 0.5,\n        \"precision_at_1\": 0.50235,\n        \"precision_at_10\": 0.12629,\n        \"precision_at_100\": 0.02056,\n        \"precision_at_1000\": 0.00246,\n        \"precision_at_20\": 0.07535,\n        \"precision_at_3\": 0.26917,\n        \"precision_at_5\": 0.19812,\n        \"recall_at_1\": 0.32154,\n        \"recall_at_10\": 0.62643,\n        \"recall_at_100\": 0.84398,\n        \"recall_at_1000\": 0.95114,\n        \"recall_at_20\": 0.69904,\n        \"recall_at_3\": 0.46787,\n        \"recall_at_5\": 0.5294\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-Qwen2-7B-instruct/Alibaba-NLP__gte-Qwen2-7B-instruct/e26182b2122f4435e8b3ebecbf363990f409b45b/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 523189.4379520416,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.46571,\n        \"map_at_1\": 0.27514,\n        \"map_at_10\": 0.39939,\n        \"map_at_100\": 0.41129,\n        \"map_at_1000\": 0.41168,\n        \"map_at_20\": 0.4066,\n        \"map_at_3\": 0.36448,\n        \"map_at_5\": 0.38421,\n        \"mrr_at_1\": 0.3016627078384798,\n        \"mrr_at_10\": 0.4210279757191871,\n        \"mrr_at_100\": 0.43137655437218475,\n        \"mrr_at_1000\": 0.4316617049477868,\n        \"mrr_at_20\": 0.42775991444354394,\n        \"mrr_at_3\": 0.39152810768012675,\n        \"mrr_at_5\": 0.40779889152810783,\n        \"nauc_map_at_1000_diff1\": 0.33293097264950955,\n        \"nauc_map_at_1000_max\": 0.3130945117290807,\n        \"nauc_map_at_1000_std\": 0.15320103165009255,\n        \"nauc_map_at_100_diff1\": 0.3329715076297884,\n        \"nauc_map_at_100_max\": 0.3129594820935785,\n        \"nauc_map_at_100_std\": 0.15338062022944135,\n        \"nauc_map_at_10_diff1\": 0.32887360247558767,\n        \"nauc_map_at_10_max\": 0.3108233813084867,\n        \"nauc_map_at_10_std\": 0.1546675312359396,\n        \"nauc_map_at_1_diff1\": 0.36727145137891976,\n        \"nauc_map_at_1_max\": 0.2835205184523079,\n        \"nauc_map_at_1_std\": 0.08284292069749208,\n        \"nauc_map_at_20_diff1\": 0.3312437874430616,\n        \"nauc_map_at_20_max\": 0.3132079222147372,\n        \"nauc_map_at_20_std\": 0.15360937950563022,\n        \"nauc_map_at_3_diff1\": 0.3359312089046139,\n        \"nauc_map_at_3_max\": 0.30787457325441847,\n        \"nauc_map_at_3_std\": 0.13849369378070164,\n        \"nauc_map_at_5_diff1\": 0.3399343435870189,\n        \"nauc_map_at_5_max\": 0.31547727388019076,\n        \"nauc_map_at_5_std\": 0.1446015036644677,\n        \"nauc_mrr_at_1000_diff1\": 0.34708453070365647,\n        \"nauc_mrr_at_1000_max\": 0.3327969140637137,\n        \"nauc_mrr_at_1000_std\": 0.16830876389746163,\n        \"nauc_mrr_at_100_diff1\": 0.3470604278609808,\n        \"nauc_mrr_at_100_max\": 0.3326620162101879,\n        \"nauc_mrr_at_100_std\": 0.16837297579442742,\n        \"nauc_mrr_at_10_diff1\": 0.3437214867731117,\n        \"nauc_mrr_at_10_max\": 0.3316098836220819,\n        \"nauc_mrr_at_10_std\": 0.1690527564620172,\n        \"nauc_mrr_at_1_diff1\": 0.3767527634408593,\n        \"nauc_mrr_at_1_max\": 0.3048804875104381,\n        \"nauc_mrr_at_1_std\": 0.10983635052464556,\n        \"nauc_mrr_at_20_diff1\": 0.3452672537657949,\n        \"nauc_mrr_at_20_max\": 0.33298105123957994,\n        \"nauc_mrr_at_20_std\": 0.1682974971024297,\n        \"nauc_mrr_at_3_diff1\": 0.349791941798552,\n        \"nauc_mrr_at_3_max\": 0.3344859077948214,\n        \"nauc_mrr_at_3_std\": 0.16473453655024795,\n        \"nauc_mrr_at_5_diff1\": 0.3537503263120288,\n        \"nauc_mrr_at_5_max\": 0.3353023453737103,\n        \"nauc_mrr_at_5_std\": 0.1662874495535466,\n        \"nauc_ndcg_at_1000_diff1\": 0.32908917733637794,\n        \"nauc_ndcg_at_1000_max\": 0.32613113076041883,\n        \"nauc_ndcg_at_1000_std\": 0.18277112937224538,\n        \"nauc_ndcg_at_100_diff1\": 0.329842647374385,\n        \"nauc_ndcg_at_100_max\": 0.3204276831537327,\n        \"nauc_ndcg_at_100_std\": 0.18695185786004517,\n        \"nauc_ndcg_at_10_diff1\": 0.308389151053235,\n        \"nauc_ndcg_at_10_max\": 0.31744735058957213,\n        \"nauc_ndcg_at_10_std\": 0.18928893750159045,\n        \"nauc_ndcg_at_1_diff1\": 0.3767527634408593,\n        \"nauc_ndcg_at_1_max\": 0.3048804875104381,\n        \"nauc_ndcg_at_1_std\": 0.10983635052464556,\n        \"nauc_ndcg_at_20_diff1\": 0.3142097652257374,\n        \"nauc_ndcg_at_20_max\": 0.3256140956842127,\n        \"nauc_ndcg_at_20_std\": 0.18825616208232035,\n        \"nauc_ndcg_at_3_diff1\": 0.32710712769551964,\n        \"nauc_ndcg_at_3_max\": 0.31887549789970226,\n        \"nauc_ndcg_at_3_std\": 0.1612799742774508,\n        \"nauc_ndcg_at_5_diff1\": 0.33316107860910377,\n        \"nauc_ndcg_at_5_max\": 0.32772903954728455,\n        \"nauc_ndcg_at_5_std\": 0.16985213318205114,\n        \"nauc_precision_at_1000_diff1\": 0.05823992403845274,\n        \"nauc_precision_at_1000_max\": 0.1253829515929163,\n        \"nauc_precision_at_1000_std\": 0.09610589777902924,\n        \"nauc_precision_at_100_diff1\": 0.14105102943548245,\n        \"nauc_precision_at_100_max\": 0.1440230375138777,\n        \"nauc_precision_at_100_std\": 0.17203917643895358,\n        \"nauc_precision_at_10_diff1\": 0.18331538719235707,\n        \"nauc_precision_at_10_max\": 0.28980912626029914,\n        \"nauc_precision_at_10_std\": 0.2805987246660366,\n        \"nauc_precision_at_1_diff1\": 0.3767527634408593,\n        \"nauc_precision_at_1_max\": 0.3048804875104381,\n        \"nauc_precision_at_1_std\": 0.10983635052464556,\n        \"nauc_precision_at_20_diff1\": 0.15619077660826267,\n        \"nauc_precision_at_20_max\": 0.2832576972655273,\n        \"nauc_precision_at_20_std\": 0.24994856873135776,\n        \"nauc_precision_at_3_diff1\": 0.30310011086092725,\n        \"nauc_precision_at_3_max\": 0.3488172732208653,\n        \"nauc_precision_at_3_std\": 0.2316356138771506,\n        \"nauc_precision_at_5_diff1\": 0.28818187989791355,\n        \"nauc_precision_at_5_max\": 0.34918912698140314,\n        \"nauc_precision_at_5_std\": 0.2403851697874218,\n        \"nauc_recall_at_1000_diff1\": 0.252208053700925,\n        \"nauc_recall_at_1000_max\": 0.539409617920156,\n        \"nauc_recall_at_1000_std\": 0.7654850168562043,\n        \"nauc_recall_at_100_diff1\": 0.31153747808028986,\n        \"nauc_recall_at_100_max\": 0.2589106974778827,\n        \"nauc_recall_at_100_std\": 0.4433876652036297,\n        \"nauc_recall_at_10_diff1\": 0.20384518056559342,\n        \"nauc_recall_at_10_max\": 0.29640975881808485,\n        \"nauc_recall_at_10_std\": 0.2876325943932951,\n        \"nauc_recall_at_1_diff1\": 0.36727145137891976,\n        \"nauc_recall_at_1_max\": 0.2835205184523079,\n        \"nauc_recall_at_1_std\": 0.08284292069749208,\n        \"nauc_recall_at_20_diff1\": 0.20428489732555838,\n        \"nauc_recall_at_20_max\": 0.3310372371548431,\n        \"nauc_recall_at_20_std\": 0.3143954063567378,\n        \"nauc_recall_at_3_diff1\": 0.2765682171149457,\n        \"nauc_recall_at_3_max\": 0.3119664143708647,\n        \"nauc_recall_at_3_std\": 0.19408329545045494,\n        \"nauc_recall_at_5_diff1\": 0.28498223121657856,\n        \"nauc_recall_at_5_max\": 0.3281071536534065,\n        \"nauc_recall_at_5_std\": 0.2149027801698047,\n        \"ndcg_at_1\": 0.30166,\n        \"ndcg_at_10\": 0.46571,\n        \"ndcg_at_100\": 0.52079,\n        \"ndcg_at_1000\": 0.53041,\n        \"ndcg_at_20\": 0.4905,\n        \"ndcg_at_3\": 0.39923,\n        \"ndcg_at_5\": 0.43194,\n        \"precision_at_1\": 0.30166,\n        \"precision_at_10\": 0.07292,\n        \"precision_at_100\": 0.01043,\n        \"precision_at_1000\": 0.00113,\n        \"precision_at_20\": 0.04228,\n        \"precision_at_3\": 0.1734,\n        \"precision_at_5\": 0.12209,\n        \"recall_at_1\": 0.27514,\n        \"recall_at_10\": 0.64846,\n        \"recall_at_100\": 0.89351,\n        \"recall_at_1000\": 0.96793,\n        \"recall_at_20\": 0.7403,\n        \"recall_at_3\": 0.47427,\n        \"recall_at_5\": 0.54988\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-Qwen2-7B-instruct/Alibaba-NLP__gte-Qwen2-7B-instruct/e26182b2122f4435e8b3ebecbf363990f409b45b/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 6735.936784029007,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.30313,\n        \"map_at_1\": 0.21,\n        \"map_at_10\": 0.27097,\n        \"map_at_100\": 0.27948,\n        \"map_at_1000\": 0.28033,\n        \"map_at_20\": 0.27614,\n        \"map_at_3\": 0.255,\n        \"map_at_5\": 0.2635,\n        \"mrr_at_1\": 0.21,\n        \"mrr_at_10\": 0.27097023809523807,\n        \"mrr_at_100\": 0.27947751541679616,\n        \"mrr_at_1000\": 0.2803278246284526,\n        \"mrr_at_20\": 0.27614094647182885,\n        \"mrr_at_3\": 0.25499999999999995,\n        \"mrr_at_5\": 0.26349999999999996,\n        \"nauc_map_at_1000_diff1\": 0.35873770357574136,\n        \"nauc_map_at_1000_max\": 0.31134425197944254,\n        \"nauc_map_at_1000_std\": -0.06704458741305393,\n        \"nauc_map_at_100_diff1\": 0.3586784080926965,\n        \"nauc_map_at_100_max\": 0.311717869958562,\n        \"nauc_map_at_100_std\": -0.06674245676360822,\n        \"nauc_map_at_10_diff1\": 0.35860247103967324,\n        \"nauc_map_at_10_max\": 0.3032036458545803,\n        \"nauc_map_at_10_std\": -0.0813804882991818,\n        \"nauc_map_at_1_diff1\": 0.4261168384879724,\n        \"nauc_map_at_1_max\": 0.32412466150410946,\n        \"nauc_map_at_1_std\": -0.10102617701553508,\n        \"nauc_map_at_20_diff1\": 0.35724833739937045,\n        \"nauc_map_at_20_max\": 0.31083006589902196,\n        \"nauc_map_at_20_std\": -0.06922956842820864,\n        \"nauc_map_at_3_diff1\": 0.3684035495695084,\n        \"nauc_map_at_3_max\": 0.2922831830708324,\n        \"nauc_map_at_3_std\": -0.08888473191164713,\n        \"nauc_map_at_5_diff1\": 0.3678964185766755,\n        \"nauc_map_at_5_max\": 0.30087480560348767,\n        \"nauc_map_at_5_std\": -0.08768089007739847,\n        \"nauc_mrr_at_1000_diff1\": 0.35873770357574136,\n        \"nauc_mrr_at_1000_max\": 0.31134425197944254,\n        \"nauc_mrr_at_1000_std\": -0.06704458741305393,\n        \"nauc_mrr_at_100_diff1\": 0.3586784080926965,\n        \"nauc_mrr_at_100_max\": 0.311717869958562,\n        \"nauc_mrr_at_100_std\": -0.06674245676360822,\n        \"nauc_mrr_at_10_diff1\": 0.35860247103967324,\n        \"nauc_mrr_at_10_max\": 0.3032036458545803,\n        \"nauc_mrr_at_10_std\": -0.0813804882991818,\n        \"nauc_mrr_at_1_diff1\": 0.4261168384879724,\n        \"nauc_mrr_at_1_max\": 0.32412466150410946,\n        \"nauc_mrr_at_1_std\": -0.10102617701553508,\n        \"nauc_mrr_at_20_diff1\": 0.35724833739937045,\n        \"nauc_mrr_at_20_max\": 0.31083006589902196,\n        \"nauc_mrr_at_20_std\": -0.06922956842820864,\n        \"nauc_mrr_at_3_diff1\": 0.3684035495695084,\n        \"nauc_mrr_at_3_max\": 0.2922831830708324,\n        \"nauc_mrr_at_3_std\": -0.08888473191164713,\n        \"nauc_mrr_at_5_diff1\": 0.3678964185766755,\n        \"nauc_mrr_at_5_max\": 0.30087480560348767,\n        \"nauc_mrr_at_5_std\": -0.08768089007739847,\n        \"nauc_ndcg_at_1000_diff1\": 0.3352554616023902,\n        \"nauc_ndcg_at_1000_max\": 0.32663083442920143,\n        \"nauc_ndcg_at_1000_std\": -0.01311576117979229,\n        \"nauc_ndcg_at_100_diff1\": 0.3318237851782861,\n        \"nauc_ndcg_at_100_max\": 0.33657772487092585,\n        \"nauc_ndcg_at_100_std\": -0.005489102690649493,\n        \"nauc_ndcg_at_10_diff1\": 0.3314404267618865,\n        \"nauc_ndcg_at_10_max\": 0.30633427477190284,\n        \"nauc_ndcg_at_10_std\": -0.06522869923869197,\n        \"nauc_ndcg_at_1_diff1\": 0.4261168384879724,\n        \"nauc_ndcg_at_1_max\": 0.32412466150410946,\n        \"nauc_ndcg_at_1_std\": -0.10102617701553508,\n        \"nauc_ndcg_at_20_diff1\": 0.3283232800788365,\n        \"nauc_ndcg_at_20_max\": 0.33313347262163,\n        \"nauc_ndcg_at_20_std\": -0.02484722727801561,\n        \"nauc_ndcg_at_3_diff1\": 0.35287080579869623,\n        \"nauc_ndcg_at_3_max\": 0.2868857758777876,\n        \"nauc_ndcg_at_3_std\": -0.08231335061500795,\n        \"nauc_ndcg_at_5_diff1\": 0.35322102269226135,\n        \"nauc_ndcg_at_5_max\": 0.3024221792638072,\n        \"nauc_ndcg_at_5_std\": -0.07959401367124273,\n        \"nauc_precision_at_1000_diff1\": 0.1879961649089168,\n        \"nauc_precision_at_1000_max\": 0.3998465963566634,\n        \"nauc_precision_at_1000_std\": 0.49311601150527246,\n        \"nauc_precision_at_100_diff1\": 0.23821275795609478,\n        \"nauc_precision_at_100_max\": 0.44484401197135665,\n        \"nauc_precision_at_100_std\": 0.26764756577194854,\n        \"nauc_precision_at_10_diff1\": 0.2552144786810836,\n        \"nauc_precision_at_10_max\": 0.317691509184575,\n        \"nauc_precision_at_10_std\": -0.017563202383024983,\n        \"nauc_precision_at_1_diff1\": 0.4261168384879724,\n        \"nauc_precision_at_1_max\": 0.32412466150410946,\n        \"nauc_precision_at_1_std\": -0.10102617701553508,\n        \"nauc_precision_at_20_diff1\": 0.2454380345408315,\n        \"nauc_precision_at_20_max\": 0.41575801604860807,\n        \"nauc_precision_at_20_std\": 0.12646039031800008,\n        \"nauc_precision_at_3_diff1\": 0.31220954795099287,\n        \"nauc_precision_at_3_max\": 0.2737508466279064,\n        \"nauc_precision_at_3_std\": -0.06407548232643295,\n        \"nauc_precision_at_5_diff1\": 0.31606566022809685,\n        \"nauc_precision_at_5_max\": 0.309862218999275,\n        \"nauc_precision_at_5_std\": -0.05685279187817251,\n        \"nauc_recall_at_1000_diff1\": 0.1879961649089169,\n        \"nauc_recall_at_1000_max\": 0.3998465963566645,\n        \"nauc_recall_at_1000_std\": 0.4931160115052724,\n        \"nauc_recall_at_100_diff1\": 0.23821275795609434,\n        \"nauc_recall_at_100_max\": 0.4448440119713569,\n        \"nauc_recall_at_100_std\": 0.26764756577194837,\n        \"nauc_recall_at_10_diff1\": 0.25521447868108316,\n        \"nauc_recall_at_10_max\": 0.31769150918457467,\n        \"nauc_recall_at_10_std\": -0.017563202383025025,\n        \"nauc_recall_at_1_diff1\": 0.4261168384879724,\n        \"nauc_recall_at_1_max\": 0.32412466150410946,\n        \"nauc_recall_at_1_std\": -0.10102617701553508,\n        \"nauc_recall_at_20_diff1\": 0.24543803454083146,\n        \"nauc_recall_at_20_max\": 0.4157580160486079,\n        \"nauc_recall_at_20_std\": 0.12646039031800027,\n        \"nauc_recall_at_3_diff1\": 0.31220954795099265,\n        \"nauc_recall_at_3_max\": 0.2737508466279063,\n        \"nauc_recall_at_3_std\": -0.06407548232643298,\n        \"nauc_recall_at_5_diff1\": 0.31606566022809673,\n        \"nauc_recall_at_5_max\": 0.30986221899927474,\n        \"nauc_recall_at_5_std\": -0.05685279187817247,\n        \"ndcg_at_1\": 0.21,\n        \"ndcg_at_10\": 0.30313,\n        \"ndcg_at_100\": 0.34874,\n        \"ndcg_at_1000\": 0.37803,\n        \"ndcg_at_20\": 0.32123,\n        \"ndcg_at_3\": 0.27036,\n        \"ndcg_at_5\": 0.28521,\n        \"precision_at_1\": 0.21,\n        \"precision_at_10\": 0.0405,\n        \"precision_at_100\": 0.0063,\n        \"precision_at_1000\": 0.00088,\n        \"precision_at_20\": 0.02375,\n        \"precision_at_3\": 0.105,\n        \"precision_at_5\": 0.07,\n        \"recall_at_1\": 0.21,\n        \"recall_at_10\": 0.405,\n        \"recall_at_100\": 0.63,\n        \"recall_at_1000\": 0.875,\n        \"recall_at_20\": 0.475,\n        \"recall_at_3\": 0.315,\n        \"recall_at_5\": 0.35\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.29368,\n        \"map_at_1\": 0.23,\n        \"map_at_10\": 0.27265,\n        \"map_at_100\": 0.2815,\n        \"map_at_1000\": 0.28244,\n        \"map_at_20\": 0.27838,\n        \"map_at_3\": 0.25917,\n        \"map_at_5\": 0.26867,\n        \"mrr_at_1\": 0.23,\n        \"mrr_at_10\": 0.27264880952380954,\n        \"mrr_at_100\": 0.281497391346387,\n        \"mrr_at_1000\": 0.2824432364298307,\n        \"mrr_at_20\": 0.2783757250661276,\n        \"mrr_at_3\": 0.25916666666666666,\n        \"mrr_at_5\": 0.26866666666666666,\n        \"nauc_map_at_1000_diff1\": 0.5693273819450104,\n        \"nauc_map_at_1000_max\": 0.5806473230147973,\n        \"nauc_map_at_1000_std\": -0.060757043584923086,\n        \"nauc_map_at_100_diff1\": 0.5693786847659337,\n        \"nauc_map_at_100_max\": 0.5807719113443569,\n        \"nauc_map_at_100_std\": -0.06089628585980827,\n        \"nauc_map_at_10_diff1\": 0.5711855003420948,\n        \"nauc_map_at_10_max\": 0.5777140106516642,\n        \"nauc_map_at_10_std\": -0.07319092362315573,\n        \"nauc_map_at_1_diff1\": 0.6205289730174953,\n        \"nauc_map_at_1_max\": 0.5944463934351216,\n        \"nauc_map_at_1_std\": -0.08557679108006284,\n        \"nauc_map_at_20_diff1\": 0.5724183931836933,\n        \"nauc_map_at_20_max\": 0.5807674045138349,\n        \"nauc_map_at_20_std\": -0.06504509217669452,\n        \"nauc_map_at_3_diff1\": 0.5816747629910118,\n        \"nauc_map_at_3_max\": 0.5802199578516652,\n        \"nauc_map_at_3_std\": -0.08412296119192691,\n        \"nauc_map_at_5_diff1\": 0.5773259359315182,\n        \"nauc_map_at_5_max\": 0.5791643172847812,\n        \"nauc_map_at_5_std\": -0.07712777414534365,\n        \"nauc_mrr_at_1000_diff1\": 0.5693273819450104,\n        \"nauc_mrr_at_1000_max\": 0.5806473230147973,\n        \"nauc_mrr_at_1000_std\": -0.060757043584923086,\n        \"nauc_mrr_at_100_diff1\": 0.5693786847659337,\n        \"nauc_mrr_at_100_max\": 0.5807719113443569,\n        \"nauc_mrr_at_100_std\": -0.06089628585980827,\n        \"nauc_mrr_at_10_diff1\": 0.5711855003420948,\n        \"nauc_mrr_at_10_max\": 0.5777140106516642,\n        \"nauc_mrr_at_10_std\": -0.07319092362315573,\n        \"nauc_mrr_at_1_diff1\": 0.6205289730174953,\n        \"nauc_mrr_at_1_max\": 0.5944463934351216,\n        \"nauc_mrr_at_1_std\": -0.08557679108006284,\n        \"nauc_mrr_at_20_diff1\": 0.5724183931836933,\n        \"nauc_mrr_at_20_max\": 0.5807674045138349,\n        \"nauc_mrr_at_20_std\": -0.06504509217669452,\n        \"nauc_mrr_at_3_diff1\": 0.5816747629910118,\n        \"nauc_mrr_at_3_max\": 0.5802199578516652,\n        \"nauc_mrr_at_3_std\": -0.08412296119192691,\n        \"nauc_mrr_at_5_diff1\": 0.5773259359315182,\n        \"nauc_mrr_at_5_max\": 0.5791643172847812,\n        \"nauc_mrr_at_5_std\": -0.07712777414534365,\n        \"nauc_ndcg_at_1000_diff1\": 0.5362013372269028,\n        \"nauc_ndcg_at_1000_max\": 0.5832488209073998,\n        \"nauc_ndcg_at_1000_std\": -0.001090633497059146,\n        \"nauc_ndcg_at_100_diff1\": 0.5350372618108911,\n        \"nauc_ndcg_at_100_max\": 0.584824061919428,\n        \"nauc_ndcg_at_100_std\": 0.00032361783827936655,\n        \"nauc_ndcg_at_10_diff1\": 0.5479495957959611,\n        \"nauc_ndcg_at_10_max\": 0.5725374735471958,\n        \"nauc_ndcg_at_10_std\": -0.061335475446542505,\n        \"nauc_ndcg_at_1_diff1\": 0.6205289730174953,\n        \"nauc_ndcg_at_1_max\": 0.5944463934351216,\n        \"nauc_ndcg_at_1_std\": -0.08557679108006284,\n        \"nauc_ndcg_at_20_diff1\": 0.5548679294963687,\n        \"nauc_ndcg_at_20_max\": 0.5874811607238918,\n        \"nauc_ndcg_at_20_std\": -0.02590888789912424,\n        \"nauc_ndcg_at_3_diff1\": 0.570878278999106,\n        \"nauc_ndcg_at_3_max\": 0.5777343931413231,\n        \"nauc_ndcg_at_3_std\": -0.08385814742901972,\n        \"nauc_ndcg_at_5_diff1\": 0.5630976166667157,\n        \"nauc_ndcg_at_5_max\": 0.5759898239262172,\n        \"nauc_ndcg_at_5_std\": -0.07118431240108142,\n        \"nauc_precision_at_1000_diff1\": 0.2822715643852065,\n        \"nauc_precision_at_1000_max\": 0.6049556236379151,\n        \"nauc_precision_at_1000_std\": 0.5230251729256822,\n        \"nauc_precision_at_100_diff1\": 0.39846672618740214,\n        \"nauc_precision_at_100_max\": 0.604278114324083,\n        \"nauc_precision_at_100_std\": 0.2741446353863069,\n        \"nauc_precision_at_10_diff1\": 0.4793667663884957,\n        \"nauc_precision_at_10_max\": 0.5578845851047082,\n        \"nauc_precision_at_10_std\": -0.02404476985251651,\n        \"nauc_precision_at_1_diff1\": 0.6205289730174953,\n        \"nauc_precision_at_1_max\": 0.5944463934351216,\n        \"nauc_precision_at_1_std\": -0.08557679108006284,\n        \"nauc_precision_at_20_diff1\": 0.509670660642965,\n        \"nauc_precision_at_20_max\": 0.6209520068094021,\n        \"nauc_precision_at_20_std\": 0.1194722713284881,\n        \"nauc_precision_at_3_diff1\": 0.5415367498592096,\n        \"nauc_precision_at_3_max\": 0.5714530994601875,\n        \"nauc_precision_at_3_std\": -0.08318338530005635,\n        \"nauc_precision_at_5_diff1\": 0.524031100637723,\n        \"nauc_precision_at_5_max\": 0.5678262837666922,\n        \"nauc_precision_at_5_std\": -0.053414280198639245,\n        \"nauc_recall_at_1000_diff1\": 0.2822715643852057,\n        \"nauc_recall_at_1000_max\": 0.604955623637915,\n        \"nauc_recall_at_1000_std\": 0.523025172925681,\n        \"nauc_recall_at_100_diff1\": 0.3984667261874016,\n        \"nauc_recall_at_100_max\": 0.6042781143240835,\n        \"nauc_recall_at_100_std\": 0.2741446353863071,\n        \"nauc_recall_at_10_diff1\": 0.47936676638849496,\n        \"nauc_recall_at_10_max\": 0.557884585104708,\n        \"nauc_recall_at_10_std\": -0.024044769852516724,\n        \"nauc_recall_at_1_diff1\": 0.6205289730174953,\n        \"nauc_recall_at_1_max\": 0.5944463934351216,\n        \"nauc_recall_at_1_std\": -0.08557679108006284,\n        \"nauc_recall_at_20_diff1\": 0.5096706606429648,\n        \"nauc_recall_at_20_max\": 0.620952006809402,\n        \"nauc_recall_at_20_std\": 0.11947227132848824,\n        \"nauc_recall_at_3_diff1\": 0.5415367498592092,\n        \"nauc_recall_at_3_max\": 0.5714530994601871,\n        \"nauc_recall_at_3_std\": -0.08318338530005628,\n        \"nauc_recall_at_5_diff1\": 0.5240311006377228,\n        \"nauc_recall_at_5_max\": 0.567826283766692,\n        \"nauc_recall_at_5_std\": -0.053414280198639634,\n        \"ndcg_at_1\": 0.23,\n        \"ndcg_at_10\": 0.29368,\n        \"ndcg_at_100\": 0.34147,\n        \"ndcg_at_1000\": 0.37178,\n        \"ndcg_at_20\": 0.31579,\n        \"ndcg_at_3\": 0.2672,\n        \"ndcg_at_5\": 0.28399,\n        \"precision_at_1\": 0.23,\n        \"precision_at_10\": 0.036,\n        \"precision_at_100\": 0.00595,\n        \"precision_at_1000\": 0.00085,\n        \"precision_at_20\": 0.0225,\n        \"precision_at_3\": 0.09667,\n        \"precision_at_5\": 0.066,\n        \"recall_at_1\": 0.23,\n        \"recall_at_10\": 0.36,\n        \"recall_at_100\": 0.595,\n        \"recall_at_1000\": 0.845,\n        \"recall_at_20\": 0.45,\n        \"recall_at_3\": 0.29,\n        \"recall_at_5\": 0.33\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-Qwen2-7B-instruct/Alibaba-NLP__gte-Qwen2-7B-instruct/e26182b2122f4435e8b3ebecbf363990f409b45b/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 46.12740516662598,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.85844,\n        \"map_at_1\": 0.68831,\n        \"map_at_10\": 0.81196,\n        \"map_at_100\": 0.81196,\n        \"map_at_1000\": 0.81196,\n        \"map_at_20\": 0.81196,\n        \"map_at_3\": 0.80303,\n        \"map_at_5\": 0.80303,\n        \"mrr_at_1\": 0.6883116883116883,\n        \"mrr_at_10\": 0.8119562976705834,\n        \"mrr_at_100\": 0.8119562976705834,\n        \"mrr_at_1000\": 0.8119562976705834,\n        \"mrr_at_20\": 0.8119562976705834,\n        \"mrr_at_3\": 0.8030303030303031,\n        \"mrr_at_5\": 0.8030303030303031,\n        \"nauc_map_at_1000_diff1\": 0.7306499143837317,\n        \"nauc_map_at_1000_max\": 0.3237895227119708,\n        \"nauc_map_at_1000_std\": -0.16620176663433442,\n        \"nauc_map_at_100_diff1\": 0.7306499143837317,\n        \"nauc_map_at_100_max\": 0.3237895227119708,\n        \"nauc_map_at_100_std\": -0.16620176663433442,\n        \"nauc_map_at_10_diff1\": 0.7306499143837317,\n        \"nauc_map_at_10_max\": 0.3237895227119708,\n        \"nauc_map_at_10_std\": -0.16620176663433442,\n        \"nauc_map_at_1_diff1\": 0.7422916035829402,\n        \"nauc_map_at_1_max\": 0.3482164359211589,\n        \"nauc_map_at_1_std\": -0.09165116325682032,\n        \"nauc_map_at_20_diff1\": 0.7306499143837317,\n        \"nauc_map_at_20_max\": 0.3237895227119708,\n        \"nauc_map_at_20_std\": -0.16620176663433442,\n        \"nauc_map_at_3_diff1\": 0.727274397793811,\n        \"nauc_map_at_3_max\": 0.3229930586432481,\n        \"nauc_map_at_3_std\": -0.18695188162216977,\n        \"nauc_map_at_5_diff1\": 0.727274397793811,\n        \"nauc_map_at_5_max\": 0.3229930586432481,\n        \"nauc_map_at_5_std\": -0.18695188162216977,\n        \"nauc_mrr_at_1000_diff1\": 0.7306499143837317,\n        \"nauc_mrr_at_1000_max\": 0.3237895227119708,\n        \"nauc_mrr_at_1000_std\": -0.16620176663433442,\n        \"nauc_mrr_at_100_diff1\": 0.7306499143837317,\n        \"nauc_mrr_at_100_max\": 0.3237895227119708,\n        \"nauc_mrr_at_100_std\": -0.16620176663433442,\n        \"nauc_mrr_at_10_diff1\": 0.7306499143837317,\n        \"nauc_mrr_at_10_max\": 0.3237895227119708,\n        \"nauc_mrr_at_10_std\": -0.16620176663433442,\n        \"nauc_mrr_at_1_diff1\": 0.7422916035829402,\n        \"nauc_mrr_at_1_max\": 0.3482164359211589,\n        \"nauc_mrr_at_1_std\": -0.09165116325682032,\n        \"nauc_mrr_at_20_diff1\": 0.7306499143837317,\n        \"nauc_mrr_at_20_max\": 0.3237895227119708,\n        \"nauc_mrr_at_20_std\": -0.16620176663433442,\n        \"nauc_mrr_at_3_diff1\": 0.727274397793811,\n        \"nauc_mrr_at_3_max\": 0.3229930586432481,\n        \"nauc_mrr_at_3_std\": -0.18695188162216977,\n        \"nauc_mrr_at_5_diff1\": 0.727274397793811,\n        \"nauc_mrr_at_5_max\": 0.3229930586432481,\n        \"nauc_mrr_at_5_std\": -0.18695188162216977,\n        \"nauc_ndcg_at_1000_diff1\": 0.7298622798036085,\n        \"nauc_ndcg_at_1000_max\": 0.32081770832924095,\n        \"nauc_ndcg_at_1000_std\": -0.17269361184898482,\n        \"nauc_ndcg_at_100_diff1\": 0.7298622798036085,\n        \"nauc_ndcg_at_100_max\": 0.32081770832924095,\n        \"nauc_ndcg_at_100_std\": -0.17269361184898482,\n        \"nauc_ndcg_at_10_diff1\": 0.7298622798036085,\n        \"nauc_ndcg_at_10_max\": 0.32081770832924095,\n        \"nauc_ndcg_at_10_std\": -0.17269361184898482,\n        \"nauc_ndcg_at_1_diff1\": 0.7422916035829402,\n        \"nauc_ndcg_at_1_max\": 0.3482164359211589,\n        \"nauc_ndcg_at_1_std\": -0.09165116325682032,\n        \"nauc_ndcg_at_20_diff1\": 0.7298622798036085,\n        \"nauc_ndcg_at_20_max\": 0.32081770832924095,\n        \"nauc_ndcg_at_20_std\": -0.17269361184898482,\n        \"nauc_ndcg_at_3_diff1\": 0.7219783130912044,\n        \"nauc_ndcg_at_3_max\": 0.31347352334832335,\n        \"nauc_ndcg_at_3_std\": -0.22725218013410522,\n        \"nauc_ndcg_at_5_diff1\": 0.7219783130912044,\n        \"nauc_ndcg_at_5_max\": 0.31347352334832335,\n        \"nauc_ndcg_at_5_std\": -0.22725218013410522,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 1.0,\n        \"nauc_precision_at_10_max\": 1.0,\n        \"nauc_precision_at_10_std\": 1.0,\n        \"nauc_precision_at_1_diff1\": 0.7422916035829402,\n        \"nauc_precision_at_1_max\": 0.3482164359211589,\n        \"nauc_precision_at_1_std\": -0.09165116325682032,\n        \"nauc_precision_at_20_diff1\": 1.0,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 1.0,\n        \"nauc_precision_at_3_diff1\": 0.6835820481559275,\n        \"nauc_precision_at_3_max\": 0.24373783838225974,\n        \"nauc_precision_at_3_std\": -0.5271426588640465,\n        \"nauc_precision_at_5_diff1\": 0.6835820481559289,\n        \"nauc_precision_at_5_max\": 0.24373783838226237,\n        \"nauc_precision_at_5_std\": -0.5271426588640427,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": NaN,\n        \"nauc_recall_at_10_max\": NaN,\n        \"nauc_recall_at_10_std\": NaN,\n        \"nauc_recall_at_1_diff1\": 0.7422916035829402,\n        \"nauc_recall_at_1_max\": 0.3482164359211589,\n        \"nauc_recall_at_1_std\": -0.09165116325682032,\n        \"nauc_recall_at_20_diff1\": NaN,\n        \"nauc_recall_at_20_max\": NaN,\n        \"nauc_recall_at_20_std\": NaN,\n        \"nauc_recall_at_3_diff1\": 0.6835820481559286,\n        \"nauc_recall_at_3_max\": 0.24373783838225746,\n        \"nauc_recall_at_3_std\": -0.5271426588640481,\n        \"nauc_recall_at_5_diff1\": 0.6835820481559286,\n        \"nauc_recall_at_5_max\": 0.24373783838225746,\n        \"nauc_recall_at_5_std\": -0.5271426588640481,\n        \"ndcg_at_1\": 0.68831,\n        \"ndcg_at_10\": 0.85844,\n        \"ndcg_at_100\": 0.85844,\n        \"ndcg_at_1000\": 0.85844,\n        \"ndcg_at_20\": 0.85844,\n        \"ndcg_at_3\": 0.83719,\n        \"ndcg_at_5\": 0.83719,\n        \"precision_at_1\": 0.68831,\n        \"precision_at_10\": 0.1,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.05,\n        \"precision_at_3\": 0.31169,\n        \"precision_at_5\": 0.18701,\n        \"recall_at_1\": 0.68831,\n        \"recall_at_10\": 1.0,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 1.0,\n        \"recall_at_3\": 0.93506,\n        \"recall_at_5\": 0.93506\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-Qwen2-7B-instruct/Alibaba-NLP__gte-Qwen2-7B-instruct/e26182b2122f4435e8b3ebecbf363990f409b45b/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 373.6595883369446,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.37866,\n        \"map_at_1\": 0.21493,\n        \"map_at_10\": 0.3305,\n        \"map_at_100\": 0.34654,\n        \"map_at_1000\": 0.34759,\n        \"map_at_20\": 0.33866,\n        \"map_at_3\": 0.2948,\n        \"map_at_5\": 0.31486,\n        \"mrr_at_1\": 0.2996941896024465,\n        \"mrr_at_10\": 0.36733168292801305,\n        \"mrr_at_100\": 0.3793843923095916,\n        \"mrr_at_1000\": 0.380081832466756,\n        \"mrr_at_20\": 0.37381202387628654,\n        \"mrr_at_3\": 0.34378185524974525,\n        \"mrr_at_5\": 0.35616717635066264,\n        \"nauc_map_at_1000_diff1\": 0.39605398696420363,\n        \"nauc_map_at_1000_max\": 0.0412782945923716,\n        \"nauc_map_at_1000_std\": -0.3673566334388843,\n        \"nauc_map_at_100_diff1\": 0.395789867336939,\n        \"nauc_map_at_100_max\": 0.04155953451877115,\n        \"nauc_map_at_100_std\": -0.36651315519418337,\n        \"nauc_map_at_10_diff1\": 0.3977984105897261,\n        \"nauc_map_at_10_max\": 0.03743921340462259,\n        \"nauc_map_at_10_std\": -0.37518750626502256,\n        \"nauc_map_at_1_diff1\": 0.446152501423059,\n        \"nauc_map_at_1_max\": 0.02663440208773937,\n        \"nauc_map_at_1_std\": -0.33965214961688095,\n        \"nauc_map_at_20_diff1\": 0.39625562343728227,\n        \"nauc_map_at_20_max\": 0.038924158809186135,\n        \"nauc_map_at_20_std\": -0.37210104220524026,\n        \"nauc_map_at_3_diff1\": 0.39380176890037777,\n        \"nauc_map_at_3_max\": 0.03416038244220423,\n        \"nauc_map_at_3_std\": -0.3681811178017894,\n        \"nauc_map_at_5_diff1\": 0.39571643464140555,\n        \"nauc_map_at_5_max\": 0.03721875189175598,\n        \"nauc_map_at_5_std\": -0.37458573833597125,\n        \"nauc_mrr_at_1000_diff1\": 0.4204049613713672,\n        \"nauc_mrr_at_1000_max\": 0.04473616768863933,\n        \"nauc_mrr_at_1000_std\": -0.3683979005894126,\n        \"nauc_mrr_at_100_diff1\": 0.42024967745486136,\n        \"nauc_mrr_at_100_max\": 0.04499165061867992,\n        \"nauc_mrr_at_100_std\": -0.3677313105342792,\n        \"nauc_mrr_at_10_diff1\": 0.4213875590775421,\n        \"nauc_mrr_at_10_max\": 0.03916398461276921,\n        \"nauc_mrr_at_10_std\": -0.3760084893557857,\n        \"nauc_mrr_at_1_diff1\": 0.43496360123353245,\n        \"nauc_mrr_at_1_max\": 0.05114237339724553,\n        \"nauc_mrr_at_1_std\": -0.3737822614588633,\n        \"nauc_mrr_at_20_diff1\": 0.42058757596953117,\n        \"nauc_mrr_at_20_max\": 0.042627432553596564,\n        \"nauc_mrr_at_20_std\": -0.37140474184158695,\n        \"nauc_mrr_at_3_diff1\": 0.42186574684849265,\n        \"nauc_mrr_at_3_max\": 0.03772375422449969,\n        \"nauc_mrr_at_3_std\": -0.3779124477466279,\n        \"nauc_mrr_at_5_diff1\": 0.4199331499830262,\n        \"nauc_mrr_at_5_max\": 0.03760842836763998,\n        \"nauc_mrr_at_5_std\": -0.37814230032915724,\n        \"nauc_ndcg_at_1000_diff1\": 0.3978473800651747,\n        \"nauc_ndcg_at_1000_max\": 0.053960682039080894,\n        \"nauc_ndcg_at_1000_std\": -0.3476679618966263,\n        \"nauc_ndcg_at_100_diff1\": 0.3936901716079827,\n        \"nauc_ndcg_at_100_max\": 0.06975428508696647,\n        \"nauc_ndcg_at_100_std\": -0.3176601369260679,\n        \"nauc_ndcg_at_10_diff1\": 0.4015378876968567,\n        \"nauc_ndcg_at_10_max\": 0.03791666857344486,\n        \"nauc_ndcg_at_10_std\": -0.37436111440335995,\n        \"nauc_ndcg_at_1_diff1\": 0.4302105091963213,\n        \"nauc_ndcg_at_1_max\": 0.04725753243883758,\n        \"nauc_ndcg_at_1_std\": -0.3773456769429174,\n        \"nauc_ndcg_at_20_diff1\": 0.3962429416823341,\n        \"nauc_ndcg_at_20_max\": 0.04389393336467113,\n        \"nauc_ndcg_at_20_std\": -0.3630483112178299,\n        \"nauc_ndcg_at_3_diff1\": 0.3950615196047281,\n        \"nauc_ndcg_at_3_max\": 0.030305615511054654,\n        \"nauc_ndcg_at_3_std\": -0.37394136253274857,\n        \"nauc_ndcg_at_5_diff1\": 0.3963854674719409,\n        \"nauc_ndcg_at_5_max\": 0.034625800368698355,\n        \"nauc_ndcg_at_5_std\": -0.375950275291491,\n        \"nauc_precision_at_1000_diff1\": -0.034626884552404966,\n        \"nauc_precision_at_1000_max\": 0.07690224605888045,\n        \"nauc_precision_at_1000_std\": 0.021871172442492676,\n        \"nauc_precision_at_100_diff1\": 0.0714801115254476,\n        \"nauc_precision_at_100_max\": 0.13315561541052745,\n        \"nauc_precision_at_100_std\": 0.03444855372602813,\n        \"nauc_precision_at_10_diff1\": 0.23573365255125925,\n        \"nauc_precision_at_10_max\": 0.035876362649886924,\n        \"nauc_precision_at_10_std\": -0.29724374204707604,\n        \"nauc_precision_at_1_diff1\": 0.4302105091963213,\n        \"nauc_precision_at_1_max\": 0.04725753243883758,\n        \"nauc_precision_at_1_std\": -0.3773456769429174,\n        \"nauc_precision_at_20_diff1\": 0.1874260473657467,\n        \"nauc_precision_at_20_max\": 0.04232031468123627,\n        \"nauc_precision_at_20_std\": -0.23356189942493982,\n        \"nauc_precision_at_3_diff1\": 0.26903273918480025,\n        \"nauc_precision_at_3_max\": 0.04616211001781429,\n        \"nauc_precision_at_3_std\": -0.3359670496699033,\n        \"nauc_precision_at_5_diff1\": 0.2533080980168239,\n        \"nauc_precision_at_5_max\": 0.0447726069996935,\n        \"nauc_precision_at_5_std\": -0.32679138663754764,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.310564964535451,\n        \"nauc_recall_at_100_max\": 0.30173839624071874,\n        \"nauc_recall_at_100_std\": 0.11377334515723407,\n        \"nauc_recall_at_10_diff1\": 0.37982695676707556,\n        \"nauc_recall_at_10_max\": 0.042492451912603056,\n        \"nauc_recall_at_10_std\": -0.35231447642883357,\n        \"nauc_recall_at_1_diff1\": 0.446152501423059,\n        \"nauc_recall_at_1_max\": 0.02663440208773937,\n        \"nauc_recall_at_1_std\": -0.33965214961688095,\n        \"nauc_recall_at_20_diff1\": 0.35638430589180825,\n        \"nauc_recall_at_20_max\": 0.06328227941791602,\n        \"nauc_recall_at_20_std\": -0.3113052824785763,\n        \"nauc_recall_at_3_diff1\": 0.3712633595908005,\n        \"nauc_recall_at_3_max\": 0.02494288594337995,\n        \"nauc_recall_at_3_std\": -0.35548445928432737,\n        \"nauc_recall_at_5_diff1\": 0.36571414475870745,\n        \"nauc_recall_at_5_max\": 0.029103482587579426,\n        \"nauc_recall_at_5_std\": -0.3588705476558524,\n        \"ndcg_at_1\": 0.30122,\n        \"ndcg_at_10\": 0.37866,\n        \"ndcg_at_100\": 0.45423,\n        \"ndcg_at_1000\": 0.4792,\n        \"ndcg_at_20\": 0.40376,\n        \"ndcg_at_3\": 0.3221,\n        \"ndcg_at_5\": 0.34735,\n        \"precision_at_1\": 0.30122,\n        \"precision_at_10\": 0.07691,\n        \"precision_at_100\": 0.01303,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.0458,\n        \"precision_at_3\": 0.17431,\n        \"precision_at_5\": 0.12508,\n        \"recall_at_1\": 0.21493,\n        \"recall_at_10\": 0.4843,\n        \"recall_at_100\": 0.8169,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.56944,\n        \"recall_at_3\": 0.33876,\n        \"recall_at_5\": 0.40008\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.39995,\n        \"map_at_1\": 0.19177,\n        \"map_at_10\": 0.33984,\n        \"map_at_100\": 0.35699,\n        \"map_at_1000\": 0.35838,\n        \"map_at_20\": 0.34825,\n        \"map_at_3\": 0.28717,\n        \"map_at_5\": 0.3174,\n        \"mrr_at_1\": 0.3318042813455658,\n        \"mrr_at_10\": 0.40260545604582293,\n        \"mrr_at_100\": 0.41334522944107477,\n        \"mrr_at_1000\": 0.4138877971938659,\n        \"mrr_at_20\": 0.4083959893443803,\n        \"mrr_at_3\": 0.374362895005097,\n        \"mrr_at_5\": 0.38934760448521916,\n        \"nauc_map_at_1000_diff1\": 0.41058617945545617,\n        \"nauc_map_at_1000_max\": -0.0013002952537210077,\n        \"nauc_map_at_1000_std\": -0.402768625964047,\n        \"nauc_map_at_100_diff1\": 0.4103859458849651,\n        \"nauc_map_at_100_max\": -0.0024929692398992275,\n        \"nauc_map_at_100_std\": -0.40403076519830755,\n        \"nauc_map_at_10_diff1\": 0.4066546282104827,\n        \"nauc_map_at_10_max\": -0.002486845640082756,\n        \"nauc_map_at_10_std\": -0.4053493086971202,\n        \"nauc_map_at_1_diff1\": 0.46831829280036646,\n        \"nauc_map_at_1_max\": -0.014474441932302181,\n        \"nauc_map_at_1_std\": -0.34551612668189086,\n        \"nauc_map_at_20_diff1\": 0.4101210254500855,\n        \"nauc_map_at_20_max\": -0.0047810042551561975,\n        \"nauc_map_at_20_std\": -0.4079539137908949,\n        \"nauc_map_at_3_diff1\": 0.4391849418232014,\n        \"nauc_map_at_3_max\": 0.012395764653712059,\n        \"nauc_map_at_3_std\": -0.38991991301597145,\n        \"nauc_map_at_5_diff1\": 0.41917501735931717,\n        \"nauc_map_at_5_max\": 0.008385330503281803,\n        \"nauc_map_at_5_std\": -0.3995164775690684,\n        \"nauc_mrr_at_1000_diff1\": 0.40920660076706167,\n        \"nauc_mrr_at_1000_max\": 0.0012385941769198715,\n        \"nauc_mrr_at_1000_std\": -0.3932741446560242,\n        \"nauc_mrr_at_100_diff1\": 0.40904930361090497,\n        \"nauc_mrr_at_100_max\": 0.0010593221401256512,\n        \"nauc_mrr_at_100_std\": -0.39335860583329924,\n        \"nauc_mrr_at_10_diff1\": 0.40766999280728256,\n        \"nauc_mrr_at_10_max\": -8.088705493833043e-05,\n        \"nauc_mrr_at_10_std\": -0.39530918705522655,\n        \"nauc_mrr_at_1_diff1\": 0.4427688268960664,\n        \"nauc_mrr_at_1_max\": 0.01633880940031036,\n        \"nauc_mrr_at_1_std\": -0.38611719450212045,\n        \"nauc_mrr_at_20_diff1\": 0.4090902574437497,\n        \"nauc_mrr_at_20_max\": -0.0009201069513837534,\n        \"nauc_mrr_at_20_std\": -0.39607998114446913,\n        \"nauc_mrr_at_3_diff1\": 0.41695142105898064,\n        \"nauc_mrr_at_3_max\": 0.004057669729456041,\n        \"nauc_mrr_at_3_std\": -0.39551144383536135,\n        \"nauc_mrr_at_5_diff1\": 0.4070267126250566,\n        \"nauc_mrr_at_5_max\": 0.005278939293701363,\n        \"nauc_mrr_at_5_std\": -0.3919125656637338,\n        \"nauc_ndcg_at_1000_diff1\": 0.40215131033707746,\n        \"nauc_ndcg_at_1000_max\": 0.001258704325013927,\n        \"nauc_ndcg_at_1000_std\": -0.3908957262121216,\n        \"nauc_ndcg_at_100_diff1\": 0.39832291711852713,\n        \"nauc_ndcg_at_100_max\": -0.004799637066320755,\n        \"nauc_ndcg_at_100_std\": -0.393164829192417,\n        \"nauc_ndcg_at_10_diff1\": 0.38899882407459435,\n        \"nauc_ndcg_at_10_max\": -0.018537873597670097,\n        \"nauc_ndcg_at_10_std\": -0.4141314712129482,\n        \"nauc_ndcg_at_1_diff1\": 0.4427688268960664,\n        \"nauc_ndcg_at_1_max\": 0.01633880940031036,\n        \"nauc_ndcg_at_1_std\": -0.38611719450212045,\n        \"nauc_ndcg_at_20_diff1\": 0.39736311864081186,\n        \"nauc_ndcg_at_20_max\": -0.026621311940814282,\n        \"nauc_ndcg_at_20_std\": -0.4212133721923276,\n        \"nauc_ndcg_at_3_diff1\": 0.4190616958577465,\n        \"nauc_ndcg_at_3_max\": 0.009013169509649496,\n        \"nauc_ndcg_at_3_std\": -0.3993861491322945,\n        \"nauc_ndcg_at_5_diff1\": 0.4032274550560342,\n        \"nauc_ndcg_at_5_max\": 0.0024637382960664166,\n        \"nauc_ndcg_at_5_std\": -0.40340444594494707,\n        \"nauc_precision_at_1000_diff1\": 0.004259057835218737,\n        \"nauc_precision_at_1000_max\": 0.08826356081485175,\n        \"nauc_precision_at_1000_std\": 0.01338165737445073,\n        \"nauc_precision_at_100_diff1\": 0.06902501449184535,\n        \"nauc_precision_at_100_max\": 0.05582969368179055,\n        \"nauc_precision_at_100_std\": -0.08454217226602033,\n        \"nauc_precision_at_10_diff1\": 0.17246682812480735,\n        \"nauc_precision_at_10_max\": -0.012406289944737326,\n        \"nauc_precision_at_10_std\": -0.3006788219394346,\n        \"nauc_precision_at_1_diff1\": 0.4427688268960664,\n        \"nauc_precision_at_1_max\": 0.01633880940031036,\n        \"nauc_precision_at_1_std\": -0.38611719450212045,\n        \"nauc_precision_at_20_diff1\": 0.163521463625998,\n        \"nauc_precision_at_20_max\": -0.01981955957289997,\n        \"nauc_precision_at_20_std\": -0.27855391812427455,\n        \"nauc_precision_at_3_diff1\": 0.3015896868111652,\n        \"nauc_precision_at_3_max\": 0.038691751764205154,\n        \"nauc_precision_at_3_std\": -0.347123228838273,\n        \"nauc_precision_at_5_diff1\": 0.23111191170926612,\n        \"nauc_precision_at_5_max\": 0.02370344878705259,\n        \"nauc_precision_at_5_std\": -0.32399634526515875,\n        \"nauc_recall_at_1000_diff1\": 0.5647183521144965,\n        \"nauc_recall_at_1000_max\": 0.41208649490966276,\n        \"nauc_recall_at_1000_std\": -0.15695523713683882,\n        \"nauc_recall_at_100_diff1\": 0.3156808945250338,\n        \"nauc_recall_at_100_max\": 0.01423885208773468,\n        \"nauc_recall_at_100_std\": -0.2687000214523801,\n        \"nauc_recall_at_10_diff1\": 0.3193138140628656,\n        \"nauc_recall_at_10_max\": -0.06363018392286901,\n        \"nauc_recall_at_10_std\": -0.4226385831868655,\n        \"nauc_recall_at_1_diff1\": 0.46831829280036646,\n        \"nauc_recall_at_1_max\": -0.014474441932302181,\n        \"nauc_recall_at_1_std\": -0.34551612668189086,\n        \"nauc_recall_at_20_diff1\": 0.3433179839518331,\n        \"nauc_recall_at_20_max\": -0.1038140150525632,\n        \"nauc_recall_at_20_std\": -0.45289277852456233,\n        \"nauc_recall_at_3_diff1\": 0.39994036352425977,\n        \"nauc_recall_at_3_max\": -0.005326393503024048,\n        \"nauc_recall_at_3_std\": -0.3869023976730874,\n        \"nauc_recall_at_5_diff1\": 0.3578112098305799,\n        \"nauc_recall_at_5_max\": -0.006546757260117465,\n        \"nauc_recall_at_5_std\": -0.39532613786244336,\n        \"ndcg_at_1\": 0.3318,\n        \"ndcg_at_10\": 0.39995,\n        \"ndcg_at_100\": 0.47688,\n        \"ndcg_at_1000\": 0.50029,\n        \"ndcg_at_20\": 0.42508,\n        \"ndcg_at_3\": 0.33655,\n        \"ndcg_at_5\": 0.35826,\n        \"precision_at_1\": 0.3318,\n        \"precision_at_10\": 0.10489,\n        \"precision_at_100\": 0.01665,\n        \"precision_at_1000\": 0.00195,\n        \"precision_at_20\": 0.06063,\n        \"precision_at_3\": 0.21764,\n        \"precision_at_5\": 0.16483,\n        \"recall_at_1\": 0.19177,\n        \"recall_at_10\": 0.51012,\n        \"recall_at_100\": 0.83907,\n        \"recall_at_1000\": 0.99503,\n        \"recall_at_20\": 0.59455,\n        \"recall_at_3\": 0.32989,\n        \"recall_at_5\": 0.40344\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.36948,\n        \"map_at_1\": 0.20615,\n        \"map_at_10\": 0.3216,\n        \"map_at_100\": 0.33743,\n        \"map_at_1000\": 0.33861,\n        \"map_at_20\": 0.32978,\n        \"map_at_3\": 0.2846,\n        \"map_at_5\": 0.3068,\n        \"mrr_at_1\": 0.2980456026058632,\n        \"mrr_at_10\": 0.3613728607621115,\n        \"mrr_at_100\": 0.37275227119258564,\n        \"mrr_at_1000\": 0.3734207310023052,\n        \"mrr_at_20\": 0.3672744150330474,\n        \"mrr_at_3\": 0.3390336590662324,\n        \"mrr_at_5\": 0.351900108577633,\n        \"nauc_map_at_1000_diff1\": 0.4373721133535326,\n        \"nauc_map_at_1000_max\": 0.09733685887316677,\n        \"nauc_map_at_1000_std\": -0.309625544370664,\n        \"nauc_map_at_100_diff1\": 0.4370183083119422,\n        \"nauc_map_at_100_max\": 0.0972950650230623,\n        \"nauc_map_at_100_std\": -0.3090029910345518,\n        \"nauc_map_at_10_diff1\": 0.4391928166766258,\n        \"nauc_map_at_10_max\": 0.09307475831631143,\n        \"nauc_map_at_10_std\": -0.3162571191444478,\n        \"nauc_map_at_1_diff1\": 0.5602577371730281,\n        \"nauc_map_at_1_max\": 0.10724644675399574,\n        \"nauc_map_at_1_std\": -0.277598300172147,\n        \"nauc_map_at_20_diff1\": 0.43948424825376897,\n        \"nauc_map_at_20_max\": 0.0930331336171994,\n        \"nauc_map_at_20_std\": -0.31738766465049795,\n        \"nauc_map_at_3_diff1\": 0.46090849293075453,\n        \"nauc_map_at_3_max\": 0.10879690061773899,\n        \"nauc_map_at_3_std\": -0.29945481511490535,\n        \"nauc_map_at_5_diff1\": 0.43825072507014,\n        \"nauc_map_at_5_max\": 0.09575663793164427,\n        \"nauc_map_at_5_std\": -0.3117128053942495,\n        \"nauc_mrr_at_1000_diff1\": 0.46421231294131865,\n        \"nauc_mrr_at_1000_max\": 0.10977960061397075,\n        \"nauc_mrr_at_1000_std\": -0.3030153340987944,\n        \"nauc_mrr_at_100_diff1\": 0.46392796505574907,\n        \"nauc_mrr_at_100_max\": 0.11010970849782215,\n        \"nauc_mrr_at_100_std\": -0.30223842219228625,\n        \"nauc_mrr_at_10_diff1\": 0.46498471958808024,\n        \"nauc_mrr_at_10_max\": 0.106646067543003,\n        \"nauc_mrr_at_10_std\": -0.30795365867667474,\n        \"nauc_mrr_at_1_diff1\": 0.500778242420633,\n        \"nauc_mrr_at_1_max\": 0.13070668371304484,\n        \"nauc_mrr_at_1_std\": -0.30514994152834823,\n        \"nauc_mrr_at_20_diff1\": 0.465026746737862,\n        \"nauc_mrr_at_20_max\": 0.10683571107326713,\n        \"nauc_mrr_at_20_std\": -0.30811545466865076,\n        \"nauc_mrr_at_3_diff1\": 0.4718357358171834,\n        \"nauc_mrr_at_3_max\": 0.11748827081331539,\n        \"nauc_mrr_at_3_std\": -0.30066474511851476,\n        \"nauc_mrr_at_5_diff1\": 0.46458638326622315,\n        \"nauc_mrr_at_5_max\": 0.1046713557604587,\n        \"nauc_mrr_at_5_std\": -0.308084580457927,\n        \"nauc_ndcg_at_1000_diff1\": 0.4283433731130498,\n        \"nauc_ndcg_at_1000_max\": 0.10949293288269658,\n        \"nauc_ndcg_at_1000_std\": -0.28754953984153664,\n        \"nauc_ndcg_at_100_diff1\": 0.41417211580021823,\n        \"nauc_ndcg_at_100_max\": 0.11602320148783662,\n        \"nauc_ndcg_at_100_std\": -0.2606633885264539,\n        \"nauc_ndcg_at_10_diff1\": 0.43018721793998604,\n        \"nauc_ndcg_at_10_max\": 0.08274497479111372,\n        \"nauc_ndcg_at_10_std\": -0.32042032605870274,\n        \"nauc_ndcg_at_1_diff1\": 0.49473135350997494,\n        \"nauc_ndcg_at_1_max\": 0.13578656720000074,\n        \"nauc_ndcg_at_1_std\": -0.29611939726083886,\n        \"nauc_ndcg_at_20_diff1\": 0.43105443007993605,\n        \"nauc_ndcg_at_20_max\": 0.0827979056933635,\n        \"nauc_ndcg_at_20_std\": -0.3232816484442792,\n        \"nauc_ndcg_at_3_diff1\": 0.45036219779939474,\n        \"nauc_ndcg_at_3_max\": 0.10478070893705232,\n        \"nauc_ndcg_at_3_std\": -0.30016964568421,\n        \"nauc_ndcg_at_5_diff1\": 0.4281601682293345,\n        \"nauc_ndcg_at_5_max\": 0.08520122895762401,\n        \"nauc_ndcg_at_5_std\": -0.31392015201203394,\n        \"nauc_precision_at_1000_diff1\": -0.10680404046939247,\n        \"nauc_precision_at_1000_max\": 0.1781045855411332,\n        \"nauc_precision_at_1000_std\": 0.10293066129639211,\n        \"nauc_precision_at_100_diff1\": -0.02641496096230086,\n        \"nauc_precision_at_100_max\": 0.18623465151680246,\n        \"nauc_precision_at_100_std\": 0.08975371905085901,\n        \"nauc_precision_at_10_diff1\": 0.16369753143889806,\n        \"nauc_precision_at_10_max\": 0.047241852955354345,\n        \"nauc_precision_at_10_std\": -0.25690527620071385,\n        \"nauc_precision_at_1_diff1\": 0.49473135350997494,\n        \"nauc_precision_at_1_max\": 0.13578656720000074,\n        \"nauc_precision_at_1_std\": -0.29611939726083886,\n        \"nauc_precision_at_20_diff1\": 0.14351541443712884,\n        \"nauc_precision_at_20_max\": 0.06193074008380701,\n        \"nauc_precision_at_20_std\": -0.21514301134983735,\n        \"nauc_precision_at_3_diff1\": 0.25417523312181733,\n        \"nauc_precision_at_3_max\": 0.11194211250906363,\n        \"nauc_precision_at_3_std\": -0.2606506300756569,\n        \"nauc_precision_at_5_diff1\": 0.1848561701587436,\n        \"nauc_precision_at_5_max\": 0.07073984164943047,\n        \"nauc_precision_at_5_std\": -0.2682731675801018,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.20706354222903484,\n        \"nauc_recall_at_100_max\": 0.21365885661701703,\n        \"nauc_recall_at_100_std\": 0.09035637562095138,\n        \"nauc_recall_at_10_diff1\": 0.3677163354241613,\n        \"nauc_recall_at_10_max\": 0.03575033957027068,\n        \"nauc_recall_at_10_std\": -0.3280144585910673,\n        \"nauc_recall_at_1_diff1\": 0.5602577371730281,\n        \"nauc_recall_at_1_max\": 0.10724644675399574,\n        \"nauc_recall_at_1_std\": -0.277598300172147,\n        \"nauc_recall_at_20_diff1\": 0.3642988806351914,\n        \"nauc_recall_at_20_max\": 0.026840971376837584,\n        \"nauc_recall_at_20_std\": -0.34325729113061004,\n        \"nauc_recall_at_3_diff1\": 0.4275675122137623,\n        \"nauc_recall_at_3_max\": 0.09106384319877968,\n        \"nauc_recall_at_3_std\": -0.28650617926616817,\n        \"nauc_recall_at_5_diff1\": 0.3698909986822292,\n        \"nauc_recall_at_5_max\": 0.03906080211614774,\n        \"nauc_recall_at_5_std\": -0.3178511477594843,\n        \"ndcg_at_1\": 0.29967,\n        \"ndcg_at_10\": 0.36948,\n        \"ndcg_at_100\": 0.44298,\n        \"ndcg_at_1000\": 0.47161,\n        \"ndcg_at_20\": 0.39425,\n        \"ndcg_at_3\": 0.31568,\n        \"ndcg_at_5\": 0.34151,\n        \"precision_at_1\": 0.29967,\n        \"precision_at_10\": 0.07948,\n        \"precision_at_100\": 0.01355,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.04707,\n        \"precision_at_3\": 0.18024,\n        \"precision_at_5\": 0.13192,\n        \"recall_at_1\": 0.20615,\n        \"recall_at_10\": 0.46939,\n        \"recall_at_100\": 0.78699,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.55504,\n        \"recall_at_3\": 0.32724,\n        \"recall_at_5\": 0.39265\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-Qwen2-7B-instruct/Alibaba-NLP__gte-Qwen2-7B-instruct/e26182b2122f4435e8b3ebecbf363990f409b45b/model_meta.json",
    "content": "{\"name\": \"Alibaba-NLP/gte-Qwen2-7B-instruct\", \"revision\": \"e26182b2122f4435e8b3ebecbf363990f409b45b\", \"release_date\": \"2024-06-15\", \"languages\": null, \"n_parameters\": 7613000000, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": 3584, \"license\": \"apache-2.0\", \"open_weights\": true, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"Sentence Transformers\", \"PyTorch\"], \"reference\": \"https://huggingface.co/Alibaba-NLP/gte-Qwen2-7B-instruct\", \"similarity_fn_name\": \"cosine\", \"use_instructions\": true, \"zero_shot_benchmarks\": null, \"loader\": \"instruct_wrapper\"}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-multilingual-base/Alibaba-NLP__gte-multilingual-base/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 9.638917446136475,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.77108,\n        \"map_at_1\": 0.59649,\n        \"map_at_10\": 0.71667,\n        \"map_at_100\": 0.71923,\n        \"map_at_1000\": 0.71923,\n        \"map_at_20\": 0.71793,\n        \"map_at_3\": 0.69298,\n        \"map_at_5\": 0.7057,\n        \"mrr_at_1\": 0.5964912280701754,\n        \"mrr_at_10\": 0.7166666666666666,\n        \"mrr_at_100\": 0.7192301247857292,\n        \"mrr_at_1000\": 0.7192301247857292,\n        \"mrr_at_20\": 0.717925795349618,\n        \"mrr_at_3\": 0.6929824561403509,\n        \"mrr_at_5\": 0.7057017543859649,\n        \"nauc_map_at_1000_diff1\": 0.5936517099361166,\n        \"nauc_map_at_1000_max\": 0.23025820800907956,\n        \"nauc_map_at_1000_std\": -0.44830854310298024,\n        \"nauc_map_at_100_diff1\": 0.5936517099361166,\n        \"nauc_map_at_100_max\": 0.23025820800907956,\n        \"nauc_map_at_100_std\": -0.44830854310298024,\n        \"nauc_map_at_10_diff1\": 0.5893271930047639,\n        \"nauc_map_at_10_max\": 0.2276498001316117,\n        \"nauc_map_at_10_std\": -0.4551546095194692,\n        \"nauc_map_at_1_diff1\": 0.6110833815898389,\n        \"nauc_map_at_1_max\": 0.1908294474342627,\n        \"nauc_map_at_1_std\": -0.35314996932177417,\n        \"nauc_map_at_20_diff1\": 0.59448055498058,\n        \"nauc_map_at_20_max\": 0.2329357588721152,\n        \"nauc_map_at_20_std\": -0.45255932263784404,\n        \"nauc_map_at_3_diff1\": 0.5938383228262359,\n        \"nauc_map_at_3_max\": 0.23164372605869038,\n        \"nauc_map_at_3_std\": -0.43564852034913903,\n        \"nauc_map_at_5_diff1\": 0.5900023435482211,\n        \"nauc_map_at_5_max\": 0.23294445889550133,\n        \"nauc_map_at_5_std\": -0.45567242172858874,\n        \"nauc_mrr_at_1000_diff1\": 0.5936517099361166,\n        \"nauc_mrr_at_1000_max\": 0.23025820800907956,\n        \"nauc_mrr_at_1000_std\": -0.44830854310298024,\n        \"nauc_mrr_at_100_diff1\": 0.5936517099361166,\n        \"nauc_mrr_at_100_max\": 0.23025820800907956,\n        \"nauc_mrr_at_100_std\": -0.44830854310298024,\n        \"nauc_mrr_at_10_diff1\": 0.5893271930047639,\n        \"nauc_mrr_at_10_max\": 0.2276498001316117,\n        \"nauc_mrr_at_10_std\": -0.4551546095194692,\n        \"nauc_mrr_at_1_diff1\": 0.6110833815898389,\n        \"nauc_mrr_at_1_max\": 0.1908294474342627,\n        \"nauc_mrr_at_1_std\": -0.35314996932177417,\n        \"nauc_mrr_at_20_diff1\": 0.59448055498058,\n        \"nauc_mrr_at_20_max\": 0.2329357588721152,\n        \"nauc_mrr_at_20_std\": -0.45255932263784404,\n        \"nauc_mrr_at_3_diff1\": 0.5938383228262359,\n        \"nauc_mrr_at_3_max\": 0.23164372605869038,\n        \"nauc_mrr_at_3_std\": -0.43564852034913903,\n        \"nauc_mrr_at_5_diff1\": 0.5900023435482211,\n        \"nauc_mrr_at_5_max\": 0.23294445889550133,\n        \"nauc_mrr_at_5_std\": -0.45567242172858874,\n        \"nauc_ndcg_at_1000_diff1\": 0.5925722016847822,\n        \"nauc_ndcg_at_1000_max\": 0.2381630983055214,\n        \"nauc_ndcg_at_1000_std\": -0.467474281511242,\n        \"nauc_ndcg_at_100_diff1\": 0.5925722016847822,\n        \"nauc_ndcg_at_100_max\": 0.2381630983055214,\n        \"nauc_ndcg_at_100_std\": -0.467474281511242,\n        \"nauc_ndcg_at_10_diff1\": 0.5800090322494245,\n        \"nauc_ndcg_at_10_max\": 0.24203689898525843,\n        \"nauc_ndcg_at_10_std\": -0.5118177090163054,\n        \"nauc_ndcg_at_1_diff1\": 0.6110833815898389,\n        \"nauc_ndcg_at_1_max\": 0.1908294474342627,\n        \"nauc_ndcg_at_1_std\": -0.35314996932177417,\n        \"nauc_ndcg_at_20_diff1\": 0.598047860353563,\n        \"nauc_ndcg_at_20_max\": 0.25996203653945654,\n        \"nauc_ndcg_at_20_std\": -0.5029431420978402,\n        \"nauc_ndcg_at_3_diff1\": 0.5896443334804378,\n        \"nauc_ndcg_at_3_max\": 0.2439244231908955,\n        \"nauc_ndcg_at_3_std\": -0.4669491517657949,\n        \"nauc_ndcg_at_5_diff1\": 0.5816884009461497,\n        \"nauc_ndcg_at_5_max\": 0.2509765225930184,\n        \"nauc_ndcg_at_5_std\": -0.5086643597687968,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.47965320075378115,\n        \"nauc_precision_at_10_max\": 0.40503318457167936,\n        \"nauc_precision_at_10_std\": -1.143569297810643,\n        \"nauc_precision_at_1_diff1\": 0.6110833815898389,\n        \"nauc_precision_at_1_max\": 0.1908294474342627,\n        \"nauc_precision_at_1_std\": -0.35314996932177417,\n        \"nauc_precision_at_20_diff1\": 0.7008965455883202,\n        \"nauc_precision_at_20_max\": 0.7183536566232184,\n        \"nauc_precision_at_20_std\": -1.2588569287895695,\n        \"nauc_precision_at_3_diff1\": 0.5731811728893021,\n        \"nauc_precision_at_3_max\": 0.2938957496013745,\n        \"nauc_precision_at_3_std\": -0.5982375555469349,\n        \"nauc_precision_at_5_diff1\": 0.5358095787755137,\n        \"nauc_precision_at_5_max\": 0.35334774502959576,\n        \"nauc_precision_at_5_std\": -0.8077434531545805,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.4796532007537782,\n        \"nauc_recall_at_10_max\": 0.40503318457167875,\n        \"nauc_recall_at_10_std\": -1.1435692978106466,\n        \"nauc_recall_at_1_diff1\": 0.6110833815898389,\n        \"nauc_recall_at_1_max\": 0.1908294474342627,\n        \"nauc_recall_at_1_std\": -0.35314996932177417,\n        \"nauc_recall_at_20_diff1\": 0.700896545588321,\n        \"nauc_recall_at_20_max\": 0.7183536566232177,\n        \"nauc_recall_at_20_std\": -1.2588569287895657,\n        \"nauc_recall_at_3_diff1\": 0.5731811728893031,\n        \"nauc_recall_at_3_max\": 0.2938957496013749,\n        \"nauc_recall_at_3_std\": -0.5982375555469336,\n        \"nauc_recall_at_5_diff1\": 0.5358095787755134,\n        \"nauc_recall_at_5_max\": 0.3533477450295955,\n        \"nauc_recall_at_5_std\": -0.8077434531545817,\n        \"ndcg_at_1\": 0.59649,\n        \"ndcg_at_10\": 0.77108,\n        \"ndcg_at_100\": 0.78411,\n        \"ndcg_at_1000\": 0.78411,\n        \"ndcg_at_20\": 0.77556,\n        \"ndcg_at_3\": 0.72452,\n        \"ndcg_at_5\": 0.7468,\n        \"precision_at_1\": 0.59649,\n        \"precision_at_10\": 0.09386,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04781,\n        \"precision_at_3\": 0.27193,\n        \"precision_at_5\": 0.17368,\n        \"recall_at_1\": 0.59649,\n        \"recall_at_10\": 0.9386,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.95614,\n        \"recall_at_3\": 0.81579,\n        \"recall_at_5\": 0.86842\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-multilingual-base/Alibaba-NLP__gte-multilingual-base/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 9.514682531356812,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.8796,\n        \"map_at_1\": 0.80333,\n        \"map_at_10\": 0.85849,\n        \"map_at_100\": 0.86055,\n        \"map_at_1000\": 0.86059,\n        \"map_at_20\": 0.85972,\n        \"map_at_3\": 0.85074,\n        \"map_at_5\": 0.85674,\n        \"mrr_at_1\": 0.8033333333333333,\n        \"mrr_at_10\": 0.8584872134038802,\n        \"mrr_at_100\": 0.8605501771786044,\n        \"mrr_at_1000\": 0.860594347604656,\n        \"mrr_at_20\": 0.859719015958051,\n        \"mrr_at_3\": 0.8507407407407409,\n        \"mrr_at_5\": 0.8567407407407408,\n        \"nauc_map_at_1000_diff1\": 0.8651361278493194,\n        \"nauc_map_at_1000_max\": 0.7418586175399554,\n        \"nauc_map_at_1000_std\": 0.013734735612603912,\n        \"nauc_map_at_100_diff1\": 0.8651555699121707,\n        \"nauc_map_at_100_max\": 0.7419304322492464,\n        \"nauc_map_at_100_std\": 0.013970732162235726,\n        \"nauc_map_at_10_diff1\": 0.8642127452490442,\n        \"nauc_map_at_10_max\": 0.7423022391957348,\n        \"nauc_map_at_10_std\": 0.013077755502568747,\n        \"nauc_map_at_1_diff1\": 0.8783845490368515,\n        \"nauc_map_at_1_max\": 0.7144604734281541,\n        \"nauc_map_at_1_std\": -0.03075479037358894,\n        \"nauc_map_at_20_diff1\": 0.8653809000316373,\n        \"nauc_map_at_20_max\": 0.7427858268462051,\n        \"nauc_map_at_20_std\": 0.015015758160884355,\n        \"nauc_map_at_3_diff1\": 0.8595602194780724,\n        \"nauc_map_at_3_max\": 0.7380410878857894,\n        \"nauc_map_at_3_std\": 0.0037690970412170128,\n        \"nauc_map_at_5_diff1\": 0.8639913582671778,\n        \"nauc_map_at_5_max\": 0.7441652104318379,\n        \"nauc_map_at_5_std\": 0.019813631471681307,\n        \"nauc_mrr_at_1000_diff1\": 0.8651361278493194,\n        \"nauc_mrr_at_1000_max\": 0.7418586175399554,\n        \"nauc_mrr_at_1000_std\": 0.013734735612603912,\n        \"nauc_mrr_at_100_diff1\": 0.8651555699121707,\n        \"nauc_mrr_at_100_max\": 0.7419304322492464,\n        \"nauc_mrr_at_100_std\": 0.013970732162235726,\n        \"nauc_mrr_at_10_diff1\": 0.8642127452490442,\n        \"nauc_mrr_at_10_max\": 0.7423022391957348,\n        \"nauc_mrr_at_10_std\": 0.013077755502568747,\n        \"nauc_mrr_at_1_diff1\": 0.8783845490368515,\n        \"nauc_mrr_at_1_max\": 0.7144604734281541,\n        \"nauc_mrr_at_1_std\": -0.03075479037358894,\n        \"nauc_mrr_at_20_diff1\": 0.8653809000316373,\n        \"nauc_mrr_at_20_max\": 0.7427858268462051,\n        \"nauc_mrr_at_20_std\": 0.015015758160884355,\n        \"nauc_mrr_at_3_diff1\": 0.8595602194780724,\n        \"nauc_mrr_at_3_max\": 0.7380410878857894,\n        \"nauc_mrr_at_3_std\": 0.0037690970412170128,\n        \"nauc_mrr_at_5_diff1\": 0.8639913582671778,\n        \"nauc_mrr_at_5_max\": 0.7441652104318379,\n        \"nauc_mrr_at_5_std\": 0.019813631471681307,\n        \"nauc_ndcg_at_1000_diff1\": 0.8640736382725115,\n        \"nauc_ndcg_at_1000_max\": 0.7476194763678936,\n        \"nauc_ndcg_at_1000_std\": 0.023164955045697332,\n        \"nauc_ndcg_at_100_diff1\": 0.8646708926516866,\n        \"nauc_ndcg_at_100_max\": 0.7497271398718169,\n        \"nauc_ndcg_at_100_std\": 0.030462267429729645,\n        \"nauc_ndcg_at_10_diff1\": 0.8601464938487059,\n        \"nauc_ndcg_at_10_max\": 0.7537308843825129,\n        \"nauc_ndcg_at_10_std\": 0.02743877031929201,\n        \"nauc_ndcg_at_1_diff1\": 0.8783845490368515,\n        \"nauc_ndcg_at_1_max\": 0.7144604734281541,\n        \"nauc_ndcg_at_1_std\": -0.03075479037358894,\n        \"nauc_ndcg_at_20_diff1\": 0.8660678949081592,\n        \"nauc_ndcg_at_20_max\": 0.756589310017133,\n        \"nauc_ndcg_at_20_std\": 0.03472573440205783,\n        \"nauc_ndcg_at_3_diff1\": 0.8518734277875382,\n        \"nauc_ndcg_at_3_max\": 0.7460751997142202,\n        \"nauc_ndcg_at_3_std\": 0.01431613860324495,\n        \"nauc_ndcg_at_5_diff1\": 0.8600816216068748,\n        \"nauc_ndcg_at_5_max\": 0.7588431787096619,\n        \"nauc_ndcg_at_5_std\": 0.04660310694125582,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9253034547152017,\n        \"nauc_precision_at_100_max\": 0.962651727357627,\n        \"nauc_precision_at_100_std\": 0.7736427904495127,\n        \"nauc_precision_at_10_diff1\": 0.834376888010103,\n        \"nauc_precision_at_10_max\": 0.8285091814503543,\n        \"nauc_precision_at_10_std\": 0.1116237344611039,\n        \"nauc_precision_at_1_diff1\": 0.8783845490368515,\n        \"nauc_precision_at_1_max\": 0.7144604734281541,\n        \"nauc_precision_at_1_std\": -0.03075479037358894,\n        \"nauc_precision_at_20_diff1\": 0.8951580632252828,\n        \"nauc_precision_at_20_max\": 0.8967587034813862,\n        \"nauc_precision_at_20_std\": 0.22232893157262623,\n        \"nauc_precision_at_3_diff1\": 0.8191105899724272,\n        \"nauc_precision_at_3_max\": 0.7795691920178943,\n        \"nauc_precision_at_3_std\": 0.05760211061168791,\n        \"nauc_precision_at_5_diff1\": 0.8404324692840104,\n        \"nauc_precision_at_5_max\": 0.8426852222370399,\n        \"nauc_precision_at_5_std\": 0.20104338031508923,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9253034547152172,\n        \"nauc_recall_at_100_max\": 0.962651727357617,\n        \"nauc_recall_at_100_std\": 0.7736427904495109,\n        \"nauc_recall_at_10_diff1\": 0.8343768880101047,\n        \"nauc_recall_at_10_max\": 0.8285091814503583,\n        \"nauc_recall_at_10_std\": 0.1116237344611009,\n        \"nauc_recall_at_1_diff1\": 0.8783845490368515,\n        \"nauc_recall_at_1_max\": 0.7144604734281541,\n        \"nauc_recall_at_1_std\": -0.03075479037358894,\n        \"nauc_recall_at_20_diff1\": 0.8951580632252891,\n        \"nauc_recall_at_20_max\": 0.8967587034813924,\n        \"nauc_recall_at_20_std\": 0.22232893157262798,\n        \"nauc_recall_at_3_diff1\": 0.8191105899724227,\n        \"nauc_recall_at_3_max\": 0.7795691920178919,\n        \"nauc_recall_at_3_std\": 0.057602110611686456,\n        \"nauc_recall_at_5_diff1\": 0.8404324692840107,\n        \"nauc_recall_at_5_max\": 0.8426852222370445,\n        \"nauc_recall_at_5_std\": 0.2010433803150886,\n        \"ndcg_at_1\": 0.80333,\n        \"ndcg_at_10\": 0.8796,\n        \"ndcg_at_100\": 0.88994,\n        \"ndcg_at_1000\": 0.89097,\n        \"ndcg_at_20\": 0.88409,\n        \"ndcg_at_3\": 0.86465,\n        \"ndcg_at_5\": 0.87532,\n        \"precision_at_1\": 0.80333,\n        \"precision_at_10\": 0.09433,\n        \"precision_at_100\": 0.00992,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04806,\n        \"precision_at_3\": 0.30148,\n        \"precision_at_5\": 0.186,\n        \"recall_at_1\": 0.80333,\n        \"recall_at_10\": 0.94333,\n        \"recall_at_100\": 0.99222,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96111,\n        \"recall_at_3\": 0.90444,\n        \"recall_at_5\": 0.93\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.88062,\n        \"map_at_1\": 0.79778,\n        \"map_at_10\": 0.85643,\n        \"map_at_100\": 0.85821,\n        \"map_at_1000\": 0.85825,\n        \"map_at_20\": 0.85771,\n        \"map_at_3\": 0.84815,\n        \"map_at_5\": 0.85343,\n        \"mrr_at_1\": 0.7977777777777778,\n        \"mrr_at_10\": 0.856428130511464,\n        \"mrr_at_100\": 0.8582147049962549,\n        \"mrr_at_1000\": 0.8582509822841501,\n        \"mrr_at_20\": 0.8577066769468734,\n        \"mrr_at_3\": 0.8481481481481484,\n        \"mrr_at_5\": 0.8534259259259264,\n        \"nauc_map_at_1000_diff1\": 0.829546134330904,\n        \"nauc_map_at_1000_max\": 0.6325855821857873,\n        \"nauc_map_at_1000_std\": -0.08592721118228824,\n        \"nauc_map_at_100_diff1\": 0.8295521080594748,\n        \"nauc_map_at_100_max\": 0.6326847487835539,\n        \"nauc_map_at_100_std\": -0.0856605907756247,\n        \"nauc_map_at_10_diff1\": 0.8288997350230023,\n        \"nauc_map_at_10_max\": 0.6333210130677666,\n        \"nauc_map_at_10_std\": -0.08382181759549567,\n        \"nauc_map_at_1_diff1\": 0.8469104756035148,\n        \"nauc_map_at_1_max\": 0.6136072240228472,\n        \"nauc_map_at_1_std\": -0.10831081787516371,\n        \"nauc_map_at_20_diff1\": 0.8291637416330593,\n        \"nauc_map_at_20_max\": 0.6330502230134387,\n        \"nauc_map_at_20_std\": -0.08618019653766029,\n        \"nauc_map_at_3_diff1\": 0.827284260162407,\n        \"nauc_map_at_3_max\": 0.6325155136406339,\n        \"nauc_map_at_3_std\": -0.08899414161844547,\n        \"nauc_map_at_5_diff1\": 0.8268611228256288,\n        \"nauc_map_at_5_max\": 0.6324112783164382,\n        \"nauc_map_at_5_std\": -0.08103465516566621,\n        \"nauc_mrr_at_1000_diff1\": 0.829546134330904,\n        \"nauc_mrr_at_1000_max\": 0.6325855821857873,\n        \"nauc_mrr_at_1000_std\": -0.08592721118228824,\n        \"nauc_mrr_at_100_diff1\": 0.8295521080594748,\n        \"nauc_mrr_at_100_max\": 0.6326847487835539,\n        \"nauc_mrr_at_100_std\": -0.0856605907756247,\n        \"nauc_mrr_at_10_diff1\": 0.8288997350230023,\n        \"nauc_mrr_at_10_max\": 0.6333210130677666,\n        \"nauc_mrr_at_10_std\": -0.08382181759549567,\n        \"nauc_mrr_at_1_diff1\": 0.8469104756035148,\n        \"nauc_mrr_at_1_max\": 0.6136072240228472,\n        \"nauc_mrr_at_1_std\": -0.10831081787516371,\n        \"nauc_mrr_at_20_diff1\": 0.8291637416330593,\n        \"nauc_mrr_at_20_max\": 0.6330502230134387,\n        \"nauc_mrr_at_20_std\": -0.08618019653766029,\n        \"nauc_mrr_at_3_diff1\": 0.827284260162407,\n        \"nauc_mrr_at_3_max\": 0.6325155136406339,\n        \"nauc_mrr_at_3_std\": -0.08899414161844547,\n        \"nauc_mrr_at_5_diff1\": 0.8268611228256288,\n        \"nauc_mrr_at_5_max\": 0.6324112783164382,\n        \"nauc_mrr_at_5_std\": -0.08103465516566621,\n        \"nauc_ndcg_at_1000_diff1\": 0.827275101042018,\n        \"nauc_ndcg_at_1000_max\": 0.6368223960440613,\n        \"nauc_ndcg_at_1000_std\": -0.0795689943247917,\n        \"nauc_ndcg_at_100_diff1\": 0.8275142613783739,\n        \"nauc_ndcg_at_100_max\": 0.6394490798501035,\n        \"nauc_ndcg_at_100_std\": -0.07252899389683454,\n        \"nauc_ndcg_at_10_diff1\": 0.8236698658167095,\n        \"nauc_ndcg_at_10_max\": 0.643210997098357,\n        \"nauc_ndcg_at_10_std\": -0.0682725779951663,\n        \"nauc_ndcg_at_1_diff1\": 0.8469104756035148,\n        \"nauc_ndcg_at_1_max\": 0.6136072240228472,\n        \"nauc_ndcg_at_1_std\": -0.10831081787516371,\n        \"nauc_ndcg_at_20_diff1\": 0.8243330368189321,\n        \"nauc_ndcg_at_20_max\": 0.6425555639374455,\n        \"nauc_ndcg_at_20_std\": -0.07771461296268094,\n        \"nauc_ndcg_at_3_diff1\": 0.8196030620594603,\n        \"nauc_ndcg_at_3_max\": 0.6396350400369007,\n        \"nauc_ndcg_at_3_std\": -0.07909721619527248,\n        \"nauc_ndcg_at_5_diff1\": 0.8181558557674538,\n        \"nauc_ndcg_at_5_max\": 0.6395382719190128,\n        \"nauc_ndcg_at_5_std\": -0.06251199626346327,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8627450980391947,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.8921568627450869,\n        \"nauc_precision_at_10_diff1\": 0.7854751656760247,\n        \"nauc_precision_at_10_max\": 0.7316731570677019,\n        \"nauc_precision_at_10_std\": 0.0690601443829509,\n        \"nauc_precision_at_1_diff1\": 0.8469104756035148,\n        \"nauc_precision_at_1_max\": 0.6136072240228472,\n        \"nauc_precision_at_1_std\": -0.10831081787516371,\n        \"nauc_precision_at_20_diff1\": 0.7666705571117243,\n        \"nauc_precision_at_20_max\": 0.784702769996881,\n        \"nauc_precision_at_20_std\": 0.017098506069089116,\n        \"nauc_precision_at_3_diff1\": 0.7846249610955512,\n        \"nauc_precision_at_3_max\": 0.6719057993567797,\n        \"nauc_precision_at_3_std\": -0.032783483763876776,\n        \"nauc_precision_at_5_diff1\": 0.7670095360548549,\n        \"nauc_precision_at_5_max\": 0.6802589888414331,\n        \"nauc_precision_at_5_std\": 0.0515911282545789,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8627450980392323,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.892156862745096,\n        \"nauc_recall_at_10_diff1\": 0.7854751656760276,\n        \"nauc_recall_at_10_max\": 0.7316731570677064,\n        \"nauc_recall_at_10_std\": 0.0690601443829571,\n        \"nauc_recall_at_1_diff1\": 0.8469104756035148,\n        \"nauc_recall_at_1_max\": 0.6136072240228472,\n        \"nauc_recall_at_1_std\": -0.10831081787516371,\n        \"nauc_recall_at_20_diff1\": 0.7666705571117347,\n        \"nauc_recall_at_20_max\": 0.7847027699968866,\n        \"nauc_recall_at_20_std\": 0.017098506069086708,\n        \"nauc_recall_at_3_diff1\": 0.7846249610955486,\n        \"nauc_recall_at_3_max\": 0.6719057993567795,\n        \"nauc_recall_at_3_std\": -0.03278348376387673,\n        \"nauc_recall_at_5_diff1\": 0.7670095360548592,\n        \"nauc_recall_at_5_max\": 0.6802589888414381,\n        \"nauc_recall_at_5_std\": 0.05159112825458121,\n        \"ndcg_at_1\": 0.79778,\n        \"ndcg_at_10\": 0.88062,\n        \"ndcg_at_100\": 0.88921,\n        \"ndcg_at_1000\": 0.88998,\n        \"ndcg_at_20\": 0.88536,\n        \"ndcg_at_3\": 0.86407,\n        \"ndcg_at_5\": 0.8734,\n        \"precision_at_1\": 0.79778,\n        \"precision_at_10\": 0.09544,\n        \"precision_at_100\": 0.00994,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04867,\n        \"precision_at_3\": 0.30333,\n        \"precision_at_5\": 0.18644,\n        \"recall_at_1\": 0.79778,\n        \"recall_at_10\": 0.95444,\n        \"recall_at_100\": 0.99444,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.97333,\n        \"recall_at_3\": 0.91,\n        \"recall_at_5\": 0.93222\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.85657,\n        \"map_at_1\": 0.75889,\n        \"map_at_10\": 0.82638,\n        \"map_at_100\": 0.82792,\n        \"map_at_1000\": 0.82798,\n        \"map_at_20\": 0.82724,\n        \"map_at_3\": 0.81167,\n        \"map_at_5\": 0.82194,\n        \"mrr_at_1\": 0.7588888888888888,\n        \"mrr_at_10\": 0.8263791887125224,\n        \"mrr_at_100\": 0.8279172664600791,\n        \"mrr_at_1000\": 0.8279781231588634,\n        \"mrr_at_20\": 0.8272371670392827,\n        \"mrr_at_3\": 0.8116666666666666,\n        \"mrr_at_5\": 0.8219444444444447,\n        \"nauc_map_at_1000_diff1\": 0.8080662924334656,\n        \"nauc_map_at_1000_max\": 0.7137610309322288,\n        \"nauc_map_at_1000_std\": 0.03889981948933412,\n        \"nauc_map_at_100_diff1\": 0.8080206640656972,\n        \"nauc_map_at_100_max\": 0.713844142428308,\n        \"nauc_map_at_100_std\": 0.03925475947340508,\n        \"nauc_map_at_10_diff1\": 0.8085438358710668,\n        \"nauc_map_at_10_max\": 0.7147965670336995,\n        \"nauc_map_at_10_std\": 0.041601046039760524,\n        \"nauc_map_at_1_diff1\": 0.8148941927542931,\n        \"nauc_map_at_1_max\": 0.6885576833277857,\n        \"nauc_map_at_1_std\": -0.005981815090553283,\n        \"nauc_map_at_20_diff1\": 0.8079968971636359,\n        \"nauc_map_at_20_max\": 0.7144601462940647,\n        \"nauc_map_at_20_std\": 0.04099096241352047,\n        \"nauc_map_at_3_diff1\": 0.8077983411024191,\n        \"nauc_map_at_3_max\": 0.717892878661459,\n        \"nauc_map_at_3_std\": 0.03975692189966652,\n        \"nauc_map_at_5_diff1\": 0.8063046003130837,\n        \"nauc_map_at_5_max\": 0.7106092932047338,\n        \"nauc_map_at_5_std\": 0.03282925356427449,\n        \"nauc_mrr_at_1000_diff1\": 0.8080662924334656,\n        \"nauc_mrr_at_1000_max\": 0.7137610309322288,\n        \"nauc_mrr_at_1000_std\": 0.03889981948933412,\n        \"nauc_mrr_at_100_diff1\": 0.8080206640656972,\n        \"nauc_mrr_at_100_max\": 0.713844142428308,\n        \"nauc_mrr_at_100_std\": 0.03925475947340508,\n        \"nauc_mrr_at_10_diff1\": 0.8085438358710668,\n        \"nauc_mrr_at_10_max\": 0.7147965670336995,\n        \"nauc_mrr_at_10_std\": 0.041601046039760524,\n        \"nauc_mrr_at_1_diff1\": 0.8148941927542931,\n        \"nauc_mrr_at_1_max\": 0.6885576833277857,\n        \"nauc_mrr_at_1_std\": -0.005981815090553283,\n        \"nauc_mrr_at_20_diff1\": 0.8079968971636359,\n        \"nauc_mrr_at_20_max\": 0.7144601462940647,\n        \"nauc_mrr_at_20_std\": 0.04099096241352047,\n        \"nauc_mrr_at_3_diff1\": 0.8077983411024191,\n        \"nauc_mrr_at_3_max\": 0.717892878661459,\n        \"nauc_mrr_at_3_std\": 0.03975692189966652,\n        \"nauc_mrr_at_5_diff1\": 0.8063046003130837,\n        \"nauc_mrr_at_5_max\": 0.7106092932047338,\n        \"nauc_mrr_at_5_std\": 0.03282925356427449,\n        \"nauc_ndcg_at_1000_diff1\": 0.8071936485236224,\n        \"nauc_ndcg_at_1000_max\": 0.7194181195131821,\n        \"nauc_ndcg_at_1000_std\": 0.05342224213986593,\n        \"nauc_ndcg_at_100_diff1\": 0.8061779133250535,\n        \"nauc_ndcg_at_100_max\": 0.7219947254747765,\n        \"nauc_ndcg_at_100_std\": 0.06398427568254675,\n        \"nauc_ndcg_at_10_diff1\": 0.8084808695754142,\n        \"nauc_ndcg_at_10_max\": 0.7284930166428097,\n        \"nauc_ndcg_at_10_std\": 0.07720960494895679,\n        \"nauc_ndcg_at_1_diff1\": 0.8148941927542931,\n        \"nauc_ndcg_at_1_max\": 0.6885576833277857,\n        \"nauc_ndcg_at_1_std\": -0.005981815090553283,\n        \"nauc_ndcg_at_20_diff1\": 0.8062310856840769,\n        \"nauc_ndcg_at_20_max\": 0.7277722658852183,\n        \"nauc_ndcg_at_20_std\": 0.07684336868935904,\n        \"nauc_ndcg_at_3_diff1\": 0.8059262738497057,\n        \"nauc_ndcg_at_3_max\": 0.7294359748625586,\n        \"nauc_ndcg_at_3_std\": 0.06181714689020046,\n        \"nauc_ndcg_at_5_diff1\": 0.8028769320851481,\n        \"nauc_ndcg_at_5_max\": 0.7164772902430775,\n        \"nauc_ndcg_at_5_std\": 0.05087262789435781,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.7288048552754708,\n        \"nauc_precision_at_100_max\": 0.9423436041083034,\n        \"nauc_precision_at_100_std\": 0.9554154995331525,\n        \"nauc_precision_at_10_diff1\": 0.813175640626619,\n        \"nauc_precision_at_10_max\": 0.8620915032679718,\n        \"nauc_precision_at_10_std\": 0.4347235190372405,\n        \"nauc_precision_at_1_diff1\": 0.8148941927542931,\n        \"nauc_precision_at_1_max\": 0.6885576833277857,\n        \"nauc_precision_at_1_std\": -0.005981815090553283,\n        \"nauc_precision_at_20_diff1\": 0.7854122040973202,\n        \"nauc_precision_at_20_max\": 0.8985280386664453,\n        \"nauc_precision_at_20_std\": 0.5554457076948398,\n        \"nauc_precision_at_3_diff1\": 0.7987855205754054,\n        \"nauc_precision_at_3_max\": 0.7759908703488474,\n        \"nauc_precision_at_3_std\": 0.15259740259740234,\n        \"nauc_precision_at_5_diff1\": 0.7832790773967219,\n        \"nauc_precision_at_5_max\": 0.7469086733792593,\n        \"nauc_precision_at_5_std\": 0.15426350720468127,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.7288048552754446,\n        \"nauc_recall_at_100_max\": 0.9423436041083036,\n        \"nauc_recall_at_100_std\": 0.9554154995331435,\n        \"nauc_recall_at_10_diff1\": 0.8131756406266185,\n        \"nauc_recall_at_10_max\": 0.8620915032679746,\n        \"nauc_recall_at_10_std\": 0.4347235190372419,\n        \"nauc_recall_at_1_diff1\": 0.8148941927542931,\n        \"nauc_recall_at_1_max\": 0.6885576833277857,\n        \"nauc_recall_at_1_std\": -0.005981815090553283,\n        \"nauc_recall_at_20_diff1\": 0.7854122040973217,\n        \"nauc_recall_at_20_max\": 0.8985280386664473,\n        \"nauc_recall_at_20_std\": 0.5554457076948423,\n        \"nauc_recall_at_3_diff1\": 0.7987855205754045,\n        \"nauc_recall_at_3_max\": 0.7759908703488476,\n        \"nauc_recall_at_3_std\": 0.15259740259740326,\n        \"nauc_recall_at_5_diff1\": 0.7832790773967254,\n        \"nauc_recall_at_5_max\": 0.7469086733792616,\n        \"nauc_recall_at_5_std\": 0.15426350720468285,\n        \"ndcg_at_1\": 0.75889,\n        \"ndcg_at_10\": 0.85657,\n        \"ndcg_at_100\": 0.86461,\n        \"ndcg_at_1000\": 0.86607,\n        \"ndcg_at_20\": 0.85967,\n        \"ndcg_at_3\": 0.8276,\n        \"ndcg_at_5\": 0.84601,\n        \"precision_at_1\": 0.75889,\n        \"precision_at_10\": 0.095,\n        \"precision_at_100\": 0.00989,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04811,\n        \"precision_at_3\": 0.29111,\n        \"precision_at_5\": 0.18356,\n        \"recall_at_1\": 0.75889,\n        \"recall_at_10\": 0.95,\n        \"recall_at_100\": 0.98889,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96222,\n        \"recall_at_3\": 0.87333,\n        \"recall_at_5\": 0.91778\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-multilingual-base/Alibaba-NLP__gte-multilingual-base/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 47.95084285736084,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.75121,\n        \"map_at_1\": 0.45135,\n        \"map_at_10\": 0.69709,\n        \"map_at_100\": 0.70379,\n        \"map_at_1000\": 0.7042,\n        \"map_at_20\": 0.70167,\n        \"map_at_3\": 0.65496,\n        \"map_at_5\": 0.68422,\n        \"mrr_at_1\": 0.7010135135135135,\n        \"mrr_at_10\": 0.7737069658944656,\n        \"mrr_at_100\": 0.7755940101379746,\n        \"mrr_at_1000\": 0.775762024387044,\n        \"mrr_at_20\": 0.7747121401629913,\n        \"mrr_at_3\": 0.764921171171171,\n        \"mrr_at_5\": 0.7705799549549547,\n        \"nauc_map_at_1000_diff1\": 0.5519197145137611,\n        \"nauc_map_at_1000_max\": 0.6067402935995151,\n        \"nauc_map_at_1000_std\": 0.1594828873545819,\n        \"nauc_map_at_100_diff1\": 0.552117983876564,\n        \"nauc_map_at_100_max\": 0.6071358257277069,\n        \"nauc_map_at_100_std\": 0.15992886906044776,\n        \"nauc_map_at_10_diff1\": 0.5482356659883542,\n        \"nauc_map_at_10_max\": 0.6036640161616742,\n        \"nauc_map_at_10_std\": 0.14948304159183426,\n        \"nauc_map_at_1_diff1\": 0.5834434025577803,\n        \"nauc_map_at_1_max\": 0.299451623991129,\n        \"nauc_map_at_1_std\": -0.022953282119810403,\n        \"nauc_map_at_20_diff1\": 0.551019680772447,\n        \"nauc_map_at_20_max\": 0.6074107021103508,\n        \"nauc_map_at_20_std\": 0.15853657489864967,\n        \"nauc_map_at_3_diff1\": 0.5248726081949865,\n        \"nauc_map_at_3_max\": 0.5594477813787555,\n        \"nauc_map_at_3_std\": 0.08416007387108534,\n        \"nauc_map_at_5_diff1\": 0.5373092416579366,\n        \"nauc_map_at_5_max\": 0.5899555474257632,\n        \"nauc_map_at_5_std\": 0.12732982461525347,\n        \"nauc_mrr_at_1000_diff1\": 0.6630500026079771,\n        \"nauc_mrr_at_1000_max\": 0.6736685608978698,\n        \"nauc_mrr_at_1000_std\": 0.2320878485491545,\n        \"nauc_mrr_at_100_diff1\": 0.663057226112171,\n        \"nauc_mrr_at_100_max\": 0.6738925445530085,\n        \"nauc_mrr_at_100_std\": 0.2325917862628659,\n        \"nauc_mrr_at_10_diff1\": 0.6636967780082375,\n        \"nauc_mrr_at_10_max\": 0.6762588126119293,\n        \"nauc_mrr_at_10_std\": 0.23291273028624304,\n        \"nauc_mrr_at_1_diff1\": 0.661500115820817,\n        \"nauc_mrr_at_1_max\": 0.5770263549598156,\n        \"nauc_mrr_at_1_std\": 0.1313742842575525,\n        \"nauc_mrr_at_20_diff1\": 0.662962026964006,\n        \"nauc_mrr_at_20_max\": 0.6747824530605779,\n        \"nauc_mrr_at_20_std\": 0.23226267353927715,\n        \"nauc_mrr_at_3_diff1\": 0.658707138510419,\n        \"nauc_mrr_at_3_max\": 0.6720413722313505,\n        \"nauc_mrr_at_3_std\": 0.214088474893056,\n        \"nauc_mrr_at_5_diff1\": 0.6603441608824964,\n        \"nauc_mrr_at_5_max\": 0.6736745604944314,\n        \"nauc_mrr_at_5_std\": 0.22846499218561858,\n        \"nauc_ndcg_at_1000_diff1\": 0.5907551369979055,\n        \"nauc_ndcg_at_1000_max\": 0.6615877024334198,\n        \"nauc_ndcg_at_1000_std\": 0.2393015359142359,\n        \"nauc_ndcg_at_100_diff1\": 0.5937442728212519,\n        \"nauc_ndcg_at_100_max\": 0.670641015014622,\n        \"nauc_ndcg_at_100_std\": 0.25487773336698044,\n        \"nauc_ndcg_at_10_diff1\": 0.5831817543877047,\n        \"nauc_ndcg_at_10_max\": 0.6643418532861225,\n        \"nauc_ndcg_at_10_std\": 0.22326362761367885,\n        \"nauc_ndcg_at_1_diff1\": 0.661500115820817,\n        \"nauc_ndcg_at_1_max\": 0.5770263549598156,\n        \"nauc_ndcg_at_1_std\": 0.1313742842575525,\n        \"nauc_ndcg_at_20_diff1\": 0.5899026096075843,\n        \"nauc_ndcg_at_20_max\": 0.673272767215356,\n        \"nauc_ndcg_at_20_std\": 0.24635138529614536,\n        \"nauc_ndcg_at_3_diff1\": 0.5479702226955419,\n        \"nauc_ndcg_at_3_max\": 0.6059582416432887,\n        \"nauc_ndcg_at_3_std\": 0.12743795996465662,\n        \"nauc_ndcg_at_5_diff1\": 0.5628160195267607,\n        \"nauc_ndcg_at_5_max\": 0.6411398480758634,\n        \"nauc_ndcg_at_5_std\": 0.18438351907666847,\n        \"nauc_precision_at_1000_diff1\": -0.2004685252782137,\n        \"nauc_precision_at_1000_max\": 0.07063855451998648,\n        \"nauc_precision_at_1000_std\": 0.23065877466350113,\n        \"nauc_precision_at_100_diff1\": -0.07861027277114246,\n        \"nauc_precision_at_100_max\": 0.21703569000810188,\n        \"nauc_precision_at_100_std\": 0.31518785228088636,\n        \"nauc_precision_at_10_diff1\": 0.012468448328005923,\n        \"nauc_precision_at_10_max\": 0.35106876700614753,\n        \"nauc_precision_at_10_std\": 0.30589978246233046,\n        \"nauc_precision_at_1_diff1\": 0.661500115820817,\n        \"nauc_precision_at_1_max\": 0.5770263549598156,\n        \"nauc_precision_at_1_std\": 0.1313742842575525,\n        \"nauc_precision_at_20_diff1\": -0.015991023617958375,\n        \"nauc_precision_at_20_max\": 0.31120661076351014,\n        \"nauc_precision_at_20_std\": 0.32862281412296374,\n        \"nauc_precision_at_3_diff1\": 0.10652022166353019,\n        \"nauc_precision_at_3_max\": 0.4643801024890446,\n        \"nauc_precision_at_3_std\": 0.21573365606067008,\n        \"nauc_precision_at_5_diff1\": 0.04752964400629679,\n        \"nauc_precision_at_5_max\": 0.3993637294469268,\n        \"nauc_precision_at_5_std\": 0.26849236828347134,\n        \"nauc_recall_at_1000_diff1\": 0.6310537710228703,\n        \"nauc_recall_at_1000_max\": 0.9077919776775288,\n        \"nauc_recall_at_1000_std\": 0.7655930243673666,\n        \"nauc_recall_at_100_diff1\": 0.6368032349603382,\n        \"nauc_recall_at_100_max\": 0.8803880729883224,\n        \"nauc_recall_at_100_std\": 0.6979867070823739,\n        \"nauc_recall_at_10_diff1\": 0.5650349723481966,\n        \"nauc_recall_at_10_max\": 0.7654270251851792,\n        \"nauc_recall_at_10_std\": 0.3773682882526592,\n        \"nauc_recall_at_1_diff1\": 0.5834434025577803,\n        \"nauc_recall_at_1_max\": 0.299451623991129,\n        \"nauc_recall_at_1_std\": -0.022953282119810403,\n        \"nauc_recall_at_20_diff1\": 0.5996092880814857,\n        \"nauc_recall_at_20_max\": 0.829226851926464,\n        \"nauc_recall_at_20_std\": 0.5101268399413494,\n        \"nauc_recall_at_3_diff1\": 0.49205076291344274,\n        \"nauc_recall_at_3_max\": 0.6109051461139894,\n        \"nauc_recall_at_3_std\": 0.12072253500359617,\n        \"nauc_recall_at_5_diff1\": 0.5088705234664951,\n        \"nauc_recall_at_5_max\": 0.6817156339665192,\n        \"nauc_recall_at_5_std\": 0.24410069255370517,\n        \"ndcg_at_1\": 0.70101,\n        \"ndcg_at_10\": 0.75121,\n        \"ndcg_at_100\": 0.77256,\n        \"ndcg_at_1000\": 0.78115,\n        \"ndcg_at_20\": 0.76145,\n        \"ndcg_at_3\": 0.70056,\n        \"ndcg_at_5\": 0.73113,\n        \"precision_at_1\": 0.70101,\n        \"precision_at_10\": 0.15152,\n        \"precision_at_100\": 0.01698,\n        \"precision_at_1000\": 0.00183,\n        \"precision_at_20\": 0.07956,\n        \"precision_at_3\": 0.41667,\n        \"precision_at_5\": 0.27939,\n        \"recall_at_1\": 0.45135,\n        \"recall_at_10\": 0.82298,\n        \"recall_at_100\": 0.90386,\n        \"recall_at_1000\": 0.9587,\n        \"recall_at_20\": 0.85468,\n        \"recall_at_3\": 0.71127,\n        \"recall_at_5\": 0.77506\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-multilingual-base/Alibaba-NLP__gte-multilingual-base/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 4725.387804031372,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.62697,\n        \"map_at_1\": 0.38205,\n        \"map_at_10\": 0.54289,\n        \"map_at_100\": 0.56555,\n        \"map_at_1000\": 0.56697,\n        \"map_at_20\": 0.55681,\n        \"map_at_3\": 0.48344,\n        \"map_at_5\": 0.51568,\n        \"mrr_at_1\": 0.6103286384976526,\n        \"mrr_at_10\": 0.7039291303375809,\n        \"mrr_at_100\": 0.7082462092431728,\n        \"mrr_at_1000\": 0.7084151998358826,\n        \"mrr_at_20\": 0.7072567444280695,\n        \"mrr_at_3\": 0.6862284820031298,\n        \"mrr_at_5\": 0.69679186228482,\n        \"nauc_map_at_1000_diff1\": 0.3880663627782523,\n        \"nauc_map_at_1000_max\": 0.26875837358990384,\n        \"nauc_map_at_1000_std\": -0.02915658141808151,\n        \"nauc_map_at_100_diff1\": 0.3877255300606842,\n        \"nauc_map_at_100_max\": 0.2676573499357481,\n        \"nauc_map_at_100_std\": -0.03003797795589652,\n        \"nauc_map_at_10_diff1\": 0.3967106291403696,\n        \"nauc_map_at_10_max\": 0.2507505837032776,\n        \"nauc_map_at_10_std\": -0.051781293185286445,\n        \"nauc_map_at_1_diff1\": 0.41809526232663874,\n        \"nauc_map_at_1_max\": 0.08779534853304669,\n        \"nauc_map_at_1_std\": -0.17386942942712602,\n        \"nauc_map_at_20_diff1\": 0.3915764765548958,\n        \"nauc_map_at_20_max\": 0.25739603266273464,\n        \"nauc_map_at_20_std\": -0.041442559021572345,\n        \"nauc_map_at_3_diff1\": 0.42231719725329264,\n        \"nauc_map_at_3_max\": 0.18371697143417534,\n        \"nauc_map_at_3_std\": -0.12726929425612019,\n        \"nauc_map_at_5_diff1\": 0.398872122466833,\n        \"nauc_map_at_5_max\": 0.2183229034565644,\n        \"nauc_map_at_5_std\": -0.08595999951698406,\n        \"nauc_mrr_at_1000_diff1\": 0.4088929543341095,\n        \"nauc_mrr_at_1000_max\": 0.4960270065168594,\n        \"nauc_mrr_at_1000_std\": 0.1986308055671587,\n        \"nauc_mrr_at_100_diff1\": 0.40884542440189453,\n        \"nauc_mrr_at_100_max\": 0.496298929979252,\n        \"nauc_mrr_at_100_std\": 0.19901507136436228,\n        \"nauc_mrr_at_10_diff1\": 0.4095868941932426,\n        \"nauc_mrr_at_10_max\": 0.5016475476247045,\n        \"nauc_mrr_at_10_std\": 0.20295922598033728,\n        \"nauc_mrr_at_1_diff1\": 0.42845609791848677,\n        \"nauc_mrr_at_1_max\": 0.40065137930038525,\n        \"nauc_mrr_at_1_std\": 0.10762285365210995,\n        \"nauc_mrr_at_20_diff1\": 0.4083082899116937,\n        \"nauc_mrr_at_20_max\": 0.49640091643714074,\n        \"nauc_mrr_at_20_std\": 0.20091163621165942,\n        \"nauc_mrr_at_3_diff1\": 0.4157753000024607,\n        \"nauc_mrr_at_3_max\": 0.49681140521620853,\n        \"nauc_mrr_at_3_std\": 0.18299091495164696,\n        \"nauc_mrr_at_5_diff1\": 0.4024032183255278,\n        \"nauc_mrr_at_5_max\": 0.4965190104753864,\n        \"nauc_mrr_at_5_std\": 0.1973793570513383,\n        \"nauc_ndcg_at_1000_diff1\": 0.37373031518754046,\n        \"nauc_ndcg_at_1000_max\": 0.37607986329290355,\n        \"nauc_ndcg_at_1000_std\": 0.0908324185246208,\n        \"nauc_ndcg_at_100_diff1\": 0.3717491373566511,\n        \"nauc_ndcg_at_100_max\": 0.37240022954155677,\n        \"nauc_ndcg_at_100_std\": 0.08618214219538683,\n        \"nauc_ndcg_at_10_diff1\": 0.39086793566356887,\n        \"nauc_ndcg_at_10_max\": 0.33466796739784904,\n        \"nauc_ndcg_at_10_std\": 0.030749916588024073,\n        \"nauc_ndcg_at_1_diff1\": 0.42845609791848677,\n        \"nauc_ndcg_at_1_max\": 0.40065137930038525,\n        \"nauc_ndcg_at_1_std\": 0.10762285365210995,\n        \"nauc_ndcg_at_20_diff1\": 0.38054633502568497,\n        \"nauc_ndcg_at_20_max\": 0.3438995134967677,\n        \"nauc_ndcg_at_20_std\": 0.0562318258312696,\n        \"nauc_ndcg_at_3_diff1\": 0.399795423235567,\n        \"nauc_ndcg_at_3_max\": 0.33702985956781256,\n        \"nauc_ndcg_at_3_std\": 0.011897751562643624,\n        \"nauc_ndcg_at_5_diff1\": 0.37602006444813374,\n        \"nauc_ndcg_at_5_max\": 0.32301355137987625,\n        \"nauc_ndcg_at_5_std\": 0.014210821857346219,\n        \"nauc_precision_at_1000_diff1\": -0.2325905952276443,\n        \"nauc_precision_at_1000_max\": 0.26803251700559394,\n        \"nauc_precision_at_1000_std\": 0.40373084311985863,\n        \"nauc_precision_at_100_diff1\": -0.22361371198039076,\n        \"nauc_precision_at_100_max\": 0.30222103314451515,\n        \"nauc_precision_at_100_std\": 0.42174055990118403,\n        \"nauc_precision_at_10_diff1\": -0.10782271786242098,\n        \"nauc_precision_at_10_max\": 0.3906023360764504,\n        \"nauc_precision_at_10_std\": 0.41343020041282674,\n        \"nauc_precision_at_1_diff1\": 0.42845609791848677,\n        \"nauc_precision_at_1_max\": 0.40065137930038525,\n        \"nauc_precision_at_1_std\": 0.10762285365210995,\n        \"nauc_precision_at_20_diff1\": -0.16620077076923456,\n        \"nauc_precision_at_20_max\": 0.3540662038450409,\n        \"nauc_precision_at_20_std\": 0.4385742655258709,\n        \"nauc_precision_at_3_diff1\": 0.0643330951436578,\n        \"nauc_precision_at_3_max\": 0.4708826625517317,\n        \"nauc_precision_at_3_std\": 0.3150688758870942,\n        \"nauc_precision_at_5_diff1\": -0.0791402282451768,\n        \"nauc_precision_at_5_max\": 0.410837502746928,\n        \"nauc_precision_at_5_std\": 0.3739032437456903,\n        \"nauc_recall_at_1000_diff1\": 0.1461707557767423,\n        \"nauc_recall_at_1000_max\": 0.7392773551034885,\n        \"nauc_recall_at_1000_std\": 0.596389402600282,\n        \"nauc_recall_at_100_diff1\": 0.2603605715058474,\n        \"nauc_recall_at_100_max\": 0.4411100758773747,\n        \"nauc_recall_at_100_std\": 0.20665759469441622,\n        \"nauc_recall_at_10_diff1\": 0.3496804304290531,\n        \"nauc_recall_at_10_max\": 0.2969594791669843,\n        \"nauc_recall_at_10_std\": -0.0024174736235818084,\n        \"nauc_recall_at_1_diff1\": 0.41809526232663874,\n        \"nauc_recall_at_1_max\": 0.08779534853304669,\n        \"nauc_recall_at_1_std\": -0.17386942942712602,\n        \"nauc_recall_at_20_diff1\": 0.3034341078071222,\n        \"nauc_recall_at_20_max\": 0.29415428741234795,\n        \"nauc_recall_at_20_std\": 0.0621874859031154,\n        \"nauc_recall_at_3_diff1\": 0.4114352782373673,\n        \"nauc_recall_at_3_max\": 0.184362694523637,\n        \"nauc_recall_at_3_std\": -0.1315379775711195,\n        \"nauc_recall_at_5_diff1\": 0.3507401455620195,\n        \"nauc_recall_at_5_max\": 0.2305916637080133,\n        \"nauc_recall_at_5_std\": -0.0646045286797751,\n        \"ndcg_at_1\": 0.61033,\n        \"ndcg_at_10\": 0.62697,\n        \"ndcg_at_100\": 0.6861,\n        \"ndcg_at_1000\": 0.70173,\n        \"ndcg_at_20\": 0.65736,\n        \"ndcg_at_3\": 0.58892,\n        \"ndcg_at_5\": 0.60065,\n        \"precision_at_1\": 0.61033,\n        \"precision_at_10\": 0.15681,\n        \"precision_at_100\": 0.02244,\n        \"precision_at_1000\": 0.00253,\n        \"precision_at_20\": 0.09202,\n        \"precision_at_3\": 0.33959,\n        \"precision_at_5\": 0.2554,\n        \"recall_at_1\": 0.38205,\n        \"recall_at_10\": 0.70019,\n        \"recall_at_100\": 0.89421,\n        \"recall_at_1000\": 0.97981,\n        \"recall_at_20\": 0.78979,\n        \"recall_at_3\": 0.53982,\n        \"recall_at_5\": 0.6097\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-multilingual-base/Alibaba-NLP__gte-multilingual-base/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 4789.847511768341,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.56464,\n        \"map_at_1\": 0.38836,\n        \"map_at_10\": 0.50553,\n        \"map_at_100\": 0.51348,\n        \"map_at_1000\": 0.51388,\n        \"map_at_20\": 0.51026,\n        \"map_at_3\": 0.47816,\n        \"map_at_5\": 0.4954,\n        \"mrr_at_1\": 0.42042755344418054,\n        \"mrr_at_10\": 0.5310343852505374,\n        \"mrr_at_100\": 0.5367455539072286,\n        \"mrr_at_1000\": 0.5370753449207969,\n        \"mrr_at_20\": 0.5347435394689465,\n        \"mrr_at_3\": 0.5079176563737136,\n        \"mrr_at_5\": 0.5206254948535236,\n        \"nauc_map_at_1000_diff1\": 0.25716543859897323,\n        \"nauc_map_at_1000_max\": 0.28005192170293824,\n        \"nauc_map_at_1000_std\": 0.03836511543988043,\n        \"nauc_map_at_100_diff1\": 0.25715155161945596,\n        \"nauc_map_at_100_max\": 0.2801515462923894,\n        \"nauc_map_at_100_std\": 0.03847960284606766,\n        \"nauc_map_at_10_diff1\": 0.25825901715325766,\n        \"nauc_map_at_10_max\": 0.2774051051549839,\n        \"nauc_map_at_10_std\": 0.030341349544946543,\n        \"nauc_map_at_1_diff1\": 0.32573416780172126,\n        \"nauc_map_at_1_max\": 0.31247776894025886,\n        \"nauc_map_at_1_std\": 0.031249381404232498,\n        \"nauc_map_at_20_diff1\": 0.257080817902839,\n        \"nauc_map_at_20_max\": 0.2782100911069668,\n        \"nauc_map_at_20_std\": 0.03451940941925907,\n        \"nauc_map_at_3_diff1\": 0.26845525923224,\n        \"nauc_map_at_3_max\": 0.2642457306385882,\n        \"nauc_map_at_3_std\": 0.015335480167255127,\n        \"nauc_map_at_5_diff1\": 0.25278758474435037,\n        \"nauc_map_at_5_max\": 0.27504315746221053,\n        \"nauc_map_at_5_std\": 0.029983842134557192,\n        \"nauc_mrr_at_1000_diff1\": 0.26088870787930196,\n        \"nauc_mrr_at_1000_max\": 0.2912226938065716,\n        \"nauc_mrr_at_1000_std\": 0.04285053316771879,\n        \"nauc_mrr_at_100_diff1\": 0.2609646228530708,\n        \"nauc_mrr_at_100_max\": 0.2914631566489875,\n        \"nauc_mrr_at_100_std\": 0.0430522291485771,\n        \"nauc_mrr_at_10_diff1\": 0.2609882291729948,\n        \"nauc_mrr_at_10_max\": 0.28934197519266663,\n        \"nauc_mrr_at_10_std\": 0.03827684254515211,\n        \"nauc_mrr_at_1_diff1\": 0.3214764381617425,\n        \"nauc_mrr_at_1_max\": 0.3109742940946706,\n        \"nauc_mrr_at_1_std\": 0.03263481415776953,\n        \"nauc_mrr_at_20_diff1\": 0.2603922334686195,\n        \"nauc_mrr_at_20_max\": 0.2900484255899885,\n        \"nauc_mrr_at_20_std\": 0.040662887127286745,\n        \"nauc_mrr_at_3_diff1\": 0.2654485903005151,\n        \"nauc_mrr_at_3_max\": 0.2779252830401248,\n        \"nauc_mrr_at_3_std\": 0.02424182001973642,\n        \"nauc_mrr_at_5_diff1\": 0.2539868410845816,\n        \"nauc_mrr_at_5_max\": 0.28505476937588964,\n        \"nauc_mrr_at_5_std\": 0.03596238739186569,\n        \"nauc_ndcg_at_1000_diff1\": 0.23557354884221127,\n        \"nauc_ndcg_at_1000_max\": 0.29032978771135,\n        \"nauc_ndcg_at_1000_std\": 0.06997467082862376,\n        \"nauc_ndcg_at_100_diff1\": 0.23571006906147526,\n        \"nauc_ndcg_at_100_max\": 0.29522278193987794,\n        \"nauc_ndcg_at_100_std\": 0.07461791164210363,\n        \"nauc_ndcg_at_10_diff1\": 0.23718143213771353,\n        \"nauc_ndcg_at_10_max\": 0.27862306219326183,\n        \"nauc_ndcg_at_10_std\": 0.036243938954022954,\n        \"nauc_ndcg_at_1_diff1\": 0.3214764381617425,\n        \"nauc_ndcg_at_1_max\": 0.3109742940946706,\n        \"nauc_ndcg_at_1_std\": 0.03263481415776953,\n        \"nauc_ndcg_at_20_diff1\": 0.23384962103391074,\n        \"nauc_ndcg_at_20_max\": 0.2823622591128196,\n        \"nauc_ndcg_at_20_std\": 0.05073943905013697,\n        \"nauc_ndcg_at_3_diff1\": 0.2505995080003967,\n        \"nauc_ndcg_at_3_max\": 0.2550849070629041,\n        \"nauc_ndcg_at_3_std\": 0.012143397163197251,\n        \"nauc_ndcg_at_5_diff1\": 0.22439685641544171,\n        \"nauc_ndcg_at_5_max\": 0.2716990904719191,\n        \"nauc_ndcg_at_5_std\": 0.03575325421970202,\n        \"nauc_precision_at_1000_diff1\": -0.13230947244366867,\n        \"nauc_precision_at_1000_max\": 0.050305125840942856,\n        \"nauc_precision_at_1000_std\": 0.1764339714748889,\n        \"nauc_precision_at_100_diff1\": -0.06222382942833803,\n        \"nauc_precision_at_100_max\": 0.13842447314423142,\n        \"nauc_precision_at_100_std\": 0.20705592120058777,\n        \"nauc_precision_at_10_diff1\": 0.05514361830417003,\n        \"nauc_precision_at_10_max\": 0.18701739784935376,\n        \"nauc_precision_at_10_std\": 0.04650331876462832,\n        \"nauc_precision_at_1_diff1\": 0.3214764381617425,\n        \"nauc_precision_at_1_max\": 0.3109742940946706,\n        \"nauc_precision_at_1_std\": 0.03263481415776953,\n        \"nauc_precision_at_20_diff1\": -0.00617052929258315,\n        \"nauc_precision_at_20_max\": 0.1565272393710742,\n        \"nauc_precision_at_20_std\": 0.1100427948727622,\n        \"nauc_precision_at_3_diff1\": 0.1468202987011345,\n        \"nauc_precision_at_3_max\": 0.1849822470919322,\n        \"nauc_precision_at_3_std\": -0.010667626125281129,\n        \"nauc_precision_at_5_diff1\": 0.05497589349994129,\n        \"nauc_precision_at_5_max\": 0.1879791183562475,\n        \"nauc_precision_at_5_std\": 0.0444158747825215,\n        \"nauc_recall_at_1000_diff1\": -0.03852211432611442,\n        \"nauc_recall_at_1000_max\": 0.41798503899896616,\n        \"nauc_recall_at_1000_std\": 0.6213555554385645,\n        \"nauc_recall_at_100_diff1\": 0.10092135478885442,\n        \"nauc_recall_at_100_max\": 0.4381086975662203,\n        \"nauc_recall_at_100_std\": 0.4171683707601491,\n        \"nauc_recall_at_10_diff1\": 0.15252772800619863,\n        \"nauc_recall_at_10_max\": 0.26507602202914265,\n        \"nauc_recall_at_10_std\": 0.045423224965121856,\n        \"nauc_recall_at_1_diff1\": 0.32573416780172126,\n        \"nauc_recall_at_1_max\": 0.31247776894025886,\n        \"nauc_recall_at_1_std\": 0.031249381404232498,\n        \"nauc_recall_at_20_diff1\": 0.13064148113752028,\n        \"nauc_recall_at_20_max\": 0.2901054578717061,\n        \"nauc_recall_at_20_std\": 0.12413182063867068,\n        \"nauc_recall_at_3_diff1\": 0.19680821832881057,\n        \"nauc_recall_at_3_max\": 0.20838567453412998,\n        \"nauc_recall_at_3_std\": -0.00682971262625349,\n        \"nauc_recall_at_5_diff1\": 0.12554959294600906,\n        \"nauc_recall_at_5_max\": 0.24624746390881122,\n        \"nauc_recall_at_5_std\": 0.04863875266602324,\n        \"ndcg_at_1\": 0.42043,\n        \"ndcg_at_10\": 0.56464,\n        \"ndcg_at_100\": 0.59861,\n        \"ndcg_at_1000\": 0.60804,\n        \"ndcg_at_20\": 0.57975,\n        \"ndcg_at_3\": 0.51325,\n        \"ndcg_at_5\": 0.54051,\n        \"precision_at_1\": 0.42043,\n        \"precision_at_10\": 0.08076,\n        \"precision_at_100\": 0.01007,\n        \"precision_at_1000\": 0.00109,\n        \"precision_at_20\": 0.04418,\n        \"precision_at_3\": 0.21615,\n        \"precision_at_5\": 0.14537,\n        \"recall_at_1\": 0.38836,\n        \"recall_at_10\": 0.71971,\n        \"recall_at_100\": 0.86659,\n        \"recall_at_1000\": 0.93666,\n        \"recall_at_20\": 0.77395,\n        \"recall_at_3\": 0.58591,\n        \"recall_at_5\": 0.64766\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-multilingual-base/Alibaba-NLP__gte-multilingual-base/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 4641.1542456150055,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.48402,\n        \"map_at_1\": 0.36,\n        \"map_at_10\": 0.44135,\n        \"map_at_100\": 0.45013,\n        \"map_at_1000\": 0.45073,\n        \"map_at_20\": 0.44591,\n        \"map_at_3\": 0.42167,\n        \"map_at_5\": 0.42967,\n        \"mrr_at_1\": 0.36,\n        \"mrr_at_10\": 0.4413511904761906,\n        \"mrr_at_100\": 0.450129543381387,\n        \"mrr_at_1000\": 0.45073324355439376,\n        \"mrr_at_20\": 0.44590807700211743,\n        \"mrr_at_3\": 0.4216666666666667,\n        \"mrr_at_5\": 0.4296666666666667,\n        \"nauc_map_at_1000_diff1\": 0.653999576097392,\n        \"nauc_map_at_1000_max\": 0.5915981156693542,\n        \"nauc_map_at_1000_std\": 0.04204665806066081,\n        \"nauc_map_at_100_diff1\": 0.6537378762654921,\n        \"nauc_map_at_100_max\": 0.591719062921236,\n        \"nauc_map_at_100_std\": 0.042690974962164625,\n        \"nauc_map_at_10_diff1\": 0.652369406457342,\n        \"nauc_map_at_10_max\": 0.5909253802982799,\n        \"nauc_map_at_10_std\": 0.036022144467421524,\n        \"nauc_map_at_1_diff1\": 0.7126436781609194,\n        \"nauc_map_at_1_max\": 0.5840418831680049,\n        \"nauc_map_at_1_std\": -0.021833831942476276,\n        \"nauc_map_at_20_diff1\": 0.6520302323881799,\n        \"nauc_map_at_20_max\": 0.5908525887352375,\n        \"nauc_map_at_20_std\": 0.04020584504644928,\n        \"nauc_map_at_3_diff1\": 0.6640690747768079,\n        \"nauc_map_at_3_max\": 0.5918378557726748,\n        \"nauc_map_at_3_std\": 0.027992687337536,\n        \"nauc_map_at_5_diff1\": 0.6522396910722045,\n        \"nauc_map_at_5_max\": 0.591985080836136,\n        \"nauc_map_at_5_std\": 0.040401896772712935,\n        \"nauc_mrr_at_1000_diff1\": 0.653999576097392,\n        \"nauc_mrr_at_1000_max\": 0.5915981156693542,\n        \"nauc_mrr_at_1000_std\": 0.04204665806066081,\n        \"nauc_mrr_at_100_diff1\": 0.6537378762654921,\n        \"nauc_mrr_at_100_max\": 0.591719062921236,\n        \"nauc_mrr_at_100_std\": 0.042690974962164625,\n        \"nauc_mrr_at_10_diff1\": 0.652369406457342,\n        \"nauc_mrr_at_10_max\": 0.5909253802982799,\n        \"nauc_mrr_at_10_std\": 0.036022144467421524,\n        \"nauc_mrr_at_1_diff1\": 0.7126436781609194,\n        \"nauc_mrr_at_1_max\": 0.5840418831680049,\n        \"nauc_mrr_at_1_std\": -0.021833831942476276,\n        \"nauc_mrr_at_20_diff1\": 0.6520302323881799,\n        \"nauc_mrr_at_20_max\": 0.5908525887352375,\n        \"nauc_mrr_at_20_std\": 0.04020584504644928,\n        \"nauc_mrr_at_3_diff1\": 0.6640690747768079,\n        \"nauc_mrr_at_3_max\": 0.5918378557726748,\n        \"nauc_mrr_at_3_std\": 0.027992687337536,\n        \"nauc_mrr_at_5_diff1\": 0.6522396910722045,\n        \"nauc_mrr_at_5_max\": 0.591985080836136,\n        \"nauc_mrr_at_5_std\": 0.040401896772712935,\n        \"nauc_ndcg_at_1000_diff1\": 0.6432566916474228,\n        \"nauc_ndcg_at_1000_max\": 0.5998470404188347,\n        \"nauc_ndcg_at_1000_std\": 0.07410684021566737,\n        \"nauc_ndcg_at_100_diff1\": 0.6360589988421134,\n        \"nauc_ndcg_at_100_max\": 0.6037341341497577,\n        \"nauc_ndcg_at_100_std\": 0.09785768793288292,\n        \"nauc_ndcg_at_10_diff1\": 0.6293196340250062,\n        \"nauc_ndcg_at_10_max\": 0.5982485402739869,\n        \"nauc_ndcg_at_10_std\": 0.06006582165943897,\n        \"nauc_ndcg_at_1_diff1\": 0.7126436781609194,\n        \"nauc_ndcg_at_1_max\": 0.5840418831680049,\n        \"nauc_ndcg_at_1_std\": -0.021833831942476276,\n        \"nauc_ndcg_at_20_diff1\": 0.6261813451342695,\n        \"nauc_ndcg_at_20_max\": 0.5970582271477827,\n        \"nauc_ndcg_at_20_std\": 0.07622456371047974,\n        \"nauc_ndcg_at_3_diff1\": 0.6506603473332017,\n        \"nauc_ndcg_at_3_max\": 0.6004543836287595,\n        \"nauc_ndcg_at_3_std\": 0.047787735554177944,\n        \"nauc_ndcg_at_5_diff1\": 0.6287749223122684,\n        \"nauc_ndcg_at_5_max\": 0.6005997287841836,\n        \"nauc_ndcg_at_5_std\": 0.07005047365688216,\n        \"nauc_precision_at_1000_diff1\": 0.8078120136943695,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 0.5412788805727321,\n        \"nauc_precision_at_100_max\": 0.7116986657988953,\n        \"nauc_precision_at_100_std\": 0.598714611129191,\n        \"nauc_precision_at_10_diff1\": 0.5518721348798572,\n        \"nauc_precision_at_10_max\": 0.6234424514660185,\n        \"nauc_precision_at_10_std\": 0.13918715195520429,\n        \"nauc_precision_at_1_diff1\": 0.7126436781609194,\n        \"nauc_precision_at_1_max\": 0.5840418831680049,\n        \"nauc_precision_at_1_std\": -0.021833831942476276,\n        \"nauc_precision_at_20_diff1\": 0.5220822971233046,\n        \"nauc_precision_at_20_max\": 0.6184366015838579,\n        \"nauc_precision_at_20_std\": 0.22843360318888078,\n        \"nauc_precision_at_3_diff1\": 0.6122251832111925,\n        \"nauc_precision_at_3_max\": 0.6275216522318455,\n        \"nauc_precision_at_3_std\": 0.10674217188541009,\n        \"nauc_precision_at_5_diff1\": 0.5556584283947462,\n        \"nauc_precision_at_5_max\": 0.6282966330640979,\n        \"nauc_precision_at_5_std\": 0.16318549585092312,\n        \"nauc_recall_at_1000_diff1\": 0.8078120136943671,\n        \"nauc_recall_at_1000_max\": 1.0,\n        \"nauc_recall_at_1000_std\": 1.0,\n        \"nauc_recall_at_100_diff1\": 0.5412788805727307,\n        \"nauc_recall_at_100_max\": 0.7116986657988936,\n        \"nauc_recall_at_100_std\": 0.5987146111291889,\n        \"nauc_recall_at_10_diff1\": 0.5518721348798571,\n        \"nauc_recall_at_10_max\": 0.6234424514660182,\n        \"nauc_recall_at_10_std\": 0.13918715195520406,\n        \"nauc_recall_at_1_diff1\": 0.7126436781609194,\n        \"nauc_recall_at_1_max\": 0.5840418831680049,\n        \"nauc_recall_at_1_std\": -0.021833831942476276,\n        \"nauc_recall_at_20_diff1\": 0.5220822971233048,\n        \"nauc_recall_at_20_max\": 0.6184366015838583,\n        \"nauc_recall_at_20_std\": 0.22843360318888178,\n        \"nauc_recall_at_3_diff1\": 0.6122251832111921,\n        \"nauc_recall_at_3_max\": 0.6275216522318453,\n        \"nauc_recall_at_3_std\": 0.10674217188540977,\n        \"nauc_recall_at_5_diff1\": 0.5556584283947461,\n        \"nauc_recall_at_5_max\": 0.6282966330640981,\n        \"nauc_recall_at_5_std\": 0.16318549585092318,\n        \"ndcg_at_1\": 0.36,\n        \"ndcg_at_10\": 0.48402,\n        \"ndcg_at_100\": 0.53127,\n        \"ndcg_at_1000\": 0.54818,\n        \"ndcg_at_20\": 0.50135,\n        \"ndcg_at_3\": 0.44178,\n        \"ndcg_at_5\": 0.4562,\n        \"precision_at_1\": 0.36,\n        \"precision_at_10\": 0.062,\n        \"precision_at_100\": 0.0085,\n        \"precision_at_1000\": 0.00099,\n        \"precision_at_20\": 0.0345,\n        \"precision_at_3\": 0.16667,\n        \"precision_at_5\": 0.107,\n        \"recall_at_1\": 0.36,\n        \"recall_at_10\": 0.62,\n        \"recall_at_100\": 0.85,\n        \"recall_at_1000\": 0.985,\n        \"recall_at_20\": 0.69,\n        \"recall_at_3\": 0.5,\n        \"recall_at_5\": 0.535\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.46733,\n        \"map_at_1\": 0.33,\n        \"map_at_10\": 0.42326,\n        \"map_at_100\": 0.43228,\n        \"map_at_1000\": 0.43308,\n        \"map_at_20\": 0.42878,\n        \"map_at_3\": 0.40333,\n        \"map_at_5\": 0.41608,\n        \"mrr_at_1\": 0.33,\n        \"mrr_at_10\": 0.4232619047619048,\n        \"mrr_at_100\": 0.432279471134081,\n        \"mrr_at_1000\": 0.4330762455314873,\n        \"mrr_at_20\": 0.4287762510107712,\n        \"mrr_at_3\": 0.40333333333333327,\n        \"mrr_at_5\": 0.4160833333333334,\n        \"nauc_map_at_1000_diff1\": 0.6409752471277966,\n        \"nauc_map_at_1000_max\": 0.5946002721149415,\n        \"nauc_map_at_1000_std\": 0.03492754217391834,\n        \"nauc_map_at_100_diff1\": 0.6405785551672617,\n        \"nauc_map_at_100_max\": 0.5947016987665,\n        \"nauc_map_at_100_std\": 0.03519683850581178,\n        \"nauc_map_at_10_diff1\": 0.6437977226295699,\n        \"nauc_map_at_10_max\": 0.5938053519033123,\n        \"nauc_map_at_10_std\": 0.031333520693003776,\n        \"nauc_map_at_1_diff1\": 0.7091105164356752,\n        \"nauc_map_at_1_max\": 0.6154957329818537,\n        \"nauc_map_at_1_std\": 0.014005937878606113,\n        \"nauc_map_at_20_diff1\": 0.6414751638548382,\n        \"nauc_map_at_20_max\": 0.5939793225373083,\n        \"nauc_map_at_20_std\": 0.03190726201177065,\n        \"nauc_map_at_3_diff1\": 0.6404104137741969,\n        \"nauc_map_at_3_max\": 0.5827813691071001,\n        \"nauc_map_at_3_std\": 0.008878591452145033,\n        \"nauc_map_at_5_diff1\": 0.6400465541544528,\n        \"nauc_map_at_5_max\": 0.5881739870325576,\n        \"nauc_map_at_5_std\": 0.021291218705272164,\n        \"nauc_mrr_at_1000_diff1\": 0.6409752471277966,\n        \"nauc_mrr_at_1000_max\": 0.5946002721149415,\n        \"nauc_mrr_at_1000_std\": 0.03492754217391834,\n        \"nauc_mrr_at_100_diff1\": 0.6405785551672617,\n        \"nauc_mrr_at_100_max\": 0.5947016987665,\n        \"nauc_mrr_at_100_std\": 0.03519683850581178,\n        \"nauc_mrr_at_10_diff1\": 0.6437977226295699,\n        \"nauc_mrr_at_10_max\": 0.5938053519033123,\n        \"nauc_mrr_at_10_std\": 0.031333520693003776,\n        \"nauc_mrr_at_1_diff1\": 0.7091105164356752,\n        \"nauc_mrr_at_1_max\": 0.6154957329818537,\n        \"nauc_mrr_at_1_std\": 0.014005937878606113,\n        \"nauc_mrr_at_20_diff1\": 0.6414751638548382,\n        \"nauc_mrr_at_20_max\": 0.5939793225373083,\n        \"nauc_mrr_at_20_std\": 0.03190726201177065,\n        \"nauc_mrr_at_3_diff1\": 0.6404104137741969,\n        \"nauc_mrr_at_3_max\": 0.5827813691071001,\n        \"nauc_mrr_at_3_std\": 0.008878591452145033,\n        \"nauc_mrr_at_5_diff1\": 0.6400465541544528,\n        \"nauc_mrr_at_5_max\": 0.5881739870325576,\n        \"nauc_mrr_at_5_std\": 0.021291218705272164,\n        \"nauc_ndcg_at_1000_diff1\": 0.6225573328293726,\n        \"nauc_ndcg_at_1000_max\": 0.599281715322545,\n        \"nauc_ndcg_at_1000_std\": 0.06719272824721652,\n        \"nauc_ndcg_at_100_diff1\": 0.6080334683443672,\n        \"nauc_ndcg_at_100_max\": 0.6039284709620057,\n        \"nauc_ndcg_at_100_std\": 0.08347014870182251,\n        \"nauc_ndcg_at_10_diff1\": 0.6233539007043118,\n        \"nauc_ndcg_at_10_max\": 0.594255714519112,\n        \"nauc_ndcg_at_10_std\": 0.05460105589744826,\n        \"nauc_ndcg_at_1_diff1\": 0.7091105164356752,\n        \"nauc_ndcg_at_1_max\": 0.6154957329818537,\n        \"nauc_ndcg_at_1_std\": 0.014005937878606113,\n        \"nauc_ndcg_at_20_diff1\": 0.6135707800197637,\n        \"nauc_ndcg_at_20_max\": 0.5967141800825231,\n        \"nauc_ndcg_at_20_std\": 0.05829972851360095,\n        \"nauc_ndcg_at_3_diff1\": 0.6164968584122404,\n        \"nauc_ndcg_at_3_max\": 0.5722148672843138,\n        \"nauc_ndcg_at_3_std\": 0.007984550405491661,\n        \"nauc_ndcg_at_5_diff1\": 0.6147514584683341,\n        \"nauc_ndcg_at_5_max\": 0.5815707344595532,\n        \"nauc_ndcg_at_5_std\": 0.032085748538331245,\n        \"nauc_precision_at_1000_diff1\": 0.5799097416744464,\n        \"nauc_precision_at_1000_max\": 0.7833022097727956,\n        \"nauc_precision_at_1000_std\": 0.8712262682850928,\n        \"nauc_precision_at_100_diff1\": 0.40935590273338596,\n        \"nauc_precision_at_100_max\": 0.6985987880027615,\n        \"nauc_precision_at_100_std\": 0.4522488429773202,\n        \"nauc_precision_at_10_diff1\": 0.5601805754156903,\n        \"nauc_precision_at_10_max\": 0.6014014808381931,\n        \"nauc_precision_at_10_std\": 0.14141330957603684,\n        \"nauc_precision_at_1_diff1\": 0.7091105164356752,\n        \"nauc_precision_at_1_max\": 0.6154957329818537,\n        \"nauc_precision_at_1_std\": 0.014005937878606113,\n        \"nauc_precision_at_20_diff1\": 0.5030837537143249,\n        \"nauc_precision_at_20_max\": 0.6184524220855502,\n        \"nauc_precision_at_20_std\": 0.1739686269089894,\n        \"nauc_precision_at_3_diff1\": 0.5466105358366083,\n        \"nauc_precision_at_3_max\": 0.541569402047046,\n        \"nauc_precision_at_3_std\": 0.005626384150355919,\n        \"nauc_precision_at_5_diff1\": 0.5370287158604224,\n        \"nauc_precision_at_5_max\": 0.5628308642842097,\n        \"nauc_precision_at_5_std\": 0.06966931124060934,\n        \"nauc_recall_at_1000_diff1\": 0.5799097416744453,\n        \"nauc_recall_at_1000_max\": 0.7833022097727981,\n        \"nauc_recall_at_1000_std\": 0.8712262682850952,\n        \"nauc_recall_at_100_diff1\": 0.40935590273338546,\n        \"nauc_recall_at_100_max\": 0.6985987880027614,\n        \"nauc_recall_at_100_std\": 0.45224884297731915,\n        \"nauc_recall_at_10_diff1\": 0.5601805754156904,\n        \"nauc_recall_at_10_max\": 0.6014014808381932,\n        \"nauc_recall_at_10_std\": 0.141413309576037,\n        \"nauc_recall_at_1_diff1\": 0.7091105164356752,\n        \"nauc_recall_at_1_max\": 0.6154957329818537,\n        \"nauc_recall_at_1_std\": 0.014005937878606113,\n        \"nauc_recall_at_20_diff1\": 0.5030837537143243,\n        \"nauc_recall_at_20_max\": 0.6184524220855504,\n        \"nauc_recall_at_20_std\": 0.17396862690898954,\n        \"nauc_recall_at_3_diff1\": 0.5466105358366087,\n        \"nauc_recall_at_3_max\": 0.5415694020470461,\n        \"nauc_recall_at_3_std\": 0.005626384150356102,\n        \"nauc_recall_at_5_diff1\": 0.5370287158604221,\n        \"nauc_recall_at_5_max\": 0.5628308642842097,\n        \"nauc_recall_at_5_std\": 0.06966931124060896,\n        \"ndcg_at_1\": 0.33,\n        \"ndcg_at_10\": 0.46733,\n        \"ndcg_at_100\": 0.51055,\n        \"ndcg_at_1000\": 0.53145,\n        \"ndcg_at_20\": 0.48667,\n        \"ndcg_at_3\": 0.4269,\n        \"ndcg_at_5\": 0.44971,\n        \"precision_at_1\": 0.33,\n        \"precision_at_10\": 0.0605,\n        \"precision_at_100\": 0.00805,\n        \"precision_at_1000\": 0.00097,\n        \"precision_at_20\": 0.034,\n        \"precision_at_3\": 0.165,\n        \"precision_at_5\": 0.11,\n        \"recall_at_1\": 0.33,\n        \"recall_at_10\": 0.605,\n        \"recall_at_100\": 0.805,\n        \"recall_at_1000\": 0.97,\n        \"recall_at_20\": 0.68,\n        \"recall_at_3\": 0.495,\n        \"recall_at_5\": 0.55\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-multilingual-base/Alibaba-NLP__gte-multilingual-base/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 0.8287994861602783,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.74584,\n        \"map_at_1\": 0.58442,\n        \"map_at_10\": 0.69325,\n        \"map_at_100\": 0.6971,\n        \"map_at_1000\": 0.6971,\n        \"map_at_20\": 0.69433,\n        \"map_at_3\": 0.6645,\n        \"map_at_5\": 0.68593,\n        \"mrr_at_1\": 0.5844155844155844,\n        \"mrr_at_10\": 0.6932488146773862,\n        \"mrr_at_100\": 0.6970974064556953,\n        \"mrr_at_1000\": 0.6970974064556953,\n        \"mrr_at_20\": 0.6943310657596372,\n        \"mrr_at_3\": 0.6645021645021645,\n        \"mrr_at_5\": 0.685930735930736,\n        \"nauc_map_at_1000_diff1\": 0.7508489385385345,\n        \"nauc_map_at_1000_max\": 0.33771961050685273,\n        \"nauc_map_at_1000_std\": 0.11725264519083228,\n        \"nauc_map_at_100_diff1\": 0.7508489385385345,\n        \"nauc_map_at_100_max\": 0.33771961050685273,\n        \"nauc_map_at_100_std\": 0.11725264519083228,\n        \"nauc_map_at_10_diff1\": 0.7483846046747796,\n        \"nauc_map_at_10_max\": 0.3278511780894081,\n        \"nauc_map_at_10_std\": 0.10838335653878874,\n        \"nauc_map_at_1_diff1\": 0.8173815695220201,\n        \"nauc_map_at_1_max\": 0.3888661331865086,\n        \"nauc_map_at_1_std\": 0.182953924038586,\n        \"nauc_map_at_20_diff1\": 0.748496829413396,\n        \"nauc_map_at_20_max\": 0.3343465578187079,\n        \"nauc_map_at_20_std\": 0.11392342799281159,\n        \"nauc_map_at_3_diff1\": 0.7388199939774669,\n        \"nauc_map_at_3_max\": 0.3464508902718699,\n        \"nauc_map_at_3_std\": 0.12606109572212115,\n        \"nauc_map_at_5_diff1\": 0.745049440719342,\n        \"nauc_map_at_5_max\": 0.3326396709852455,\n        \"nauc_map_at_5_std\": 0.0958479589280496,\n        \"nauc_mrr_at_1000_diff1\": 0.7508489385385345,\n        \"nauc_mrr_at_1000_max\": 0.33771961050685273,\n        \"nauc_mrr_at_1000_std\": 0.11725264519083228,\n        \"nauc_mrr_at_100_diff1\": 0.7508489385385345,\n        \"nauc_mrr_at_100_max\": 0.33771961050685273,\n        \"nauc_mrr_at_100_std\": 0.11725264519083228,\n        \"nauc_mrr_at_10_diff1\": 0.7483846046747796,\n        \"nauc_mrr_at_10_max\": 0.3278511780894081,\n        \"nauc_mrr_at_10_std\": 0.10838335653878874,\n        \"nauc_mrr_at_1_diff1\": 0.8173815695220201,\n        \"nauc_mrr_at_1_max\": 0.3888661331865086,\n        \"nauc_mrr_at_1_std\": 0.182953924038586,\n        \"nauc_mrr_at_20_diff1\": 0.748496829413396,\n        \"nauc_mrr_at_20_max\": 0.3343465578187079,\n        \"nauc_mrr_at_20_std\": 0.11392342799281159,\n        \"nauc_mrr_at_3_diff1\": 0.7388199939774669,\n        \"nauc_mrr_at_3_max\": 0.3464508902718699,\n        \"nauc_mrr_at_3_std\": 0.12606109572212115,\n        \"nauc_mrr_at_5_diff1\": 0.745049440719342,\n        \"nauc_mrr_at_5_max\": 0.3326396709852455,\n        \"nauc_mrr_at_5_std\": 0.0958479589280496,\n        \"nauc_ndcg_at_1000_diff1\": 0.7412942244900864,\n        \"nauc_ndcg_at_1000_max\": 0.3294039014370792,\n        \"nauc_ndcg_at_1000_std\": 0.10640993082293992,\n        \"nauc_ndcg_at_100_diff1\": 0.7412942244900864,\n        \"nauc_ndcg_at_100_max\": 0.3294039014370792,\n        \"nauc_ndcg_at_100_std\": 0.10640993082293992,\n        \"nauc_ndcg_at_10_diff1\": 0.7245304898357027,\n        \"nauc_ndcg_at_10_max\": 0.28679437262219604,\n        \"nauc_ndcg_at_10_std\": 0.07027087615828691,\n        \"nauc_ndcg_at_1_diff1\": 0.8173815695220201,\n        \"nauc_ndcg_at_1_max\": 0.3888661331865086,\n        \"nauc_ndcg_at_1_std\": 0.182953924038586,\n        \"nauc_ndcg_at_20_diff1\": 0.7245630270157414,\n        \"nauc_ndcg_at_20_max\": 0.3112863125754883,\n        \"nauc_ndcg_at_20_std\": 0.09110844214276108,\n        \"nauc_ndcg_at_3_diff1\": 0.7075235631793855,\n        \"nauc_ndcg_at_3_max\": 0.33335386066642836,\n        \"nauc_ndcg_at_3_std\": 0.09914814670853166,\n        \"nauc_ndcg_at_5_diff1\": 0.7186345849221563,\n        \"nauc_ndcg_at_5_max\": 0.3034500672099746,\n        \"nauc_ndcg_at_5_std\": 0.03592370656674037,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.5468315567317322,\n        \"nauc_precision_at_10_max\": -0.06634874229956951,\n        \"nauc_precision_at_10_std\": -0.21572501610658196,\n        \"nauc_precision_at_1_diff1\": 0.8173815695220201,\n        \"nauc_precision_at_1_max\": 0.3888661331865086,\n        \"nauc_precision_at_1_std\": 0.182953924038586,\n        \"nauc_precision_at_20_diff1\": 0.5175363752626384,\n        \"nauc_precision_at_20_max\": 0.11665403289856896,\n        \"nauc_precision_at_20_std\": -0.057618286542947705,\n        \"nauc_precision_at_3_diff1\": 0.5903452819024319,\n        \"nauc_precision_at_3_max\": 0.28575847531395104,\n        \"nauc_precision_at_3_std\": -0.0032297965710546225,\n        \"nauc_precision_at_5_diff1\": 0.5826897053901425,\n        \"nauc_precision_at_5_max\": 0.14081401961953136,\n        \"nauc_precision_at_5_std\": -0.3032079255275951,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.5468315567317299,\n        \"nauc_recall_at_10_max\": -0.0663487422995702,\n        \"nauc_recall_at_10_std\": -0.21572501610658368,\n        \"nauc_recall_at_1_diff1\": 0.8173815695220201,\n        \"nauc_recall_at_1_max\": 0.3888661331865086,\n        \"nauc_recall_at_1_std\": 0.182953924038586,\n        \"nauc_recall_at_20_diff1\": 0.5175363752626353,\n        \"nauc_recall_at_20_max\": 0.11665403289856766,\n        \"nauc_recall_at_20_std\": -0.05761828654294978,\n        \"nauc_recall_at_3_diff1\": 0.5903452819024316,\n        \"nauc_recall_at_3_max\": 0.2857584753139499,\n        \"nauc_recall_at_3_std\": -0.0032297965710566382,\n        \"nauc_recall_at_5_diff1\": 0.582689705390142,\n        \"nauc_recall_at_5_max\": 0.14081401961952994,\n        \"nauc_recall_at_5_std\": -0.30320792552759585,\n        \"ndcg_at_1\": 0.58442,\n        \"ndcg_at_10\": 0.74584,\n        \"ndcg_at_100\": 0.76531,\n        \"ndcg_at_1000\": 0.76531,\n        \"ndcg_at_20\": 0.74935,\n        \"ndcg_at_3\": 0.69063,\n        \"ndcg_at_5\": 0.72864,\n        \"precision_at_1\": 0.58442,\n        \"precision_at_10\": 0.09091,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.0461,\n        \"precision_at_3\": 0.25541,\n        \"precision_at_5\": 0.17143,\n        \"recall_at_1\": 0.58442,\n        \"recall_at_10\": 0.90909,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.92208,\n        \"recall_at_3\": 0.76623,\n        \"recall_at_5\": 0.85714\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-multilingual-base/Alibaba-NLP__gte-multilingual-base/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 8.458330631256104,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.30702,\n        \"map_at_1\": 0.16654,\n        \"map_at_10\": 0.26176,\n        \"map_at_100\": 0.27447,\n        \"map_at_1000\": 0.27609,\n        \"map_at_20\": 0.26741,\n        \"map_at_3\": 0.23243,\n        \"map_at_5\": 0.24625,\n        \"mrr_at_1\": 0.23853211009174313,\n        \"mrr_at_10\": 0.2994272122712488,\n        \"mrr_at_100\": 0.3092636327608635,\n        \"mrr_at_1000\": 0.3103838648517695,\n        \"mrr_at_20\": 0.3037993683781453,\n        \"mrr_at_3\": 0.2787971457696229,\n        \"mrr_at_5\": 0.2883537206931702,\n        \"nauc_map_at_1000_diff1\": 0.46037215418732746,\n        \"nauc_map_at_1000_max\": 0.17509641042870955,\n        \"nauc_map_at_1000_std\": -0.17188557832411727,\n        \"nauc_map_at_100_diff1\": 0.46012638860618277,\n        \"nauc_map_at_100_max\": 0.17596415631476192,\n        \"nauc_map_at_100_std\": -0.1706743537347323,\n        \"nauc_map_at_10_diff1\": 0.4638654360953357,\n        \"nauc_map_at_10_max\": 0.16920793650998478,\n        \"nauc_map_at_10_std\": -0.1794379089439455,\n        \"nauc_map_at_1_diff1\": 0.5347896707142972,\n        \"nauc_map_at_1_max\": 0.1415086449494959,\n        \"nauc_map_at_1_std\": -0.15905266073600383,\n        \"nauc_map_at_20_diff1\": 0.46412466330756236,\n        \"nauc_map_at_20_max\": 0.17219377532778699,\n        \"nauc_map_at_20_std\": -0.1770192034055921,\n        \"nauc_map_at_3_diff1\": 0.4636462501096955,\n        \"nauc_map_at_3_max\": 0.16869218091148191,\n        \"nauc_map_at_3_std\": -0.17287896666367372,\n        \"nauc_map_at_5_diff1\": 0.4574507609721948,\n        \"nauc_map_at_5_max\": 0.16880300762739983,\n        \"nauc_map_at_5_std\": -0.17282665641306172,\n        \"nauc_mrr_at_1000_diff1\": 0.47463336275490126,\n        \"nauc_mrr_at_1000_max\": 0.1754406462372458,\n        \"nauc_mrr_at_1000_std\": -0.17836658248225642,\n        \"nauc_mrr_at_100_diff1\": 0.47438486192134394,\n        \"nauc_mrr_at_100_max\": 0.17631789973620762,\n        \"nauc_mrr_at_100_std\": -0.17729650956089177,\n        \"nauc_mrr_at_10_diff1\": 0.4773350221044842,\n        \"nauc_mrr_at_10_max\": 0.169646370077787,\n        \"nauc_mrr_at_10_std\": -0.18538268596385504,\n        \"nauc_mrr_at_1_diff1\": 0.5011382624720796,\n        \"nauc_mrr_at_1_max\": 0.1710328904197035,\n        \"nauc_mrr_at_1_std\": -0.20048698319894603,\n        \"nauc_mrr_at_20_diff1\": 0.476647662919602,\n        \"nauc_mrr_at_20_max\": 0.17387141807320416,\n        \"nauc_mrr_at_20_std\": -0.18091518544942548,\n        \"nauc_mrr_at_3_diff1\": 0.4807309717858008,\n        \"nauc_mrr_at_3_max\": 0.16802519862298554,\n        \"nauc_mrr_at_3_std\": -0.188463319155195,\n        \"nauc_mrr_at_5_diff1\": 0.4757825397621256,\n        \"nauc_mrr_at_5_max\": 0.16830225143196942,\n        \"nauc_mrr_at_5_std\": -0.18397246262737063,\n        \"nauc_ndcg_at_1000_diff1\": 0.4506344245877477,\n        \"nauc_ndcg_at_1000_max\": 0.18690325211360131,\n        \"nauc_ndcg_at_1000_std\": -0.15412837595255235,\n        \"nauc_ndcg_at_100_diff1\": 0.43891772837206106,\n        \"nauc_ndcg_at_100_max\": 0.20632483522841427,\n        \"nauc_ndcg_at_100_std\": -0.12462220190485555,\n        \"nauc_ndcg_at_10_diff1\": 0.4608819675765099,\n        \"nauc_ndcg_at_10_max\": 0.16898512929369572,\n        \"nauc_ndcg_at_10_std\": -0.17887277077473462,\n        \"nauc_ndcg_at_1_diff1\": 0.5011382624720796,\n        \"nauc_ndcg_at_1_max\": 0.1710328904197035,\n        \"nauc_ndcg_at_1_std\": -0.20048698319894603,\n        \"nauc_ndcg_at_20_diff1\": 0.4610263899849392,\n        \"nauc_ndcg_at_20_max\": 0.18148306889631222,\n        \"nauc_ndcg_at_20_std\": -0.1669782987396665,\n        \"nauc_ndcg_at_3_diff1\": 0.4619158776702101,\n        \"nauc_ndcg_at_3_max\": 0.16634419046964202,\n        \"nauc_ndcg_at_3_std\": -0.17793218801362695,\n        \"nauc_ndcg_at_5_diff1\": 0.45333962167423275,\n        \"nauc_ndcg_at_5_max\": 0.16888164823356713,\n        \"nauc_ndcg_at_5_std\": -0.16992609978088177,\n        \"nauc_precision_at_1000_diff1\": -0.03034936062924852,\n        \"nauc_precision_at_1000_max\": 0.0970387619515828,\n        \"nauc_precision_at_1000_std\": 0.007738454229137765,\n        \"nauc_precision_at_100_diff1\": 0.09814930477773491,\n        \"nauc_precision_at_100_max\": 0.21804049604114545,\n        \"nauc_precision_at_100_std\": 0.05638855924167594,\n        \"nauc_precision_at_10_diff1\": 0.3097693795188088,\n        \"nauc_precision_at_10_max\": 0.15471913586482394,\n        \"nauc_precision_at_10_std\": -0.18007184914104188,\n        \"nauc_precision_at_1_diff1\": 0.5011382624720796,\n        \"nauc_precision_at_1_max\": 0.1710328904197035,\n        \"nauc_precision_at_1_std\": -0.20048698319894603,\n        \"nauc_precision_at_20_diff1\": 0.29084470955788,\n        \"nauc_precision_at_20_max\": 0.17499612606897091,\n        \"nauc_precision_at_20_std\": -0.14158176879585316,\n        \"nauc_precision_at_3_diff1\": 0.3367612336349229,\n        \"nauc_precision_at_3_max\": 0.17714261527312772,\n        \"nauc_precision_at_3_std\": -0.19270047922441152,\n        \"nauc_precision_at_5_diff1\": 0.30820104113069113,\n        \"nauc_precision_at_5_max\": 0.164027258650643,\n        \"nauc_precision_at_5_std\": -0.17750788382137142,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.3042749854292903,\n        \"nauc_recall_at_100_max\": 0.34308274479573453,\n        \"nauc_recall_at_100_std\": 0.12212368148463992,\n        \"nauc_recall_at_10_diff1\": 0.42578302543364643,\n        \"nauc_recall_at_10_max\": 0.15927311372949235,\n        \"nauc_recall_at_10_std\": -0.16790350265095189,\n        \"nauc_recall_at_1_diff1\": 0.5347896707142972,\n        \"nauc_recall_at_1_max\": 0.1415086449494959,\n        \"nauc_recall_at_1_std\": -0.15905266073600383,\n        \"nauc_recall_at_20_diff1\": 0.4267970206817293,\n        \"nauc_recall_at_20_max\": 0.20118521431192207,\n        \"nauc_recall_at_20_std\": -0.12773593944421877,\n        \"nauc_recall_at_3_diff1\": 0.42538434941403624,\n        \"nauc_recall_at_3_max\": 0.16120603935905187,\n        \"nauc_recall_at_3_std\": -0.15232329094239325,\n        \"nauc_recall_at_5_diff1\": 0.41206673640909786,\n        \"nauc_recall_at_5_max\": 0.16241875942413933,\n        \"nauc_recall_at_5_std\": -0.1459331777008506,\n        \"ndcg_at_1\": 0.23853,\n        \"ndcg_at_10\": 0.30702,\n        \"ndcg_at_100\": 0.37301,\n        \"ndcg_at_1000\": 0.41317,\n        \"ndcg_at_20\": 0.32484,\n        \"ndcg_at_3\": 0.25869,\n        \"ndcg_at_5\": 0.27568,\n        \"precision_at_1\": 0.23853,\n        \"precision_at_10\": 0.0656,\n        \"precision_at_100\": 0.01139,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.03754,\n        \"precision_at_3\": 0.14526,\n        \"precision_at_5\": 0.10336,\n        \"recall_at_1\": 0.16654,\n        \"recall_at_10\": 0.40405,\n        \"recall_at_100\": 0.70308,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.46774,\n        \"recall_at_3\": 0.27859,\n        \"recall_at_5\": 0.31873\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.31767,\n        \"map_at_1\": 0.15966,\n        \"map_at_10\": 0.26847,\n        \"map_at_100\": 0.28679,\n        \"map_at_1000\": 0.28872,\n        \"map_at_20\": 0.2779,\n        \"map_at_3\": 0.23239,\n        \"map_at_5\": 0.25223,\n        \"mrr_at_1\": 0.28287461773700306,\n        \"mrr_at_10\": 0.3392656909858745,\n        \"mrr_at_100\": 0.35278022303264084,\n        \"mrr_at_1000\": 0.353609282078622,\n        \"mrr_at_20\": 0.34644945831570667,\n        \"mrr_at_3\": 0.3216106014271154,\n        \"mrr_at_5\": 0.33086136595310917,\n        \"nauc_map_at_1000_diff1\": 0.43014345069572735,\n        \"nauc_map_at_1000_max\": 0.2047702252588999,\n        \"nauc_map_at_1000_std\": -0.18619729753828168,\n        \"nauc_map_at_100_diff1\": 0.43044481164149107,\n        \"nauc_map_at_100_max\": 0.20366438026852898,\n        \"nauc_map_at_100_std\": -0.1872260820118899,\n        \"nauc_map_at_10_diff1\": 0.4358332518843372,\n        \"nauc_map_at_10_max\": 0.20302947817138878,\n        \"nauc_map_at_10_std\": -0.19235050148342497,\n        \"nauc_map_at_1_diff1\": 0.5094094888816958,\n        \"nauc_map_at_1_max\": 0.2022136942837982,\n        \"nauc_map_at_1_std\": -0.16629879431908526,\n        \"nauc_map_at_20_diff1\": 0.43203029390503284,\n        \"nauc_map_at_20_max\": 0.20281589336854433,\n        \"nauc_map_at_20_std\": -0.18975715654086692,\n        \"nauc_map_at_3_diff1\": 0.45683769382324835,\n        \"nauc_map_at_3_max\": 0.2114974049562774,\n        \"nauc_map_at_3_std\": -0.18973643431599205,\n        \"nauc_map_at_5_diff1\": 0.44408303291369394,\n        \"nauc_map_at_5_max\": 0.20755508120960656,\n        \"nauc_map_at_5_std\": -0.1907358768225807,\n        \"nauc_mrr_at_1000_diff1\": 0.39456178133655373,\n        \"nauc_mrr_at_1000_max\": 0.16875177053249982,\n        \"nauc_mrr_at_1000_std\": -0.18293062246227396,\n        \"nauc_mrr_at_100_diff1\": 0.39441163476792995,\n        \"nauc_mrr_at_100_max\": 0.16897730217108786,\n        \"nauc_mrr_at_100_std\": -0.18246884202006136,\n        \"nauc_mrr_at_10_diff1\": 0.3972495519440698,\n        \"nauc_mrr_at_10_max\": 0.16447577013697356,\n        \"nauc_mrr_at_10_std\": -0.18918425257815177,\n        \"nauc_mrr_at_1_diff1\": 0.43078365226721643,\n        \"nauc_mrr_at_1_max\": 0.1702882626404106,\n        \"nauc_mrr_at_1_std\": -0.19022047922326274,\n        \"nauc_mrr_at_20_diff1\": 0.39416443882324576,\n        \"nauc_mrr_at_20_max\": 0.16767463626082799,\n        \"nauc_mrr_at_20_std\": -0.18362884131701146,\n        \"nauc_mrr_at_3_diff1\": 0.4052476466508942,\n        \"nauc_mrr_at_3_max\": 0.1702917598959025,\n        \"nauc_mrr_at_3_std\": -0.18516509262458347,\n        \"nauc_mrr_at_5_diff1\": 0.39963181278379417,\n        \"nauc_mrr_at_5_max\": 0.16467520855433232,\n        \"nauc_mrr_at_5_std\": -0.1915264977988557,\n        \"nauc_ndcg_at_1000_diff1\": 0.3972885201945313,\n        \"nauc_ndcg_at_1000_max\": 0.20065085824709233,\n        \"nauc_ndcg_at_1000_std\": -0.16600079150324779,\n        \"nauc_ndcg_at_100_diff1\": 0.3963014283716522,\n        \"nauc_ndcg_at_100_max\": 0.2045151315369148,\n        \"nauc_ndcg_at_100_std\": -0.1558031913999578,\n        \"nauc_ndcg_at_10_diff1\": 0.4089925178791608,\n        \"nauc_ndcg_at_10_max\": 0.18660983146430193,\n        \"nauc_ndcg_at_10_std\": -0.19358731965441847,\n        \"nauc_ndcg_at_1_diff1\": 0.43078365226721643,\n        \"nauc_ndcg_at_1_max\": 0.1702882626404106,\n        \"nauc_ndcg_at_1_std\": -0.19022047922326274,\n        \"nauc_ndcg_at_20_diff1\": 0.3960518079661171,\n        \"nauc_ndcg_at_20_max\": 0.19130027169181624,\n        \"nauc_ndcg_at_20_std\": -0.18014939464801458,\n        \"nauc_ndcg_at_3_diff1\": 0.422294467926566,\n        \"nauc_ndcg_at_3_max\": 0.19472976699280825,\n        \"nauc_ndcg_at_3_std\": -0.19475941988238804,\n        \"nauc_ndcg_at_5_diff1\": 0.42150046271189157,\n        \"nauc_ndcg_at_5_max\": 0.19273669097369414,\n        \"nauc_ndcg_at_5_std\": -0.19416658235162243,\n        \"nauc_precision_at_1000_diff1\": -0.08592574039060139,\n        \"nauc_precision_at_1000_max\": 0.03273543588118617,\n        \"nauc_precision_at_1000_std\": 0.034027378427526046,\n        \"nauc_precision_at_100_diff1\": 0.04597533172148491,\n        \"nauc_precision_at_100_max\": 0.10853805071890375,\n        \"nauc_precision_at_100_std\": 0.016852971188687477,\n        \"nauc_precision_at_10_diff1\": 0.20270424761964256,\n        \"nauc_precision_at_10_max\": 0.11219194377794384,\n        \"nauc_precision_at_10_std\": -0.15977413044551775,\n        \"nauc_precision_at_1_diff1\": 0.43078365226721643,\n        \"nauc_precision_at_1_max\": 0.1702882626404106,\n        \"nauc_precision_at_1_std\": -0.19022047922326274,\n        \"nauc_precision_at_20_diff1\": 0.1571047263945439,\n        \"nauc_precision_at_20_max\": 0.10847376906241053,\n        \"nauc_precision_at_20_std\": -0.1221847777154949,\n        \"nauc_precision_at_3_diff1\": 0.28366520674490603,\n        \"nauc_precision_at_3_max\": 0.15377715751169105,\n        \"nauc_precision_at_3_std\": -0.18440380852826943,\n        \"nauc_precision_at_5_diff1\": 0.2419626741051632,\n        \"nauc_precision_at_5_max\": 0.13773446176999182,\n        \"nauc_precision_at_5_std\": -0.1731204992204692,\n        \"nauc_recall_at_1000_diff1\": 0.3794834485562372,\n        \"nauc_recall_at_1000_max\": 0.85774024244626,\n        \"nauc_recall_at_1000_std\": 0.8178081164635485,\n        \"nauc_recall_at_100_diff1\": 0.29569892516149393,\n        \"nauc_recall_at_100_max\": 0.26057031713542306,\n        \"nauc_recall_at_100_std\": 0.028329931041429883,\n        \"nauc_recall_at_10_diff1\": 0.348625448128896,\n        \"nauc_recall_at_10_max\": 0.1643013408968958,\n        \"nauc_recall_at_10_std\": -0.1839318165372178,\n        \"nauc_recall_at_1_diff1\": 0.5094094888816958,\n        \"nauc_recall_at_1_max\": 0.2022136942837982,\n        \"nauc_recall_at_1_std\": -0.16629879431908526,\n        \"nauc_recall_at_20_diff1\": 0.30229226859696084,\n        \"nauc_recall_at_20_max\": 0.18109751827851614,\n        \"nauc_recall_at_20_std\": -0.13702112357432608,\n        \"nauc_recall_at_3_diff1\": 0.4025757277241289,\n        \"nauc_recall_at_3_max\": 0.19605999728416043,\n        \"nauc_recall_at_3_std\": -0.17775588225430455,\n        \"nauc_recall_at_5_diff1\": 0.37889647475908744,\n        \"nauc_recall_at_5_max\": 0.1769513092530404,\n        \"nauc_recall_at_5_std\": -0.189916223373261,\n        \"ndcg_at_1\": 0.28287,\n        \"ndcg_at_10\": 0.31767,\n        \"ndcg_at_100\": 0.40373,\n        \"ndcg_at_1000\": 0.43976,\n        \"ndcg_at_20\": 0.34737,\n        \"ndcg_at_3\": 0.27816,\n        \"ndcg_at_5\": 0.2897,\n        \"precision_at_1\": 0.28287,\n        \"precision_at_10\": 0.08073,\n        \"precision_at_100\": 0.01489,\n        \"precision_at_1000\": 0.00194,\n        \"precision_at_20\": 0.05008,\n        \"precision_at_3\": 0.18094,\n        \"precision_at_5\": 0.1315,\n        \"recall_at_1\": 0.15966,\n        \"recall_at_10\": 0.39006,\n        \"recall_at_100\": 0.75754,\n        \"recall_at_1000\": 0.99791,\n        \"recall_at_20\": 0.48981,\n        \"recall_at_3\": 0.26937,\n        \"recall_at_5\": 0.31955\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.29414,\n        \"map_at_1\": 0.16169,\n        \"map_at_10\": 0.2529,\n        \"map_at_100\": 0.26952,\n        \"map_at_1000\": 0.27127,\n        \"map_at_20\": 0.26193,\n        \"map_at_3\": 0.22819,\n        \"map_at_5\": 0.24023,\n        \"mrr_at_1\": 0.23289902280130292,\n        \"mrr_at_10\": 0.2953647691432707,\n        \"mrr_at_100\": 0.3071666675264507,\n        \"mrr_at_1000\": 0.30820981319186874,\n        \"mrr_at_20\": 0.302379485948379,\n        \"mrr_at_3\": 0.27904451682953313,\n        \"mrr_at_5\": 0.286699239956569,\n        \"nauc_map_at_1000_diff1\": 0.402343188167998,\n        \"nauc_map_at_1000_max\": 0.1299753545662161,\n        \"nauc_map_at_1000_std\": -0.19019062841266368,\n        \"nauc_map_at_100_diff1\": 0.4014383333829576,\n        \"nauc_map_at_100_max\": 0.13032050794516703,\n        \"nauc_map_at_100_std\": -0.18960081163590695,\n        \"nauc_map_at_10_diff1\": 0.4094501157108844,\n        \"nauc_map_at_10_max\": 0.12651540749352239,\n        \"nauc_map_at_10_std\": -0.19866000806898948,\n        \"nauc_map_at_1_diff1\": 0.49998577979517983,\n        \"nauc_map_at_1_max\": 0.13000935252442475,\n        \"nauc_map_at_1_std\": -0.15265135985215136,\n        \"nauc_map_at_20_diff1\": 0.4042994016481559,\n        \"nauc_map_at_20_max\": 0.12718616483049597,\n        \"nauc_map_at_20_std\": -0.1940792732991164,\n        \"nauc_map_at_3_diff1\": 0.41724986246003115,\n        \"nauc_map_at_3_max\": 0.12281456025945924,\n        \"nauc_map_at_3_std\": -0.18824030125445101,\n        \"nauc_map_at_5_diff1\": 0.41152774793705993,\n        \"nauc_map_at_5_max\": 0.11919557019524485,\n        \"nauc_map_at_5_std\": -0.19524997617072462,\n        \"nauc_mrr_at_1000_diff1\": 0.4307038972832546,\n        \"nauc_mrr_at_1000_max\": 0.13352079024017607,\n        \"nauc_mrr_at_1000_std\": -0.184049039415171,\n        \"nauc_mrr_at_100_diff1\": 0.43026716054026354,\n        \"nauc_mrr_at_100_max\": 0.13406610028872684,\n        \"nauc_mrr_at_100_std\": -0.18348794449823466,\n        \"nauc_mrr_at_10_diff1\": 0.43488458644787525,\n        \"nauc_mrr_at_10_max\": 0.12881780828582814,\n        \"nauc_mrr_at_10_std\": -0.19015371067992137,\n        \"nauc_mrr_at_1_diff1\": 0.48468119540124965,\n        \"nauc_mrr_at_1_max\": 0.15042533595554772,\n        \"nauc_mrr_at_1_std\": -0.18437012032221006,\n        \"nauc_mrr_at_20_diff1\": 0.4314267128535979,\n        \"nauc_mrr_at_20_max\": 0.13322245076423717,\n        \"nauc_mrr_at_20_std\": -0.18459294813723132,\n        \"nauc_mrr_at_3_diff1\": 0.43897967255324455,\n        \"nauc_mrr_at_3_max\": 0.1254625553396092,\n        \"nauc_mrr_at_3_std\": -0.19092380547574533,\n        \"nauc_mrr_at_5_diff1\": 0.43502145833562217,\n        \"nauc_mrr_at_5_max\": 0.12200585923704393,\n        \"nauc_mrr_at_5_std\": -0.19294483424478642,\n        \"nauc_ndcg_at_1000_diff1\": 0.3880667336937146,\n        \"nauc_ndcg_at_1000_max\": 0.14092945160808437,\n        \"nauc_ndcg_at_1000_std\": -0.17436592159846515,\n        \"nauc_ndcg_at_100_diff1\": 0.366324948159121,\n        \"nauc_ndcg_at_100_max\": 0.15152727703516525,\n        \"nauc_ndcg_at_100_std\": -0.15744481087079681,\n        \"nauc_ndcg_at_10_diff1\": 0.39720572550680455,\n        \"nauc_ndcg_at_10_max\": 0.12608780384446125,\n        \"nauc_ndcg_at_10_std\": -0.20161383875574887,\n        \"nauc_ndcg_at_1_diff1\": 0.48468119540124965,\n        \"nauc_ndcg_at_1_max\": 0.15042533595554772,\n        \"nauc_ndcg_at_1_std\": -0.18437012032221006,\n        \"nauc_ndcg_at_20_diff1\": 0.38198989790320925,\n        \"nauc_ndcg_at_20_max\": 0.1309411335322321,\n        \"nauc_ndcg_at_20_std\": -0.1851352452028806,\n        \"nauc_ndcg_at_3_diff1\": 0.4051695223146839,\n        \"nauc_ndcg_at_3_max\": 0.11944364435132239,\n        \"nauc_ndcg_at_3_std\": -0.19126849095602919,\n        \"nauc_ndcg_at_5_diff1\": 0.39947912250237116,\n        \"nauc_ndcg_at_5_max\": 0.10992273316880617,\n        \"nauc_ndcg_at_5_std\": -0.20016531175412253,\n        \"nauc_precision_at_1000_diff1\": -0.01258523599785369,\n        \"nauc_precision_at_1000_max\": 0.13899813834379615,\n        \"nauc_precision_at_1000_std\": 0.04000898712738393,\n        \"nauc_precision_at_100_diff1\": 0.04345755772775644,\n        \"nauc_precision_at_100_max\": 0.19226963732967228,\n        \"nauc_precision_at_100_std\": 0.026170385214899197,\n        \"nauc_precision_at_10_diff1\": 0.2369754676384766,\n        \"nauc_precision_at_10_max\": 0.11842985597589158,\n        \"nauc_precision_at_10_std\": -0.20115083032042783,\n        \"nauc_precision_at_1_diff1\": 0.48468119540124965,\n        \"nauc_precision_at_1_max\": 0.15042533595554772,\n        \"nauc_precision_at_1_std\": -0.18437012032221006,\n        \"nauc_precision_at_20_diff1\": 0.1709476117260024,\n        \"nauc_precision_at_20_max\": 0.12064257063411347,\n        \"nauc_precision_at_20_std\": -0.1401821039917873,\n        \"nauc_precision_at_3_diff1\": 0.291841490033633,\n        \"nauc_precision_at_3_max\": 0.11466029738009711,\n        \"nauc_precision_at_3_std\": -0.20702151399249047,\n        \"nauc_precision_at_5_diff1\": 0.26375878245224577,\n        \"nauc_precision_at_5_max\": 0.09186387677675449,\n        \"nauc_precision_at_5_std\": -0.21344184500612426,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.17567011906387164,\n        \"nauc_recall_at_100_max\": 0.22326397283006172,\n        \"nauc_recall_at_100_std\": -0.012573773594995362,\n        \"nauc_recall_at_10_diff1\": 0.3302339778122505,\n        \"nauc_recall_at_10_max\": 0.11908567442911973,\n        \"nauc_recall_at_10_std\": -0.20567345005177817,\n        \"nauc_recall_at_1_diff1\": 0.49998577979517983,\n        \"nauc_recall_at_1_max\": 0.13000935252442475,\n        \"nauc_recall_at_1_std\": -0.15265135985215136,\n        \"nauc_recall_at_20_diff1\": 0.2808225129566676,\n        \"nauc_recall_at_20_max\": 0.1309001978764897,\n        \"nauc_recall_at_20_std\": -0.15195365980849182,\n        \"nauc_recall_at_3_diff1\": 0.3532291466642572,\n        \"nauc_recall_at_3_max\": 0.09429804779858321,\n        \"nauc_recall_at_3_std\": -0.18793468626423918,\n        \"nauc_recall_at_5_diff1\": 0.3371090964412974,\n        \"nauc_recall_at_5_max\": 0.07987294522395673,\n        \"nauc_recall_at_5_std\": -0.2053014135072843,\n        \"ndcg_at_1\": 0.2329,\n        \"ndcg_at_10\": 0.29414,\n        \"ndcg_at_100\": 0.36767,\n        \"ndcg_at_1000\": 0.41069,\n        \"ndcg_at_20\": 0.32188,\n        \"ndcg_at_3\": 0.25664,\n        \"ndcg_at_5\": 0.26976,\n        \"precision_at_1\": 0.2329,\n        \"precision_at_10\": 0.06352,\n        \"precision_at_100\": 0.01197,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.04055,\n        \"precision_at_3\": 0.14767,\n        \"precision_at_5\": 0.10293,\n        \"recall_at_1\": 0.16169,\n        \"recall_at_10\": 0.37021,\n        \"recall_at_100\": 0.68048,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.46359,\n        \"recall_at_3\": 0.2719,\n        \"recall_at_5\": 0.30482\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/Alibaba-NLP/gte-multilingual-base/Alibaba-NLP__gte-multilingual-base/no_revision_available/model_meta.json",
    "content": "{\"name\": \"Alibaba-NLP/gte-multilingual-base\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": [], \"n_parameters\": null, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": null, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"Sentence Transformers\"], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"zero_shot_benchmarks\": null, \"loader\": null}"
  },
  {
    "path": "eval/results/BAAI/bge-m3/BAAI__bge-m3/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 50.766931772232056,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.83008,\n        \"map_at_1\": 0.67544,\n        \"map_at_10\": 0.78346,\n        \"map_at_100\": 0.78514,\n        \"map_at_1000\": 0.78514,\n        \"map_at_20\": 0.78514,\n        \"map_at_3\": 0.76316,\n        \"map_at_5\": 0.77807,\n        \"mrr_at_1\": 0.6754385964912281,\n        \"mrr_at_10\": 0.7834551656920076,\n        \"mrr_at_100\": 0.7851364522417152,\n        \"mrr_at_1000\": 0.7851364522417152,\n        \"mrr_at_20\": 0.7851364522417152,\n        \"mrr_at_3\": 0.763157894736842,\n        \"mrr_at_5\": 0.7780701754385964,\n        \"nauc_map_at_1000_diff1\": 0.7480913240467126,\n        \"nauc_map_at_1000_max\": 0.40994529514037564,\n        \"nauc_map_at_1000_std\": -0.4041235885308545,\n        \"nauc_map_at_100_diff1\": 0.7480913240467126,\n        \"nauc_map_at_100_max\": 0.40994529514037564,\n        \"nauc_map_at_100_std\": -0.4041235885308545,\n        \"nauc_map_at_10_diff1\": 0.7480655535449382,\n        \"nauc_map_at_10_max\": 0.4118513196432917,\n        \"nauc_map_at_10_std\": -0.4096886794877292,\n        \"nauc_map_at_1_diff1\": 0.7458196841797787,\n        \"nauc_map_at_1_max\": 0.336170140077049,\n        \"nauc_map_at_1_std\": -0.414109409881053,\n        \"nauc_map_at_20_diff1\": 0.7480913240467126,\n        \"nauc_map_at_20_max\": 0.40994529514037564,\n        \"nauc_map_at_20_std\": -0.4041235885308545,\n        \"nauc_map_at_3_diff1\": 0.7539865940326704,\n        \"nauc_map_at_3_max\": 0.43539749968062214,\n        \"nauc_map_at_3_std\": -0.37847225265122253,\n        \"nauc_map_at_5_diff1\": 0.7459089722049166,\n        \"nauc_map_at_5_max\": 0.4228032046558571,\n        \"nauc_map_at_5_std\": -0.39011603199971223,\n        \"nauc_mrr_at_1000_diff1\": 0.7480913240467126,\n        \"nauc_mrr_at_1000_max\": 0.40994529514037564,\n        \"nauc_mrr_at_1000_std\": -0.4041235885308545,\n        \"nauc_mrr_at_100_diff1\": 0.7480913240467126,\n        \"nauc_mrr_at_100_max\": 0.40994529514037564,\n        \"nauc_mrr_at_100_std\": -0.4041235885308545,\n        \"nauc_mrr_at_10_diff1\": 0.7480655535449382,\n        \"nauc_mrr_at_10_max\": 0.4118513196432917,\n        \"nauc_mrr_at_10_std\": -0.4096886794877292,\n        \"nauc_mrr_at_1_diff1\": 0.7458196841797787,\n        \"nauc_mrr_at_1_max\": 0.336170140077049,\n        \"nauc_mrr_at_1_std\": -0.414109409881053,\n        \"nauc_mrr_at_20_diff1\": 0.7480913240467126,\n        \"nauc_mrr_at_20_max\": 0.40994529514037564,\n        \"nauc_mrr_at_20_std\": -0.4041235885308545,\n        \"nauc_mrr_at_3_diff1\": 0.7539865940326704,\n        \"nauc_mrr_at_3_max\": 0.43539749968062214,\n        \"nauc_mrr_at_3_std\": -0.37847225265122253,\n        \"nauc_mrr_at_5_diff1\": 0.7459089722049166,\n        \"nauc_mrr_at_5_max\": 0.4228032046558571,\n        \"nauc_mrr_at_5_std\": -0.39011603199971223,\n        \"nauc_ndcg_at_1000_diff1\": 0.7479959191104514,\n        \"nauc_ndcg_at_1000_max\": 0.4183290864437548,\n        \"nauc_ndcg_at_1000_std\": -0.40438403097706516,\n        \"nauc_ndcg_at_100_diff1\": 0.7479959191104514,\n        \"nauc_ndcg_at_100_max\": 0.4183290864437548,\n        \"nauc_ndcg_at_100_std\": -0.40438403097706516,\n        \"nauc_ndcg_at_10_diff1\": 0.7477939461929645,\n        \"nauc_ndcg_at_10_max\": 0.427014191152891,\n        \"nauc_ndcg_at_10_std\": -0.43143047149879826,\n        \"nauc_ndcg_at_1_diff1\": 0.7458196841797787,\n        \"nauc_ndcg_at_1_max\": 0.336170140077049,\n        \"nauc_ndcg_at_1_std\": -0.414109409881053,\n        \"nauc_ndcg_at_20_diff1\": 0.7479959191104514,\n        \"nauc_ndcg_at_20_max\": 0.4183290864437548,\n        \"nauc_ndcg_at_20_std\": -0.40438403097706516,\n        \"nauc_ndcg_at_3_diff1\": 0.7579191887220348,\n        \"nauc_ndcg_at_3_max\": 0.48018090636879757,\n        \"nauc_ndcg_at_3_std\": -0.35255980074276044,\n        \"nauc_ndcg_at_5_diff1\": 0.7420060164656852,\n        \"nauc_ndcg_at_5_max\": 0.46033083419612225,\n        \"nauc_ndcg_at_5_std\": -0.3737451683555684,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.7424388206277509,\n        \"nauc_precision_at_10_max\": 0.6148801048337371,\n        \"nauc_precision_at_10_std\": -1.0242575880069984,\n        \"nauc_precision_at_1_diff1\": 0.7458196841797787,\n        \"nauc_precision_at_1_max\": 0.336170140077049,\n        \"nauc_precision_at_1_std\": -0.414109409881053,\n        \"nauc_precision_at_20_diff1\": 1.0,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 1.0,\n        \"nauc_precision_at_3_diff1\": 0.7765098273273427,\n        \"nauc_precision_at_3_max\": 0.690557013561025,\n        \"nauc_precision_at_3_std\": -0.22618135533655087,\n        \"nauc_precision_at_5_diff1\": 0.7064297107719757,\n        \"nauc_precision_at_5_max\": 0.7510957493307909,\n        \"nauc_precision_at_5_std\": -0.24381180954894718,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.7424388206277525,\n        \"nauc_recall_at_10_max\": 0.6148801048337426,\n        \"nauc_recall_at_10_std\": -1.024257588006983,\n        \"nauc_recall_at_1_diff1\": 0.7458196841797787,\n        \"nauc_recall_at_1_max\": 0.336170140077049,\n        \"nauc_recall_at_1_std\": -0.414109409881053,\n        \"nauc_recall_at_20_diff1\": NaN,\n        \"nauc_recall_at_20_max\": NaN,\n        \"nauc_recall_at_20_std\": NaN,\n        \"nauc_recall_at_3_diff1\": 0.7765098273273437,\n        \"nauc_recall_at_3_max\": 0.6905570135610254,\n        \"nauc_recall_at_3_std\": -0.22618135533654984,\n        \"nauc_recall_at_5_diff1\": 0.7064297107719775,\n        \"nauc_recall_at_5_max\": 0.7510957493307917,\n        \"nauc_recall_at_5_std\": -0.24381180954894452,\n        \"ndcg_at_1\": 0.67544,\n        \"ndcg_at_10\": 0.83008,\n        \"ndcg_at_100\": 0.83656,\n        \"ndcg_at_1000\": 0.83656,\n        \"ndcg_at_20\": 0.83656,\n        \"ndcg_at_3\": 0.79031,\n        \"ndcg_at_5\": 0.81637,\n        \"precision_at_1\": 0.67544,\n        \"precision_at_10\": 0.09737,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.05,\n        \"precision_at_3\": 0.28947,\n        \"precision_at_5\": 0.18596,\n        \"recall_at_1\": 0.67544,\n        \"recall_at_10\": 0.97368,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 1.0,\n        \"recall_at_3\": 0.86842,\n        \"recall_at_5\": 0.92982\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-m3/BAAI__bge-m3/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 42.1163535118103,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.93164,\n        \"map_at_1\": 0.87889,\n        \"map_at_10\": 0.91594,\n        \"map_at_100\": 0.91652,\n        \"map_at_1000\": 0.91656,\n        \"map_at_20\": 0.91631,\n        \"map_at_3\": 0.90944,\n        \"map_at_5\": 0.91344,\n        \"mrr_at_1\": 0.8788888888888889,\n        \"mrr_at_10\": 0.915938712522046,\n        \"mrr_at_100\": 0.9165196696089475,\n        \"mrr_at_1000\": 0.9165613420972883,\n        \"mrr_at_20\": 0.9163125423958758,\n        \"mrr_at_3\": 0.9094444444444446,\n        \"mrr_at_5\": 0.9134444444444446,\n        \"nauc_map_at_1000_diff1\": 0.9144018424312078,\n        \"nauc_map_at_1000_max\": 0.7625594223308878,\n        \"nauc_map_at_1000_std\": 0.08078533832109351,\n        \"nauc_map_at_100_diff1\": 0.9144325380134781,\n        \"nauc_map_at_100_max\": 0.7626093328877492,\n        \"nauc_map_at_100_std\": 0.08115864225106753,\n        \"nauc_map_at_10_diff1\": 0.9143139179478519,\n        \"nauc_map_at_10_max\": 0.763197065026625,\n        \"nauc_map_at_10_std\": 0.08254448049332629,\n        \"nauc_map_at_1_diff1\": 0.9182364852426823,\n        \"nauc_map_at_1_max\": 0.7360338011378074,\n        \"nauc_map_at_1_std\": 0.055233653871440136,\n        \"nauc_map_at_20_diff1\": 0.9145308131541325,\n        \"nauc_map_at_20_max\": 0.7627389376229389,\n        \"nauc_map_at_20_std\": 0.0799713735263409,\n        \"nauc_map_at_3_diff1\": 0.9131876782636175,\n        \"nauc_map_at_3_max\": 0.7698593668502859,\n        \"nauc_map_at_3_std\": 0.08250297146424689,\n        \"nauc_map_at_5_diff1\": 0.9140255060135355,\n        \"nauc_map_at_5_max\": 0.7658910154050281,\n        \"nauc_map_at_5_std\": 0.08177793016479339,\n        \"nauc_mrr_at_1000_diff1\": 0.9144018424312078,\n        \"nauc_mrr_at_1000_max\": 0.7625594223308878,\n        \"nauc_mrr_at_1000_std\": 0.08078533832109351,\n        \"nauc_mrr_at_100_diff1\": 0.9144325380134781,\n        \"nauc_mrr_at_100_max\": 0.7626093328877492,\n        \"nauc_mrr_at_100_std\": 0.08115864225106753,\n        \"nauc_mrr_at_10_diff1\": 0.9143139179478519,\n        \"nauc_mrr_at_10_max\": 0.763197065026625,\n        \"nauc_mrr_at_10_std\": 0.08254448049332629,\n        \"nauc_mrr_at_1_diff1\": 0.9182364852426823,\n        \"nauc_mrr_at_1_max\": 0.7360338011378074,\n        \"nauc_mrr_at_1_std\": 0.055233653871440136,\n        \"nauc_mrr_at_20_diff1\": 0.9145308131541325,\n        \"nauc_mrr_at_20_max\": 0.7627389376229389,\n        \"nauc_mrr_at_20_std\": 0.0799713735263409,\n        \"nauc_mrr_at_3_diff1\": 0.9131876782636175,\n        \"nauc_mrr_at_3_max\": 0.7698593668502859,\n        \"nauc_mrr_at_3_std\": 0.08250297146424689,\n        \"nauc_mrr_at_5_diff1\": 0.9140255060135355,\n        \"nauc_mrr_at_5_max\": 0.7658910154050281,\n        \"nauc_mrr_at_5_std\": 0.08177793016479339,\n        \"nauc_ndcg_at_1000_diff1\": 0.9145982546159986,\n        \"nauc_ndcg_at_1000_max\": 0.7658476741472501,\n        \"nauc_ndcg_at_1000_std\": 0.08783028480120193,\n        \"nauc_ndcg_at_100_diff1\": 0.9152384365333261,\n        \"nauc_ndcg_at_100_max\": 0.7672413292997466,\n        \"nauc_ndcg_at_100_std\": 0.09739655293777892,\n        \"nauc_ndcg_at_10_diff1\": 0.914857655889842,\n        \"nauc_ndcg_at_10_max\": 0.769537674473529,\n        \"nauc_ndcg_at_10_std\": 0.09838891524632452,\n        \"nauc_ndcg_at_1_diff1\": 0.9182364852426823,\n        \"nauc_ndcg_at_1_max\": 0.7360338011378074,\n        \"nauc_ndcg_at_1_std\": 0.055233653871440136,\n        \"nauc_ndcg_at_20_diff1\": 0.91593068556539,\n        \"nauc_ndcg_at_20_max\": 0.7676635353081863,\n        \"nauc_ndcg_at_20_std\": 0.08682263886524719,\n        \"nauc_ndcg_at_3_diff1\": 0.9121176059457036,\n        \"nauc_ndcg_at_3_max\": 0.7833482042650488,\n        \"nauc_ndcg_at_3_std\": 0.09610521311242015,\n        \"nauc_ndcg_at_5_diff1\": 0.9141395218023763,\n        \"nauc_ndcg_at_5_max\": 0.7764607899687949,\n        \"nauc_ndcg_at_5_std\": 0.09570954287447543,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9564270152505334,\n        \"nauc_precision_at_100_max\": 0.8665577342047719,\n        \"nauc_precision_at_100_std\": 0.7584811702458871,\n        \"nauc_precision_at_10_diff1\": 0.9255628177196747,\n        \"nauc_precision_at_10_max\": 0.8285610540512508,\n        \"nauc_precision_at_10_std\": 0.2889563232700455,\n        \"nauc_precision_at_1_diff1\": 0.9182364852426823,\n        \"nauc_precision_at_1_max\": 0.7360338011378074,\n        \"nauc_precision_at_1_std\": 0.055233653871440136,\n        \"nauc_precision_at_20_diff1\": 0.949723479135242,\n        \"nauc_precision_at_20_max\": 0.8182862888745052,\n        \"nauc_precision_at_20_std\": 0.1519428284134084,\n        \"nauc_precision_at_3_diff1\": 0.9077497665732935,\n        \"nauc_precision_at_3_max\": 0.8447338935574222,\n        \"nauc_precision_at_3_std\": 0.15945845004668682,\n        \"nauc_precision_at_5_diff1\": 0.9168589004229141,\n        \"nauc_precision_at_5_max\": 0.8416817707475116,\n        \"nauc_precision_at_5_std\": 0.18645301257757552,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9564270152505339,\n        \"nauc_recall_at_100_max\": 0.8665577342047819,\n        \"nauc_recall_at_100_std\": 0.7584811702458742,\n        \"nauc_recall_at_10_diff1\": 0.9255628177196826,\n        \"nauc_recall_at_10_max\": 0.8285610540512551,\n        \"nauc_recall_at_10_std\": 0.2889563232700448,\n        \"nauc_recall_at_1_diff1\": 0.9182364852426823,\n        \"nauc_recall_at_1_max\": 0.7360338011378074,\n        \"nauc_recall_at_1_std\": 0.055233653871440136,\n        \"nauc_recall_at_20_diff1\": 0.9497234791352488,\n        \"nauc_recall_at_20_max\": 0.8182862888745368,\n        \"nauc_recall_at_20_std\": 0.15194282841342197,\n        \"nauc_recall_at_3_diff1\": 0.907749766573295,\n        \"nauc_recall_at_3_max\": 0.8447338935574227,\n        \"nauc_recall_at_3_std\": 0.15945845004668527,\n        \"nauc_recall_at_5_diff1\": 0.9168589004229126,\n        \"nauc_recall_at_5_max\": 0.8416817707475147,\n        \"nauc_recall_at_5_std\": 0.18645301257758004,\n        \"ndcg_at_1\": 0.87889,\n        \"ndcg_at_10\": 0.93164,\n        \"ndcg_at_100\": 0.93448,\n        \"ndcg_at_1000\": 0.93539,\n        \"ndcg_at_20\": 0.93303,\n        \"ndcg_at_3\": 0.9185,\n        \"ndcg_at_5\": 0.92577,\n        \"precision_at_1\": 0.87889,\n        \"precision_at_10\": 0.098,\n        \"precision_at_100\": 0.00993,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04928,\n        \"precision_at_3\": 0.31481,\n        \"precision_at_5\": 0.19244,\n        \"recall_at_1\": 0.87889,\n        \"recall_at_10\": 0.98,\n        \"recall_at_100\": 0.99333,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98556,\n        \"recall_at_3\": 0.94444,\n        \"recall_at_5\": 0.96222\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.90365,\n        \"map_at_1\": 0.83556,\n        \"map_at_10\": 0.88327,\n        \"map_at_100\": 0.88495,\n        \"map_at_1000\": 0.88497,\n        \"map_at_20\": 0.88462,\n        \"map_at_3\": 0.87574,\n        \"map_at_5\": 0.88052,\n        \"mrr_at_1\": 0.8355555555555556,\n        \"mrr_at_10\": 0.8832663139329808,\n        \"mrr_at_100\": 0.8849464937287592,\n        \"mrr_at_1000\": 0.8849749325397649,\n        \"mrr_at_20\": 0.8846182396703555,\n        \"mrr_at_3\": 0.8757407407407409,\n        \"mrr_at_5\": 0.8805185185185187,\n        \"nauc_map_at_1000_diff1\": 0.855347628670212,\n        \"nauc_map_at_1000_max\": 0.6898140243410444,\n        \"nauc_map_at_1000_std\": 0.10353937270721077,\n        \"nauc_map_at_100_diff1\": 0.855275356255775,\n        \"nauc_map_at_100_max\": 0.6898299533073919,\n        \"nauc_map_at_100_std\": 0.10369584797022877,\n        \"nauc_map_at_10_diff1\": 0.8545939543607107,\n        \"nauc_map_at_10_max\": 0.691361711480954,\n        \"nauc_map_at_10_std\": 0.10799233041904452,\n        \"nauc_map_at_1_diff1\": 0.8673830358805222,\n        \"nauc_map_at_1_max\": 0.6620807511237589,\n        \"nauc_map_at_1_std\": 0.05348498550416149,\n        \"nauc_map_at_20_diff1\": 0.8550816588802468,\n        \"nauc_map_at_20_max\": 0.6902918325884226,\n        \"nauc_map_at_20_std\": 0.10508842671827126,\n        \"nauc_map_at_3_diff1\": 0.8556449045847431,\n        \"nauc_map_at_3_max\": 0.6940007000047526,\n        \"nauc_map_at_3_std\": 0.10619835484479548,\n        \"nauc_map_at_5_diff1\": 0.8549919507891112,\n        \"nauc_map_at_5_max\": 0.6928210519115601,\n        \"nauc_map_at_5_std\": 0.10521440661745296,\n        \"nauc_mrr_at_1000_diff1\": 0.855347628670212,\n        \"nauc_mrr_at_1000_max\": 0.6898140243410444,\n        \"nauc_mrr_at_1000_std\": 0.10353937270721077,\n        \"nauc_mrr_at_100_diff1\": 0.855275356255775,\n        \"nauc_mrr_at_100_max\": 0.6898299533073919,\n        \"nauc_mrr_at_100_std\": 0.10369584797022877,\n        \"nauc_mrr_at_10_diff1\": 0.8545939543607107,\n        \"nauc_mrr_at_10_max\": 0.691361711480954,\n        \"nauc_mrr_at_10_std\": 0.10799233041904452,\n        \"nauc_mrr_at_1_diff1\": 0.8673830358805222,\n        \"nauc_mrr_at_1_max\": 0.6620807511237589,\n        \"nauc_mrr_at_1_std\": 0.05348498550416149,\n        \"nauc_mrr_at_20_diff1\": 0.8550816588802468,\n        \"nauc_mrr_at_20_max\": 0.6902918325884226,\n        \"nauc_mrr_at_20_std\": 0.10508842671827126,\n        \"nauc_mrr_at_3_diff1\": 0.8556449045847431,\n        \"nauc_mrr_at_3_max\": 0.6940007000047526,\n        \"nauc_mrr_at_3_std\": 0.10619835484479548,\n        \"nauc_mrr_at_5_diff1\": 0.8549919507891112,\n        \"nauc_mrr_at_5_max\": 0.6928210519115601,\n        \"nauc_mrr_at_5_std\": 0.10521440661745296,\n        \"nauc_ndcg_at_1000_diff1\": 0.8527012462802727,\n        \"nauc_ndcg_at_1000_max\": 0.6933498509696858,\n        \"nauc_ndcg_at_1000_std\": 0.11443873671850584,\n        \"nauc_ndcg_at_100_diff1\": 0.8508516789196892,\n        \"nauc_ndcg_at_100_max\": 0.6943035655845461,\n        \"nauc_ndcg_at_100_std\": 0.11991478266036447,\n        \"nauc_ndcg_at_10_diff1\": 0.8477011560099511,\n        \"nauc_ndcg_at_10_max\": 0.701026901481694,\n        \"nauc_ndcg_at_10_std\": 0.14075623622130473,\n        \"nauc_ndcg_at_1_diff1\": 0.8673830358805222,\n        \"nauc_ndcg_at_1_max\": 0.6620807511237589,\n        \"nauc_ndcg_at_1_std\": 0.05348498550416149,\n        \"nauc_ndcg_at_20_diff1\": 0.8495343252357374,\n        \"nauc_ndcg_at_20_max\": 0.6966836378939858,\n        \"nauc_ndcg_at_20_std\": 0.12927198789204877,\n        \"nauc_ndcg_at_3_diff1\": 0.8509468666257631,\n        \"nauc_ndcg_at_3_max\": 0.7046413690365483,\n        \"nauc_ndcg_at_3_std\": 0.12717513638981803,\n        \"nauc_ndcg_at_5_diff1\": 0.849510553173776,\n        \"nauc_ndcg_at_5_max\": 0.7041140837858083,\n        \"nauc_ndcg_at_5_std\": 0.12814143423088434,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.6438842203548022,\n        \"nauc_precision_at_100_max\": 0.819327731092435,\n        \"nauc_precision_at_100_std\": 0.7824463118580629,\n        \"nauc_precision_at_10_diff1\": 0.7782601929660737,\n        \"nauc_precision_at_10_max\": 0.790242763772179,\n        \"nauc_precision_at_10_std\": 0.48392468098350033,\n        \"nauc_precision_at_1_diff1\": 0.8673830358805222,\n        \"nauc_precision_at_1_max\": 0.6620807511237589,\n        \"nauc_precision_at_1_std\": 0.05348498550416149,\n        \"nauc_precision_at_20_diff1\": 0.7402627717753778,\n        \"nauc_precision_at_20_max\": 0.7947512338268672,\n        \"nauc_precision_at_20_std\": 0.6165466186474461,\n        \"nauc_precision_at_3_diff1\": 0.8300112315457603,\n        \"nauc_precision_at_3_max\": 0.7509776857602969,\n        \"nauc_precision_at_3_std\": 0.22059161828983137,\n        \"nauc_precision_at_5_diff1\": 0.8170961718020517,\n        \"nauc_precision_at_5_max\": 0.7704388422035447,\n        \"nauc_precision_at_5_std\": 0.2653127917833765,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.6438842203548035,\n        \"nauc_recall_at_100_max\": 0.8193277310924408,\n        \"nauc_recall_at_100_std\": 0.782446311858087,\n        \"nauc_recall_at_10_diff1\": 0.778260192966078,\n        \"nauc_recall_at_10_max\": 0.7902427637721744,\n        \"nauc_recall_at_10_std\": 0.48392468098350666,\n        \"nauc_recall_at_1_diff1\": 0.8673830358805222,\n        \"nauc_recall_at_1_max\": 0.6620807511237589,\n        \"nauc_recall_at_1_std\": 0.05348498550416149,\n        \"nauc_recall_at_20_diff1\": 0.7402627717753743,\n        \"nauc_recall_at_20_max\": 0.7947512338268609,\n        \"nauc_recall_at_20_std\": 0.6165466186474606,\n        \"nauc_recall_at_3_diff1\": 0.8300112315457603,\n        \"nauc_recall_at_3_max\": 0.7509776857602934,\n        \"nauc_recall_at_3_std\": 0.22059161828982624,\n        \"nauc_recall_at_5_diff1\": 0.8170961718020519,\n        \"nauc_recall_at_5_max\": 0.7704388422035484,\n        \"nauc_recall_at_5_std\": 0.2653127917833834,\n        \"ndcg_at_1\": 0.83556,\n        \"ndcg_at_10\": 0.90365,\n        \"ndcg_at_100\": 0.91028,\n        \"ndcg_at_1000\": 0.911,\n        \"ndcg_at_20\": 0.90829,\n        \"ndcg_at_3\": 0.88803,\n        \"ndcg_at_5\": 0.89668,\n        \"precision_at_1\": 0.83556,\n        \"precision_at_10\": 0.09667,\n        \"precision_at_100\": 0.00994,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04922,\n        \"precision_at_3\": 0.30778,\n        \"precision_at_5\": 0.18889,\n        \"recall_at_1\": 0.83556,\n        \"recall_at_10\": 0.96667,\n        \"recall_at_100\": 0.99444,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98444,\n        \"recall_at_3\": 0.92333,\n        \"recall_at_5\": 0.94444\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.88363,\n        \"map_at_1\": 0.79667,\n        \"map_at_10\": 0.85787,\n        \"map_at_100\": 0.8592,\n        \"map_at_1000\": 0.85925,\n        \"map_at_20\": 0.85867,\n        \"map_at_3\": 0.84741,\n        \"map_at_5\": 0.85496,\n        \"mrr_at_1\": 0.7966666666666666,\n        \"mrr_at_10\": 0.8578650793650797,\n        \"mrr_at_100\": 0.8592039439643446,\n        \"mrr_at_1000\": 0.8592467110152766,\n        \"mrr_at_20\": 0.8586734267672094,\n        \"mrr_at_3\": 0.8474074074074077,\n        \"mrr_at_5\": 0.8549629629629634,\n        \"nauc_map_at_1000_diff1\": 0.859468841140476,\n        \"nauc_map_at_1000_max\": 0.6418851630612379,\n        \"nauc_map_at_1000_std\": 0.12161212115529317,\n        \"nauc_map_at_100_diff1\": 0.8594694509113175,\n        \"nauc_map_at_100_max\": 0.6419321905712058,\n        \"nauc_map_at_100_std\": 0.12179724364431067,\n        \"nauc_map_at_10_diff1\": 0.8588613413517707,\n        \"nauc_map_at_10_max\": 0.641709583131691,\n        \"nauc_map_at_10_std\": 0.121384800872592,\n        \"nauc_map_at_1_diff1\": 0.8702250130821565,\n        \"nauc_map_at_1_max\": 0.6163243388374275,\n        \"nauc_map_at_1_std\": 0.07164637905101645,\n        \"nauc_map_at_20_diff1\": 0.8594870506841481,\n        \"nauc_map_at_20_max\": 0.6425710944098023,\n        \"nauc_map_at_20_std\": 0.1237131469715452,\n        \"nauc_map_at_3_diff1\": 0.8558682567291922,\n        \"nauc_map_at_3_max\": 0.6492018403346966,\n        \"nauc_map_at_3_std\": 0.11860755714696808,\n        \"nauc_map_at_5_diff1\": 0.8589466899055904,\n        \"nauc_map_at_5_max\": 0.6449249342806429,\n        \"nauc_map_at_5_std\": 0.1277634095588614,\n        \"nauc_mrr_at_1000_diff1\": 0.859468841140476,\n        \"nauc_mrr_at_1000_max\": 0.6418851630612379,\n        \"nauc_mrr_at_1000_std\": 0.12161212115529317,\n        \"nauc_mrr_at_100_diff1\": 0.8594694509113175,\n        \"nauc_mrr_at_100_max\": 0.6419321905712058,\n        \"nauc_mrr_at_100_std\": 0.12179724364431067,\n        \"nauc_mrr_at_10_diff1\": 0.8588613413517707,\n        \"nauc_mrr_at_10_max\": 0.641709583131691,\n        \"nauc_mrr_at_10_std\": 0.121384800872592,\n        \"nauc_mrr_at_1_diff1\": 0.8702250130821565,\n        \"nauc_mrr_at_1_max\": 0.6163243388374275,\n        \"nauc_mrr_at_1_std\": 0.07164637905101645,\n        \"nauc_mrr_at_20_diff1\": 0.8594870506841481,\n        \"nauc_mrr_at_20_max\": 0.6425710944098023,\n        \"nauc_mrr_at_20_std\": 0.1237131469715452,\n        \"nauc_mrr_at_3_diff1\": 0.8558682567291922,\n        \"nauc_mrr_at_3_max\": 0.6492018403346966,\n        \"nauc_mrr_at_3_std\": 0.11860755714696808,\n        \"nauc_mrr_at_5_diff1\": 0.8589466899055904,\n        \"nauc_mrr_at_5_max\": 0.6449249342806429,\n        \"nauc_mrr_at_5_std\": 0.1277634095588614,\n        \"nauc_ndcg_at_1000_diff1\": 0.8588358520863845,\n        \"nauc_ndcg_at_1000_max\": 0.645465796921435,\n        \"nauc_ndcg_at_1000_std\": 0.13240406904224863,\n        \"nauc_ndcg_at_100_diff1\": 0.8588633851935984,\n        \"nauc_ndcg_at_100_max\": 0.6464585395890068,\n        \"nauc_ndcg_at_100_std\": 0.13631972155577624,\n        \"nauc_ndcg_at_10_diff1\": 0.8567728449023886,\n        \"nauc_ndcg_at_10_max\": 0.6475703207508358,\n        \"nauc_ndcg_at_10_std\": 0.1422797846281043,\n        \"nauc_ndcg_at_1_diff1\": 0.8702250130821565,\n        \"nauc_ndcg_at_1_max\": 0.6163243388374275,\n        \"nauc_ndcg_at_1_std\": 0.07164637905101645,\n        \"nauc_ndcg_at_20_diff1\": 0.8594313083100267,\n        \"nauc_ndcg_at_20_max\": 0.6510508012250286,\n        \"nauc_ndcg_at_20_std\": 0.15212758928270584,\n        \"nauc_ndcg_at_3_diff1\": 0.8507464933321702,\n        \"nauc_ndcg_at_3_max\": 0.6625695478441651,\n        \"nauc_ndcg_at_3_std\": 0.13701665752617875,\n        \"nauc_ndcg_at_5_diff1\": 0.8570505968282397,\n        \"nauc_ndcg_at_5_max\": 0.6557638094232093,\n        \"nauc_ndcg_at_5_std\": 0.15745646851391326,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8627450980391947,\n        \"nauc_precision_at_100_max\": 0.7735760971054999,\n        \"nauc_precision_at_100_std\": 0.6373482726424144,\n        \"nauc_precision_at_10_diff1\": 0.8408716427747522,\n        \"nauc_precision_at_10_max\": 0.6951859175042543,\n        \"nauc_precision_at_10_std\": 0.3470917778876209,\n        \"nauc_precision_at_1_diff1\": 0.8702250130821565,\n        \"nauc_precision_at_1_max\": 0.6163243388374275,\n        \"nauc_precision_at_1_std\": 0.07164637905101645,\n        \"nauc_precision_at_20_diff1\": 0.8759142545907178,\n        \"nauc_precision_at_20_max\": 0.7660480859010207,\n        \"nauc_precision_at_20_std\": 0.5798124805477631,\n        \"nauc_precision_at_3_diff1\": 0.8278734257930804,\n        \"nauc_precision_at_3_max\": 0.7232185557149703,\n        \"nauc_precision_at_3_std\": 0.22018970189701878,\n        \"nauc_precision_at_5_diff1\": 0.8476980535804056,\n        \"nauc_precision_at_5_max\": 0.7277167277167269,\n        \"nauc_precision_at_5_std\": 0.36440601881777845,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8627450980392323,\n        \"nauc_recall_at_100_max\": 0.7735760971055182,\n        \"nauc_recall_at_100_std\": 0.6373482726423895,\n        \"nauc_recall_at_10_diff1\": 0.8408716427747571,\n        \"nauc_recall_at_10_max\": 0.695185917504258,\n        \"nauc_recall_at_10_std\": 0.347091777887624,\n        \"nauc_recall_at_1_diff1\": 0.8702250130821565,\n        \"nauc_recall_at_1_max\": 0.6163243388374275,\n        \"nauc_recall_at_1_std\": 0.07164637905101645,\n        \"nauc_recall_at_20_diff1\": 0.8759142545907237,\n        \"nauc_recall_at_20_max\": 0.7660480859010214,\n        \"nauc_recall_at_20_std\": 0.5798124805477695,\n        \"nauc_recall_at_3_diff1\": 0.8278734257930809,\n        \"nauc_recall_at_3_max\": 0.7232185557149695,\n        \"nauc_recall_at_3_std\": 0.22018970189702047,\n        \"nauc_recall_at_5_diff1\": 0.8476980535804093,\n        \"nauc_recall_at_5_max\": 0.7277167277167285,\n        \"nauc_recall_at_5_std\": 0.3644060188177846,\n        \"ndcg_at_1\": 0.79667,\n        \"ndcg_at_10\": 0.88363,\n        \"ndcg_at_100\": 0.89038,\n        \"ndcg_at_1000\": 0.89116,\n        \"ndcg_at_20\": 0.88648,\n        \"ndcg_at_3\": 0.86325,\n        \"ndcg_at_5\": 0.87693,\n        \"precision_at_1\": 0.79667,\n        \"precision_at_10\": 0.09622,\n        \"precision_at_100\": 0.00994,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04867,\n        \"precision_at_3\": 0.30296,\n        \"precision_at_5\": 0.18844,\n        \"recall_at_1\": 0.79667,\n        \"recall_at_10\": 0.96222,\n        \"recall_at_100\": 0.99444,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.97333,\n        \"recall_at_3\": 0.90889,\n        \"recall_at_5\": 0.94222\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-m3/BAAI__bge-m3/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 185.89697933197021,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.79405,\n        \"map_at_1\": 0.49267,\n        \"map_at_10\": 0.75068,\n        \"map_at_100\": 0.75588,\n        \"map_at_1000\": 0.75626,\n        \"map_at_20\": 0.75409,\n        \"map_at_3\": 0.71019,\n        \"map_at_5\": 0.73924,\n        \"mrr_at_1\": 0.7567567567567568,\n        \"mrr_at_10\": 0.8111593736593736,\n        \"mrr_at_100\": 0.8129820393113771,\n        \"mrr_at_1000\": 0.8131176819899872,\n        \"mrr_at_20\": 0.8123800402389797,\n        \"mrr_at_3\": 0.8026463963963962,\n        \"mrr_at_5\": 0.809065315315315,\n        \"nauc_map_at_1000_diff1\": 0.6073564845705162,\n        \"nauc_map_at_1000_max\": 0.6142808799071932,\n        \"nauc_map_at_1000_std\": 0.2777535403105099,\n        \"nauc_map_at_100_diff1\": 0.6074610172189073,\n        \"nauc_map_at_100_max\": 0.6147329654986178,\n        \"nauc_map_at_100_std\": 0.27839664065266817,\n        \"nauc_map_at_10_diff1\": 0.6057452723427406,\n        \"nauc_map_at_10_max\": 0.6147408260448912,\n        \"nauc_map_at_10_std\": 0.27396835761844074,\n        \"nauc_map_at_1_diff1\": 0.6606149953272771,\n        \"nauc_map_at_1_max\": 0.2789519671066579,\n        \"nauc_map_at_1_std\": 0.043338484369368206,\n        \"nauc_map_at_20_diff1\": 0.6050594418976999,\n        \"nauc_map_at_20_max\": 0.6143563208405669,\n        \"nauc_map_at_20_std\": 0.276742270435723,\n        \"nauc_map_at_3_diff1\": 0.5916665330995543,\n        \"nauc_map_at_3_max\": 0.5605227755844461,\n        \"nauc_map_at_3_std\": 0.2104961965183136,\n        \"nauc_map_at_5_diff1\": 0.6012828801837301,\n        \"nauc_map_at_5_max\": 0.5977220283801926,\n        \"nauc_map_at_5_std\": 0.239568588369421,\n        \"nauc_mrr_at_1000_diff1\": 0.7204077645198788,\n        \"nauc_mrr_at_1000_max\": 0.6874919147005658,\n        \"nauc_mrr_at_1000_std\": 0.3960669270046734,\n        \"nauc_mrr_at_100_diff1\": 0.7204224854441412,\n        \"nauc_mrr_at_100_max\": 0.6877110638254341,\n        \"nauc_mrr_at_100_std\": 0.3964536952924918,\n        \"nauc_mrr_at_10_diff1\": 0.7208324628160704,\n        \"nauc_mrr_at_10_max\": 0.6897440891787184,\n        \"nauc_mrr_at_10_std\": 0.3963588333134652,\n        \"nauc_mrr_at_1_diff1\": 0.733564685115092,\n        \"nauc_mrr_at_1_max\": 0.6004409767078538,\n        \"nauc_mrr_at_1_std\": 0.3056509437634208,\n        \"nauc_mrr_at_20_diff1\": 0.7206297856582866,\n        \"nauc_mrr_at_20_max\": 0.688336867623408,\n        \"nauc_mrr_at_20_std\": 0.39657236146996266,\n        \"nauc_mrr_at_3_diff1\": 0.7186594739549138,\n        \"nauc_mrr_at_3_max\": 0.68914836868804,\n        \"nauc_mrr_at_3_std\": 0.38332225603422865,\n        \"nauc_mrr_at_5_diff1\": 0.7209733355169085,\n        \"nauc_mrr_at_5_max\": 0.6888801228180421,\n        \"nauc_mrr_at_5_std\": 0.39270866874049193,\n        \"nauc_ndcg_at_1000_diff1\": 0.6338473482311605,\n        \"nauc_ndcg_at_1000_max\": 0.6658318500784468,\n        \"nauc_ndcg_at_1000_std\": 0.3613327838786333,\n        \"nauc_ndcg_at_100_diff1\": 0.6359961983984979,\n        \"nauc_ndcg_at_100_max\": 0.6768630279285994,\n        \"nauc_ndcg_at_100_std\": 0.37843517651343045,\n        \"nauc_ndcg_at_10_diff1\": 0.6302885124429262,\n        \"nauc_ndcg_at_10_max\": 0.677901974773586,\n        \"nauc_ndcg_at_10_std\": 0.35987771021811943,\n        \"nauc_ndcg_at_1_diff1\": 0.733564685115092,\n        \"nauc_ndcg_at_1_max\": 0.6004409767078538,\n        \"nauc_ndcg_at_1_std\": 0.3056509437634208,\n        \"nauc_ndcg_at_20_diff1\": 0.6284643385980219,\n        \"nauc_ndcg_at_20_max\": 0.6768232098229742,\n        \"nauc_ndcg_at_20_std\": 0.3688374813640457,\n        \"nauc_ndcg_at_3_diff1\": 0.6054013951584047,\n        \"nauc_ndcg_at_3_max\": 0.6092729334025931,\n        \"nauc_ndcg_at_3_std\": 0.25866032885907,\n        \"nauc_ndcg_at_5_diff1\": 0.6238418504187758,\n        \"nauc_ndcg_at_5_max\": 0.6509906586415192,\n        \"nauc_ndcg_at_5_std\": 0.30210068484335106,\n        \"nauc_precision_at_1000_diff1\": -0.35990568904125725,\n        \"nauc_precision_at_1000_max\": 0.0067781404379028245,\n        \"nauc_precision_at_1000_std\": 0.15395949020431401,\n        \"nauc_precision_at_100_diff1\": -0.23352187794170565,\n        \"nauc_precision_at_100_max\": 0.15596081334229617,\n        \"nauc_precision_at_100_std\": 0.267173695536987,\n        \"nauc_precision_at_10_diff1\": -0.13641666339761727,\n        \"nauc_precision_at_10_max\": 0.2816031935192935,\n        \"nauc_precision_at_10_std\": 0.30570851296675766,\n        \"nauc_precision_at_1_diff1\": 0.733564685115092,\n        \"nauc_precision_at_1_max\": 0.6004409767078538,\n        \"nauc_precision_at_1_std\": 0.3056509437634208,\n        \"nauc_precision_at_20_diff1\": -0.18962238004033924,\n        \"nauc_precision_at_20_max\": 0.22895177335346711,\n        \"nauc_precision_at_20_std\": 0.29028521348267383,\n        \"nauc_precision_at_3_diff1\": -0.0033508590425714883,\n        \"nauc_precision_at_3_max\": 0.3897633058892868,\n        \"nauc_precision_at_3_std\": 0.2660099232096745,\n        \"nauc_precision_at_5_diff1\": -0.08105324547471025,\n        \"nauc_precision_at_5_max\": 0.3249889835054694,\n        \"nauc_precision_at_5_std\": 0.25654282884764673,\n        \"nauc_recall_at_1000_diff1\": 0.5511369328228183,\n        \"nauc_recall_at_1000_max\": 0.8893951650461698,\n        \"nauc_recall_at_1000_std\": 0.908942266283279,\n        \"nauc_recall_at_100_diff1\": 0.620790115513722,\n        \"nauc_recall_at_100_max\": 0.885920841896125,\n        \"nauc_recall_at_100_std\": 0.7925130360150211,\n        \"nauc_recall_at_10_diff1\": 0.5943289326994741,\n        \"nauc_recall_at_10_max\": 0.8028881422138773,\n        \"nauc_recall_at_10_std\": 0.5280584453731186,\n        \"nauc_recall_at_1_diff1\": 0.6606149953272771,\n        \"nauc_recall_at_1_max\": 0.2789519671066579,\n        \"nauc_recall_at_1_std\": 0.043338484369368206,\n        \"nauc_recall_at_20_diff1\": 0.5813900968151912,\n        \"nauc_recall_at_20_max\": 0.8287976348105712,\n        \"nauc_recall_at_20_std\": 0.6138570052685672,\n        \"nauc_recall_at_3_diff1\": 0.5549790197723918,\n        \"nauc_recall_at_3_max\": 0.6195795055811252,\n        \"nauc_recall_at_3_std\": 0.25210116535419186,\n        \"nauc_recall_at_5_diff1\": 0.584423609937162,\n        \"nauc_recall_at_5_max\": 0.7135500268808825,\n        \"nauc_recall_at_5_std\": 0.3504720792523775,\n        \"ndcg_at_1\": 0.75676,\n        \"ndcg_at_10\": 0.79405,\n        \"ndcg_at_100\": 0.81105,\n        \"ndcg_at_1000\": 0.81929,\n        \"ndcg_at_20\": 0.80289,\n        \"ndcg_at_3\": 0.74791,\n        \"ndcg_at_5\": 0.77754,\n        \"precision_at_1\": 0.75676,\n        \"precision_at_10\": 0.15743,\n        \"precision_at_100\": 0.0172,\n        \"precision_at_1000\": 0.00184,\n        \"precision_at_20\": 0.08193,\n        \"precision_at_3\": 0.44313,\n        \"precision_at_5\": 0.29493,\n        \"recall_at_1\": 0.49267,\n        \"recall_at_10\": 0.85203,\n        \"recall_at_100\": 0.9141,\n        \"recall_at_1000\": 0.96796,\n        \"recall_at_20\": 0.87968,\n        \"recall_at_3\": 0.75176,\n        \"recall_at_5\": 0.81346\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-m3/BAAI__bge-m3/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 25134.011864423752,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.70146,\n        \"map_at_1\": 0.42297,\n        \"map_at_10\": 0.61161,\n        \"map_at_100\": 0.63802,\n        \"map_at_1000\": 0.63844,\n        \"map_at_20\": 0.62969,\n        \"map_at_3\": 0.53676,\n        \"map_at_5\": 0.57778,\n        \"mrr_at_1\": 0.6713615023474179,\n        \"mrr_at_10\": 0.7659344958640735,\n        \"mrr_at_100\": 0.7683117539523098,\n        \"mrr_at_1000\": 0.7683494097782307,\n        \"mrr_at_20\": 0.7676708919666668,\n        \"mrr_at_3\": 0.7511737089201878,\n        \"mrr_at_5\": 0.761267605633803,\n        \"nauc_map_at_1000_diff1\": 0.2860679246516418,\n        \"nauc_map_at_1000_max\": 0.2416200329933295,\n        \"nauc_map_at_1000_std\": -0.12005920416004798,\n        \"nauc_map_at_100_diff1\": 0.28612865312726604,\n        \"nauc_map_at_100_max\": 0.24147614705594259,\n        \"nauc_map_at_100_std\": -0.12000538814638757,\n        \"nauc_map_at_10_diff1\": 0.2910535705883505,\n        \"nauc_map_at_10_max\": 0.22063655735554957,\n        \"nauc_map_at_10_std\": -0.1755548069677421,\n        \"nauc_map_at_1_diff1\": 0.3731225761234927,\n        \"nauc_map_at_1_max\": 0.09201026764951797,\n        \"nauc_map_at_1_std\": -0.3014661427052009,\n        \"nauc_map_at_20_diff1\": 0.28831099175996144,\n        \"nauc_map_at_20_max\": 0.2380261079942362,\n        \"nauc_map_at_20_std\": -0.13345707243096736,\n        \"nauc_map_at_3_diff1\": 0.3342501310457326,\n        \"nauc_map_at_3_max\": 0.15872651094652668,\n        \"nauc_map_at_3_std\": -0.26884596583229825,\n        \"nauc_map_at_5_diff1\": 0.29839691155660714,\n        \"nauc_map_at_5_max\": 0.1870288376376699,\n        \"nauc_map_at_5_std\": -0.21145942033023102,\n        \"nauc_mrr_at_1000_diff1\": 0.27343011112899185,\n        \"nauc_mrr_at_1000_max\": 0.36215294276407056,\n        \"nauc_mrr_at_1000_std\": 0.03997507028764519,\n        \"nauc_mrr_at_100_diff1\": 0.2733480592732512,\n        \"nauc_mrr_at_100_max\": 0.36215662012921923,\n        \"nauc_mrr_at_100_std\": 0.0400697404328969,\n        \"nauc_mrr_at_10_diff1\": 0.27482567942556374,\n        \"nauc_mrr_at_10_max\": 0.36635220564893367,\n        \"nauc_mrr_at_10_std\": 0.036866485562697504,\n        \"nauc_mrr_at_1_diff1\": 0.2948130734383108,\n        \"nauc_mrr_at_1_max\": 0.2926407082840507,\n        \"nauc_mrr_at_1_std\": -0.027831021522469086,\n        \"nauc_mrr_at_20_diff1\": 0.27309467155693556,\n        \"nauc_mrr_at_20_max\": 0.36358562538828787,\n        \"nauc_mrr_at_20_std\": 0.04156820247382249,\n        \"nauc_mrr_at_3_diff1\": 0.2691890441095148,\n        \"nauc_mrr_at_3_max\": 0.3601144018951212,\n        \"nauc_mrr_at_3_std\": 0.0356925953037033,\n        \"nauc_mrr_at_5_diff1\": 0.2782361790018662,\n        \"nauc_mrr_at_5_max\": 0.36655032927215986,\n        \"nauc_mrr_at_5_std\": 0.04156090999995617,\n        \"nauc_ndcg_at_1000_diff1\": 0.27008440080369717,\n        \"nauc_ndcg_at_1000_max\": 0.31432467578992335,\n        \"nauc_ndcg_at_1000_std\": -0.01322753759468674,\n        \"nauc_ndcg_at_100_diff1\": 0.2691417400497451,\n        \"nauc_ndcg_at_100_max\": 0.3149913299281308,\n        \"nauc_ndcg_at_100_std\": -0.0069897350287974995,\n        \"nauc_ndcg_at_10_diff1\": 0.2759161503451715,\n        \"nauc_ndcg_at_10_max\": 0.28337609820359727,\n        \"nauc_ndcg_at_10_std\": -0.11079866548891888,\n        \"nauc_ndcg_at_1_diff1\": 0.2948130734383108,\n        \"nauc_ndcg_at_1_max\": 0.2926407082840507,\n        \"nauc_ndcg_at_1_std\": -0.027831021522469086,\n        \"nauc_ndcg_at_20_diff1\": 0.2719166891767834,\n        \"nauc_ndcg_at_20_max\": 0.31104279428884174,\n        \"nauc_ndcg_at_20_std\": -0.0325073620013048,\n        \"nauc_ndcg_at_3_diff1\": 0.2971934028744493,\n        \"nauc_ndcg_at_3_max\": 0.2443350194831595,\n        \"nauc_ndcg_at_3_std\": -0.11285592786460469,\n        \"nauc_ndcg_at_5_diff1\": 0.27619207496823056,\n        \"nauc_ndcg_at_5_max\": 0.24632112632918796,\n        \"nauc_ndcg_at_5_std\": -0.1027718220598243,\n        \"nauc_precision_at_1000_diff1\": -0.21812881816741134,\n        \"nauc_precision_at_1000_max\": 0.14106897125057397,\n        \"nauc_precision_at_1000_std\": 0.48173738645886327,\n        \"nauc_precision_at_100_diff1\": -0.21203964015536822,\n        \"nauc_precision_at_100_max\": 0.15783084406970369,\n        \"nauc_precision_at_100_std\": 0.5021751159419123,\n        \"nauc_precision_at_10_diff1\": -0.2007207389719376,\n        \"nauc_precision_at_10_max\": 0.23263258358188674,\n        \"nauc_precision_at_10_std\": 0.4501018452604258,\n        \"nauc_precision_at_1_diff1\": 0.2948130734383108,\n        \"nauc_precision_at_1_max\": 0.2926407082840507,\n        \"nauc_precision_at_1_std\": -0.027831021522469086,\n        \"nauc_precision_at_20_diff1\": -0.20516364776757468,\n        \"nauc_precision_at_20_max\": 0.1977163767715501,\n        \"nauc_precision_at_20_std\": 0.4995418544872059,\n        \"nauc_precision_at_3_diff1\": -0.10731185639919887,\n        \"nauc_precision_at_3_max\": 0.27109790464689093,\n        \"nauc_precision_at_3_std\": 0.28277292710319796,\n        \"nauc_precision_at_5_diff1\": -0.20268354514790782,\n        \"nauc_precision_at_5_max\": 0.23139780215041297,\n        \"nauc_precision_at_5_std\": 0.40233922024606095,\n        \"nauc_recall_at_1000_diff1\": 0.3625332041174769,\n        \"nauc_recall_at_1000_max\": 0.8600957914042522,\n        \"nauc_recall_at_1000_std\": 0.8103352826255814,\n        \"nauc_recall_at_100_diff1\": 0.21183843007998174,\n        \"nauc_recall_at_100_max\": 0.48029123227428006,\n        \"nauc_recall_at_100_std\": 0.4243256333272366,\n        \"nauc_recall_at_10_diff1\": 0.22120282376188027,\n        \"nauc_recall_at_10_max\": 0.2749413623813262,\n        \"nauc_recall_at_10_std\": -0.18226669196653814,\n        \"nauc_recall_at_1_diff1\": 0.3731225761234927,\n        \"nauc_recall_at_1_max\": 0.09201026764951797,\n        \"nauc_recall_at_1_std\": -0.3014661427052009,\n        \"nauc_recall_at_20_diff1\": 0.21036420602067207,\n        \"nauc_recall_at_20_max\": 0.38058742085733716,\n        \"nauc_recall_at_20_std\": 0.11650063573321266,\n        \"nauc_recall_at_3_diff1\": 0.3251254419362985,\n        \"nauc_recall_at_3_max\": 0.15496086730521202,\n        \"nauc_recall_at_3_std\": -0.2878870790262251,\n        \"nauc_recall_at_5_diff1\": 0.2592535399889266,\n        \"nauc_recall_at_5_max\": 0.19539608299498687,\n        \"nauc_recall_at_5_std\": -0.1963956729684935,\n        \"ndcg_at_1\": 0.67136,\n        \"ndcg_at_10\": 0.70146,\n        \"ndcg_at_100\": 0.75433,\n        \"ndcg_at_1000\": 0.75993,\n        \"ndcg_at_20\": 0.73002,\n        \"ndcg_at_3\": 0.65453,\n        \"ndcg_at_5\": 0.66807,\n        \"precision_at_1\": 0.67136,\n        \"precision_at_10\": 0.18122,\n        \"precision_at_100\": 0.02451,\n        \"precision_at_1000\": 0.00255,\n        \"precision_at_20\": 0.10587,\n        \"precision_at_3\": 0.39124,\n        \"precision_at_5\": 0.29108,\n        \"recall_at_1\": 0.42297,\n        \"recall_at_10\": 0.792,\n        \"recall_at_100\": 0.95456,\n        \"recall_at_1000\": 0.98732,\n        \"recall_at_20\": 0.86726,\n        \"recall_at_3\": 0.59949,\n        \"recall_at_5\": 0.68371\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-m3/BAAI__bge-m3/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 15034.357434511185,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.64708,\n        \"map_at_1\": 0.47823,\n        \"map_at_10\": 0.59078,\n        \"map_at_100\": 0.59938,\n        \"map_at_1000\": 0.59956,\n        \"map_at_20\": 0.59711,\n        \"map_at_3\": 0.56182,\n        \"map_at_5\": 0.57697,\n        \"mrr_at_1\": 0.5201900237529691,\n        \"mrr_at_10\": 0.6182624514572258,\n        \"mrr_at_100\": 0.6236958323634181,\n        \"mrr_at_1000\": 0.623854309693826,\n        \"mrr_at_20\": 0.622454465076337,\n        \"mrr_at_3\": 0.5942201108471894,\n        \"mrr_at_5\": 0.6063341250989708,\n        \"nauc_map_at_1000_diff1\": 0.3995809729123824,\n        \"nauc_map_at_1000_max\": 0.3685222486712915,\n        \"nauc_map_at_1000_std\": 0.06373832421801984,\n        \"nauc_map_at_100_diff1\": 0.3996006455556901,\n        \"nauc_map_at_100_max\": 0.36864203636141646,\n        \"nauc_map_at_100_std\": 0.06383760412402077,\n        \"nauc_map_at_10_diff1\": 0.40046422054500413,\n        \"nauc_map_at_10_max\": 0.3670278175626621,\n        \"nauc_map_at_10_std\": 0.0611611053235871,\n        \"nauc_map_at_1_diff1\": 0.45659036090089766,\n        \"nauc_map_at_1_max\": 0.33927633905548615,\n        \"nauc_map_at_1_std\": 0.030288521635467035,\n        \"nauc_map_at_20_diff1\": 0.39748224739889754,\n        \"nauc_map_at_20_max\": 0.36602272288213494,\n        \"nauc_map_at_20_std\": 0.062088919209027066,\n        \"nauc_map_at_3_diff1\": 0.4054712860586374,\n        \"nauc_map_at_3_max\": 0.3624873599798654,\n        \"nauc_map_at_3_std\": 0.044772202259510875,\n        \"nauc_map_at_5_diff1\": 0.39915141043021296,\n        \"nauc_map_at_5_max\": 0.3718285751697345,\n        \"nauc_map_at_5_std\": 0.06739584492621328,\n        \"nauc_mrr_at_1000_diff1\": 0.4145924520403507,\n        \"nauc_mrr_at_1000_max\": 0.39913215972590815,\n        \"nauc_mrr_at_1000_std\": 0.08536808844882394,\n        \"nauc_mrr_at_100_diff1\": 0.4145639732356783,\n        \"nauc_mrr_at_100_max\": 0.3991859161244107,\n        \"nauc_mrr_at_100_std\": 0.0854102871442121,\n        \"nauc_mrr_at_10_diff1\": 0.4138086354915033,\n        \"nauc_mrr_at_10_max\": 0.3989755743376254,\n        \"nauc_mrr_at_10_std\": 0.08724304325932151,\n        \"nauc_mrr_at_1_diff1\": 0.4647720318783489,\n        \"nauc_mrr_at_1_max\": 0.3726092605121275,\n        \"nauc_mrr_at_1_std\": 0.05069874346527008,\n        \"nauc_mrr_at_20_diff1\": 0.4141702250960487,\n        \"nauc_mrr_at_20_max\": 0.3985579489738777,\n        \"nauc_mrr_at_20_std\": 0.08461936766142766,\n        \"nauc_mrr_at_3_diff1\": 0.4131951592928855,\n        \"nauc_mrr_at_3_max\": 0.3912898253463345,\n        \"nauc_mrr_at_3_std\": 0.06924020273458875,\n        \"nauc_mrr_at_5_diff1\": 0.4106291356397838,\n        \"nauc_mrr_at_5_max\": 0.4018937774834494,\n        \"nauc_mrr_at_5_std\": 0.08975693367426406,\n        \"nauc_ndcg_at_1000_diff1\": 0.39195098358822655,\n        \"nauc_ndcg_at_1000_max\": 0.3918858910986785,\n        \"nauc_ndcg_at_1000_std\": 0.08771090753438557,\n        \"nauc_ndcg_at_100_diff1\": 0.39104415839438417,\n        \"nauc_ndcg_at_100_max\": 0.3962634998305795,\n        \"nauc_ndcg_at_100_std\": 0.09272160089858074,\n        \"nauc_ndcg_at_10_diff1\": 0.3863953192497146,\n        \"nauc_ndcg_at_10_max\": 0.38554346803374445,\n        \"nauc_ndcg_at_10_std\": 0.08406611640534893,\n        \"nauc_ndcg_at_1_diff1\": 0.4647720318783489,\n        \"nauc_ndcg_at_1_max\": 0.3726092605121275,\n        \"nauc_ndcg_at_1_std\": 0.05069874346527008,\n        \"nauc_ndcg_at_20_diff1\": 0.37950175729603264,\n        \"nauc_ndcg_at_20_max\": 0.38392833756198785,\n        \"nauc_ndcg_at_20_std\": 0.0820759351926107,\n        \"nauc_ndcg_at_3_diff1\": 0.3912189680297108,\n        \"nauc_ndcg_at_3_max\": 0.3734691298157102,\n        \"nauc_ndcg_at_3_std\": 0.052651355500254036,\n        \"nauc_ndcg_at_5_diff1\": 0.3814458791769543,\n        \"nauc_ndcg_at_5_max\": 0.39347904278774437,\n        \"nauc_ndcg_at_5_std\": 0.09381500382630131,\n        \"nauc_precision_at_1000_diff1\": -0.12898648404854904,\n        \"nauc_precision_at_1000_max\": 0.050173585805003536,\n        \"nauc_precision_at_1000_std\": 0.13373269070320742,\n        \"nauc_precision_at_100_diff1\": -0.05502828412565439,\n        \"nauc_precision_at_100_max\": 0.14498281238555707,\n        \"nauc_precision_at_100_std\": 0.18089885274812176,\n        \"nauc_precision_at_10_diff1\": 0.08791350092212162,\n        \"nauc_precision_at_10_max\": 0.25165509721637486,\n        \"nauc_precision_at_10_std\": 0.1509702516631406,\n        \"nauc_precision_at_1_diff1\": 0.4647720318783489,\n        \"nauc_precision_at_1_max\": 0.3726092605121275,\n        \"nauc_precision_at_1_std\": 0.05069874346527008,\n        \"nauc_precision_at_20_diff1\": -0.03977766401214331,\n        \"nauc_precision_at_20_max\": 0.16065895400343622,\n        \"nauc_precision_at_20_std\": 0.14222227441113028,\n        \"nauc_precision_at_3_diff1\": 0.24874213589040703,\n        \"nauc_precision_at_3_max\": 0.350474552111039,\n        \"nauc_precision_at_3_std\": 0.07535034822396319,\n        \"nauc_precision_at_5_diff1\": 0.156423303496061,\n        \"nauc_precision_at_5_max\": 0.3363413019177353,\n        \"nauc_precision_at_5_std\": 0.17570990345202453,\n        \"nauc_recall_at_1000_diff1\": 0.31102111214763173,\n        \"nauc_recall_at_1000_max\": 0.7449072924584909,\n        \"nauc_recall_at_1000_std\": 0.38932378344859375,\n        \"nauc_recall_at_100_diff1\": 0.32095681471021337,\n        \"nauc_recall_at_100_max\": 0.6448452329637108,\n        \"nauc_recall_at_100_std\": 0.3486184419235017,\n        \"nauc_recall_at_10_diff1\": 0.3086089560455287,\n        \"nauc_recall_at_10_max\": 0.4185246680502123,\n        \"nauc_recall_at_10_std\": 0.14169850467989772,\n        \"nauc_recall_at_1_diff1\": 0.45659036090089766,\n        \"nauc_recall_at_1_max\": 0.33927633905548615,\n        \"nauc_recall_at_1_std\": 0.030288521635467035,\n        \"nauc_recall_at_20_diff1\": 0.23899533056974023,\n        \"nauc_recall_at_20_max\": 0.42735942577615504,\n        \"nauc_recall_at_20_std\": 0.13915565833927118,\n        \"nauc_recall_at_3_diff1\": 0.3312670437746897,\n        \"nauc_recall_at_3_max\": 0.36969768105139733,\n        \"nauc_recall_at_3_std\": 0.050130007567662206,\n        \"nauc_recall_at_5_diff1\": 0.30225426737864636,\n        \"nauc_recall_at_5_max\": 0.4308089065920804,\n        \"nauc_recall_at_5_std\": 0.15938912980183326,\n        \"ndcg_at_1\": 0.52019,\n        \"ndcg_at_10\": 0.64708,\n        \"ndcg_at_100\": 0.67978,\n        \"ndcg_at_1000\": 0.68529,\n        \"ndcg_at_20\": 0.66663,\n        \"ndcg_at_3\": 0.59182,\n        \"ndcg_at_5\": 0.61685,\n        \"precision_at_1\": 0.52019,\n        \"precision_at_10\": 0.09097,\n        \"precision_at_100\": 0.01088,\n        \"precision_at_1000\": 0.00114,\n        \"precision_at_20\": 0.05,\n        \"precision_at_3\": 0.2407,\n        \"precision_at_5\": 0.1601,\n        \"recall_at_1\": 0.47823,\n        \"recall_at_10\": 0.79137,\n        \"recall_at_100\": 0.92914,\n        \"recall_at_1000\": 0.97348,\n        \"recall_at_20\": 0.86382,\n        \"recall_at_3\": 0.64766,\n        \"recall_at_5\": 0.70467\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-m3/BAAI__bge-m3/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 11767.261229991913,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.43011,\n        \"map_at_1\": 0.305,\n        \"map_at_10\": 0.38785,\n        \"map_at_100\": 0.39515,\n        \"map_at_1000\": 0.39604,\n        \"map_at_20\": 0.39052,\n        \"map_at_3\": 0.36583,\n        \"map_at_5\": 0.37733,\n        \"mrr_at_1\": 0.305,\n        \"mrr_at_10\": 0.3878531746031747,\n        \"mrr_at_100\": 0.39515355720909306,\n        \"mrr_at_1000\": 0.3960379563087161,\n        \"mrr_at_20\": 0.39052307545825365,\n        \"mrr_at_3\": 0.36583333333333334,\n        \"mrr_at_5\": 0.37733333333333335,\n        \"nauc_map_at_1000_diff1\": 0.5810056203148152,\n        \"nauc_map_at_1000_max\": 0.5588819003136871,\n        \"nauc_map_at_1000_std\": 0.059712449754901524,\n        \"nauc_map_at_100_diff1\": 0.5805354442945942,\n        \"nauc_map_at_100_max\": 0.5588426603626263,\n        \"nauc_map_at_100_std\": 0.05977434254548648,\n        \"nauc_map_at_10_diff1\": 0.583233343861228,\n        \"nauc_map_at_10_max\": 0.5601596948204381,\n        \"nauc_map_at_10_std\": 0.05652632363778106,\n        \"nauc_map_at_1_diff1\": 0.6522943384528295,\n        \"nauc_map_at_1_max\": 0.5608308005418264,\n        \"nauc_map_at_1_std\": 0.0563526454473775,\n        \"nauc_map_at_20_diff1\": 0.5804005223060995,\n        \"nauc_map_at_20_max\": 0.5579725481672463,\n        \"nauc_map_at_20_std\": 0.05707539378182075,\n        \"nauc_map_at_3_diff1\": 0.60131329290114,\n        \"nauc_map_at_3_max\": 0.5664799406416307,\n        \"nauc_map_at_3_std\": 0.05032782710221144,\n        \"nauc_map_at_5_diff1\": 0.5863527663604615,\n        \"nauc_map_at_5_max\": 0.5583534314009817,\n        \"nauc_map_at_5_std\": 0.04508261866567717,\n        \"nauc_mrr_at_1000_diff1\": 0.5810056203148152,\n        \"nauc_mrr_at_1000_max\": 0.5588819003136871,\n        \"nauc_mrr_at_1000_std\": 0.059712449754901524,\n        \"nauc_mrr_at_100_diff1\": 0.5805354442945942,\n        \"nauc_mrr_at_100_max\": 0.5588426603626263,\n        \"nauc_mrr_at_100_std\": 0.05977434254548648,\n        \"nauc_mrr_at_10_diff1\": 0.583233343861228,\n        \"nauc_mrr_at_10_max\": 0.5601596948204381,\n        \"nauc_mrr_at_10_std\": 0.05652632363778106,\n        \"nauc_mrr_at_1_diff1\": 0.6522943384528295,\n        \"nauc_mrr_at_1_max\": 0.5608308005418264,\n        \"nauc_mrr_at_1_std\": 0.0563526454473775,\n        \"nauc_mrr_at_20_diff1\": 0.5804005223060995,\n        \"nauc_mrr_at_20_max\": 0.5579725481672463,\n        \"nauc_mrr_at_20_std\": 0.05707539378182075,\n        \"nauc_mrr_at_3_diff1\": 0.60131329290114,\n        \"nauc_mrr_at_3_max\": 0.5664799406416307,\n        \"nauc_mrr_at_3_std\": 0.05032782710221144,\n        \"nauc_mrr_at_5_diff1\": 0.5863527663604615,\n        \"nauc_mrr_at_5_max\": 0.5583534314009817,\n        \"nauc_mrr_at_5_std\": 0.04508261866567717,\n        \"nauc_ndcg_at_1000_diff1\": 0.5571050456061191,\n        \"nauc_ndcg_at_1000_max\": 0.5567212027776901,\n        \"nauc_ndcg_at_1000_std\": 0.08525770642536085,\n        \"nauc_ndcg_at_100_diff1\": 0.5458349516815053,\n        \"nauc_ndcg_at_100_max\": 0.5571204347773431,\n        \"nauc_ndcg_at_100_std\": 0.09310933703884099,\n        \"nauc_ndcg_at_10_diff1\": 0.5546526730229415,\n        \"nauc_ndcg_at_10_max\": 0.5557633877636018,\n        \"nauc_ndcg_at_10_std\": 0.06410434020832524,\n        \"nauc_ndcg_at_1_diff1\": 0.6522943384528295,\n        \"nauc_ndcg_at_1_max\": 0.5608308005418264,\n        \"nauc_ndcg_at_1_std\": 0.0563526454473775,\n        \"nauc_ndcg_at_20_diff1\": 0.5429081173519749,\n        \"nauc_ndcg_at_20_max\": 0.5475832962469729,\n        \"nauc_ndcg_at_20_std\": 0.06805509553296839,\n        \"nauc_ndcg_at_3_diff1\": 0.5879274570764406,\n        \"nauc_ndcg_at_3_max\": 0.5663435443475426,\n        \"nauc_ndcg_at_3_std\": 0.04678024829103677,\n        \"nauc_ndcg_at_5_diff1\": 0.5610142142367601,\n        \"nauc_ndcg_at_5_max\": 0.5515072831320688,\n        \"nauc_ndcg_at_5_std\": 0.03817704892536418,\n        \"nauc_precision_at_1000_diff1\": 0.2718420701613969,\n        \"nauc_precision_at_1000_max\": 0.5815659597172199,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 0.35817805383022844,\n        \"nauc_precision_at_100_max\": 0.571649086699255,\n        \"nauc_precision_at_100_std\": 0.3839048354098527,\n        \"nauc_precision_at_10_diff1\": 0.46273076950524145,\n        \"nauc_precision_at_10_max\": 0.5411228225420862,\n        \"nauc_precision_at_10_std\": 0.0953835394529327,\n        \"nauc_precision_at_1_diff1\": 0.6522943384528295,\n        \"nauc_precision_at_1_max\": 0.5608308005418264,\n        \"nauc_precision_at_1_std\": 0.0563526454473775,\n        \"nauc_precision_at_20_diff1\": 0.4042496940764128,\n        \"nauc_precision_at_20_max\": 0.5047814723611258,\n        \"nauc_precision_at_20_std\": 0.11872856646473169,\n        \"nauc_precision_at_3_diff1\": 0.5506419400855919,\n        \"nauc_precision_at_3_max\": 0.5653697587920712,\n        \"nauc_precision_at_3_std\": 0.03617793237319149,\n        \"nauc_precision_at_5_diff1\": 0.48499890648092314,\n        \"nauc_precision_at_5_max\": 0.5289053542670439,\n        \"nauc_precision_at_5_std\": 0.017118544095328325,\n        \"nauc_recall_at_1000_diff1\": 0.271842070161403,\n        \"nauc_recall_at_1000_max\": 0.5815659597172216,\n        \"nauc_recall_at_1000_std\": 1.0,\n        \"nauc_recall_at_100_diff1\": 0.35817805383022694,\n        \"nauc_recall_at_100_max\": 0.5716490866992541,\n        \"nauc_recall_at_100_std\": 0.38390483540985126,\n        \"nauc_recall_at_10_diff1\": 0.4627307695052414,\n        \"nauc_recall_at_10_max\": 0.5411228225420865,\n        \"nauc_recall_at_10_std\": 0.09538353945293275,\n        \"nauc_recall_at_1_diff1\": 0.6522943384528295,\n        \"nauc_recall_at_1_max\": 0.5608308005418264,\n        \"nauc_recall_at_1_std\": 0.0563526454473775,\n        \"nauc_recall_at_20_diff1\": 0.4042496940764129,\n        \"nauc_recall_at_20_max\": 0.5047814723611256,\n        \"nauc_recall_at_20_std\": 0.11872856646473179,\n        \"nauc_recall_at_3_diff1\": 0.5506419400855921,\n        \"nauc_recall_at_3_max\": 0.5653697587920716,\n        \"nauc_recall_at_3_std\": 0.03617793237319166,\n        \"nauc_recall_at_5_diff1\": 0.48499890648092314,\n        \"nauc_recall_at_5_max\": 0.5289053542670441,\n        \"nauc_recall_at_5_std\": 0.017118544095328505,\n        \"ndcg_at_1\": 0.305,\n        \"ndcg_at_10\": 0.43011,\n        \"ndcg_at_100\": 0.47499,\n        \"ndcg_at_1000\": 0.49695,\n        \"ndcg_at_20\": 0.44091,\n        \"ndcg_at_3\": 0.38375,\n        \"ndcg_at_5\": 0.4044,\n        \"precision_at_1\": 0.305,\n        \"precision_at_10\": 0.0565,\n        \"precision_at_100\": 0.00795,\n        \"precision_at_1000\": 0.00097,\n        \"precision_at_20\": 0.0305,\n        \"precision_at_3\": 0.145,\n        \"precision_at_5\": 0.097,\n        \"recall_at_1\": 0.305,\n        \"recall_at_10\": 0.565,\n        \"recall_at_100\": 0.795,\n        \"recall_at_1000\": 0.965,\n        \"recall_at_20\": 0.61,\n        \"recall_at_3\": 0.435,\n        \"recall_at_5\": 0.485\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.42728,\n        \"map_at_1\": 0.315,\n        \"map_at_10\": 0.38977,\n        \"map_at_100\": 0.39754,\n        \"map_at_1000\": 0.39831,\n        \"map_at_20\": 0.39356,\n        \"map_at_3\": 0.37,\n        \"map_at_5\": 0.38475,\n        \"mrr_at_1\": 0.315,\n        \"mrr_at_10\": 0.3897698412698414,\n        \"mrr_at_100\": 0.397541530350222,\n        \"mrr_at_1000\": 0.39831436476698917,\n        \"mrr_at_20\": 0.39356284197828323,\n        \"mrr_at_3\": 0.37,\n        \"mrr_at_5\": 0.3847500000000001,\n        \"nauc_map_at_1000_diff1\": 0.6597900579101365,\n        \"nauc_map_at_1000_max\": 0.4743814969593238,\n        \"nauc_map_at_1000_std\": 0.04456937650037774,\n        \"nauc_map_at_100_diff1\": 0.6595578028145409,\n        \"nauc_map_at_100_max\": 0.4746207529903431,\n        \"nauc_map_at_100_std\": 0.04469464306791652,\n        \"nauc_map_at_10_diff1\": 0.6584969505864283,\n        \"nauc_map_at_10_max\": 0.4726482183566381,\n        \"nauc_map_at_10_std\": 0.03992466480001028,\n        \"nauc_map_at_1_diff1\": 0.6806754246551459,\n        \"nauc_map_at_1_max\": 0.4481595482862911,\n        \"nauc_map_at_1_std\": -0.03792893019762483,\n        \"nauc_map_at_20_diff1\": 0.6602038571715491,\n        \"nauc_map_at_20_max\": 0.4750531319415043,\n        \"nauc_map_at_20_std\": 0.04278409018479869,\n        \"nauc_map_at_3_diff1\": 0.6690542521026155,\n        \"nauc_map_at_3_max\": 0.4683804468855765,\n        \"nauc_map_at_3_std\": 0.01923821721086023,\n        \"nauc_map_at_5_diff1\": 0.6675321967565364,\n        \"nauc_map_at_5_max\": 0.4740915890417542,\n        \"nauc_map_at_5_std\": 0.03970725804693442,\n        \"nauc_mrr_at_1000_diff1\": 0.6597900579101365,\n        \"nauc_mrr_at_1000_max\": 0.4743814969593238,\n        \"nauc_mrr_at_1000_std\": 0.04456937650037774,\n        \"nauc_mrr_at_100_diff1\": 0.6595578028145409,\n        \"nauc_mrr_at_100_max\": 0.4746207529903431,\n        \"nauc_mrr_at_100_std\": 0.04469464306791652,\n        \"nauc_mrr_at_10_diff1\": 0.6584969505864283,\n        \"nauc_mrr_at_10_max\": 0.4726482183566381,\n        \"nauc_mrr_at_10_std\": 0.03992466480001028,\n        \"nauc_mrr_at_1_diff1\": 0.6806754246551459,\n        \"nauc_mrr_at_1_max\": 0.4481595482862911,\n        \"nauc_mrr_at_1_std\": -0.03792893019762483,\n        \"nauc_mrr_at_20_diff1\": 0.6602038571715491,\n        \"nauc_mrr_at_20_max\": 0.4750531319415043,\n        \"nauc_mrr_at_20_std\": 0.04278409018479869,\n        \"nauc_mrr_at_3_diff1\": 0.6690542521026155,\n        \"nauc_mrr_at_3_max\": 0.4683804468855765,\n        \"nauc_mrr_at_3_std\": 0.01923821721086023,\n        \"nauc_mrr_at_5_diff1\": 0.6675321967565364,\n        \"nauc_mrr_at_5_max\": 0.4740915890417542,\n        \"nauc_mrr_at_5_std\": 0.03970725804693442,\n        \"nauc_ndcg_at_1000_diff1\": 0.642790367735302,\n        \"nauc_ndcg_at_1000_max\": 0.4799335985943758,\n        \"nauc_ndcg_at_1000_std\": 0.09173020382279143,\n        \"nauc_ndcg_at_100_diff1\": 0.6358413267468765,\n        \"nauc_ndcg_at_100_max\": 0.482234434494922,\n        \"nauc_ndcg_at_100_std\": 0.10276963770578404,\n        \"nauc_ndcg_at_10_diff1\": 0.6357168723135498,\n        \"nauc_ndcg_at_10_max\": 0.47785124426174147,\n        \"nauc_ndcg_at_10_std\": 0.07606618544656002,\n        \"nauc_ndcg_at_1_diff1\": 0.6806754246551459,\n        \"nauc_ndcg_at_1_max\": 0.4481595482862911,\n        \"nauc_ndcg_at_1_std\": -0.03792893019762483,\n        \"nauc_ndcg_at_20_diff1\": 0.6416960939448727,\n        \"nauc_ndcg_at_20_max\": 0.48480138347365553,\n        \"nauc_ndcg_at_20_std\": 0.08688008419865503,\n        \"nauc_ndcg_at_3_diff1\": 0.6617572971976259,\n        \"nauc_ndcg_at_3_max\": 0.4706892075831608,\n        \"nauc_ndcg_at_3_std\": 0.03690585168881346,\n        \"nauc_ndcg_at_5_diff1\": 0.6585927852329279,\n        \"nauc_ndcg_at_5_max\": 0.48058093705348043,\n        \"nauc_ndcg_at_5_std\": 0.07384049008083444,\n        \"nauc_precision_at_1000_diff1\": 0.3869281045751624,\n        \"nauc_precision_at_1000_max\": 0.562231559290378,\n        \"nauc_precision_at_1000_std\": 0.8977591036414542,\n        \"nauc_precision_at_100_diff1\": 0.49931859479103574,\n        \"nauc_precision_at_100_max\": 0.515585792160596,\n        \"nauc_precision_at_100_std\": 0.44370295059271386,\n        \"nauc_precision_at_10_diff1\": 0.55474625865067,\n        \"nauc_precision_at_10_max\": 0.49297820485065996,\n        \"nauc_precision_at_10_std\": 0.19283225207231972,\n        \"nauc_precision_at_1_diff1\": 0.6806754246551459,\n        \"nauc_precision_at_1_max\": 0.4481595482862911,\n        \"nauc_precision_at_1_std\": -0.03792893019762483,\n        \"nauc_precision_at_20_diff1\": 0.5748392264903835,\n        \"nauc_precision_at_20_max\": 0.5196634050294592,\n        \"nauc_precision_at_20_std\": 0.24749013647967752,\n        \"nauc_precision_at_3_diff1\": 0.6397987680743332,\n        \"nauc_precision_at_3_max\": 0.47603356475439784,\n        \"nauc_precision_at_3_std\": 0.08725922639244146,\n        \"nauc_precision_at_5_diff1\": 0.6306978363790986,\n        \"nauc_precision_at_5_max\": 0.4993337038698742,\n        \"nauc_precision_at_5_std\": 0.17841334467264405,\n        \"nauc_recall_at_1000_diff1\": 0.38692810457516086,\n        \"nauc_recall_at_1000_max\": 0.5622315592903827,\n        \"nauc_recall_at_1000_std\": 0.8977591036414535,\n        \"nauc_recall_at_100_diff1\": 0.4993185947910358,\n        \"nauc_recall_at_100_max\": 0.5155857921605947,\n        \"nauc_recall_at_100_std\": 0.4437029505927141,\n        \"nauc_recall_at_10_diff1\": 0.5547462586506702,\n        \"nauc_recall_at_10_max\": 0.49297820485066035,\n        \"nauc_recall_at_10_std\": 0.19283225207231988,\n        \"nauc_recall_at_1_diff1\": 0.6806754246551459,\n        \"nauc_recall_at_1_max\": 0.4481595482862911,\n        \"nauc_recall_at_1_std\": -0.03792893019762483,\n        \"nauc_recall_at_20_diff1\": 0.5748392264903833,\n        \"nauc_recall_at_20_max\": 0.5196634050294594,\n        \"nauc_recall_at_20_std\": 0.2474901364796777,\n        \"nauc_recall_at_3_diff1\": 0.6397987680743328,\n        \"nauc_recall_at_3_max\": 0.47603356475439795,\n        \"nauc_recall_at_3_std\": 0.08725922639244142,\n        \"nauc_recall_at_5_diff1\": 0.6306978363790989,\n        \"nauc_recall_at_5_max\": 0.4993337038698746,\n        \"nauc_recall_at_5_std\": 0.17841334467264416,\n        \"ndcg_at_1\": 0.315,\n        \"ndcg_at_10\": 0.42728,\n        \"ndcg_at_100\": 0.47081,\n        \"ndcg_at_1000\": 0.49414,\n        \"ndcg_at_20\": 0.44197,\n        \"ndcg_at_3\": 0.38797,\n        \"ndcg_at_5\": 0.41465,\n        \"precision_at_1\": 0.315,\n        \"precision_at_10\": 0.0545,\n        \"precision_at_100\": 0.0076,\n        \"precision_at_1000\": 0.00095,\n        \"precision_at_20\": 0.03025,\n        \"precision_at_3\": 0.14667,\n        \"precision_at_5\": 0.101,\n        \"recall_at_1\": 0.315,\n        \"recall_at_10\": 0.545,\n        \"recall_at_100\": 0.76,\n        \"recall_at_1000\": 0.95,\n        \"recall_at_20\": 0.605,\n        \"recall_at_3\": 0.44,\n        \"recall_at_5\": 0.505\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-m3/BAAI__bge-m3/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 3.1353759765625,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.80412,\n        \"map_at_1\": 0.67532,\n        \"map_at_10\": 0.76239,\n        \"map_at_100\": 0.7653,\n        \"map_at_1000\": 0.7653,\n        \"map_at_20\": 0.76444,\n        \"map_at_3\": 0.74459,\n        \"map_at_5\": 0.75368,\n        \"mrr_at_1\": 0.6753246753246753,\n        \"mrr_at_10\": 0.7623891981034839,\n        \"mrr_at_100\": 0.765300226623,\n        \"mrr_at_1000\": 0.765300226623,\n        \"mrr_at_20\": 0.7644356365135587,\n        \"mrr_at_3\": 0.7445887445887447,\n        \"mrr_at_5\": 0.7536796536796538,\n        \"nauc_map_at_1000_diff1\": 0.5979237469677664,\n        \"nauc_map_at_1000_max\": 0.2924115950702348,\n        \"nauc_map_at_1000_std\": -0.17318296732546787,\n        \"nauc_map_at_100_diff1\": 0.5979237469677664,\n        \"nauc_map_at_100_max\": 0.2924115950702348,\n        \"nauc_map_at_100_std\": -0.17318296732546787,\n        \"nauc_map_at_10_diff1\": 0.596903792453234,\n        \"nauc_map_at_10_max\": 0.2933935645857382,\n        \"nauc_map_at_10_std\": -0.1870047943320845,\n        \"nauc_map_at_1_diff1\": 0.6562465610611244,\n        \"nauc_map_at_1_max\": 0.2923486241773153,\n        \"nauc_map_at_1_std\": -0.14113187264225374,\n        \"nauc_map_at_20_diff1\": 0.5948084784833071,\n        \"nauc_map_at_20_max\": 0.2898190873177562,\n        \"nauc_map_at_20_std\": -0.17399345717993836,\n        \"nauc_map_at_3_diff1\": 0.5882399698411667,\n        \"nauc_map_at_3_max\": 0.3008896632226807,\n        \"nauc_map_at_3_std\": -0.15775222111292986,\n        \"nauc_map_at_5_diff1\": 0.6011825802675416,\n        \"nauc_map_at_5_max\": 0.2896018482846817,\n        \"nauc_map_at_5_std\": -0.1893640157933465,\n        \"nauc_mrr_at_1000_diff1\": 0.5979237469677664,\n        \"nauc_mrr_at_1000_max\": 0.2924115950702348,\n        \"nauc_mrr_at_1000_std\": -0.17318296732546787,\n        \"nauc_mrr_at_100_diff1\": 0.5979237469677664,\n        \"nauc_mrr_at_100_max\": 0.2924115950702348,\n        \"nauc_mrr_at_100_std\": -0.17318296732546787,\n        \"nauc_mrr_at_10_diff1\": 0.596903792453234,\n        \"nauc_mrr_at_10_max\": 0.2933935645857382,\n        \"nauc_mrr_at_10_std\": -0.1870047943320845,\n        \"nauc_mrr_at_1_diff1\": 0.6562465610611244,\n        \"nauc_mrr_at_1_max\": 0.2923486241773153,\n        \"nauc_mrr_at_1_std\": -0.14113187264225374,\n        \"nauc_mrr_at_20_diff1\": 0.5948084784833071,\n        \"nauc_mrr_at_20_max\": 0.2898190873177562,\n        \"nauc_mrr_at_20_std\": -0.17399345717993836,\n        \"nauc_mrr_at_3_diff1\": 0.5882399698411667,\n        \"nauc_mrr_at_3_max\": 0.3008896632226807,\n        \"nauc_mrr_at_3_std\": -0.15775222111292986,\n        \"nauc_mrr_at_5_diff1\": 0.6011825802675416,\n        \"nauc_mrr_at_5_max\": 0.2896018482846817,\n        \"nauc_mrr_at_5_std\": -0.1893640157933465,\n        \"nauc_ndcg_at_1000_diff1\": 0.5863829285899035,\n        \"nauc_ndcg_at_1000_max\": 0.2862629130506407,\n        \"nauc_ndcg_at_1000_std\": -0.1801172856670342,\n        \"nauc_ndcg_at_100_diff1\": 0.5863829285899035,\n        \"nauc_ndcg_at_100_max\": 0.2862629130506407,\n        \"nauc_ndcg_at_100_std\": -0.1801172856670342,\n        \"nauc_ndcg_at_10_diff1\": 0.5691397820536505,\n        \"nauc_ndcg_at_10_max\": 0.27936017201735985,\n        \"nauc_ndcg_at_10_std\": -0.23489702342436491,\n        \"nauc_ndcg_at_1_diff1\": 0.6562465610611244,\n        \"nauc_ndcg_at_1_max\": 0.2923486241773153,\n        \"nauc_ndcg_at_1_std\": -0.14113187264225374,\n        \"nauc_ndcg_at_20_diff1\": 0.5596142899845385,\n        \"nauc_ndcg_at_20_max\": 0.2643206426149416,\n        \"nauc_ndcg_at_20_std\": -0.1841509467955105,\n        \"nauc_ndcg_at_3_diff1\": 0.5594550811473704,\n        \"nauc_ndcg_at_3_max\": 0.2957261118765833,\n        \"nauc_ndcg_at_3_std\": -0.1669115648012619,\n        \"nauc_ndcg_at_5_diff1\": 0.5816286642082346,\n        \"nauc_ndcg_at_5_max\": 0.2715504531622847,\n        \"nauc_ndcg_at_5_std\": -0.231577091224693,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.31051762722087517,\n        \"nauc_precision_at_10_max\": 0.13450912346094948,\n        \"nauc_precision_at_10_std\": -0.7262196475190367,\n        \"nauc_precision_at_1_diff1\": 0.6562465610611244,\n        \"nauc_precision_at_1_max\": 0.2923486241773153,\n        \"nauc_precision_at_1_std\": -0.14113187264225374,\n        \"nauc_precision_at_20_diff1\": -0.012909070638074602,\n        \"nauc_precision_at_20_max\": -0.20163456083414846,\n        \"nauc_precision_at_20_std\": -0.2453969933433873,\n        \"nauc_precision_at_3_diff1\": 0.44361177715468525,\n        \"nauc_precision_at_3_max\": 0.2714359789930319,\n        \"nauc_precision_at_3_std\": -0.20462224480229224,\n        \"nauc_precision_at_5_diff1\": 0.4887066625206391,\n        \"nauc_precision_at_5_max\": 0.1715034869029589,\n        \"nauc_precision_at_5_std\": -0.45582172416288225,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.31051762722087156,\n        \"nauc_recall_at_10_max\": 0.13450912346094304,\n        \"nauc_recall_at_10_std\": -0.7262196475190429,\n        \"nauc_recall_at_1_diff1\": 0.6562465610611244,\n        \"nauc_recall_at_1_max\": 0.2923486241773153,\n        \"nauc_recall_at_1_std\": -0.14113187264225374,\n        \"nauc_recall_at_20_diff1\": -0.012909070638077955,\n        \"nauc_recall_at_20_max\": -0.20163456083415854,\n        \"nauc_recall_at_20_std\": -0.2453969933433915,\n        \"nauc_recall_at_3_diff1\": 0.4436117771546839,\n        \"nauc_recall_at_3_max\": 0.27143597899302946,\n        \"nauc_recall_at_3_std\": -0.2046222448022942,\n        \"nauc_recall_at_5_diff1\": 0.4887066625206389,\n        \"nauc_recall_at_5_max\": 0.1715034869029567,\n        \"nauc_recall_at_5_std\": -0.4558217241628853,\n        \"ndcg_at_1\": 0.67532,\n        \"ndcg_at_10\": 0.80412,\n        \"ndcg_at_100\": 0.81803,\n        \"ndcg_at_1000\": 0.81803,\n        \"ndcg_at_20\": 0.81099,\n        \"ndcg_at_3\": 0.76685,\n        \"ndcg_at_5\": 0.78306,\n        \"precision_at_1\": 0.67532,\n        \"precision_at_10\": 0.09351,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04805,\n        \"precision_at_3\": 0.27706,\n        \"precision_at_5\": 0.17403,\n        \"recall_at_1\": 0.67532,\n        \"recall_at_10\": 0.93506,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96104,\n        \"recall_at_3\": 0.83117,\n        \"recall_at_5\": 0.87013\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-m3/BAAI__bge-m3/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 14.820614337921143,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.36075,\n        \"map_at_1\": 0.20869,\n        \"map_at_10\": 0.31251,\n        \"map_at_100\": 0.32829,\n        \"map_at_1000\": 0.3295,\n        \"map_at_20\": 0.32044,\n        \"map_at_3\": 0.27927,\n        \"map_at_5\": 0.29813,\n        \"mrr_at_1\": 0.2981651376146789,\n        \"mrr_at_10\": 0.36110868404446383,\n        \"mrr_at_100\": 0.37293569979489216,\n        \"mrr_at_1000\": 0.37373096839382697,\n        \"mrr_at_20\": 0.36738264151456124,\n        \"mrr_at_3\": 0.3399592252803263,\n        \"mrr_at_5\": 0.3518093781855251,\n        \"nauc_map_at_1000_diff1\": 0.4362409385792419,\n        \"nauc_map_at_1000_max\": 0.1800486478837926,\n        \"nauc_map_at_1000_std\": -0.26553196504621107,\n        \"nauc_map_at_100_diff1\": 0.43620257998412865,\n        \"nauc_map_at_100_max\": 0.18041121730191945,\n        \"nauc_map_at_100_std\": -0.2647152938362735,\n        \"nauc_map_at_10_diff1\": 0.4365198864276503,\n        \"nauc_map_at_10_max\": 0.17654502923161086,\n        \"nauc_map_at_10_std\": -0.27053686219361156,\n        \"nauc_map_at_1_diff1\": 0.4775455448698503,\n        \"nauc_map_at_1_max\": 0.14025200235237892,\n        \"nauc_map_at_1_std\": -0.24531006529699495,\n        \"nauc_map_at_20_diff1\": 0.4372089574951557,\n        \"nauc_map_at_20_max\": 0.17841296368749265,\n        \"nauc_map_at_20_std\": -0.27054609403498514,\n        \"nauc_map_at_3_diff1\": 0.43961166664937285,\n        \"nauc_map_at_3_max\": 0.1732670244304699,\n        \"nauc_map_at_3_std\": -0.2687298321809951,\n        \"nauc_map_at_5_diff1\": 0.43149891318406053,\n        \"nauc_map_at_5_max\": 0.1698123078445682,\n        \"nauc_map_at_5_std\": -0.27170327177369624,\n        \"nauc_mrr_at_1000_diff1\": 0.4624744241639784,\n        \"nauc_mrr_at_1000_max\": 0.1731885093497636,\n        \"nauc_mrr_at_1000_std\": -0.26682701100639095,\n        \"nauc_mrr_at_100_diff1\": 0.46224820778311054,\n        \"nauc_mrr_at_100_max\": 0.17381712611397718,\n        \"nauc_mrr_at_100_std\": -0.2658464744036903,\n        \"nauc_mrr_at_10_diff1\": 0.4646238026569186,\n        \"nauc_mrr_at_10_max\": 0.17108141117685932,\n        \"nauc_mrr_at_10_std\": -0.2709506520398262,\n        \"nauc_mrr_at_1_diff1\": 0.4795989047978672,\n        \"nauc_mrr_at_1_max\": 0.1613152106252518,\n        \"nauc_mrr_at_1_std\": -0.2794729237371355,\n        \"nauc_mrr_at_20_diff1\": 0.4625648951242374,\n        \"nauc_mrr_at_20_max\": 0.17240416545488282,\n        \"nauc_mrr_at_20_std\": -0.26933954811207755,\n        \"nauc_mrr_at_3_diff1\": 0.46485773566608873,\n        \"nauc_mrr_at_3_max\": 0.16259516847114316,\n        \"nauc_mrr_at_3_std\": -0.2792100954377753,\n        \"nauc_mrr_at_5_diff1\": 0.4634993684884953,\n        \"nauc_mrr_at_5_max\": 0.16570511771454952,\n        \"nauc_mrr_at_5_std\": -0.2776998684810224,\n        \"nauc_ndcg_at_1000_diff1\": 0.4369497458665596,\n        \"nauc_ndcg_at_1000_max\": 0.1915032282436996,\n        \"nauc_ndcg_at_1000_std\": -0.24616957979834705,\n        \"nauc_ndcg_at_100_diff1\": 0.4309501960061425,\n        \"nauc_ndcg_at_100_max\": 0.2039078472412195,\n        \"nauc_ndcg_at_100_std\": -0.22259433873748213,\n        \"nauc_ndcg_at_10_diff1\": 0.4391876806744528,\n        \"nauc_ndcg_at_10_max\": 0.18210353909233828,\n        \"nauc_ndcg_at_10_std\": -0.26517297046778904,\n        \"nauc_ndcg_at_1_diff1\": 0.4739748753019021,\n        \"nauc_ndcg_at_1_max\": 0.16470793869325873,\n        \"nauc_ndcg_at_1_std\": -0.2736602237293781,\n        \"nauc_ndcg_at_20_diff1\": 0.43610809749086343,\n        \"nauc_ndcg_at_20_max\": 0.18705830469730586,\n        \"nauc_ndcg_at_20_std\": -0.262436971587048,\n        \"nauc_ndcg_at_3_diff1\": 0.4404524148865511,\n        \"nauc_ndcg_at_3_max\": 0.16685181632799478,\n        \"nauc_ndcg_at_3_std\": -0.2760472904229075,\n        \"nauc_ndcg_at_5_diff1\": 0.43175905189077163,\n        \"nauc_ndcg_at_5_max\": 0.16802255171664907,\n        \"nauc_ndcg_at_5_std\": -0.27313213116694535,\n        \"nauc_precision_at_1000_diff1\": 0.005738353521907607,\n        \"nauc_precision_at_1000_max\": 0.12700703924892656,\n        \"nauc_precision_at_1000_std\": 0.07119374603768011,\n        \"nauc_precision_at_100_diff1\": 0.11322430246123903,\n        \"nauc_precision_at_100_max\": 0.20523244705487917,\n        \"nauc_precision_at_100_std\": 0.06400716793210835,\n        \"nauc_precision_at_10_diff1\": 0.28455008810078686,\n        \"nauc_precision_at_10_max\": 0.1643627103941248,\n        \"nauc_precision_at_10_std\": -0.21860014184635101,\n        \"nauc_precision_at_1_diff1\": 0.4739748753019021,\n        \"nauc_precision_at_1_max\": 0.16470793869325873,\n        \"nauc_precision_at_1_std\": -0.2736602237293781,\n        \"nauc_precision_at_20_diff1\": 0.25222565983172496,\n        \"nauc_precision_at_20_max\": 0.16477777191116325,\n        \"nauc_precision_at_20_std\": -0.18651987868268488,\n        \"nauc_precision_at_3_diff1\": 0.3378333070589199,\n        \"nauc_precision_at_3_max\": 0.18122173410071726,\n        \"nauc_precision_at_3_std\": -0.2567043215963174,\n        \"nauc_precision_at_5_diff1\": 0.290729541778719,\n        \"nauc_precision_at_5_max\": 0.1554550049956641,\n        \"nauc_precision_at_5_std\": -0.24180845484190416,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.3078252171240789,\n        \"nauc_recall_at_100_max\": 0.3384084172097074,\n        \"nauc_recall_at_100_std\": 0.07928212220425672,\n        \"nauc_recall_at_10_diff1\": 0.3988096195861225,\n        \"nauc_recall_at_10_max\": 0.19381012460429922,\n        \"nauc_recall_at_10_std\": -0.23436828228388612,\n        \"nauc_recall_at_1_diff1\": 0.4775455448698503,\n        \"nauc_recall_at_1_max\": 0.14025200235237892,\n        \"nauc_recall_at_1_std\": -0.24531006529699495,\n        \"nauc_recall_at_20_diff1\": 0.37800523343844544,\n        \"nauc_recall_at_20_max\": 0.2084767289752829,\n        \"nauc_recall_at_20_std\": -0.22265254957557698,\n        \"nauc_recall_at_3_diff1\": 0.4118684124430158,\n        \"nauc_recall_at_3_max\": 0.15919744597863614,\n        \"nauc_recall_at_3_std\": -0.26957065331521735,\n        \"nauc_recall_at_5_diff1\": 0.3872357077075556,\n        \"nauc_recall_at_5_max\": 0.15746330901970873,\n        \"nauc_recall_at_5_std\": -0.2632903690243722,\n        \"ndcg_at_1\": 0.29969,\n        \"ndcg_at_10\": 0.36075,\n        \"ndcg_at_100\": 0.438,\n        \"ndcg_at_1000\": 0.46551,\n        \"ndcg_at_20\": 0.38676,\n        \"ndcg_at_3\": 0.30866,\n        \"ndcg_at_5\": 0.33199,\n        \"precision_at_1\": 0.29969,\n        \"precision_at_10\": 0.07339,\n        \"precision_at_100\": 0.01275,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.04373,\n        \"precision_at_3\": 0.16769,\n        \"precision_at_5\": 0.12049,\n        \"recall_at_1\": 0.20869,\n        \"recall_at_10\": 0.4565,\n        \"recall_at_100\": 0.80196,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.55059,\n        \"recall_at_3\": 0.32164,\n        \"recall_at_5\": 0.37734\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.34097,\n        \"map_at_1\": 0.15329,\n        \"map_at_10\": 0.28211,\n        \"map_at_100\": 0.30033,\n        \"map_at_1000\": 0.30226,\n        \"map_at_20\": 0.29105,\n        \"map_at_3\": 0.23869,\n        \"map_at_5\": 0.26591,\n        \"mrr_at_1\": 0.2599388379204893,\n        \"mrr_at_10\": 0.34867057424396874,\n        \"mrr_at_100\": 0.35994203378643586,\n        \"mrr_at_1000\": 0.36064997729462694,\n        \"mrr_at_20\": 0.3539873685171496,\n        \"mrr_at_3\": 0.3246687054026505,\n        \"mrr_at_5\": 0.33904179408766577,\n        \"nauc_map_at_1000_diff1\": 0.4022637216689636,\n        \"nauc_map_at_1000_max\": 0.011405819834518141,\n        \"nauc_map_at_1000_std\": -0.3304653513589999,\n        \"nauc_map_at_100_diff1\": 0.4015497416795462,\n        \"nauc_map_at_100_max\": 0.00999834034490326,\n        \"nauc_map_at_100_std\": -0.3315000593794023,\n        \"nauc_map_at_10_diff1\": 0.4050857717148575,\n        \"nauc_map_at_10_max\": 0.007792945212886593,\n        \"nauc_map_at_10_std\": -0.33401676582266493,\n        \"nauc_map_at_1_diff1\": 0.49852568637580613,\n        \"nauc_map_at_1_max\": 0.02404894735225604,\n        \"nauc_map_at_1_std\": -0.2958887726957041,\n        \"nauc_map_at_20_diff1\": 0.40291247339467057,\n        \"nauc_map_at_20_max\": 0.008587253687752358,\n        \"nauc_map_at_20_std\": -0.33421441567561455,\n        \"nauc_map_at_3_diff1\": 0.4222013776089469,\n        \"nauc_map_at_3_max\": 0.010136085993912492,\n        \"nauc_map_at_3_std\": -0.3217815240658463,\n        \"nauc_map_at_5_diff1\": 0.40647453183337523,\n        \"nauc_map_at_5_max\": 0.00784040840222447,\n        \"nauc_map_at_5_std\": -0.333646684697192,\n        \"nauc_mrr_at_1000_diff1\": 0.42172847950756187,\n        \"nauc_mrr_at_1000_max\": 0.030659369617223816,\n        \"nauc_mrr_at_1000_std\": -0.3294606914183562,\n        \"nauc_mrr_at_100_diff1\": 0.42121093117322805,\n        \"nauc_mrr_at_100_max\": 0.030771466732591353,\n        \"nauc_mrr_at_100_std\": -0.32908633822077565,\n        \"nauc_mrr_at_10_diff1\": 0.42269462574679667,\n        \"nauc_mrr_at_10_max\": 0.02890850927456576,\n        \"nauc_mrr_at_10_std\": -0.33308852547287354,\n        \"nauc_mrr_at_1_diff1\": 0.4932698402485779,\n        \"nauc_mrr_at_1_max\": 0.057147760742959436,\n        \"nauc_mrr_at_1_std\": -0.33036442287893925,\n        \"nauc_mrr_at_20_diff1\": 0.4222852986333038,\n        \"nauc_mrr_at_20_max\": 0.029630418083217754,\n        \"nauc_mrr_at_20_std\": -0.33077727396662693,\n        \"nauc_mrr_at_3_diff1\": 0.4221909842276611,\n        \"nauc_mrr_at_3_max\": 0.027951377591010493,\n        \"nauc_mrr_at_3_std\": -0.33298500148454946,\n        \"nauc_mrr_at_5_diff1\": 0.42174716322716244,\n        \"nauc_mrr_at_5_max\": 0.026063202507198405,\n        \"nauc_mrr_at_5_std\": -0.33793652527089124,\n        \"nauc_ndcg_at_1000_diff1\": 0.389985021344595,\n        \"nauc_ndcg_at_1000_max\": 0.025478227758486245,\n        \"nauc_ndcg_at_1000_std\": -0.3135560630292576,\n        \"nauc_ndcg_at_100_diff1\": 0.3736204768886421,\n        \"nauc_ndcg_at_100_max\": 0.01822183922412112,\n        \"nauc_ndcg_at_100_std\": -0.3119570550697157,\n        \"nauc_ndcg_at_10_diff1\": 0.3877510519245756,\n        \"nauc_ndcg_at_10_max\": 0.004903649764391959,\n        \"nauc_ndcg_at_10_std\": -0.33622046849680726,\n        \"nauc_ndcg_at_1_diff1\": 0.4932698402485779,\n        \"nauc_ndcg_at_1_max\": 0.057147760742959436,\n        \"nauc_ndcg_at_1_std\": -0.33036442287893925,\n        \"nauc_ndcg_at_20_diff1\": 0.382337268651163,\n        \"nauc_ndcg_at_20_max\": 0.005347611162799741,\n        \"nauc_ndcg_at_20_std\": -0.3333227743975014,\n        \"nauc_ndcg_at_3_diff1\": 0.3958505613149547,\n        \"nauc_ndcg_at_3_max\": 0.01333717863280632,\n        \"nauc_ndcg_at_3_std\": -0.3269820535215641,\n        \"nauc_ndcg_at_5_diff1\": 0.3891041993512005,\n        \"nauc_ndcg_at_5_max\": 0.004872403771688151,\n        \"nauc_ndcg_at_5_std\": -0.33796576122118294,\n        \"nauc_precision_at_1000_diff1\": 0.018385980950516967,\n        \"nauc_precision_at_1000_max\": 0.10829418337507772,\n        \"nauc_precision_at_1000_std\": 0.012377008907229219,\n        \"nauc_precision_at_100_diff1\": 0.052371030353125736,\n        \"nauc_precision_at_100_max\": 0.07423047732844952,\n        \"nauc_precision_at_100_std\": -0.0750545936290214,\n        \"nauc_precision_at_10_diff1\": 0.19232194764074734,\n        \"nauc_precision_at_10_max\": -0.0033784513521296126,\n        \"nauc_precision_at_10_std\": -0.2798787278299724,\n        \"nauc_precision_at_1_diff1\": 0.4932698402485779,\n        \"nauc_precision_at_1_max\": 0.057147760742959436,\n        \"nauc_precision_at_1_std\": -0.33036442287893925,\n        \"nauc_precision_at_20_diff1\": 0.1628337505030489,\n        \"nauc_precision_at_20_max\": 0.008810919798039354,\n        \"nauc_precision_at_20_std\": -0.24592783621714245,\n        \"nauc_precision_at_3_diff1\": 0.2603627393385583,\n        \"nauc_precision_at_3_max\": 0.00461726406111989,\n        \"nauc_precision_at_3_std\": -0.3148008782795308,\n        \"nauc_precision_at_5_diff1\": 0.21110877531171163,\n        \"nauc_precision_at_5_max\": -0.0035837827562565593,\n        \"nauc_precision_at_5_std\": -0.3142870970521295,\n        \"nauc_recall_at_1000_diff1\": 0.5720905885610953,\n        \"nauc_recall_at_1000_max\": 0.459646771815093,\n        \"nauc_recall_at_1000_std\": 0.35316247214157614,\n        \"nauc_recall_at_100_diff1\": 0.16627657178276536,\n        \"nauc_recall_at_100_max\": 0.01909966925378612,\n        \"nauc_recall_at_100_std\": -0.16809671666048576,\n        \"nauc_recall_at_10_diff1\": 0.3097083306895549,\n        \"nauc_recall_at_10_max\": -0.0150857823864439,\n        \"nauc_recall_at_10_std\": -0.3107430801334924,\n        \"nauc_recall_at_1_diff1\": 0.49852568637580613,\n        \"nauc_recall_at_1_max\": 0.02404894735225604,\n        \"nauc_recall_at_1_std\": -0.2958887726957041,\n        \"nauc_recall_at_20_diff1\": 0.286070471392095,\n        \"nauc_recall_at_20_max\": -0.022532940637716797,\n        \"nauc_recall_at_20_std\": -0.30186268870653005,\n        \"nauc_recall_at_3_diff1\": 0.33628511779923886,\n        \"nauc_recall_at_3_max\": -0.006004096452956056,\n        \"nauc_recall_at_3_std\": -0.29302186995925117,\n        \"nauc_recall_at_5_diff1\": 0.31865956050985655,\n        \"nauc_recall_at_5_max\": -0.0127304827540012,\n        \"nauc_recall_at_5_std\": -0.3175634383646668,\n        \"ndcg_at_1\": 0.25994,\n        \"ndcg_at_10\": 0.34097,\n        \"ndcg_at_100\": 0.42407,\n        \"ndcg_at_1000\": 0.45495,\n        \"ndcg_at_20\": 0.36704,\n        \"ndcg_at_3\": 0.28859,\n        \"ndcg_at_5\": 0.31071,\n        \"precision_at_1\": 0.25994,\n        \"precision_at_10\": 0.09098,\n        \"precision_at_100\": 0.01578,\n        \"precision_at_1000\": 0.00195,\n        \"precision_at_20\": 0.05413,\n        \"precision_at_3\": 0.19113,\n        \"precision_at_5\": 0.14618,\n        \"recall_at_1\": 0.15329,\n        \"recall_at_10\": 0.4367,\n        \"recall_at_100\": 0.79322,\n        \"recall_at_1000\": 0.99592,\n        \"recall_at_20\": 0.52339,\n        \"recall_at_3\": 0.29177,\n        \"recall_at_5\": 0.36307\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.31949,\n        \"map_at_1\": 0.17277,\n        \"map_at_10\": 0.2702,\n        \"map_at_100\": 0.28856,\n        \"map_at_1000\": 0.28995,\n        \"map_at_20\": 0.27957,\n        \"map_at_3\": 0.24088,\n        \"map_at_5\": 0.25708,\n        \"mrr_at_1\": 0.24267100977198697,\n        \"mrr_at_10\": 0.31691872188614845,\n        \"mrr_at_100\": 0.328413410224604,\n        \"mrr_at_1000\": 0.329229369589827,\n        \"mrr_at_20\": 0.3228330336041533,\n        \"mrr_at_3\": 0.2926167209554832,\n        \"mrr_at_5\": 0.3045874049945711,\n        \"nauc_map_at_1000_diff1\": 0.41505090394048866,\n        \"nauc_map_at_1000_max\": 0.13241336388494718,\n        \"nauc_map_at_1000_std\": -0.19201020800120797,\n        \"nauc_map_at_100_diff1\": 0.4145118451334163,\n        \"nauc_map_at_100_max\": 0.13241089525446442,\n        \"nauc_map_at_100_std\": -0.19148643172776678,\n        \"nauc_map_at_10_diff1\": 0.41401562649660273,\n        \"nauc_map_at_10_max\": 0.13134661521994792,\n        \"nauc_map_at_10_std\": -0.19904013040457355,\n        \"nauc_map_at_1_diff1\": 0.4925810221309357,\n        \"nauc_map_at_1_max\": 0.12167560986697107,\n        \"nauc_map_at_1_std\": -0.16440428374787602,\n        \"nauc_map_at_20_diff1\": 0.4140400331213615,\n        \"nauc_map_at_20_max\": 0.1287694349146764,\n        \"nauc_map_at_20_std\": -0.2002561977628548,\n        \"nauc_map_at_3_diff1\": 0.42367078522749024,\n        \"nauc_map_at_3_max\": 0.1335653702272776,\n        \"nauc_map_at_3_std\": -0.19622013982861383,\n        \"nauc_map_at_5_diff1\": 0.41654803369714793,\n        \"nauc_map_at_5_max\": 0.1286532915530522,\n        \"nauc_map_at_5_std\": -0.2001912647201993,\n        \"nauc_mrr_at_1000_diff1\": 0.45183780463327433,\n        \"nauc_mrr_at_1000_max\": 0.14496507835048258,\n        \"nauc_mrr_at_1000_std\": -0.1765942333681556,\n        \"nauc_mrr_at_100_diff1\": 0.45163588502609076,\n        \"nauc_mrr_at_100_max\": 0.14538390414927446,\n        \"nauc_mrr_at_100_std\": -0.17569220940165448,\n        \"nauc_mrr_at_10_diff1\": 0.4529239223346786,\n        \"nauc_mrr_at_10_max\": 0.14284857231467374,\n        \"nauc_mrr_at_10_std\": -0.18221641068311575,\n        \"nauc_mrr_at_1_diff1\": 0.4933141110384315,\n        \"nauc_mrr_at_1_max\": 0.1470220161647062,\n        \"nauc_mrr_at_1_std\": -0.18184622537720502,\n        \"nauc_mrr_at_20_diff1\": 0.45170537665016325,\n        \"nauc_mrr_at_20_max\": 0.14353492025833842,\n        \"nauc_mrr_at_20_std\": -0.18058264159515347,\n        \"nauc_mrr_at_3_diff1\": 0.4569265963743151,\n        \"nauc_mrr_at_3_max\": 0.13946392741551988,\n        \"nauc_mrr_at_3_std\": -0.18887643809079077,\n        \"nauc_mrr_at_5_diff1\": 0.45306740774381393,\n        \"nauc_mrr_at_5_max\": 0.14065915445105157,\n        \"nauc_mrr_at_5_std\": -0.185550522817219,\n        \"nauc_ndcg_at_1000_diff1\": 0.41635722113714646,\n        \"nauc_ndcg_at_1000_max\": 0.14770010488401367,\n        \"nauc_ndcg_at_1000_std\": -0.16435648756657403,\n        \"nauc_ndcg_at_100_diff1\": 0.40619177981217786,\n        \"nauc_ndcg_at_100_max\": 0.1556090922438858,\n        \"nauc_ndcg_at_100_std\": -0.14259999248239374,\n        \"nauc_ndcg_at_10_diff1\": 0.40757123471236806,\n        \"nauc_ndcg_at_10_max\": 0.13381733405090998,\n        \"nauc_ndcg_at_10_std\": -0.19595078611831573,\n        \"nauc_ndcg_at_1_diff1\": 0.4933141110384315,\n        \"nauc_ndcg_at_1_max\": 0.1470220161647062,\n        \"nauc_ndcg_at_1_std\": -0.18184622537720502,\n        \"nauc_ndcg_at_20_diff1\": 0.4048954589210238,\n        \"nauc_ndcg_at_20_max\": 0.1297128681452499,\n        \"nauc_ndcg_at_20_std\": -0.19617046481394884,\n        \"nauc_ndcg_at_3_diff1\": 0.4234307694909729,\n        \"nauc_ndcg_at_3_max\": 0.13498935897305633,\n        \"nauc_ndcg_at_3_std\": -0.1983067983598234,\n        \"nauc_ndcg_at_5_diff1\": 0.41299148536389446,\n        \"nauc_ndcg_at_5_max\": 0.12908388749749589,\n        \"nauc_ndcg_at_5_std\": -0.2007748056600153,\n        \"nauc_precision_at_1000_diff1\": 0.04861193672132261,\n        \"nauc_precision_at_1000_max\": 0.16256377281794238,\n        \"nauc_precision_at_1000_std\": 0.14917420534621734,\n        \"nauc_precision_at_100_diff1\": 0.11837321725063916,\n        \"nauc_precision_at_100_max\": 0.20102015016691627,\n        \"nauc_precision_at_100_std\": 0.14444275898938244,\n        \"nauc_precision_at_10_diff1\": 0.26536633318911446,\n        \"nauc_precision_at_10_max\": 0.11926061953347789,\n        \"nauc_precision_at_10_std\": -0.15367486499405267,\n        \"nauc_precision_at_1_diff1\": 0.4933141110384315,\n        \"nauc_precision_at_1_max\": 0.1470220161647062,\n        \"nauc_precision_at_1_std\": -0.18184622537720502,\n        \"nauc_precision_at_20_diff1\": 0.22872657885495534,\n        \"nauc_precision_at_20_max\": 0.0963507558339687,\n        \"nauc_precision_at_20_std\": -0.12574891572105426,\n        \"nauc_precision_at_3_diff1\": 0.31992163766273557,\n        \"nauc_precision_at_3_max\": 0.13552665742834516,\n        \"nauc_precision_at_3_std\": -0.19881480307611593,\n        \"nauc_precision_at_5_diff1\": 0.28623210182482245,\n        \"nauc_precision_at_5_max\": 0.11026835194152086,\n        \"nauc_precision_at_5_std\": -0.19152693283731337,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.27966581240649957,\n        \"nauc_recall_at_100_max\": 0.23425675276197166,\n        \"nauc_recall_at_100_std\": 0.10921505542278978,\n        \"nauc_recall_at_10_diff1\": 0.33956407535116556,\n        \"nauc_recall_at_10_max\": 0.12826659208335056,\n        \"nauc_recall_at_10_std\": -0.1943975091252743,\n        \"nauc_recall_at_1_diff1\": 0.4925810221309357,\n        \"nauc_recall_at_1_max\": 0.12167560986697107,\n        \"nauc_recall_at_1_std\": -0.16440428374787602,\n        \"nauc_recall_at_20_diff1\": 0.317679503564471,\n        \"nauc_recall_at_20_max\": 0.11352166597469808,\n        \"nauc_recall_at_20_std\": -0.19408222099233943,\n        \"nauc_recall_at_3_diff1\": 0.3757273582663656,\n        \"nauc_recall_at_3_max\": 0.12682016391977954,\n        \"nauc_recall_at_3_std\": -0.20341052110217941,\n        \"nauc_recall_at_5_diff1\": 0.3598059148605256,\n        \"nauc_recall_at_5_max\": 0.1185482342600925,\n        \"nauc_recall_at_5_std\": -0.20587844250384485,\n        \"ndcg_at_1\": 0.24267,\n        \"ndcg_at_10\": 0.31949,\n        \"ndcg_at_100\": 0.40277,\n        \"ndcg_at_1000\": 0.43378,\n        \"ndcg_at_20\": 0.34741,\n        \"ndcg_at_3\": 0.26984,\n        \"ndcg_at_5\": 0.29087,\n        \"precision_at_1\": 0.24267,\n        \"precision_at_10\": 0.06954,\n        \"precision_at_100\": 0.01326,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.043,\n        \"precision_at_3\": 0.15255,\n        \"precision_at_5\": 0.11107,\n        \"recall_at_1\": 0.17277,\n        \"recall_at_10\": 0.41503,\n        \"recall_at_100\": 0.77696,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.51226,\n        \"recall_at_3\": 0.29015,\n        \"recall_at_5\": 0.33854\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-m3/BAAI__bge-m3/no_revision_available/model_meta.json",
    "content": "{\"name\": \"BAAI/bge-m3\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": [], \"n_parameters\": null, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": null, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"Sentence Transformers\"], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"zero_shot_benchmarks\": null, \"loader\": null}"
  },
  {
    "path": "eval/results/BAAI/bge-multilingual-gemma2/no_model_name_available/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 119.05822992324829,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.76535,\n        \"map_at_1\": 0.58772,\n        \"map_at_10\": 0.71412,\n        \"map_at_100\": 0.71727,\n        \"map_at_1000\": 0.71731,\n        \"map_at_20\": 0.71588,\n        \"map_at_3\": 0.69298,\n        \"map_at_5\": 0.70614,\n        \"mrr_at_1\": 0.5877192982456141,\n        \"mrr_at_10\": 0.7141186299081036,\n        \"mrr_at_100\": 0.7172715798404293,\n        \"mrr_at_1000\": 0.7173069505252058,\n        \"mrr_at_20\": 0.7158782372598161,\n        \"mrr_at_3\": 0.6929824561403509,\n        \"mrr_at_5\": 0.706140350877193,\n        \"nauc_map_at_1000_diff1\": 0.6871804548539637,\n        \"nauc_map_at_1000_max\": 0.1420323864306385,\n        \"nauc_map_at_1000_std\": -0.4359167933175919,\n        \"nauc_map_at_100_diff1\": 0.6869888986630723,\n        \"nauc_map_at_100_max\": 0.14202935472851613,\n        \"nauc_map_at_100_std\": -0.4361190145277671,\n        \"nauc_map_at_10_diff1\": 0.6821625682937265,\n        \"nauc_map_at_10_max\": 0.14282670462128133,\n        \"nauc_map_at_10_std\": -0.44046306719237877,\n        \"nauc_map_at_1_diff1\": 0.7565205727235682,\n        \"nauc_map_at_1_max\": 0.14499014445168806,\n        \"nauc_map_at_1_std\": -0.4021330787124016,\n        \"nauc_map_at_20_diff1\": 0.683899005732777,\n        \"nauc_map_at_20_max\": 0.14037491725835372,\n        \"nauc_map_at_20_std\": -0.43770795307708554,\n        \"nauc_map_at_3_diff1\": 0.6857726824218638,\n        \"nauc_map_at_3_max\": 0.11412180292020804,\n        \"nauc_map_at_3_std\": -0.44606450164059286,\n        \"nauc_map_at_5_diff1\": 0.6882116080015668,\n        \"nauc_map_at_5_max\": 0.13770668919721318,\n        \"nauc_map_at_5_std\": -0.43159780499446615,\n        \"nauc_mrr_at_1000_diff1\": 0.6871804548539637,\n        \"nauc_mrr_at_1000_max\": 0.1420323864306385,\n        \"nauc_mrr_at_1000_std\": -0.4359167933175919,\n        \"nauc_mrr_at_100_diff1\": 0.6869888986630723,\n        \"nauc_mrr_at_100_max\": 0.14202935472851613,\n        \"nauc_mrr_at_100_std\": -0.4361190145277671,\n        \"nauc_mrr_at_10_diff1\": 0.6821625682937265,\n        \"nauc_mrr_at_10_max\": 0.14282670462128133,\n        \"nauc_mrr_at_10_std\": -0.44046306719237877,\n        \"nauc_mrr_at_1_diff1\": 0.7565205727235682,\n        \"nauc_mrr_at_1_max\": 0.14499014445168806,\n        \"nauc_mrr_at_1_std\": -0.4021330787124016,\n        \"nauc_mrr_at_20_diff1\": 0.683899005732777,\n        \"nauc_mrr_at_20_max\": 0.14037491725835372,\n        \"nauc_mrr_at_20_std\": -0.43770795307708554,\n        \"nauc_mrr_at_3_diff1\": 0.6857726824218638,\n        \"nauc_mrr_at_3_max\": 0.11412180292020804,\n        \"nauc_mrr_at_3_std\": -0.44606450164059286,\n        \"nauc_mrr_at_5_diff1\": 0.6882116080015668,\n        \"nauc_mrr_at_5_max\": 0.13770668919721318,\n        \"nauc_mrr_at_5_std\": -0.43159780499446615,\n        \"nauc_ndcg_at_1000_diff1\": 0.6725739924867542,\n        \"nauc_ndcg_at_1000_max\": 0.14475508849337584,\n        \"nauc_ndcg_at_1000_std\": -0.4473199404587193,\n        \"nauc_ndcg_at_100_diff1\": 0.6650462445483546,\n        \"nauc_ndcg_at_100_max\": 0.14461796408541713,\n        \"nauc_ndcg_at_100_std\": -0.4552912559815156,\n        \"nauc_ndcg_at_10_diff1\": 0.6424956614815897,\n        \"nauc_ndcg_at_10_max\": 0.15106663392054379,\n        \"nauc_ndcg_at_10_std\": -0.4748615636013759,\n        \"nauc_ndcg_at_1_diff1\": 0.7565205727235682,\n        \"nauc_ndcg_at_1_max\": 0.14499014445168806,\n        \"nauc_ndcg_at_1_std\": -0.4021330787124016,\n        \"nauc_ndcg_at_20_diff1\": 0.6488798602618329,\n        \"nauc_ndcg_at_20_max\": 0.14049065208385828,\n        \"nauc_ndcg_at_20_std\": -0.46283163692940793,\n        \"nauc_ndcg_at_3_diff1\": 0.6574451317211064,\n        \"nauc_ndcg_at_3_max\": 0.09375508448638213,\n        \"nauc_ndcg_at_3_std\": -0.4739113630902631,\n        \"nauc_ndcg_at_5_diff1\": 0.6595895244317779,\n        \"nauc_ndcg_at_5_max\": 0.13802228056251378,\n        \"nauc_ndcg_at_5_std\": -0.4481832149672461,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": -0.5637901180614636,\n        \"nauc_precision_at_100_max\": 0.12223365206034731,\n        \"nauc_precision_at_100_std\": -1.7565359911142433,\n        \"nauc_precision_at_10_diff1\": 0.29489340133999126,\n        \"nauc_precision_at_10_max\": 0.2401706780084637,\n        \"nauc_precision_at_10_std\": -0.7962881634526331,\n        \"nauc_precision_at_1_diff1\": 0.7565205727235682,\n        \"nauc_precision_at_1_max\": 0.14499014445168806,\n        \"nauc_precision_at_1_std\": -0.4021330787124016,\n        \"nauc_precision_at_20_diff1\": 0.21143457644733152,\n        \"nauc_precision_at_20_max\": 0.1353309980220975,\n        \"nauc_precision_at_20_std\": -0.7794901519427275,\n        \"nauc_precision_at_3_diff1\": 0.538958335146876,\n        \"nauc_precision_at_3_max\": 0.0048859242585519765,\n        \"nauc_precision_at_3_std\": -0.5951020938202185,\n        \"nauc_precision_at_5_diff1\": 0.5045809293735882,\n        \"nauc_precision_at_5_max\": 0.14478965602215157,\n        \"nauc_precision_at_5_std\": -0.538854179166969,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": -0.5637901180615443,\n        \"nauc_recall_at_100_max\": 0.12223365206031499,\n        \"nauc_recall_at_100_std\": -1.756535991114336,\n        \"nauc_recall_at_10_diff1\": 0.2948934013399936,\n        \"nauc_recall_at_10_max\": 0.24017067800846637,\n        \"nauc_recall_at_10_std\": -0.7962881634526358,\n        \"nauc_recall_at_1_diff1\": 0.7565205727235682,\n        \"nauc_recall_at_1_max\": 0.14499014445168806,\n        \"nauc_recall_at_1_std\": -0.4021330787124016,\n        \"nauc_recall_at_20_diff1\": 0.21143457644733485,\n        \"nauc_recall_at_20_max\": 0.13533099802210283,\n        \"nauc_recall_at_20_std\": -0.7794901519427204,\n        \"nauc_recall_at_3_diff1\": 0.5389583351468771,\n        \"nauc_recall_at_3_max\": 0.004885924258552919,\n        \"nauc_recall_at_3_std\": -0.5951020938202172,\n        \"nauc_recall_at_5_diff1\": 0.5045809293735892,\n        \"nauc_recall_at_5_max\": 0.14478965602215235,\n        \"nauc_recall_at_5_std\": -0.5388541791669698,\n        \"ndcg_at_1\": 0.58772,\n        \"ndcg_at_10\": 0.76535,\n        \"ndcg_at_100\": 0.78048,\n        \"ndcg_at_1000\": 0.78158,\n        \"ndcg_at_20\": 0.77193,\n        \"ndcg_at_3\": 0.72472,\n        \"ndcg_at_5\": 0.74739,\n        \"precision_at_1\": 0.58772,\n        \"precision_at_10\": 0.09211,\n        \"precision_at_100\": 0.00991,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04737,\n        \"precision_at_3\": 0.27193,\n        \"precision_at_5\": 0.17368,\n        \"recall_at_1\": 0.58772,\n        \"recall_at_10\": 0.92105,\n        \"recall_at_100\": 0.99123,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.94737,\n        \"recall_at_3\": 0.81579,\n        \"recall_at_5\": 0.86842\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-multilingual-gemma2/no_model_name_available/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 195.57231187820435,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.95001,\n        \"map_at_1\": 0.90778,\n        \"map_at_10\": 0.93791,\n        \"map_at_100\": 0.93841,\n        \"map_at_1000\": 0.93842,\n        \"map_at_20\": 0.93826,\n        \"map_at_3\": 0.93259,\n        \"map_at_5\": 0.93676,\n        \"mrr_at_1\": 0.9077777777777778,\n        \"mrr_at_10\": 0.937910052910053,\n        \"mrr_at_100\": 0.9384057688805332,\n        \"mrr_at_1000\": 0.9384191334793509,\n        \"mrr_at_20\": 0.9382570947570948,\n        \"mrr_at_3\": 0.9325925925925926,\n        \"mrr_at_5\": 0.9367592592592593,\n        \"nauc_map_at_1000_diff1\": 0.9142665361908336,\n        \"nauc_map_at_1000_max\": 0.7417200323164244,\n        \"nauc_map_at_1000_std\": -0.022857413046968294,\n        \"nauc_map_at_100_diff1\": 0.9142851384743285,\n        \"nauc_map_at_100_max\": 0.7417760734113105,\n        \"nauc_map_at_100_std\": -0.02263547539591741,\n        \"nauc_map_at_10_diff1\": 0.9134947687355001,\n        \"nauc_map_at_10_max\": 0.741494495824178,\n        \"nauc_map_at_10_std\": -0.024850704377757292,\n        \"nauc_map_at_1_diff1\": 0.9127602848368274,\n        \"nauc_map_at_1_max\": 0.7206529198024576,\n        \"nauc_map_at_1_std\": -0.05017267951357163,\n        \"nauc_map_at_20_diff1\": 0.9144115754201003,\n        \"nauc_map_at_20_max\": 0.7421258068927056,\n        \"nauc_map_at_20_std\": -0.021967674396242153,\n        \"nauc_map_at_3_diff1\": 0.9122854269913103,\n        \"nauc_map_at_3_max\": 0.7422276602948861,\n        \"nauc_map_at_3_std\": -0.023631247370742646,\n        \"nauc_map_at_5_diff1\": 0.9141119600597686,\n        \"nauc_map_at_5_max\": 0.7437446428058785,\n        \"nauc_map_at_5_std\": -0.020491515298165976,\n        \"nauc_mrr_at_1000_diff1\": 0.9142665361908336,\n        \"nauc_mrr_at_1000_max\": 0.7417200323164244,\n        \"nauc_mrr_at_1000_std\": -0.022857413046968294,\n        \"nauc_mrr_at_100_diff1\": 0.9142851384743285,\n        \"nauc_mrr_at_100_max\": 0.7417760734113105,\n        \"nauc_mrr_at_100_std\": -0.02263547539591741,\n        \"nauc_mrr_at_10_diff1\": 0.9134947687355001,\n        \"nauc_mrr_at_10_max\": 0.741494495824178,\n        \"nauc_mrr_at_10_std\": -0.024850704377757292,\n        \"nauc_mrr_at_1_diff1\": 0.9127602848368274,\n        \"nauc_mrr_at_1_max\": 0.7206529198024576,\n        \"nauc_mrr_at_1_std\": -0.05017267951357163,\n        \"nauc_mrr_at_20_diff1\": 0.9144115754201003,\n        \"nauc_mrr_at_20_max\": 0.7421258068927056,\n        \"nauc_mrr_at_20_std\": -0.021967674396242153,\n        \"nauc_mrr_at_3_diff1\": 0.9122854269913103,\n        \"nauc_mrr_at_3_max\": 0.7422276602948861,\n        \"nauc_mrr_at_3_std\": -0.023631247370742646,\n        \"nauc_mrr_at_5_diff1\": 0.9141119600597686,\n        \"nauc_mrr_at_5_max\": 0.7437446428058785,\n        \"nauc_mrr_at_5_std\": -0.020491515298165976,\n        \"nauc_ndcg_at_1000_diff1\": 0.9148444589331953,\n        \"nauc_ndcg_at_1000_max\": 0.7452873562263655,\n        \"nauc_ndcg_at_1000_std\": -0.017786190784458585,\n        \"nauc_ndcg_at_100_diff1\": 0.9153780312139375,\n        \"nauc_ndcg_at_100_max\": 0.7468833487427657,\n        \"nauc_ndcg_at_100_std\": -0.011408889996697627,\n        \"nauc_ndcg_at_10_diff1\": 0.9129157695282673,\n        \"nauc_ndcg_at_10_max\": 0.7474421693216621,\n        \"nauc_ndcg_at_10_std\": -0.021544911168402143,\n        \"nauc_ndcg_at_1_diff1\": 0.9127602848368274,\n        \"nauc_ndcg_at_1_max\": 0.7206529198024576,\n        \"nauc_ndcg_at_1_std\": -0.05017267951357163,\n        \"nauc_ndcg_at_20_diff1\": 0.9164480561151565,\n        \"nauc_ndcg_at_20_max\": 0.7495752715796,\n        \"nauc_ndcg_at_20_std\": -0.008984213063139969,\n        \"nauc_ndcg_at_3_diff1\": 0.9111897107164737,\n        \"nauc_ndcg_at_3_max\": 0.749687976964171,\n        \"nauc_ndcg_at_3_std\": -0.017244343945449332,\n        \"nauc_ndcg_at_5_diff1\": 0.9145423364478309,\n        \"nauc_ndcg_at_5_max\": 0.7534919419643613,\n        \"nauc_ndcg_at_5_std\": -0.008650222933101416,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.9029333955804523,\n        \"nauc_precision_at_10_max\": 0.8148537192654776,\n        \"nauc_precision_at_10_std\": -0.00042794895737402667,\n        \"nauc_precision_at_1_diff1\": 0.9127602848368274,\n        \"nauc_precision_at_1_max\": 0.7206529198024576,\n        \"nauc_precision_at_1_std\": -0.05017267951357163,\n        \"nauc_precision_at_20_diff1\": 0.9673202614378968,\n        \"nauc_precision_at_20_max\": 0.8850373482726227,\n        \"nauc_precision_at_20_std\": 0.27357609710550823,\n        \"nauc_precision_at_3_diff1\": 0.9052954515139436,\n        \"nauc_precision_at_3_max\": 0.7854875283446744,\n        \"nauc_precision_at_3_std\": 0.011497932506332782,\n        \"nauc_precision_at_5_diff1\": 0.9180549412747513,\n        \"nauc_precision_at_5_max\": 0.8355201729814675,\n        \"nauc_precision_at_5_std\": 0.09275640080592862,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 1.0,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 1.0,\n        \"nauc_recall_at_10_diff1\": 0.9029333955804517,\n        \"nauc_recall_at_10_max\": 0.8148537192654788,\n        \"nauc_recall_at_10_std\": -0.00042794895735932413,\n        \"nauc_recall_at_1_diff1\": 0.9127602848368274,\n        \"nauc_recall_at_1_max\": 0.7206529198024576,\n        \"nauc_recall_at_1_std\": -0.05017267951357163,\n        \"nauc_recall_at_20_diff1\": 0.9673202614379147,\n        \"nauc_recall_at_20_max\": 0.8850373482726468,\n        \"nauc_recall_at_20_std\": 0.2735760971055196,\n        \"nauc_recall_at_3_diff1\": 0.9052954515139391,\n        \"nauc_recall_at_3_max\": 0.7854875283446687,\n        \"nauc_recall_at_3_std\": 0.01149793250633776,\n        \"nauc_recall_at_5_diff1\": 0.9180549412747542,\n        \"nauc_recall_at_5_max\": 0.8355201729814765,\n        \"nauc_recall_at_5_std\": 0.0927564008059334,\n        \"ndcg_at_1\": 0.90778,\n        \"ndcg_at_10\": 0.95001,\n        \"ndcg_at_100\": 0.95238,\n        \"ndcg_at_1000\": 0.95268,\n        \"ndcg_at_20\": 0.95119,\n        \"ndcg_at_3\": 0.93997,\n        \"ndcg_at_5\": 0.94739,\n        \"precision_at_1\": 0.90778,\n        \"precision_at_10\": 0.09867,\n        \"precision_at_100\": 0.00998,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04956,\n        \"precision_at_3\": 0.32037,\n        \"precision_at_5\": 0.19578,\n        \"recall_at_1\": 0.90778,\n        \"recall_at_10\": 0.98667,\n        \"recall_at_100\": 0.99778,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.99111,\n        \"recall_at_3\": 0.96111,\n        \"recall_at_5\": 0.97889\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.9533,\n        \"map_at_1\": 0.90778,\n        \"map_at_10\": 0.94111,\n        \"map_at_100\": 0.94148,\n        \"map_at_1000\": 0.94149,\n        \"map_at_20\": 0.94134,\n        \"map_at_3\": 0.93833,\n        \"map_at_5\": 0.93944,\n        \"mrr_at_1\": 0.9077777777777778,\n        \"mrr_at_10\": 0.9411089065255732,\n        \"mrr_at_100\": 0.9414824263539285,\n        \"mrr_at_1000\": 0.9414930083645107,\n        \"mrr_at_20\": 0.9413410894660895,\n        \"mrr_at_3\": 0.9383333333333335,\n        \"mrr_at_5\": 0.9394444444444445,\n        \"nauc_map_at_1000_diff1\": 0.9132390834178515,\n        \"nauc_map_at_1000_max\": 0.7034851682270743,\n        \"nauc_map_at_1000_std\": -0.08533923507942101,\n        \"nauc_map_at_100_diff1\": 0.9132547728061845,\n        \"nauc_map_at_100_max\": 0.7035387884114396,\n        \"nauc_map_at_100_std\": -0.08514296803424397,\n        \"nauc_map_at_10_diff1\": 0.9131790376965144,\n        \"nauc_map_at_10_max\": 0.7036961829241862,\n        \"nauc_map_at_10_std\": -0.08741887301346339,\n        \"nauc_map_at_1_diff1\": 0.9127602848368274,\n        \"nauc_map_at_1_max\": 0.6805766483300142,\n        \"nauc_map_at_1_std\": -0.08971460069971847,\n        \"nauc_map_at_20_diff1\": 0.9133632060050118,\n        \"nauc_map_at_20_max\": 0.7039100639974116,\n        \"nauc_map_at_20_std\": -0.08463651070667616,\n        \"nauc_map_at_3_diff1\": 0.913022265963442,\n        \"nauc_map_at_3_max\": 0.7048799499779878,\n        \"nauc_map_at_3_std\": -0.08527995782897725,\n        \"nauc_map_at_5_diff1\": 0.9138998106888043,\n        \"nauc_map_at_5_max\": 0.7084357698227083,\n        \"nauc_map_at_5_std\": -0.08271157596575836,\n        \"nauc_mrr_at_1000_diff1\": 0.9132390834178515,\n        \"nauc_mrr_at_1000_max\": 0.7034851682270743,\n        \"nauc_mrr_at_1000_std\": -0.08533923507942101,\n        \"nauc_mrr_at_100_diff1\": 0.9132547728061845,\n        \"nauc_mrr_at_100_max\": 0.7035387884114396,\n        \"nauc_mrr_at_100_std\": -0.08514296803424397,\n        \"nauc_mrr_at_10_diff1\": 0.9131790376965144,\n        \"nauc_mrr_at_10_max\": 0.7036961829241862,\n        \"nauc_mrr_at_10_std\": -0.08741887301346339,\n        \"nauc_mrr_at_1_diff1\": 0.9127602848368274,\n        \"nauc_mrr_at_1_max\": 0.6805766483300142,\n        \"nauc_mrr_at_1_std\": -0.08971460069971847,\n        \"nauc_mrr_at_20_diff1\": 0.9133632060050118,\n        \"nauc_mrr_at_20_max\": 0.7039100639974116,\n        \"nauc_mrr_at_20_std\": -0.08463651070667616,\n        \"nauc_mrr_at_3_diff1\": 0.913022265963442,\n        \"nauc_mrr_at_3_max\": 0.7048799499779878,\n        \"nauc_mrr_at_3_std\": -0.08527995782897725,\n        \"nauc_mrr_at_5_diff1\": 0.9138998106888043,\n        \"nauc_mrr_at_5_max\": 0.7084357698227083,\n        \"nauc_mrr_at_5_std\": -0.08271157596575836,\n        \"nauc_ndcg_at_1000_diff1\": 0.9136586516663353,\n        \"nauc_ndcg_at_1000_max\": 0.7067346358618749,\n        \"nauc_ndcg_at_1000_std\": -0.08426696192429434,\n        \"nauc_ndcg_at_100_diff1\": 0.9139767092971215,\n        \"nauc_ndcg_at_100_max\": 0.7078149442970522,\n        \"nauc_ndcg_at_100_std\": -0.08027282252636965,\n        \"nauc_ndcg_at_10_diff1\": 0.9137398261541717,\n        \"nauc_ndcg_at_10_max\": 0.7089914704706038,\n        \"nauc_ndcg_at_10_std\": -0.09076166542013302,\n        \"nauc_ndcg_at_1_diff1\": 0.9127602848368274,\n        \"nauc_ndcg_at_1_max\": 0.6805766483300142,\n        \"nauc_ndcg_at_1_std\": -0.08971460069971847,\n        \"nauc_ndcg_at_20_diff1\": 0.9147962958143541,\n        \"nauc_ndcg_at_20_max\": 0.7105830753311271,\n        \"nauc_ndcg_at_20_std\": -0.07929133989085652,\n        \"nauc_ndcg_at_3_diff1\": 0.9139755965104456,\n        \"nauc_ndcg_at_3_max\": 0.7145165315074726,\n        \"nauc_ndcg_at_3_std\": -0.08322391069107185,\n        \"nauc_ndcg_at_5_diff1\": 0.9158174675677071,\n        \"nauc_ndcg_at_5_max\": 0.7221978200003155,\n        \"nauc_ndcg_at_5_std\": -0.07786087673971333,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.9214130096483081,\n        \"nauc_precision_at_10_max\": 0.7707749766573202,\n        \"nauc_precision_at_10_std\": -0.16692602967115508,\n        \"nauc_precision_at_1_diff1\": 0.9127602848368274,\n        \"nauc_precision_at_1_max\": 0.6805766483300142,\n        \"nauc_precision_at_1_std\": -0.08971460069971847,\n        \"nauc_precision_at_20_diff1\": 0.9564270152505291,\n        \"nauc_precision_at_20_max\": 0.8513849984437983,\n        \"nauc_precision_at_20_std\": 0.08667911609085283,\n        \"nauc_precision_at_3_diff1\": 0.9208294428882671,\n        \"nauc_precision_at_3_max\": 0.7763383131030174,\n        \"nauc_precision_at_3_std\": -0.06977513227512878,\n        \"nauc_precision_at_5_diff1\": 0.9319561157796464,\n        \"nauc_precision_at_5_max\": 0.8293884220354816,\n        \"nauc_precision_at_5_std\": -0.03867880485527598,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 1.0,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 1.0,\n        \"nauc_recall_at_10_diff1\": 0.9214130096482933,\n        \"nauc_recall_at_10_max\": 0.7707749766573149,\n        \"nauc_recall_at_10_std\": -0.16692602967111914,\n        \"nauc_recall_at_1_diff1\": 0.9127602848368274,\n        \"nauc_recall_at_1_max\": 0.6805766483300142,\n        \"nauc_recall_at_1_std\": -0.08971460069971847,\n        \"nauc_recall_at_20_diff1\": 0.9564270152505339,\n        \"nauc_recall_at_20_max\": 0.8513849984438123,\n        \"nauc_recall_at_20_std\": 0.08667911609088264,\n        \"nauc_recall_at_3_diff1\": 0.9208294428882646,\n        \"nauc_recall_at_3_max\": 0.7763383131030149,\n        \"nauc_recall_at_3_std\": -0.06977513227513614,\n        \"nauc_recall_at_5_diff1\": 0.9319561157796439,\n        \"nauc_recall_at_5_max\": 0.8293884220354797,\n        \"nauc_recall_at_5_std\": -0.03867880485527428,\n        \"ndcg_at_1\": 0.90778,\n        \"ndcg_at_10\": 0.9533,\n        \"ndcg_at_100\": 0.95517,\n        \"ndcg_at_1000\": 0.95533,\n        \"ndcg_at_20\": 0.95414,\n        \"ndcg_at_3\": 0.94739,\n        \"ndcg_at_5\": 0.94931,\n        \"precision_at_1\": 0.90778,\n        \"precision_at_10\": 0.099,\n        \"precision_at_100\": 0.00999,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04967,\n        \"precision_at_3\": 0.32444,\n        \"precision_at_5\": 0.19556,\n        \"recall_at_1\": 0.90778,\n        \"recall_at_10\": 0.99,\n        \"recall_at_100\": 0.99889,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.99333,\n        \"recall_at_3\": 0.97333,\n        \"recall_at_5\": 0.97778\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.92542,\n        \"map_at_1\": 0.86889,\n        \"map_at_10\": 0.90865,\n        \"map_at_100\": 0.90952,\n        \"map_at_1000\": 0.90955,\n        \"map_at_20\": 0.90934,\n        \"map_at_3\": 0.90167,\n        \"map_at_5\": 0.90644,\n        \"mrr_at_1\": 0.8688888888888889,\n        \"mrr_at_10\": 0.9086534391534392,\n        \"mrr_at_100\": 0.9095160509349679,\n        \"mrr_at_1000\": 0.9095506290733619,\n        \"mrr_at_20\": 0.9093372640192817,\n        \"mrr_at_3\": 0.901666666666667,\n        \"mrr_at_5\": 0.9064444444444446,\n        \"nauc_map_at_1000_diff1\": 0.8655071414135598,\n        \"nauc_map_at_1000_max\": 0.712880044053201,\n        \"nauc_map_at_1000_std\": 0.07778526277498768,\n        \"nauc_map_at_100_diff1\": 0.8655016531537733,\n        \"nauc_map_at_100_max\": 0.712992288401549,\n        \"nauc_map_at_100_std\": 0.07814578592941561,\n        \"nauc_map_at_10_diff1\": 0.8655264893655531,\n        \"nauc_map_at_10_max\": 0.7144121638788207,\n        \"nauc_map_at_10_std\": 0.08036728429197564,\n        \"nauc_map_at_1_diff1\": 0.8740098646066407,\n        \"nauc_map_at_1_max\": 0.6846061506802336,\n        \"nauc_map_at_1_std\": 0.016475036338989085,\n        \"nauc_map_at_20_diff1\": 0.8655606749633783,\n        \"nauc_map_at_20_max\": 0.7133069583346271,\n        \"nauc_map_at_20_std\": 0.07895951036393203,\n        \"nauc_map_at_3_diff1\": 0.8629935666435051,\n        \"nauc_map_at_3_max\": 0.7143413754778334,\n        \"nauc_map_at_3_std\": 0.0809241912518571,\n        \"nauc_map_at_5_diff1\": 0.8652061970583541,\n        \"nauc_map_at_5_max\": 0.7163535037743536,\n        \"nauc_map_at_5_std\": 0.07951637719503098,\n        \"nauc_mrr_at_1000_diff1\": 0.8655071414135598,\n        \"nauc_mrr_at_1000_max\": 0.712880044053201,\n        \"nauc_mrr_at_1000_std\": 0.07778526277498768,\n        \"nauc_mrr_at_100_diff1\": 0.8655016531537733,\n        \"nauc_mrr_at_100_max\": 0.712992288401549,\n        \"nauc_mrr_at_100_std\": 0.07814578592941561,\n        \"nauc_mrr_at_10_diff1\": 0.8655264893655531,\n        \"nauc_mrr_at_10_max\": 0.7144121638788207,\n        \"nauc_mrr_at_10_std\": 0.08036728429197564,\n        \"nauc_mrr_at_1_diff1\": 0.8740098646066407,\n        \"nauc_mrr_at_1_max\": 0.6846061506802336,\n        \"nauc_mrr_at_1_std\": 0.016475036338989085,\n        \"nauc_mrr_at_20_diff1\": 0.8655606749633783,\n        \"nauc_mrr_at_20_max\": 0.7133069583346271,\n        \"nauc_mrr_at_20_std\": 0.07895951036393203,\n        \"nauc_mrr_at_3_diff1\": 0.8629935666435051,\n        \"nauc_mrr_at_3_max\": 0.7143413754778334,\n        \"nauc_mrr_at_3_std\": 0.0809241912518571,\n        \"nauc_mrr_at_5_diff1\": 0.8652061970583541,\n        \"nauc_mrr_at_5_max\": 0.7163535037743536,\n        \"nauc_mrr_at_5_std\": 0.07951637719503098,\n        \"nauc_ndcg_at_1000_diff1\": 0.8647471328268296,\n        \"nauc_ndcg_at_1000_max\": 0.7185203395380872,\n        \"nauc_ndcg_at_1000_std\": 0.09124983250276489,\n        \"nauc_ndcg_at_100_diff1\": 0.8644783270567897,\n        \"nauc_ndcg_at_100_max\": 0.7215603085795872,\n        \"nauc_ndcg_at_100_std\": 0.10106429785744557,\n        \"nauc_ndcg_at_10_diff1\": 0.8648663071038122,\n        \"nauc_ndcg_at_10_max\": 0.7282776538048082,\n        \"nauc_ndcg_at_10_std\": 0.11073311323860291,\n        \"nauc_ndcg_at_1_diff1\": 0.8740098646066407,\n        \"nauc_ndcg_at_1_max\": 0.6846061506802336,\n        \"nauc_ndcg_at_1_std\": 0.016475036338989085,\n        \"nauc_ndcg_at_20_diff1\": 0.8649366008500634,\n        \"nauc_ndcg_at_20_max\": 0.7236249483095551,\n        \"nauc_ndcg_at_20_std\": 0.10537703607809089,\n        \"nauc_ndcg_at_3_diff1\": 0.8591692392430215,\n        \"nauc_ndcg_at_3_max\": 0.72692936085964,\n        \"nauc_ndcg_at_3_std\": 0.10883567883912774,\n        \"nauc_ndcg_at_5_diff1\": 0.8637479893020074,\n        \"nauc_ndcg_at_5_max\": 0.7331969061294942,\n        \"nauc_ndcg_at_5_std\": 0.10888095163739013,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8366013071895334,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.8646125116713362,\n        \"nauc_precision_at_10_max\": 0.8768618558534468,\n        \"nauc_precision_at_10_std\": 0.43799742119069335,\n        \"nauc_precision_at_1_diff1\": 0.8740098646066407,\n        \"nauc_precision_at_1_max\": 0.6846061506802336,\n        \"nauc_precision_at_1_std\": 0.016475036338989085,\n        \"nauc_precision_at_20_diff1\": 0.8651960784313695,\n        \"nauc_precision_at_20_max\": 0.8897447868036057,\n        \"nauc_precision_at_20_std\": 0.5705726735138443,\n        \"nauc_precision_at_3_diff1\": 0.8417278861230014,\n        \"nauc_precision_at_3_max\": 0.7857407113788957,\n        \"nauc_precision_at_3_std\": 0.23955745820341165,\n        \"nauc_precision_at_5_diff1\": 0.8566760037348254,\n        \"nauc_precision_at_5_max\": 0.8495664932639713,\n        \"nauc_precision_at_5_std\": 0.30673602774442654,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8366013071895522,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 1.0,\n        \"nauc_recall_at_10_diff1\": 0.8646125116713329,\n        \"nauc_recall_at_10_max\": 0.8768618558534561,\n        \"nauc_recall_at_10_std\": 0.4379974211906987,\n        \"nauc_recall_at_1_diff1\": 0.8740098646066407,\n        \"nauc_recall_at_1_max\": 0.6846061506802336,\n        \"nauc_recall_at_1_std\": 0.016475036338989085,\n        \"nauc_recall_at_20_diff1\": 0.865196078431372,\n        \"nauc_recall_at_20_max\": 0.8897447868036054,\n        \"nauc_recall_at_20_std\": 0.5705726735138528,\n        \"nauc_recall_at_3_diff1\": 0.8417278861230021,\n        \"nauc_recall_at_3_max\": 0.7857407113788921,\n        \"nauc_recall_at_3_std\": 0.23955745820340837,\n        \"nauc_recall_at_5_diff1\": 0.8566760037348257,\n        \"nauc_recall_at_5_max\": 0.8495664932639706,\n        \"nauc_recall_at_5_std\": 0.3067360277444287,\n        \"ndcg_at_1\": 0.86889,\n        \"ndcg_at_10\": 0.92542,\n        \"ndcg_at_100\": 0.92934,\n        \"ndcg_at_1000\": 0.93009,\n        \"ndcg_at_20\": 0.92794,\n        \"ndcg_at_3\": 0.91184,\n        \"ndcg_at_5\": 0.92026,\n        \"precision_at_1\": 0.86889,\n        \"precision_at_10\": 0.09767,\n        \"precision_at_100\": 0.00994,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04933,\n        \"precision_at_3\": 0.3137,\n        \"precision_at_5\": 0.19222,\n        \"recall_at_1\": 0.86889,\n        \"recall_at_10\": 0.97667,\n        \"recall_at_100\": 0.99444,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98667,\n        \"recall_at_3\": 0.94111,\n        \"recall_at_5\": 0.96111\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-multilingual-gemma2/no_model_name_available/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 1484.8957543373108,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.79072,\n        \"map_at_1\": 0.4751,\n        \"map_at_10\": 0.74355,\n        \"map_at_100\": 0.74902,\n        \"map_at_1000\": 0.74932,\n        \"map_at_20\": 0.7475,\n        \"map_at_3\": 0.69864,\n        \"map_at_5\": 0.73103,\n        \"mrr_at_1\": 0.7280405405405406,\n        \"mrr_at_10\": 0.7977303196053193,\n        \"mrr_at_100\": 0.7993979797532479,\n        \"mrr_at_1000\": 0.7995630295310928,\n        \"mrr_at_20\": 0.798864165188178,\n        \"mrr_at_3\": 0.7916666666666664,\n        \"mrr_at_5\": 0.795636261261261,\n        \"nauc_map_at_1000_diff1\": 0.6256649071324872,\n        \"nauc_map_at_1000_max\": 0.5735375619379824,\n        \"nauc_map_at_1000_std\": 0.22083743098839143,\n        \"nauc_map_at_100_diff1\": 0.6258479659620486,\n        \"nauc_map_at_100_max\": 0.5740550390532451,\n        \"nauc_map_at_100_std\": 0.22152263331314953,\n        \"nauc_map_at_10_diff1\": 0.6217411286741686,\n        \"nauc_map_at_10_max\": 0.5702714855001783,\n        \"nauc_map_at_10_std\": 0.21405796044522293,\n        \"nauc_map_at_1_diff1\": 0.6002554239795219,\n        \"nauc_map_at_1_max\": 0.234901175002455,\n        \"nauc_map_at_1_std\": 0.034169324518353,\n        \"nauc_map_at_20_diff1\": 0.6260613170820447,\n        \"nauc_map_at_20_max\": 0.5737386933721409,\n        \"nauc_map_at_20_std\": 0.21992702151623847,\n        \"nauc_map_at_3_diff1\": 0.6090197689169069,\n        \"nauc_map_at_3_max\": 0.49284382384621306,\n        \"nauc_map_at_3_std\": 0.138624455301081,\n        \"nauc_map_at_5_diff1\": 0.6185927547856056,\n        \"nauc_map_at_5_max\": 0.5615815304157588,\n        \"nauc_map_at_5_std\": 0.20245448375917285,\n        \"nauc_mrr_at_1000_diff1\": 0.6668721433088087,\n        \"nauc_mrr_at_1000_max\": 0.6446490938197565,\n        \"nauc_mrr_at_1000_std\": 0.31776904035044184,\n        \"nauc_mrr_at_100_diff1\": 0.6669711329326476,\n        \"nauc_mrr_at_100_max\": 0.6448963717970834,\n        \"nauc_mrr_at_100_std\": 0.31813572678586155,\n        \"nauc_mrr_at_10_diff1\": 0.6665297306611556,\n        \"nauc_mrr_at_10_max\": 0.6461626693027981,\n        \"nauc_mrr_at_10_std\": 0.3196263666901991,\n        \"nauc_mrr_at_1_diff1\": 0.6575720836305169,\n        \"nauc_mrr_at_1_max\": 0.5533847493305769,\n        \"nauc_mrr_at_1_std\": 0.21355645302950124,\n        \"nauc_mrr_at_20_diff1\": 0.6667875799287543,\n        \"nauc_mrr_at_20_max\": 0.6455155944464043,\n        \"nauc_mrr_at_20_std\": 0.31852476694902354,\n        \"nauc_mrr_at_3_diff1\": 0.664813000551536,\n        \"nauc_mrr_at_3_max\": 0.643043305388793,\n        \"nauc_mrr_at_3_std\": 0.3097808850229901,\n        \"nauc_mrr_at_5_diff1\": 0.665857829582622,\n        \"nauc_mrr_at_5_max\": 0.6450324247131991,\n        \"nauc_mrr_at_5_std\": 0.31935362969536607,\n        \"nauc_ndcg_at_1000_diff1\": 0.6452554189620043,\n        \"nauc_ndcg_at_1000_max\": 0.6337749441549703,\n        \"nauc_ndcg_at_1000_std\": 0.303874650663312,\n        \"nauc_ndcg_at_100_diff1\": 0.6491652007587659,\n        \"nauc_ndcg_at_100_max\": 0.6441858281974558,\n        \"nauc_ndcg_at_100_std\": 0.31742026395480366,\n        \"nauc_ndcg_at_10_diff1\": 0.6391422675672194,\n        \"nauc_ndcg_at_10_max\": 0.6366084275304457,\n        \"nauc_ndcg_at_10_std\": 0.2931836617472829,\n        \"nauc_ndcg_at_1_diff1\": 0.6575720836305169,\n        \"nauc_ndcg_at_1_max\": 0.5533847493305769,\n        \"nauc_ndcg_at_1_std\": 0.21355645302950124,\n        \"nauc_ndcg_at_20_diff1\": 0.6492444931741755,\n        \"nauc_ndcg_at_20_max\": 0.6459156570602925,\n        \"nauc_ndcg_at_20_std\": 0.3088994793914235,\n        \"nauc_ndcg_at_3_diff1\": 0.6159064468715444,\n        \"nauc_ndcg_at_3_max\": 0.549490455209115,\n        \"nauc_ndcg_at_3_std\": 0.19277974263365644,\n        \"nauc_ndcg_at_5_diff1\": 0.632330726369529,\n        \"nauc_ndcg_at_5_max\": 0.6188063762925213,\n        \"nauc_ndcg_at_5_std\": 0.269801271967624,\n        \"nauc_precision_at_1000_diff1\": -0.29138047819005797,\n        \"nauc_precision_at_1000_max\": 0.101601813226311,\n        \"nauc_precision_at_1000_std\": 0.1763922980088165,\n        \"nauc_precision_at_100_diff1\": -0.18031829366040822,\n        \"nauc_precision_at_100_max\": 0.2170414669213159,\n        \"nauc_precision_at_100_std\": 0.25866935327202856,\n        \"nauc_precision_at_10_diff1\": -0.0938064195201447,\n        \"nauc_precision_at_10_max\": 0.30520467264375906,\n        \"nauc_precision_at_10_std\": 0.2559624998139914,\n        \"nauc_precision_at_1_diff1\": 0.6575720836305169,\n        \"nauc_precision_at_1_max\": 0.5533847493305769,\n        \"nauc_precision_at_1_std\": 0.21355645302950124,\n        \"nauc_precision_at_20_diff1\": -0.1260731942177778,\n        \"nauc_precision_at_20_max\": 0.27243280987859214,\n        \"nauc_precision_at_20_std\": 0.26381077730402147,\n        \"nauc_precision_at_3_diff1\": 0.05273177364101314,\n        \"nauc_precision_at_3_max\": 0.3895696620910321,\n        \"nauc_precision_at_3_std\": 0.21741897358471318,\n        \"nauc_precision_at_5_diff1\": -0.032521923578669315,\n        \"nauc_precision_at_5_max\": 0.3683805962204715,\n        \"nauc_precision_at_5_std\": 0.26718712482468526,\n        \"nauc_recall_at_1000_diff1\": 0.7311646540840526,\n        \"nauc_recall_at_1000_max\": 0.9428956332658632,\n        \"nauc_recall_at_1000_std\": 0.8378377024188404,\n        \"nauc_recall_at_100_diff1\": 0.7345940983451282,\n        \"nauc_recall_at_100_max\": 0.9204853995815641,\n        \"nauc_recall_at_100_std\": 0.7451243993738742,\n        \"nauc_recall_at_10_diff1\": 0.6400880030997321,\n        \"nauc_recall_at_10_max\": 0.7782417771679832,\n        \"nauc_recall_at_10_std\": 0.46177014614662737,\n        \"nauc_recall_at_1_diff1\": 0.6002554239795219,\n        \"nauc_recall_at_1_max\": 0.234901175002455,\n        \"nauc_recall_at_1_std\": 0.034169324518353,\n        \"nauc_recall_at_20_diff1\": 0.7061094411625372,\n        \"nauc_recall_at_20_max\": 0.8660046059800297,\n        \"nauc_recall_at_20_std\": 0.5751746991889914,\n        \"nauc_recall_at_3_diff1\": 0.5739425851828479,\n        \"nauc_recall_at_3_max\": 0.5294684112762419,\n        \"nauc_recall_at_3_std\": 0.18366776112042058,\n        \"nauc_recall_at_5_diff1\": 0.6126662940491471,\n        \"nauc_recall_at_5_max\": 0.6963000057908852,\n        \"nauc_recall_at_5_std\": 0.362227933418644,\n        \"ndcg_at_1\": 0.72804,\n        \"ndcg_at_10\": 0.79072,\n        \"ndcg_at_100\": 0.80673,\n        \"ndcg_at_1000\": 0.81307,\n        \"ndcg_at_20\": 0.79961,\n        \"ndcg_at_3\": 0.7428,\n        \"ndcg_at_5\": 0.77321,\n        \"precision_at_1\": 0.72804,\n        \"precision_at_10\": 0.16014,\n        \"precision_at_100\": 0.01736,\n        \"precision_at_1000\": 0.00183,\n        \"precision_at_20\": 0.08336,\n        \"precision_at_3\": 0.44651,\n        \"precision_at_5\": 0.29932,\n        \"recall_at_1\": 0.4751,\n        \"recall_at_10\": 0.86162,\n        \"recall_at_100\": 0.91864,\n        \"recall_at_1000\": 0.95721,\n        \"recall_at_20\": 0.88824,\n        \"recall_at_3\": 0.75862,\n        \"recall_at_5\": 0.82077\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-multilingual-gemma2/no_model_name_available/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 226490.0695669651,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.70315,\n        \"map_at_1\": 0.40696,\n        \"map_at_10\": 0.6179,\n        \"map_at_100\": 0.64309,\n        \"map_at_1000\": 0.64353,\n        \"map_at_20\": 0.6354,\n        \"map_at_3\": 0.5396,\n        \"map_at_5\": 0.5818,\n        \"mrr_at_1\": 0.647887323943662,\n        \"mrr_at_10\": 0.7541135703107532,\n        \"mrr_at_100\": 0.756483656164785,\n        \"mrr_at_1000\": 0.7565706179045278,\n        \"mrr_at_20\": 0.7558957279027702,\n        \"mrr_at_3\": 0.7394366197183099,\n        \"mrr_at_5\": 0.7488262910798122,\n        \"nauc_map_at_1000_diff1\": 0.42552998881302734,\n        \"nauc_map_at_1000_max\": 0.43253852127285747,\n        \"nauc_map_at_1000_std\": -0.048738283171735924,\n        \"nauc_map_at_100_diff1\": 0.425107385005373,\n        \"nauc_map_at_100_max\": 0.43288751763034894,\n        \"nauc_map_at_100_std\": -0.04827078902742531,\n        \"nauc_map_at_10_diff1\": 0.4223931151651558,\n        \"nauc_map_at_10_max\": 0.41416943314831794,\n        \"nauc_map_at_10_std\": -0.09765345839536647,\n        \"nauc_map_at_1_diff1\": 0.5476774384667021,\n        \"nauc_map_at_1_max\": 0.3508466130362578,\n        \"nauc_map_at_1_std\": -0.2035097473946885,\n        \"nauc_map_at_20_diff1\": 0.41952567372103966,\n        \"nauc_map_at_20_max\": 0.4277687815742127,\n        \"nauc_map_at_20_std\": -0.058148737142206766,\n        \"nauc_map_at_3_diff1\": 0.4709814401670962,\n        \"nauc_map_at_3_max\": 0.4046661811300015,\n        \"nauc_map_at_3_std\": -0.18553573987315636,\n        \"nauc_map_at_5_diff1\": 0.4558106421319416,\n        \"nauc_map_at_5_max\": 0.3971314966952542,\n        \"nauc_map_at_5_std\": -0.15454760317419264,\n        \"nauc_mrr_at_1000_diff1\": 0.4714198679370516,\n        \"nauc_mrr_at_1000_max\": 0.49974094019049387,\n        \"nauc_mrr_at_1000_std\": 0.059360318840965084,\n        \"nauc_mrr_at_100_diff1\": 0.4714650897451011,\n        \"nauc_mrr_at_100_max\": 0.49982591467441995,\n        \"nauc_mrr_at_100_std\": 0.05959962814788641,\n        \"nauc_mrr_at_10_diff1\": 0.4679289815151978,\n        \"nauc_mrr_at_10_max\": 0.5010831390131519,\n        \"nauc_mrr_at_10_std\": 0.06168711909655768,\n        \"nauc_mrr_at_1_diff1\": 0.5042396590385281,\n        \"nauc_mrr_at_1_max\": 0.4699305141604478,\n        \"nauc_mrr_at_1_std\": -0.0011007059701792971,\n        \"nauc_mrr_at_20_diff1\": 0.4704854162022878,\n        \"nauc_mrr_at_20_max\": 0.5008331396297026,\n        \"nauc_mrr_at_20_std\": 0.060925795418258,\n        \"nauc_mrr_at_3_diff1\": 0.4715046578891891,\n        \"nauc_mrr_at_3_max\": 0.49816203311296314,\n        \"nauc_mrr_at_3_std\": 0.056350371986931214,\n        \"nauc_mrr_at_5_diff1\": 0.4723870570529245,\n        \"nauc_mrr_at_5_max\": 0.4955394810752652,\n        \"nauc_mrr_at_5_std\": 0.06356591587965502,\n        \"nauc_ndcg_at_1000_diff1\": 0.4270525162587747,\n        \"nauc_ndcg_at_1000_max\": 0.47117300959402636,\n        \"nauc_ndcg_at_1000_std\": 0.03133906346076797,\n        \"nauc_ndcg_at_100_diff1\": 0.4221656058478231,\n        \"nauc_ndcg_at_100_max\": 0.4800851305303125,\n        \"nauc_ndcg_at_100_std\": 0.04498541606625714,\n        \"nauc_ndcg_at_10_diff1\": 0.3965948030560033,\n        \"nauc_ndcg_at_10_max\": 0.4512772471953279,\n        \"nauc_ndcg_at_10_std\": -0.030608424277932752,\n        \"nauc_ndcg_at_1_diff1\": 0.5042396590385281,\n        \"nauc_ndcg_at_1_max\": 0.4699305141604478,\n        \"nauc_ndcg_at_1_std\": -0.0011007059701792971,\n        \"nauc_ndcg_at_20_diff1\": 0.39626112547057285,\n        \"nauc_ndcg_at_20_max\": 0.4760189355895963,\n        \"nauc_ndcg_at_20_std\": 0.03248405807057921,\n        \"nauc_ndcg_at_3_diff1\": 0.42166580498704165,\n        \"nauc_ndcg_at_3_max\": 0.45149429818153103,\n        \"nauc_ndcg_at_3_std\": -0.0408513220270249,\n        \"nauc_ndcg_at_5_diff1\": 0.4269384493145147,\n        \"nauc_ndcg_at_5_max\": 0.42644511900266857,\n        \"nauc_ndcg_at_5_std\": -0.03984430540195149,\n        \"nauc_precision_at_1000_diff1\": -0.24101868411855218,\n        \"nauc_precision_at_1000_max\": -0.04746443318515683,\n        \"nauc_precision_at_1000_std\": 0.41741552513094327,\n        \"nauc_precision_at_100_diff1\": -0.23606184742838943,\n        \"nauc_precision_at_100_max\": -0.017038071863325368,\n        \"nauc_precision_at_100_std\": 0.4375692179815892,\n        \"nauc_precision_at_10_diff1\": -0.23798899035846333,\n        \"nauc_precision_at_10_max\": 0.04073411138282004,\n        \"nauc_precision_at_10_std\": 0.40078496264694746,\n        \"nauc_precision_at_1_diff1\": 0.5042396590385281,\n        \"nauc_precision_at_1_max\": 0.4699305141604478,\n        \"nauc_precision_at_1_std\": -0.0011007059701792971,\n        \"nauc_precision_at_20_diff1\": -0.25405923535139,\n        \"nauc_precision_at_20_max\": 0.023578697930631626,\n        \"nauc_precision_at_20_std\": 0.4569720970184273,\n        \"nauc_precision_at_3_diff1\": -0.052995738627394005,\n        \"nauc_precision_at_3_max\": 0.18323842116419178,\n        \"nauc_precision_at_3_std\": 0.2240819386079469,\n        \"nauc_precision_at_5_diff1\": -0.14718211901562456,\n        \"nauc_precision_at_5_max\": 0.0717424078506237,\n        \"nauc_precision_at_5_std\": 0.32151182016566493,\n        \"nauc_recall_at_1000_diff1\": 0.806368320522017,\n        \"nauc_recall_at_1000_max\": -0.17087593368954954,\n        \"nauc_recall_at_1000_std\": -1.1451833892298617,\n        \"nauc_recall_at_100_diff1\": 0.2909290823307582,\n        \"nauc_recall_at_100_max\": 0.6688047794752549,\n        \"nauc_recall_at_100_std\": 0.43562146184686673,\n        \"nauc_recall_at_10_diff1\": 0.20633514494858715,\n        \"nauc_recall_at_10_max\": 0.4057250627983415,\n        \"nauc_recall_at_10_std\": -0.05566438793011242,\n        \"nauc_recall_at_1_diff1\": 0.5476774384667021,\n        \"nauc_recall_at_1_max\": 0.3508466130362578,\n        \"nauc_recall_at_1_std\": -0.2035097473946885,\n        \"nauc_recall_at_20_diff1\": 0.16102371618571604,\n        \"nauc_recall_at_20_max\": 0.5229582968117912,\n        \"nauc_recall_at_20_std\": 0.17547160506393064,\n        \"nauc_recall_at_3_diff1\": 0.3820991451441941,\n        \"nauc_recall_at_3_max\": 0.37984007561200095,\n        \"nauc_recall_at_3_std\": -0.19212144775977344,\n        \"nauc_recall_at_5_diff1\": 0.35722728457669023,\n        \"nauc_recall_at_5_max\": 0.35453563586445336,\n        \"nauc_recall_at_5_std\": -0.15577293164732453,\n        \"ndcg_at_1\": 0.64789,\n        \"ndcg_at_10\": 0.70315,\n        \"ndcg_at_100\": 0.75526,\n        \"ndcg_at_1000\": 0.76135,\n        \"ndcg_at_20\": 0.73133,\n        \"ndcg_at_3\": 0.6588,\n        \"ndcg_at_5\": 0.67139,\n        \"precision_at_1\": 0.64789,\n        \"precision_at_10\": 0.18638,\n        \"precision_at_100\": 0.02474,\n        \"precision_at_1000\": 0.00256,\n        \"precision_at_20\": 0.10775,\n        \"precision_at_3\": 0.40063,\n        \"precision_at_5\": 0.29859,\n        \"recall_at_1\": 0.40696,\n        \"recall_at_10\": 0.79588,\n        \"recall_at_100\": 0.95957,\n        \"recall_at_1000\": 0.99804,\n        \"recall_at_20\": 0.87194,\n        \"recall_at_3\": 0.60968,\n        \"recall_at_5\": 0.69135\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-multilingual-gemma2/no_model_name_available/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 225582.5098335743,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.47521,\n        \"map_at_1\": 0.27633,\n        \"map_at_10\": 0.40312,\n        \"map_at_100\": 0.41514,\n        \"map_at_1000\": 0.41546,\n        \"map_at_20\": 0.41135,\n        \"map_at_3\": 0.36012,\n        \"map_at_5\": 0.38971,\n        \"mrr_at_1\": 0.30403800475059384,\n        \"mrr_at_10\": 0.42929155827018056,\n        \"mrr_at_100\": 0.43882159362643647,\n        \"mrr_at_1000\": 0.4390708750947643,\n        \"mrr_at_20\": 0.43607832888459863,\n        \"mrr_at_3\": 0.39034045922406985,\n        \"mrr_at_5\": 0.4170625494853524,\n        \"nauc_map_at_1000_diff1\": 0.3299997110422999,\n        \"nauc_map_at_1000_max\": 0.261136550440722,\n        \"nauc_map_at_1000_std\": 0.05180398576481644,\n        \"nauc_map_at_100_diff1\": 0.32981208083213237,\n        \"nauc_map_at_100_max\": 0.26113801470672554,\n        \"nauc_map_at_100_std\": 0.051673677500214926,\n        \"nauc_map_at_10_diff1\": 0.3274851176386591,\n        \"nauc_map_at_10_max\": 0.2603323830317976,\n        \"nauc_map_at_10_std\": 0.052308397860183264,\n        \"nauc_map_at_1_diff1\": 0.41465785426818985,\n        \"nauc_map_at_1_max\": 0.27030540018926097,\n        \"nauc_map_at_1_std\": 0.0023165462854145853,\n        \"nauc_map_at_20_diff1\": 0.32880687706482875,\n        \"nauc_map_at_20_max\": 0.2629650012217612,\n        \"nauc_map_at_20_std\": 0.05446051110700691,\n        \"nauc_map_at_3_diff1\": 0.3428481637942387,\n        \"nauc_map_at_3_max\": 0.26321278862175634,\n        \"nauc_map_at_3_std\": 0.037101244696859936,\n        \"nauc_map_at_5_diff1\": 0.33321956753870174,\n        \"nauc_map_at_5_max\": 0.2629455113862495,\n        \"nauc_map_at_5_std\": 0.05460387559470636,\n        \"nauc_mrr_at_1000_diff1\": 0.3391131477393978,\n        \"nauc_mrr_at_1000_max\": 0.2670718808327621,\n        \"nauc_mrr_at_1000_std\": 0.05745966983171127,\n        \"nauc_mrr_at_100_diff1\": 0.3390230568793171,\n        \"nauc_mrr_at_100_max\": 0.2671436426531771,\n        \"nauc_mrr_at_100_std\": 0.05736360861869989,\n        \"nauc_mrr_at_10_diff1\": 0.3344011804166142,\n        \"nauc_mrr_at_10_max\": 0.2657666006840405,\n        \"nauc_mrr_at_10_std\": 0.057863489730523174,\n        \"nauc_mrr_at_1_diff1\": 0.41442850939921844,\n        \"nauc_mrr_at_1_max\": 0.27186743449287076,\n        \"nauc_mrr_at_1_std\": 0.01296059900788334,\n        \"nauc_mrr_at_20_diff1\": 0.338040888416676,\n        \"nauc_mrr_at_20_max\": 0.26892076225670264,\n        \"nauc_mrr_at_20_std\": 0.059408352473913524,\n        \"nauc_mrr_at_3_diff1\": 0.34798351395796856,\n        \"nauc_mrr_at_3_max\": 0.2721745101928153,\n        \"nauc_mrr_at_3_std\": 0.054692191143277176,\n        \"nauc_mrr_at_5_diff1\": 0.3376418122676429,\n        \"nauc_mrr_at_5_max\": 0.2634763841561849,\n        \"nauc_mrr_at_5_std\": 0.06183139175418699,\n        \"nauc_ndcg_at_1000_diff1\": 0.31131009883990385,\n        \"nauc_ndcg_at_1000_max\": 0.26439124461019764,\n        \"nauc_ndcg_at_1000_std\": 0.07304740928882791,\n        \"nauc_ndcg_at_100_diff1\": 0.3060948038438666,\n        \"nauc_ndcg_at_100_max\": 0.2645714917339233,\n        \"nauc_ndcg_at_100_std\": 0.07049845288026353,\n        \"nauc_ndcg_at_10_diff1\": 0.2924432543443178,\n        \"nauc_ndcg_at_10_max\": 0.2632135618758708,\n        \"nauc_ndcg_at_10_std\": 0.07745730443694289,\n        \"nauc_ndcg_at_1_diff1\": 0.41442850939921844,\n        \"nauc_ndcg_at_1_max\": 0.27186743449287076,\n        \"nauc_ndcg_at_1_std\": 0.01296059900788334,\n        \"nauc_ndcg_at_20_diff1\": 0.2993053088686414,\n        \"nauc_ndcg_at_20_max\": 0.2748616805397411,\n        \"nauc_ndcg_at_20_std\": 0.08624189874787164,\n        \"nauc_ndcg_at_3_diff1\": 0.3266546843467852,\n        \"nauc_ndcg_at_3_max\": 0.26790901916180276,\n        \"nauc_ndcg_at_3_std\": 0.05528896643741061,\n        \"nauc_ndcg_at_5_diff1\": 0.3068610853041326,\n        \"nauc_ndcg_at_5_max\": 0.2638375185069462,\n        \"nauc_ndcg_at_5_std\": 0.08316288426103477,\n        \"nauc_precision_at_1000_diff1\": -0.05523684016254207,\n        \"nauc_precision_at_1000_max\": -0.00905274759700128,\n        \"nauc_precision_at_1000_std\": 0.07357648643285562,\n        \"nauc_precision_at_100_diff1\": -0.027874601394909285,\n        \"nauc_precision_at_100_max\": 0.0446628567171925,\n        \"nauc_precision_at_100_std\": 0.07016491966862602,\n        \"nauc_precision_at_10_diff1\": 0.11500240615914001,\n        \"nauc_precision_at_10_max\": 0.21040947801283377,\n        \"nauc_precision_at_10_std\": 0.1464462638185187,\n        \"nauc_precision_at_1_diff1\": 0.41442850939921844,\n        \"nauc_precision_at_1_max\": 0.27186743449287076,\n        \"nauc_precision_at_1_std\": 0.01296059900788334,\n        \"nauc_precision_at_20_diff1\": 0.062028655994787185,\n        \"nauc_precision_at_20_max\": 0.19068781355702719,\n        \"nauc_precision_at_20_std\": 0.17273256146657345,\n        \"nauc_precision_at_3_diff1\": 0.2602570091547143,\n        \"nauc_precision_at_3_max\": 0.2657809243311167,\n        \"nauc_precision_at_3_std\": 0.1105366063394043,\n        \"nauc_precision_at_5_diff1\": 0.1944037995411402,\n        \"nauc_precision_at_5_max\": 0.24159428718600895,\n        \"nauc_precision_at_5_std\": 0.17169251233558955,\n        \"nauc_recall_at_1000_diff1\": 0.02465665919311491,\n        \"nauc_recall_at_1000_max\": 0.33345290954641715,\n        \"nauc_recall_at_1000_std\": 0.5754950856097731,\n        \"nauc_recall_at_100_diff1\": 0.09651938189716085,\n        \"nauc_recall_at_100_max\": 0.27347112901513265,\n        \"nauc_recall_at_100_std\": 0.17782919554033105,\n        \"nauc_recall_at_10_diff1\": 0.13957480788444254,\n        \"nauc_recall_at_10_max\": 0.25693549389031883,\n        \"nauc_recall_at_10_std\": 0.1576834345452784,\n        \"nauc_recall_at_1_diff1\": 0.41465785426818985,\n        \"nauc_recall_at_1_max\": 0.27030540018926097,\n        \"nauc_recall_at_1_std\": 0.0023165462854145853,\n        \"nauc_recall_at_20_diff1\": 0.13755908199795955,\n        \"nauc_recall_at_20_max\": 0.3302629769637712,\n        \"nauc_recall_at_20_std\": 0.23341298688647236,\n        \"nauc_recall_at_3_diff1\": 0.2669687987201209,\n        \"nauc_recall_at_3_max\": 0.2635911241634212,\n        \"nauc_recall_at_3_std\": 0.08708729704891159,\n        \"nauc_recall_at_5_diff1\": 0.2075990915648664,\n        \"nauc_recall_at_5_max\": 0.25456082319944046,\n        \"nauc_recall_at_5_std\": 0.1620135372926199,\n        \"ndcg_at_1\": 0.30404,\n        \"ndcg_at_10\": 0.47521,\n        \"ndcg_at_100\": 0.5268,\n        \"ndcg_at_1000\": 0.5359,\n        \"ndcg_at_20\": 0.50275,\n        \"ndcg_at_3\": 0.39307,\n        \"ndcg_at_5\": 0.44387,\n        \"precision_at_1\": 0.30404,\n        \"precision_at_10\": 0.07625,\n        \"precision_at_100\": 0.01048,\n        \"precision_at_1000\": 0.00113,\n        \"precision_at_20\": 0.04442,\n        \"precision_at_3\": 0.16865,\n        \"precision_at_5\": 0.12922,\n        \"recall_at_1\": 0.27633,\n        \"recall_at_10\": 0.67181,\n        \"recall_at_100\": 0.89667,\n        \"recall_at_1000\": 0.96873,\n        \"recall_at_20\": 0.77553,\n        \"recall_at_3\": 0.45962,\n        \"recall_at_5\": 0.57878\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-multilingual-gemma2/no_model_name_available/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 1957.7613937854767,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.31021,\n        \"map_at_1\": 0.205,\n        \"map_at_10\": 0.27098,\n        \"map_at_100\": 0.27647,\n        \"map_at_1000\": 0.27733,\n        \"map_at_20\": 0.2736,\n        \"map_at_3\": 0.24583,\n        \"map_at_5\": 0.26408,\n        \"mrr_at_1\": 0.205,\n        \"mrr_at_10\": 0.2709781746031746,\n        \"mrr_at_100\": 0.2764738908569317,\n        \"mrr_at_1000\": 0.27733006788463876,\n        \"mrr_at_20\": 0.2735993867243867,\n        \"mrr_at_3\": 0.24583333333333332,\n        \"mrr_at_5\": 0.26408333333333334,\n        \"nauc_map_at_1000_diff1\": 0.39733314773068384,\n        \"nauc_map_at_1000_max\": 0.26177504420530523,\n        \"nauc_map_at_1000_std\": -0.044565445932742434,\n        \"nauc_map_at_100_diff1\": 0.3973711015291718,\n        \"nauc_map_at_100_max\": 0.26210930689594614,\n        \"nauc_map_at_100_std\": -0.044480465313211245,\n        \"nauc_map_at_10_diff1\": 0.4008119062964794,\n        \"nauc_map_at_10_max\": 0.26615517939284056,\n        \"nauc_map_at_10_std\": -0.048709690232786436,\n        \"nauc_map_at_1_diff1\": 0.3974833515872953,\n        \"nauc_map_at_1_max\": 0.2091824090433059,\n        \"nauc_map_at_1_std\": -0.07337293243902232,\n        \"nauc_map_at_20_diff1\": 0.39855645189686256,\n        \"nauc_map_at_20_max\": 0.26309233062394216,\n        \"nauc_map_at_20_std\": -0.0470281024793479,\n        \"nauc_map_at_3_diff1\": 0.38411975469841636,\n        \"nauc_map_at_3_max\": 0.23797842781734818,\n        \"nauc_map_at_3_std\": -0.08279732915833832,\n        \"nauc_map_at_5_diff1\": 0.3972286051496386,\n        \"nauc_map_at_5_max\": 0.2603135968220476,\n        \"nauc_map_at_5_std\": -0.06161473773449569,\n        \"nauc_mrr_at_1000_diff1\": 0.39733314773068384,\n        \"nauc_mrr_at_1000_max\": 0.26177504420530523,\n        \"nauc_mrr_at_1000_std\": -0.044565445932742434,\n        \"nauc_mrr_at_100_diff1\": 0.3973711015291718,\n        \"nauc_mrr_at_100_max\": 0.26210930689594614,\n        \"nauc_mrr_at_100_std\": -0.044480465313211245,\n        \"nauc_mrr_at_10_diff1\": 0.4008119062964794,\n        \"nauc_mrr_at_10_max\": 0.26615517939284056,\n        \"nauc_mrr_at_10_std\": -0.048709690232786436,\n        \"nauc_mrr_at_1_diff1\": 0.3974833515872953,\n        \"nauc_mrr_at_1_max\": 0.2091824090433059,\n        \"nauc_mrr_at_1_std\": -0.07337293243902232,\n        \"nauc_mrr_at_20_diff1\": 0.39855645189686256,\n        \"nauc_mrr_at_20_max\": 0.26309233062394216,\n        \"nauc_mrr_at_20_std\": -0.0470281024793479,\n        \"nauc_mrr_at_3_diff1\": 0.38411975469841636,\n        \"nauc_mrr_at_3_max\": 0.23797842781734818,\n        \"nauc_mrr_at_3_std\": -0.08279732915833832,\n        \"nauc_mrr_at_5_diff1\": 0.3972286051496386,\n        \"nauc_mrr_at_5_max\": 0.2603135968220476,\n        \"nauc_mrr_at_5_std\": -0.06161473773449569,\n        \"nauc_ndcg_at_1000_diff1\": 0.4013539559811185,\n        \"nauc_ndcg_at_1000_max\": 0.28507892906757715,\n        \"nauc_ndcg_at_1000_std\": 0.004858667645440177,\n        \"nauc_ndcg_at_100_diff1\": 0.4007852359443604,\n        \"nauc_ndcg_at_100_max\": 0.2907197959727122,\n        \"nauc_ndcg_at_100_std\": 0.007853949474176185,\n        \"nauc_ndcg_at_10_diff1\": 0.4149383023022595,\n        \"nauc_ndcg_at_10_max\": 0.3045199903629755,\n        \"nauc_ndcg_at_10_std\": -0.015284828398756922,\n        \"nauc_ndcg_at_1_diff1\": 0.3974833515872953,\n        \"nauc_ndcg_at_1_max\": 0.2091824090433059,\n        \"nauc_ndcg_at_1_std\": -0.07337293243902232,\n        \"nauc_ndcg_at_20_diff1\": 0.40616856971054405,\n        \"nauc_ndcg_at_20_max\": 0.29242695558692794,\n        \"nauc_ndcg_at_20_std\": -0.01101570303459534,\n        \"nauc_ndcg_at_3_diff1\": 0.3840734360437966,\n        \"nauc_ndcg_at_3_max\": 0.2527827522900115,\n        \"nauc_ndcg_at_3_std\": -0.08424756880596201,\n        \"nauc_ndcg_at_5_diff1\": 0.4059240405340309,\n        \"nauc_ndcg_at_5_max\": 0.29096068689802457,\n        \"nauc_ndcg_at_5_std\": -0.04612859569696686,\n        \"nauc_precision_at_1000_diff1\": 0.4244877773067686,\n        \"nauc_precision_at_1000_max\": 0.3884131694220722,\n        \"nauc_precision_at_1000_std\": 0.353002684753426,\n        \"nauc_precision_at_100_diff1\": 0.4059412515587299,\n        \"nauc_precision_at_100_max\": 0.37999808156308357,\n        \"nauc_precision_at_100_std\": 0.21763191098452753,\n        \"nauc_precision_at_10_diff1\": 0.458027996534631,\n        \"nauc_precision_at_10_max\": 0.4135774724952613,\n        \"nauc_precision_at_10_std\": 0.08749405611031875,\n        \"nauc_precision_at_1_diff1\": 0.3974833515872953,\n        \"nauc_precision_at_1_max\": 0.2091824090433059,\n        \"nauc_precision_at_1_std\": -0.07337293243902232,\n        \"nauc_precision_at_20_diff1\": 0.425010732093914,\n        \"nauc_precision_at_20_max\": 0.36834527622758645,\n        \"nauc_precision_at_20_std\": 0.1013638014727735,\n        \"nauc_precision_at_3_diff1\": 0.385060685909143,\n        \"nauc_precision_at_3_max\": 0.293442147897053,\n        \"nauc_precision_at_3_std\": -0.0876761441366157,\n        \"nauc_precision_at_5_diff1\": 0.43126170920335316,\n        \"nauc_precision_at_5_max\": 0.37529738945539676,\n        \"nauc_precision_at_5_std\": -0.0007714298679494246,\n        \"nauc_recall_at_1000_diff1\": 0.4244877773067688,\n        \"nauc_recall_at_1000_max\": 0.38841316942207216,\n        \"nauc_recall_at_1000_std\": 0.35300268475342617,\n        \"nauc_recall_at_100_diff1\": 0.40594125155873034,\n        \"nauc_recall_at_100_max\": 0.37999808156308335,\n        \"nauc_recall_at_100_std\": 0.21763191098452705,\n        \"nauc_recall_at_10_diff1\": 0.458027996534631,\n        \"nauc_recall_at_10_max\": 0.413577472495261,\n        \"nauc_recall_at_10_std\": 0.08749405611031859,\n        \"nauc_recall_at_1_diff1\": 0.3974833515872953,\n        \"nauc_recall_at_1_max\": 0.2091824090433059,\n        \"nauc_recall_at_1_std\": -0.07337293243902232,\n        \"nauc_recall_at_20_diff1\": 0.42501073209391427,\n        \"nauc_recall_at_20_max\": 0.36834527622758656,\n        \"nauc_recall_at_20_std\": 0.10136380147277349,\n        \"nauc_recall_at_3_diff1\": 0.3850606859091431,\n        \"nauc_recall_at_3_max\": 0.293442147897053,\n        \"nauc_recall_at_3_std\": -0.08767614413661576,\n        \"nauc_recall_at_5_diff1\": 0.4312617092033527,\n        \"nauc_recall_at_5_max\": 0.3752973894553965,\n        \"nauc_recall_at_5_std\": -0.0007714298679495149,\n        \"ndcg_at_1\": 0.205,\n        \"ndcg_at_10\": 0.31021,\n        \"ndcg_at_100\": 0.34194,\n        \"ndcg_at_1000\": 0.36992,\n        \"ndcg_at_20\": 0.32013,\n        \"ndcg_at_3\": 0.26089,\n        \"ndcg_at_5\": 0.29381,\n        \"precision_at_1\": 0.205,\n        \"precision_at_10\": 0.0435,\n        \"precision_at_100\": 0.00595,\n        \"precision_at_1000\": 0.00083,\n        \"precision_at_20\": 0.02375,\n        \"precision_at_3\": 0.10167,\n        \"precision_at_5\": 0.077,\n        \"recall_at_1\": 0.205,\n        \"recall_at_10\": 0.435,\n        \"recall_at_100\": 0.595,\n        \"recall_at_1000\": 0.825,\n        \"recall_at_20\": 0.475,\n        \"recall_at_3\": 0.305,\n        \"recall_at_5\": 0.385\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.28278,\n        \"map_at_1\": 0.2,\n        \"map_at_10\": 0.25367,\n        \"map_at_100\": 0.26251,\n        \"map_at_1000\": 0.26325,\n        \"map_at_20\": 0.25857,\n        \"map_at_3\": 0.23833,\n        \"map_at_5\": 0.24833,\n        \"mrr_at_1\": 0.2,\n        \"mrr_at_10\": 0.253670634920635,\n        \"mrr_at_100\": 0.2625110520095054,\n        \"mrr_at_1000\": 0.26325325927271204,\n        \"mrr_at_20\": 0.2585687943592357,\n        \"mrr_at_3\": 0.23833333333333337,\n        \"mrr_at_5\": 0.24833333333333335,\n        \"nauc_map_at_1000_diff1\": 0.48846433045230764,\n        \"nauc_map_at_1000_max\": 0.4184821449135949,\n        \"nauc_map_at_1000_std\": 0.1649120543143561,\n        \"nauc_map_at_100_diff1\": 0.48850419034873516,\n        \"nauc_map_at_100_max\": 0.4187393743703572,\n        \"nauc_map_at_100_std\": 0.1651000090790014,\n        \"nauc_map_at_10_diff1\": 0.4951649412044444,\n        \"nauc_map_at_10_max\": 0.4173850927312253,\n        \"nauc_map_at_10_std\": 0.15971050008080603,\n        \"nauc_map_at_1_diff1\": 0.5464401033257992,\n        \"nauc_map_at_1_max\": 0.40082337746206026,\n        \"nauc_map_at_1_std\": 0.1043186955117856,\n        \"nauc_map_at_20_diff1\": 0.49048308444617456,\n        \"nauc_map_at_20_max\": 0.41788675027001815,\n        \"nauc_map_at_20_std\": 0.16211881844640397,\n        \"nauc_map_at_3_diff1\": 0.4937193447187161,\n        \"nauc_map_at_3_max\": 0.4130072283244158,\n        \"nauc_map_at_3_std\": 0.1410825210753104,\n        \"nauc_map_at_5_diff1\": 0.4950184057607674,\n        \"nauc_map_at_5_max\": 0.42583483715307674,\n        \"nauc_map_at_5_std\": 0.16011398415838624,\n        \"nauc_mrr_at_1000_diff1\": 0.48846433045230764,\n        \"nauc_mrr_at_1000_max\": 0.4184821449135949,\n        \"nauc_mrr_at_1000_std\": 0.1649120543143561,\n        \"nauc_mrr_at_100_diff1\": 0.48850419034873516,\n        \"nauc_mrr_at_100_max\": 0.4187393743703572,\n        \"nauc_mrr_at_100_std\": 0.1651000090790014,\n        \"nauc_mrr_at_10_diff1\": 0.4951649412044444,\n        \"nauc_mrr_at_10_max\": 0.4173850927312253,\n        \"nauc_mrr_at_10_std\": 0.15971050008080603,\n        \"nauc_mrr_at_1_diff1\": 0.5464401033257992,\n        \"nauc_mrr_at_1_max\": 0.40082337746206026,\n        \"nauc_mrr_at_1_std\": 0.1043186955117856,\n        \"nauc_mrr_at_20_diff1\": 0.49048308444617456,\n        \"nauc_mrr_at_20_max\": 0.41788675027001815,\n        \"nauc_mrr_at_20_std\": 0.16211881844640397,\n        \"nauc_mrr_at_3_diff1\": 0.4937193447187161,\n        \"nauc_mrr_at_3_max\": 0.4130072283244158,\n        \"nauc_mrr_at_3_std\": 0.1410825210753104,\n        \"nauc_mrr_at_5_diff1\": 0.4950184057607674,\n        \"nauc_mrr_at_5_max\": 0.42583483715307674,\n        \"nauc_mrr_at_5_std\": 0.16011398415838624,\n        \"nauc_ndcg_at_1000_diff1\": 0.45934372208001717,\n        \"nauc_ndcg_at_1000_max\": 0.4215169378811277,\n        \"nauc_ndcg_at_1000_std\": 0.20931476899785414,\n        \"nauc_ndcg_at_100_diff1\": 0.45624813807719783,\n        \"nauc_ndcg_at_100_max\": 0.4275818663860078,\n        \"nauc_ndcg_at_100_std\": 0.21518755563634898,\n        \"nauc_ndcg_at_10_diff1\": 0.4825968395141318,\n        \"nauc_ndcg_at_10_max\": 0.4189614797028018,\n        \"nauc_ndcg_at_10_std\": 0.18252879839759328,\n        \"nauc_ndcg_at_1_diff1\": 0.5464401033257992,\n        \"nauc_ndcg_at_1_max\": 0.40082337746206026,\n        \"nauc_ndcg_at_1_std\": 0.1043186955117856,\n        \"nauc_ndcg_at_20_diff1\": 0.4673813466344015,\n        \"nauc_ndcg_at_20_max\": 0.42296503599069235,\n        \"nauc_ndcg_at_20_std\": 0.1929808659951319,\n        \"nauc_ndcg_at_3_diff1\": 0.47916085101108324,\n        \"nauc_ndcg_at_3_max\": 0.4152641986255343,\n        \"nauc_ndcg_at_3_std\": 0.15033600889958793,\n        \"nauc_ndcg_at_5_diff1\": 0.4814091000301,\n        \"nauc_ndcg_at_5_max\": 0.4386330550531778,\n        \"nauc_ndcg_at_5_std\": 0.18384208900679808,\n        \"nauc_precision_at_1000_diff1\": 0.31238761238761237,\n        \"nauc_precision_at_1000_max\": 0.4142482517482516,\n        \"nauc_precision_at_1000_std\": 0.4742382617382624,\n        \"nauc_precision_at_100_diff1\": 0.3347757406062608,\n        \"nauc_precision_at_100_max\": 0.462818084493124,\n        \"nauc_precision_at_100_std\": 0.42115547303721634,\n        \"nauc_precision_at_10_diff1\": 0.45217391304347826,\n        \"nauc_precision_at_10_max\": 0.4194105194593717,\n        \"nauc_precision_at_10_std\": 0.24364110079791576,\n        \"nauc_precision_at_1_diff1\": 0.5464401033257992,\n        \"nauc_precision_at_1_max\": 0.40082337746206026,\n        \"nauc_precision_at_1_std\": 0.1043186955117856,\n        \"nauc_precision_at_20_diff1\": 0.39996601151686717,\n        \"nauc_precision_at_20_max\": 0.43821612753524697,\n        \"nauc_precision_at_20_std\": 0.2850326485525485,\n        \"nauc_precision_at_3_diff1\": 0.4409502355672158,\n        \"nauc_precision_at_3_max\": 0.4208480419762924,\n        \"nauc_precision_at_3_std\": 0.1743472109665811,\n        \"nauc_precision_at_5_diff1\": 0.44671921587898206,\n        \"nauc_precision_at_5_max\": 0.4748554011249165,\n        \"nauc_precision_at_5_std\": 0.24908193825578231,\n        \"nauc_recall_at_1000_diff1\": 0.31238761238761215,\n        \"nauc_recall_at_1000_max\": 0.41424825174825103,\n        \"nauc_recall_at_1000_std\": 0.47423826173826156,\n        \"nauc_recall_at_100_diff1\": 0.33477574060626,\n        \"nauc_recall_at_100_max\": 0.4628180844931236,\n        \"nauc_recall_at_100_std\": 0.42115547303721584,\n        \"nauc_recall_at_10_diff1\": 0.4521739130434784,\n        \"nauc_recall_at_10_max\": 0.4194105194593716,\n        \"nauc_recall_at_10_std\": 0.24364110079791582,\n        \"nauc_recall_at_1_diff1\": 0.5464401033257992,\n        \"nauc_recall_at_1_max\": 0.40082337746206026,\n        \"nauc_recall_at_1_std\": 0.1043186955117856,\n        \"nauc_recall_at_20_diff1\": 0.3999660115168666,\n        \"nauc_recall_at_20_max\": 0.4382161275352466,\n        \"nauc_recall_at_20_std\": 0.2850326485525483,\n        \"nauc_recall_at_3_diff1\": 0.44095023556721585,\n        \"nauc_recall_at_3_max\": 0.4208480419762923,\n        \"nauc_recall_at_3_std\": 0.17434721096658118,\n        \"nauc_recall_at_5_diff1\": 0.4467192158789817,\n        \"nauc_recall_at_5_max\": 0.47485540112491614,\n        \"nauc_recall_at_5_std\": 0.2490819382557821,\n        \"ndcg_at_1\": 0.2,\n        \"ndcg_at_10\": 0.28278,\n        \"ndcg_at_100\": 0.32982,\n        \"ndcg_at_1000\": 0.35357,\n        \"ndcg_at_20\": 0.30054,\n        \"ndcg_at_3\": 0.25155,\n        \"ndcg_at_5\": 0.26983,\n        \"precision_at_1\": 0.2,\n        \"precision_at_10\": 0.0375,\n        \"precision_at_100\": 0.00605,\n        \"precision_at_1000\": 0.0008,\n        \"precision_at_20\": 0.02225,\n        \"precision_at_3\": 0.09667,\n        \"precision_at_5\": 0.067,\n        \"recall_at_1\": 0.2,\n        \"recall_at_10\": 0.375,\n        \"recall_at_100\": 0.605,\n        \"recall_at_1000\": 0.8,\n        \"recall_at_20\": 0.445,\n        \"recall_at_3\": 0.29,\n        \"recall_at_5\": 0.335\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-multilingual-gemma2/no_model_name_available/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 13.14871883392334,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.87102,\n        \"map_at_1\": 0.76623,\n        \"map_at_10\": 0.83824,\n        \"map_at_100\": 0.8405,\n        \"map_at_1000\": 0.8405,\n        \"map_at_20\": 0.8405,\n        \"map_at_3\": 0.829,\n        \"map_at_5\": 0.83225,\n        \"mrr_at_1\": 0.7662337662337663,\n        \"mrr_at_10\": 0.8382395382395383,\n        \"mrr_at_100\": 0.8405024268660632,\n        \"mrr_at_1000\": 0.8405024268660632,\n        \"mrr_at_20\": 0.8405024268660632,\n        \"mrr_at_3\": 0.8290043290043291,\n        \"mrr_at_5\": 0.8322510822510824,\n        \"nauc_map_at_1000_diff1\": 0.6885097620218021,\n        \"nauc_map_at_1000_max\": 0.4904532674828099,\n        \"nauc_map_at_1000_std\": -0.04312965967394911,\n        \"nauc_map_at_100_diff1\": 0.6885097620218021,\n        \"nauc_map_at_100_max\": 0.4904532674828099,\n        \"nauc_map_at_100_std\": -0.04312965967394911,\n        \"nauc_map_at_10_diff1\": 0.6872038137909682,\n        \"nauc_map_at_10_max\": 0.48687056680246493,\n        \"nauc_map_at_10_std\": -0.05217570853794742,\n        \"nauc_map_at_1_diff1\": 0.7055578519524833,\n        \"nauc_map_at_1_max\": 0.4691591722758418,\n        \"nauc_map_at_1_std\": -0.04903115664558869,\n        \"nauc_map_at_20_diff1\": 0.6885097620218021,\n        \"nauc_map_at_20_max\": 0.4904532674828099,\n        \"nauc_map_at_20_std\": -0.04312965967394911,\n        \"nauc_map_at_3_diff1\": 0.6938494791877855,\n        \"nauc_map_at_3_max\": 0.5041937160694657,\n        \"nauc_map_at_3_std\": -0.01740315649056545,\n        \"nauc_map_at_5_diff1\": 0.6874582527449108,\n        \"nauc_map_at_5_max\": 0.4938432184645834,\n        \"nauc_map_at_5_std\": -0.03864255840167695,\n        \"nauc_mrr_at_1000_diff1\": 0.6885097620218021,\n        \"nauc_mrr_at_1000_max\": 0.4904532674828099,\n        \"nauc_mrr_at_1000_std\": -0.04312965967394911,\n        \"nauc_mrr_at_100_diff1\": 0.6885097620218021,\n        \"nauc_mrr_at_100_max\": 0.4904532674828099,\n        \"nauc_mrr_at_100_std\": -0.04312965967394911,\n        \"nauc_mrr_at_10_diff1\": 0.6872038137909682,\n        \"nauc_mrr_at_10_max\": 0.48687056680246493,\n        \"nauc_mrr_at_10_std\": -0.05217570853794742,\n        \"nauc_mrr_at_1_diff1\": 0.7055578519524833,\n        \"nauc_mrr_at_1_max\": 0.4691591722758418,\n        \"nauc_mrr_at_1_std\": -0.04903115664558869,\n        \"nauc_mrr_at_20_diff1\": 0.6885097620218021,\n        \"nauc_mrr_at_20_max\": 0.4904532674828099,\n        \"nauc_mrr_at_20_std\": -0.04312965967394911,\n        \"nauc_mrr_at_3_diff1\": 0.6938494791877855,\n        \"nauc_mrr_at_3_max\": 0.5041937160694657,\n        \"nauc_mrr_at_3_std\": -0.01740315649056545,\n        \"nauc_mrr_at_5_diff1\": 0.6874582527449108,\n        \"nauc_mrr_at_5_max\": 0.4938432184645834,\n        \"nauc_mrr_at_5_std\": -0.03864255840167695,\n        \"nauc_ndcg_at_1000_diff1\": 0.6875068929206645,\n        \"nauc_ndcg_at_1000_max\": 0.4907520578278997,\n        \"nauc_ndcg_at_1000_std\": -0.04447977952738645,\n        \"nauc_ndcg_at_100_diff1\": 0.6875068929206645,\n        \"nauc_ndcg_at_100_max\": 0.4907520578278997,\n        \"nauc_ndcg_at_100_std\": -0.04447977952738645,\n        \"nauc_ndcg_at_10_diff1\": 0.6828535625360586,\n        \"nauc_ndcg_at_10_max\": 0.4753715542957344,\n        \"nauc_ndcg_at_10_std\": -0.08166804488905967,\n        \"nauc_ndcg_at_1_diff1\": 0.7055578519524833,\n        \"nauc_ndcg_at_1_max\": 0.4691591722758418,\n        \"nauc_ndcg_at_1_std\": -0.04903115664558869,\n        \"nauc_ndcg_at_20_diff1\": 0.6875068929206645,\n        \"nauc_ndcg_at_20_max\": 0.4907520578278997,\n        \"nauc_ndcg_at_20_std\": -0.04447977952738645,\n        \"nauc_ndcg_at_3_diff1\": 0.6967417535519655,\n        \"nauc_ndcg_at_3_max\": 0.5162820063696817,\n        \"nauc_ndcg_at_3_std\": 0.001959353725228958,\n        \"nauc_ndcg_at_5_diff1\": 0.6842494443336714,\n        \"nauc_ndcg_at_5_max\": 0.4963559043702825,\n        \"nauc_ndcg_at_5_std\": -0.03915356739636289,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.613314205220816,\n        \"nauc_precision_at_10_max\": 0.21977808756952869,\n        \"nauc_precision_at_10_std\": -0.68631307805364,\n        \"nauc_precision_at_1_diff1\": 0.7055578519524833,\n        \"nauc_precision_at_1_max\": 0.4691591722758418,\n        \"nauc_precision_at_1_std\": -0.04903115664558869,\n        \"nauc_precision_at_20_diff1\": 1.0,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 1.0,\n        \"nauc_precision_at_3_diff1\": 0.7154433535920243,\n        \"nauc_precision_at_3_max\": 0.5750317724577289,\n        \"nauc_precision_at_3_std\": 0.10172403925188567,\n        \"nauc_precision_at_5_diff1\": 0.6680172458573604,\n        \"nauc_precision_at_5_max\": 0.5042037345340171,\n        \"nauc_precision_at_5_std\": -0.047988620872798975,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.6133142052208155,\n        \"nauc_recall_at_10_max\": 0.21977808756952488,\n        \"nauc_recall_at_10_std\": -0.6863130780536503,\n        \"nauc_recall_at_1_diff1\": 0.7055578519524833,\n        \"nauc_recall_at_1_max\": 0.4691591722758418,\n        \"nauc_recall_at_1_std\": -0.04903115664558869,\n        \"nauc_recall_at_20_diff1\": NaN,\n        \"nauc_recall_at_20_max\": NaN,\n        \"nauc_recall_at_20_std\": NaN,\n        \"nauc_recall_at_3_diff1\": 0.7154433535920213,\n        \"nauc_recall_at_3_max\": 0.5750317724577277,\n        \"nauc_recall_at_3_std\": 0.10172403925188503,\n        \"nauc_recall_at_5_diff1\": 0.668017245857358,\n        \"nauc_recall_at_5_max\": 0.5042037345340157,\n        \"nauc_recall_at_5_std\": -0.04798862087280273,\n        \"ndcg_at_1\": 0.76623,\n        \"ndcg_at_10\": 0.87102,\n        \"ndcg_at_100\": 0.87815,\n        \"ndcg_at_1000\": 0.87815,\n        \"ndcg_at_20\": 0.87815,\n        \"ndcg_at_3\": 0.84957,\n        \"ndcg_at_5\": 0.85516,\n        \"precision_at_1\": 0.76623,\n        \"precision_at_10\": 0.0974,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.05,\n        \"precision_at_3\": 0.30303,\n        \"precision_at_5\": 0.18442,\n        \"recall_at_1\": 0.76623,\n        \"recall_at_10\": 0.97403,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 1.0,\n        \"recall_at_3\": 0.90909,\n        \"recall_at_5\": 0.92208\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-multilingual-gemma2/no_model_name_available/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 214.9201488494873,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.37446,\n        \"map_at_1\": 0.20971,\n        \"map_at_10\": 0.32866,\n        \"map_at_100\": 0.34424,\n        \"map_at_1000\": 0.34533,\n        \"map_at_20\": 0.33707,\n        \"map_at_3\": 0.29453,\n        \"map_at_5\": 0.31455,\n        \"mrr_at_1\": 0.29357798165137616,\n        \"mrr_at_10\": 0.36200548517062264,\n        \"mrr_at_100\": 0.3740163116039349,\n        \"mrr_at_1000\": 0.37468599603491515,\n        \"mrr_at_20\": 0.3687663363276522,\n        \"mrr_at_3\": 0.3409785932721714,\n        \"mrr_at_5\": 0.35275229357798166,\n        \"nauc_map_at_1000_diff1\": 0.45378110647853365,\n        \"nauc_map_at_1000_max\": 0.04759413522164465,\n        \"nauc_map_at_1000_std\": -0.3401700100287993,\n        \"nauc_map_at_100_diff1\": 0.45329104168210915,\n        \"nauc_map_at_100_max\": 0.047579865387336544,\n        \"nauc_map_at_100_std\": -0.3399619310023172,\n        \"nauc_map_at_10_diff1\": 0.4577169109716571,\n        \"nauc_map_at_10_max\": 0.05097338145091819,\n        \"nauc_map_at_10_std\": -0.3413191852269897,\n        \"nauc_map_at_1_diff1\": 0.5518348816563906,\n        \"nauc_map_at_1_max\": 0.07377101119089663,\n        \"nauc_map_at_1_std\": -0.26809843855821786,\n        \"nauc_map_at_20_diff1\": 0.4547596157257102,\n        \"nauc_map_at_20_max\": 0.04688698286524278,\n        \"nauc_map_at_20_std\": -0.34268186516724314,\n        \"nauc_map_at_3_diff1\": 0.4679841190429562,\n        \"nauc_map_at_3_max\": 0.05790504514306734,\n        \"nauc_map_at_3_std\": -0.32209965854683414,\n        \"nauc_map_at_5_diff1\": 0.460133850677349,\n        \"nauc_map_at_5_max\": 0.05327053889146215,\n        \"nauc_map_at_5_std\": -0.33567484138364745,\n        \"nauc_mrr_at_1000_diff1\": 0.4818611900563693,\n        \"nauc_mrr_at_1000_max\": 0.03688776037602183,\n        \"nauc_mrr_at_1000_std\": -0.35643108371521776,\n        \"nauc_mrr_at_100_diff1\": 0.4814378572863629,\n        \"nauc_mrr_at_100_max\": 0.0367993573850964,\n        \"nauc_mrr_at_100_std\": -0.3561719362447453,\n        \"nauc_mrr_at_10_diff1\": 0.48258660834366796,\n        \"nauc_mrr_at_10_max\": 0.036186629121457,\n        \"nauc_mrr_at_10_std\": -0.35958431245602557,\n        \"nauc_mrr_at_1_diff1\": 0.5230353749741389,\n        \"nauc_mrr_at_1_max\": 0.06587751414523899,\n        \"nauc_mrr_at_1_std\": -0.32859487926805514,\n        \"nauc_mrr_at_20_diff1\": 0.4819017718965853,\n        \"nauc_mrr_at_20_max\": 0.036475821434962016,\n        \"nauc_mrr_at_20_std\": -0.35816082778792685,\n        \"nauc_mrr_at_3_diff1\": 0.4905198332221737,\n        \"nauc_mrr_at_3_max\": 0.03661467102314838,\n        \"nauc_mrr_at_3_std\": -0.35640572814472793,\n        \"nauc_mrr_at_5_diff1\": 0.4824162768724931,\n        \"nauc_mrr_at_5_max\": 0.03364822894570434,\n        \"nauc_mrr_at_5_std\": -0.35963166357650084,\n        \"nauc_ndcg_at_1000_diff1\": 0.4450897476457732,\n        \"nauc_ndcg_at_1000_max\": 0.04253233686878224,\n        \"nauc_ndcg_at_1000_std\": -0.34135743053752615,\n        \"nauc_ndcg_at_100_diff1\": 0.4300598727282433,\n        \"nauc_ndcg_at_100_max\": 0.044135555523664306,\n        \"nauc_ndcg_at_100_std\": -0.3286139221465386,\n        \"nauc_ndcg_at_10_diff1\": 0.44711999598286095,\n        \"nauc_ndcg_at_10_max\": 0.04090220393579857,\n        \"nauc_ndcg_at_10_std\": -0.3584111558393882,\n        \"nauc_ndcg_at_1_diff1\": 0.5230353749741389,\n        \"nauc_ndcg_at_1_max\": 0.06587751414523899,\n        \"nauc_ndcg_at_1_std\": -0.32859487926805514,\n        \"nauc_ndcg_at_20_diff1\": 0.4387416070736086,\n        \"nauc_ndcg_at_20_max\": 0.03230834151415491,\n        \"nauc_ndcg_at_20_std\": -0.3587366944538616,\n        \"nauc_ndcg_at_3_diff1\": 0.4641232978935688,\n        \"nauc_ndcg_at_3_max\": 0.04028056576504315,\n        \"nauc_ndcg_at_3_std\": -0.3446656104836864,\n        \"nauc_ndcg_at_5_diff1\": 0.45040047273630857,\n        \"nauc_ndcg_at_5_max\": 0.03979649691333102,\n        \"nauc_ndcg_at_5_std\": -0.3511801978433322,\n        \"nauc_precision_at_1000_diff1\": -0.07041101680846983,\n        \"nauc_precision_at_1000_max\": 0.014657691604807463,\n        \"nauc_precision_at_1000_std\": -0.039924232399408184,\n        \"nauc_precision_at_100_diff1\": -0.0056135207397094685,\n        \"nauc_precision_at_100_max\": 0.027912903091879524,\n        \"nauc_precision_at_100_std\": -0.08066141684496765,\n        \"nauc_precision_at_10_diff1\": 0.20485786635579623,\n        \"nauc_precision_at_10_max\": -0.019954336112085008,\n        \"nauc_precision_at_10_std\": -0.3488177923175864,\n        \"nauc_precision_at_1_diff1\": 0.5230353749741389,\n        \"nauc_precision_at_1_max\": 0.06587751414523899,\n        \"nauc_precision_at_1_std\": -0.32859487926805514,\n        \"nauc_precision_at_20_diff1\": 0.145619780468102,\n        \"nauc_precision_at_20_max\": -0.03706454738456665,\n        \"nauc_precision_at_20_std\": -0.3138145777743116,\n        \"nauc_precision_at_3_diff1\": 0.27939462010075594,\n        \"nauc_precision_at_3_max\": 0.01284089151169814,\n        \"nauc_precision_at_3_std\": -0.34079680000131574,\n        \"nauc_precision_at_5_diff1\": 0.23749631814377248,\n        \"nauc_precision_at_5_max\": -0.009766776981789392,\n        \"nauc_precision_at_5_std\": -0.35023524187203975,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.2152830103417114,\n        \"nauc_recall_at_100_max\": 0.07106920383398822,\n        \"nauc_recall_at_100_std\": -0.12740884920285253,\n        \"nauc_recall_at_10_diff1\": 0.38412046069100564,\n        \"nauc_recall_at_10_max\": 0.03512918479884001,\n        \"nauc_recall_at_10_std\": -0.36799641807074623,\n        \"nauc_recall_at_1_diff1\": 0.5518348816563906,\n        \"nauc_recall_at_1_max\": 0.07377101119089663,\n        \"nauc_recall_at_1_std\": -0.26809843855821786,\n        \"nauc_recall_at_20_diff1\": 0.3465280191808201,\n        \"nauc_recall_at_20_max\": 0.0017577641688437504,\n        \"nauc_recall_at_20_std\": -0.3661202915437602,\n        \"nauc_recall_at_3_diff1\": 0.42395320185818214,\n        \"nauc_recall_at_3_max\": 0.027697685968404766,\n        \"nauc_recall_at_3_std\": -0.3374561320362361,\n        \"nauc_recall_at_5_diff1\": 0.39403075751656697,\n        \"nauc_recall_at_5_max\": 0.02406606359316884,\n        \"nauc_recall_at_5_std\": -0.3555034100963647,\n        \"ndcg_at_1\": 0.29358,\n        \"ndcg_at_10\": 0.37446,\n        \"ndcg_at_100\": 0.44885,\n        \"ndcg_at_1000\": 0.47516,\n        \"ndcg_at_20\": 0.40232,\n        \"ndcg_at_3\": 0.32326,\n        \"ndcg_at_5\": 0.34683,\n        \"precision_at_1\": 0.29358,\n        \"precision_at_10\": 0.07768,\n        \"precision_at_100\": 0.01292,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.04633,\n        \"precision_at_3\": 0.18298,\n        \"precision_at_5\": 0.1315,\n        \"recall_at_1\": 0.20971,\n        \"recall_at_10\": 0.47617,\n        \"recall_at_100\": 0.80466,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.5777,\n        \"recall_at_3\": 0.34182,\n        \"recall_at_5\": 0.40038\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.34661,\n        \"map_at_1\": 0.16825,\n        \"map_at_10\": 0.29036,\n        \"map_at_100\": 0.30859,\n        \"map_at_1000\": 0.31046,\n        \"map_at_20\": 0.3002,\n        \"map_at_3\": 0.24643,\n        \"map_at_5\": 0.27468,\n        \"mrr_at_1\": 0.2874617737003058,\n        \"mrr_at_10\": 0.36174518227270513,\n        \"mrr_at_100\": 0.3740905454658665,\n        \"mrr_at_1000\": 0.37486441693210293,\n        \"mrr_at_20\": 0.36896087973093267,\n        \"mrr_at_3\": 0.33893985728848136,\n        \"mrr_at_5\": 0.35178389398572896,\n        \"nauc_map_at_1000_diff1\": 0.43408674116439533,\n        \"nauc_map_at_1000_max\": -0.0781045934625065,\n        \"nauc_map_at_1000_std\": -0.37262055431721036,\n        \"nauc_map_at_100_diff1\": 0.43372688722543273,\n        \"nauc_map_at_100_max\": -0.07898705574706322,\n        \"nauc_map_at_100_std\": -0.3734511070798701,\n        \"nauc_map_at_10_diff1\": 0.43007088282208156,\n        \"nauc_map_at_10_max\": -0.08084375661708175,\n        \"nauc_map_at_10_std\": -0.3755659759251913,\n        \"nauc_map_at_1_diff1\": 0.4718554401290633,\n        \"nauc_map_at_1_max\": -0.08010336469225167,\n        \"nauc_map_at_1_std\": -0.3086076796871873,\n        \"nauc_map_at_20_diff1\": 0.43273126305857496,\n        \"nauc_map_at_20_max\": -0.08154413984121149,\n        \"nauc_map_at_20_std\": -0.37713432219940535,\n        \"nauc_map_at_3_diff1\": 0.4399922767182238,\n        \"nauc_map_at_3_max\": -0.07177036482821501,\n        \"nauc_map_at_3_std\": -0.35609704330938696,\n        \"nauc_map_at_5_diff1\": 0.43315207872628014,\n        \"nauc_map_at_5_max\": -0.07962376430405066,\n        \"nauc_map_at_5_std\": -0.36861286758266093,\n        \"nauc_mrr_at_1000_diff1\": 0.45778654097969523,\n        \"nauc_mrr_at_1000_max\": -0.09093283852005311,\n        \"nauc_mrr_at_1000_std\": -0.3980434677180335,\n        \"nauc_mrr_at_100_diff1\": 0.45751526696935674,\n        \"nauc_mrr_at_100_max\": -0.0909091440945732,\n        \"nauc_mrr_at_100_std\": -0.39788117539104273,\n        \"nauc_mrr_at_10_diff1\": 0.4566004428578541,\n        \"nauc_mrr_at_10_max\": -0.09457397072149339,\n        \"nauc_mrr_at_10_std\": -0.4026325473909036,\n        \"nauc_mrr_at_1_diff1\": 0.5200549198032715,\n        \"nauc_mrr_at_1_max\": -0.07890395420526032,\n        \"nauc_mrr_at_1_std\": -0.393363625612812,\n        \"nauc_mrr_at_20_diff1\": 0.45713824341360926,\n        \"nauc_mrr_at_20_max\": -0.09116271873911638,\n        \"nauc_mrr_at_20_std\": -0.3992770051600864,\n        \"nauc_mrr_at_3_diff1\": 0.4611576322989618,\n        \"nauc_mrr_at_3_max\": -0.09627581748308975,\n        \"nauc_mrr_at_3_std\": -0.4030908830145351,\n        \"nauc_mrr_at_5_diff1\": 0.45570439185164613,\n        \"nauc_mrr_at_5_max\": -0.09489554045913565,\n        \"nauc_mrr_at_5_std\": -0.4010519332946782,\n        \"nauc_ndcg_at_1000_diff1\": 0.4282778137273464,\n        \"nauc_ndcg_at_1000_max\": -0.07094144336277669,\n        \"nauc_ndcg_at_1000_std\": -0.36650615049900964,\n        \"nauc_ndcg_at_100_diff1\": 0.41884799526273186,\n        \"nauc_ndcg_at_100_max\": -0.06995363016792937,\n        \"nauc_ndcg_at_100_std\": -0.359887810898336,\n        \"nauc_ndcg_at_10_diff1\": 0.41241717995825367,\n        \"nauc_ndcg_at_10_max\": -0.0917564028796353,\n        \"nauc_ndcg_at_10_std\": -0.39161872772526274,\n        \"nauc_ndcg_at_1_diff1\": 0.5200549198032715,\n        \"nauc_ndcg_at_1_max\": -0.07890395420526032,\n        \"nauc_ndcg_at_1_std\": -0.393363625612812,\n        \"nauc_ndcg_at_20_diff1\": 0.4187269134432203,\n        \"nauc_ndcg_at_20_max\": -0.08777624732484189,\n        \"nauc_ndcg_at_20_std\": -0.39029048439084557,\n        \"nauc_ndcg_at_3_diff1\": 0.4305826194695503,\n        \"nauc_ndcg_at_3_max\": -0.07609209333894651,\n        \"nauc_ndcg_at_3_std\": -0.37738703403188706,\n        \"nauc_ndcg_at_5_diff1\": 0.4153195435356488,\n        \"nauc_ndcg_at_5_max\": -0.08866109540688547,\n        \"nauc_ndcg_at_5_std\": -0.38023370215240054,\n        \"nauc_precision_at_1000_diff1\": 0.09602906643187797,\n        \"nauc_precision_at_1000_max\": 0.061603874890195504,\n        \"nauc_precision_at_1000_std\": -0.032617277454407304,\n        \"nauc_precision_at_100_diff1\": 0.1657852134906329,\n        \"nauc_precision_at_100_max\": 0.04464208789278082,\n        \"nauc_precision_at_100_std\": -0.10333452416246913,\n        \"nauc_precision_at_10_diff1\": 0.2751306967754088,\n        \"nauc_precision_at_10_max\": -0.06871625850600073,\n        \"nauc_precision_at_10_std\": -0.3455839419676085,\n        \"nauc_precision_at_1_diff1\": 0.5200549198032715,\n        \"nauc_precision_at_1_max\": -0.07890395420526032,\n        \"nauc_precision_at_1_std\": -0.393363625612812,\n        \"nauc_precision_at_20_diff1\": 0.26429363273796425,\n        \"nauc_precision_at_20_max\": -0.056867504122808527,\n        \"nauc_precision_at_20_std\": -0.31859774863833207,\n        \"nauc_precision_at_3_diff1\": 0.3585490915750111,\n        \"nauc_precision_at_3_max\": -0.0588168533717345,\n        \"nauc_precision_at_3_std\": -0.3778525156033515,\n        \"nauc_precision_at_5_diff1\": 0.3173381453275914,\n        \"nauc_precision_at_5_max\": -0.07158141598094207,\n        \"nauc_precision_at_5_std\": -0.36335703054042195,\n        \"nauc_recall_at_1000_diff1\": -0.10407317508841295,\n        \"nauc_recall_at_1000_max\": 0.5028113070253024,\n        \"nauc_recall_at_1000_std\": 0.44697916727698483,\n        \"nauc_recall_at_100_diff1\": 0.26253714857740146,\n        \"nauc_recall_at_100_max\": 0.007743556269314414,\n        \"nauc_recall_at_100_std\": -0.1732423165494968,\n        \"nauc_recall_at_10_diff1\": 0.31657628588215375,\n        \"nauc_recall_at_10_max\": -0.10287505538155159,\n        \"nauc_recall_at_10_std\": -0.38093458994929014,\n        \"nauc_recall_at_1_diff1\": 0.4718554401290633,\n        \"nauc_recall_at_1_max\": -0.08010336469225167,\n        \"nauc_recall_at_1_std\": -0.3086076796871873,\n        \"nauc_recall_at_20_diff1\": 0.3251959720635749,\n        \"nauc_recall_at_20_max\": -0.08663571831697997,\n        \"nauc_recall_at_20_std\": -0.3685351766024191,\n        \"nauc_recall_at_3_diff1\": 0.350720002293693,\n        \"nauc_recall_at_3_max\": -0.0770006441235346,\n        \"nauc_recall_at_3_std\": -0.3379478997653626,\n        \"nauc_recall_at_5_diff1\": 0.32461586682936044,\n        \"nauc_recall_at_5_max\": -0.09297069153847383,\n        \"nauc_recall_at_5_std\": -0.35374272867378154,\n        \"ndcg_at_1\": 0.28746,\n        \"ndcg_at_10\": 0.34661,\n        \"ndcg_at_100\": 0.42667,\n        \"ndcg_at_1000\": 0.46022,\n        \"ndcg_at_20\": 0.37589,\n        \"ndcg_at_3\": 0.29564,\n        \"ndcg_at_5\": 0.31791,\n        \"precision_at_1\": 0.28746,\n        \"precision_at_10\": 0.08899,\n        \"precision_at_100\": 0.01535,\n        \"precision_at_1000\": 0.00194,\n        \"precision_at_20\": 0.0539,\n        \"precision_at_3\": 0.18858,\n        \"precision_at_5\": 0.14495,\n        \"recall_at_1\": 0.16825,\n        \"recall_at_10\": 0.43537,\n        \"recall_at_100\": 0.76952,\n        \"recall_at_1000\": 0.99529,\n        \"recall_at_20\": 0.53272,\n        \"recall_at_3\": 0.29225,\n        \"recall_at_5\": 0.36555\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.36844,\n        \"map_at_1\": 0.20053,\n        \"map_at_10\": 0.32119,\n        \"map_at_100\": 0.33609,\n        \"map_at_1000\": 0.33724,\n        \"map_at_20\": 0.32875,\n        \"map_at_3\": 0.28589,\n        \"map_at_5\": 0.30422,\n        \"mrr_at_1\": 0.2915309446254072,\n        \"mrr_at_10\": 0.3576728193992037,\n        \"mrr_at_100\": 0.3685340664387878,\n        \"mrr_at_1000\": 0.36922795246376183,\n        \"mrr_at_20\": 0.36325312691972717,\n        \"mrr_at_3\": 0.3357763300760045,\n        \"mrr_at_5\": 0.346199782844734,\n        \"nauc_map_at_1000_diff1\": 0.41813669791893776,\n        \"nauc_map_at_1000_max\": 0.007552584722714954,\n        \"nauc_map_at_1000_std\": -0.3026040760903253,\n        \"nauc_map_at_100_diff1\": 0.4177465362193772,\n        \"nauc_map_at_100_max\": 0.007214830327060678,\n        \"nauc_map_at_100_std\": -0.30268745302145583,\n        \"nauc_map_at_10_diff1\": 0.42085448669537834,\n        \"nauc_map_at_10_max\": 0.006364125031470106,\n        \"nauc_map_at_10_std\": -0.3071472255158821,\n        \"nauc_map_at_1_diff1\": 0.5184323474689903,\n        \"nauc_map_at_1_max\": 0.014963896113339063,\n        \"nauc_map_at_1_std\": -0.2440981121144059,\n        \"nauc_map_at_20_diff1\": 0.4194286322842389,\n        \"nauc_map_at_20_max\": 0.004354642450157929,\n        \"nauc_map_at_20_std\": -0.307072227884935,\n        \"nauc_map_at_3_diff1\": 0.44586295812962795,\n        \"nauc_map_at_3_max\": 0.007930967745808305,\n        \"nauc_map_at_3_std\": -0.29710924898322916,\n        \"nauc_map_at_5_diff1\": 0.4311737957820591,\n        \"nauc_map_at_5_max\": 0.007918955890765625,\n        \"nauc_map_at_5_std\": -0.30633520852076374,\n        \"nauc_mrr_at_1000_diff1\": 0.4354023503587192,\n        \"nauc_mrr_at_1000_max\": -0.003970421913251222,\n        \"nauc_mrr_at_1000_std\": -0.3113503346789748,\n        \"nauc_mrr_at_100_diff1\": 0.43518787677162674,\n        \"nauc_mrr_at_100_max\": -0.004117761167703212,\n        \"nauc_mrr_at_100_std\": -0.3112766826824572,\n        \"nauc_mrr_at_10_diff1\": 0.43652695829120913,\n        \"nauc_mrr_at_10_max\": -0.0036706389480374666,\n        \"nauc_mrr_at_10_std\": -0.3130101204856395,\n        \"nauc_mrr_at_1_diff1\": 0.45804622982087095,\n        \"nauc_mrr_at_1_max\": 0.0022866283980352733,\n        \"nauc_mrr_at_1_std\": -0.2981204258269174,\n        \"nauc_mrr_at_20_diff1\": 0.4358619448426231,\n        \"nauc_mrr_at_20_max\": -0.004360869558686554,\n        \"nauc_mrr_at_20_std\": -0.31266435497381806,\n        \"nauc_mrr_at_3_diff1\": 0.44785727048628854,\n        \"nauc_mrr_at_3_max\": -0.014145524448956039,\n        \"nauc_mrr_at_3_std\": -0.3222094215558068,\n        \"nauc_mrr_at_5_diff1\": 0.43954828980579475,\n        \"nauc_mrr_at_5_max\": -0.006563909112455232,\n        \"nauc_mrr_at_5_std\": -0.3182430061373452,\n        \"nauc_ndcg_at_1000_diff1\": 0.40844284469814046,\n        \"nauc_ndcg_at_1000_max\": 0.015080435112036725,\n        \"nauc_ndcg_at_1000_std\": -0.291890093061604,\n        \"nauc_ndcg_at_100_diff1\": 0.39704412813599954,\n        \"nauc_ndcg_at_100_max\": 0.016089111193302506,\n        \"nauc_ndcg_at_100_std\": -0.28219762613772403,\n        \"nauc_ndcg_at_10_diff1\": 0.4088979768044545,\n        \"nauc_ndcg_at_10_max\": 0.004666657059697,\n        \"nauc_ndcg_at_10_std\": -0.31202664936338564,\n        \"nauc_ndcg_at_1_diff1\": 0.45804622982087095,\n        \"nauc_ndcg_at_1_max\": 0.0022866283980352733,\n        \"nauc_ndcg_at_1_std\": -0.2981204258269174,\n        \"nauc_ndcg_at_20_diff1\": 0.4032049470009599,\n        \"nauc_ndcg_at_20_max\": -0.0006181694712085585,\n        \"nauc_ndcg_at_20_std\": -0.3103864548925818,\n        \"nauc_ndcg_at_3_diff1\": 0.4385036165208426,\n        \"nauc_ndcg_at_3_max\": -0.004331691755456782,\n        \"nauc_ndcg_at_3_std\": -0.31799870435750993,\n        \"nauc_ndcg_at_5_diff1\": 0.422456674845733,\n        \"nauc_ndcg_at_5_max\": 0.004322515747886231,\n        \"nauc_ndcg_at_5_std\": -0.31603953506255617,\n        \"nauc_precision_at_1000_diff1\": -0.08207023394380356,\n        \"nauc_precision_at_1000_max\": 0.12415361386838557,\n        \"nauc_precision_at_1000_std\": 0.04949077736997206,\n        \"nauc_precision_at_100_diff1\": -0.024188274262316435,\n        \"nauc_precision_at_100_max\": 0.09925301307678765,\n        \"nauc_precision_at_100_std\": -0.013622993433942163,\n        \"nauc_precision_at_10_diff1\": 0.14368637929984812,\n        \"nauc_precision_at_10_max\": -0.01062236695603982,\n        \"nauc_precision_at_10_std\": -0.2751113441776455,\n        \"nauc_precision_at_1_diff1\": 0.45804622982087095,\n        \"nauc_precision_at_1_max\": 0.0022866283980352733,\n        \"nauc_precision_at_1_std\": -0.2981204258269174,\n        \"nauc_precision_at_20_diff1\": 0.1082263641660178,\n        \"nauc_precision_at_20_max\": -0.015697333715391372,\n        \"nauc_precision_at_20_std\": -0.2429625882645431,\n        \"nauc_precision_at_3_diff1\": 0.2532752428987566,\n        \"nauc_precision_at_3_max\": -0.01810692192437379,\n        \"nauc_precision_at_3_std\": -0.3180735176178936,\n        \"nauc_precision_at_5_diff1\": 0.19985716355588498,\n        \"nauc_precision_at_5_max\": -0.011542622259030643,\n        \"nauc_precision_at_5_std\": -0.3098687288272108,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.24172121926780435,\n        \"nauc_recall_at_100_max\": 0.0724716126973392,\n        \"nauc_recall_at_100_std\": -0.10402632689466423,\n        \"nauc_recall_at_10_diff1\": 0.3500669517021082,\n        \"nauc_recall_at_10_max\": 0.012805663309776125,\n        \"nauc_recall_at_10_std\": -0.29977093252907944,\n        \"nauc_recall_at_1_diff1\": 0.5184323474689903,\n        \"nauc_recall_at_1_max\": 0.014963896113339063,\n        \"nauc_recall_at_1_std\": -0.2440981121144059,\n        \"nauc_recall_at_20_diff1\": 0.3195452308319116,\n        \"nauc_recall_at_20_max\": -0.007130058012837736,\n        \"nauc_recall_at_20_std\": -0.290770239297093,\n        \"nauc_recall_at_3_diff1\": 0.4266731339339648,\n        \"nauc_recall_at_3_max\": -0.005380600005323247,\n        \"nauc_recall_at_3_std\": -0.31113757836239436,\n        \"nauc_recall_at_5_diff1\": 0.3850481536457508,\n        \"nauc_recall_at_5_max\": 0.008066667725823217,\n        \"nauc_recall_at_5_std\": -0.31577804754380534,\n        \"ndcg_at_1\": 0.29153,\n        \"ndcg_at_10\": 0.36844,\n        \"ndcg_at_100\": 0.44152,\n        \"ndcg_at_1000\": 0.4695,\n        \"ndcg_at_20\": 0.39218,\n        \"ndcg_at_3\": 0.31583,\n        \"ndcg_at_5\": 0.33543,\n        \"precision_at_1\": 0.29153,\n        \"precision_at_10\": 0.08062,\n        \"precision_at_100\": 0.01357,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.04739,\n        \"precision_at_3\": 0.18187,\n        \"precision_at_5\": 0.13029,\n        \"recall_at_1\": 0.20053,\n        \"recall_at_10\": 0.46927,\n        \"recall_at_100\": 0.79471,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.55277,\n        \"recall_at_3\": 0.32904,\n        \"recall_at_5\": 0.37916\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/BAAI/bge-multilingual-gemma2/no_model_name_available/no_revision_available/model_meta.json",
    "content": "{\"name\": \"no_model_name_available\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": null, \"n_parameters\": null, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": null, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"zero_shot_benchmarks\": null, \"loader\": null}"
  },
  {
    "path": "eval/results/Salesforce/SFR-Embedding-2_R/Salesforce__SFR-Embedding-2_R/91762139d94ed4371a9fa31db5551272e0b83818/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 1549.6882767677307,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.70782,\n        \"map_at_1\": 0.54386,\n        \"map_at_10\": 0.65351,\n        \"map_at_100\": 0.65816,\n        \"map_at_1000\": 0.65822,\n        \"map_at_20\": 0.65658,\n        \"map_at_3\": 0.62427,\n        \"map_at_5\": 0.64313,\n        \"mrr_at_1\": 0.543859649122807,\n        \"mrr_at_10\": 0.6535087719298245,\n        \"mrr_at_100\": 0.6581566406059242,\n        \"mrr_at_1000\": 0.6582175567852613,\n        \"mrr_at_20\": 0.6565841687552212,\n        \"mrr_at_3\": 0.6242690058479534,\n        \"mrr_at_5\": 0.6431286549707603,\n        \"nauc_map_at_1000_diff1\": 0.4589811760453532,\n        \"nauc_map_at_1000_max\": 0.10234092569414859,\n        \"nauc_map_at_1000_std\": -0.356311102381068,\n        \"nauc_map_at_100_diff1\": 0.45883771525940487,\n        \"nauc_map_at_100_max\": 0.10218882872908919,\n        \"nauc_map_at_100_std\": -0.3563584758354272,\n        \"nauc_map_at_10_diff1\": 0.45785560488749766,\n        \"nauc_map_at_10_max\": 0.1083158493065166,\n        \"nauc_map_at_10_std\": -0.3542947811883265,\n        \"nauc_map_at_1_diff1\": 0.45100389919557227,\n        \"nauc_map_at_1_max\": 0.07773262230195767,\n        \"nauc_map_at_1_std\": -0.29191787775456185,\n        \"nauc_map_at_20_diff1\": 0.45889280176699143,\n        \"nauc_map_at_20_max\": 0.1041613429769374,\n        \"nauc_map_at_20_std\": -0.3562801591947266,\n        \"nauc_map_at_3_diff1\": 0.4581271634272649,\n        \"nauc_map_at_3_max\": 0.07010811847042181,\n        \"nauc_map_at_3_std\": -0.36784309569200174,\n        \"nauc_map_at_5_diff1\": 0.46628806215271035,\n        \"nauc_map_at_5_max\": 0.0998584281053696,\n        \"nauc_map_at_5_std\": -0.37400894462811973,\n        \"nauc_mrr_at_1000_diff1\": 0.4589811760453532,\n        \"nauc_mrr_at_1000_max\": 0.10234092569414859,\n        \"nauc_mrr_at_1000_std\": -0.356311102381068,\n        \"nauc_mrr_at_100_diff1\": 0.45883771525940487,\n        \"nauc_mrr_at_100_max\": 0.10218882872908919,\n        \"nauc_mrr_at_100_std\": -0.3563584758354272,\n        \"nauc_mrr_at_10_diff1\": 0.45785560488749766,\n        \"nauc_mrr_at_10_max\": 0.1083158493065166,\n        \"nauc_mrr_at_10_std\": -0.3542947811883265,\n        \"nauc_mrr_at_1_diff1\": 0.45100389919557227,\n        \"nauc_mrr_at_1_max\": 0.07773262230195767,\n        \"nauc_mrr_at_1_std\": -0.29191787775456185,\n        \"nauc_mrr_at_20_diff1\": 0.45889280176699143,\n        \"nauc_mrr_at_20_max\": 0.1041613429769374,\n        \"nauc_mrr_at_20_std\": -0.3562801591947266,\n        \"nauc_mrr_at_3_diff1\": 0.4581271634272649,\n        \"nauc_mrr_at_3_max\": 0.07010811847042181,\n        \"nauc_mrr_at_3_std\": -0.36784309569200174,\n        \"nauc_mrr_at_5_diff1\": 0.46628806215271035,\n        \"nauc_mrr_at_5_max\": 0.0998584281053696,\n        \"nauc_mrr_at_5_std\": -0.37400894462811973,\n        \"nauc_ndcg_at_1000_diff1\": 0.4579233057407457,\n        \"nauc_ndcg_at_1000_max\": 0.11353070121982693,\n        \"nauc_ndcg_at_1000_std\": -0.36344840933846423,\n        \"nauc_ndcg_at_100_diff1\": 0.45430840688203755,\n        \"nauc_ndcg_at_100_max\": 0.10962723815228848,\n        \"nauc_ndcg_at_100_std\": -0.3646029972953465,\n        \"nauc_ndcg_at_10_diff1\": 0.4503205658127994,\n        \"nauc_ndcg_at_10_max\": 0.1462947779227858,\n        \"nauc_ndcg_at_10_std\": -0.3628340802117219,\n        \"nauc_ndcg_at_1_diff1\": 0.45100389919557227,\n        \"nauc_ndcg_at_1_max\": 0.07773262230195767,\n        \"nauc_ndcg_at_1_std\": -0.29191787775456185,\n        \"nauc_ndcg_at_20_diff1\": 0.4570695553298544,\n        \"nauc_ndcg_at_20_max\": 0.13210328427557108,\n        \"nauc_ndcg_at_20_std\": -0.3660073237106156,\n        \"nauc_ndcg_at_3_diff1\": 0.45833625612690976,\n        \"nauc_ndcg_at_3_max\": 0.0708825922620583,\n        \"nauc_ndcg_at_3_std\": -0.3897144449317193,\n        \"nauc_ndcg_at_5_diff1\": 0.47257932918610845,\n        \"nauc_ndcg_at_5_max\": 0.1250269996217293,\n        \"nauc_ndcg_at_5_std\": -0.40588530243383514,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": -0.16932645024141074,\n        \"nauc_precision_at_100_max\": -0.5637901180614636,\n        \"nauc_precision_at_100_std\": -0.5637901180614636,\n        \"nauc_precision_at_10_diff1\": 0.3830070681610025,\n        \"nauc_precision_at_10_max\": 0.418519573108106,\n        \"nauc_precision_at_10_std\": -0.4009186122719858,\n        \"nauc_precision_at_1_diff1\": 0.45100389919557227,\n        \"nauc_precision_at_1_max\": 0.07773262230195767,\n        \"nauc_precision_at_1_std\": -0.29191787775456185,\n        \"nauc_precision_at_20_diff1\": 0.4392864027297254,\n        \"nauc_precision_at_20_max\": 0.41063793833902507,\n        \"nauc_precision_at_20_std\": -0.4208684992861658,\n        \"nauc_precision_at_3_diff1\": 0.45816122675541565,\n        \"nauc_precision_at_3_max\": 0.07498683816017587,\n        \"nauc_precision_at_3_std\": -0.4649198530675704,\n        \"nauc_precision_at_5_diff1\": 0.5008433631808221,\n        \"nauc_precision_at_5_max\": 0.24698005260037342,\n        \"nauc_precision_at_5_std\": -0.5508019949459134,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": -0.16932645024147489,\n        \"nauc_recall_at_100_max\": -0.5637901180615443,\n        \"nauc_recall_at_100_std\": -0.5637901180615443,\n        \"nauc_recall_at_10_diff1\": 0.38300706816100444,\n        \"nauc_recall_at_10_max\": 0.4185195731081076,\n        \"nauc_recall_at_10_std\": -0.40091861227198716,\n        \"nauc_recall_at_1_diff1\": 0.45100389919557227,\n        \"nauc_recall_at_1_max\": 0.07773262230195767,\n        \"nauc_recall_at_1_std\": -0.29191787775456185,\n        \"nauc_recall_at_20_diff1\": 0.43928640272972663,\n        \"nauc_recall_at_20_max\": 0.4106379383390254,\n        \"nauc_recall_at_20_std\": -0.420868499286167,\n        \"nauc_recall_at_3_diff1\": 0.45816122675541615,\n        \"nauc_recall_at_3_max\": 0.07498683816017519,\n        \"nauc_recall_at_3_std\": -0.4649198530675706,\n        \"nauc_recall_at_5_diff1\": 0.5008433631808211,\n        \"nauc_recall_at_5_max\": 0.24698005260037348,\n        \"nauc_recall_at_5_std\": -0.5508019949459128,\n        \"ndcg_at_1\": 0.54386,\n        \"ndcg_at_10\": 0.70782,\n        \"ndcg_at_100\": 0.73155,\n        \"ndcg_at_1000\": 0.73278,\n        \"ndcg_at_20\": 0.71895,\n        \"ndcg_at_3\": 0.6509,\n        \"ndcg_at_5\": 0.68413,\n        \"precision_at_1\": 0.54386,\n        \"precision_at_10\": 0.08772,\n        \"precision_at_100\": 0.00991,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04605,\n        \"precision_at_3\": 0.24269,\n        \"precision_at_5\": 0.1614,\n        \"recall_at_1\": 0.54386,\n        \"recall_at_10\": 0.87719,\n        \"recall_at_100\": 0.99123,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.92105,\n        \"recall_at_3\": 0.72807,\n        \"recall_at_5\": 0.80702\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/Salesforce/SFR-Embedding-2_R/Salesforce__SFR-Embedding-2_R/91762139d94ed4371a9fa31db5551272e0b83818/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 1465.829463481903,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.91747,\n        \"map_at_1\": 0.86,\n        \"map_at_10\": 0.90096,\n        \"map_at_100\": 0.90212,\n        \"map_at_1000\": 0.90215,\n        \"map_at_20\": 0.90174,\n        \"map_at_3\": 0.89463,\n        \"map_at_5\": 0.89835,\n        \"mrr_at_1\": 0.86,\n        \"mrr_at_10\": 0.900962081128748,\n        \"mrr_at_100\": 0.9021249834348359,\n        \"mrr_at_1000\": 0.9021471859406125,\n        \"mrr_at_20\": 0.9017424595194203,\n        \"mrr_at_3\": 0.8946296296296297,\n        \"mrr_at_5\": 0.8983518518518521,\n        \"nauc_map_at_1000_diff1\": 0.9038265405786627,\n        \"nauc_map_at_1000_max\": 0.7775056855610126,\n        \"nauc_map_at_1000_std\": -0.03270651100548468,\n        \"nauc_map_at_100_diff1\": 0.9038184890206553,\n        \"nauc_map_at_100_max\": 0.7775375908773677,\n        \"nauc_map_at_100_std\": -0.03250325754067984,\n        \"nauc_map_at_10_diff1\": 0.9039191701071102,\n        \"nauc_map_at_10_max\": 0.7790969647189588,\n        \"nauc_map_at_10_std\": -0.028729734505420247,\n        \"nauc_map_at_1_diff1\": 0.9094614567456455,\n        \"nauc_map_at_1_max\": 0.75417609656213,\n        \"nauc_map_at_1_std\": -0.12773851862115637,\n        \"nauc_map_at_20_diff1\": 0.9038802928670955,\n        \"nauc_map_at_20_max\": 0.7782253662276372,\n        \"nauc_map_at_20_std\": -0.03015435395933517,\n        \"nauc_map_at_3_diff1\": 0.9007654653790561,\n        \"nauc_map_at_3_max\": 0.7781202095312141,\n        \"nauc_map_at_3_std\": -0.02215962536115016,\n        \"nauc_map_at_5_diff1\": 0.9019619140503947,\n        \"nauc_map_at_5_max\": 0.7794158343254726,\n        \"nauc_map_at_5_std\": -0.02349717216127941,\n        \"nauc_mrr_at_1000_diff1\": 0.9038265405786627,\n        \"nauc_mrr_at_1000_max\": 0.7775056855610126,\n        \"nauc_mrr_at_1000_std\": -0.03270651100548468,\n        \"nauc_mrr_at_100_diff1\": 0.9038184890206553,\n        \"nauc_mrr_at_100_max\": 0.7775375908773677,\n        \"nauc_mrr_at_100_std\": -0.03250325754067984,\n        \"nauc_mrr_at_10_diff1\": 0.9039191701071102,\n        \"nauc_mrr_at_10_max\": 0.7790969647189588,\n        \"nauc_mrr_at_10_std\": -0.028729734505420247,\n        \"nauc_mrr_at_1_diff1\": 0.9094614567456455,\n        \"nauc_mrr_at_1_max\": 0.75417609656213,\n        \"nauc_mrr_at_1_std\": -0.12773851862115637,\n        \"nauc_mrr_at_20_diff1\": 0.9038802928670955,\n        \"nauc_mrr_at_20_max\": 0.7782253662276372,\n        \"nauc_mrr_at_20_std\": -0.03015435395933517,\n        \"nauc_mrr_at_3_diff1\": 0.9007654653790561,\n        \"nauc_mrr_at_3_max\": 0.7781202095312141,\n        \"nauc_mrr_at_3_std\": -0.02215962536115016,\n        \"nauc_mrr_at_5_diff1\": 0.9019619140503947,\n        \"nauc_mrr_at_5_max\": 0.7794158343254726,\n        \"nauc_mrr_at_5_std\": -0.02349717216127941,\n        \"nauc_ndcg_at_1000_diff1\": 0.9037169251607843,\n        \"nauc_ndcg_at_1000_max\": 0.7825042250574558,\n        \"nauc_ndcg_at_1000_std\": -0.013103733510511814,\n        \"nauc_ndcg_at_100_diff1\": 0.90350685579764,\n        \"nauc_ndcg_at_100_max\": 0.7833044667596207,\n        \"nauc_ndcg_at_100_std\": -0.007790985921977495,\n        \"nauc_ndcg_at_10_diff1\": 0.9047554274230343,\n        \"nauc_ndcg_at_10_max\": 0.7929516389052672,\n        \"nauc_ndcg_at_10_std\": 0.017937956553844697,\n        \"nauc_ndcg_at_1_diff1\": 0.9094614567456455,\n        \"nauc_ndcg_at_1_max\": 0.75417609656213,\n        \"nauc_ndcg_at_1_std\": -0.12773851862115637,\n        \"nauc_ndcg_at_20_diff1\": 0.9044326135405133,\n        \"nauc_ndcg_at_20_max\": 0.7893189448516453,\n        \"nauc_ndcg_at_20_std\": 0.013078954190118957,\n        \"nauc_ndcg_at_3_diff1\": 0.8974391156578337,\n        \"nauc_ndcg_at_3_max\": 0.7892974922303669,\n        \"nauc_ndcg_at_3_std\": 0.027141537353611352,\n        \"nauc_ndcg_at_5_diff1\": 0.8995251483219957,\n        \"nauc_ndcg_at_5_max\": 0.7929255775725709,\n        \"nauc_ndcg_at_5_std\": 0.028589749196155496,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8692810457516348,\n        \"nauc_precision_at_100_max\": 0.9128540305010695,\n        \"nauc_precision_at_100_std\": 0.8638344226579172,\n        \"nauc_precision_at_10_diff1\": 0.918300653594768,\n        \"nauc_precision_at_10_max\": 0.914195563282784,\n        \"nauc_precision_at_10_std\": 0.41237644483080255,\n        \"nauc_precision_at_1_diff1\": 0.9094614567456455,\n        \"nauc_precision_at_1_max\": 0.75417609656213,\n        \"nauc_precision_at_1_std\": -0.12773851862115637,\n        \"nauc_precision_at_20_diff1\": 0.920116194625998,\n        \"nauc_precision_at_20_max\": 0.930750077808904,\n        \"nauc_precision_at_20_std\": 0.5774198568316234,\n        \"nauc_precision_at_3_diff1\": 0.882701103040088,\n        \"nauc_precision_at_3_max\": 0.839900932124267,\n        \"nauc_precision_at_3_std\": 0.25035211824843107,\n        \"nauc_precision_at_5_diff1\": 0.8863990040460619,\n        \"nauc_precision_at_5_max\": 0.8712625791057137,\n        \"nauc_precision_at_5_std\": 0.3274198568316172,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8692810457516407,\n        \"nauc_recall_at_100_max\": 0.9128540305010676,\n        \"nauc_recall_at_100_std\": 0.8638344226579231,\n        \"nauc_recall_at_10_diff1\": 0.9183006535947711,\n        \"nauc_recall_at_10_max\": 0.9141955632827841,\n        \"nauc_recall_at_10_std\": 0.4123764448308052,\n        \"nauc_recall_at_1_diff1\": 0.9094614567456455,\n        \"nauc_recall_at_1_max\": 0.75417609656213,\n        \"nauc_recall_at_1_std\": -0.12773851862115637,\n        \"nauc_recall_at_20_diff1\": 0.9201161946259977,\n        \"nauc_recall_at_20_max\": 0.9307500778089021,\n        \"nauc_recall_at_20_std\": 0.5774198568316253,\n        \"nauc_recall_at_3_diff1\": 0.8827011030400855,\n        \"nauc_recall_at_3_max\": 0.8399009321242628,\n        \"nauc_recall_at_3_std\": 0.25035211824842885,\n        \"nauc_recall_at_5_diff1\": 0.8863990040460626,\n        \"nauc_recall_at_5_max\": 0.8712625791057151,\n        \"nauc_recall_at_5_std\": 0.32741985683162,\n        \"ndcg_at_1\": 0.86,\n        \"ndcg_at_10\": 0.91747,\n        \"ndcg_at_100\": 0.92349,\n        \"ndcg_at_1000\": 0.92395,\n        \"ndcg_at_20\": 0.92048,\n        \"ndcg_at_3\": 0.90493,\n        \"ndcg_at_5\": 0.91149,\n        \"precision_at_1\": 0.86,\n        \"precision_at_10\": 0.09678,\n        \"precision_at_100\": 0.00997,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.049,\n        \"precision_at_3\": 0.31148,\n        \"precision_at_5\": 0.19,\n        \"recall_at_1\": 0.86,\n        \"recall_at_10\": 0.96778,\n        \"recall_at_100\": 0.99667,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98,\n        \"recall_at_3\": 0.93444,\n        \"recall_at_5\": 0.95\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.89583,\n        \"map_at_1\": 0.82444,\n        \"map_at_10\": 0.8743,\n        \"map_at_100\": 0.87606,\n        \"map_at_1000\": 0.87609,\n        \"map_at_20\": 0.87558,\n        \"map_at_3\": 0.86704,\n        \"map_at_5\": 0.87109,\n        \"mrr_at_1\": 0.8244444444444444,\n        \"mrr_at_10\": 0.8743029100529099,\n        \"mrr_at_100\": 0.8760601012965096,\n        \"mrr_at_1000\": 0.8760935672797767,\n        \"mrr_at_20\": 0.8755839329277152,\n        \"mrr_at_3\": 0.867037037037037,\n        \"mrr_at_5\": 0.8710925925925928,\n        \"nauc_map_at_1000_diff1\": 0.8709388580881812,\n        \"nauc_map_at_1000_max\": 0.7257094345122158,\n        \"nauc_map_at_1000_std\": -0.15810898862814932,\n        \"nauc_map_at_100_diff1\": 0.8709262914659613,\n        \"nauc_map_at_100_max\": 0.7256623523411022,\n        \"nauc_map_at_100_std\": -0.15801895449476316,\n        \"nauc_map_at_10_diff1\": 0.8704691614053939,\n        \"nauc_map_at_10_max\": 0.7273011370477138,\n        \"nauc_map_at_10_std\": -0.15290381074544582,\n        \"nauc_map_at_1_diff1\": 0.8785551478415506,\n        \"nauc_map_at_1_max\": 0.6949085148217262,\n        \"nauc_map_at_1_std\": -0.21110157923079828,\n        \"nauc_map_at_20_diff1\": 0.8709799295251514,\n        \"nauc_map_at_20_max\": 0.7264313439462893,\n        \"nauc_map_at_20_std\": -0.15571474736075042,\n        \"nauc_map_at_3_diff1\": 0.8700221104222086,\n        \"nauc_map_at_3_max\": 0.7320877164020355,\n        \"nauc_map_at_3_std\": -0.16073965722079653,\n        \"nauc_map_at_5_diff1\": 0.869566359696301,\n        \"nauc_map_at_5_max\": 0.7302110743273366,\n        \"nauc_map_at_5_std\": -0.15265026941719037,\n        \"nauc_mrr_at_1000_diff1\": 0.8709388580881812,\n        \"nauc_mrr_at_1000_max\": 0.7257094345122158,\n        \"nauc_mrr_at_1000_std\": -0.15810898862814932,\n        \"nauc_mrr_at_100_diff1\": 0.8709262914659613,\n        \"nauc_mrr_at_100_max\": 0.7256623523411022,\n        \"nauc_mrr_at_100_std\": -0.15801895449476316,\n        \"nauc_mrr_at_10_diff1\": 0.8704691614053939,\n        \"nauc_mrr_at_10_max\": 0.7273011370477138,\n        \"nauc_mrr_at_10_std\": -0.15290381074544582,\n        \"nauc_mrr_at_1_diff1\": 0.8785551478415506,\n        \"nauc_mrr_at_1_max\": 0.6949085148217262,\n        \"nauc_mrr_at_1_std\": -0.21110157923079828,\n        \"nauc_mrr_at_20_diff1\": 0.8709799295251514,\n        \"nauc_mrr_at_20_max\": 0.7264313439462893,\n        \"nauc_mrr_at_20_std\": -0.15571474736075042,\n        \"nauc_mrr_at_3_diff1\": 0.8700221104222086,\n        \"nauc_mrr_at_3_max\": 0.7320877164020355,\n        \"nauc_mrr_at_3_std\": -0.16073965722079653,\n        \"nauc_mrr_at_5_diff1\": 0.869566359696301,\n        \"nauc_mrr_at_5_max\": 0.7302110743273366,\n        \"nauc_mrr_at_5_std\": -0.15265026941719037,\n        \"nauc_ndcg_at_1000_diff1\": 0.8701658703321531,\n        \"nauc_ndcg_at_1000_max\": 0.7290703499029934,\n        \"nauc_ndcg_at_1000_std\": -0.14716087659059404,\n        \"nauc_ndcg_at_100_diff1\": 0.8699994343208388,\n        \"nauc_ndcg_at_100_max\": 0.7277723702500393,\n        \"nauc_ndcg_at_100_std\": -0.14525520109240692,\n        \"nauc_ndcg_at_10_diff1\": 0.8685949260017891,\n        \"nauc_ndcg_at_10_max\": 0.7366320436014431,\n        \"nauc_ndcg_at_10_std\": -0.11810262632565337,\n        \"nauc_ndcg_at_1_diff1\": 0.8785551478415506,\n        \"nauc_ndcg_at_1_max\": 0.6949085148217262,\n        \"nauc_ndcg_at_1_std\": -0.21110157923079828,\n        \"nauc_ndcg_at_20_diff1\": 0.8700391722631855,\n        \"nauc_ndcg_at_20_max\": 0.7331283394586031,\n        \"nauc_ndcg_at_20_std\": -0.12834392630963246,\n        \"nauc_ndcg_at_3_diff1\": 0.8671925487503549,\n        \"nauc_ndcg_at_3_max\": 0.7471430113550027,\n        \"nauc_ndcg_at_3_std\": -0.13793944800144223,\n        \"nauc_ndcg_at_5_diff1\": 0.8661644204364798,\n        \"nauc_ndcg_at_5_max\": 0.7442138775204387,\n        \"nauc_ndcg_at_5_std\": -0.1199269593757352,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8552754435107516,\n        \"nauc_precision_at_100_max\": 0.5719887955182057,\n        \"nauc_precision_at_100_std\": 0.07301587301587033,\n        \"nauc_precision_at_10_diff1\": 0.855138133684845,\n        \"nauc_precision_at_10_max\": 0.8101142417751384,\n        \"nauc_precision_at_10_std\": 0.21226725984510994,\n        \"nauc_precision_at_1_diff1\": 0.8785551478415506,\n        \"nauc_precision_at_1_max\": 0.6949085148217262,\n        \"nauc_precision_at_1_std\": -0.21110157923079828,\n        \"nauc_precision_at_20_diff1\": 0.8630563336445668,\n        \"nauc_precision_at_20_max\": 0.8091347650171139,\n        \"nauc_precision_at_20_std\": 0.32031331050939155,\n        \"nauc_precision_at_3_diff1\": 0.8546270359995863,\n        \"nauc_precision_at_3_max\": 0.8156966490299831,\n        \"nauc_precision_at_3_std\": -0.03289371304077219,\n        \"nauc_precision_at_5_diff1\": 0.8471055088702153,\n        \"nauc_precision_at_5_max\": 0.822604041616646,\n        \"nauc_precision_at_5_std\": 0.072362278244633,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8552754435107421,\n        \"nauc_recall_at_100_max\": 0.5719887955182243,\n        \"nauc_recall_at_100_std\": 0.07301587301587503,\n        \"nauc_recall_at_10_diff1\": 0.8551381336848447,\n        \"nauc_recall_at_10_max\": 0.8101142417751407,\n        \"nauc_recall_at_10_std\": 0.21226725984511266,\n        \"nauc_recall_at_1_diff1\": 0.8785551478415506,\n        \"nauc_recall_at_1_max\": 0.6949085148217262,\n        \"nauc_recall_at_1_std\": -0.21110157923079828,\n        \"nauc_recall_at_20_diff1\": 0.8630563336445648,\n        \"nauc_recall_at_20_max\": 0.8091347650171263,\n        \"nauc_recall_at_20_std\": 0.3203133105093926,\n        \"nauc_recall_at_3_diff1\": 0.8546270359995847,\n        \"nauc_recall_at_3_max\": 0.8156966490299821,\n        \"nauc_recall_at_3_std\": -0.032893713040773036,\n        \"nauc_recall_at_5_diff1\": 0.8471055088702144,\n        \"nauc_recall_at_5_max\": 0.8226040416166456,\n        \"nauc_recall_at_5_std\": 0.07236227824463086,\n        \"ndcg_at_1\": 0.82444,\n        \"ndcg_at_10\": 0.89583,\n        \"ndcg_at_100\": 0.90326,\n        \"ndcg_at_1000\": 0.90401,\n        \"ndcg_at_20\": 0.90038,\n        \"ndcg_at_3\": 0.88066,\n        \"ndcg_at_5\": 0.88798,\n        \"precision_at_1\": 0.82444,\n        \"precision_at_10\": 0.09622,\n        \"precision_at_100\": 0.00994,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.049,\n        \"precision_at_3\": 0.30667,\n        \"precision_at_5\": 0.18756,\n        \"recall_at_1\": 0.82444,\n        \"recall_at_10\": 0.96222,\n        \"recall_at_100\": 0.99444,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98,\n        \"recall_at_3\": 0.92,\n        \"recall_at_5\": 0.93778\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.83689,\n        \"map_at_1\": 0.75444,\n        \"map_at_10\": 0.81117,\n        \"map_at_100\": 0.81415,\n        \"map_at_1000\": 0.81427,\n        \"map_at_20\": 0.81333,\n        \"map_at_3\": 0.80148,\n        \"map_at_5\": 0.8072,\n        \"mrr_at_1\": 0.7544444444444445,\n        \"mrr_at_10\": 0.8111746031746031,\n        \"mrr_at_100\": 0.8141532860912081,\n        \"mrr_at_1000\": 0.8142724960071842,\n        \"mrr_at_20\": 0.8133258077014527,\n        \"mrr_at_3\": 0.8014814814814816,\n        \"mrr_at_5\": 0.8072037037037036,\n        \"nauc_map_at_1000_diff1\": 0.8083049100518027,\n        \"nauc_map_at_1000_max\": 0.7307283436029658,\n        \"nauc_map_at_1000_std\": 0.3433873013726241,\n        \"nauc_map_at_100_diff1\": 0.8082815175989179,\n        \"nauc_map_at_100_max\": 0.7307524396818857,\n        \"nauc_map_at_100_std\": 0.34351917177659325,\n        \"nauc_map_at_10_diff1\": 0.8076607264797645,\n        \"nauc_map_at_10_max\": 0.7310244696138717,\n        \"nauc_map_at_10_std\": 0.3440074274709909,\n        \"nauc_map_at_1_diff1\": 0.8267667483901106,\n        \"nauc_map_at_1_max\": 0.7076927796275018,\n        \"nauc_map_at_1_std\": 0.29862171326633397,\n        \"nauc_map_at_20_diff1\": 0.8079446901936352,\n        \"nauc_map_at_20_max\": 0.7307802533053914,\n        \"nauc_map_at_20_std\": 0.3441420971715125,\n        \"nauc_map_at_3_diff1\": 0.8057650891455094,\n        \"nauc_map_at_3_max\": 0.7360422173098745,\n        \"nauc_map_at_3_std\": 0.3479020108426812,\n        \"nauc_map_at_5_diff1\": 0.8081779021885703,\n        \"nauc_map_at_5_max\": 0.7336408216313035,\n        \"nauc_map_at_5_std\": 0.3462356493217495,\n        \"nauc_mrr_at_1000_diff1\": 0.8083049100518027,\n        \"nauc_mrr_at_1000_max\": 0.7307283436029658,\n        \"nauc_mrr_at_1000_std\": 0.3433873013726241,\n        \"nauc_mrr_at_100_diff1\": 0.8082815175989179,\n        \"nauc_mrr_at_100_max\": 0.7307524396818857,\n        \"nauc_mrr_at_100_std\": 0.34351917177659325,\n        \"nauc_mrr_at_10_diff1\": 0.8076607264797645,\n        \"nauc_mrr_at_10_max\": 0.7310244696138717,\n        \"nauc_mrr_at_10_std\": 0.3440074274709909,\n        \"nauc_mrr_at_1_diff1\": 0.8267667483901106,\n        \"nauc_mrr_at_1_max\": 0.7076927796275018,\n        \"nauc_mrr_at_1_std\": 0.29862171326633397,\n        \"nauc_mrr_at_20_diff1\": 0.8079446901936352,\n        \"nauc_mrr_at_20_max\": 0.7307802533053914,\n        \"nauc_mrr_at_20_std\": 0.3441420971715125,\n        \"nauc_mrr_at_3_diff1\": 0.8057650891455094,\n        \"nauc_mrr_at_3_max\": 0.7360422173098745,\n        \"nauc_mrr_at_3_std\": 0.3479020108426812,\n        \"nauc_mrr_at_5_diff1\": 0.8081779021885703,\n        \"nauc_mrr_at_5_max\": 0.7336408216313035,\n        \"nauc_mrr_at_5_std\": 0.3462356493217495,\n        \"nauc_ndcg_at_1000_diff1\": 0.8052545003984145,\n        \"nauc_ndcg_at_1000_max\": 0.7337087713187748,\n        \"nauc_ndcg_at_1000_std\": 0.3521440097869082,\n        \"nauc_ndcg_at_100_diff1\": 0.8043710163779854,\n        \"nauc_ndcg_at_100_max\": 0.73466028469277,\n        \"nauc_ndcg_at_100_std\": 0.3570677509208818,\n        \"nauc_ndcg_at_10_diff1\": 0.8011042496275814,\n        \"nauc_ndcg_at_10_max\": 0.7359503405504093,\n        \"nauc_ndcg_at_10_std\": 0.3599063932712571,\n        \"nauc_ndcg_at_1_diff1\": 0.8267667483901106,\n        \"nauc_ndcg_at_1_max\": 0.7076927796275018,\n        \"nauc_ndcg_at_1_std\": 0.29862171326633397,\n        \"nauc_ndcg_at_20_diff1\": 0.8017400377524357,\n        \"nauc_ndcg_at_20_max\": 0.7349810079603146,\n        \"nauc_ndcg_at_20_std\": 0.36136200111436173,\n        \"nauc_ndcg_at_3_diff1\": 0.7979086996889073,\n        \"nauc_ndcg_at_3_max\": 0.746526925607291,\n        \"nauc_ndcg_at_3_std\": 0.36613741670310723,\n        \"nauc_ndcg_at_5_diff1\": 0.8020528589215355,\n        \"nauc_ndcg_at_5_max\": 0.7423490426830931,\n        \"nauc_ndcg_at_5_std\": 0.36493608101353514,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.7593493537766106,\n        \"nauc_precision_at_100_max\": 0.7853948596982715,\n        \"nauc_precision_at_100_std\": 0.6117008206791629,\n        \"nauc_precision_at_10_diff1\": 0.7638406473700596,\n        \"nauc_precision_at_10_max\": 0.759215686274508,\n        \"nauc_precision_at_10_std\": 0.45134765017117956,\n        \"nauc_precision_at_1_diff1\": 0.8267667483901106,\n        \"nauc_precision_at_1_max\": 0.7076927796275018,\n        \"nauc_precision_at_1_std\": 0.29862171326633397,\n        \"nauc_precision_at_20_diff1\": 0.749423578955388,\n        \"nauc_precision_at_20_max\": 0.7604946740600972,\n        \"nauc_precision_at_20_std\": 0.515272775776977,\n        \"nauc_precision_at_3_diff1\": 0.7673231246365565,\n        \"nauc_precision_at_3_max\": 0.7872921108742008,\n        \"nauc_precision_at_3_std\": 0.4370420624151964,\n        \"nauc_precision_at_5_diff1\": 0.7750274260426531,\n        \"nauc_precision_at_5_max\": 0.7808240828545379,\n        \"nauc_precision_at_5_std\": 0.45057734144028394,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.7593493537765984,\n        \"nauc_recall_at_100_max\": 0.7853948596982716,\n        \"nauc_recall_at_100_std\": 0.6117008206791502,\n        \"nauc_recall_at_10_diff1\": 0.7638406473700595,\n        \"nauc_recall_at_10_max\": 0.7592156862745094,\n        \"nauc_recall_at_10_std\": 0.45134765017118056,\n        \"nauc_recall_at_1_diff1\": 0.8267667483901106,\n        \"nauc_recall_at_1_max\": 0.7076927796275018,\n        \"nauc_recall_at_1_std\": 0.29862171326633397,\n        \"nauc_recall_at_20_diff1\": 0.7494235789553924,\n        \"nauc_recall_at_20_max\": 0.7604946740601015,\n        \"nauc_recall_at_20_std\": 0.5152727757769768,\n        \"nauc_recall_at_3_diff1\": 0.7673231246365568,\n        \"nauc_recall_at_3_max\": 0.7872921108741997,\n        \"nauc_recall_at_3_std\": 0.4370420624151967,\n        \"nauc_recall_at_5_diff1\": 0.7750274260426544,\n        \"nauc_recall_at_5_max\": 0.7808240828545392,\n        \"nauc_recall_at_5_std\": 0.4505773414402868,\n        \"ndcg_at_1\": 0.75444,\n        \"ndcg_at_10\": 0.83689,\n        \"ndcg_at_100\": 0.85052,\n        \"ndcg_at_1000\": 0.85332,\n        \"ndcg_at_20\": 0.84438,\n        \"ndcg_at_3\": 0.8168,\n        \"ndcg_at_5\": 0.82722,\n        \"precision_at_1\": 0.75444,\n        \"precision_at_10\": 0.09167,\n        \"precision_at_100\": 0.00979,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04728,\n        \"precision_at_3\": 0.28704,\n        \"precision_at_5\": 0.17733,\n        \"recall_at_1\": 0.75444,\n        \"recall_at_10\": 0.91667,\n        \"recall_at_100\": 0.97889,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.94556,\n        \"recall_at_3\": 0.86111,\n        \"recall_at_5\": 0.88667\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/Salesforce/SFR-Embedding-2_R/Salesforce__SFR-Embedding-2_R/91762139d94ed4371a9fa31db5551272e0b83818/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 26252.303451776505,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.77042,\n        \"map_at_1\": 0.46592,\n        \"map_at_10\": 0.72027,\n        \"map_at_100\": 0.72551,\n        \"map_at_1000\": 0.72587,\n        \"map_at_20\": 0.7237,\n        \"map_at_3\": 0.67501,\n        \"map_at_5\": 0.70711,\n        \"mrr_at_1\": 0.7195945945945946,\n        \"mrr_at_10\": 0.7861949002574001,\n        \"mrr_at_100\": 0.7875507651031451,\n        \"mrr_at_1000\": 0.7878467841424145,\n        \"mrr_at_20\": 0.7870200135825133,\n        \"mrr_at_3\": 0.777027027027027,\n        \"mrr_at_5\": 0.7842060810810809,\n        \"nauc_map_at_1000_diff1\": 0.5798460629285543,\n        \"nauc_map_at_1000_max\": 0.5709365893012763,\n        \"nauc_map_at_1000_std\": 0.24963229926789668,\n        \"nauc_map_at_100_diff1\": 0.579850903420959,\n        \"nauc_map_at_100_max\": 0.5713400656786721,\n        \"nauc_map_at_100_std\": 0.24999648567848107,\n        \"nauc_map_at_10_diff1\": 0.5803471345606962,\n        \"nauc_map_at_10_max\": 0.5712431756202678,\n        \"nauc_map_at_10_std\": 0.2421700727422,\n        \"nauc_map_at_1_diff1\": 0.5512870662759014,\n        \"nauc_map_at_1_max\": 0.22338378158416522,\n        \"nauc_map_at_1_std\": 0.00987834782975795,\n        \"nauc_map_at_20_diff1\": 0.5796823602883358,\n        \"nauc_map_at_20_max\": 0.5705266832163431,\n        \"nauc_map_at_20_std\": 0.2468221196093924,\n        \"nauc_map_at_3_diff1\": 0.5607918178010085,\n        \"nauc_map_at_3_max\": 0.5245880639557309,\n        \"nauc_map_at_3_std\": 0.18915077275137712,\n        \"nauc_map_at_5_diff1\": 0.5721320973412499,\n        \"nauc_map_at_5_max\": 0.5576511822270637,\n        \"nauc_map_at_5_std\": 0.21990609077755557,\n        \"nauc_mrr_at_1000_diff1\": 0.6488061140795381,\n        \"nauc_mrr_at_1000_max\": 0.6093968304137143,\n        \"nauc_mrr_at_1000_std\": 0.318541599167972,\n        \"nauc_mrr_at_100_diff1\": 0.6489704492564633,\n        \"nauc_mrr_at_100_max\": 0.6098143688186834,\n        \"nauc_mrr_at_100_std\": 0.31903470358423563,\n        \"nauc_mrr_at_10_diff1\": 0.6486553682311893,\n        \"nauc_mrr_at_10_max\": 0.6112651859819409,\n        \"nauc_mrr_at_10_std\": 0.3203063096386445,\n        \"nauc_mrr_at_1_diff1\": 0.6206797143265911,\n        \"nauc_mrr_at_1_max\": 0.4945201476497312,\n        \"nauc_mrr_at_1_std\": 0.1972028407123734,\n        \"nauc_mrr_at_20_diff1\": 0.6488366321442393,\n        \"nauc_mrr_at_20_max\": 0.6098816742420539,\n        \"nauc_mrr_at_20_std\": 0.3181061242841399,\n        \"nauc_mrr_at_3_diff1\": 0.6483813289040319,\n        \"nauc_mrr_at_3_max\": 0.6135880843665676,\n        \"nauc_mrr_at_3_std\": 0.317010318288184,\n        \"nauc_mrr_at_5_diff1\": 0.6464749557254158,\n        \"nauc_mrr_at_5_max\": 0.6146318548989139,\n        \"nauc_mrr_at_5_std\": 0.3227119161042139,\n        \"nauc_ndcg_at_1000_diff1\": 0.6113128952769129,\n        \"nauc_ndcg_at_1000_max\": 0.621181818996922,\n        \"nauc_ndcg_at_1000_std\": 0.32647263494138723,\n        \"nauc_ndcg_at_100_diff1\": 0.6098657037764337,\n        \"nauc_ndcg_at_100_max\": 0.6320186725086027,\n        \"nauc_ndcg_at_100_std\": 0.33838728012231184,\n        \"nauc_ndcg_at_10_diff1\": 0.6077329427579963,\n        \"nauc_ndcg_at_10_max\": 0.6315137058304188,\n        \"nauc_ndcg_at_10_std\": 0.31395351203019783,\n        \"nauc_ndcg_at_1_diff1\": 0.6206797143265911,\n        \"nauc_ndcg_at_1_max\": 0.4945201476497312,\n        \"nauc_ndcg_at_1_std\": 0.1972028407123734,\n        \"nauc_ndcg_at_20_diff1\": 0.6070561082184659,\n        \"nauc_ndcg_at_20_max\": 0.6292145515101722,\n        \"nauc_ndcg_at_20_std\": 0.3227008210375962,\n        \"nauc_ndcg_at_3_diff1\": 0.5867661134954778,\n        \"nauc_ndcg_at_3_max\": 0.5794669490947111,\n        \"nauc_ndcg_at_3_std\": 0.24828332002512565,\n        \"nauc_ndcg_at_5_diff1\": 0.5926357588594711,\n        \"nauc_ndcg_at_5_max\": 0.610982040152071,\n        \"nauc_ndcg_at_5_std\": 0.28090467113558243,\n        \"nauc_precision_at_1000_diff1\": -0.1935591294276986,\n        \"nauc_precision_at_1000_max\": 0.10619685387536802,\n        \"nauc_precision_at_1000_std\": 0.2468394907699279,\n        \"nauc_precision_at_100_diff1\": -0.0900605496254096,\n        \"nauc_precision_at_100_max\": 0.2429950066850094,\n        \"nauc_precision_at_100_std\": 0.3289252874196544,\n        \"nauc_precision_at_10_diff1\": 0.0018350440784743298,\n        \"nauc_precision_at_10_max\": 0.33957770539706905,\n        \"nauc_precision_at_10_std\": 0.31891611215728227,\n        \"nauc_precision_at_1_diff1\": 0.6206797143265911,\n        \"nauc_precision_at_1_max\": 0.4945201476497312,\n        \"nauc_precision_at_1_std\": 0.1972028407123734,\n        \"nauc_precision_at_20_diff1\": -0.03365736454035419,\n        \"nauc_precision_at_20_max\": 0.30114386228196793,\n        \"nauc_precision_at_20_std\": 0.32274309305272564,\n        \"nauc_precision_at_3_diff1\": 0.12755097872349536,\n        \"nauc_precision_at_3_max\": 0.46353058962173,\n        \"nauc_precision_at_3_std\": 0.3097186037482983,\n        \"nauc_precision_at_5_diff1\": 0.04223451425936662,\n        \"nauc_precision_at_5_max\": 0.3925891263112398,\n        \"nauc_precision_at_5_std\": 0.30983738011566825,\n        \"nauc_recall_at_1000_diff1\": 0.7872997351004211,\n        \"nauc_recall_at_1000_max\": 0.9011890957279892,\n        \"nauc_recall_at_1000_std\": 0.8485183303325131,\n        \"nauc_recall_at_100_diff1\": 0.6607507229672478,\n        \"nauc_recall_at_100_max\": 0.8665929700563204,\n        \"nauc_recall_at_100_std\": 0.6988902010210113,\n        \"nauc_recall_at_10_diff1\": 0.6153792478846523,\n        \"nauc_recall_at_10_max\": 0.7718276200957296,\n        \"nauc_recall_at_10_std\": 0.45811084641605715,\n        \"nauc_recall_at_1_diff1\": 0.5512870662759014,\n        \"nauc_recall_at_1_max\": 0.22338378158416522,\n        \"nauc_recall_at_1_std\": 0.00987834782975795,\n        \"nauc_recall_at_20_diff1\": 0.6229462319927663,\n        \"nauc_recall_at_20_max\": 0.7874474748052596,\n        \"nauc_recall_at_20_std\": 0.5121623906656506,\n        \"nauc_recall_at_3_diff1\": 0.5522361870538924,\n        \"nauc_recall_at_3_max\": 0.5990514608940101,\n        \"nauc_recall_at_3_std\": 0.2546656850956461,\n        \"nauc_recall_at_5_diff1\": 0.5715206663883843,\n        \"nauc_recall_at_5_max\": 0.6907112067834904,\n        \"nauc_recall_at_5_std\": 0.34368037183961025,\n        \"ndcg_at_1\": 0.71959,\n        \"ndcg_at_10\": 0.77042,\n        \"ndcg_at_100\": 0.78684,\n        \"ndcg_at_1000\": 0.7957,\n        \"ndcg_at_20\": 0.77812,\n        \"ndcg_at_3\": 0.7189,\n        \"ndcg_at_5\": 0.75232,\n        \"precision_at_1\": 0.71959,\n        \"precision_at_10\": 0.15625,\n        \"precision_at_100\": 0.01701,\n        \"precision_at_1000\": 0.00183,\n        \"precision_at_20\": 0.08074,\n        \"precision_at_3\": 0.42849,\n        \"precision_at_5\": 0.29122,\n        \"recall_at_1\": 0.46592,\n        \"recall_at_10\": 0.84045,\n        \"recall_at_100\": 0.90191,\n        \"recall_at_1000\": 0.95898,\n        \"recall_at_20\": 0.86444,\n        \"recall_at_3\": 0.72924,\n        \"recall_at_5\": 0.79788\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/Salesforce/SFR-Embedding-2_R/Salesforce__SFR-Embedding-2_R/91762139d94ed4371a9fa31db5551272e0b83818/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 1186423.9800457954,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.55798,\n        \"map_at_1\": 0.29203,\n        \"map_at_10\": 0.46203,\n        \"map_at_100\": 0.48745,\n        \"map_at_1000\": 0.48846,\n        \"map_at_20\": 0.47661,\n        \"map_at_3\": 0.40607,\n        \"map_at_5\": 0.43463,\n        \"mrr_at_1\": 0.49765258215962443,\n        \"mrr_at_10\": 0.6230289142260972,\n        \"mrr_at_100\": 0.6277851950173721,\n        \"mrr_at_1000\": 0.6279549678842242,\n        \"mrr_at_20\": 0.6266624066568468,\n        \"mrr_at_3\": 0.60093896713615,\n        \"mrr_at_5\": 0.6126760563380279,\n        \"nauc_map_at_1000_diff1\": 0.491194883591401,\n        \"nauc_map_at_1000_max\": 0.4069872070975119,\n        \"nauc_map_at_1000_std\": 0.1503680269848714,\n        \"nauc_map_at_100_diff1\": 0.4913454233702117,\n        \"nauc_map_at_100_max\": 0.40729458264289015,\n        \"nauc_map_at_100_std\": 0.15028625396742795,\n        \"nauc_map_at_10_diff1\": 0.48358147289855585,\n        \"nauc_map_at_10_max\": 0.401153758256364,\n        \"nauc_map_at_10_std\": 0.13214457746948782,\n        \"nauc_map_at_1_diff1\": 0.5406803589896482,\n        \"nauc_map_at_1_max\": 0.37956385631507095,\n        \"nauc_map_at_1_std\": 0.01951489431069034,\n        \"nauc_map_at_20_diff1\": 0.4881433473837766,\n        \"nauc_map_at_20_max\": 0.40653494240357857,\n        \"nauc_map_at_20_std\": 0.13840323230776408,\n        \"nauc_map_at_3_diff1\": 0.5007445498318888,\n        \"nauc_map_at_3_max\": 0.39660095984986155,\n        \"nauc_map_at_3_std\": 0.10303331423281582,\n        \"nauc_map_at_5_diff1\": 0.4795533699889755,\n        \"nauc_map_at_5_max\": 0.39376258695768596,\n        \"nauc_map_at_5_std\": 0.1272747061807712,\n        \"nauc_mrr_at_1000_diff1\": 0.4864620495031914,\n        \"nauc_mrr_at_1000_max\": 0.41944207225633723,\n        \"nauc_mrr_at_1000_std\": 0.2139266544276021,\n        \"nauc_mrr_at_100_diff1\": 0.48654660037253383,\n        \"nauc_mrr_at_100_max\": 0.41972927438876206,\n        \"nauc_mrr_at_100_std\": 0.2143479051340134,\n        \"nauc_mrr_at_10_diff1\": 0.48504116206277675,\n        \"nauc_mrr_at_10_max\": 0.42189655584570024,\n        \"nauc_mrr_at_10_std\": 0.21635367595331065,\n        \"nauc_mrr_at_1_diff1\": 0.503902511177942,\n        \"nauc_mrr_at_1_max\": 0.37842900420373343,\n        \"nauc_mrr_at_1_std\": 0.13358952143755706,\n        \"nauc_mrr_at_20_diff1\": 0.4870227638485244,\n        \"nauc_mrr_at_20_max\": 0.42038872245430065,\n        \"nauc_mrr_at_20_std\": 0.21523868650702208,\n        \"nauc_mrr_at_3_diff1\": 0.48157473054556565,\n        \"nauc_mrr_at_3_max\": 0.4240310174815224,\n        \"nauc_mrr_at_3_std\": 0.2193030086323231,\n        \"nauc_mrr_at_5_diff1\": 0.4823847363954533,\n        \"nauc_mrr_at_5_max\": 0.4204479083239435,\n        \"nauc_mrr_at_5_std\": 0.22258727059077912,\n        \"nauc_ndcg_at_1000_diff1\": 0.4997349532235543,\n        \"nauc_ndcg_at_1000_max\": 0.4298387606599779,\n        \"nauc_ndcg_at_1000_std\": 0.22086264873797648,\n        \"nauc_ndcg_at_100_diff1\": 0.5044444671929433,\n        \"nauc_ndcg_at_100_max\": 0.4380204415938954,\n        \"nauc_ndcg_at_100_std\": 0.23084687735018677,\n        \"nauc_ndcg_at_10_diff1\": 0.47565872284869415,\n        \"nauc_ndcg_at_10_max\": 0.41736335785305456,\n        \"nauc_ndcg_at_10_std\": 0.1817944693451711,\n        \"nauc_ndcg_at_1_diff1\": 0.503902511177942,\n        \"nauc_ndcg_at_1_max\": 0.37842900420373343,\n        \"nauc_ndcg_at_1_std\": 0.13358952143755706,\n        \"nauc_ndcg_at_20_diff1\": 0.49225862046154123,\n        \"nauc_ndcg_at_20_max\": 0.42426048013735657,\n        \"nauc_ndcg_at_20_std\": 0.194972162210241,\n        \"nauc_ndcg_at_3_diff1\": 0.47687923026335577,\n        \"nauc_ndcg_at_3_max\": 0.40531035894440326,\n        \"nauc_ndcg_at_3_std\": 0.19084986432153023,\n        \"nauc_ndcg_at_5_diff1\": 0.4657060987971936,\n        \"nauc_ndcg_at_5_max\": 0.39069416975755794,\n        \"nauc_ndcg_at_5_std\": 0.1940174168936946,\n        \"nauc_precision_at_1000_diff1\": -0.11961975615453432,\n        \"nauc_precision_at_1000_max\": -0.05579563542470387,\n        \"nauc_precision_at_1000_std\": 0.20820953474163356,\n        \"nauc_precision_at_100_diff1\": -0.07510979845535082,\n        \"nauc_precision_at_100_max\": -0.014431689714078318,\n        \"nauc_precision_at_100_std\": 0.24395066530154658,\n        \"nauc_precision_at_10_diff1\": 0.0033959763225131613,\n        \"nauc_precision_at_10_max\": 0.09943027216073655,\n        \"nauc_precision_at_10_std\": 0.26396146250865166,\n        \"nauc_precision_at_1_diff1\": 0.503902511177942,\n        \"nauc_precision_at_1_max\": 0.37842900420373343,\n        \"nauc_precision_at_1_std\": 0.13358952143755706,\n        \"nauc_precision_at_20_diff1\": -0.03237023973607798,\n        \"nauc_precision_at_20_max\": 0.051844987113912645,\n        \"nauc_precision_at_20_std\": 0.24372696384200618,\n        \"nauc_precision_at_3_diff1\": 0.15365445388164742,\n        \"nauc_precision_at_3_max\": 0.25053447360765924,\n        \"nauc_precision_at_3_std\": 0.29623151747718696,\n        \"nauc_precision_at_5_diff1\": 0.04820706512058263,\n        \"nauc_precision_at_5_max\": 0.15270339762587773,\n        \"nauc_precision_at_5_std\": 0.2983220616107835,\n        \"nauc_recall_at_1000_diff1\": 0.7973836608766782,\n        \"nauc_recall_at_1000_max\": 0.5872450504603903,\n        \"nauc_recall_at_1000_std\": 0.6800368078340461,\n        \"nauc_recall_at_100_diff1\": 0.5701935430871975,\n        \"nauc_recall_at_100_max\": 0.5487692759263737,\n        \"nauc_recall_at_100_std\": 0.521275254554224,\n        \"nauc_recall_at_10_diff1\": 0.3682811335069578,\n        \"nauc_recall_at_10_max\": 0.3614076934322836,\n        \"nauc_recall_at_10_std\": 0.1854444416214071,\n        \"nauc_recall_at_1_diff1\": 0.5406803589896482,\n        \"nauc_recall_at_1_max\": 0.37956385631507095,\n        \"nauc_recall_at_1_std\": 0.01951489431069034,\n        \"nauc_recall_at_20_diff1\": 0.42827597952233176,\n        \"nauc_recall_at_20_max\": 0.3692076115465993,\n        \"nauc_recall_at_20_std\": 0.23099687906425917,\n        \"nauc_recall_at_3_diff1\": 0.42526025206025636,\n        \"nauc_recall_at_3_max\": 0.3747420478623814,\n        \"nauc_recall_at_3_std\": 0.14258382259602792,\n        \"nauc_recall_at_5_diff1\": 0.37441114533135217,\n        \"nauc_recall_at_5_max\": 0.3510166504479535,\n        \"nauc_recall_at_5_std\": 0.19577868823310826,\n        \"ndcg_at_1\": 0.49765,\n        \"ndcg_at_10\": 0.55798,\n        \"ndcg_at_100\": 0.62582,\n        \"ndcg_at_1000\": 0.63931,\n        \"ndcg_at_20\": 0.58864,\n        \"ndcg_at_3\": 0.51786,\n        \"ndcg_at_5\": 0.52451,\n        \"precision_at_1\": 0.49765,\n        \"precision_at_10\": 0.14883,\n        \"precision_at_100\": 0.02282,\n        \"precision_at_1000\": 0.00252,\n        \"precision_at_20\": 0.08873,\n        \"precision_at_3\": 0.32238,\n        \"precision_at_5\": 0.23286,\n        \"recall_at_1\": 0.29203,\n        \"recall_at_10\": 0.66858,\n        \"recall_at_100\": 0.89209,\n        \"recall_at_1000\": 0.97269,\n        \"recall_at_20\": 0.7564,\n        \"recall_at_3\": 0.49825,\n        \"recall_at_5\": 0.56757\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/Salesforce/SFR-Embedding-2_R/Salesforce__SFR-Embedding-2_R/91762139d94ed4371a9fa31db5551272e0b83818/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 1455631.1653485298,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.40347,\n        \"map_at_1\": 0.2312,\n        \"map_at_10\": 0.34018,\n        \"map_at_100\": 0.35384,\n        \"map_at_1000\": 0.35433,\n        \"map_at_20\": 0.34932,\n        \"map_at_3\": 0.30681,\n        \"map_at_5\": 0.3253,\n        \"mrr_at_1\": 0.2494061757719715,\n        \"mrr_at_10\": 0.35903272631301125,\n        \"mrr_at_100\": 0.3706073589603738,\n        \"mrr_at_1000\": 0.3709959642055801,\n        \"mrr_at_20\": 0.3667203837232443,\n        \"mrr_at_3\": 0.32818685669041964,\n        \"mrr_at_5\": 0.34481393507521774,\n        \"nauc_map_at_1000_diff1\": 0.35314835099740105,\n        \"nauc_map_at_1000_max\": 0.3184028824344834,\n        \"nauc_map_at_1000_std\": 0.1432921331223796,\n        \"nauc_map_at_100_diff1\": 0.35296058643756734,\n        \"nauc_map_at_100_max\": 0.31841688633705867,\n        \"nauc_map_at_100_std\": 0.14349656279043632,\n        \"nauc_map_at_10_diff1\": 0.35112506194836135,\n        \"nauc_map_at_10_max\": 0.31491953489216773,\n        \"nauc_map_at_10_std\": 0.13911813914615137,\n        \"nauc_map_at_1_diff1\": 0.4093468304996029,\n        \"nauc_map_at_1_max\": 0.327725215421424,\n        \"nauc_map_at_1_std\": 0.09909470695069918,\n        \"nauc_map_at_20_diff1\": 0.35100121453234423,\n        \"nauc_map_at_20_max\": 0.3181574024852935,\n        \"nauc_map_at_20_std\": 0.14559399484397795,\n        \"nauc_map_at_3_diff1\": 0.3756745099127106,\n        \"nauc_map_at_3_max\": 0.32612578483522403,\n        \"nauc_map_at_3_std\": 0.13379369457944715,\n        \"nauc_map_at_5_diff1\": 0.3568498924051157,\n        \"nauc_map_at_5_max\": 0.31074286391034067,\n        \"nauc_map_at_5_std\": 0.1293251651765584,\n        \"nauc_mrr_at_1000_diff1\": 0.364977531152561,\n        \"nauc_mrr_at_1000_max\": 0.33340877689458087,\n        \"nauc_mrr_at_1000_std\": 0.1452165152480756,\n        \"nauc_mrr_at_100_diff1\": 0.3647663369033261,\n        \"nauc_mrr_at_100_max\": 0.33343770667477374,\n        \"nauc_mrr_at_100_std\": 0.14535532653439698,\n        \"nauc_mrr_at_10_diff1\": 0.36456902168528393,\n        \"nauc_mrr_at_10_max\": 0.33150060580676827,\n        \"nauc_mrr_at_10_std\": 0.1417761017055953,\n        \"nauc_mrr_at_1_diff1\": 0.41959061576722323,\n        \"nauc_mrr_at_1_max\": 0.3433839178533463,\n        \"nauc_mrr_at_1_std\": 0.0974870864589389,\n        \"nauc_mrr_at_20_diff1\": 0.36332755358638935,\n        \"nauc_mrr_at_20_max\": 0.33339240206318743,\n        \"nauc_mrr_at_20_std\": 0.14724678496394428,\n        \"nauc_mrr_at_3_diff1\": 0.38550657045567355,\n        \"nauc_mrr_at_3_max\": 0.3415972835297517,\n        \"nauc_mrr_at_3_std\": 0.14372554311864696,\n        \"nauc_mrr_at_5_diff1\": 0.36792261359578443,\n        \"nauc_mrr_at_5_max\": 0.32610972899994883,\n        \"nauc_mrr_at_5_std\": 0.13251527197477345,\n        \"nauc_ndcg_at_1000_diff1\": 0.33995483891551825,\n        \"nauc_ndcg_at_1000_max\": 0.32613427563168335,\n        \"nauc_ndcg_at_1000_std\": 0.16820157108978356,\n        \"nauc_ndcg_at_100_diff1\": 0.333763670806927,\n        \"nauc_ndcg_at_100_max\": 0.3232036273021733,\n        \"nauc_ndcg_at_100_std\": 0.17143680193565985,\n        \"nauc_ndcg_at_10_diff1\": 0.32351652052150365,\n        \"nauc_ndcg_at_10_max\": 0.3092628191110229,\n        \"nauc_ndcg_at_10_std\": 0.15760843232563637,\n        \"nauc_ndcg_at_1_diff1\": 0.41959061576722323,\n        \"nauc_ndcg_at_1_max\": 0.3433839178533463,\n        \"nauc_ndcg_at_1_std\": 0.0974870864589389,\n        \"nauc_ndcg_at_20_diff1\": 0.3184009538690653,\n        \"nauc_ndcg_at_20_max\": 0.31759749112137114,\n        \"nauc_ndcg_at_20_std\": 0.18107837405928612,\n        \"nauc_ndcg_at_3_diff1\": 0.3684020079755906,\n        \"nauc_ndcg_at_3_max\": 0.3289719410412564,\n        \"nauc_ndcg_at_3_std\": 0.1477630747515411,\n        \"nauc_ndcg_at_5_diff1\": 0.33512227447065757,\n        \"nauc_ndcg_at_5_max\": 0.30012607008251885,\n        \"nauc_ndcg_at_5_std\": 0.13502330718572497,\n        \"nauc_precision_at_1000_diff1\": 0.06521978170848006,\n        \"nauc_precision_at_1000_max\": 0.12105515582448478,\n        \"nauc_precision_at_1000_std\": 0.03867644111859382,\n        \"nauc_precision_at_100_diff1\": 0.12353944797790105,\n        \"nauc_precision_at_100_max\": 0.1913192006044018,\n        \"nauc_precision_at_100_std\": 0.14174840682942003,\n        \"nauc_precision_at_10_diff1\": 0.1965669422940171,\n        \"nauc_precision_at_10_max\": 0.25496564994278625,\n        \"nauc_precision_at_10_std\": 0.18820923954238694,\n        \"nauc_precision_at_1_diff1\": 0.41959061576722323,\n        \"nauc_precision_at_1_max\": 0.3433839178533463,\n        \"nauc_precision_at_1_std\": 0.0974870864589389,\n        \"nauc_precision_at_20_diff1\": 0.11676195546241633,\n        \"nauc_precision_at_20_max\": 0.21904929672037599,\n        \"nauc_precision_at_20_std\": 0.23147430316311335,\n        \"nauc_precision_at_3_diff1\": 0.34674459790480033,\n        \"nauc_precision_at_3_max\": 0.33319229819409746,\n        \"nauc_precision_at_3_std\": 0.1752854772824614,\n        \"nauc_precision_at_5_diff1\": 0.24789066663662582,\n        \"nauc_precision_at_5_max\": 0.2485642215680406,\n        \"nauc_precision_at_5_std\": 0.14710195968857806,\n        \"nauc_recall_at_1000_diff1\": 0.2548683272740943,\n        \"nauc_recall_at_1000_max\": 0.5855865374228014,\n        \"nauc_recall_at_1000_std\": 0.7160706897978473,\n        \"nauc_recall_at_100_diff1\": 0.21085262386402295,\n        \"nauc_recall_at_100_max\": 0.3527713843700616,\n        \"nauc_recall_at_100_std\": 0.38591614385520506,\n        \"nauc_recall_at_10_diff1\": 0.21019952954619286,\n        \"nauc_recall_at_10_max\": 0.2622111605771992,\n        \"nauc_recall_at_10_std\": 0.20840494045508398,\n        \"nauc_recall_at_1_diff1\": 0.4093468304996029,\n        \"nauc_recall_at_1_max\": 0.327725215421424,\n        \"nauc_recall_at_1_std\": 0.09909470695069918,\n        \"nauc_recall_at_20_diff1\": 0.1573821569814531,\n        \"nauc_recall_at_20_max\": 0.288872669243251,\n        \"nauc_recall_at_20_std\": 0.3308644175315028,\n        \"nauc_recall_at_3_diff1\": 0.3337416059993435,\n        \"nauc_recall_at_3_max\": 0.3171886527151158,\n        \"nauc_recall_at_3_std\": 0.1724507303422492,\n        \"nauc_recall_at_5_diff1\": 0.2552725017557499,\n        \"nauc_recall_at_5_max\": 0.24659826971970386,\n        \"nauc_recall_at_5_std\": 0.13957583477761074,\n        \"ndcg_at_1\": 0.24941,\n        \"ndcg_at_10\": 0.40347,\n        \"ndcg_at_100\": 0.46451,\n        \"ndcg_at_1000\": 0.47738,\n        \"ndcg_at_20\": 0.43455,\n        \"ndcg_at_3\": 0.33662,\n        \"ndcg_at_5\": 0.36865,\n        \"precision_at_1\": 0.24941,\n        \"precision_at_10\": 0.06508,\n        \"precision_at_100\": 0.00981,\n        \"precision_at_1000\": 0.0011,\n        \"precision_at_20\": 0.03979,\n        \"precision_at_3\": 0.14727,\n        \"precision_at_5\": 0.10594,\n        \"recall_at_1\": 0.2312,\n        \"recall_at_10\": 0.58155,\n        \"recall_at_100\": 0.85234,\n        \"recall_at_1000\": 0.95051,\n        \"recall_at_20\": 0.69873,\n        \"recall_at_3\": 0.40222,\n        \"recall_at_5\": 0.47783\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/Salesforce/SFR-Embedding-2_R/Salesforce__SFR-Embedding-2_R/91762139d94ed4371a9fa31db5551272e0b83818/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 12127.463791370392,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.24346,\n        \"map_at_1\": 0.16,\n        \"map_at_10\": 0.21462,\n        \"map_at_100\": 0.22418,\n        \"map_at_1000\": 0.22525,\n        \"map_at_20\": 0.2195,\n        \"map_at_3\": 0.19833,\n        \"map_at_5\": 0.20933,\n        \"mrr_at_1\": 0.16,\n        \"mrr_at_10\": 0.21461507936507943,\n        \"mrr_at_100\": 0.22417548602107892,\n        \"mrr_at_1000\": 0.22525155738712846,\n        \"mrr_at_20\": 0.21949745576061366,\n        \"mrr_at_3\": 0.19833333333333336,\n        \"mrr_at_5\": 0.20933333333333334,\n        \"nauc_map_at_1000_diff1\": 0.49929863529099233,\n        \"nauc_map_at_1000_max\": 0.41971415809226786,\n        \"nauc_map_at_1000_std\": 0.09531890382009271,\n        \"nauc_map_at_100_diff1\": 0.4990409957299045,\n        \"nauc_map_at_100_max\": 0.41987897706351596,\n        \"nauc_map_at_100_std\": 0.0952393361704494,\n        \"nauc_map_at_10_diff1\": 0.5062956213852428,\n        \"nauc_map_at_10_max\": 0.4243765133769566,\n        \"nauc_map_at_10_std\": 0.08795426579167952,\n        \"nauc_map_at_1_diff1\": 0.6395663696420342,\n        \"nauc_map_at_1_max\": 0.4531898141035488,\n        \"nauc_map_at_1_std\": 0.05106391150714374,\n        \"nauc_map_at_20_diff1\": 0.496346158552349,\n        \"nauc_map_at_20_max\": 0.4192185873029332,\n        \"nauc_map_at_20_std\": 0.09161467444411081,\n        \"nauc_map_at_3_diff1\": 0.5307151722565736,\n        \"nauc_map_at_3_max\": 0.4392240081280448,\n        \"nauc_map_at_3_std\": 0.08356857193516706,\n        \"nauc_map_at_5_diff1\": 0.5156828411866133,\n        \"nauc_map_at_5_max\": 0.43736539278879716,\n        \"nauc_map_at_5_std\": 0.08712073248344535,\n        \"nauc_mrr_at_1000_diff1\": 0.49929863529099233,\n        \"nauc_mrr_at_1000_max\": 0.41971415809226786,\n        \"nauc_mrr_at_1000_std\": 0.09531890382009271,\n        \"nauc_mrr_at_100_diff1\": 0.4990409957299045,\n        \"nauc_mrr_at_100_max\": 0.41987897706351596,\n        \"nauc_mrr_at_100_std\": 0.0952393361704494,\n        \"nauc_mrr_at_10_diff1\": 0.5062956213852428,\n        \"nauc_mrr_at_10_max\": 0.4243765133769566,\n        \"nauc_mrr_at_10_std\": 0.08795426579167952,\n        \"nauc_mrr_at_1_diff1\": 0.6395663696420342,\n        \"nauc_mrr_at_1_max\": 0.4531898141035488,\n        \"nauc_mrr_at_1_std\": 0.05106391150714374,\n        \"nauc_mrr_at_20_diff1\": 0.496346158552349,\n        \"nauc_mrr_at_20_max\": 0.4192185873029332,\n        \"nauc_mrr_at_20_std\": 0.09161467444411081,\n        \"nauc_mrr_at_3_diff1\": 0.5307151722565736,\n        \"nauc_mrr_at_3_max\": 0.4392240081280448,\n        \"nauc_mrr_at_3_std\": 0.08356857193516706,\n        \"nauc_mrr_at_5_diff1\": 0.5156828411866133,\n        \"nauc_mrr_at_5_max\": 0.43736539278879716,\n        \"nauc_mrr_at_5_std\": 0.08712073248344535,\n        \"nauc_ndcg_at_1000_diff1\": 0.45240660942590677,\n        \"nauc_ndcg_at_1000_max\": 0.40142745355267073,\n        \"nauc_ndcg_at_1000_std\": 0.14297847584846893,\n        \"nauc_ndcg_at_100_diff1\": 0.4422257629311109,\n        \"nauc_ndcg_at_100_max\": 0.39084482306992857,\n        \"nauc_ndcg_at_100_std\": 0.1396135977087359,\n        \"nauc_ndcg_at_10_diff1\": 0.4559678485368314,\n        \"nauc_ndcg_at_10_max\": 0.4016152381044367,\n        \"nauc_ndcg_at_10_std\": 0.10065001102931954,\n        \"nauc_ndcg_at_1_diff1\": 0.6395663696420342,\n        \"nauc_ndcg_at_1_max\": 0.4531898141035488,\n        \"nauc_ndcg_at_1_std\": 0.05106391150714374,\n        \"nauc_ndcg_at_20_diff1\": 0.42455881041527677,\n        \"nauc_ndcg_at_20_max\": 0.3829538123114625,\n        \"nauc_ndcg_at_20_std\": 0.11126163095011597,\n        \"nauc_ndcg_at_3_diff1\": 0.5032758392136251,\n        \"nauc_ndcg_at_3_max\": 0.4361327441336674,\n        \"nauc_ndcg_at_3_std\": 0.0920914189387461,\n        \"nauc_ndcg_at_5_diff1\": 0.4768782619701144,\n        \"nauc_ndcg_at_5_max\": 0.4318323517533922,\n        \"nauc_ndcg_at_5_std\": 0.09792981024765775,\n        \"nauc_precision_at_1000_diff1\": 0.29945358643125614,\n        \"nauc_precision_at_1000_max\": 0.4339723950601696,\n        \"nauc_precision_at_1000_std\": 0.5704020719497185,\n        \"nauc_precision_at_100_diff1\": 0.29562207969353155,\n        \"nauc_precision_at_100_max\": 0.30654874191020737,\n        \"nauc_precision_at_100_std\": 0.31555271788025674,\n        \"nauc_precision_at_10_diff1\": 0.32826434865760473,\n        \"nauc_precision_at_10_max\": 0.33699008559722193,\n        \"nauc_precision_at_10_std\": 0.1325528425050969,\n        \"nauc_precision_at_1_diff1\": 0.6395663696420342,\n        \"nauc_precision_at_1_max\": 0.4531898141035488,\n        \"nauc_precision_at_1_std\": 0.05106391150714374,\n        \"nauc_precision_at_20_diff1\": 0.23176493305870235,\n        \"nauc_precision_at_20_max\": 0.27511585993820825,\n        \"nauc_precision_at_20_std\": 0.16388388259526274,\n        \"nauc_precision_at_3_diff1\": 0.43420437425320807,\n        \"nauc_precision_at_3_max\": 0.4284823701416771,\n        \"nauc_precision_at_3_std\": 0.11364597789866632,\n        \"nauc_precision_at_5_diff1\": 0.3807973408349397,\n        \"nauc_precision_at_5_max\": 0.41757201337756206,\n        \"nauc_precision_at_5_std\": 0.12434866122209884,\n        \"nauc_recall_at_1000_diff1\": 0.29945358643125675,\n        \"nauc_recall_at_1000_max\": 0.4339723950601693,\n        \"nauc_recall_at_1000_std\": 0.5704020719497167,\n        \"nauc_recall_at_100_diff1\": 0.29562207969353077,\n        \"nauc_recall_at_100_max\": 0.3065487419102072,\n        \"nauc_recall_at_100_std\": 0.3155527178802567,\n        \"nauc_recall_at_10_diff1\": 0.32826434865760423,\n        \"nauc_recall_at_10_max\": 0.33699008559722154,\n        \"nauc_recall_at_10_std\": 0.1325528425050965,\n        \"nauc_recall_at_1_diff1\": 0.6395663696420342,\n        \"nauc_recall_at_1_max\": 0.4531898141035488,\n        \"nauc_recall_at_1_std\": 0.05106391150714374,\n        \"nauc_recall_at_20_diff1\": 0.23176493305870227,\n        \"nauc_recall_at_20_max\": 0.27511585993820803,\n        \"nauc_recall_at_20_std\": 0.16388388259526257,\n        \"nauc_recall_at_3_diff1\": 0.43420437425320807,\n        \"nauc_recall_at_3_max\": 0.42848237014167706,\n        \"nauc_recall_at_3_std\": 0.11364597789866643,\n        \"nauc_recall_at_5_diff1\": 0.38079734083493955,\n        \"nauc_recall_at_5_max\": 0.4175720133775618,\n        \"nauc_recall_at_5_std\": 0.12434866122209884,\n        \"ndcg_at_1\": 0.16,\n        \"ndcg_at_10\": 0.24346,\n        \"ndcg_at_100\": 0.29392,\n        \"ndcg_at_1000\": 0.3264,\n        \"ndcg_at_20\": 0.26034,\n        \"ndcg_at_3\": 0.21036,\n        \"ndcg_at_5\": 0.23057,\n        \"precision_at_1\": 0.16,\n        \"precision_at_10\": 0.0335,\n        \"precision_at_100\": 0.0058,\n        \"precision_at_1000\": 0.00085,\n        \"precision_at_20\": 0.02,\n        \"precision_at_3\": 0.08167,\n        \"precision_at_5\": 0.059,\n        \"recall_at_1\": 0.16,\n        \"recall_at_10\": 0.335,\n        \"recall_at_100\": 0.58,\n        \"recall_at_1000\": 0.845,\n        \"recall_at_20\": 0.4,\n        \"recall_at_3\": 0.245,\n        \"recall_at_5\": 0.295\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.26801,\n        \"map_at_1\": 0.2,\n        \"map_at_10\": 0.24508,\n        \"map_at_100\": 0.24995,\n        \"map_at_1000\": 0.25111,\n        \"map_at_20\": 0.24643,\n        \"map_at_3\": 0.23417,\n        \"map_at_5\": 0.23917,\n        \"mrr_at_1\": 0.2,\n        \"mrr_at_10\": 0.24508333333333332,\n        \"mrr_at_100\": 0.2499496802510732,\n        \"mrr_at_1000\": 0.25110701532543067,\n        \"mrr_at_20\": 0.24642822199730097,\n        \"mrr_at_3\": 0.2341666666666667,\n        \"mrr_at_5\": 0.23916666666666667,\n        \"nauc_map_at_1000_diff1\": 0.6395355878729584,\n        \"nauc_map_at_1000_max\": 0.365187460643138,\n        \"nauc_map_at_1000_std\": 0.01970574265860572,\n        \"nauc_map_at_100_diff1\": 0.6391681401299727,\n        \"nauc_map_at_100_max\": 0.3650387442985491,\n        \"nauc_map_at_100_std\": 0.01867822705611146,\n        \"nauc_map_at_10_diff1\": 0.6434385016870486,\n        \"nauc_map_at_10_max\": 0.368285928478509,\n        \"nauc_map_at_10_std\": 0.020151886079335497,\n        \"nauc_map_at_1_diff1\": 0.71360187278011,\n        \"nauc_map_at_1_max\": 0.37068937681627384,\n        \"nauc_map_at_1_std\": -0.027615434291249602,\n        \"nauc_map_at_20_diff1\": 0.6418435602302738,\n        \"nauc_map_at_20_max\": 0.3665716207617676,\n        \"nauc_map_at_20_std\": 0.018595393472855243,\n        \"nauc_map_at_3_diff1\": 0.6594812851695392,\n        \"nauc_map_at_3_max\": 0.36501267080996064,\n        \"nauc_map_at_3_std\": 0.0028860938964413215,\n        \"nauc_map_at_5_diff1\": 0.6504570573581048,\n        \"nauc_map_at_5_max\": 0.3660302571596071,\n        \"nauc_map_at_5_std\": 0.013442348773576428,\n        \"nauc_mrr_at_1000_diff1\": 0.6395355878729584,\n        \"nauc_mrr_at_1000_max\": 0.365187460643138,\n        \"nauc_mrr_at_1000_std\": 0.01970574265860572,\n        \"nauc_mrr_at_100_diff1\": 0.6391681401299727,\n        \"nauc_mrr_at_100_max\": 0.3650387442985491,\n        \"nauc_mrr_at_100_std\": 0.01867822705611146,\n        \"nauc_mrr_at_10_diff1\": 0.6434385016870486,\n        \"nauc_mrr_at_10_max\": 0.368285928478509,\n        \"nauc_mrr_at_10_std\": 0.020151886079335497,\n        \"nauc_mrr_at_1_diff1\": 0.71360187278011,\n        \"nauc_mrr_at_1_max\": 0.37068937681627384,\n        \"nauc_mrr_at_1_std\": -0.027615434291249602,\n        \"nauc_mrr_at_20_diff1\": 0.6418435602302738,\n        \"nauc_mrr_at_20_max\": 0.3665716207617676,\n        \"nauc_mrr_at_20_std\": 0.018595393472855243,\n        \"nauc_mrr_at_3_diff1\": 0.6594812851695392,\n        \"nauc_mrr_at_3_max\": 0.36501267080996064,\n        \"nauc_mrr_at_3_std\": 0.0028860938964413215,\n        \"nauc_mrr_at_5_diff1\": 0.6504570573581048,\n        \"nauc_mrr_at_5_max\": 0.3660302571596071,\n        \"nauc_mrr_at_5_std\": 0.013442348773576428,\n        \"nauc_ndcg_at_1000_diff1\": 0.596417643300829,\n        \"nauc_ndcg_at_1000_max\": 0.3518020144512341,\n        \"nauc_ndcg_at_1000_std\": 0.06391223751601617,\n        \"nauc_ndcg_at_100_diff1\": 0.5881156440243976,\n        \"nauc_ndcg_at_100_max\": 0.355639229989986,\n        \"nauc_ndcg_at_100_std\": 0.04401917229409399,\n        \"nauc_ndcg_at_10_diff1\": 0.6092903909063339,\n        \"nauc_ndcg_at_10_max\": 0.36768272278214337,\n        \"nauc_ndcg_at_10_std\": 0.043181167699574335,\n        \"nauc_ndcg_at_1_diff1\": 0.71360187278011,\n        \"nauc_ndcg_at_1_max\": 0.37068937681627384,\n        \"nauc_ndcg_at_1_std\": -0.027615434291249602,\n        \"nauc_ndcg_at_20_diff1\": 0.6044725907955486,\n        \"nauc_ndcg_at_20_max\": 0.3619261402136727,\n        \"nauc_ndcg_at_20_std\": 0.03685933589523102,\n        \"nauc_ndcg_at_3_diff1\": 0.6389221482842374,\n        \"nauc_ndcg_at_3_max\": 0.3596097338870786,\n        \"nauc_ndcg_at_3_std\": 0.010131471633429949,\n        \"nauc_ndcg_at_5_diff1\": 0.6241080600798613,\n        \"nauc_ndcg_at_5_max\": 0.36139735015946556,\n        \"nauc_ndcg_at_5_std\": 0.02771549327543668,\n        \"nauc_precision_at_1000_diff1\": 0.40370096225018537,\n        \"nauc_precision_at_1000_max\": 0.23549507487331303,\n        \"nauc_precision_at_1000_std\": 0.3946820019358882,\n        \"nauc_precision_at_100_diff1\": 0.42064133112556024,\n        \"nauc_precision_at_100_max\": 0.32471090289837545,\n        \"nauc_precision_at_100_std\": 0.132641384973682,\n        \"nauc_precision_at_10_diff1\": 0.5151898566469701,\n        \"nauc_precision_at_10_max\": 0.3685179787487747,\n        \"nauc_precision_at_10_std\": 0.10883966188823242,\n        \"nauc_precision_at_1_diff1\": 0.71360187278011,\n        \"nauc_precision_at_1_max\": 0.37068937681627384,\n        \"nauc_precision_at_1_std\": -0.027615434291249602,\n        \"nauc_precision_at_20_diff1\": 0.5002558652180761,\n        \"nauc_precision_at_20_max\": 0.348403138613342,\n        \"nauc_precision_at_20_std\": 0.08404188316800501,\n        \"nauc_precision_at_3_diff1\": 0.5827769707804907,\n        \"nauc_precision_at_3_max\": 0.3441183865020392,\n        \"nauc_precision_at_3_std\": 0.028933180624616014,\n        \"nauc_precision_at_5_diff1\": 0.5527631401162005,\n        \"nauc_precision_at_5_max\": 0.3484664234562899,\n        \"nauc_precision_at_5_std\": 0.06611944331847057,\n        \"nauc_recall_at_1000_diff1\": 0.403700962250185,\n        \"nauc_recall_at_1000_max\": 0.23549507487331284,\n        \"nauc_recall_at_1000_std\": 0.3946820019358879,\n        \"nauc_recall_at_100_diff1\": 0.42064133112556035,\n        \"nauc_recall_at_100_max\": 0.3247109028983749,\n        \"nauc_recall_at_100_std\": 0.1326413849736817,\n        \"nauc_recall_at_10_diff1\": 0.5151898566469698,\n        \"nauc_recall_at_10_max\": 0.36851797874877423,\n        \"nauc_recall_at_10_std\": 0.10883966188823224,\n        \"nauc_recall_at_1_diff1\": 0.71360187278011,\n        \"nauc_recall_at_1_max\": 0.37068937681627384,\n        \"nauc_recall_at_1_std\": -0.027615434291249602,\n        \"nauc_recall_at_20_diff1\": 0.5002558652180759,\n        \"nauc_recall_at_20_max\": 0.3484031386133417,\n        \"nauc_recall_at_20_std\": 0.08404188316800514,\n        \"nauc_recall_at_3_diff1\": 0.5827769707804905,\n        \"nauc_recall_at_3_max\": 0.3441183865020391,\n        \"nauc_recall_at_3_std\": 0.028933180624615876,\n        \"nauc_recall_at_5_diff1\": 0.5527631401162005,\n        \"nauc_recall_at_5_max\": 0.34846642345628953,\n        \"nauc_recall_at_5_std\": 0.06611944331847029,\n        \"ndcg_at_1\": 0.2,\n        \"ndcg_at_10\": 0.26801,\n        \"ndcg_at_100\": 0.30033,\n        \"ndcg_at_1000\": 0.3334,\n        \"ndcg_at_20\": 0.27302,\n        \"ndcg_at_3\": 0.24589,\n        \"ndcg_at_5\": 0.25451,\n        \"precision_at_1\": 0.2,\n        \"precision_at_10\": 0.034,\n        \"precision_at_100\": 0.0051,\n        \"precision_at_1000\": 0.00078,\n        \"precision_at_20\": 0.018,\n        \"precision_at_3\": 0.09333,\n        \"precision_at_5\": 0.06,\n        \"recall_at_1\": 0.2,\n        \"recall_at_10\": 0.34,\n        \"recall_at_100\": 0.51,\n        \"recall_at_1000\": 0.775,\n        \"recall_at_20\": 0.36,\n        \"recall_at_3\": 0.28,\n        \"recall_at_5\": 0.3\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/Salesforce/SFR-Embedding-2_R/Salesforce__SFR-Embedding-2_R/91762139d94ed4371a9fa31db5551272e0b83818/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 88.03694748878479,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.8605,\n        \"map_at_1\": 0.72727,\n        \"map_at_10\": 0.82287,\n        \"map_at_100\": 0.8246,\n        \"map_at_1000\": 0.8246,\n        \"map_at_20\": 0.8246,\n        \"map_at_3\": 0.80952,\n        \"map_at_5\": 0.81926,\n        \"mrr_at_1\": 0.7272727272727273,\n        \"mrr_at_10\": 0.8228715728715729,\n        \"mrr_at_100\": 0.8246031746031747,\n        \"mrr_at_1000\": 0.8246031746031747,\n        \"mrr_at_20\": 0.8246031746031747,\n        \"mrr_at_3\": 0.8095238095238095,\n        \"mrr_at_5\": 0.8192640692640693,\n        \"nauc_map_at_1000_diff1\": 0.5941123198806364,\n        \"nauc_map_at_1000_max\": 0.35774172874077775,\n        \"nauc_map_at_1000_std\": -0.03559328712720151,\n        \"nauc_map_at_100_diff1\": 0.5941123198806364,\n        \"nauc_map_at_100_max\": 0.35774172874077775,\n        \"nauc_map_at_100_std\": -0.03559328712720151,\n        \"nauc_map_at_10_diff1\": 0.5963003758717501,\n        \"nauc_map_at_10_max\": 0.36400168489193485,\n        \"nauc_map_at_10_std\": -0.032820874591175796,\n        \"nauc_map_at_1_diff1\": 0.6291397163278336,\n        \"nauc_map_at_1_max\": 0.3512047101861982,\n        \"nauc_map_at_1_std\": -0.02760603176568628,\n        \"nauc_map_at_20_diff1\": 0.5941123198806364,\n        \"nauc_map_at_20_max\": 0.35774172874077775,\n        \"nauc_map_at_20_std\": -0.03559328712720151,\n        \"nauc_map_at_3_diff1\": 0.5683248864352117,\n        \"nauc_map_at_3_max\": 0.3613617400875627,\n        \"nauc_map_at_3_std\": -0.035344875398458854,\n        \"nauc_map_at_5_diff1\": 0.5753457266413127,\n        \"nauc_map_at_5_max\": 0.35922690099588295,\n        \"nauc_map_at_5_std\": -0.030867869425378183,\n        \"nauc_mrr_at_1000_diff1\": 0.5941123198806364,\n        \"nauc_mrr_at_1000_max\": 0.35774172874077775,\n        \"nauc_mrr_at_1000_std\": -0.03559328712720151,\n        \"nauc_mrr_at_100_diff1\": 0.5941123198806364,\n        \"nauc_mrr_at_100_max\": 0.35774172874077775,\n        \"nauc_mrr_at_100_std\": -0.03559328712720151,\n        \"nauc_mrr_at_10_diff1\": 0.5963003758717501,\n        \"nauc_mrr_at_10_max\": 0.36400168489193485,\n        \"nauc_mrr_at_10_std\": -0.032820874591175796,\n        \"nauc_mrr_at_1_diff1\": 0.6291397163278336,\n        \"nauc_mrr_at_1_max\": 0.3512047101861982,\n        \"nauc_mrr_at_1_std\": -0.02760603176568628,\n        \"nauc_mrr_at_20_diff1\": 0.5941123198806364,\n        \"nauc_mrr_at_20_max\": 0.35774172874077775,\n        \"nauc_mrr_at_20_std\": -0.03559328712720151,\n        \"nauc_mrr_at_3_diff1\": 0.5683248864352117,\n        \"nauc_mrr_at_3_max\": 0.3613617400875627,\n        \"nauc_mrr_at_3_std\": -0.035344875398458854,\n        \"nauc_mrr_at_5_diff1\": 0.5753457266413127,\n        \"nauc_mrr_at_5_max\": 0.35922690099588295,\n        \"nauc_mrr_at_5_std\": -0.030867869425378183,\n        \"nauc_ndcg_at_1000_diff1\": 0.5923204922760418,\n        \"nauc_ndcg_at_1000_max\": 0.3617737751423526,\n        \"nauc_ndcg_at_1000_std\": -0.035546633374422584,\n        \"nauc_ndcg_at_100_diff1\": 0.5923204922760418,\n        \"nauc_ndcg_at_100_max\": 0.3617737751423526,\n        \"nauc_ndcg_at_100_std\": -0.035546633374422584,\n        \"nauc_ndcg_at_10_diff1\": 0.6027625914595975,\n        \"nauc_ndcg_at_10_max\": 0.3911779598535934,\n        \"nauc_ndcg_at_10_std\": -0.02243478615895175,\n        \"nauc_ndcg_at_1_diff1\": 0.6291397163278336,\n        \"nauc_ndcg_at_1_max\": 0.3512047101861982,\n        \"nauc_ndcg_at_1_std\": -0.02760603176568628,\n        \"nauc_ndcg_at_20_diff1\": 0.5923204922760418,\n        \"nauc_ndcg_at_20_max\": 0.3617737751423526,\n        \"nauc_ndcg_at_20_std\": -0.035546633374422584,\n        \"nauc_ndcg_at_3_diff1\": 0.5389406858000926,\n        \"nauc_ndcg_at_3_max\": 0.3764518408506499,\n        \"nauc_ndcg_at_3_std\": -0.034403886138833065,\n        \"nauc_ndcg_at_5_diff1\": 0.5499029401176652,\n        \"nauc_ndcg_at_5_max\": 0.3738836785483251,\n        \"nauc_ndcg_at_5_std\": -0.024967315629729113,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.7956576740092968,\n        \"nauc_precision_at_10_max\": 0.9343563512361485,\n        \"nauc_precision_at_10_std\": 0.21977808756952869,\n        \"nauc_precision_at_1_diff1\": 0.6291397163278336,\n        \"nauc_precision_at_1_max\": 0.3512047101861982,\n        \"nauc_precision_at_1_std\": -0.02760603176568628,\n        \"nauc_precision_at_20_diff1\": 1.0,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 1.0,\n        \"nauc_precision_at_3_diff1\": 0.37827560700261104,\n        \"nauc_precision_at_3_max\": 0.46448289340790067,\n        \"nauc_precision_at_3_std\": -0.02672054880618261,\n        \"nauc_precision_at_5_diff1\": 0.3239156642506275,\n        \"nauc_precision_at_5_max\": 0.5150116195409513,\n        \"nauc_precision_at_5_std\": 0.03597587103073941,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.7956576740092982,\n        \"nauc_recall_at_10_max\": 0.9343563512361502,\n        \"nauc_recall_at_10_std\": 0.21977808756952488,\n        \"nauc_recall_at_1_diff1\": 0.6291397163278336,\n        \"nauc_recall_at_1_max\": 0.3512047101861982,\n        \"nauc_recall_at_1_std\": -0.02760603176568628,\n        \"nauc_recall_at_20_diff1\": NaN,\n        \"nauc_recall_at_20_max\": NaN,\n        \"nauc_recall_at_20_std\": NaN,\n        \"nauc_recall_at_3_diff1\": 0.37827560700261204,\n        \"nauc_recall_at_3_max\": 0.4644828934079003,\n        \"nauc_recall_at_3_std\": -0.026720548806184068,\n        \"nauc_recall_at_5_diff1\": 0.3239156642506218,\n        \"nauc_recall_at_5_max\": 0.5150116195409485,\n        \"nauc_recall_at_5_std\": 0.035975871030735844,\n        \"ndcg_at_1\": 0.72727,\n        \"ndcg_at_10\": 0.8605,\n        \"ndcg_at_100\": 0.86699,\n        \"ndcg_at_1000\": 0.86699,\n        \"ndcg_at_20\": 0.86699,\n        \"ndcg_at_3\": 0.83519,\n        \"ndcg_at_5\": 0.85197,\n        \"precision_at_1\": 0.72727,\n        \"precision_at_10\": 0.0974,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.05,\n        \"precision_at_3\": 0.30303,\n        \"precision_at_5\": 0.18961,\n        \"recall_at_1\": 0.72727,\n        \"recall_at_10\": 0.97403,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 1.0,\n        \"recall_at_3\": 0.90909,\n        \"recall_at_5\": 0.94805\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/Salesforce/SFR-Embedding-2_R/Salesforce__SFR-Embedding-2_R/91762139d94ed4371a9fa31db5551272e0b83818/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 1152.1036405563354,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.37371,\n        \"map_at_1\": 0.19952,\n        \"map_at_10\": 0.32266,\n        \"map_at_100\": 0.33694,\n        \"map_at_1000\": 0.33813,\n        \"map_at_20\": 0.32958,\n        \"map_at_3\": 0.28349,\n        \"map_at_5\": 0.30785,\n        \"mrr_at_1\": 0.2874617737003058,\n        \"mrr_at_10\": 0.3625163826998689,\n        \"mrr_at_100\": 0.37359128430577954,\n        \"mrr_at_1000\": 0.374369843992097,\n        \"mrr_at_20\": 0.3680337539140476,\n        \"mrr_at_3\": 0.33970438328236496,\n        \"mrr_at_5\": 0.35201325178389403,\n        \"nauc_map_at_1000_diff1\": 0.46444161025916086,\n        \"nauc_map_at_1000_max\": 0.11479500611039435,\n        \"nauc_map_at_1000_std\": -0.3216946254853604,\n        \"nauc_map_at_100_diff1\": 0.463898231197359,\n        \"nauc_map_at_100_max\": 0.11521867987574255,\n        \"nauc_map_at_100_std\": -0.3209755901041567,\n        \"nauc_map_at_10_diff1\": 0.465059961833811,\n        \"nauc_map_at_10_max\": 0.10964692960708387,\n        \"nauc_map_at_10_std\": -0.328964243519146,\n        \"nauc_map_at_1_diff1\": 0.5503972615133271,\n        \"nauc_map_at_1_max\": 0.12588443767003374,\n        \"nauc_map_at_1_std\": -0.2873373787737232,\n        \"nauc_map_at_20_diff1\": 0.4642576023527398,\n        \"nauc_map_at_20_max\": 0.11061400990262676,\n        \"nauc_map_at_20_std\": -0.32767134556537214,\n        \"nauc_map_at_3_diff1\": 0.4709000192756455,\n        \"nauc_map_at_3_max\": 0.10338449035860794,\n        \"nauc_map_at_3_std\": -0.3169434722464316,\n        \"nauc_map_at_5_diff1\": 0.46616412893115433,\n        \"nauc_map_at_5_max\": 0.1070088513295947,\n        \"nauc_map_at_5_std\": -0.3277349614494219,\n        \"nauc_mrr_at_1000_diff1\": 0.49517760407182454,\n        \"nauc_mrr_at_1000_max\": 0.1153835361655304,\n        \"nauc_mrr_at_1000_std\": -0.3329689521993201,\n        \"nauc_mrr_at_100_diff1\": 0.49500566200526813,\n        \"nauc_mrr_at_100_max\": 0.11591775127846696,\n        \"nauc_mrr_at_100_std\": -0.332225635828467,\n        \"nauc_mrr_at_10_diff1\": 0.49450832626240365,\n        \"nauc_mrr_at_10_max\": 0.11125497198889121,\n        \"nauc_mrr_at_10_std\": -0.33913630107640047,\n        \"nauc_mrr_at_1_diff1\": 0.5295829906140828,\n        \"nauc_mrr_at_1_max\": 0.13620875839895372,\n        \"nauc_mrr_at_1_std\": -0.33037302783647077,\n        \"nauc_mrr_at_20_diff1\": 0.4945475348958433,\n        \"nauc_mrr_at_20_max\": 0.11251481135013906,\n        \"nauc_mrr_at_20_std\": -0.33668887785018126,\n        \"nauc_mrr_at_3_diff1\": 0.4938308341804614,\n        \"nauc_mrr_at_3_max\": 0.10149320444858013,\n        \"nauc_mrr_at_3_std\": -0.3434660134069083,\n        \"nauc_mrr_at_5_diff1\": 0.4959445813904095,\n        \"nauc_mrr_at_5_max\": 0.1084496199527392,\n        \"nauc_mrr_at_5_std\": -0.34103297689719125,\n        \"nauc_ndcg_at_1000_diff1\": 0.46716230134313386,\n        \"nauc_ndcg_at_1000_max\": 0.12359694790565268,\n        \"nauc_ndcg_at_1000_std\": -0.31023924119027163,\n        \"nauc_ndcg_at_100_diff1\": 0.4580749898944042,\n        \"nauc_ndcg_at_100_max\": 0.13924706891695451,\n        \"nauc_ndcg_at_100_std\": -0.28398539584435967,\n        \"nauc_ndcg_at_10_diff1\": 0.45886164732099666,\n        \"nauc_ndcg_at_10_max\": 0.10344883823068486,\n        \"nauc_ndcg_at_10_std\": -0.3368211415891488,\n        \"nauc_ndcg_at_1_diff1\": 0.5295829906140828,\n        \"nauc_ndcg_at_1_max\": 0.13679889247116944,\n        \"nauc_ndcg_at_1_std\": -0.3311319557153684,\n        \"nauc_ndcg_at_20_diff1\": 0.4575048476371181,\n        \"nauc_ndcg_at_20_max\": 0.10615074399619397,\n        \"nauc_ndcg_at_20_std\": -0.3309719655646826,\n        \"nauc_ndcg_at_3_diff1\": 0.46054804670971383,\n        \"nauc_ndcg_at_3_max\": 0.08595210158045091,\n        \"nauc_ndcg_at_3_std\": -0.33183538771567966,\n        \"nauc_ndcg_at_5_diff1\": 0.4606539526586548,\n        \"nauc_ndcg_at_5_max\": 0.09754113254472742,\n        \"nauc_ndcg_at_5_std\": -0.3363424955563504,\n        \"nauc_precision_at_1000_diff1\": 0.03322933106078146,\n        \"nauc_precision_at_1000_max\": 0.09535375289890795,\n        \"nauc_precision_at_1000_std\": -0.009488197248939465,\n        \"nauc_precision_at_100_diff1\": 0.11137500357644262,\n        \"nauc_precision_at_100_max\": 0.17571371775911468,\n        \"nauc_precision_at_100_std\": 0.003886182907374527,\n        \"nauc_precision_at_10_diff1\": 0.25578011735014483,\n        \"nauc_precision_at_10_max\": 0.07875443323051794,\n        \"nauc_precision_at_10_std\": -0.2900464680421701,\n        \"nauc_precision_at_1_diff1\": 0.5295829906140828,\n        \"nauc_precision_at_1_max\": 0.13679889247116944,\n        \"nauc_precision_at_1_std\": -0.3311319557153684,\n        \"nauc_precision_at_20_diff1\": 0.21803247757837754,\n        \"nauc_precision_at_20_max\": 0.08011191417088347,\n        \"nauc_precision_at_20_std\": -0.24641000603213958,\n        \"nauc_precision_at_3_diff1\": 0.3125591042971302,\n        \"nauc_precision_at_3_max\": 0.07252243412420498,\n        \"nauc_precision_at_3_std\": -0.3164760884209657,\n        \"nauc_precision_at_5_diff1\": 0.2807649152793834,\n        \"nauc_precision_at_5_max\": 0.07724142885277911,\n        \"nauc_precision_at_5_std\": -0.30443002296468685,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.3572248383150459,\n        \"nauc_recall_at_100_max\": 0.31061429813565594,\n        \"nauc_recall_at_100_std\": 0.036335209156296955,\n        \"nauc_recall_at_10_diff1\": 0.3964961266050805,\n        \"nauc_recall_at_10_max\": 0.08171629769667459,\n        \"nauc_recall_at_10_std\": -0.3314459840071667,\n        \"nauc_recall_at_1_diff1\": 0.5503972615133271,\n        \"nauc_recall_at_1_max\": 0.12588443767003374,\n        \"nauc_recall_at_1_std\": -0.2873373787737232,\n        \"nauc_recall_at_20_diff1\": 0.38809851857446975,\n        \"nauc_recall_at_20_max\": 0.08606656648272232,\n        \"nauc_recall_at_20_std\": -0.31075764840972503,\n        \"nauc_recall_at_3_diff1\": 0.40850208475343025,\n        \"nauc_recall_at_3_max\": 0.04933418986196694,\n        \"nauc_recall_at_3_std\": -0.3198688670871101,\n        \"nauc_recall_at_5_diff1\": 0.4034460899480087,\n        \"nauc_recall_at_5_max\": 0.0674036916753514,\n        \"nauc_recall_at_5_std\": -0.3329769217802357,\n        \"ndcg_at_1\": 0.28746,\n        \"ndcg_at_10\": 0.37371,\n        \"ndcg_at_100\": 0.44235,\n        \"ndcg_at_1000\": 0.47117,\n        \"ndcg_at_20\": 0.39627,\n        \"ndcg_at_3\": 0.31517,\n        \"ndcg_at_5\": 0.34389,\n        \"precision_at_1\": 0.28746,\n        \"precision_at_10\": 0.07783,\n        \"precision_at_100\": 0.01263,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.04518,\n        \"precision_at_3\": 0.17737,\n        \"precision_at_5\": 0.13089,\n        \"recall_at_1\": 0.19952,\n        \"recall_at_10\": 0.48591,\n        \"recall_at_100\": 0.78682,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.56636,\n        \"recall_at_3\": 0.33629,\n        \"recall_at_5\": 0.4039\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.33915,\n        \"map_at_1\": 0.16577,\n        \"map_at_10\": 0.28601,\n        \"map_at_100\": 0.30486,\n        \"map_at_1000\": 0.30666,\n        \"map_at_20\": 0.29596,\n        \"map_at_3\": 0.2399,\n        \"map_at_5\": 0.26884,\n        \"mrr_at_1\": 0.28287461773700306,\n        \"mrr_at_10\": 0.3462168098635987,\n        \"mrr_at_100\": 0.3574002013497723,\n        \"mrr_at_1000\": 0.3582673706739296,\n        \"mrr_at_20\": 0.3520306843415528,\n        \"mrr_at_3\": 0.3182976554536189,\n        \"mrr_at_5\": 0.3339704383282365,\n        \"nauc_map_at_1000_diff1\": 0.44862829866771636,\n        \"nauc_map_at_1000_max\": 0.1868603331777558,\n        \"nauc_map_at_1000_std\": -0.23781028742308002,\n        \"nauc_map_at_100_diff1\": 0.44856887266249545,\n        \"nauc_map_at_100_max\": 0.18565202232669537,\n        \"nauc_map_at_100_std\": -0.23914927193885566,\n        \"nauc_map_at_10_diff1\": 0.4483312252840105,\n        \"nauc_map_at_10_max\": 0.18399006610554597,\n        \"nauc_map_at_10_std\": -0.2452129696015986,\n        \"nauc_map_at_1_diff1\": 0.46695496227991584,\n        \"nauc_map_at_1_max\": 0.16305370574266562,\n        \"nauc_map_at_1_std\": -0.19783370337577047,\n        \"nauc_map_at_20_diff1\": 0.4504350704238741,\n        \"nauc_map_at_20_max\": 0.18555170887364925,\n        \"nauc_map_at_20_std\": -0.24063964918946817,\n        \"nauc_map_at_3_diff1\": 0.4637167195369921,\n        \"nauc_map_at_3_max\": 0.1896462231219421,\n        \"nauc_map_at_3_std\": -0.22896228336804447,\n        \"nauc_map_at_5_diff1\": 0.4492227924871043,\n        \"nauc_map_at_5_max\": 0.19086660193436616,\n        \"nauc_map_at_5_std\": -0.23324770099359846,\n        \"nauc_mrr_at_1000_diff1\": 0.4459226568485144,\n        \"nauc_mrr_at_1000_max\": 0.1765025673789009,\n        \"nauc_mrr_at_1000_std\": -0.23262559415731116,\n        \"nauc_mrr_at_100_diff1\": 0.4456985604313047,\n        \"nauc_mrr_at_100_max\": 0.17637479623488186,\n        \"nauc_mrr_at_100_std\": -0.23251985996765268,\n        \"nauc_mrr_at_10_diff1\": 0.44818247963403246,\n        \"nauc_mrr_at_10_max\": 0.17653252362901384,\n        \"nauc_mrr_at_10_std\": -0.23664740354352845,\n        \"nauc_mrr_at_1_diff1\": 0.4636896954638108,\n        \"nauc_mrr_at_1_max\": 0.1890309030431272,\n        \"nauc_mrr_at_1_std\": -0.2346242988878434,\n        \"nauc_mrr_at_20_diff1\": 0.4469219811962643,\n        \"nauc_mrr_at_20_max\": 0.17637699958853023,\n        \"nauc_mrr_at_20_std\": -0.234594750073801,\n        \"nauc_mrr_at_3_diff1\": 0.4528198397450242,\n        \"nauc_mrr_at_3_max\": 0.17955788910333872,\n        \"nauc_mrr_at_3_std\": -0.2376516051597019,\n        \"nauc_mrr_at_5_diff1\": 0.4469627642330273,\n        \"nauc_mrr_at_5_max\": 0.17643403796964313,\n        \"nauc_mrr_at_5_std\": -0.23283768470458424,\n        \"nauc_ndcg_at_1000_diff1\": 0.43900411557115737,\n        \"nauc_ndcg_at_1000_max\": 0.18754236588293277,\n        \"nauc_ndcg_at_1000_std\": -0.22172936526380338,\n        \"nauc_ndcg_at_100_diff1\": 0.43210131283241693,\n        \"nauc_ndcg_at_100_max\": 0.18109760715434928,\n        \"nauc_ndcg_at_100_std\": -0.2222934180499701,\n        \"nauc_ndcg_at_10_diff1\": 0.4390335763848873,\n        \"nauc_ndcg_at_10_max\": 0.17364612679841726,\n        \"nauc_ndcg_at_10_std\": -0.251637150473817,\n        \"nauc_ndcg_at_1_diff1\": 0.4636896954638108,\n        \"nauc_ndcg_at_1_max\": 0.1890309030431272,\n        \"nauc_ndcg_at_1_std\": -0.2346242988878434,\n        \"nauc_ndcg_at_20_diff1\": 0.4422382375961862,\n        \"nauc_ndcg_at_20_max\": 0.1755348159868798,\n        \"nauc_ndcg_at_20_std\": -0.24038299245542574,\n        \"nauc_ndcg_at_3_diff1\": 0.4514476241956719,\n        \"nauc_ndcg_at_3_max\": 0.18778870526053468,\n        \"nauc_ndcg_at_3_std\": -0.23870201989358064,\n        \"nauc_ndcg_at_5_diff1\": 0.4389203557523558,\n        \"nauc_ndcg_at_5_max\": 0.18209283565176848,\n        \"nauc_ndcg_at_5_std\": -0.23223058959521303,\n        \"nauc_precision_at_1000_diff1\": 0.04417038855005799,\n        \"nauc_precision_at_1000_max\": 0.10874882232618706,\n        \"nauc_precision_at_1000_std\": 0.02128219191979829,\n        \"nauc_precision_at_100_diff1\": 0.13318298530387523,\n        \"nauc_precision_at_100_max\": 0.12181532190768891,\n        \"nauc_precision_at_100_std\": -0.05883785462110636,\n        \"nauc_precision_at_10_diff1\": 0.2900814849077367,\n        \"nauc_precision_at_10_max\": 0.14374772391820556,\n        \"nauc_precision_at_10_std\": -0.2173607505039916,\n        \"nauc_precision_at_1_diff1\": 0.4636896954638108,\n        \"nauc_precision_at_1_max\": 0.1890309030431272,\n        \"nauc_precision_at_1_std\": -0.2346242988878434,\n        \"nauc_precision_at_20_diff1\": 0.25999307679332195,\n        \"nauc_precision_at_20_max\": 0.1320926866538145,\n        \"nauc_precision_at_20_std\": -0.16959662283088012,\n        \"nauc_precision_at_3_diff1\": 0.360015785987485,\n        \"nauc_precision_at_3_max\": 0.18115538783997318,\n        \"nauc_precision_at_3_std\": -0.23114999628155805,\n        \"nauc_precision_at_5_diff1\": 0.30225219967341,\n        \"nauc_precision_at_5_max\": 0.17107969445680038,\n        \"nauc_precision_at_5_std\": -0.20493189135850728,\n        \"nauc_recall_at_1000_diff1\": 0.39868921582836264,\n        \"nauc_recall_at_1000_max\": 0.24677421562564303,\n        \"nauc_recall_at_1000_std\": 0.17281627161748658,\n        \"nauc_recall_at_100_diff1\": 0.3148361772259049,\n        \"nauc_recall_at_100_max\": 0.15649635658167008,\n        \"nauc_recall_at_100_std\": -0.11398241040093268,\n        \"nauc_recall_at_10_diff1\": 0.38493841481355845,\n        \"nauc_recall_at_10_max\": 0.13860452389296737,\n        \"nauc_recall_at_10_std\": -0.26599323894928106,\n        \"nauc_recall_at_1_diff1\": 0.46695496227991584,\n        \"nauc_recall_at_1_max\": 0.16305370574266562,\n        \"nauc_recall_at_1_std\": -0.19783370337577047,\n        \"nauc_recall_at_20_diff1\": 0.39277190728666644,\n        \"nauc_recall_at_20_max\": 0.14008993824278584,\n        \"nauc_recall_at_20_std\": -0.23145921727069257,\n        \"nauc_recall_at_3_diff1\": 0.42519191661800404,\n        \"nauc_recall_at_3_max\": 0.16819962699311578,\n        \"nauc_recall_at_3_std\": -0.2195755842172038,\n        \"nauc_recall_at_5_diff1\": 0.39154306459667243,\n        \"nauc_recall_at_5_max\": 0.15958991890486823,\n        \"nauc_recall_at_5_std\": -0.21857793250510632,\n        \"ndcg_at_1\": 0.28287,\n        \"ndcg_at_10\": 0.33915,\n        \"ndcg_at_100\": 0.42095,\n        \"ndcg_at_1000\": 0.45354,\n        \"ndcg_at_20\": 0.36748,\n        \"ndcg_at_3\": 0.28262,\n        \"ndcg_at_5\": 0.30601,\n        \"precision_at_1\": 0.28287,\n        \"precision_at_10\": 0.08869,\n        \"precision_at_100\": 0.0158,\n        \"precision_at_1000\": 0.00194,\n        \"precision_at_20\": 0.05466,\n        \"precision_at_3\": 0.18196,\n        \"precision_at_5\": 0.1422,\n        \"recall_at_1\": 0.16577,\n        \"recall_at_10\": 0.43175,\n        \"recall_at_100\": 0.77097,\n        \"recall_at_1000\": 0.99401,\n        \"recall_at_20\": 0.52212,\n        \"recall_at_3\": 0.27273,\n        \"recall_at_5\": 0.34722\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.28069,\n        \"map_at_1\": 0.14384,\n        \"map_at_10\": 0.23206,\n        \"map_at_100\": 0.24851,\n        \"map_at_1000\": 0.25019,\n        \"map_at_20\": 0.23928,\n        \"map_at_3\": 0.20174,\n        \"map_at_5\": 0.2198,\n        \"mrr_at_1\": 0.21009771986970685,\n        \"mrr_at_10\": 0.27868323768160896,\n        \"mrr_at_100\": 0.2914729717303233,\n        \"mrr_at_1000\": 0.2923742227125538,\n        \"mrr_at_20\": 0.28498404529839516,\n        \"mrr_at_3\": 0.25352877307274707,\n        \"mrr_at_5\": 0.2673724212812161,\n        \"nauc_map_at_1000_diff1\": 0.39411401350349234,\n        \"nauc_map_at_1000_max\": 0.08315202055240034,\n        \"nauc_map_at_1000_std\": -0.22334318940963396,\n        \"nauc_map_at_100_diff1\": 0.393133941537155,\n        \"nauc_map_at_100_max\": 0.08372750234188758,\n        \"nauc_map_at_100_std\": -0.22244595787765817,\n        \"nauc_map_at_10_diff1\": 0.3976104145328913,\n        \"nauc_map_at_10_max\": 0.07667757593928304,\n        \"nauc_map_at_10_std\": -0.23342235584850604,\n        \"nauc_map_at_1_diff1\": 0.47888230868159154,\n        \"nauc_map_at_1_max\": 0.08149092947082825,\n        \"nauc_map_at_1_std\": -0.22164586926600838,\n        \"nauc_map_at_20_diff1\": 0.39513065855474855,\n        \"nauc_map_at_20_max\": 0.07578819036347148,\n        \"nauc_map_at_20_std\": -0.2318293043634674,\n        \"nauc_map_at_3_diff1\": 0.42534192375380364,\n        \"nauc_map_at_3_max\": 0.08278700283177769,\n        \"nauc_map_at_3_std\": -0.23392898253230987,\n        \"nauc_map_at_5_diff1\": 0.40496545896359537,\n        \"nauc_map_at_5_max\": 0.07263646886510684,\n        \"nauc_map_at_5_std\": -0.23755355346647417,\n        \"nauc_mrr_at_1000_diff1\": 0.4273326414300659,\n        \"nauc_mrr_at_1000_max\": 0.08947214016925248,\n        \"nauc_mrr_at_1000_std\": -0.21867801746554558,\n        \"nauc_mrr_at_100_diff1\": 0.42672783101627787,\n        \"nauc_mrr_at_100_max\": 0.0901414497970279,\n        \"nauc_mrr_at_100_std\": -0.2175503484566645,\n        \"nauc_mrr_at_10_diff1\": 0.42930279656854725,\n        \"nauc_mrr_at_10_max\": 0.08580892409809703,\n        \"nauc_mrr_at_10_std\": -0.22414605867606796,\n        \"nauc_mrr_at_1_diff1\": 0.49296925922109,\n        \"nauc_mrr_at_1_max\": 0.11114904317803229,\n        \"nauc_mrr_at_1_std\": -0.21667452405028526,\n        \"nauc_mrr_at_20_diff1\": 0.42702370102541154,\n        \"nauc_mrr_at_20_max\": 0.08583226911350729,\n        \"nauc_mrr_at_20_std\": -0.22200466434556937,\n        \"nauc_mrr_at_3_diff1\": 0.44693342638609657,\n        \"nauc_mrr_at_3_max\": 0.0852618594155734,\n        \"nauc_mrr_at_3_std\": -0.23280930677054384,\n        \"nauc_mrr_at_5_diff1\": 0.43273716355120434,\n        \"nauc_mrr_at_5_max\": 0.07705694781033827,\n        \"nauc_mrr_at_5_std\": -0.23231080115177496,\n        \"nauc_ndcg_at_1000_diff1\": 0.3821434066787995,\n        \"nauc_ndcg_at_1000_max\": 0.09852208182245302,\n        \"nauc_ndcg_at_1000_std\": -0.19780269601157274,\n        \"nauc_ndcg_at_100_diff1\": 0.35653592795330313,\n        \"nauc_ndcg_at_100_max\": 0.12016785115478233,\n        \"nauc_ndcg_at_100_std\": -0.16381893284621826,\n        \"nauc_ndcg_at_10_diff1\": 0.3765727975354946,\n        \"nauc_ndcg_at_10_max\": 0.07103763683123743,\n        \"nauc_ndcg_at_10_std\": -0.2341567169326087,\n        \"nauc_ndcg_at_1_diff1\": 0.5000490731839153,\n        \"nauc_ndcg_at_1_max\": 0.11703668167822963,\n        \"nauc_ndcg_at_1_std\": -0.21253420128790015,\n        \"nauc_ndcg_at_20_diff1\": 0.36662533490475036,\n        \"nauc_ndcg_at_20_max\": 0.0713928514487197,\n        \"nauc_ndcg_at_20_std\": -0.2252942135515429,\n        \"nauc_ndcg_at_3_diff1\": 0.42431414758585906,\n        \"nauc_ndcg_at_3_max\": 0.07704900688736101,\n        \"nauc_ndcg_at_3_std\": -0.2418866569683114,\n        \"nauc_ndcg_at_5_diff1\": 0.3894177391749591,\n        \"nauc_ndcg_at_5_max\": 0.059484874082167453,\n        \"nauc_ndcg_at_5_std\": -0.24445288527546188,\n        \"nauc_precision_at_1000_diff1\": 0.06255244128398815,\n        \"nauc_precision_at_1000_max\": 0.141142616095593,\n        \"nauc_precision_at_1000_std\": 0.14429878851751324,\n        \"nauc_precision_at_100_diff1\": 0.08697360897084735,\n        \"nauc_precision_at_100_max\": 0.25610915785057037,\n        \"nauc_precision_at_100_std\": 0.20096301840203545,\n        \"nauc_precision_at_10_diff1\": 0.27123942115127225,\n        \"nauc_precision_at_10_max\": 0.08630032169377386,\n        \"nauc_precision_at_10_std\": -0.16295369167027704,\n        \"nauc_precision_at_1_diff1\": 0.5000490731839153,\n        \"nauc_precision_at_1_max\": 0.11703668167822963,\n        \"nauc_precision_at_1_std\": -0.21253420128790015,\n        \"nauc_precision_at_20_diff1\": 0.23764990738737155,\n        \"nauc_precision_at_20_max\": 0.08588449008707481,\n        \"nauc_precision_at_20_std\": -0.12815024827595317,\n        \"nauc_precision_at_3_diff1\": 0.3768282473477028,\n        \"nauc_precision_at_3_max\": 0.1103862880909554,\n        \"nauc_precision_at_3_std\": -0.21218349734884562,\n        \"nauc_precision_at_5_diff1\": 0.30776817382059346,\n        \"nauc_precision_at_5_max\": 0.06910657831809393,\n        \"nauc_precision_at_5_std\": -0.20211493575780667,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.08596297357423918,\n        \"nauc_recall_at_100_max\": 0.2950883540607703,\n        \"nauc_recall_at_100_std\": 0.16625199068581592,\n        \"nauc_recall_at_10_diff1\": 0.270419694339493,\n        \"nauc_recall_at_10_max\": 0.046831921499422155,\n        \"nauc_recall_at_10_std\": -0.2291113605930743,\n        \"nauc_recall_at_1_diff1\": 0.47888230868159154,\n        \"nauc_recall_at_1_max\": 0.08149092947082825,\n        \"nauc_recall_at_1_std\": -0.22164586926600838,\n        \"nauc_recall_at_20_diff1\": 0.22616433288375737,\n        \"nauc_recall_at_20_max\": 0.04938458080277544,\n        \"nauc_recall_at_20_std\": -0.19195410173948851,\n        \"nauc_recall_at_3_diff1\": 0.36684713139195185,\n        \"nauc_recall_at_3_max\": 0.05142566690039451,\n        \"nauc_recall_at_3_std\": -0.2508517314624551,\n        \"nauc_recall_at_5_diff1\": 0.3046746274351698,\n        \"nauc_recall_at_5_max\": 0.01884075606571528,\n        \"nauc_recall_at_5_std\": -0.2544658705115468,\n        \"ndcg_at_1\": 0.20847,\n        \"ndcg_at_10\": 0.28069,\n        \"ndcg_at_100\": 0.36561,\n        \"ndcg_at_1000\": 0.40056,\n        \"ndcg_at_20\": 0.305,\n        \"ndcg_at_3\": 0.2281,\n        \"ndcg_at_5\": 0.25418,\n        \"precision_at_1\": 0.20847,\n        \"precision_at_10\": 0.06107,\n        \"precision_at_100\": 0.01248,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.03738,\n        \"precision_at_3\": 0.12866,\n        \"precision_at_5\": 0.09805,\n        \"recall_at_1\": 0.14384,\n        \"recall_at_10\": 0.37803,\n        \"recall_at_100\": 0.75915,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.46473,\n        \"recall_at_3\": 0.24683,\n        \"recall_at_5\": 0.3057\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/Salesforce/SFR-Embedding-2_R/Salesforce__SFR-Embedding-2_R/91762139d94ed4371a9fa31db5551272e0b83818/model_meta.json",
    "content": "{\"name\": \"Salesforce/SFR-Embedding-2_R\", \"revision\": \"91762139d94ed4371a9fa31db5551272e0b83818\", \"release_date\": \"2024-06-14\", \"languages\": [\"eng_Latn\"], \"n_parameters\": 7110000000, \"memory_usage\": null, \"max_tokens\": 32768, \"embed_dim\": 4096, \"license\": \"cc-by-nc-4.0\", \"open_weights\": true, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"Sentence Transformers\", \"PyTorch\"], \"reference\": \"https://huggingface.co/Salesforce/SFR-Embedding-2_R\", \"similarity_fn_name\": \"cosine\", \"use_instructions\": true, \"zero_shot_benchmarks\": null, \"loader\": \"instruct_wrapper\"}"
  },
  {
    "path": "eval/results/Snowflake/snowflake-arctic-embed-l-v2.0/no_model_name_available/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"task_name\": \"AutoRAGRetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.68421,\n        \"ndcg_at_3\": 0.79354,\n        \"ndcg_at_5\": 0.83356,\n        \"ndcg_at_10\": 0.83863,\n        \"ndcg_at_20\": 0.84288,\n        \"ndcg_at_100\": 0.84288,\n        \"ndcg_at_1000\": 0.84288,\n        \"map_at_1\": 0.68421,\n        \"map_at_3\": 0.76754,\n        \"map_at_5\": 0.78991,\n        \"map_at_10\": 0.79167,\n        \"map_at_20\": 0.79273,\n        \"map_at_100\": 0.79273,\n        \"map_at_1000\": 0.79273,\n        \"recall_at_1\": 0.68421,\n        \"recall_at_3\": 0.86842,\n        \"recall_at_5\": 0.96491,\n        \"recall_at_10\": 0.98246,\n        \"recall_at_20\": 1.0,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.68421,\n        \"precision_at_3\": 0.28947,\n        \"precision_at_5\": 0.19298,\n        \"precision_at_10\": 0.09825,\n        \"precision_at_20\": 0.05,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.684211,\n        \"mrr_at_3\": 0.767544,\n        \"mrr_at_5\": 0.789912,\n        \"mrr_at_10\": 0.791667,\n        \"mrr_at_20\": 0.792731,\n        \"mrr_at_100\": 0.792731,\n        \"mrr_at_1000\": 0.792731,\n        \"nauc_ndcg_at_1_max\": 0.089373,\n        \"nauc_ndcg_at_1_std\": -0.409446,\n        \"nauc_ndcg_at_1_diff1\": 0.731574,\n        \"nauc_ndcg_at_3_max\": 0.24842,\n        \"nauc_ndcg_at_3_std\": -0.431082,\n        \"nauc_ndcg_at_3_diff1\": 0.701366,\n        \"nauc_ndcg_at_5_max\": 0.215152,\n        \"nauc_ndcg_at_5_std\": -0.476746,\n        \"nauc_ndcg_at_5_diff1\": 0.705081,\n        \"nauc_ndcg_at_10_max\": 0.206529,\n        \"nauc_ndcg_at_10_std\": -0.441859,\n        \"nauc_ndcg_at_10_diff1\": 0.717517,\n        \"nauc_ndcg_at_20_max\": 0.194023,\n        \"nauc_ndcg_at_20_std\": -0.429968,\n        \"nauc_ndcg_at_20_diff1\": 0.715736,\n        \"nauc_ndcg_at_100_max\": 0.194023,\n        \"nauc_ndcg_at_100_std\": -0.429968,\n        \"nauc_ndcg_at_100_diff1\": 0.715736,\n        \"nauc_ndcg_at_1000_max\": 0.194023,\n        \"nauc_ndcg_at_1000_std\": -0.429968,\n        \"nauc_ndcg_at_1000_diff1\": 0.715736,\n        \"nauc_map_at_1_max\": 0.089373,\n        \"nauc_map_at_1_std\": -0.409446,\n        \"nauc_map_at_1_diff1\": 0.731574,\n        \"nauc_map_at_3_max\": 0.207744,\n        \"nauc_map_at_3_std\": -0.421012,\n        \"nauc_map_at_3_diff1\": 0.712041,\n        \"nauc_map_at_5_max\": 0.190054,\n        \"nauc_map_at_5_std\": -0.437245,\n        \"nauc_map_at_5_diff1\": 0.714414,\n        \"nauc_map_at_10_max\": 0.187487,\n        \"nauc_map_at_10_std\": -0.42746,\n        \"nauc_map_at_10_diff1\": 0.717856,\n        \"nauc_map_at_20_max\": 0.185025,\n        \"nauc_map_at_20_std\": -0.424999,\n        \"nauc_map_at_20_diff1\": 0.717545,\n        \"nauc_map_at_100_max\": 0.185025,\n        \"nauc_map_at_100_std\": -0.424999,\n        \"nauc_map_at_100_diff1\": 0.717545,\n        \"nauc_map_at_1000_max\": 0.185025,\n        \"nauc_map_at_1000_std\": -0.424999,\n        \"nauc_map_at_1000_diff1\": 0.717545,\n        \"nauc_recall_at_1_max\": 0.089373,\n        \"nauc_recall_at_1_std\": -0.409446,\n        \"nauc_recall_at_1_diff1\": 0.731574,\n        \"nauc_recall_at_3_max\": 0.431506,\n        \"nauc_recall_at_3_std\": -0.480129,\n        \"nauc_recall_at_3_diff1\": 0.6509,\n        \"nauc_recall_at_5_max\": 0.534901,\n        \"nauc_recall_at_5_std\": -1.134437,\n        \"nauc_recall_at_5_diff1\": 0.567454,\n        \"nauc_recall_at_10_max\": 0.613658,\n        \"nauc_recall_at_10_std\": -0.817151,\n        \"nauc_recall_at_10_diff1\": 0.77738,\n        \"nauc_recall_at_20_max\": NaN,\n        \"nauc_recall_at_20_std\": NaN,\n        \"nauc_recall_at_20_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.089373,\n        \"nauc_precision_at_1_std\": -0.409446,\n        \"nauc_precision_at_1_diff1\": 0.731574,\n        \"nauc_precision_at_3_max\": 0.431506,\n        \"nauc_precision_at_3_std\": -0.480129,\n        \"nauc_precision_at_3_diff1\": 0.6509,\n        \"nauc_precision_at_5_max\": 0.534901,\n        \"nauc_precision_at_5_std\": -1.134437,\n        \"nauc_precision_at_5_diff1\": 0.567454,\n        \"nauc_precision_at_10_max\": 0.613658,\n        \"nauc_precision_at_10_std\": -0.817151,\n        \"nauc_precision_at_10_diff1\": 0.77738,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 1.0,\n        \"nauc_precision_at_20_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_mrr_at_1_max\": 0.089373,\n        \"nauc_mrr_at_1_std\": -0.409446,\n        \"nauc_mrr_at_1_diff1\": 0.731574,\n        \"nauc_mrr_at_3_max\": 0.207744,\n        \"nauc_mrr_at_3_std\": -0.421012,\n        \"nauc_mrr_at_3_diff1\": 0.712041,\n        \"nauc_mrr_at_5_max\": 0.190054,\n        \"nauc_mrr_at_5_std\": -0.437245,\n        \"nauc_mrr_at_5_diff1\": 0.714414,\n        \"nauc_mrr_at_10_max\": 0.187487,\n        \"nauc_mrr_at_10_std\": -0.42746,\n        \"nauc_mrr_at_10_diff1\": 0.717856,\n        \"nauc_mrr_at_20_max\": 0.185025,\n        \"nauc_mrr_at_20_std\": -0.424999,\n        \"nauc_mrr_at_20_diff1\": 0.717545,\n        \"nauc_mrr_at_100_max\": 0.185025,\n        \"nauc_mrr_at_100_std\": -0.424999,\n        \"nauc_mrr_at_100_diff1\": 0.717545,\n        \"nauc_mrr_at_1000_max\": 0.185025,\n        \"nauc_mrr_at_1000_std\": -0.424999,\n        \"nauc_mrr_at_1000_diff1\": 0.717545,\n        \"main_score\": 0.83863,\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 23.466877222061157,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/Snowflake/snowflake-arctic-embed-l-v2.0/no_model_name_available/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"task_name\": \"BelebeleRetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.88222,\n        \"ndcg_at_3\": 0.91395,\n        \"ndcg_at_5\": 0.92314,\n        \"ndcg_at_10\": 0.9271,\n        \"ndcg_at_20\": 0.92943,\n        \"ndcg_at_100\": 0.93212,\n        \"ndcg_at_1000\": 0.93287,\n        \"map_at_1\": 0.88222,\n        \"map_at_3\": 0.90611,\n        \"map_at_5\": 0.91122,\n        \"map_at_10\": 0.91286,\n        \"map_at_20\": 0.91355,\n        \"map_at_100\": 0.91392,\n        \"map_at_1000\": 0.91395,\n        \"recall_at_1\": 0.88222,\n        \"recall_at_3\": 0.93667,\n        \"recall_at_5\": 0.95889,\n        \"recall_at_10\": 0.97111,\n        \"recall_at_20\": 0.98,\n        \"recall_at_100\": 0.99444,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.88222,\n        \"precision_at_3\": 0.31222,\n        \"precision_at_5\": 0.19178,\n        \"precision_at_10\": 0.09711,\n        \"precision_at_20\": 0.049,\n        \"precision_at_100\": 0.00994,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.882222,\n        \"mrr_at_3\": 0.906111,\n        \"mrr_at_5\": 0.911222,\n        \"mrr_at_10\": 0.91286,\n        \"mrr_at_20\": 0.913546,\n        \"mrr_at_100\": 0.91392,\n        \"mrr_at_1000\": 0.913953,\n        \"nauc_ndcg_at_1_max\": 0.871794,\n        \"nauc_ndcg_at_1_std\": 0.087549,\n        \"nauc_ndcg_at_1_diff1\": 0.929623,\n        \"nauc_ndcg_at_3_max\": 0.894372,\n        \"nauc_ndcg_at_3_std\": 0.155473,\n        \"nauc_ndcg_at_3_diff1\": 0.930714,\n        \"nauc_ndcg_at_5_max\": 0.897519,\n        \"nauc_ndcg_at_5_std\": 0.187537,\n        \"nauc_ndcg_at_5_diff1\": 0.931269,\n        \"nauc_ndcg_at_10_max\": 0.893185,\n        \"nauc_ndcg_at_10_std\": 0.177046,\n        \"nauc_ndcg_at_10_diff1\": 0.93079,\n        \"nauc_ndcg_at_20_max\": 0.891259,\n        \"nauc_ndcg_at_20_std\": 0.163212,\n        \"nauc_ndcg_at_20_diff1\": 0.931353,\n        \"nauc_ndcg_at_100_max\": 0.888519,\n        \"nauc_ndcg_at_100_std\": 0.153497,\n        \"nauc_ndcg_at_100_diff1\": 0.929808,\n        \"nauc_ndcg_at_1000_max\": 0.887597,\n        \"nauc_ndcg_at_1000_std\": 0.147442,\n        \"nauc_ndcg_at_1000_diff1\": 0.929651,\n        \"nauc_map_at_1_max\": 0.871794,\n        \"nauc_map_at_1_std\": 0.087549,\n        \"nauc_map_at_1_diff1\": 0.929623,\n        \"nauc_map_at_3_max\": 0.886618,\n        \"nauc_map_at_3_std\": 0.132461,\n        \"nauc_map_at_3_diff1\": 0.929284,\n        \"nauc_map_at_5_max\": 0.887467,\n        \"nauc_map_at_5_std\": 0.145346,\n        \"nauc_map_at_5_diff1\": 0.929489,\n        \"nauc_map_at_10_max\": 0.885774,\n        \"nauc_map_at_10_std\": 0.140933,\n        \"nauc_map_at_10_diff1\": 0.92927,\n        \"nauc_map_at_20_max\": 0.885161,\n        \"nauc_map_at_20_std\": 0.137009,\n        \"nauc_map_at_20_diff1\": 0.929247,\n        \"nauc_map_at_100_max\": 0.88479,\n        \"nauc_map_at_100_std\": 0.135555,\n        \"nauc_map_at_100_diff1\": 0.929069,\n        \"nauc_map_at_1000_max\": 0.884762,\n        \"nauc_map_at_1000_std\": 0.135323,\n        \"nauc_map_at_1000_diff1\": 0.929069,\n        \"nauc_recall_at_1_max\": 0.871794,\n        \"nauc_recall_at_1_std\": 0.087549,\n        \"nauc_recall_at_1_diff1\": 0.929623,\n        \"nauc_recall_at_3_max\": 0.92772,\n        \"nauc_recall_at_3_std\": 0.254279,\n        \"nauc_recall_at_3_diff1\": 0.937425,\n        \"nauc_recall_at_5_max\": 0.961768,\n        \"nauc_recall_at_5_std\": 0.462286,\n        \"nauc_recall_at_5_diff1\": 0.943347,\n        \"nauc_recall_at_10_max\": 0.955649,\n        \"nauc_recall_at_10_std\": 0.497684,\n        \"nauc_recall_at_10_diff1\": 0.945145,\n        \"nauc_recall_at_20_max\": 0.960707,\n        \"nauc_recall_at_20_std\": 0.466205,\n        \"nauc_recall_at_20_diff1\": 0.963689,\n        \"nauc_recall_at_100_max\": 0.973856,\n        \"nauc_recall_at_100_std\": 0.679832,\n        \"nauc_recall_at_100_diff1\": 0.947712,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.871794,\n        \"nauc_precision_at_1_std\": 0.087549,\n        \"nauc_precision_at_1_diff1\": 0.929623,\n        \"nauc_precision_at_3_max\": 0.92772,\n        \"nauc_precision_at_3_std\": 0.254279,\n        \"nauc_precision_at_3_diff1\": 0.937425,\n        \"nauc_precision_at_5_max\": 0.961768,\n        \"nauc_precision_at_5_std\": 0.462286,\n        \"nauc_precision_at_5_diff1\": 0.943347,\n        \"nauc_precision_at_10_max\": 0.955649,\n        \"nauc_precision_at_10_std\": 0.497684,\n        \"nauc_precision_at_10_diff1\": 0.945145,\n        \"nauc_precision_at_20_max\": 0.960707,\n        \"nauc_precision_at_20_std\": 0.466205,\n        \"nauc_precision_at_20_diff1\": 0.963689,\n        \"nauc_precision_at_100_max\": 0.973856,\n        \"nauc_precision_at_100_std\": 0.679832,\n        \"nauc_precision_at_100_diff1\": 0.947712,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.871794,\n        \"nauc_mrr_at_1_std\": 0.087549,\n        \"nauc_mrr_at_1_diff1\": 0.929623,\n        \"nauc_mrr_at_3_max\": 0.886618,\n        \"nauc_mrr_at_3_std\": 0.132461,\n        \"nauc_mrr_at_3_diff1\": 0.929284,\n        \"nauc_mrr_at_5_max\": 0.887467,\n        \"nauc_mrr_at_5_std\": 0.145346,\n        \"nauc_mrr_at_5_diff1\": 0.929489,\n        \"nauc_mrr_at_10_max\": 0.885774,\n        \"nauc_mrr_at_10_std\": 0.140933,\n        \"nauc_mrr_at_10_diff1\": 0.92927,\n        \"nauc_mrr_at_20_max\": 0.885161,\n        \"nauc_mrr_at_20_std\": 0.137009,\n        \"nauc_mrr_at_20_diff1\": 0.929247,\n        \"nauc_mrr_at_100_max\": 0.88479,\n        \"nauc_mrr_at_100_std\": 0.135555,\n        \"nauc_mrr_at_100_diff1\": 0.929069,\n        \"nauc_mrr_at_1000_max\": 0.884762,\n        \"nauc_mrr_at_1000_std\": 0.135323,\n        \"nauc_mrr_at_1000_diff1\": 0.929069,\n        \"main_score\": 0.9271,\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.82111,\n        \"ndcg_at_3\": 0.87551,\n        \"ndcg_at_5\": 0.88427,\n        \"ndcg_at_10\": 0.89361,\n        \"ndcg_at_20\": 0.89785,\n        \"ndcg_at_100\": 0.90122,\n        \"ndcg_at_1000\": 0.9015,\n        \"map_at_1\": 0.82111,\n        \"map_at_3\": 0.86241,\n        \"map_at_5\": 0.8673,\n        \"map_at_10\": 0.87116,\n        \"map_at_20\": 0.87233,\n        \"map_at_100\": 0.87283,\n        \"map_at_1000\": 0.87284,\n        \"recall_at_1\": 0.82111,\n        \"recall_at_3\": 0.91333,\n        \"recall_at_5\": 0.93444,\n        \"recall_at_10\": 0.96333,\n        \"recall_at_20\": 0.98,\n        \"recall_at_100\": 0.99778,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.82111,\n        \"precision_at_3\": 0.30444,\n        \"precision_at_5\": 0.18689,\n        \"precision_at_10\": 0.09633,\n        \"precision_at_20\": 0.049,\n        \"precision_at_100\": 0.00998,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.821111,\n        \"mrr_at_3\": 0.862407,\n        \"mrr_at_5\": 0.867296,\n        \"mrr_at_10\": 0.871156,\n        \"mrr_at_20\": 0.872332,\n        \"mrr_at_100\": 0.872827,\n        \"mrr_at_1000\": 0.872837,\n        \"nauc_ndcg_at_1_max\": 0.802669,\n        \"nauc_ndcg_at_1_std\": -0.00893,\n        \"nauc_ndcg_at_1_diff1\": 0.884766,\n        \"nauc_ndcg_at_3_max\": 0.827755,\n        \"nauc_ndcg_at_3_std\": 0.013666,\n        \"nauc_ndcg_at_3_diff1\": 0.854555,\n        \"nauc_ndcg_at_5_max\": 0.832537,\n        \"nauc_ndcg_at_5_std\": 0.045388,\n        \"nauc_ndcg_at_5_diff1\": 0.858638,\n        \"nauc_ndcg_at_10_max\": 0.832546,\n        \"nauc_ndcg_at_10_std\": 0.049355,\n        \"nauc_ndcg_at_10_diff1\": 0.861864,\n        \"nauc_ndcg_at_20_max\": 0.82833,\n        \"nauc_ndcg_at_20_std\": 0.037394,\n        \"nauc_ndcg_at_20_diff1\": 0.864736,\n        \"nauc_ndcg_at_100_max\": 0.823982,\n        \"nauc_ndcg_at_100_std\": 0.026893,\n        \"nauc_ndcg_at_100_diff1\": 0.866592,\n        \"nauc_ndcg_at_1000_max\": 0.823846,\n        \"nauc_ndcg_at_1000_std\": 0.026387,\n        \"nauc_ndcg_at_1000_diff1\": 0.866377,\n        \"nauc_map_at_1_max\": 0.802669,\n        \"nauc_map_at_1_std\": -0.00893,\n        \"nauc_map_at_1_diff1\": 0.884766,\n        \"nauc_map_at_3_max\": 0.820357,\n        \"nauc_map_at_3_std\": 0.007998,\n        \"nauc_map_at_3_diff1\": 0.863485,\n        \"nauc_map_at_5_max\": 0.822401,\n        \"nauc_map_at_5_std\": 0.023728,\n        \"nauc_map_at_5_diff1\": 0.865723,\n        \"nauc_map_at_10_max\": 0.822178,\n        \"nauc_map_at_10_std\": 0.024889,\n        \"nauc_map_at_10_diff1\": 0.867105,\n        \"nauc_map_at_20_max\": 0.821079,\n        \"nauc_map_at_20_std\": 0.021636,\n        \"nauc_map_at_20_diff1\": 0.867859,\n        \"nauc_map_at_100_max\": 0.82055,\n        \"nauc_map_at_100_std\": 0.020074,\n        \"nauc_map_at_100_diff1\": 0.868173,\n        \"nauc_map_at_1000_max\": 0.820543,\n        \"nauc_map_at_1000_std\": 0.020045,\n        \"nauc_map_at_1000_diff1\": 0.868166,\n        \"nauc_recall_at_1_max\": 0.802669,\n        \"nauc_recall_at_1_std\": -0.00893,\n        \"nauc_recall_at_1_diff1\": 0.884766,\n        \"nauc_recall_at_3_max\": 0.860094,\n        \"nauc_recall_at_3_std\": 0.037791,\n        \"nauc_recall_at_3_diff1\": 0.815503,\n        \"nauc_recall_at_5_max\": 0.890289,\n        \"nauc_recall_at_5_std\": 0.172752,\n        \"nauc_recall_at_5_diff1\": 0.820578,\n        \"nauc_recall_at_10_max\": 0.934145,\n        \"nauc_recall_at_10_std\": 0.298333,\n        \"nauc_recall_at_10_diff1\": 0.817432,\n        \"nauc_recall_at_20_max\": 0.940087,\n        \"nauc_recall_at_20_std\": 0.289786,\n        \"nauc_recall_at_20_diff1\": 0.8331,\n        \"nauc_recall_at_100_max\": 0.861111,\n        \"nauc_recall_at_100_std\": 0.152894,\n        \"nauc_recall_at_100_diff1\": 0.934641,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.802669,\n        \"nauc_precision_at_1_std\": -0.00893,\n        \"nauc_precision_at_1_diff1\": 0.884766,\n        \"nauc_precision_at_3_max\": 0.860094,\n        \"nauc_precision_at_3_std\": 0.037791,\n        \"nauc_precision_at_3_diff1\": 0.815503,\n        \"nauc_precision_at_5_max\": 0.890289,\n        \"nauc_precision_at_5_std\": 0.172752,\n        \"nauc_precision_at_5_diff1\": 0.820578,\n        \"nauc_precision_at_10_max\": 0.934145,\n        \"nauc_precision_at_10_std\": 0.298333,\n        \"nauc_precision_at_10_diff1\": 0.817432,\n        \"nauc_precision_at_20_max\": 0.940087,\n        \"nauc_precision_at_20_std\": 0.289786,\n        \"nauc_precision_at_20_diff1\": 0.8331,\n        \"nauc_precision_at_100_max\": 0.861111,\n        \"nauc_precision_at_100_std\": 0.152894,\n        \"nauc_precision_at_100_diff1\": 0.934641,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.802669,\n        \"nauc_mrr_at_1_std\": -0.00893,\n        \"nauc_mrr_at_1_diff1\": 0.884766,\n        \"nauc_mrr_at_3_max\": 0.820357,\n        \"nauc_mrr_at_3_std\": 0.007998,\n        \"nauc_mrr_at_3_diff1\": 0.863485,\n        \"nauc_mrr_at_5_max\": 0.822401,\n        \"nauc_mrr_at_5_std\": 0.023728,\n        \"nauc_mrr_at_5_diff1\": 0.865723,\n        \"nauc_mrr_at_10_max\": 0.822178,\n        \"nauc_mrr_at_10_std\": 0.024889,\n        \"nauc_mrr_at_10_diff1\": 0.867105,\n        \"nauc_mrr_at_20_max\": 0.821079,\n        \"nauc_mrr_at_20_std\": 0.021636,\n        \"nauc_mrr_at_20_diff1\": 0.867859,\n        \"nauc_mrr_at_100_max\": 0.82055,\n        \"nauc_mrr_at_100_std\": 0.020074,\n        \"nauc_mrr_at_100_diff1\": 0.868173,\n        \"nauc_mrr_at_1000_max\": 0.820543,\n        \"nauc_mrr_at_1000_std\": 0.020045,\n        \"nauc_mrr_at_1000_diff1\": 0.868166,\n        \"main_score\": 0.89361,\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.79667,\n        \"ndcg_at_3\": 0.84704,\n        \"ndcg_at_5\": 0.85765,\n        \"ndcg_at_10\": 0.86663,\n        \"ndcg_at_20\": 0.87407,\n        \"ndcg_at_100\": 0.87837,\n        \"ndcg_at_1000\": 0.88035,\n        \"map_at_1\": 0.79667,\n        \"map_at_3\": 0.83519,\n        \"map_at_5\": 0.84113,\n        \"map_at_10\": 0.84483,\n        \"map_at_20\": 0.84695,\n        \"map_at_100\": 0.8476,\n        \"map_at_1000\": 0.8477,\n        \"recall_at_1\": 0.79667,\n        \"recall_at_3\": 0.88111,\n        \"recall_at_5\": 0.90667,\n        \"recall_at_10\": 0.93444,\n        \"recall_at_20\": 0.96333,\n        \"recall_at_100\": 0.98556,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.79667,\n        \"precision_at_3\": 0.2937,\n        \"precision_at_5\": 0.18133,\n        \"precision_at_10\": 0.09344,\n        \"precision_at_20\": 0.04817,\n        \"precision_at_100\": 0.00986,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.796667,\n        \"mrr_at_3\": 0.835185,\n        \"mrr_at_5\": 0.84113,\n        \"mrr_at_10\": 0.84483,\n        \"mrr_at_20\": 0.846945,\n        \"mrr_at_100\": 0.847603,\n        \"mrr_at_1000\": 0.847697,\n        \"nauc_ndcg_at_1_max\": 0.840491,\n        \"nauc_ndcg_at_1_std\": 0.215939,\n        \"nauc_ndcg_at_1_diff1\": 0.888987,\n        \"nauc_ndcg_at_3_max\": 0.847283,\n        \"nauc_ndcg_at_3_std\": 0.237854,\n        \"nauc_ndcg_at_3_diff1\": 0.870479,\n        \"nauc_ndcg_at_5_max\": 0.846485,\n        \"nauc_ndcg_at_5_std\": 0.253122,\n        \"nauc_ndcg_at_5_diff1\": 0.864964,\n        \"nauc_ndcg_at_10_max\": 0.847742,\n        \"nauc_ndcg_at_10_std\": 0.266191,\n        \"nauc_ndcg_at_10_diff1\": 0.866941,\n        \"nauc_ndcg_at_20_max\": 0.85193,\n        \"nauc_ndcg_at_20_std\": 0.266515,\n        \"nauc_ndcg_at_20_diff1\": 0.872463,\n        \"nauc_ndcg_at_100_max\": 0.851502,\n        \"nauc_ndcg_at_100_std\": 0.261466,\n        \"nauc_ndcg_at_100_diff1\": 0.874104,\n        \"nauc_ndcg_at_1000_max\": 0.849079,\n        \"nauc_ndcg_at_1000_std\": 0.252442,\n        \"nauc_ndcg_at_1000_diff1\": 0.87355,\n        \"nauc_map_at_1_max\": 0.840491,\n        \"nauc_map_at_1_std\": 0.215939,\n        \"nauc_map_at_1_diff1\": 0.888987,\n        \"nauc_map_at_3_max\": 0.846426,\n        \"nauc_map_at_3_std\": 0.233667,\n        \"nauc_map_at_3_diff1\": 0.875654,\n        \"nauc_map_at_5_max\": 0.846003,\n        \"nauc_map_at_5_std\": 0.240665,\n        \"nauc_map_at_5_diff1\": 0.873101,\n        \"nauc_map_at_10_max\": 0.846476,\n        \"nauc_map_at_10_std\": 0.244957,\n        \"nauc_map_at_10_diff1\": 0.873953,\n        \"nauc_map_at_20_max\": 0.847544,\n        \"nauc_map_at_20_std\": 0.244568,\n        \"nauc_map_at_20_diff1\": 0.875416,\n        \"nauc_map_at_100_max\": 0.847432,\n        \"nauc_map_at_100_std\": 0.243779,\n        \"nauc_map_at_100_diff1\": 0.875553,\n        \"nauc_map_at_1000_max\": 0.847336,\n        \"nauc_map_at_1000_std\": 0.243415,\n        \"nauc_map_at_1000_diff1\": 0.875536,\n        \"nauc_recall_at_1_max\": 0.840491,\n        \"nauc_recall_at_1_std\": 0.215939,\n        \"nauc_recall_at_1_diff1\": 0.888987,\n        \"nauc_recall_at_3_max\": 0.849974,\n        \"nauc_recall_at_3_std\": 0.252823,\n        \"nauc_recall_at_3_diff1\": 0.850589,\n        \"nauc_recall_at_5_max\": 0.847761,\n        \"nauc_recall_at_5_std\": 0.314092,\n        \"nauc_recall_at_5_diff1\": 0.825914,\n        \"nauc_recall_at_10_max\": 0.855378,\n        \"nauc_recall_at_10_std\": 0.419037,\n        \"nauc_recall_at_10_diff1\": 0.821899,\n        \"nauc_recall_at_20_max\": 0.911524,\n        \"nauc_recall_at_20_std\": 0.547803,\n        \"nauc_recall_at_20_diff1\": 0.854794,\n        \"nauc_recall_at_100_max\": 0.989945,\n        \"nauc_recall_at_100_std\": 0.775946,\n        \"nauc_recall_at_100_diff1\": 0.906988,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.840491,\n        \"nauc_precision_at_1_std\": 0.215939,\n        \"nauc_precision_at_1_diff1\": 0.888987,\n        \"nauc_precision_at_3_max\": 0.849974,\n        \"nauc_precision_at_3_std\": 0.252823,\n        \"nauc_precision_at_3_diff1\": 0.850589,\n        \"nauc_precision_at_5_max\": 0.847761,\n        \"nauc_precision_at_5_std\": 0.314092,\n        \"nauc_precision_at_5_diff1\": 0.825914,\n        \"nauc_precision_at_10_max\": 0.855378,\n        \"nauc_precision_at_10_std\": 0.419037,\n        \"nauc_precision_at_10_diff1\": 0.821899,\n        \"nauc_precision_at_20_max\": 0.911524,\n        \"nauc_precision_at_20_std\": 0.547803,\n        \"nauc_precision_at_20_diff1\": 0.854794,\n        \"nauc_precision_at_100_max\": 0.989945,\n        \"nauc_precision_at_100_std\": 0.775946,\n        \"nauc_precision_at_100_diff1\": 0.906988,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.840491,\n        \"nauc_mrr_at_1_std\": 0.215939,\n        \"nauc_mrr_at_1_diff1\": 0.888987,\n        \"nauc_mrr_at_3_max\": 0.846426,\n        \"nauc_mrr_at_3_std\": 0.233667,\n        \"nauc_mrr_at_3_diff1\": 0.875654,\n        \"nauc_mrr_at_5_max\": 0.846003,\n        \"nauc_mrr_at_5_std\": 0.240665,\n        \"nauc_mrr_at_5_diff1\": 0.873101,\n        \"nauc_mrr_at_10_max\": 0.846476,\n        \"nauc_mrr_at_10_std\": 0.244957,\n        \"nauc_mrr_at_10_diff1\": 0.873953,\n        \"nauc_mrr_at_20_max\": 0.847544,\n        \"nauc_mrr_at_20_std\": 0.244568,\n        \"nauc_mrr_at_20_diff1\": 0.875416,\n        \"nauc_mrr_at_100_max\": 0.847432,\n        \"nauc_mrr_at_100_std\": 0.243779,\n        \"nauc_mrr_at_100_diff1\": 0.875553,\n        \"nauc_mrr_at_1000_max\": 0.847336,\n        \"nauc_mrr_at_1000_std\": 0.243415,\n        \"nauc_mrr_at_1000_diff1\": 0.875536,\n        \"main_score\": 0.86663,\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 19.306873321533203,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/Snowflake/snowflake-arctic-embed-l-v2.0/no_model_name_available/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"task_name\": \"Ko-StrategyQA\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"ndcg_at_1\": 0.78378,\n        \"ndcg_at_3\": 0.75718,\n        \"ndcg_at_5\": 0.78694,\n        \"ndcg_at_10\": 0.80455,\n        \"ndcg_at_20\": 0.81148,\n        \"ndcg_at_100\": 0.81914,\n        \"ndcg_at_1000\": 0.82687,\n        \"map_at_1\": 0.50886,\n        \"map_at_3\": 0.71843,\n        \"map_at_5\": 0.74839,\n        \"map_at_10\": 0.76025,\n        \"map_at_20\": 0.7634,\n        \"map_at_100\": 0.76489,\n        \"map_at_1000\": 0.76521,\n        \"recall_at_1\": 0.50886,\n        \"recall_at_3\": 0.75575,\n        \"recall_at_5\": 0.81673,\n        \"recall_at_10\": 0.85876,\n        \"recall_at_20\": 0.87945,\n        \"recall_at_100\": 0.91277,\n        \"recall_at_1000\": 0.96273,\n        \"precision_at_1\": 0.78378,\n        \"precision_at_3\": 0.44369,\n        \"precision_at_5\": 0.29662,\n        \"precision_at_10\": 0.15861,\n        \"precision_at_20\": 0.08193,\n        \"precision_at_100\": 0.01715,\n        \"precision_at_1000\": 0.00183,\n        \"mrr_at_1\": 0.783784,\n        \"mrr_at_3\": 0.819257,\n        \"mrr_at_5\": 0.824916,\n        \"mrr_at_10\": 0.827873,\n        \"mrr_at_20\": 0.828349,\n        \"mrr_at_100\": 0.828891,\n        \"mrr_at_1000\": 0.829072,\n        \"nauc_ndcg_at_1_max\": 0.66351,\n        \"nauc_ndcg_at_1_std\": 0.342961,\n        \"nauc_ndcg_at_1_diff1\": 0.703978,\n        \"nauc_ndcg_at_3_max\": 0.600697,\n        \"nauc_ndcg_at_3_std\": 0.246012,\n        \"nauc_ndcg_at_3_diff1\": 0.555382,\n        \"nauc_ndcg_at_5_max\": 0.656793,\n        \"nauc_ndcg_at_5_std\": 0.310234,\n        \"nauc_ndcg_at_5_diff1\": 0.564383,\n        \"nauc_ndcg_at_10_max\": 0.68711,\n        \"nauc_ndcg_at_10_std\": 0.366137,\n        \"nauc_ndcg_at_10_diff1\": 0.57362,\n        \"nauc_ndcg_at_20_max\": 0.698608,\n        \"nauc_ndcg_at_20_std\": 0.388451,\n        \"nauc_ndcg_at_20_diff1\": 0.580961,\n        \"nauc_ndcg_at_100_max\": 0.70173,\n        \"nauc_ndcg_at_100_std\": 0.393134,\n        \"nauc_ndcg_at_100_diff1\": 0.595129,\n        \"nauc_ndcg_at_1000_max\": 0.689353,\n        \"nauc_ndcg_at_1000_std\": 0.379922,\n        \"nauc_ndcg_at_1000_diff1\": 0.589623,\n        \"nauc_map_at_1_max\": 0.274554,\n        \"nauc_map_at_1_std\": 0.049087,\n        \"nauc_map_at_1_diff1\": 0.603685,\n        \"nauc_map_at_3_max\": 0.552057,\n        \"nauc_map_at_3_std\": 0.19298,\n        \"nauc_map_at_3_diff1\": 0.5385,\n        \"nauc_map_at_5_max\": 0.599469,\n        \"nauc_map_at_5_std\": 0.241903,\n        \"nauc_map_at_5_diff1\": 0.539366,\n        \"nauc_map_at_10_max\": 0.616915,\n        \"nauc_map_at_10_std\": 0.274562,\n        \"nauc_map_at_10_diff1\": 0.543664,\n        \"nauc_map_at_20_max\": 0.620948,\n        \"nauc_map_at_20_std\": 0.28246,\n        \"nauc_map_at_20_diff1\": 0.546535,\n        \"nauc_map_at_100_max\": 0.621487,\n        \"nauc_map_at_100_std\": 0.28351,\n        \"nauc_map_at_100_diff1\": 0.549163,\n        \"nauc_map_at_1000_max\": 0.621058,\n        \"nauc_map_at_1000_std\": 0.283215,\n        \"nauc_map_at_1000_diff1\": 0.548932,\n        \"nauc_recall_at_1_max\": 0.274554,\n        \"nauc_recall_at_1_std\": 0.049087,\n        \"nauc_recall_at_1_diff1\": 0.603685,\n        \"nauc_recall_at_3_max\": 0.586384,\n        \"nauc_recall_at_3_std\": 0.220095,\n        \"nauc_recall_at_3_diff1\": 0.509868,\n        \"nauc_recall_at_5_max\": 0.695287,\n        \"nauc_recall_at_5_std\": 0.34578,\n        \"nauc_recall_at_5_diff1\": 0.514654,\n        \"nauc_recall_at_10_max\": 0.790076,\n        \"nauc_recall_at_10_std\": 0.51455,\n        \"nauc_recall_at_10_diff1\": 0.528608,\n        \"nauc_recall_at_20_max\": 0.865104,\n        \"nauc_recall_at_20_std\": 0.640404,\n        \"nauc_recall_at_20_diff1\": 0.560792,\n        \"nauc_recall_at_100_max\": 0.953183,\n        \"nauc_recall_at_100_std\": 0.763603,\n        \"nauc_recall_at_100_diff1\": 0.671003,\n        \"nauc_recall_at_1000_max\": 0.947876,\n        \"nauc_recall_at_1000_std\": 0.861736,\n        \"nauc_recall_at_1000_diff1\": 0.622166,\n        \"nauc_precision_at_1_max\": 0.66351,\n        \"nauc_precision_at_1_std\": 0.342961,\n        \"nauc_precision_at_1_diff1\": 0.703978,\n        \"nauc_precision_at_3_max\": 0.39359,\n        \"nauc_precision_at_3_std\": 0.248765,\n        \"nauc_precision_at_3_diff1\": -0.007857,\n        \"nauc_precision_at_5_max\": 0.328642,\n        \"nauc_precision_at_5_std\": 0.264825,\n        \"nauc_precision_at_5_diff1\": -0.090444,\n        \"nauc_precision_at_10_max\": 0.288377,\n        \"nauc_precision_at_10_std\": 0.305151,\n        \"nauc_precision_at_10_diff1\": -0.13785,\n        \"nauc_precision_at_20_max\": 0.261299,\n        \"nauc_precision_at_20_std\": 0.315143,\n        \"nauc_precision_at_20_diff1\": -0.156061,\n        \"nauc_precision_at_100_max\": 0.202035,\n        \"nauc_precision_at_100_std\": 0.287929,\n        \"nauc_precision_at_100_diff1\": -0.18364,\n        \"nauc_precision_at_1000_max\": 0.045862,\n        \"nauc_precision_at_1000_std\": 0.184977,\n        \"nauc_precision_at_1000_diff1\": -0.309691,\n        \"nauc_mrr_at_1_max\": 0.66351,\n        \"nauc_mrr_at_1_std\": 0.342961,\n        \"nauc_mrr_at_1_diff1\": 0.703978,\n        \"nauc_mrr_at_3_max\": 0.737671,\n        \"nauc_mrr_at_3_std\": 0.42406,\n        \"nauc_mrr_at_3_diff1\": 0.683418,\n        \"nauc_mrr_at_5_max\": 0.736757,\n        \"nauc_mrr_at_5_std\": 0.436965,\n        \"nauc_mrr_at_5_diff1\": 0.684921,\n        \"nauc_mrr_at_10_max\": 0.740439,\n        \"nauc_mrr_at_10_std\": 0.442523,\n        \"nauc_mrr_at_10_diff1\": 0.686669,\n        \"nauc_mrr_at_20_max\": 0.740304,\n        \"nauc_mrr_at_20_std\": 0.442289,\n        \"nauc_mrr_at_20_diff1\": 0.686576,\n        \"nauc_mrr_at_100_max\": 0.739776,\n        \"nauc_mrr_at_100_std\": 0.441713,\n        \"nauc_mrr_at_100_diff1\": 0.687177,\n        \"nauc_mrr_at_1000_max\": 0.739504,\n        \"nauc_mrr_at_1000_std\": 0.441296,\n        \"nauc_mrr_at_1000_diff1\": 0.687133,\n        \"main_score\": 0.80455,\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 116.52639317512512,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/Snowflake/snowflake-arctic-embed-l-v2.0/no_model_name_available/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"task_name\": \"MIRACLRetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"ndcg_at_1\": 0.6338,\n        \"ndcg_at_3\": 0.62186,\n        \"ndcg_at_5\": 0.63188,\n        \"ndcg_at_10\": 0.66077,\n        \"ndcg_at_20\": 0.6872,\n        \"ndcg_at_100\": 0.71572,\n        \"ndcg_at_1000\": 0.72622,\n        \"map_at_1\": 0.39586,\n        \"map_at_3\": 0.50791,\n        \"map_at_5\": 0.54136,\n        \"map_at_10\": 0.56835,\n        \"map_at_20\": 0.58173,\n        \"map_at_100\": 0.58996,\n        \"map_at_1000\": 0.59094,\n        \"recall_at_1\": 0.39586,\n        \"recall_at_3\": 0.57785,\n        \"recall_at_5\": 0.65636,\n        \"recall_at_10\": 0.74806,\n        \"recall_at_20\": 0.82219,\n        \"recall_at_100\": 0.92769,\n        \"recall_at_1000\": 0.98419,\n        \"precision_at_1\": 0.6338,\n        \"precision_at_3\": 0.3662,\n        \"precision_at_5\": 0.26667,\n        \"precision_at_10\": 0.16479,\n        \"precision_at_20\": 0.09577,\n        \"precision_at_100\": 0.02319,\n        \"precision_at_1000\": 0.00254,\n        \"mrr_at_1\": 0.633803,\n        \"mrr_at_3\": 0.720657,\n        \"mrr_at_5\": 0.732394,\n        \"mrr_at_10\": 0.737898,\n        \"mrr_at_20\": 0.739605,\n        \"mrr_at_100\": 0.740413,\n        \"mrr_at_1000\": 0.740491,\n        \"nauc_ndcg_at_1_max\": 0.36433,\n        \"nauc_ndcg_at_1_std\": 0.057948,\n        \"nauc_ndcg_at_1_diff1\": 0.317296,\n        \"nauc_ndcg_at_3_max\": 0.291245,\n        \"nauc_ndcg_at_3_std\": 0.012819,\n        \"nauc_ndcg_at_3_diff1\": 0.229384,\n        \"nauc_ndcg_at_5_max\": 0.301409,\n        \"nauc_ndcg_at_5_std\": -0.00086,\n        \"nauc_ndcg_at_5_diff1\": 0.225941,\n        \"nauc_ndcg_at_10_max\": 0.327252,\n        \"nauc_ndcg_at_10_std\": 0.018858,\n        \"nauc_ndcg_at_10_diff1\": 0.222747,\n        \"nauc_ndcg_at_20_max\": 0.372009,\n        \"nauc_ndcg_at_20_std\": 0.083221,\n        \"nauc_ndcg_at_20_diff1\": 0.229619,\n        \"nauc_ndcg_at_100_max\": 0.364411,\n        \"nauc_ndcg_at_100_std\": 0.077404,\n        \"nauc_ndcg_at_100_diff1\": 0.214304,\n        \"nauc_ndcg_at_1000_max\": 0.357641,\n        \"nauc_ndcg_at_1000_std\": 0.079982,\n        \"nauc_ndcg_at_1000_diff1\": 0.219213,\n        \"nauc_map_at_1_max\": 0.225558,\n        \"nauc_map_at_1_std\": -0.154759,\n        \"nauc_map_at_1_diff1\": 0.35403,\n        \"nauc_map_at_3_max\": 0.253169,\n        \"nauc_map_at_3_std\": -0.091057,\n        \"nauc_map_at_3_diff1\": 0.275777,\n        \"nauc_map_at_5_max\": 0.280381,\n        \"nauc_map_at_5_std\": -0.048579,\n        \"nauc_map_at_5_diff1\": 0.256842,\n        \"nauc_map_at_10_max\": 0.297772,\n        \"nauc_map_at_10_std\": -0.02757,\n        \"nauc_map_at_10_diff1\": 0.25329,\n        \"nauc_map_at_20_max\": 0.315153,\n        \"nauc_map_at_20_std\": -0.002361,\n        \"nauc_map_at_20_diff1\": 0.254841,\n        \"nauc_map_at_100_max\": 0.314783,\n        \"nauc_map_at_100_std\": -0.002325,\n        \"nauc_map_at_100_diff1\": 0.25129,\n        \"nauc_map_at_1000_max\": 0.314298,\n        \"nauc_map_at_1000_std\": -0.001981,\n        \"nauc_map_at_1000_diff1\": 0.251598,\n        \"nauc_recall_at_1_max\": 0.225558,\n        \"nauc_recall_at_1_std\": -0.154759,\n        \"nauc_recall_at_1_diff1\": 0.35403,\n        \"nauc_recall_at_3_max\": 0.200469,\n        \"nauc_recall_at_3_std\": -0.121722,\n        \"nauc_recall_at_3_diff1\": 0.212938,\n        \"nauc_recall_at_5_max\": 0.2192,\n        \"nauc_recall_at_5_std\": -0.077641,\n        \"nauc_recall_at_5_diff1\": 0.161298,\n        \"nauc_recall_at_10_max\": 0.25392,\n        \"nauc_recall_at_10_std\": -0.032093,\n        \"nauc_recall_at_10_diff1\": 0.125612,\n        \"nauc_recall_at_20_max\": 0.398226,\n        \"nauc_recall_at_20_std\": 0.190764,\n        \"nauc_recall_at_20_diff1\": 0.140787,\n        \"nauc_recall_at_100_max\": 0.400267,\n        \"nauc_recall_at_100_std\": 0.142762,\n        \"nauc_recall_at_100_diff1\": -0.043031,\n        \"nauc_recall_at_1000_max\": 0.373517,\n        \"nauc_recall_at_1000_std\": 0.503357,\n        \"nauc_recall_at_1000_diff1\": -0.317952,\n        \"nauc_precision_at_1_max\": 0.36433,\n        \"nauc_precision_at_1_std\": 0.057948,\n        \"nauc_precision_at_1_diff1\": 0.317296,\n        \"nauc_precision_at_3_max\": 0.204832,\n        \"nauc_precision_at_3_std\": 0.293384,\n        \"nauc_precision_at_3_diff1\": -0.116665,\n        \"nauc_precision_at_5_max\": 0.188669,\n        \"nauc_precision_at_5_std\": 0.332137,\n        \"nauc_precision_at_5_diff1\": -0.147681,\n        \"nauc_precision_at_10_max\": 0.161853,\n        \"nauc_precision_at_10_std\": 0.332841,\n        \"nauc_precision_at_10_diff1\": -0.173471,\n        \"nauc_precision_at_20_max\": 0.16721,\n        \"nauc_precision_at_20_std\": 0.396508,\n        \"nauc_precision_at_20_diff1\": -0.184459,\n        \"nauc_precision_at_100_max\": 0.063707,\n        \"nauc_precision_at_100_std\": 0.323576,\n        \"nauc_precision_at_100_diff1\": -0.227542,\n        \"nauc_precision_at_1000_max\": 0.01149,\n        \"nauc_precision_at_1000_std\": 0.295511,\n        \"nauc_precision_at_1000_diff1\": -0.213489,\n        \"nauc_mrr_at_1_max\": 0.36433,\n        \"nauc_mrr_at_1_std\": 0.057948,\n        \"nauc_mrr_at_1_diff1\": 0.317296,\n        \"nauc_mrr_at_3_max\": 0.401771,\n        \"nauc_mrr_at_3_std\": 0.120315,\n        \"nauc_mrr_at_3_diff1\": 0.236438,\n        \"nauc_mrr_at_5_max\": 0.404058,\n        \"nauc_mrr_at_5_std\": 0.113415,\n        \"nauc_mrr_at_5_diff1\": 0.24794,\n        \"nauc_mrr_at_10_max\": 0.402361,\n        \"nauc_mrr_at_10_std\": 0.120171,\n        \"nauc_mrr_at_10_diff1\": 0.240421,\n        \"nauc_mrr_at_20_max\": 0.403472,\n        \"nauc_mrr_at_20_std\": 0.12475,\n        \"nauc_mrr_at_20_diff1\": 0.241169,\n        \"nauc_mrr_at_100_max\": 0.403146,\n        \"nauc_mrr_at_100_std\": 0.122353,\n        \"nauc_mrr_at_100_diff1\": 0.243043,\n        \"nauc_mrr_at_1000_max\": 0.403191,\n        \"nauc_mrr_at_1000_std\": 0.122326,\n        \"nauc_mrr_at_1000_diff1\": 0.243267,\n        \"main_score\": 0.66077,\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 10909.090243339539,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/Snowflake/snowflake-arctic-embed-l-v2.0/no_model_name_available/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"task_name\": \"MrTidyRetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.46793,\n        \"ndcg_at_3\": 0.5442,\n        \"ndcg_at_5\": 0.56769,\n        \"ndcg_at_10\": 0.59071,\n        \"ndcg_at_20\": 0.61105,\n        \"ndcg_at_100\": 0.63034,\n        \"ndcg_at_1000\": 0.63913,\n        \"map_at_1\": 0.42953,\n        \"map_at_3\": 0.51326,\n        \"map_at_5\": 0.52803,\n        \"map_at_10\": 0.53806,\n        \"map_at_20\": 0.54429,\n        \"map_at_100\": 0.54752,\n        \"map_at_1000\": 0.5478,\n        \"recall_at_1\": 0.42953,\n        \"recall_at_3\": 0.60333,\n        \"recall_at_5\": 0.65717,\n        \"recall_at_10\": 0.72328,\n        \"recall_at_20\": 0.7981,\n        \"recall_at_100\": 0.89509,\n        \"recall_at_1000\": 0.96556,\n        \"precision_at_1\": 0.46793,\n        \"precision_at_3\": 0.22169,\n        \"precision_at_5\": 0.14679,\n        \"precision_at_10\": 0.08242,\n        \"precision_at_20\": 0.0462,\n        \"precision_at_100\": 0.01045,\n        \"precision_at_1000\": 0.00113,\n        \"mrr_at_1\": 0.467933,\n        \"mrr_at_3\": 0.545527,\n        \"mrr_at_5\": 0.556215,\n        \"mrr_at_10\": 0.565528,\n        \"mrr_at_20\": 0.570359,\n        \"mrr_at_100\": 0.572393,\n        \"mrr_at_1000\": 0.572636,\n        \"nauc_ndcg_at_1_max\": 0.347778,\n        \"nauc_ndcg_at_1_std\": -0.058339,\n        \"nauc_ndcg_at_1_diff1\": 0.501989,\n        \"nauc_ndcg_at_3_max\": 0.321743,\n        \"nauc_ndcg_at_3_std\": -0.021783,\n        \"nauc_ndcg_at_3_diff1\": 0.431511,\n        \"nauc_ndcg_at_5_max\": 0.332574,\n        \"nauc_ndcg_at_5_std\": -0.004894,\n        \"nauc_ndcg_at_5_diff1\": 0.424748,\n        \"nauc_ndcg_at_10_max\": 0.340703,\n        \"nauc_ndcg_at_10_std\": -0.012762,\n        \"nauc_ndcg_at_10_diff1\": 0.427041,\n        \"nauc_ndcg_at_20_max\": 0.3389,\n        \"nauc_ndcg_at_20_std\": -0.003515,\n        \"nauc_ndcg_at_20_diff1\": 0.424289,\n        \"nauc_ndcg_at_100_max\": 0.343308,\n        \"nauc_ndcg_at_100_std\": 0.007776,\n        \"nauc_ndcg_at_100_diff1\": 0.43105,\n        \"nauc_ndcg_at_1000_max\": 0.342666,\n        \"nauc_ndcg_at_1000_std\": -2.3e-05,\n        \"nauc_ndcg_at_1000_diff1\": 0.432686,\n        \"nauc_map_at_1_max\": 0.322004,\n        \"nauc_map_at_1_std\": -0.060647,\n        \"nauc_map_at_1_diff1\": 0.479496,\n        \"nauc_map_at_3_max\": 0.315617,\n        \"nauc_map_at_3_std\": -0.032644,\n        \"nauc_map_at_3_diff1\": 0.440521,\n        \"nauc_map_at_5_max\": 0.323492,\n        \"nauc_map_at_5_std\": -0.022745,\n        \"nauc_map_at_5_diff1\": 0.436075,\n        \"nauc_map_at_10_max\": 0.326869,\n        \"nauc_map_at_10_std\": -0.027004,\n        \"nauc_map_at_10_diff1\": 0.437014,\n        \"nauc_map_at_20_max\": 0.326,\n        \"nauc_map_at_20_std\": -0.024601,\n        \"nauc_map_at_20_diff1\": 0.436045,\n        \"nauc_map_at_100_max\": 0.326345,\n        \"nauc_map_at_100_std\": -0.023394,\n        \"nauc_map_at_100_diff1\": 0.437366,\n        \"nauc_map_at_1000_max\": 0.326387,\n        \"nauc_map_at_1000_std\": -0.023538,\n        \"nauc_map_at_1000_diff1\": 0.437423,\n        \"nauc_recall_at_1_max\": 0.322004,\n        \"nauc_recall_at_1_std\": -0.060647,\n        \"nauc_recall_at_1_diff1\": 0.479496,\n        \"nauc_recall_at_3_max\": 0.307551,\n        \"nauc_recall_at_3_std\": 0.011178,\n        \"nauc_recall_at_3_diff1\": 0.380203,\n        \"nauc_recall_at_5_max\": 0.330094,\n        \"nauc_recall_at_5_std\": 0.054829,\n        \"nauc_recall_at_5_diff1\": 0.359187,\n        \"nauc_recall_at_10_max\": 0.356746,\n        \"nauc_recall_at_10_std\": 0.039576,\n        \"nauc_recall_at_10_diff1\": 0.356908,\n        \"nauc_recall_at_20_max\": 0.359008,\n        \"nauc_recall_at_20_std\": 0.103216,\n        \"nauc_recall_at_20_diff1\": 0.330975,\n        \"nauc_recall_at_100_max\": 0.448561,\n        \"nauc_recall_at_100_std\": 0.339303,\n        \"nauc_recall_at_100_diff1\": 0.34747,\n        \"nauc_recall_at_1000_max\": 0.604003,\n        \"nauc_recall_at_1000_std\": 0.505597,\n        \"nauc_recall_at_1000_diff1\": 0.291852,\n        \"nauc_precision_at_1_max\": 0.347778,\n        \"nauc_precision_at_1_std\": -0.058339,\n        \"nauc_precision_at_1_diff1\": 0.501989,\n        \"nauc_precision_at_3_max\": 0.293071,\n        \"nauc_precision_at_3_std\": 0.002078,\n        \"nauc_precision_at_3_diff1\": 0.346977,\n        \"nauc_precision_at_5_max\": 0.288524,\n        \"nauc_precision_at_5_std\": 0.054756,\n        \"nauc_precision_at_5_diff1\": 0.273477,\n        \"nauc_precision_at_10_max\": 0.260607,\n        \"nauc_precision_at_10_std\": 0.032127,\n        \"nauc_precision_at_10_diff1\": 0.206793,\n        \"nauc_precision_at_20_max\": 0.202122,\n        \"nauc_precision_at_20_std\": 0.091149,\n        \"nauc_precision_at_20_diff1\": 0.111556,\n        \"nauc_precision_at_100_max\": 0.138927,\n        \"nauc_precision_at_100_std\": 0.151481,\n        \"nauc_precision_at_100_diff1\": 0.039547,\n        \"nauc_precision_at_1000_max\": 0.053952,\n        \"nauc_precision_at_1000_std\": 0.100944,\n        \"nauc_precision_at_1000_diff1\": -0.064182,\n        \"nauc_mrr_at_1_max\": 0.347778,\n        \"nauc_mrr_at_1_std\": -0.058339,\n        \"nauc_mrr_at_1_diff1\": 0.501989,\n        \"nauc_mrr_at_3_max\": 0.343049,\n        \"nauc_mrr_at_3_std\": -0.030596,\n        \"nauc_mrr_at_3_diff1\": 0.456467,\n        \"nauc_mrr_at_5_max\": 0.346555,\n        \"nauc_mrr_at_5_std\": -0.022801,\n        \"nauc_mrr_at_5_diff1\": 0.45453,\n        \"nauc_mrr_at_10_max\": 0.350391,\n        \"nauc_mrr_at_10_std\": -0.026001,\n        \"nauc_mrr_at_10_diff1\": 0.456921,\n        \"nauc_mrr_at_20_max\": 0.349081,\n        \"nauc_mrr_at_20_std\": -0.024796,\n        \"nauc_mrr_at_20_diff1\": 0.456687,\n        \"nauc_mrr_at_100_max\": 0.3492,\n        \"nauc_mrr_at_100_std\": -0.023745,\n        \"nauc_mrr_at_100_diff1\": 0.457028,\n        \"nauc_mrr_at_1000_max\": 0.349218,\n        \"nauc_mrr_at_1000_std\": -0.023931,\n        \"nauc_mrr_at_1000_diff1\": 0.45708,\n        \"main_score\": 0.59071,\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 11037.680595874786,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/Snowflake/snowflake-arctic-embed-l-v2.0/no_model_name_available/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"task_name\": \"MultiLongDocRetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"ndcg_at_1\": 0.29,\n        \"ndcg_at_3\": 0.35917,\n        \"ndcg_at_5\": 0.38176,\n        \"ndcg_at_10\": 0.40401,\n        \"ndcg_at_20\": 0.42135,\n        \"ndcg_at_100\": 0.4465,\n        \"ndcg_at_1000\": 0.4683,\n        \"map_at_1\": 0.29,\n        \"map_at_3\": 0.34167,\n        \"map_at_5\": 0.35417,\n        \"map_at_10\": 0.3631,\n        \"map_at_20\": 0.36767,\n        \"map_at_100\": 0.37114,\n        \"map_at_1000\": 0.3719,\n        \"recall_at_1\": 0.29,\n        \"recall_at_3\": 0.41,\n        \"recall_at_5\": 0.465,\n        \"recall_at_10\": 0.535,\n        \"recall_at_20\": 0.605,\n        \"recall_at_100\": 0.74,\n        \"recall_at_1000\": 0.915,\n        \"precision_at_1\": 0.29,\n        \"precision_at_3\": 0.13667,\n        \"precision_at_5\": 0.093,\n        \"precision_at_10\": 0.0535,\n        \"precision_at_20\": 0.03025,\n        \"precision_at_100\": 0.0074,\n        \"precision_at_1000\": 0.00092,\n        \"mrr_at_1\": 0.29,\n        \"mrr_at_3\": 0.341667,\n        \"mrr_at_5\": 0.354167,\n        \"mrr_at_10\": 0.363099,\n        \"mrr_at_20\": 0.367668,\n        \"mrr_at_100\": 0.371138,\n        \"mrr_at_1000\": 0.371897,\n        \"nauc_ndcg_at_1_max\": 0.39918,\n        \"nauc_ndcg_at_1_std\": 0.027622,\n        \"nauc_ndcg_at_1_diff1\": 0.482817,\n        \"nauc_ndcg_at_3_max\": 0.419841,\n        \"nauc_ndcg_at_3_std\": 0.065095,\n        \"nauc_ndcg_at_3_diff1\": 0.454577,\n        \"nauc_ndcg_at_5_max\": 0.433728,\n        \"nauc_ndcg_at_5_std\": 0.085569,\n        \"nauc_ndcg_at_5_diff1\": 0.456413,\n        \"nauc_ndcg_at_10_max\": 0.43599,\n        \"nauc_ndcg_at_10_std\": 0.086145,\n        \"nauc_ndcg_at_10_diff1\": 0.446462,\n        \"nauc_ndcg_at_20_max\": 0.447888,\n        \"nauc_ndcg_at_20_std\": 0.111184,\n        \"nauc_ndcg_at_20_diff1\": 0.436923,\n        \"nauc_ndcg_at_100_max\": 0.445429,\n        \"nauc_ndcg_at_100_std\": 0.125808,\n        \"nauc_ndcg_at_100_diff1\": 0.428585,\n        \"nauc_ndcg_at_1000_max\": 0.449401,\n        \"nauc_ndcg_at_1000_std\": 0.123922,\n        \"nauc_ndcg_at_1000_diff1\": 0.434085,\n        \"nauc_map_at_1_max\": 0.39918,\n        \"nauc_map_at_1_std\": 0.027622,\n        \"nauc_map_at_1_diff1\": 0.482817,\n        \"nauc_map_at_3_max\": 0.419223,\n        \"nauc_map_at_3_std\": 0.058823,\n        \"nauc_map_at_3_diff1\": 0.464053,\n        \"nauc_map_at_5_max\": 0.426188,\n        \"nauc_map_at_5_std\": 0.069444,\n        \"nauc_map_at_5_diff1\": 0.465167,\n        \"nauc_map_at_10_max\": 0.427027,\n        \"nauc_map_at_10_std\": 0.069249,\n        \"nauc_map_at_10_diff1\": 0.461081,\n        \"nauc_map_at_20_max\": 0.430036,\n        \"nauc_map_at_20_std\": 0.075798,\n        \"nauc_map_at_20_diff1\": 0.458386,\n        \"nauc_map_at_100_max\": 0.429814,\n        \"nauc_map_at_100_std\": 0.077453,\n        \"nauc_map_at_100_diff1\": 0.457465,\n        \"nauc_map_at_1000_max\": 0.429917,\n        \"nauc_map_at_1000_std\": 0.077293,\n        \"nauc_map_at_1000_diff1\": 0.457679,\n        \"nauc_recall_at_1_max\": 0.39918,\n        \"nauc_recall_at_1_std\": 0.027622,\n        \"nauc_recall_at_1_diff1\": 0.482817,\n        \"nauc_recall_at_3_max\": 0.419875,\n        \"nauc_recall_at_3_std\": 0.081604,\n        \"nauc_recall_at_3_diff1\": 0.426973,\n        \"nauc_recall_at_5_max\": 0.456315,\n        \"nauc_recall_at_5_std\": 0.134105,\n        \"nauc_recall_at_5_diff1\": 0.430654,\n        \"nauc_recall_at_10_max\": 0.464821,\n        \"nauc_recall_at_10_std\": 0.140302,\n        \"nauc_recall_at_10_diff1\": 0.39827,\n        \"nauc_recall_at_20_max\": 0.519446,\n        \"nauc_recall_at_20_std\": 0.253255,\n        \"nauc_recall_at_20_diff1\": 0.3549,\n        \"nauc_recall_at_100_max\": 0.521197,\n        \"nauc_recall_at_100_std\": 0.413396,\n        \"nauc_recall_at_100_diff1\": 0.261415,\n        \"nauc_recall_at_1000_max\": 0.766601,\n        \"nauc_recall_at_1000_std\": 0.843741,\n        \"nauc_recall_at_1000_diff1\": 0.137502,\n        \"nauc_precision_at_1_max\": 0.39918,\n        \"nauc_precision_at_1_std\": 0.027622,\n        \"nauc_precision_at_1_diff1\": 0.482817,\n        \"nauc_precision_at_3_max\": 0.419875,\n        \"nauc_precision_at_3_std\": 0.081604,\n        \"nauc_precision_at_3_diff1\": 0.426973,\n        \"nauc_precision_at_5_max\": 0.456315,\n        \"nauc_precision_at_5_std\": 0.134105,\n        \"nauc_precision_at_5_diff1\": 0.430654,\n        \"nauc_precision_at_10_max\": 0.464821,\n        \"nauc_precision_at_10_std\": 0.140302,\n        \"nauc_precision_at_10_diff1\": 0.39827,\n        \"nauc_precision_at_20_max\": 0.519446,\n        \"nauc_precision_at_20_std\": 0.253255,\n        \"nauc_precision_at_20_diff1\": 0.3549,\n        \"nauc_precision_at_100_max\": 0.521197,\n        \"nauc_precision_at_100_std\": 0.413396,\n        \"nauc_precision_at_100_diff1\": 0.261415,\n        \"nauc_precision_at_1000_max\": 0.766601,\n        \"nauc_precision_at_1000_std\": 0.843741,\n        \"nauc_precision_at_1000_diff1\": 0.137502,\n        \"nauc_mrr_at_1_max\": 0.39918,\n        \"nauc_mrr_at_1_std\": 0.027622,\n        \"nauc_mrr_at_1_diff1\": 0.482817,\n        \"nauc_mrr_at_3_max\": 0.419223,\n        \"nauc_mrr_at_3_std\": 0.058823,\n        \"nauc_mrr_at_3_diff1\": 0.464053,\n        \"nauc_mrr_at_5_max\": 0.426188,\n        \"nauc_mrr_at_5_std\": 0.069444,\n        \"nauc_mrr_at_5_diff1\": 0.465167,\n        \"nauc_mrr_at_10_max\": 0.427027,\n        \"nauc_mrr_at_10_std\": 0.069249,\n        \"nauc_mrr_at_10_diff1\": 0.461081,\n        \"nauc_mrr_at_20_max\": 0.430036,\n        \"nauc_mrr_at_20_std\": 0.075798,\n        \"nauc_mrr_at_20_diff1\": 0.458386,\n        \"nauc_mrr_at_100_max\": 0.429814,\n        \"nauc_mrr_at_100_std\": 0.077453,\n        \"nauc_mrr_at_100_diff1\": 0.457465,\n        \"nauc_mrr_at_1000_max\": 0.429917,\n        \"nauc_mrr_at_1000_std\": 0.077293,\n        \"nauc_mrr_at_1000_diff1\": 0.457679,\n        \"main_score\": 0.40401,\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ],\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.275,\n        \"ndcg_at_3\": 0.31958,\n        \"ndcg_at_5\": 0.34024,\n        \"ndcg_at_10\": 0.36877,\n        \"ndcg_at_20\": 0.38634,\n        \"ndcg_at_100\": 0.41038,\n        \"ndcg_at_1000\": 0.43478,\n        \"map_at_1\": 0.275,\n        \"map_at_3\": 0.3075,\n        \"map_at_5\": 0.319,\n        \"map_at_10\": 0.33044,\n        \"map_at_20\": 0.33519,\n        \"map_at_100\": 0.33817,\n        \"map_at_1000\": 0.33902,\n        \"recall_at_1\": 0.275,\n        \"recall_at_3\": 0.355,\n        \"recall_at_5\": 0.405,\n        \"recall_at_10\": 0.495,\n        \"recall_at_20\": 0.565,\n        \"recall_at_100\": 0.7,\n        \"recall_at_1000\": 0.895,\n        \"precision_at_1\": 0.275,\n        \"precision_at_3\": 0.11833,\n        \"precision_at_5\": 0.081,\n        \"precision_at_10\": 0.0495,\n        \"precision_at_20\": 0.02825,\n        \"precision_at_100\": 0.007,\n        \"precision_at_1000\": 0.0009,\n        \"mrr_at_1\": 0.275,\n        \"mrr_at_3\": 0.3075,\n        \"mrr_at_5\": 0.319,\n        \"mrr_at_10\": 0.330438,\n        \"mrr_at_20\": 0.335192,\n        \"mrr_at_100\": 0.338168,\n        \"mrr_at_1000\": 0.339015,\n        \"nauc_ndcg_at_1_max\": 0.59183,\n        \"nauc_ndcg_at_1_std\": 0.147642,\n        \"nauc_ndcg_at_1_diff1\": 0.599303,\n        \"nauc_ndcg_at_3_max\": 0.598075,\n        \"nauc_ndcg_at_3_std\": 0.151217,\n        \"nauc_ndcg_at_3_diff1\": 0.555373,\n        \"nauc_ndcg_at_5_max\": 0.60373,\n        \"nauc_ndcg_at_5_std\": 0.156529,\n        \"nauc_ndcg_at_5_diff1\": 0.575234,\n        \"nauc_ndcg_at_10_max\": 0.610056,\n        \"nauc_ndcg_at_10_std\": 0.179175,\n        \"nauc_ndcg_at_10_diff1\": 0.542187,\n        \"nauc_ndcg_at_20_max\": 0.61707,\n        \"nauc_ndcg_at_20_std\": 0.201235,\n        \"nauc_ndcg_at_20_diff1\": 0.542073,\n        \"nauc_ndcg_at_100_max\": 0.622019,\n        \"nauc_ndcg_at_100_std\": 0.204358,\n        \"nauc_ndcg_at_100_diff1\": 0.542194,\n        \"nauc_ndcg_at_1000_max\": 0.619199,\n        \"nauc_ndcg_at_1000_std\": 0.201103,\n        \"nauc_ndcg_at_1000_diff1\": 0.547707,\n        \"nauc_map_at_1_max\": 0.59183,\n        \"nauc_map_at_1_std\": 0.147642,\n        \"nauc_map_at_1_diff1\": 0.599303,\n        \"nauc_map_at_3_max\": 0.595925,\n        \"nauc_map_at_3_std\": 0.150037,\n        \"nauc_map_at_3_diff1\": 0.566575,\n        \"nauc_map_at_5_max\": 0.599379,\n        \"nauc_map_at_5_std\": 0.152998,\n        \"nauc_map_at_5_diff1\": 0.577861,\n        \"nauc_map_at_10_max\": 0.602238,\n        \"nauc_map_at_10_std\": 0.161671,\n        \"nauc_map_at_10_diff1\": 0.56457,\n        \"nauc_map_at_20_max\": 0.603882,\n        \"nauc_map_at_20_std\": 0.166928,\n        \"nauc_map_at_20_diff1\": 0.564489,\n        \"nauc_map_at_100_max\": 0.603692,\n        \"nauc_map_at_100_std\": 0.167095,\n        \"nauc_map_at_100_diff1\": 0.564556,\n        \"nauc_map_at_1000_max\": 0.603511,\n        \"nauc_map_at_1000_std\": 0.16704,\n        \"nauc_map_at_1000_diff1\": 0.564661,\n        \"nauc_recall_at_1_max\": 0.59183,\n        \"nauc_recall_at_1_std\": 0.147642,\n        \"nauc_recall_at_1_diff1\": 0.599303,\n        \"nauc_recall_at_3_max\": 0.604326,\n        \"nauc_recall_at_3_std\": 0.154633,\n        \"nauc_recall_at_3_diff1\": 0.523863,\n        \"nauc_recall_at_5_max\": 0.616376,\n        \"nauc_recall_at_5_std\": 0.167102,\n        \"nauc_recall_at_5_diff1\": 0.570192,\n        \"nauc_recall_at_10_max\": 0.634644,\n        \"nauc_recall_at_10_std\": 0.23984,\n        \"nauc_recall_at_10_diff1\": 0.467283,\n        \"nauc_recall_at_20_max\": 0.66675,\n        \"nauc_recall_at_20_std\": 0.339937,\n        \"nauc_recall_at_20_diff1\": 0.462338,\n        \"nauc_recall_at_100_max\": 0.730166,\n        \"nauc_recall_at_100_std\": 0.401171,\n        \"nauc_recall_at_100_diff1\": 0.444388,\n        \"nauc_recall_at_1000_max\": 0.834146,\n        \"nauc_recall_at_1000_std\": 0.591383,\n        \"nauc_recall_at_1000_diff1\": 0.44743,\n        \"nauc_precision_at_1_max\": 0.59183,\n        \"nauc_precision_at_1_std\": 0.147642,\n        \"nauc_precision_at_1_diff1\": 0.599303,\n        \"nauc_precision_at_3_max\": 0.604326,\n        \"nauc_precision_at_3_std\": 0.154633,\n        \"nauc_precision_at_3_diff1\": 0.523863,\n        \"nauc_precision_at_5_max\": 0.616376,\n        \"nauc_precision_at_5_std\": 0.167102,\n        \"nauc_precision_at_5_diff1\": 0.570192,\n        \"nauc_precision_at_10_max\": 0.634644,\n        \"nauc_precision_at_10_std\": 0.23984,\n        \"nauc_precision_at_10_diff1\": 0.467283,\n        \"nauc_precision_at_20_max\": 0.66675,\n        \"nauc_precision_at_20_std\": 0.339937,\n        \"nauc_precision_at_20_diff1\": 0.462338,\n        \"nauc_precision_at_100_max\": 0.730166,\n        \"nauc_precision_at_100_std\": 0.401171,\n        \"nauc_precision_at_100_diff1\": 0.444388,\n        \"nauc_precision_at_1000_max\": 0.834146,\n        \"nauc_precision_at_1000_std\": 0.591383,\n        \"nauc_precision_at_1000_diff1\": 0.44743,\n        \"nauc_mrr_at_1_max\": 0.59183,\n        \"nauc_mrr_at_1_std\": 0.147642,\n        \"nauc_mrr_at_1_diff1\": 0.599303,\n        \"nauc_mrr_at_3_max\": 0.595925,\n        \"nauc_mrr_at_3_std\": 0.150037,\n        \"nauc_mrr_at_3_diff1\": 0.566575,\n        \"nauc_mrr_at_5_max\": 0.599379,\n        \"nauc_mrr_at_5_std\": 0.152998,\n        \"nauc_mrr_at_5_diff1\": 0.577861,\n        \"nauc_mrr_at_10_max\": 0.602238,\n        \"nauc_mrr_at_10_std\": 0.161671,\n        \"nauc_mrr_at_10_diff1\": 0.56457,\n        \"nauc_mrr_at_20_max\": 0.603882,\n        \"nauc_mrr_at_20_std\": 0.166928,\n        \"nauc_mrr_at_20_diff1\": 0.564489,\n        \"nauc_mrr_at_100_max\": 0.603692,\n        \"nauc_mrr_at_100_std\": 0.167095,\n        \"nauc_mrr_at_100_diff1\": 0.564556,\n        \"nauc_mrr_at_1000_max\": 0.603511,\n        \"nauc_mrr_at_1000_std\": 0.16704,\n        \"nauc_mrr_at_1000_diff1\": 0.564661,\n        \"main_score\": 0.36877,\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 11602.840583086014,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/Snowflake/snowflake-arctic-embed-l-v2.0/no_model_name_available/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"task_name\": \"PublicHealthQA\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.67532,\n        \"ndcg_at_3\": 0.78324,\n        \"ndcg_at_5\": 0.79888,\n        \"ndcg_at_10\": 0.81679,\n        \"ndcg_at_20\": 0.82679,\n        \"ndcg_at_100\": 0.82963,\n        \"ndcg_at_1000\": 0.82963,\n        \"map_at_1\": 0.67532,\n        \"map_at_3\": 0.75758,\n        \"map_at_5\": 0.76602,\n        \"map_at_10\": 0.77406,\n        \"map_at_20\": 0.77689,\n        \"map_at_100\": 0.77745,\n        \"map_at_1000\": 0.77745,\n        \"recall_at_1\": 0.67532,\n        \"recall_at_3\": 0.85714,\n        \"recall_at_5\": 0.8961,\n        \"recall_at_10\": 0.94805,\n        \"recall_at_20\": 0.98701,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.67532,\n        \"precision_at_3\": 0.28571,\n        \"precision_at_5\": 0.17922,\n        \"precision_at_10\": 0.09481,\n        \"precision_at_20\": 0.04935,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.675325,\n        \"mrr_at_3\": 0.757576,\n        \"mrr_at_5\": 0.766017,\n        \"mrr_at_10\": 0.774057,\n        \"mrr_at_20\": 0.776887,\n        \"mrr_at_100\": 0.777451,\n        \"mrr_at_1000\": 0.777451,\n        \"nauc_ndcg_at_1_max\": 0.275234,\n        \"nauc_ndcg_at_1_std\": -0.024039,\n        \"nauc_ndcg_at_1_diff1\": 0.7852,\n        \"nauc_ndcg_at_3_max\": 0.238945,\n        \"nauc_ndcg_at_3_std\": -0.129105,\n        \"nauc_ndcg_at_3_diff1\": 0.725551,\n        \"nauc_ndcg_at_5_max\": 0.260064,\n        \"nauc_ndcg_at_5_std\": -0.14163,\n        \"nauc_ndcg_at_5_diff1\": 0.764278,\n        \"nauc_ndcg_at_10_max\": 0.229219,\n        \"nauc_ndcg_at_10_std\": -0.138331,\n        \"nauc_ndcg_at_10_diff1\": 0.766539,\n        \"nauc_ndcg_at_20_max\": 0.221126,\n        \"nauc_ndcg_at_20_std\": -0.109715,\n        \"nauc_ndcg_at_20_diff1\": 0.756675,\n        \"nauc_ndcg_at_100_max\": 0.247464,\n        \"nauc_ndcg_at_100_std\": -0.101146,\n        \"nauc_ndcg_at_100_diff1\": 0.757323,\n        \"nauc_ndcg_at_1000_max\": 0.247464,\n        \"nauc_ndcg_at_1000_std\": -0.101146,\n        \"nauc_ndcg_at_1000_diff1\": 0.757323,\n        \"nauc_map_at_1_max\": 0.275234,\n        \"nauc_map_at_1_std\": -0.024039,\n        \"nauc_map_at_1_diff1\": 0.7852,\n        \"nauc_map_at_3_max\": 0.253713,\n        \"nauc_map_at_3_std\": -0.099555,\n        \"nauc_map_at_3_diff1\": 0.742159,\n        \"nauc_map_at_5_max\": 0.263202,\n        \"nauc_map_at_5_std\": -0.104581,\n        \"nauc_map_at_5_diff1\": 0.760417,\n        \"nauc_map_at_10_max\": 0.251371,\n        \"nauc_map_at_10_std\": -0.102456,\n        \"nauc_map_at_10_diff1\": 0.760742,\n        \"nauc_map_at_20_max\": 0.249733,\n        \"nauc_map_at_20_std\": -0.093969,\n        \"nauc_map_at_20_diff1\": 0.758372,\n        \"nauc_map_at_100_max\": 0.253853,\n        \"nauc_map_at_100_std\": -0.09261,\n        \"nauc_map_at_100_diff1\": 0.758476,\n        \"nauc_map_at_1000_max\": 0.253853,\n        \"nauc_map_at_1000_std\": -0.09261,\n        \"nauc_map_at_1000_diff1\": 0.758476,\n        \"nauc_recall_at_1_max\": 0.275234,\n        \"nauc_recall_at_1_std\": -0.024039,\n        \"nauc_recall_at_1_diff1\": 0.7852,\n        \"nauc_recall_at_3_max\": 0.170913,\n        \"nauc_recall_at_3_std\": -0.258852,\n        \"nauc_recall_at_3_diff1\": 0.652751,\n        \"nauc_recall_at_5_max\": 0.248113,\n        \"nauc_recall_at_5_std\": -0.353764,\n        \"nauc_recall_at_5_diff1\": 0.801157,\n        \"nauc_recall_at_10_max\": -0.031491,\n        \"nauc_recall_at_10_std\": -0.524913,\n        \"nauc_recall_at_10_diff1\": 0.865007,\n        \"nauc_recall_at_20_max\": -1.164365,\n        \"nauc_recall_at_20_std\": -0.560444,\n        \"nauc_recall_at_20_diff1\": 0.722603,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.275234,\n        \"nauc_precision_at_1_std\": -0.024039,\n        \"nauc_precision_at_1_diff1\": 0.7852,\n        \"nauc_precision_at_3_max\": 0.170913,\n        \"nauc_precision_at_3_std\": -0.258852,\n        \"nauc_precision_at_3_diff1\": 0.652751,\n        \"nauc_precision_at_5_max\": 0.248113,\n        \"nauc_precision_at_5_std\": -0.353764,\n        \"nauc_precision_at_5_diff1\": 0.801157,\n        \"nauc_precision_at_10_max\": -0.031491,\n        \"nauc_precision_at_10_std\": -0.524913,\n        \"nauc_precision_at_10_diff1\": 0.865007,\n        \"nauc_precision_at_20_max\": -1.164365,\n        \"nauc_precision_at_20_std\": -0.560444,\n        \"nauc_precision_at_20_diff1\": 0.722603,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.275234,\n        \"nauc_mrr_at_1_std\": -0.024039,\n        \"nauc_mrr_at_1_diff1\": 0.7852,\n        \"nauc_mrr_at_3_max\": 0.253713,\n        \"nauc_mrr_at_3_std\": -0.099555,\n        \"nauc_mrr_at_3_diff1\": 0.742159,\n        \"nauc_mrr_at_5_max\": 0.263202,\n        \"nauc_mrr_at_5_std\": -0.104581,\n        \"nauc_mrr_at_5_diff1\": 0.760417,\n        \"nauc_mrr_at_10_max\": 0.251371,\n        \"nauc_mrr_at_10_std\": -0.102456,\n        \"nauc_mrr_at_10_diff1\": 0.760742,\n        \"nauc_mrr_at_20_max\": 0.249733,\n        \"nauc_mrr_at_20_std\": -0.093969,\n        \"nauc_mrr_at_20_diff1\": 0.758372,\n        \"nauc_mrr_at_100_max\": 0.253853,\n        \"nauc_mrr_at_100_std\": -0.09261,\n        \"nauc_mrr_at_100_diff1\": 0.758476,\n        \"nauc_mrr_at_1000_max\": 0.253853,\n        \"nauc_mrr_at_1000_std\": -0.09261,\n        \"nauc_mrr_at_1000_diff1\": 0.758476,\n        \"main_score\": 0.81679,\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 2.0190324783325195,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/Snowflake/snowflake-arctic-embed-l-v2.0/no_model_name_available/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"task_name\": \"XPQARetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.34098,\n        \"ndcg_at_3\": 0.37001,\n        \"ndcg_at_5\": 0.39582,\n        \"ndcg_at_10\": 0.43018,\n        \"ndcg_at_20\": 0.45717,\n        \"ndcg_at_100\": 0.49835,\n        \"ndcg_at_1000\": 0.5198,\n        \"map_at_1\": 0.24118,\n        \"map_at_3\": 0.3399,\n        \"map_at_5\": 0.36301,\n        \"map_at_10\": 0.3793,\n        \"map_at_20\": 0.38769,\n        \"map_at_100\": 0.39471,\n        \"map_at_1000\": 0.39563,\n        \"recall_at_1\": 0.24118,\n        \"recall_at_3\": 0.38856,\n        \"recall_at_5\": 0.45178,\n        \"recall_at_10\": 0.54684,\n        \"recall_at_20\": 0.64126,\n        \"recall_at_100\": 0.83856,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.34098,\n        \"precision_at_3\": 0.20897,\n        \"precision_at_5\": 0.14893,\n        \"precision_at_10\": 0.08945,\n        \"precision_at_20\": 0.05252,\n        \"precision_at_100\": 0.01373,\n        \"precision_at_1000\": 0.00156,\n        \"mrr_at_1\": 0.340979,\n        \"mrr_at_3\": 0.390163,\n        \"mrr_at_5\": 0.401784,\n        \"mrr_at_10\": 0.414107,\n        \"mrr_at_20\": 0.420741,\n        \"mrr_at_100\": 0.424817,\n        \"mrr_at_1000\": 0.425472,\n        \"nauc_ndcg_at_1_max\": 0.371938,\n        \"nauc_ndcg_at_1_std\": -0.223132,\n        \"nauc_ndcg_at_1_diff1\": 0.498818,\n        \"nauc_ndcg_at_3_max\": 0.342361,\n        \"nauc_ndcg_at_3_std\": -0.223941,\n        \"nauc_ndcg_at_3_diff1\": 0.440807,\n        \"nauc_ndcg_at_5_max\": 0.323188,\n        \"nauc_ndcg_at_5_std\": -0.236331,\n        \"nauc_ndcg_at_5_diff1\": 0.431617,\n        \"nauc_ndcg_at_10_max\": 0.31163,\n        \"nauc_ndcg_at_10_std\": -0.234533,\n        \"nauc_ndcg_at_10_diff1\": 0.422442,\n        \"nauc_ndcg_at_20_max\": 0.307969,\n        \"nauc_ndcg_at_20_std\": -0.23559,\n        \"nauc_ndcg_at_20_diff1\": 0.413812,\n        \"nauc_ndcg_at_100_max\": 0.321761,\n        \"nauc_ndcg_at_100_std\": -0.213297,\n        \"nauc_ndcg_at_100_diff1\": 0.412137,\n        \"nauc_ndcg_at_1000_max\": 0.327573,\n        \"nauc_ndcg_at_1000_std\": -0.21945,\n        \"nauc_ndcg_at_1000_diff1\": 0.42314,\n        \"nauc_map_at_1_max\": 0.285472,\n        \"nauc_map_at_1_std\": -0.215826,\n        \"nauc_map_at_1_diff1\": 0.551963,\n        \"nauc_map_at_3_max\": 0.34034,\n        \"nauc_map_at_3_std\": -0.21525,\n        \"nauc_map_at_3_diff1\": 0.449593,\n        \"nauc_map_at_5_max\": 0.332048,\n        \"nauc_map_at_5_std\": -0.228033,\n        \"nauc_map_at_5_diff1\": 0.441525,\n        \"nauc_map_at_10_max\": 0.326302,\n        \"nauc_map_at_10_std\": -0.229127,\n        \"nauc_map_at_10_diff1\": 0.43694,\n        \"nauc_map_at_20_max\": 0.325678,\n        \"nauc_map_at_20_std\": -0.229578,\n        \"nauc_map_at_20_diff1\": 0.434603,\n        \"nauc_map_at_100_max\": 0.327011,\n        \"nauc_map_at_100_std\": -0.226667,\n        \"nauc_map_at_100_diff1\": 0.433772,\n        \"nauc_map_at_1000_max\": 0.327509,\n        \"nauc_map_at_1000_std\": -0.226583,\n        \"nauc_map_at_1000_diff1\": 0.434253,\n        \"nauc_recall_at_1_max\": 0.285472,\n        \"nauc_recall_at_1_std\": -0.215826,\n        \"nauc_recall_at_1_diff1\": 0.551963,\n        \"nauc_recall_at_3_max\": 0.32072,\n        \"nauc_recall_at_3_std\": -0.221916,\n        \"nauc_recall_at_3_diff1\": 0.412067,\n        \"nauc_recall_at_5_max\": 0.280654,\n        \"nauc_recall_at_5_std\": -0.246186,\n        \"nauc_recall_at_5_diff1\": 0.381538,\n        \"nauc_recall_at_10_max\": 0.244628,\n        \"nauc_recall_at_10_std\": -0.233764,\n        \"nauc_recall_at_10_diff1\": 0.352702,\n        \"nauc_recall_at_20_max\": 0.214972,\n        \"nauc_recall_at_20_std\": -0.240123,\n        \"nauc_recall_at_20_diff1\": 0.30565,\n        \"nauc_recall_at_100_max\": 0.260948,\n        \"nauc_recall_at_100_std\": -0.082979,\n        \"nauc_recall_at_100_diff1\": 0.243887,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.371938,\n        \"nauc_precision_at_1_std\": -0.223132,\n        \"nauc_precision_at_1_diff1\": 0.498818,\n        \"nauc_precision_at_3_max\": 0.337407,\n        \"nauc_precision_at_3_std\": -0.162082,\n        \"nauc_precision_at_3_diff1\": 0.218464,\n        \"nauc_precision_at_5_max\": 0.280191,\n        \"nauc_precision_at_5_std\": -0.174784,\n        \"nauc_precision_at_5_diff1\": 0.178532,\n        \"nauc_precision_at_10_max\": 0.225539,\n        \"nauc_precision_at_10_std\": -0.159273,\n        \"nauc_precision_at_10_diff1\": 0.125716,\n        \"nauc_precision_at_20_max\": 0.193822,\n        \"nauc_precision_at_20_std\": -0.139024,\n        \"nauc_precision_at_20_diff1\": 0.068406,\n        \"nauc_precision_at_100_max\": 0.194409,\n        \"nauc_precision_at_100_std\": 0.026692,\n        \"nauc_precision_at_100_diff1\": -0.049554,\n        \"nauc_precision_at_1000_max\": 0.183445,\n        \"nauc_precision_at_1000_std\": 0.077361,\n        \"nauc_precision_at_1000_diff1\": -0.123717,\n        \"nauc_mrr_at_1_max\": 0.371938,\n        \"nauc_mrr_at_1_std\": -0.223132,\n        \"nauc_mrr_at_1_diff1\": 0.498818,\n        \"nauc_mrr_at_3_max\": 0.353543,\n        \"nauc_mrr_at_3_std\": -0.233109,\n        \"nauc_mrr_at_3_diff1\": 0.467199,\n        \"nauc_mrr_at_5_max\": 0.343539,\n        \"nauc_mrr_at_5_std\": -0.232805,\n        \"nauc_mrr_at_5_diff1\": 0.45681,\n        \"nauc_mrr_at_10_max\": 0.339967,\n        \"nauc_mrr_at_10_std\": -0.231545,\n        \"nauc_mrr_at_10_diff1\": 0.453967,\n        \"nauc_mrr_at_20_max\": 0.339934,\n        \"nauc_mrr_at_20_std\": -0.230488,\n        \"nauc_mrr_at_20_diff1\": 0.452631,\n        \"nauc_mrr_at_100_max\": 0.341445,\n        \"nauc_mrr_at_100_std\": -0.228595,\n        \"nauc_mrr_at_100_diff1\": 0.45271,\n        \"nauc_mrr_at_1000_max\": 0.341512,\n        \"nauc_mrr_at_1000_std\": -0.228865,\n        \"nauc_mrr_at_1000_diff1\": 0.453134,\n        \"main_score\": 0.43018,\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.3211,\n        \"ndcg_at_3\": 0.32729,\n        \"ndcg_at_5\": 0.34032,\n        \"ndcg_at_10\": 0.37783,\n        \"ndcg_at_20\": 0.40662,\n        \"ndcg_at_100\": 0.45834,\n        \"ndcg_at_1000\": 0.48616,\n        \"map_at_1\": 0.18524,\n        \"map_at_3\": 0.27607,\n        \"map_at_5\": 0.30003,\n        \"map_at_10\": 0.32097,\n        \"map_at_20\": 0.33112,\n        \"map_at_100\": 0.33984,\n        \"map_at_1000\": 0.34145,\n        \"recall_at_1\": 0.18524,\n        \"recall_at_3\": 0.32011,\n        \"recall_at_5\": 0.37513,\n        \"recall_at_10\": 0.47146,\n        \"recall_at_20\": 0.56577,\n        \"recall_at_100\": 0.80892,\n        \"recall_at_1000\": 0.99796,\n        \"precision_at_1\": 0.3211,\n        \"precision_at_3\": 0.21458,\n        \"precision_at_5\": 0.15841,\n        \"precision_at_10\": 0.09924,\n        \"precision_at_20\": 0.05917,\n        \"precision_at_100\": 0.01633,\n        \"precision_at_1000\": 0.00195,\n        \"mrr_at_1\": 0.321101,\n        \"mrr_at_3\": 0.364934,\n        \"mrr_at_5\": 0.378313,\n        \"mrr_at_10\": 0.389471,\n        \"mrr_at_20\": 0.395791,\n        \"mrr_at_100\": 0.400832,\n        \"mrr_at_1000\": 0.401506,\n        \"nauc_ndcg_at_1_max\": 0.274415,\n        \"nauc_ndcg_at_1_std\": -0.192429,\n        \"nauc_ndcg_at_1_diff1\": 0.498666,\n        \"nauc_ndcg_at_3_max\": 0.2414,\n        \"nauc_ndcg_at_3_std\": -0.216653,\n        \"nauc_ndcg_at_3_diff1\": 0.459131,\n        \"nauc_ndcg_at_5_max\": 0.228722,\n        \"nauc_ndcg_at_5_std\": -0.223779,\n        \"nauc_ndcg_at_5_diff1\": 0.447031,\n        \"nauc_ndcg_at_10_max\": 0.214371,\n        \"nauc_ndcg_at_10_std\": -0.238081,\n        \"nauc_ndcg_at_10_diff1\": 0.437757,\n        \"nauc_ndcg_at_20_max\": 0.200516,\n        \"nauc_ndcg_at_20_std\": -0.243786,\n        \"nauc_ndcg_at_20_diff1\": 0.433649,\n        \"nauc_ndcg_at_100_max\": 0.219774,\n        \"nauc_ndcg_at_100_std\": -0.211152,\n        \"nauc_ndcg_at_100_diff1\": 0.440395,\n        \"nauc_ndcg_at_1000_max\": 0.231401,\n        \"nauc_ndcg_at_1000_std\": -0.207592,\n        \"nauc_ndcg_at_1000_diff1\": 0.439766,\n        \"nauc_map_at_1_max\": 0.194908,\n        \"nauc_map_at_1_std\": -0.201311,\n        \"nauc_map_at_1_diff1\": 0.526747,\n        \"nauc_map_at_3_max\": 0.234864,\n        \"nauc_map_at_3_std\": -0.214969,\n        \"nauc_map_at_3_diff1\": 0.480137,\n        \"nauc_map_at_5_max\": 0.238417,\n        \"nauc_map_at_5_std\": -0.218501,\n        \"nauc_map_at_5_diff1\": 0.459737,\n        \"nauc_map_at_10_max\": 0.234651,\n        \"nauc_map_at_10_std\": -0.226327,\n        \"nauc_map_at_10_diff1\": 0.451325,\n        \"nauc_map_at_20_max\": 0.229985,\n        \"nauc_map_at_20_std\": -0.228496,\n        \"nauc_map_at_20_diff1\": 0.450564,\n        \"nauc_map_at_100_max\": 0.231539,\n        \"nauc_map_at_100_std\": -0.224153,\n        \"nauc_map_at_100_diff1\": 0.450247,\n        \"nauc_map_at_1000_max\": 0.232752,\n        \"nauc_map_at_1000_std\": -0.223034,\n        \"nauc_map_at_1000_diff1\": 0.45016,\n        \"nauc_recall_at_1_max\": 0.194908,\n        \"nauc_recall_at_1_std\": -0.201311,\n        \"nauc_recall_at_1_diff1\": 0.526747,\n        \"nauc_recall_at_3_max\": 0.190339,\n        \"nauc_recall_at_3_std\": -0.23048,\n        \"nauc_recall_at_3_diff1\": 0.440644,\n        \"nauc_recall_at_5_max\": 0.185054,\n        \"nauc_recall_at_5_std\": -0.235978,\n        \"nauc_recall_at_5_diff1\": 0.397687,\n        \"nauc_recall_at_10_max\": 0.14123,\n        \"nauc_recall_at_10_std\": -0.271337,\n        \"nauc_recall_at_10_diff1\": 0.376031,\n        \"nauc_recall_at_20_max\": 0.085163,\n        \"nauc_recall_at_20_std\": -0.296573,\n        \"nauc_recall_at_20_diff1\": 0.351952,\n        \"nauc_recall_at_100_max\": 0.139824,\n        \"nauc_recall_at_100_std\": -0.129667,\n        \"nauc_recall_at_100_diff1\": 0.384461,\n        \"nauc_recall_at_1000_max\": 0.707255,\n        \"nauc_recall_at_1000_std\": 0.400807,\n        \"nauc_recall_at_1000_diff1\": -0.343666,\n        \"nauc_precision_at_1_max\": 0.274415,\n        \"nauc_precision_at_1_std\": -0.192429,\n        \"nauc_precision_at_1_diff1\": 0.498666,\n        \"nauc_precision_at_3_max\": 0.257978,\n        \"nauc_precision_at_3_std\": -0.170719,\n        \"nauc_precision_at_3_diff1\": 0.310497,\n        \"nauc_precision_at_5_max\": 0.232798,\n        \"nauc_precision_at_5_std\": -0.157916,\n        \"nauc_precision_at_5_diff1\": 0.241854,\n        \"nauc_precision_at_10_max\": 0.188433,\n        \"nauc_precision_at_10_std\": -0.163574,\n        \"nauc_precision_at_10_diff1\": 0.191728,\n        \"nauc_precision_at_20_max\": 0.142616,\n        \"nauc_precision_at_20_std\": -0.150251,\n        \"nauc_precision_at_20_diff1\": 0.158454,\n        \"nauc_precision_at_100_max\": 0.159918,\n        \"nauc_precision_at_100_std\": 0.018437,\n        \"nauc_precision_at_100_diff1\": 0.066529,\n        \"nauc_precision_at_1000_max\": 0.170039,\n        \"nauc_precision_at_1000_std\": 0.101311,\n        \"nauc_precision_at_1000_diff1\": -0.027352,\n        \"nauc_mrr_at_1_max\": 0.274415,\n        \"nauc_mrr_at_1_std\": -0.192429,\n        \"nauc_mrr_at_1_diff1\": 0.498666,\n        \"nauc_mrr_at_3_max\": 0.246087,\n        \"nauc_mrr_at_3_std\": -0.212935,\n        \"nauc_mrr_at_3_diff1\": 0.471176,\n        \"nauc_mrr_at_5_max\": 0.243808,\n        \"nauc_mrr_at_5_std\": -0.210646,\n        \"nauc_mrr_at_5_diff1\": 0.46394,\n        \"nauc_mrr_at_10_max\": 0.238075,\n        \"nauc_mrr_at_10_std\": -0.212904,\n        \"nauc_mrr_at_10_diff1\": 0.461785,\n        \"nauc_mrr_at_20_max\": 0.235441,\n        \"nauc_mrr_at_20_std\": -0.213807,\n        \"nauc_mrr_at_20_diff1\": 0.460976,\n        \"nauc_mrr_at_100_max\": 0.23882,\n        \"nauc_mrr_at_100_std\": -0.209904,\n        \"nauc_mrr_at_100_diff1\": 0.46242,\n        \"nauc_mrr_at_1000_max\": 0.239092,\n        \"nauc_mrr_at_1000_std\": -0.209955,\n        \"nauc_mrr_at_1000_diff1\": 0.462475,\n        \"main_score\": 0.37783,\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.31107,\n        \"ndcg_at_3\": 0.33633,\n        \"ndcg_at_5\": 0.36534,\n        \"ndcg_at_10\": 0.39146,\n        \"ndcg_at_20\": 0.42104,\n        \"ndcg_at_100\": 0.46851,\n        \"ndcg_at_1000\": 0.49445,\n        \"map_at_1\": 0.21633,\n        \"map_at_3\": 0.30453,\n        \"map_at_5\": 0.3291,\n        \"map_at_10\": 0.3436,\n        \"map_at_20\": 0.35342,\n        \"map_at_100\": 0.36168,\n        \"map_at_1000\": 0.36292,\n        \"recall_at_1\": 0.21633,\n        \"recall_at_3\": 0.34737,\n        \"recall_at_5\": 0.41921,\n        \"recall_at_10\": 0.48758,\n        \"recall_at_20\": 0.59012,\n        \"recall_at_100\": 0.8113,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.31107,\n        \"precision_at_3\": 0.19598,\n        \"precision_at_5\": 0.14332,\n        \"precision_at_10\": 0.0855,\n        \"precision_at_20\": 0.05147,\n        \"precision_at_100\": 0.01417,\n        \"precision_at_1000\": 0.00167,\n        \"mrr_at_1\": 0.311075,\n        \"mrr_at_3\": 0.360206,\n        \"mrr_at_5\": 0.376004,\n        \"mrr_at_10\": 0.384515,\n        \"mrr_at_20\": 0.391031,\n        \"mrr_at_100\": 0.396106,\n        \"mrr_at_1000\": 0.396896,\n        \"nauc_ndcg_at_1_max\": 0.235083,\n        \"nauc_ndcg_at_1_std\": -0.247901,\n        \"nauc_ndcg_at_1_diff1\": 0.521614,\n        \"nauc_ndcg_at_3_max\": 0.208812,\n        \"nauc_ndcg_at_3_std\": -0.238682,\n        \"nauc_ndcg_at_3_diff1\": 0.466576,\n        \"nauc_ndcg_at_5_max\": 0.198242,\n        \"nauc_ndcg_at_5_std\": -0.244,\n        \"nauc_ndcg_at_5_diff1\": 0.452791,\n        \"nauc_ndcg_at_10_max\": 0.198586,\n        \"nauc_ndcg_at_10_std\": -0.246105,\n        \"nauc_ndcg_at_10_diff1\": 0.434085,\n        \"nauc_ndcg_at_20_max\": 0.180033,\n        \"nauc_ndcg_at_20_std\": -0.25126,\n        \"nauc_ndcg_at_20_diff1\": 0.424635,\n        \"nauc_ndcg_at_100_max\": 0.202984,\n        \"nauc_ndcg_at_100_std\": -0.217858,\n        \"nauc_ndcg_at_100_diff1\": 0.433032,\n        \"nauc_ndcg_at_1000_max\": 0.207098,\n        \"nauc_ndcg_at_1000_std\": -0.230045,\n        \"nauc_ndcg_at_1000_diff1\": 0.443934,\n        \"nauc_map_at_1_max\": 0.180573,\n        \"nauc_map_at_1_std\": -0.20972,\n        \"nauc_map_at_1_diff1\": 0.574387,\n        \"nauc_map_at_3_max\": 0.212718,\n        \"nauc_map_at_3_std\": -0.225802,\n        \"nauc_map_at_3_diff1\": 0.481218,\n        \"nauc_map_at_5_max\": 0.203508,\n        \"nauc_map_at_5_std\": -0.237369,\n        \"nauc_map_at_5_diff1\": 0.466685,\n        \"nauc_map_at_10_max\": 0.199659,\n        \"nauc_map_at_10_std\": -0.244784,\n        \"nauc_map_at_10_diff1\": 0.454792,\n        \"nauc_map_at_20_max\": 0.194065,\n        \"nauc_map_at_20_std\": -0.2454,\n        \"nauc_map_at_20_diff1\": 0.450977,\n        \"nauc_map_at_100_max\": 0.197705,\n        \"nauc_map_at_100_std\": -0.240541,\n        \"nauc_map_at_100_diff1\": 0.452898,\n        \"nauc_map_at_1000_max\": 0.198274,\n        \"nauc_map_at_1000_std\": -0.240633,\n        \"nauc_map_at_1000_diff1\": 0.45334,\n        \"nauc_recall_at_1_max\": 0.180573,\n        \"nauc_recall_at_1_std\": -0.20972,\n        \"nauc_recall_at_1_diff1\": 0.574387,\n        \"nauc_recall_at_3_max\": 0.200321,\n        \"nauc_recall_at_3_std\": -0.217471,\n        \"nauc_recall_at_3_diff1\": 0.440816,\n        \"nauc_recall_at_5_max\": 0.172545,\n        \"nauc_recall_at_5_std\": -0.23075,\n        \"nauc_recall_at_5_diff1\": 0.394698,\n        \"nauc_recall_at_10_max\": 0.173802,\n        \"nauc_recall_at_10_std\": -0.230833,\n        \"nauc_recall_at_10_diff1\": 0.342878,\n        \"nauc_recall_at_20_max\": 0.093338,\n        \"nauc_recall_at_20_std\": -0.255665,\n        \"nauc_recall_at_20_diff1\": 0.29516,\n        \"nauc_recall_at_100_max\": 0.179841,\n        \"nauc_recall_at_100_std\": -0.023651,\n        \"nauc_recall_at_100_diff1\": 0.273318,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.235083,\n        \"nauc_precision_at_1_std\": -0.247901,\n        \"nauc_precision_at_1_diff1\": 0.521614,\n        \"nauc_precision_at_3_max\": 0.19542,\n        \"nauc_precision_at_3_std\": -0.211587,\n        \"nauc_precision_at_3_diff1\": 0.248417,\n        \"nauc_precision_at_5_max\": 0.144452,\n        \"nauc_precision_at_5_std\": -0.22976,\n        \"nauc_precision_at_5_diff1\": 0.192698,\n        \"nauc_precision_at_10_max\": 0.122354,\n        \"nauc_precision_at_10_std\": -0.217942,\n        \"nauc_precision_at_10_diff1\": 0.134457,\n        \"nauc_precision_at_20_max\": 0.07614,\n        \"nauc_precision_at_20_std\": -0.19295,\n        \"nauc_precision_at_20_diff1\": 0.084722,\n        \"nauc_precision_at_100_max\": 0.146839,\n        \"nauc_precision_at_100_std\": 0.009803,\n        \"nauc_precision_at_100_diff1\": 0.006768,\n        \"nauc_precision_at_1000_max\": 0.15342,\n        \"nauc_precision_at_1000_std\": 0.044927,\n        \"nauc_precision_at_1000_diff1\": -0.068738,\n        \"nauc_mrr_at_1_max\": 0.235083,\n        \"nauc_mrr_at_1_std\": -0.247901,\n        \"nauc_mrr_at_1_diff1\": 0.521614,\n        \"nauc_mrr_at_3_max\": 0.223592,\n        \"nauc_mrr_at_3_std\": -0.250996,\n        \"nauc_mrr_at_3_diff1\": 0.48789,\n        \"nauc_mrr_at_5_max\": 0.218129,\n        \"nauc_mrr_at_5_std\": -0.251186,\n        \"nauc_mrr_at_5_diff1\": 0.481346,\n        \"nauc_mrr_at_10_max\": 0.221502,\n        \"nauc_mrr_at_10_std\": -0.246732,\n        \"nauc_mrr_at_10_diff1\": 0.476944,\n        \"nauc_mrr_at_20_max\": 0.217876,\n        \"nauc_mrr_at_20_std\": -0.249077,\n        \"nauc_mrr_at_20_diff1\": 0.476331,\n        \"nauc_mrr_at_100_max\": 0.219187,\n        \"nauc_mrr_at_100_std\": -0.246605,\n        \"nauc_mrr_at_100_diff1\": 0.476969,\n        \"nauc_mrr_at_1000_max\": 0.219149,\n        \"nauc_mrr_at_1000_std\": -0.247012,\n        \"nauc_mrr_at_1000_diff1\": 0.477279,\n        \"main_score\": 0.39146,\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 14.93372392654419,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/Snowflake/snowflake-arctic-embed-l-v2.0/no_model_name_available/no_revision_available/model_meta.json",
    "content": "{\"name\": \"no_model_name_available\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": null, \"n_parameters\": null, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": null, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"zero_shot_benchmarks\": null, \"adapted_from\": null, \"superseded_by\": null, \"loader\": null}"
  },
  {
    "path": "eval/results/dragonkue/BGE-m3-ko/dragonkue__BGE-m3-ko/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 22.999385833740234,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.87379,\n        \"map_at_1\": 0.75439,\n        \"map_at_10\": 0.83841,\n        \"map_at_100\": 0.83957,\n        \"map_at_1000\": 0.83957,\n        \"map_at_20\": 0.83957,\n        \"map_at_3\": 0.82602,\n        \"map_at_5\": 0.83216,\n        \"mrr_at_1\": 0.7543859649122807,\n        \"mrr_at_10\": 0.8384120022277919,\n        \"mrr_at_100\": 0.8395740954951483,\n        \"mrr_at_1000\": 0.8395740954951483,\n        \"mrr_at_20\": 0.8395740954951483,\n        \"mrr_at_3\": 0.8260233918128655,\n        \"mrr_at_5\": 0.8321637426900585,\n        \"nauc_map_at_1000_diff1\": 0.7553580826697276,\n        \"nauc_map_at_1000_max\": 0.15569810026809622,\n        \"nauc_map_at_1000_std\": -0.691306901301535,\n        \"nauc_map_at_100_diff1\": 0.7553580826697276,\n        \"nauc_map_at_100_max\": 0.15569810026809622,\n        \"nauc_map_at_100_std\": -0.691306901301535,\n        \"nauc_map_at_10_diff1\": 0.7543342191950719,\n        \"nauc_map_at_10_max\": 0.15938639419130274,\n        \"nauc_map_at_10_std\": -0.6934863935974837,\n        \"nauc_map_at_1_diff1\": 0.7493933183304148,\n        \"nauc_map_at_1_max\": 0.06264615667212535,\n        \"nauc_map_at_1_std\": -0.6420183946779819,\n        \"nauc_map_at_20_diff1\": 0.7553580826697276,\n        \"nauc_map_at_20_max\": 0.15569810026809622,\n        \"nauc_map_at_20_std\": -0.691306901301535,\n        \"nauc_map_at_3_diff1\": 0.7616179634532826,\n        \"nauc_map_at_3_max\": 0.1681637034361113,\n        \"nauc_map_at_3_std\": -0.7226590901715979,\n        \"nauc_map_at_5_diff1\": 0.7610831361890733,\n        \"nauc_map_at_5_max\": 0.1768332483014387,\n        \"nauc_map_at_5_std\": -0.6970842647826092,\n        \"nauc_mrr_at_1000_diff1\": 0.7553580826697276,\n        \"nauc_mrr_at_1000_max\": 0.15569810026809622,\n        \"nauc_mrr_at_1000_std\": -0.691306901301535,\n        \"nauc_mrr_at_100_diff1\": 0.7553580826697276,\n        \"nauc_mrr_at_100_max\": 0.15569810026809622,\n        \"nauc_mrr_at_100_std\": -0.691306901301535,\n        \"nauc_mrr_at_10_diff1\": 0.7543342191950719,\n        \"nauc_mrr_at_10_max\": 0.15938639419130274,\n        \"nauc_mrr_at_10_std\": -0.6934863935974837,\n        \"nauc_mrr_at_1_diff1\": 0.7493933183304148,\n        \"nauc_mrr_at_1_max\": 0.06264615667212535,\n        \"nauc_mrr_at_1_std\": -0.6420183946779819,\n        \"nauc_mrr_at_20_diff1\": 0.7553580826697276,\n        \"nauc_mrr_at_20_max\": 0.15569810026809622,\n        \"nauc_mrr_at_20_std\": -0.691306901301535,\n        \"nauc_mrr_at_3_diff1\": 0.7616179634532826,\n        \"nauc_mrr_at_3_max\": 0.1681637034361113,\n        \"nauc_mrr_at_3_std\": -0.7226590901715979,\n        \"nauc_mrr_at_5_diff1\": 0.7610831361890733,\n        \"nauc_mrr_at_5_max\": 0.1768332483014387,\n        \"nauc_mrr_at_5_std\": -0.6970842647826092,\n        \"nauc_ndcg_at_1000_diff1\": 0.7560582117239595,\n        \"nauc_ndcg_at_1000_max\": 0.165803773315689,\n        \"nauc_ndcg_at_1000_std\": -0.696811115693176,\n        \"nauc_ndcg_at_100_diff1\": 0.7560582117239595,\n        \"nauc_ndcg_at_100_max\": 0.165803773315689,\n        \"nauc_ndcg_at_100_std\": -0.696811115693176,\n        \"nauc_ndcg_at_10_diff1\": 0.751463249238206,\n        \"nauc_ndcg_at_10_max\": 0.18342906202141002,\n        \"nauc_ndcg_at_10_std\": -0.703275491144023,\n        \"nauc_ndcg_at_1_diff1\": 0.7493933183304148,\n        \"nauc_ndcg_at_1_max\": 0.06264615667212535,\n        \"nauc_ndcg_at_1_std\": -0.6420183946779819,\n        \"nauc_ndcg_at_20_diff1\": 0.7560582117239595,\n        \"nauc_ndcg_at_20_max\": 0.165803773315689,\n        \"nauc_ndcg_at_20_std\": -0.696811115693176,\n        \"nauc_ndcg_at_3_diff1\": 0.7704450250564626,\n        \"nauc_ndcg_at_3_max\": 0.20710284523661493,\n        \"nauc_ndcg_at_3_std\": -0.7680242628597699,\n        \"nauc_ndcg_at_5_diff1\": 0.7702091882328883,\n        \"nauc_ndcg_at_5_max\": 0.2274499137326895,\n        \"nauc_ndcg_at_5_std\": -0.7186386105526826,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.638583133029159,\n        \"nauc_precision_at_10_max\": 0.638583133029159,\n        \"nauc_precision_at_10_std\": -0.8171511695270405,\n        \"nauc_precision_at_1_diff1\": 0.7493933183304148,\n        \"nauc_precision_at_1_max\": 0.06264615667212535,\n        \"nauc_precision_at_1_std\": -0.6420183946779819,\n        \"nauc_precision_at_20_diff1\": 1.0,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 1.0,\n        \"nauc_precision_at_3_diff1\": 0.8183963637732921,\n        \"nauc_precision_at_3_max\": 0.40576075757101193,\n        \"nauc_precision_at_3_std\": -1.010017397627182,\n        \"nauc_precision_at_5_diff1\": 0.8384802315250225,\n        \"nauc_precision_at_5_max\": 0.5892262094609966,\n        \"nauc_precision_at_5_std\": -0.864259619975316,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.6385831330291614,\n        \"nauc_recall_at_10_max\": 0.6385831330291614,\n        \"nauc_recall_at_10_std\": -0.8171511695270118,\n        \"nauc_recall_at_1_diff1\": 0.7493933183304148,\n        \"nauc_recall_at_1_max\": 0.06264615667212535,\n        \"nauc_recall_at_1_std\": -0.6420183946779819,\n        \"nauc_recall_at_20_diff1\": NaN,\n        \"nauc_recall_at_20_max\": NaN,\n        \"nauc_recall_at_20_std\": NaN,\n        \"nauc_recall_at_3_diff1\": 0.8183963637732907,\n        \"nauc_recall_at_3_max\": 0.4057607575710131,\n        \"nauc_recall_at_3_std\": -1.0100173976271816,\n        \"nauc_recall_at_5_diff1\": 0.8384802315250196,\n        \"nauc_recall_at_5_max\": 0.589226209460994,\n        \"nauc_recall_at_5_std\": -0.8642596199753173,\n        \"ndcg_at_1\": 0.75439,\n        \"ndcg_at_10\": 0.87379,\n        \"ndcg_at_100\": 0.87816,\n        \"ndcg_at_1000\": 0.87816,\n        \"ndcg_at_20\": 0.87816,\n        \"ndcg_at_3\": 0.84826,\n        \"ndcg_at_5\": 0.85921,\n        \"precision_at_1\": 0.75439,\n        \"precision_at_10\": 0.09825,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.05,\n        \"precision_at_3\": 0.30409,\n        \"precision_at_5\": 0.18772,\n        \"recall_at_1\": 0.75439,\n        \"recall_at_10\": 0.98246,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 1.0,\n        \"recall_at_3\": 0.91228,\n        \"recall_at_5\": 0.9386\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/dragonkue/BGE-m3-ko/dragonkue__BGE-m3-ko/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 20.49944758415222,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.95027,\n        \"map_at_1\": 0.90889,\n        \"map_at_10\": 0.93864,\n        \"map_at_100\": 0.93898,\n        \"map_at_1000\": 0.939,\n        \"map_at_20\": 0.93884,\n        \"map_at_3\": 0.935,\n        \"map_at_5\": 0.93744,\n        \"mrr_at_1\": 0.9088888888888889,\n        \"mrr_at_10\": 0.9386366843033511,\n        \"mrr_at_100\": 0.9389811252026834,\n        \"mrr_at_1000\": 0.938999955232359,\n        \"mrr_at_20\": 0.9388439733593242,\n        \"mrr_at_3\": 0.9350000000000003,\n        \"mrr_at_5\": 0.9374444444444445,\n        \"nauc_map_at_1000_diff1\": 0.926260018196481,\n        \"nauc_map_at_1000_max\": 0.8410999356826026,\n        \"nauc_map_at_1000_std\": -0.09167429373268775,\n        \"nauc_map_at_100_diff1\": 0.9262622706953337,\n        \"nauc_map_at_100_max\": 0.8411394879430902,\n        \"nauc_map_at_100_std\": -0.09142238699159651,\n        \"nauc_map_at_10_diff1\": 0.9260798552935571,\n        \"nauc_map_at_10_max\": 0.8405924657296209,\n        \"nauc_map_at_10_std\": -0.09365617696316625,\n        \"nauc_map_at_1_diff1\": 0.9282924551934596,\n        \"nauc_map_at_1_max\": 0.8302418528386962,\n        \"nauc_map_at_1_std\": -0.09564232196943509,\n        \"nauc_map_at_20_diff1\": 0.9263382226923206,\n        \"nauc_map_at_20_max\": 0.8414087434785231,\n        \"nauc_map_at_20_std\": -0.09255316406161156,\n        \"nauc_map_at_3_diff1\": 0.9257955793903508,\n        \"nauc_map_at_3_max\": 0.841332354404249,\n        \"nauc_map_at_3_std\": -0.10062486533074633,\n        \"nauc_map_at_5_diff1\": 0.9262936870031215,\n        \"nauc_map_at_5_max\": 0.8423775470322344,\n        \"nauc_map_at_5_std\": -0.09012841371006793,\n        \"nauc_mrr_at_1000_diff1\": 0.926260018196481,\n        \"nauc_mrr_at_1000_max\": 0.8410999356826026,\n        \"nauc_mrr_at_1000_std\": -0.09167429373268775,\n        \"nauc_mrr_at_100_diff1\": 0.9262622706953337,\n        \"nauc_mrr_at_100_max\": 0.8411394879430902,\n        \"nauc_mrr_at_100_std\": -0.09142238699159651,\n        \"nauc_mrr_at_10_diff1\": 0.9260798552935571,\n        \"nauc_mrr_at_10_max\": 0.8405924657296209,\n        \"nauc_mrr_at_10_std\": -0.09365617696316625,\n        \"nauc_mrr_at_1_diff1\": 0.9282924551934596,\n        \"nauc_mrr_at_1_max\": 0.8302418528386962,\n        \"nauc_mrr_at_1_std\": -0.09564232196943509,\n        \"nauc_mrr_at_20_diff1\": 0.9263382226923206,\n        \"nauc_mrr_at_20_max\": 0.8414087434785231,\n        \"nauc_mrr_at_20_std\": -0.09255316406161156,\n        \"nauc_mrr_at_3_diff1\": 0.9257955793903508,\n        \"nauc_mrr_at_3_max\": 0.841332354404249,\n        \"nauc_mrr_at_3_std\": -0.10062486533074633,\n        \"nauc_mrr_at_5_diff1\": 0.9262936870031215,\n        \"nauc_mrr_at_5_max\": 0.8423775470322344,\n        \"nauc_mrr_at_5_std\": -0.09012841371006793,\n        \"nauc_ndcg_at_1000_diff1\": 0.926427485475153,\n        \"nauc_ndcg_at_1000_max\": 0.8437950581403517,\n        \"nauc_ndcg_at_1000_std\": -0.08569476135678136,\n        \"nauc_ndcg_at_100_diff1\": 0.9265205593685252,\n        \"nauc_ndcg_at_100_max\": 0.845252988548431,\n        \"nauc_ndcg_at_100_std\": -0.0763280082712212,\n        \"nauc_ndcg_at_10_diff1\": 0.9261317588839924,\n        \"nauc_ndcg_at_10_max\": 0.8439812832617384,\n        \"nauc_ndcg_at_10_std\": -0.08993729428532617,\n        \"nauc_ndcg_at_1_diff1\": 0.9282924551934596,\n        \"nauc_ndcg_at_1_max\": 0.8302418528386962,\n        \"nauc_ndcg_at_1_std\": -0.09564232196943509,\n        \"nauc_ndcg_at_20_diff1\": 0.9272449406946948,\n        \"nauc_ndcg_at_20_max\": 0.8478768490075218,\n        \"nauc_ndcg_at_20_std\": -0.08408505632860358,\n        \"nauc_ndcg_at_3_diff1\": 0.9255871319261063,\n        \"nauc_ndcg_at_3_max\": 0.8458986599961826,\n        \"nauc_ndcg_at_3_std\": -0.10218990873613223,\n        \"nauc_ndcg_at_5_diff1\": 0.9265901724509867,\n        \"nauc_ndcg_at_5_max\": 0.8487990745945639,\n        \"nauc_ndcg_at_5_std\": -0.07950641622331456,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9346405228758011,\n        \"nauc_precision_at_100_max\": 0.9673202614378776,\n        \"nauc_precision_at_100_std\": 0.7071661998132774,\n        \"nauc_precision_at_10_diff1\": 0.9283559577677162,\n        \"nauc_precision_at_10_max\": 0.8797313797313696,\n        \"nauc_precision_at_10_std\": -0.04787043022338166,\n        \"nauc_precision_at_1_diff1\": 0.9282924551934596,\n        \"nauc_precision_at_1_max\": 0.8302418528386962,\n        \"nauc_precision_at_1_std\": -0.09564232196943509,\n        \"nauc_precision_at_20_diff1\": 0.9477124183006497,\n        \"nauc_precision_at_20_max\": 0.959150326797383,\n        \"nauc_precision_at_20_std\": 0.07348272642390268,\n        \"nauc_precision_at_3_diff1\": 0.9250022589681047,\n        \"nauc_precision_at_3_max\": 0.8701996927803407,\n        \"nauc_precision_at_3_std\": -0.11020752386976498,\n        \"nauc_precision_at_5_diff1\": 0.9299719887955139,\n        \"nauc_precision_at_5_max\": 0.8990929705215371,\n        \"nauc_precision_at_5_std\": 0.01182695300341017,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9346405228758294,\n        \"nauc_recall_at_100_max\": 0.9673202614379001,\n        \"nauc_recall_at_100_std\": 0.7071661998132666,\n        \"nauc_recall_at_10_diff1\": 0.928355957767723,\n        \"nauc_recall_at_10_max\": 0.8797313797313832,\n        \"nauc_recall_at_10_std\": -0.04787043022337262,\n        \"nauc_recall_at_1_diff1\": 0.9282924551934596,\n        \"nauc_recall_at_1_max\": 0.8302418528386962,\n        \"nauc_recall_at_1_std\": -0.09564232196943509,\n        \"nauc_recall_at_20_diff1\": 0.9477124183006521,\n        \"nauc_recall_at_20_max\": 0.9591503267973885,\n        \"nauc_recall_at_20_std\": 0.07348272642390039,\n        \"nauc_recall_at_3_diff1\": 0.9250022589680997,\n        \"nauc_recall_at_3_max\": 0.8701996927803363,\n        \"nauc_recall_at_3_std\": -0.11020752386975824,\n        \"nauc_recall_at_5_diff1\": 0.9299719887955186,\n        \"nauc_recall_at_5_max\": 0.8990929705215392,\n        \"nauc_recall_at_5_std\": 0.011826953003422682,\n        \"ndcg_at_1\": 0.90889,\n        \"ndcg_at_10\": 0.95027,\n        \"ndcg_at_100\": 0.95225,\n        \"ndcg_at_1000\": 0.95281,\n        \"ndcg_at_20\": 0.95108,\n        \"ndcg_at_3\": 0.9429,\n        \"ndcg_at_5\": 0.94739,\n        \"precision_at_1\": 0.90889,\n        \"precision_at_10\": 0.09856,\n        \"precision_at_100\": 0.00996,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04944,\n        \"precision_at_3\": 0.32185,\n        \"precision_at_5\": 0.19533,\n        \"recall_at_1\": 0.90889,\n        \"recall_at_10\": 0.98556,\n        \"recall_at_100\": 0.99556,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98889,\n        \"recall_at_3\": 0.96556,\n        \"recall_at_5\": 0.97667\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.9243,\n        \"map_at_1\": 0.86778,\n        \"map_at_10\": 0.90697,\n        \"map_at_100\": 0.90797,\n        \"map_at_1000\": 0.90799,\n        \"map_at_20\": 0.90784,\n        \"map_at_3\": 0.89981,\n        \"map_at_5\": 0.90387,\n        \"mrr_at_1\": 0.8677777777777778,\n        \"mrr_at_10\": 0.9069664902998237,\n        \"mrr_at_100\": 0.9079666626771419,\n        \"mrr_at_1000\": 0.9079885704290849,\n        \"mrr_at_20\": 0.9078379264163577,\n        \"mrr_at_3\": 0.8998148148148151,\n        \"mrr_at_5\": 0.9038703703703705,\n        \"nauc_map_at_1000_diff1\": 0.8850402796626184,\n        \"nauc_map_at_1000_max\": 0.7599982828341915,\n        \"nauc_map_at_1000_std\": 0.00892263162801917,\n        \"nauc_map_at_100_diff1\": 0.8850459164348188,\n        \"nauc_map_at_100_max\": 0.7600567511471158,\n        \"nauc_map_at_100_std\": 0.009088482022350434,\n        \"nauc_map_at_10_diff1\": 0.8844167646901695,\n        \"nauc_map_at_10_max\": 0.7605216684007551,\n        \"nauc_map_at_10_std\": 0.008632526869306515,\n        \"nauc_map_at_1_diff1\": 0.8992049534399333,\n        \"nauc_map_at_1_max\": 0.7400578657740957,\n        \"nauc_map_at_1_std\": -0.01392344536385056,\n        \"nauc_map_at_20_diff1\": 0.8847442992928001,\n        \"nauc_map_at_20_max\": 0.7601359790995998,\n        \"nauc_map_at_20_std\": 0.009396726928626828,\n        \"nauc_map_at_3_diff1\": 0.8836902425995753,\n        \"nauc_map_at_3_max\": 0.7634041510425207,\n        \"nauc_map_at_3_std\": 0.002016815018924026,\n        \"nauc_map_at_5_diff1\": 0.8838014395998648,\n        \"nauc_map_at_5_max\": 0.7580897726104552,\n        \"nauc_map_at_5_std\": 0.0029415599545449143,\n        \"nauc_mrr_at_1000_diff1\": 0.8850402796626184,\n        \"nauc_mrr_at_1000_max\": 0.7599982828341915,\n        \"nauc_mrr_at_1000_std\": 0.00892263162801917,\n        \"nauc_mrr_at_100_diff1\": 0.8850459164348188,\n        \"nauc_mrr_at_100_max\": 0.7600567511471158,\n        \"nauc_mrr_at_100_std\": 0.009088482022350434,\n        \"nauc_mrr_at_10_diff1\": 0.8844167646901695,\n        \"nauc_mrr_at_10_max\": 0.7605216684007551,\n        \"nauc_mrr_at_10_std\": 0.008632526869306515,\n        \"nauc_mrr_at_1_diff1\": 0.8992049534399333,\n        \"nauc_mrr_at_1_max\": 0.7400578657740957,\n        \"nauc_mrr_at_1_std\": -0.01392344536385056,\n        \"nauc_mrr_at_20_diff1\": 0.8847442992928001,\n        \"nauc_mrr_at_20_max\": 0.7601359790995998,\n        \"nauc_mrr_at_20_std\": 0.009396726928626828,\n        \"nauc_mrr_at_3_diff1\": 0.8836902425995753,\n        \"nauc_mrr_at_3_max\": 0.7634041510425207,\n        \"nauc_mrr_at_3_std\": 0.002016815018924026,\n        \"nauc_mrr_at_5_diff1\": 0.8838014395998648,\n        \"nauc_mrr_at_5_max\": 0.7580897726104552,\n        \"nauc_mrr_at_5_std\": 0.0029415599545449143,\n        \"nauc_ndcg_at_1000_diff1\": 0.8825641009246987,\n        \"nauc_ndcg_at_1000_max\": 0.7631111439660291,\n        \"nauc_ndcg_at_1000_std\": 0.01749127399569384,\n        \"nauc_ndcg_at_100_diff1\": 0.8826975512935871,\n        \"nauc_ndcg_at_100_max\": 0.7650497757016197,\n        \"nauc_ndcg_at_100_std\": 0.02378241842482664,\n        \"nauc_ndcg_at_10_diff1\": 0.8782614858008976,\n        \"nauc_ndcg_at_10_max\": 0.7674941037073223,\n        \"nauc_ndcg_at_10_std\": 0.025064113529180507,\n        \"nauc_ndcg_at_1_diff1\": 0.8992049534399333,\n        \"nauc_ndcg_at_1_max\": 0.7400578657740957,\n        \"nauc_ndcg_at_1_std\": -0.01392344536385056,\n        \"nauc_ndcg_at_20_diff1\": 0.8792986972419587,\n        \"nauc_ndcg_at_20_max\": 0.765631594679748,\n        \"nauc_ndcg_at_20_std\": 0.027100791792958764,\n        \"nauc_ndcg_at_3_diff1\": 0.8772492993225067,\n        \"nauc_ndcg_at_3_max\": 0.7706921507590612,\n        \"nauc_ndcg_at_3_std\": 0.008060679840721787,\n        \"nauc_ndcg_at_5_diff1\": 0.8769899243312133,\n        \"nauc_ndcg_at_5_max\": 0.760375068676849,\n        \"nauc_ndcg_at_5_std\": 0.009614546520145218,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8978758169934363,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.8068394024276223,\n        \"nauc_precision_at_10_diff1\": 0.8088468720821603,\n        \"nauc_precision_at_10_max\": 0.8489729225023332,\n        \"nauc_precision_at_10_std\": 0.2315826330532213,\n        \"nauc_precision_at_1_diff1\": 0.8992049534399333,\n        \"nauc_precision_at_1_max\": 0.7400578657740957,\n        \"nauc_precision_at_1_std\": -0.01392344536385056,\n        \"nauc_precision_at_20_diff1\": 0.7500259363004358,\n        \"nauc_precision_at_20_max\": 0.8905488121174372,\n        \"nauc_precision_at_20_std\": 0.5106338831828816,\n        \"nauc_precision_at_3_diff1\": 0.8477293947882198,\n        \"nauc_precision_at_3_max\": 0.8028860028860081,\n        \"nauc_precision_at_3_std\": 0.03547237076648694,\n        \"nauc_precision_at_5_diff1\": 0.8348176877588617,\n        \"nauc_precision_at_5_max\": 0.76960185783715,\n        \"nauc_precision_at_5_std\": 0.04983360865712764,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8978758169934707,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.8068394024276523,\n        \"nauc_recall_at_10_diff1\": 0.8088468720821673,\n        \"nauc_recall_at_10_max\": 0.8489729225023311,\n        \"nauc_recall_at_10_std\": 0.23158263305322288,\n        \"nauc_recall_at_1_diff1\": 0.8992049534399333,\n        \"nauc_recall_at_1_max\": 0.7400578657740957,\n        \"nauc_recall_at_1_std\": -0.01392344536385056,\n        \"nauc_recall_at_20_diff1\": 0.7500259363004375,\n        \"nauc_recall_at_20_max\": 0.8905488121174361,\n        \"nauc_recall_at_20_std\": 0.5106338831829043,\n        \"nauc_recall_at_3_diff1\": 0.8477293947882195,\n        \"nauc_recall_at_3_max\": 0.8028860028860038,\n        \"nauc_recall_at_3_std\": 0.03547237076648996,\n        \"nauc_recall_at_5_diff1\": 0.8348176877588636,\n        \"nauc_recall_at_5_max\": 0.7696018578371483,\n        \"nauc_recall_at_5_std\": 0.04983360865714109,\n        \"ndcg_at_1\": 0.86778,\n        \"ndcg_at_10\": 0.9243,\n        \"ndcg_at_100\": 0.92843,\n        \"ndcg_at_1000\": 0.929,\n        \"ndcg_at_20\": 0.92742,\n        \"ndcg_at_3\": 0.90988,\n        \"ndcg_at_5\": 0.9172,\n        \"precision_at_1\": 0.86778,\n        \"precision_at_10\": 0.09778,\n        \"precision_at_100\": 0.00996,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.0495,\n        \"precision_at_3\": 0.31296,\n        \"precision_at_5\": 0.19133,\n        \"recall_at_1\": 0.86778,\n        \"recall_at_10\": 0.97778,\n        \"recall_at_100\": 0.99556,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.99,\n        \"recall_at_3\": 0.93889,\n        \"recall_at_5\": 0.95667\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.91243,\n        \"map_at_1\": 0.85111,\n        \"map_at_10\": 0.89436,\n        \"map_at_100\": 0.89557,\n        \"map_at_1000\": 0.89561,\n        \"map_at_20\": 0.89523,\n        \"map_at_3\": 0.88796,\n        \"map_at_5\": 0.89191,\n        \"mrr_at_1\": 0.8511111111111112,\n        \"mrr_at_10\": 0.8943633156966495,\n        \"mrr_at_100\": 0.8955659825522202,\n        \"mrr_at_1000\": 0.8956053837277665,\n        \"mrr_at_20\": 0.8952312013512996,\n        \"mrr_at_3\": 0.8879629629629634,\n        \"mrr_at_5\": 0.8919074074074078,\n        \"nauc_map_at_1000_diff1\": 0.8718693922157789,\n        \"nauc_map_at_1000_max\": 0.715312248960243,\n        \"nauc_map_at_1000_std\": -0.02182153633698573,\n        \"nauc_map_at_100_diff1\": 0.8718442887486781,\n        \"nauc_map_at_100_max\": 0.715407001301985,\n        \"nauc_map_at_100_std\": -0.021514166210986174,\n        \"nauc_map_at_10_diff1\": 0.8707102953249783,\n        \"nauc_map_at_10_max\": 0.715404021150519,\n        \"nauc_map_at_10_std\": -0.022836282188191188,\n        \"nauc_map_at_1_diff1\": 0.8839859050337086,\n        \"nauc_map_at_1_max\": 0.6831071537778296,\n        \"nauc_map_at_1_std\": -0.07323048473288021,\n        \"nauc_map_at_20_diff1\": 0.8715081801438168,\n        \"nauc_map_at_20_max\": 0.7159718638485788,\n        \"nauc_map_at_20_std\": -0.01951756920340846,\n        \"nauc_map_at_3_diff1\": 0.8703959648913775,\n        \"nauc_map_at_3_max\": 0.7207982842845231,\n        \"nauc_map_at_3_std\": -0.02022796775090404,\n        \"nauc_map_at_5_diff1\": 0.8702499758102804,\n        \"nauc_map_at_5_max\": 0.715969021995253,\n        \"nauc_map_at_5_std\": -0.030122174974660958,\n        \"nauc_mrr_at_1000_diff1\": 0.8718693922157789,\n        \"nauc_mrr_at_1000_max\": 0.715312248960243,\n        \"nauc_mrr_at_1000_std\": -0.02182153633698573,\n        \"nauc_mrr_at_100_diff1\": 0.8718442887486781,\n        \"nauc_mrr_at_100_max\": 0.715407001301985,\n        \"nauc_mrr_at_100_std\": -0.021514166210986174,\n        \"nauc_mrr_at_10_diff1\": 0.8707102953249783,\n        \"nauc_mrr_at_10_max\": 0.715404021150519,\n        \"nauc_mrr_at_10_std\": -0.022836282188191188,\n        \"nauc_mrr_at_1_diff1\": 0.8839859050337086,\n        \"nauc_mrr_at_1_max\": 0.6831071537778296,\n        \"nauc_mrr_at_1_std\": -0.07323048473288021,\n        \"nauc_mrr_at_20_diff1\": 0.8715081801438168,\n        \"nauc_mrr_at_20_max\": 0.7159718638485788,\n        \"nauc_mrr_at_20_std\": -0.01951756920340846,\n        \"nauc_mrr_at_3_diff1\": 0.8703959648913775,\n        \"nauc_mrr_at_3_max\": 0.7207982842845231,\n        \"nauc_mrr_at_3_std\": -0.02022796775090404,\n        \"nauc_mrr_at_5_diff1\": 0.8702499758102804,\n        \"nauc_mrr_at_5_max\": 0.715969021995253,\n        \"nauc_mrr_at_5_std\": -0.030122174974660958,\n        \"nauc_ndcg_at_1000_diff1\": 0.8704215704436838,\n        \"nauc_ndcg_at_1000_max\": 0.7206784091883098,\n        \"nauc_ndcg_at_1000_std\": -0.01043167083553248,\n        \"nauc_ndcg_at_100_diff1\": 0.870036775850903,\n        \"nauc_ndcg_at_100_max\": 0.7228799515433424,\n        \"nauc_ndcg_at_100_std\": -0.003498233838454148,\n        \"nauc_ndcg_at_10_diff1\": 0.8653318379092054,\n        \"nauc_ndcg_at_10_max\": 0.7248937716084193,\n        \"nauc_ndcg_at_10_std\": -0.0020540513430598534,\n        \"nauc_ndcg_at_1_diff1\": 0.8839859050337086,\n        \"nauc_ndcg_at_1_max\": 0.6831071537778296,\n        \"nauc_ndcg_at_1_std\": -0.07323048473288021,\n        \"nauc_ndcg_at_20_diff1\": 0.8684097990221203,\n        \"nauc_ndcg_at_20_max\": 0.7283072515601547,\n        \"nauc_ndcg_at_20_std\": 0.013062095849363017,\n        \"nauc_ndcg_at_3_diff1\": 0.8651129208552935,\n        \"nauc_ndcg_at_3_max\": 0.7351914072551375,\n        \"nauc_ndcg_at_3_std\": -0.0023841775056271893,\n        \"nauc_ndcg_at_5_diff1\": 0.8646168164453103,\n        \"nauc_ndcg_at_5_max\": 0.7261357664944987,\n        \"nauc_ndcg_at_5_std\": -0.022761294127049272,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8366013071895334,\n        \"nauc_precision_at_100_max\": 0.9444444444444465,\n        \"nauc_precision_at_100_std\": 0.6873015873015987,\n        \"nauc_precision_at_10_diff1\": 0.8173637271000318,\n        \"nauc_precision_at_10_max\": 0.80266589394378,\n        \"nauc_precision_at_10_std\": 0.19208602981421555,\n        \"nauc_precision_at_1_diff1\": 0.8839859050337086,\n        \"nauc_precision_at_1_max\": 0.6831071537778296,\n        \"nauc_precision_at_1_std\": -0.07323048473288021,\n        \"nauc_precision_at_20_diff1\": 0.8354341736694668,\n        \"nauc_precision_at_20_max\": 0.9101307189542478,\n        \"nauc_precision_at_20_std\": 0.5516391741881902,\n        \"nauc_precision_at_3_diff1\": 0.8410785079058934,\n        \"nauc_precision_at_3_max\": 0.8005311414183193,\n        \"nauc_precision_at_3_std\": 0.07730633236901657,\n        \"nauc_precision_at_5_diff1\": 0.8312584292976438,\n        \"nauc_precision_at_5_max\": 0.7830895321091386,\n        \"nauc_precision_at_5_std\": 0.01041601825915237,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8366013071895522,\n        \"nauc_recall_at_100_max\": 0.9444444444444562,\n        \"nauc_recall_at_100_std\": 0.6873015873015951,\n        \"nauc_recall_at_10_diff1\": 0.817363727100036,\n        \"nauc_recall_at_10_max\": 0.8026658939437843,\n        \"nauc_recall_at_10_std\": 0.1920860298142285,\n        \"nauc_recall_at_1_diff1\": 0.8839859050337086,\n        \"nauc_recall_at_1_max\": 0.6831071537778296,\n        \"nauc_recall_at_1_std\": -0.07323048473288021,\n        \"nauc_recall_at_20_diff1\": 0.8354341736694711,\n        \"nauc_recall_at_20_max\": 0.9101307189542475,\n        \"nauc_recall_at_20_std\": 0.551639174188192,\n        \"nauc_recall_at_3_diff1\": 0.8410785079058953,\n        \"nauc_recall_at_3_max\": 0.8005311414183154,\n        \"nauc_recall_at_3_std\": 0.07730633236901466,\n        \"nauc_recall_at_5_diff1\": 0.831258429297646,\n        \"nauc_recall_at_5_max\": 0.7830895321091382,\n        \"nauc_recall_at_5_std\": 0.01041601825915693,\n        \"ndcg_at_1\": 0.85111,\n        \"ndcg_at_10\": 0.91243,\n        \"ndcg_at_100\": 0.91815,\n        \"ndcg_at_1000\": 0.91892,\n        \"ndcg_at_20\": 0.91555,\n        \"ndcg_at_3\": 0.89938,\n        \"ndcg_at_5\": 0.9066,\n        \"precision_at_1\": 0.85111,\n        \"precision_at_10\": 0.09678,\n        \"precision_at_100\": 0.00994,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.049,\n        \"precision_at_3\": 0.31074,\n        \"precision_at_5\": 0.19,\n        \"recall_at_1\": 0.85111,\n        \"recall_at_10\": 0.96778,\n        \"recall_at_100\": 0.99444,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98,\n        \"recall_at_3\": 0.93222,\n        \"recall_at_5\": 0.95\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/dragonkue/BGE-m3-ko/dragonkue__BGE-m3-ko/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 115.5916862487793,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.7959,\n        \"map_at_1\": 0.49056,\n        \"map_at_10\": 0.75131,\n        \"map_at_100\": 0.75657,\n        \"map_at_1000\": 0.75691,\n        \"map_at_20\": 0.75501,\n        \"map_at_3\": 0.71088,\n        \"map_at_5\": 0.73983,\n        \"mrr_at_1\": 0.7584459459459459,\n        \"mrr_at_10\": 0.8134411196911195,\n        \"mrr_at_100\": 0.8147137843388809,\n        \"mrr_at_1000\": 0.8148351718852996,\n        \"mrr_at_20\": 0.8141698656404537,\n        \"mrr_at_3\": 0.8054617117117114,\n        \"mrr_at_5\": 0.810529279279279,\n        \"nauc_map_at_1000_diff1\": 0.6077723078794142,\n        \"nauc_map_at_1000_max\": 0.6573089583997457,\n        \"nauc_map_at_1000_std\": 0.2554489899927413,\n        \"nauc_map_at_100_diff1\": 0.6076594934702981,\n        \"nauc_map_at_100_max\": 0.6575393737587643,\n        \"nauc_map_at_100_std\": 0.25591233440846073,\n        \"nauc_map_at_10_diff1\": 0.6060453073908345,\n        \"nauc_map_at_10_max\": 0.656696375458025,\n        \"nauc_map_at_10_std\": 0.24695748909037316,\n        \"nauc_map_at_1_diff1\": 0.6458252442838546,\n        \"nauc_map_at_1_max\": 0.3121693863445959,\n        \"nauc_map_at_1_std\": 0.01652697084396131,\n        \"nauc_map_at_20_diff1\": 0.6069872318028429,\n        \"nauc_map_at_20_max\": 0.656927115861969,\n        \"nauc_map_at_20_std\": 0.25433092620557457,\n        \"nauc_map_at_3_diff1\": 0.5925124364325525,\n        \"nauc_map_at_3_max\": 0.6081099885122733,\n        \"nauc_map_at_3_std\": 0.1852920843231918,\n        \"nauc_map_at_5_diff1\": 0.6036824581960382,\n        \"nauc_map_at_5_max\": 0.6503765291038188,\n        \"nauc_map_at_5_std\": 0.21835916030257338,\n        \"nauc_mrr_at_1000_diff1\": 0.6832517415820536,\n        \"nauc_mrr_at_1000_max\": 0.7211637033411988,\n        \"nauc_mrr_at_1000_std\": 0.3641206608277797,\n        \"nauc_mrr_at_100_diff1\": 0.683308766051111,\n        \"nauc_mrr_at_100_max\": 0.7213415575516359,\n        \"nauc_mrr_at_100_std\": 0.3644459960058063,\n        \"nauc_mrr_at_10_diff1\": 0.6832094931397921,\n        \"nauc_mrr_at_10_max\": 0.7227122005456524,\n        \"nauc_mrr_at_10_std\": 0.3653443095501317,\n        \"nauc_mrr_at_1_diff1\": 0.6939000921334538,\n        \"nauc_mrr_at_1_max\": 0.6351097031562031,\n        \"nauc_mrr_at_1_std\": 0.26217789737674524,\n        \"nauc_mrr_at_20_diff1\": 0.6831394705607008,\n        \"nauc_mrr_at_20_max\": 0.7219536740322078,\n        \"nauc_mrr_at_20_std\": 0.3649367382073439,\n        \"nauc_mrr_at_3_diff1\": 0.6793523696127164,\n        \"nauc_mrr_at_3_max\": 0.7248716464145419,\n        \"nauc_mrr_at_3_std\": 0.35751312232773125,\n        \"nauc_mrr_at_5_diff1\": 0.6821188934286015,\n        \"nauc_mrr_at_5_max\": 0.7245259039980231,\n        \"nauc_mrr_at_5_std\": 0.36255712853232797,\n        \"nauc_ndcg_at_1000_diff1\": 0.6285352838789675,\n        \"nauc_ndcg_at_1000_max\": 0.7091198441855272,\n        \"nauc_ndcg_at_1000_std\": 0.3444313941136184,\n        \"nauc_ndcg_at_100_diff1\": 0.6284775238416308,\n        \"nauc_ndcg_at_100_max\": 0.7166963735380042,\n        \"nauc_ndcg_at_100_std\": 0.357603340604324,\n        \"nauc_ndcg_at_10_diff1\": 0.6224918160953309,\n        \"nauc_ndcg_at_10_max\": 0.7144185507442697,\n        \"nauc_ndcg_at_10_std\": 0.33006553182834125,\n        \"nauc_ndcg_at_1_diff1\": 0.6939000921334538,\n        \"nauc_ndcg_at_1_max\": 0.6351097031562031,\n        \"nauc_ndcg_at_1_std\": 0.26217789737674524,\n        \"nauc_ndcg_at_20_diff1\": 0.6253116873776855,\n        \"nauc_ndcg_at_20_max\": 0.7161801994053858,\n        \"nauc_ndcg_at_20_std\": 0.35005964923241917,\n        \"nauc_ndcg_at_3_diff1\": 0.5996129518498234,\n        \"nauc_ndcg_at_3_max\": 0.6570283339171115,\n        \"nauc_ndcg_at_3_std\": 0.2354207606263176,\n        \"nauc_ndcg_at_5_diff1\": 0.6183812518364293,\n        \"nauc_ndcg_at_5_max\": 0.704540189540427,\n        \"nauc_ndcg_at_5_std\": 0.2791596614003792,\n        \"nauc_precision_at_1000_diff1\": -0.3068570126990965,\n        \"nauc_precision_at_1000_max\": 0.03384203635866813,\n        \"nauc_precision_at_1000_std\": 0.21656754445137796,\n        \"nauc_precision_at_100_diff1\": -0.20359255842444202,\n        \"nauc_precision_at_100_max\": 0.1624705732683665,\n        \"nauc_precision_at_100_std\": 0.30479175635537603,\n        \"nauc_precision_at_10_diff1\": -0.12392988970999819,\n        \"nauc_precision_at_10_max\": 0.2721968635468893,\n        \"nauc_precision_at_10_std\": 0.3113424136318071,\n        \"nauc_precision_at_1_diff1\": 0.6939000921334538,\n        \"nauc_precision_at_1_max\": 0.6351097031562031,\n        \"nauc_precision_at_1_std\": 0.26217789737674524,\n        \"nauc_precision_at_20_diff1\": -0.15781732437023308,\n        \"nauc_precision_at_20_max\": 0.22767847657175486,\n        \"nauc_precision_at_20_std\": 0.32515083661935607,\n        \"nauc_precision_at_3_diff1\": 0.008293364102137213,\n        \"nauc_precision_at_3_max\": 0.41108421339521484,\n        \"nauc_precision_at_3_std\": 0.2756698186482374,\n        \"nauc_precision_at_5_diff1\": -0.06855671223726188,\n        \"nauc_precision_at_5_max\": 0.3447541035044828,\n        \"nauc_precision_at_5_std\": 0.27670493704200283,\n        \"nauc_recall_at_1000_diff1\": 0.6184491717695515,\n        \"nauc_recall_at_1000_max\": 0.9373322639715344,\n        \"nauc_recall_at_1000_std\": 0.8707432685857276,\n        \"nauc_recall_at_100_diff1\": 0.6262762168447928,\n        \"nauc_recall_at_100_max\": 0.9130875453909402,\n        \"nauc_recall_at_100_std\": 0.7664218156346466,\n        \"nauc_recall_at_10_diff1\": 0.5851607028848523,\n        \"nauc_recall_at_10_max\": 0.8231971304893786,\n        \"nauc_recall_at_10_std\": 0.49114599357555316,\n        \"nauc_recall_at_1_diff1\": 0.6458252442838546,\n        \"nauc_recall_at_1_max\": 0.3121693863445959,\n        \"nauc_recall_at_1_std\": 0.01652697084396131,\n        \"nauc_recall_at_20_diff1\": 0.6031863187385538,\n        \"nauc_recall_at_20_max\": 0.8633164767407354,\n        \"nauc_recall_at_20_std\": 0.6171635453840554,\n        \"nauc_recall_at_3_diff1\": 0.5518966024258635,\n        \"nauc_recall_at_3_max\": 0.6726580995760291,\n        \"nauc_recall_at_3_std\": 0.23325305684585876,\n        \"nauc_recall_at_5_diff1\": 0.5825866310075252,\n        \"nauc_recall_at_5_max\": 0.777951156236192,\n        \"nauc_recall_at_5_std\": 0.3204334395785277,\n        \"ndcg_at_1\": 0.75845,\n        \"ndcg_at_10\": 0.7959,\n        \"ndcg_at_100\": 0.81128,\n        \"ndcg_at_1000\": 0.81853,\n        \"ndcg_at_20\": 0.80402,\n        \"ndcg_at_3\": 0.75049,\n        \"ndcg_at_5\": 0.77913,\n        \"precision_at_1\": 0.75845,\n        \"precision_at_10\": 0.15828,\n        \"precision_at_100\": 0.01711,\n        \"precision_at_1000\": 0.00182,\n        \"precision_at_20\": 0.08193,\n        \"precision_at_3\": 0.44538,\n        \"precision_at_5\": 0.29662,\n        \"recall_at_1\": 0.49056,\n        \"recall_at_10\": 0.85471,\n        \"recall_at_100\": 0.91048,\n        \"recall_at_1000\": 0.95746,\n        \"recall_at_20\": 0.87968,\n        \"recall_at_3\": 0.75651,\n        \"recall_at_5\": 0.81552\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/dragonkue/BGE-m3-ko/dragonkue__BGE-m3-ko/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 11312.0097489357,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.68331,\n        \"map_at_1\": 0.3923,\n        \"map_at_10\": 0.59239,\n        \"map_at_100\": 0.6184,\n        \"map_at_1000\": 0.61894,\n        \"map_at_20\": 0.60938,\n        \"map_at_3\": 0.51673,\n        \"map_at_5\": 0.56081,\n        \"mrr_at_1\": 0.6431924882629108,\n        \"mrr_at_10\": 0.745903196959535,\n        \"mrr_at_100\": 0.748772757610797,\n        \"mrr_at_1000\": 0.7488523347263736,\n        \"mrr_at_20\": 0.7485247970051528,\n        \"mrr_at_3\": 0.7261345852895147,\n        \"mrr_at_5\": 0.7392801251956181,\n        \"nauc_map_at_1000_diff1\": 0.3774946180359577,\n        \"nauc_map_at_1000_max\": 0.3535314711403068,\n        \"nauc_map_at_1000_std\": -0.019909988048151767,\n        \"nauc_map_at_100_diff1\": 0.3768667446156779,\n        \"nauc_map_at_100_max\": 0.3528725827953486,\n        \"nauc_map_at_100_std\": -0.019930418545331507,\n        \"nauc_map_at_10_diff1\": 0.3850131229245043,\n        \"nauc_map_at_10_max\": 0.32331258334429996,\n        \"nauc_map_at_10_std\": -0.0671951047858982,\n        \"nauc_map_at_1_diff1\": 0.5196816318543573,\n        \"nauc_map_at_1_max\": 0.26411793746035594,\n        \"nauc_map_at_1_std\": -0.1503999839349953,\n        \"nauc_map_at_20_diff1\": 0.37669876948229386,\n        \"nauc_map_at_20_max\": 0.34069178684781326,\n        \"nauc_map_at_20_std\": -0.034742643713636716,\n        \"nauc_map_at_3_diff1\": 0.4182627612388757,\n        \"nauc_map_at_3_max\": 0.2739352819666986,\n        \"nauc_map_at_3_std\": -0.12101619469325169,\n        \"nauc_map_at_5_diff1\": 0.39687144596343005,\n        \"nauc_map_at_5_max\": 0.2971376440937249,\n        \"nauc_map_at_5_std\": -0.11478928058095475,\n        \"nauc_mrr_at_1000_diff1\": 0.3739869856099168,\n        \"nauc_mrr_at_1000_max\": 0.4806436351696716,\n        \"nauc_mrr_at_1000_std\": 0.12498978009344504,\n        \"nauc_mrr_at_100_diff1\": 0.37374067751519524,\n        \"nauc_mrr_at_100_max\": 0.4806897016682821,\n        \"nauc_mrr_at_100_std\": 0.12521604708949863,\n        \"nauc_mrr_at_10_diff1\": 0.37390275527505346,\n        \"nauc_mrr_at_10_max\": 0.48134636338291814,\n        \"nauc_mrr_at_10_std\": 0.12252512689369086,\n        \"nauc_mrr_at_1_diff1\": 0.40798053381505517,\n        \"nauc_mrr_at_1_max\": 0.43355324394619194,\n        \"nauc_mrr_at_1_std\": 0.10194903601481653,\n        \"nauc_mrr_at_20_diff1\": 0.3733532620658847,\n        \"nauc_mrr_at_20_max\": 0.481188843537414,\n        \"nauc_mrr_at_20_std\": 0.12577842594499059,\n        \"nauc_mrr_at_3_diff1\": 0.3702505623508384,\n        \"nauc_mrr_at_3_max\": 0.48860309634358867,\n        \"nauc_mrr_at_3_std\": 0.12959244782825213,\n        \"nauc_mrr_at_5_diff1\": 0.37440575876060483,\n        \"nauc_mrr_at_5_max\": 0.48190539569289936,\n        \"nauc_mrr_at_5_std\": 0.10821144432670865,\n        \"nauc_ndcg_at_1000_diff1\": 0.36468099422761685,\n        \"nauc_ndcg_at_1000_max\": 0.4283410599592818,\n        \"nauc_ndcg_at_1000_std\": 0.0777771522512293,\n        \"nauc_ndcg_at_100_diff1\": 0.3568350316982012,\n        \"nauc_ndcg_at_100_max\": 0.4267523913568,\n        \"nauc_ndcg_at_100_std\": 0.08664324619901745,\n        \"nauc_ndcg_at_10_diff1\": 0.3709148638740794,\n        \"nauc_ndcg_at_10_max\": 0.370843620720174,\n        \"nauc_ndcg_at_10_std\": -0.011817563463895356,\n        \"nauc_ndcg_at_1_diff1\": 0.40798053381505517,\n        \"nauc_ndcg_at_1_max\": 0.43355324394619194,\n        \"nauc_ndcg_at_1_std\": 0.10194903601481653,\n        \"nauc_ndcg_at_20_diff1\": 0.3545292942937683,\n        \"nauc_ndcg_at_20_max\": 0.40307170590881086,\n        \"nauc_ndcg_at_20_std\": 0.053364236078871974,\n        \"nauc_ndcg_at_3_diff1\": 0.3634317603574458,\n        \"nauc_ndcg_at_3_max\": 0.3702287982936343,\n        \"nauc_ndcg_at_3_std\": 0.006161518715522704,\n        \"nauc_ndcg_at_5_diff1\": 0.37810234789919145,\n        \"nauc_ndcg_at_5_max\": 0.36167845453393555,\n        \"nauc_ndcg_at_5_std\": -0.054103875622263674,\n        \"nauc_precision_at_1000_diff1\": -0.23764683402393874,\n        \"nauc_precision_at_1000_max\": 0.17062992955525072,\n        \"nauc_precision_at_1000_std\": 0.41900460356843805,\n        \"nauc_precision_at_100_diff1\": -0.24135047779614466,\n        \"nauc_precision_at_100_max\": 0.18576687324926303,\n        \"nauc_precision_at_100_std\": 0.4442303287310702,\n        \"nauc_precision_at_10_diff1\": -0.22766796771967845,\n        \"nauc_precision_at_10_max\": 0.21497148440048625,\n        \"nauc_precision_at_10_std\": 0.37218123721668905,\n        \"nauc_precision_at_1_diff1\": 0.40798053381505517,\n        \"nauc_precision_at_1_max\": 0.43355324394619194,\n        \"nauc_precision_at_1_std\": 0.10194903601481653,\n        \"nauc_precision_at_20_diff1\": -0.26615333990630646,\n        \"nauc_precision_at_20_max\": 0.20236992458242156,\n        \"nauc_precision_at_20_std\": 0.4430085750960338,\n        \"nauc_precision_at_3_diff1\": -0.11383669894778764,\n        \"nauc_precision_at_3_max\": 0.2717879122260088,\n        \"nauc_precision_at_3_std\": 0.2709135728694691,\n        \"nauc_precision_at_5_diff1\": -0.19463523232683233,\n        \"nauc_precision_at_5_max\": 0.2160201242456816,\n        \"nauc_precision_at_5_std\": 0.2789409714060988,\n        \"nauc_recall_at_1000_diff1\": 1.0,\n        \"nauc_recall_at_1000_max\": 1.0,\n        \"nauc_recall_at_1000_std\": 1.0,\n        \"nauc_recall_at_100_diff1\": 0.18908040393134162,\n        \"nauc_recall_at_100_max\": 0.47390319498448813,\n        \"nauc_recall_at_100_std\": 0.49521202474372344,\n        \"nauc_recall_at_10_diff1\": 0.29897134897446154,\n        \"nauc_recall_at_10_max\": 0.25670493721041504,\n        \"nauc_recall_at_10_std\": -0.082099196511308,\n        \"nauc_recall_at_1_diff1\": 0.5196816318543573,\n        \"nauc_recall_at_1_max\": 0.26411793746035594,\n        \"nauc_recall_at_1_std\": -0.1503999839349953,\n        \"nauc_recall_at_20_diff1\": 0.21242467085037842,\n        \"nauc_recall_at_20_max\": 0.31989790929720013,\n        \"nauc_recall_at_20_std\": 0.12476081609645708,\n        \"nauc_recall_at_3_diff1\": 0.35945142823550263,\n        \"nauc_recall_at_3_max\": 0.22427651751677,\n        \"nauc_recall_at_3_std\": -0.166837960755657,\n        \"nauc_recall_at_5_diff1\": 0.3154176983700154,\n        \"nauc_recall_at_5_max\": 0.22034669463342174,\n        \"nauc_recall_at_5_std\": -0.2377572626036249,\n        \"ndcg_at_1\": 0.64319,\n        \"ndcg_at_10\": 0.68331,\n        \"ndcg_at_100\": 0.74053,\n        \"ndcg_at_1000\": 0.74724,\n        \"ndcg_at_20\": 0.71542,\n        \"ndcg_at_3\": 0.6319,\n        \"ndcg_at_5\": 0.65301,\n        \"precision_at_1\": 0.64319,\n        \"precision_at_10\": 0.17606,\n        \"precision_at_100\": 0.02451,\n        \"precision_at_1000\": 0.00256,\n        \"precision_at_20\": 0.10399,\n        \"precision_at_3\": 0.37559,\n        \"precision_at_5\": 0.28263,\n        \"recall_at_1\": 0.3923,\n        \"recall_at_10\": 0.77817,\n        \"recall_at_100\": 0.95483,\n        \"recall_at_1000\": 0.99531,\n        \"recall_at_20\": 0.86781,\n        \"recall_at_3\": 0.5853,\n        \"recall_at_5\": 0.68579\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/dragonkue/BGE-m3-ko/dragonkue__BGE-m3-ko/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 11472.845931529999,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.60992,\n        \"map_at_1\": 0.43587,\n        \"map_at_10\": 0.55105,\n        \"map_at_100\": 0.55937,\n        \"map_at_1000\": 0.55967,\n        \"map_at_20\": 0.55623,\n        \"map_at_3\": 0.52375,\n        \"map_at_5\": 0.53682,\n        \"mrr_at_1\": 0.47268408551068886,\n        \"mrr_at_10\": 0.5790040719375636,\n        \"mrr_at_100\": 0.5846102667713428,\n        \"mrr_at_1000\": 0.5848739682713796,\n        \"mrr_at_20\": 0.5824617319866726,\n        \"mrr_at_3\": 0.5570071258907365,\n        \"mrr_at_5\": 0.5674584323040381,\n        \"nauc_map_at_1000_diff1\": 0.3753050258625946,\n        \"nauc_map_at_1000_max\": 0.40673073430037027,\n        \"nauc_map_at_1000_std\": 0.028514895004117826,\n        \"nauc_map_at_100_diff1\": 0.37509599591180637,\n        \"nauc_map_at_100_max\": 0.4068533874045987,\n        \"nauc_map_at_100_std\": 0.02853250905845099,\n        \"nauc_map_at_10_diff1\": 0.372372520798537,\n        \"nauc_map_at_10_max\": 0.4038802418315354,\n        \"nauc_map_at_10_std\": 0.028654103214843855,\n        \"nauc_map_at_1_diff1\": 0.42515981554619875,\n        \"nauc_map_at_1_max\": 0.37700543732750713,\n        \"nauc_map_at_1_std\": -0.016879277061596795,\n        \"nauc_map_at_20_diff1\": 0.3722103022931264,\n        \"nauc_map_at_20_max\": 0.4052825801949023,\n        \"nauc_map_at_20_std\": 0.03006486477801866,\n        \"nauc_map_at_3_diff1\": 0.37971485207970246,\n        \"nauc_map_at_3_max\": 0.40590668886879533,\n        \"nauc_map_at_3_std\": 0.02401990421735226,\n        \"nauc_map_at_5_diff1\": 0.37185612411403407,\n        \"nauc_map_at_5_max\": 0.40773810091462803,\n        \"nauc_map_at_5_std\": 0.02940435777573965,\n        \"nauc_mrr_at_1000_diff1\": 0.4078523594341167,\n        \"nauc_mrr_at_1000_max\": 0.4394076714687208,\n        \"nauc_mrr_at_1000_std\": 0.04120542083949322,\n        \"nauc_mrr_at_100_diff1\": 0.40758829173709177,\n        \"nauc_mrr_at_100_max\": 0.4395221029740597,\n        \"nauc_mrr_at_100_std\": 0.04133303089568957,\n        \"nauc_mrr_at_10_diff1\": 0.4057055441388549,\n        \"nauc_mrr_at_10_max\": 0.43793081284299035,\n        \"nauc_mrr_at_10_std\": 0.04359601366998576,\n        \"nauc_mrr_at_1_diff1\": 0.4543862358578472,\n        \"nauc_mrr_at_1_max\": 0.4147346811251485,\n        \"nauc_mrr_at_1_std\": 0.000748455478851234,\n        \"nauc_mrr_at_20_diff1\": 0.40601610889868633,\n        \"nauc_mrr_at_20_max\": 0.43892856816163567,\n        \"nauc_mrr_at_20_std\": 0.04265928289658641,\n        \"nauc_mrr_at_3_diff1\": 0.40922453974926726,\n        \"nauc_mrr_at_3_max\": 0.43797844418516424,\n        \"nauc_mrr_at_3_std\": 0.04160958218861414,\n        \"nauc_mrr_at_5_diff1\": 0.40357752382017725,\n        \"nauc_mrr_at_5_max\": 0.4404496442108461,\n        \"nauc_mrr_at_5_std\": 0.04311527223227418,\n        \"nauc_ndcg_at_1000_diff1\": 0.3757771157677983,\n        \"nauc_ndcg_at_1000_max\": 0.4283923481165144,\n        \"nauc_ndcg_at_1000_std\": 0.04388913877302194,\n        \"nauc_ndcg_at_100_diff1\": 0.3697015687305564,\n        \"nauc_ndcg_at_100_max\": 0.43299779530852794,\n        \"nauc_ndcg_at_100_std\": 0.049515406975730564,\n        \"nauc_ndcg_at_10_diff1\": 0.3568643008644076,\n        \"nauc_ndcg_at_10_max\": 0.4191783096040415,\n        \"nauc_ndcg_at_10_std\": 0.05327069324253914,\n        \"nauc_ndcg_at_1_diff1\": 0.4543862358578472,\n        \"nauc_ndcg_at_1_max\": 0.4147346811251485,\n        \"nauc_ndcg_at_1_std\": 0.000748455478851234,\n        \"nauc_ndcg_at_20_diff1\": 0.35642410549907505,\n        \"nauc_ndcg_at_20_max\": 0.42428646497726574,\n        \"nauc_ndcg_at_20_std\": 0.0571135852810691,\n        \"nauc_ndcg_at_3_diff1\": 0.36932447470250523,\n        \"nauc_ndcg_at_3_max\": 0.4216462868741249,\n        \"nauc_ndcg_at_3_std\": 0.04413272834181027,\n        \"nauc_ndcg_at_5_diff1\": 0.35585160636930985,\n        \"nauc_ndcg_at_5_max\": 0.42614120371530917,\n        \"nauc_ndcg_at_5_std\": 0.05331191865956327,\n        \"nauc_precision_at_1000_diff1\": -0.015998553156530166,\n        \"nauc_precision_at_1000_max\": 0.06158313258393215,\n        \"nauc_precision_at_1000_std\": 0.0858583970040919,\n        \"nauc_precision_at_100_diff1\": 0.02788668125934561,\n        \"nauc_precision_at_100_max\": 0.18002237908297197,\n        \"nauc_precision_at_100_std\": 0.13411651596172475,\n        \"nauc_precision_at_10_diff1\": 0.1203763746848603,\n        \"nauc_precision_at_10_max\": 0.28187948547700625,\n        \"nauc_precision_at_10_std\": 0.15123759848899393,\n        \"nauc_precision_at_1_diff1\": 0.4543862358578472,\n        \"nauc_precision_at_1_max\": 0.4147346811251485,\n        \"nauc_precision_at_1_std\": 0.000748455478851234,\n        \"nauc_precision_at_20_diff1\": 0.06066286887665023,\n        \"nauc_precision_at_20_max\": 0.23305425439373617,\n        \"nauc_precision_at_20_std\": 0.1663912099113602,\n        \"nauc_precision_at_3_diff1\": 0.27540446711958216,\n        \"nauc_precision_at_3_max\": 0.4246280669061289,\n        \"nauc_precision_at_3_std\": 0.13011858770823792,\n        \"nauc_precision_at_5_diff1\": 0.18631257416980498,\n        \"nauc_precision_at_5_max\": 0.3771850902827074,\n        \"nauc_precision_at_5_std\": 0.1485475132080138,\n        \"nauc_recall_at_1000_diff1\": 0.42933168115881765,\n        \"nauc_recall_at_1000_max\": 0.6590218806072644,\n        \"nauc_recall_at_1000_std\": 0.008830912115977791,\n        \"nauc_recall_at_100_diff1\": 0.24903970913072537,\n        \"nauc_recall_at_100_max\": 0.6180656734448082,\n        \"nauc_recall_at_100_std\": 0.18147764743985456,\n        \"nauc_recall_at_10_diff1\": 0.23934696991783594,\n        \"nauc_recall_at_10_max\": 0.4244251936633175,\n        \"nauc_recall_at_10_std\": 0.1290442757956174,\n        \"nauc_recall_at_1_diff1\": 0.42515981554619875,\n        \"nauc_recall_at_1_max\": 0.37700543732750713,\n        \"nauc_recall_at_1_std\": -0.016879277061596795,\n        \"nauc_recall_at_20_diff1\": 0.2061196808707721,\n        \"nauc_recall_at_20_max\": 0.4563681973865881,\n        \"nauc_recall_at_20_std\": 0.1729491007398988,\n        \"nauc_recall_at_3_diff1\": 0.2985328976269163,\n        \"nauc_recall_at_3_max\": 0.42777057232006016,\n        \"nauc_recall_at_3_std\": 0.08664950021076616,\n        \"nauc_recall_at_5_diff1\": 0.26064350809617987,\n        \"nauc_recall_at_5_max\": 0.4435986352499763,\n        \"nauc_recall_at_5_std\": 0.11666456046771807,\n        \"ndcg_at_1\": 0.47268,\n        \"ndcg_at_10\": 0.60992,\n        \"ndcg_at_100\": 0.64446,\n        \"ndcg_at_1000\": 0.65166,\n        \"ndcg_at_20\": 0.62619,\n        \"ndcg_at_3\": 0.55724,\n        \"ndcg_at_5\": 0.57855,\n        \"precision_at_1\": 0.47268,\n        \"precision_at_10\": 0.08741,\n        \"precision_at_100\": 0.01064,\n        \"precision_at_1000\": 0.00113,\n        \"precision_at_20\": 0.04751,\n        \"precision_at_3\": 0.2304,\n        \"precision_at_5\": 0.15154,\n        \"recall_at_1\": 0.43587,\n        \"recall_at_10\": 0.76128,\n        \"recall_at_100\": 0.91251,\n        \"recall_at_1000\": 0.96675,\n        \"recall_at_20\": 0.82225,\n        \"recall_at_3\": 0.62233,\n        \"recall_at_5\": 0.67023\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/dragonkue/BGE-m3-ko/dragonkue__BGE-m3-ko/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 11403.819789886475,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.40135,\n        \"map_at_1\": 0.305,\n        \"map_at_10\": 0.36971,\n        \"map_at_100\": 0.38027,\n        \"map_at_1000\": 0.38101,\n        \"map_at_20\": 0.37548,\n        \"map_at_3\": 0.35333,\n        \"map_at_5\": 0.36383,\n        \"mrr_at_1\": 0.305,\n        \"mrr_at_10\": 0.3697142857142858,\n        \"mrr_at_100\": 0.38027095017778445,\n        \"mrr_at_1000\": 0.3810058122522981,\n        \"mrr_at_20\": 0.375484421710041,\n        \"mrr_at_3\": 0.35333333333333344,\n        \"mrr_at_5\": 0.3638333333333334,\n        \"nauc_map_at_1000_diff1\": 0.620492315177477,\n        \"nauc_map_at_1000_max\": 0.5405636248210866,\n        \"nauc_map_at_1000_std\": 0.04283524136714581,\n        \"nauc_map_at_100_diff1\": 0.6202335672884487,\n        \"nauc_map_at_100_max\": 0.5403203845586158,\n        \"nauc_map_at_100_std\": 0.04307170013811605,\n        \"nauc_map_at_10_diff1\": 0.6222606937807431,\n        \"nauc_map_at_10_max\": 0.5410835318264443,\n        \"nauc_map_at_10_std\": 0.033766238863526594,\n        \"nauc_map_at_1_diff1\": 0.6205732308086288,\n        \"nauc_map_at_1_max\": 0.5077466354869362,\n        \"nauc_map_at_1_std\": 0.016915228422975038,\n        \"nauc_map_at_20_diff1\": 0.6223990320710757,\n        \"nauc_map_at_20_max\": 0.5405664933566876,\n        \"nauc_map_at_20_std\": 0.03971339133638137,\n        \"nauc_map_at_3_diff1\": 0.6234319716950789,\n        \"nauc_map_at_3_max\": 0.5516904083152316,\n        \"nauc_map_at_3_std\": 0.0369078724163609,\n        \"nauc_map_at_5_diff1\": 0.6273667124297218,\n        \"nauc_map_at_5_max\": 0.5489856322874752,\n        \"nauc_map_at_5_std\": 0.03448790522028278,\n        \"nauc_mrr_at_1000_diff1\": 0.620492315177477,\n        \"nauc_mrr_at_1000_max\": 0.5405636248210866,\n        \"nauc_mrr_at_1000_std\": 0.04283524136714581,\n        \"nauc_mrr_at_100_diff1\": 0.6202335672884487,\n        \"nauc_mrr_at_100_max\": 0.5403203845586158,\n        \"nauc_mrr_at_100_std\": 0.04307170013811605,\n        \"nauc_mrr_at_10_diff1\": 0.6222606937807431,\n        \"nauc_mrr_at_10_max\": 0.5410835318264443,\n        \"nauc_mrr_at_10_std\": 0.033766238863526594,\n        \"nauc_mrr_at_1_diff1\": 0.6205732308086288,\n        \"nauc_mrr_at_1_max\": 0.5077466354869362,\n        \"nauc_mrr_at_1_std\": 0.016915228422975038,\n        \"nauc_mrr_at_20_diff1\": 0.6223990320710757,\n        \"nauc_mrr_at_20_max\": 0.5405664933566876,\n        \"nauc_mrr_at_20_std\": 0.03971339133638137,\n        \"nauc_mrr_at_3_diff1\": 0.6234319716950789,\n        \"nauc_mrr_at_3_max\": 0.5516904083152316,\n        \"nauc_mrr_at_3_std\": 0.0369078724163609,\n        \"nauc_mrr_at_5_diff1\": 0.6273667124297218,\n        \"nauc_mrr_at_5_max\": 0.5489856322874752,\n        \"nauc_mrr_at_5_std\": 0.03448790522028278,\n        \"nauc_ndcg_at_1000_diff1\": 0.6144687969628315,\n        \"nauc_ndcg_at_1000_max\": 0.5451156152792646,\n        \"nauc_ndcg_at_1000_std\": 0.07430926447896827,\n        \"nauc_ndcg_at_100_diff1\": 0.6061270612245266,\n        \"nauc_ndcg_at_100_max\": 0.5394659921296081,\n        \"nauc_ndcg_at_100_std\": 0.0868759587339719,\n        \"nauc_ndcg_at_10_diff1\": 0.6171285085868562,\n        \"nauc_ndcg_at_10_max\": 0.5396922542610059,\n        \"nauc_ndcg_at_10_std\": 0.03410463633600367,\n        \"nauc_ndcg_at_1_diff1\": 0.6205732308086288,\n        \"nauc_ndcg_at_1_max\": 0.5077466354869362,\n        \"nauc_ndcg_at_1_std\": 0.016915228422975038,\n        \"nauc_ndcg_at_20_diff1\": 0.6179654605898276,\n        \"nauc_ndcg_at_20_max\": 0.5385710587988575,\n        \"nauc_ndcg_at_20_std\": 0.05852404464151673,\n        \"nauc_ndcg_at_3_diff1\": 0.6234456627258951,\n        \"nauc_ndcg_at_3_max\": 0.5633149892929821,\n        \"nauc_ndcg_at_3_std\": 0.040746553975076705,\n        \"nauc_ndcg_at_5_diff1\": 0.6298276712412417,\n        \"nauc_ndcg_at_5_max\": 0.5576675497793011,\n        \"nauc_ndcg_at_5_std\": 0.03545339125528916,\n        \"nauc_precision_at_1000_diff1\": 0.615857454092746,\n        \"nauc_precision_at_1000_max\": 0.7201213818860871,\n        \"nauc_precision_at_1000_std\": 0.698996265172736,\n        \"nauc_precision_at_100_diff1\": 0.5077437837111977,\n        \"nauc_precision_at_100_max\": 0.5325977484836956,\n        \"nauc_precision_at_100_std\": 0.4298023768492202,\n        \"nauc_precision_at_10_diff1\": 0.5969353764157226,\n        \"nauc_precision_at_10_max\": 0.5273417721518988,\n        \"nauc_precision_at_10_std\": 0.03258494337108581,\n        \"nauc_precision_at_1_diff1\": 0.6205732308086288,\n        \"nauc_precision_at_1_max\": 0.5077466354869362,\n        \"nauc_precision_at_1_std\": 0.016915228422975038,\n        \"nauc_precision_at_20_diff1\": 0.5994981437187257,\n        \"nauc_precision_at_20_max\": 0.5234419710332074,\n        \"nauc_precision_at_20_std\": 0.1423980512715159,\n        \"nauc_precision_at_3_diff1\": 0.623215221483978,\n        \"nauc_precision_at_3_max\": 0.5955386197928461,\n        \"nauc_precision_at_3_std\": 0.050863357292118244,\n        \"nauc_precision_at_5_diff1\": 0.6370266221649893,\n        \"nauc_precision_at_5_max\": 0.580451236498384,\n        \"nauc_precision_at_5_std\": 0.03604373078237124,\n        \"nauc_recall_at_1000_diff1\": 0.6158574540927494,\n        \"nauc_recall_at_1000_max\": 0.7201213818860859,\n        \"nauc_recall_at_1000_std\": 0.6989962651727336,\n        \"nauc_recall_at_100_diff1\": 0.5077437837111974,\n        \"nauc_recall_at_100_max\": 0.5325977484836953,\n        \"nauc_recall_at_100_std\": 0.42980237684921996,\n        \"nauc_recall_at_10_diff1\": 0.5969353764157229,\n        \"nauc_recall_at_10_max\": 0.5273417721518984,\n        \"nauc_recall_at_10_std\": 0.032584943371085875,\n        \"nauc_recall_at_1_diff1\": 0.6205732308086288,\n        \"nauc_recall_at_1_max\": 0.5077466354869362,\n        \"nauc_recall_at_1_std\": 0.016915228422975038,\n        \"nauc_recall_at_20_diff1\": 0.5994981437187257,\n        \"nauc_recall_at_20_max\": 0.5234419710332074,\n        \"nauc_recall_at_20_std\": 0.14239805127151595,\n        \"nauc_recall_at_3_diff1\": 0.6232152214839783,\n        \"nauc_recall_at_3_max\": 0.5955386197928457,\n        \"nauc_recall_at_3_std\": 0.050863357292118404,\n        \"nauc_recall_at_5_diff1\": 0.6370266221649892,\n        \"nauc_recall_at_5_max\": 0.5804512364983837,\n        \"nauc_recall_at_5_std\": 0.03604373078237104,\n        \"ndcg_at_1\": 0.305,\n        \"ndcg_at_10\": 0.40135,\n        \"ndcg_at_100\": 0.45729,\n        \"ndcg_at_1000\": 0.47851,\n        \"ndcg_at_20\": 0.42351,\n        \"ndcg_at_3\": 0.36917,\n        \"ndcg_at_5\": 0.38789,\n        \"precision_at_1\": 0.305,\n        \"precision_at_10\": 0.05,\n        \"precision_at_100\": 0.0077,\n        \"precision_at_1000\": 0.00094,\n        \"precision_at_20\": 0.0295,\n        \"precision_at_3\": 0.13833,\n        \"precision_at_5\": 0.092,\n        \"recall_at_1\": 0.305,\n        \"recall_at_10\": 0.5,\n        \"recall_at_100\": 0.77,\n        \"recall_at_1000\": 0.94,\n        \"recall_at_20\": 0.59,\n        \"recall_at_3\": 0.415,\n        \"recall_at_5\": 0.46\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.3784,\n        \"map_at_1\": 0.29,\n        \"map_at_10\": 0.35064,\n        \"map_at_100\": 0.36037,\n        \"map_at_1000\": 0.36121,\n        \"map_at_20\": 0.35632,\n        \"map_at_3\": 0.33833,\n        \"map_at_5\": 0.34508,\n        \"mrr_at_1\": 0.29,\n        \"mrr_at_10\": 0.35064285714285715,\n        \"mrr_at_100\": 0.36037241577362655,\n        \"mrr_at_1000\": 0.36121480369607695,\n        \"mrr_at_20\": 0.3563192501942504,\n        \"mrr_at_3\": 0.3383333333333334,\n        \"mrr_at_5\": 0.3450833333333334,\n        \"nauc_map_at_1000_diff1\": 0.5555260535712806,\n        \"nauc_map_at_1000_max\": 0.511946413470973,\n        \"nauc_map_at_1000_std\": 0.022591047932817226,\n        \"nauc_map_at_100_diff1\": 0.5553419096812181,\n        \"nauc_map_at_100_max\": 0.5117643587928126,\n        \"nauc_map_at_100_std\": 0.022828388659646884,\n        \"nauc_map_at_10_diff1\": 0.5572509137694774,\n        \"nauc_map_at_10_max\": 0.5085916101319876,\n        \"nauc_map_at_10_std\": 0.012676658329875811,\n        \"nauc_map_at_1_diff1\": 0.6181956787495021,\n        \"nauc_map_at_1_max\": 0.5593656854799941,\n        \"nauc_map_at_1_std\": 0.005727785942886888,\n        \"nauc_map_at_20_diff1\": 0.5550542388638184,\n        \"nauc_map_at_20_max\": 0.5106556823005847,\n        \"nauc_map_at_20_std\": 0.01847058609115171,\n        \"nauc_map_at_3_diff1\": 0.5666017009607073,\n        \"nauc_map_at_3_max\": 0.5049535424829046,\n        \"nauc_map_at_3_std\": -0.009695964940741828,\n        \"nauc_map_at_5_diff1\": 0.5647817750504657,\n        \"nauc_map_at_5_max\": 0.5100247925875246,\n        \"nauc_map_at_5_std\": 0.00415943136932681,\n        \"nauc_mrr_at_1000_diff1\": 0.5555260535712806,\n        \"nauc_mrr_at_1000_max\": 0.511946413470973,\n        \"nauc_mrr_at_1000_std\": 0.022591047932817226,\n        \"nauc_mrr_at_100_diff1\": 0.5553419096812181,\n        \"nauc_mrr_at_100_max\": 0.5117643587928126,\n        \"nauc_mrr_at_100_std\": 0.022828388659646884,\n        \"nauc_mrr_at_10_diff1\": 0.5572509137694774,\n        \"nauc_mrr_at_10_max\": 0.5085916101319876,\n        \"nauc_mrr_at_10_std\": 0.012676658329875811,\n        \"nauc_mrr_at_1_diff1\": 0.6181956787495021,\n        \"nauc_mrr_at_1_max\": 0.5593656854799941,\n        \"nauc_mrr_at_1_std\": 0.005727785942886888,\n        \"nauc_mrr_at_20_diff1\": 0.5550542388638184,\n        \"nauc_mrr_at_20_max\": 0.5106556823005847,\n        \"nauc_mrr_at_20_std\": 0.01847058609115171,\n        \"nauc_mrr_at_3_diff1\": 0.5666017009607073,\n        \"nauc_mrr_at_3_max\": 0.5049535424829046,\n        \"nauc_mrr_at_3_std\": -0.009695964940741828,\n        \"nauc_mrr_at_5_diff1\": 0.5647817750504657,\n        \"nauc_mrr_at_5_max\": 0.5100247925875246,\n        \"nauc_mrr_at_5_std\": 0.00415943136932681,\n        \"nauc_ndcg_at_1000_diff1\": 0.5337453799092685,\n        \"nauc_ndcg_at_1000_max\": 0.5143767757163529,\n        \"nauc_ndcg_at_1000_std\": 0.0723995373076684,\n        \"nauc_ndcg_at_100_diff1\": 0.530109793159288,\n        \"nauc_ndcg_at_100_max\": 0.5082470366543096,\n        \"nauc_ndcg_at_100_std\": 0.07922652454856884,\n        \"nauc_ndcg_at_10_diff1\": 0.5330177561108366,\n        \"nauc_ndcg_at_10_max\": 0.4955767787741621,\n        \"nauc_ndcg_at_10_std\": 0.030057528041445056,\n        \"nauc_ndcg_at_1_diff1\": 0.6181956787495021,\n        \"nauc_ndcg_at_1_max\": 0.5593656854799941,\n        \"nauc_ndcg_at_1_std\": 0.005727785942886888,\n        \"nauc_ndcg_at_20_diff1\": 0.5242176447056347,\n        \"nauc_ndcg_at_20_max\": 0.5020210419233608,\n        \"nauc_ndcg_at_20_std\": 0.05067602714199018,\n        \"nauc_ndcg_at_3_diff1\": 0.5526245593820885,\n        \"nauc_ndcg_at_3_max\": 0.4884707148210188,\n        \"nauc_ndcg_at_3_std\": -0.016061366465278247,\n        \"nauc_ndcg_at_5_diff1\": 0.550736289740471,\n        \"nauc_ndcg_at_5_max\": 0.49873468260312426,\n        \"nauc_ndcg_at_5_std\": 0.008663144671605812,\n        \"nauc_precision_at_1000_diff1\": 0.3775124084721601,\n        \"nauc_precision_at_1000_max\": 0.6907219027962068,\n        \"nauc_precision_at_1000_std\": 0.7452208953756946,\n        \"nauc_precision_at_100_diff1\": 0.4407570816548374,\n        \"nauc_precision_at_100_max\": 0.5148118714203502,\n        \"nauc_precision_at_100_std\": 0.40133183524704724,\n        \"nauc_precision_at_10_diff1\": 0.45892813657933,\n        \"nauc_precision_at_10_max\": 0.46018520346713526,\n        \"nauc_precision_at_10_std\": 0.09171323079353164,\n        \"nauc_precision_at_1_diff1\": 0.6181956787495021,\n        \"nauc_precision_at_1_max\": 0.5593656854799941,\n        \"nauc_precision_at_1_std\": 0.005727785942886888,\n        \"nauc_precision_at_20_diff1\": 0.41805590286460453,\n        \"nauc_precision_at_20_max\": 0.48255119335389396,\n        \"nauc_precision_at_20_std\": 0.17746103192464793,\n        \"nauc_precision_at_3_diff1\": 0.5141393482286294,\n        \"nauc_precision_at_3_max\": 0.4424844992999681,\n        \"nauc_precision_at_3_std\": -0.03434348648003473,\n        \"nauc_precision_at_5_diff1\": 0.5125645103703462,\n        \"nauc_precision_at_5_max\": 0.4693888149566688,\n        \"nauc_precision_at_5_std\": 0.02425265344542158,\n        \"nauc_recall_at_1000_diff1\": 0.3775124084721618,\n        \"nauc_recall_at_1000_max\": 0.6907219027962078,\n        \"nauc_recall_at_1000_std\": 0.7452208953756937,\n        \"nauc_recall_at_100_diff1\": 0.4407570816548371,\n        \"nauc_recall_at_100_max\": 0.5148118714203502,\n        \"nauc_recall_at_100_std\": 0.4013318352470472,\n        \"nauc_recall_at_10_diff1\": 0.4589281365793298,\n        \"nauc_recall_at_10_max\": 0.46018520346713554,\n        \"nauc_recall_at_10_std\": 0.09171323079353179,\n        \"nauc_recall_at_1_diff1\": 0.6181956787495021,\n        \"nauc_recall_at_1_max\": 0.5593656854799941,\n        \"nauc_recall_at_1_std\": 0.005727785942886888,\n        \"nauc_recall_at_20_diff1\": 0.4180559028646046,\n        \"nauc_recall_at_20_max\": 0.48255119335389335,\n        \"nauc_recall_at_20_std\": 0.17746103192464796,\n        \"nauc_recall_at_3_diff1\": 0.5141393482286297,\n        \"nauc_recall_at_3_max\": 0.44248449929996847,\n        \"nauc_recall_at_3_std\": -0.034343486480034824,\n        \"nauc_recall_at_5_diff1\": 0.5125645103703461,\n        \"nauc_recall_at_5_max\": 0.46938881495666834,\n        \"nauc_recall_at_5_std\": 0.024252653445421834,\n        \"ndcg_at_1\": 0.29,\n        \"ndcg_at_10\": 0.3784,\n        \"ndcg_at_100\": 0.42817,\n        \"ndcg_at_1000\": 0.45293,\n        \"ndcg_at_20\": 0.39795,\n        \"ndcg_at_3\": 0.35297,\n        \"ndcg_at_5\": 0.36524,\n        \"precision_at_1\": 0.29,\n        \"precision_at_10\": 0.0465,\n        \"precision_at_100\": 0.00705,\n        \"precision_at_1000\": 0.00091,\n        \"precision_at_20\": 0.027,\n        \"precision_at_3\": 0.13167,\n        \"precision_at_5\": 0.085,\n        \"recall_at_1\": 0.29,\n        \"recall_at_10\": 0.465,\n        \"recall_at_100\": 0.705,\n        \"recall_at_1000\": 0.905,\n        \"recall_at_20\": 0.54,\n        \"recall_at_3\": 0.395,\n        \"recall_at_5\": 0.425\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/dragonkue/BGE-m3-ko/dragonkue__BGE-m3-ko/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 1.4347784519195557,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.81545,\n        \"map_at_1\": 0.7013,\n        \"map_at_10\": 0.77759,\n        \"map_at_100\": 0.78062,\n        \"map_at_1000\": 0.78062,\n        \"map_at_20\": 0.77954,\n        \"map_at_3\": 0.75974,\n        \"map_at_5\": 0.76883,\n        \"mrr_at_1\": 0.7012987012987013,\n        \"mrr_at_10\": 0.7775922490208205,\n        \"mrr_at_100\": 0.7806158886754763,\n        \"mrr_at_1000\": 0.7806158886754763,\n        \"mrr_at_20\": 0.779536828505507,\n        \"mrr_at_3\": 0.7597402597402597,\n        \"mrr_at_5\": 0.7688311688311689,\n        \"nauc_map_at_1000_diff1\": 0.6585307223652647,\n        \"nauc_map_at_1000_max\": 0.37680650139474897,\n        \"nauc_map_at_1000_std\": -0.1509877249691887,\n        \"nauc_map_at_100_diff1\": 0.6585307223652647,\n        \"nauc_map_at_100_max\": 0.37680650139474897,\n        \"nauc_map_at_100_std\": -0.1509877249691887,\n        \"nauc_map_at_10_diff1\": 0.6568847829190118,\n        \"nauc_map_at_10_max\": 0.3767377885847465,\n        \"nauc_map_at_10_std\": -0.14852493078538043,\n        \"nauc_map_at_1_diff1\": 0.6668096724205888,\n        \"nauc_map_at_1_max\": 0.36184014288741295,\n        \"nauc_map_at_1_std\": -0.15777912686633552,\n        \"nauc_map_at_20_diff1\": 0.6552188727740201,\n        \"nauc_map_at_20_max\": 0.37306386412717907,\n        \"nauc_map_at_20_std\": -0.15147819783345062,\n        \"nauc_map_at_3_diff1\": 0.6738011334604562,\n        \"nauc_map_at_3_max\": 0.39203434874434695,\n        \"nauc_map_at_3_std\": -0.1433564775107005,\n        \"nauc_map_at_5_diff1\": 0.663166522294746,\n        \"nauc_map_at_5_max\": 0.38276613935527093,\n        \"nauc_map_at_5_std\": -0.15743918578933352,\n        \"nauc_mrr_at_1000_diff1\": 0.6585307223652647,\n        \"nauc_mrr_at_1000_max\": 0.37680650139474897,\n        \"nauc_mrr_at_1000_std\": -0.1509877249691887,\n        \"nauc_mrr_at_100_diff1\": 0.6585307223652647,\n        \"nauc_mrr_at_100_max\": 0.37680650139474897,\n        \"nauc_mrr_at_100_std\": -0.1509877249691887,\n        \"nauc_mrr_at_10_diff1\": 0.6568847829190118,\n        \"nauc_mrr_at_10_max\": 0.3767377885847465,\n        \"nauc_mrr_at_10_std\": -0.14852493078538043,\n        \"nauc_mrr_at_1_diff1\": 0.6668096724205888,\n        \"nauc_mrr_at_1_max\": 0.36184014288741295,\n        \"nauc_mrr_at_1_std\": -0.15777912686633552,\n        \"nauc_mrr_at_20_diff1\": 0.6552188727740201,\n        \"nauc_mrr_at_20_max\": 0.37306386412717907,\n        \"nauc_mrr_at_20_std\": -0.15147819783345062,\n        \"nauc_mrr_at_3_diff1\": 0.6738011334604562,\n        \"nauc_mrr_at_3_max\": 0.39203434874434695,\n        \"nauc_mrr_at_3_std\": -0.1433564775107005,\n        \"nauc_mrr_at_5_diff1\": 0.663166522294746,\n        \"nauc_mrr_at_5_max\": 0.38276613935527093,\n        \"nauc_mrr_at_5_std\": -0.15743918578933352,\n        \"nauc_ndcg_at_1000_diff1\": 0.6529694109214854,\n        \"nauc_ndcg_at_1000_max\": 0.3733407917688893,\n        \"nauc_ndcg_at_1000_std\": -0.1508903313817761,\n        \"nauc_ndcg_at_100_diff1\": 0.6529694109214854,\n        \"nauc_ndcg_at_100_max\": 0.3733407917688893,\n        \"nauc_ndcg_at_100_std\": -0.1508903313817761,\n        \"nauc_ndcg_at_10_diff1\": 0.6362204198354469,\n        \"nauc_ndcg_at_10_max\": 0.3622349150702435,\n        \"nauc_ndcg_at_10_std\": -0.14284302622133724,\n        \"nauc_ndcg_at_1_diff1\": 0.6668096724205888,\n        \"nauc_ndcg_at_1_max\": 0.36184014288741295,\n        \"nauc_ndcg_at_1_std\": -0.15777912686633552,\n        \"nauc_ndcg_at_20_diff1\": 0.6295586442414385,\n        \"nauc_ndcg_at_20_max\": 0.3478591208886981,\n        \"nauc_ndcg_at_20_std\": -0.14884275561618454,\n        \"nauc_ndcg_at_3_diff1\": 0.6758508656326555,\n        \"nauc_ndcg_at_3_max\": 0.39908738607341165,\n        \"nauc_ndcg_at_3_std\": -0.14344324960656918,\n        \"nauc_ndcg_at_5_diff1\": 0.6553047110252233,\n        \"nauc_ndcg_at_5_max\": 0.38037489847847916,\n        \"nauc_ndcg_at_5_std\": -0.17020307882711103,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.42261678126376323,\n        \"nauc_precision_at_10_max\": 0.19705791037241055,\n        \"nauc_precision_at_10_std\": -0.06801212066082346,\n        \"nauc_precision_at_1_diff1\": 0.6668096724205888,\n        \"nauc_precision_at_1_max\": 0.36184014288741295,\n        \"nauc_precision_at_1_std\": -0.15777912686633552,\n        \"nauc_precision_at_20_diff1\": 0.1860790840193073,\n        \"nauc_precision_at_20_max\": -0.12420871870242532,\n        \"nauc_precision_at_20_std\": -0.058565069938573355,\n        \"nauc_precision_at_3_diff1\": 0.6834473314679363,\n        \"nauc_precision_at_3_max\": 0.42424295062548845,\n        \"nauc_precision_at_3_std\": -0.14612372971147158,\n        \"nauc_precision_at_5_diff1\": 0.6137297328925272,\n        \"nauc_precision_at_5_max\": 0.36146272035494137,\n        \"nauc_precision_at_5_std\": -0.23800854389467807,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.4226167812637596,\n        \"nauc_recall_at_10_max\": 0.1970579103724084,\n        \"nauc_recall_at_10_std\": -0.06801212066082829,\n        \"nauc_recall_at_1_diff1\": 0.6668096724205888,\n        \"nauc_recall_at_1_max\": 0.36184014288741295,\n        \"nauc_recall_at_1_std\": -0.15777912686633552,\n        \"nauc_recall_at_20_diff1\": 0.18607908401930062,\n        \"nauc_recall_at_20_max\": -0.12420871870243454,\n        \"nauc_recall_at_20_std\": -0.058565069938578386,\n        \"nauc_recall_at_3_diff1\": 0.6834473314679358,\n        \"nauc_recall_at_3_max\": 0.42424295062548667,\n        \"nauc_recall_at_3_std\": -0.14612372971147305,\n        \"nauc_recall_at_5_diff1\": 0.6137297328925254,\n        \"nauc_recall_at_5_max\": 0.36146272035494126,\n        \"nauc_recall_at_5_std\": -0.23800854389468104,\n        \"ndcg_at_1\": 0.7013,\n        \"ndcg_at_10\": 0.81545,\n        \"ndcg_at_100\": 0.82965,\n        \"ndcg_at_1000\": 0.82965,\n        \"ndcg_at_20\": 0.82219,\n        \"ndcg_at_3\": 0.77814,\n        \"ndcg_at_5\": 0.79435,\n        \"precision_at_1\": 0.7013,\n        \"precision_at_10\": 0.09351,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04805,\n        \"precision_at_3\": 0.27706,\n        \"precision_at_5\": 0.17403,\n        \"recall_at_1\": 0.7013,\n        \"recall_at_10\": 0.93506,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96104,\n        \"recall_at_3\": 0.83117,\n        \"recall_at_5\": 0.87013\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/dragonkue/BGE-m3-ko/dragonkue__BGE-m3-ko/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 15.096574306488037,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.38131,\n        \"map_at_1\": 0.20805,\n        \"map_at_10\": 0.32937,\n        \"map_at_100\": 0.3439,\n        \"map_at_1000\": 0.34498,\n        \"map_at_20\": 0.33584,\n        \"map_at_3\": 0.29493,\n        \"map_at_5\": 0.3129,\n        \"mrr_at_1\": 0.29510703363914376,\n        \"mrr_at_10\": 0.37063795446822967,\n        \"mrr_at_100\": 0.3814246776969569,\n        \"mrr_at_1000\": 0.3821234798000114,\n        \"mrr_at_20\": 0.37556796485400895,\n        \"mrr_at_3\": 0.34836901121304803,\n        \"mrr_at_5\": 0.358231396534149,\n        \"nauc_map_at_1000_diff1\": 0.47194617185309445,\n        \"nauc_map_at_1000_max\": 0.20063304959237294,\n        \"nauc_map_at_1000_std\": -0.27080467316354245,\n        \"nauc_map_at_100_diff1\": 0.47167258973917525,\n        \"nauc_map_at_100_max\": 0.20103909814762727,\n        \"nauc_map_at_100_std\": -0.2699996587163077,\n        \"nauc_map_at_10_diff1\": 0.47494322451299137,\n        \"nauc_map_at_10_max\": 0.19755348750394167,\n        \"nauc_map_at_10_std\": -0.277782394156506,\n        \"nauc_map_at_1_diff1\": 0.5243004316160466,\n        \"nauc_map_at_1_max\": 0.16858988412450363,\n        \"nauc_map_at_1_std\": -0.23630036197807808,\n        \"nauc_map_at_20_diff1\": 0.4731181060816184,\n        \"nauc_map_at_20_max\": 0.19910885900001027,\n        \"nauc_map_at_20_std\": -0.27552019101544084,\n        \"nauc_map_at_3_diff1\": 0.4660117998053003,\n        \"nauc_map_at_3_max\": 0.19183641669365997,\n        \"nauc_map_at_3_std\": -0.2739927144150334,\n        \"nauc_map_at_5_diff1\": 0.47215462722285606,\n        \"nauc_map_at_5_max\": 0.19356885465948628,\n        \"nauc_map_at_5_std\": -0.2743860928780198,\n        \"nauc_mrr_at_1000_diff1\": 0.49532131721462486,\n        \"nauc_mrr_at_1000_max\": 0.20403872185607005,\n        \"nauc_mrr_at_1000_std\": -0.2714557158295466,\n        \"nauc_mrr_at_100_diff1\": 0.49510161178221995,\n        \"nauc_mrr_at_100_max\": 0.20455710839900487,\n        \"nauc_mrr_at_100_std\": -0.2706221095946801,\n        \"nauc_mrr_at_10_diff1\": 0.4978837020078874,\n        \"nauc_mrr_at_10_max\": 0.20061088996099663,\n        \"nauc_mrr_at_10_std\": -0.278041836280318,\n        \"nauc_mrr_at_1_diff1\": 0.5221472978688461,\n        \"nauc_mrr_at_1_max\": 0.21672555112727923,\n        \"nauc_mrr_at_1_std\": -0.27530302599967527,\n        \"nauc_mrr_at_20_diff1\": 0.4953208420700562,\n        \"nauc_mrr_at_20_max\": 0.2027147445718628,\n        \"nauc_mrr_at_20_std\": -0.273790593913149,\n        \"nauc_mrr_at_3_diff1\": 0.49391292145586174,\n        \"nauc_mrr_at_3_max\": 0.19579114213137086,\n        \"nauc_mrr_at_3_std\": -0.2853501027400802,\n        \"nauc_mrr_at_5_diff1\": 0.49648266111657696,\n        \"nauc_mrr_at_5_max\": 0.19622910821499567,\n        \"nauc_mrr_at_5_std\": -0.27956239907708147,\n        \"nauc_ndcg_at_1000_diff1\": 0.47207814235419326,\n        \"nauc_ndcg_at_1000_max\": 0.21188037356947,\n        \"nauc_ndcg_at_1000_std\": -0.25352243997667206,\n        \"nauc_ndcg_at_100_diff1\": 0.4633453263763678,\n        \"nauc_ndcg_at_100_max\": 0.2243824116388276,\n        \"nauc_ndcg_at_100_std\": -0.22895084512717154,\n        \"nauc_ndcg_at_10_diff1\": 0.4788916780647435,\n        \"nauc_ndcg_at_10_max\": 0.19978376922980615,\n        \"nauc_ndcg_at_10_std\": -0.2785919189291289,\n        \"nauc_ndcg_at_1_diff1\": 0.5221472978688461,\n        \"nauc_ndcg_at_1_max\": 0.21865071515849718,\n        \"nauc_ndcg_at_1_std\": -0.2685722998447304,\n        \"nauc_ndcg_at_20_diff1\": 0.4711012521645191,\n        \"nauc_ndcg_at_20_max\": 0.2056753067718257,\n        \"nauc_ndcg_at_20_std\": -0.26741589614765826,\n        \"nauc_ndcg_at_3_diff1\": 0.46474190308719693,\n        \"nauc_ndcg_at_3_max\": 0.1847644418071173,\n        \"nauc_ndcg_at_3_std\": -0.2867448273254548,\n        \"nauc_ndcg_at_5_diff1\": 0.4735161679168353,\n        \"nauc_ndcg_at_5_max\": 0.18954784747065154,\n        \"nauc_ndcg_at_5_std\": -0.27643406781430935,\n        \"nauc_precision_at_1000_diff1\": -0.007073399531117126,\n        \"nauc_precision_at_1000_max\": 0.1339207045233831,\n        \"nauc_precision_at_1000_std\": 0.043721130389564745,\n        \"nauc_precision_at_100_diff1\": 0.07948052573255646,\n        \"nauc_precision_at_100_max\": 0.20810014729214976,\n        \"nauc_precision_at_100_std\": 0.056528611535616245,\n        \"nauc_precision_at_10_diff1\": 0.29732012581042677,\n        \"nauc_precision_at_10_max\": 0.1823552920291509,\n        \"nauc_precision_at_10_std\": -0.23160492342624037,\n        \"nauc_precision_at_1_diff1\": 0.5221472978688461,\n        \"nauc_precision_at_1_max\": 0.21865071515849718,\n        \"nauc_precision_at_1_std\": -0.2685722998447304,\n        \"nauc_precision_at_20_diff1\": 0.24428953207068782,\n        \"nauc_precision_at_20_max\": 0.1801858221280134,\n        \"nauc_precision_at_20_std\": -0.18286248889452628,\n        \"nauc_precision_at_3_diff1\": 0.32329540590167366,\n        \"nauc_precision_at_3_max\": 0.19220633029286657,\n        \"nauc_precision_at_3_std\": -0.2677700359244656,\n        \"nauc_precision_at_5_diff1\": 0.3184896312745215,\n        \"nauc_precision_at_5_max\": 0.18225716187240096,\n        \"nauc_precision_at_5_std\": -0.24637777822360407,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.3073481689515628,\n        \"nauc_recall_at_100_max\": 0.3795704344039231,\n        \"nauc_recall_at_100_std\": 0.12193816628411744,\n        \"nauc_recall_at_10_diff1\": 0.44821276251784015,\n        \"nauc_recall_at_10_max\": 0.19824435141573585,\n        \"nauc_recall_at_10_std\": -0.264794242965765,\n        \"nauc_recall_at_1_diff1\": 0.5243004316160466,\n        \"nauc_recall_at_1_max\": 0.16858988412450363,\n        \"nauc_recall_at_1_std\": -0.23630036197807808,\n        \"nauc_recall_at_20_diff1\": 0.4150155740384653,\n        \"nauc_recall_at_20_max\": 0.2175971000293212,\n        \"nauc_recall_at_20_std\": -0.22208607862333246,\n        \"nauc_recall_at_3_diff1\": 0.42772977991353756,\n        \"nauc_recall_at_3_max\": 0.16622301552591512,\n        \"nauc_recall_at_3_std\": -0.28349676394966694,\n        \"nauc_recall_at_5_diff1\": 0.4383484768687609,\n        \"nauc_recall_at_5_max\": 0.17066050173979333,\n        \"nauc_recall_at_5_std\": -0.2648561618543115,\n        \"ndcg_at_1\": 0.29511,\n        \"ndcg_at_10\": 0.38131,\n        \"ndcg_at_100\": 0.45497,\n        \"ndcg_at_1000\": 0.47873,\n        \"ndcg_at_20\": 0.40202,\n        \"ndcg_at_3\": 0.32597,\n        \"ndcg_at_5\": 0.34719,\n        \"precision_at_1\": 0.29511,\n        \"precision_at_10\": 0.07905,\n        \"precision_at_100\": 0.0132,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.04534,\n        \"precision_at_3\": 0.18145,\n        \"precision_at_5\": 0.12752,\n        \"recall_at_1\": 0.20805,\n        \"recall_at_10\": 0.4963,\n        \"recall_at_100\": 0.83022,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.56929,\n        \"recall_at_3\": 0.3486,\n        \"recall_at_5\": 0.40194\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.36783,\n        \"map_at_1\": 0.17171,\n        \"map_at_10\": 0.30648,\n        \"map_at_100\": 0.3248,\n        \"map_at_1000\": 0.3265,\n        \"map_at_20\": 0.31589,\n        \"map_at_3\": 0.25825,\n        \"map_at_5\": 0.28643,\n        \"mrr_at_1\": 0.2966360856269113,\n        \"mrr_at_10\": 0.37645927382165906,\n        \"mrr_at_100\": 0.3879992762175121,\n        \"mrr_at_1000\": 0.38875263914647545,\n        \"mrr_at_20\": 0.3828819704394874,\n        \"mrr_at_3\": 0.3509174311926606,\n        \"mrr_at_5\": 0.36590214067278287,\n        \"nauc_map_at_1000_diff1\": 0.39522495538335056,\n        \"nauc_map_at_1000_max\": 0.04174976457405107,\n        \"nauc_map_at_1000_std\": -0.31885078685550683,\n        \"nauc_map_at_100_diff1\": 0.3946345133323068,\n        \"nauc_map_at_100_max\": 0.04078098781556888,\n        \"nauc_map_at_100_std\": -0.3195025671933243,\n        \"nauc_map_at_10_diff1\": 0.3954986642658384,\n        \"nauc_map_at_10_max\": 0.041271257279853146,\n        \"nauc_map_at_10_std\": -0.3201810221507347,\n        \"nauc_map_at_1_diff1\": 0.46018940673767755,\n        \"nauc_map_at_1_max\": 0.026857409991088595,\n        \"nauc_map_at_1_std\": -0.26072768511708483,\n        \"nauc_map_at_20_diff1\": 0.39526425341235644,\n        \"nauc_map_at_20_max\": 0.03852146604102061,\n        \"nauc_map_at_20_std\": -0.3229992529439229,\n        \"nauc_map_at_3_diff1\": 0.40751986930045464,\n        \"nauc_map_at_3_max\": 0.033755935440305126,\n        \"nauc_map_at_3_std\": -0.31104300522643485,\n        \"nauc_map_at_5_diff1\": 0.39815137542719947,\n        \"nauc_map_at_5_max\": 0.036140431875306425,\n        \"nauc_map_at_5_std\": -0.320757402972474,\n        \"nauc_mrr_at_1000_diff1\": 0.41138892539207805,\n        \"nauc_mrr_at_1000_max\": 0.036075706028644856,\n        \"nauc_mrr_at_1000_std\": -0.32158632796741027,\n        \"nauc_mrr_at_100_diff1\": 0.4107983157690925,\n        \"nauc_mrr_at_100_max\": 0.036285694743612026,\n        \"nauc_mrr_at_100_std\": -0.32093532373076283,\n        \"nauc_mrr_at_10_diff1\": 0.41046754117231543,\n        \"nauc_mrr_at_10_max\": 0.03410885855306805,\n        \"nauc_mrr_at_10_std\": -0.32625815315272727,\n        \"nauc_mrr_at_1_diff1\": 0.466179363499551,\n        \"nauc_mrr_at_1_max\": 0.044401491514074486,\n        \"nauc_mrr_at_1_std\": -0.31994123134797725,\n        \"nauc_mrr_at_20_diff1\": 0.41037316727398276,\n        \"nauc_mrr_at_20_max\": 0.03439737123523601,\n        \"nauc_mrr_at_20_std\": -0.32329135614933974,\n        \"nauc_mrr_at_3_diff1\": 0.41952574843966106,\n        \"nauc_mrr_at_3_max\": 0.029129685849109452,\n        \"nauc_mrr_at_3_std\": -0.33463121553924624,\n        \"nauc_mrr_at_5_diff1\": 0.414221864309102,\n        \"nauc_mrr_at_5_max\": 0.033148923369830066,\n        \"nauc_mrr_at_5_std\": -0.3306114597523587,\n        \"nauc_ndcg_at_1000_diff1\": 0.38549772415494227,\n        \"nauc_ndcg_at_1000_max\": 0.0514557026520757,\n        \"nauc_ndcg_at_1000_std\": -0.30279726116120725,\n        \"nauc_ndcg_at_100_diff1\": 0.3727602829287285,\n        \"nauc_ndcg_at_100_max\": 0.048233930311151973,\n        \"nauc_ndcg_at_100_std\": -0.2962119804155439,\n        \"nauc_ndcg_at_10_diff1\": 0.38051043963062375,\n        \"nauc_ndcg_at_10_max\": 0.036367319868345106,\n        \"nauc_ndcg_at_10_std\": -0.32456955734935256,\n        \"nauc_ndcg_at_1_diff1\": 0.466179363499551,\n        \"nauc_ndcg_at_1_max\": 0.044401491514074486,\n        \"nauc_ndcg_at_1_std\": -0.31994123134797725,\n        \"nauc_ndcg_at_20_diff1\": 0.378712854202551,\n        \"nauc_ndcg_at_20_max\": 0.03184188908580192,\n        \"nauc_ndcg_at_20_std\": -0.32546078957376057,\n        \"nauc_ndcg_at_3_diff1\": 0.39511029275208914,\n        \"nauc_ndcg_at_3_max\": 0.03176054328577763,\n        \"nauc_ndcg_at_3_std\": -0.32941163777526294,\n        \"nauc_ndcg_at_5_diff1\": 0.38647610324783105,\n        \"nauc_ndcg_at_5_max\": 0.029787744926969575,\n        \"nauc_ndcg_at_5_std\": -0.32996941608936253,\n        \"nauc_precision_at_1000_diff1\": 0.0006998751582486866,\n        \"nauc_precision_at_1000_max\": 0.11825407208946465,\n        \"nauc_precision_at_1000_std\": 0.01712018373173514,\n        \"nauc_precision_at_100_diff1\": 0.0549092317048009,\n        \"nauc_precision_at_100_max\": 0.09826849400810544,\n        \"nauc_precision_at_100_std\": -0.057210573901148136,\n        \"nauc_precision_at_10_diff1\": 0.19800849972948234,\n        \"nauc_precision_at_10_max\": 0.0471972091041214,\n        \"nauc_precision_at_10_std\": -0.2682010255326668,\n        \"nauc_precision_at_1_diff1\": 0.466179363499551,\n        \"nauc_precision_at_1_max\": 0.044401491514074486,\n        \"nauc_precision_at_1_std\": -0.31994123134797725,\n        \"nauc_precision_at_20_diff1\": 0.17420748368672398,\n        \"nauc_precision_at_20_max\": 0.03308766045486042,\n        \"nauc_precision_at_20_std\": -0.25054427932796136,\n        \"nauc_precision_at_3_diff1\": 0.2861768860728149,\n        \"nauc_precision_at_3_max\": 0.030311130047706455,\n        \"nauc_precision_at_3_std\": -0.34534427655896854,\n        \"nauc_precision_at_5_diff1\": 0.2317301049279226,\n        \"nauc_precision_at_5_max\": 0.030641536817061336,\n        \"nauc_precision_at_5_std\": -0.3203145309958511,\n        \"nauc_recall_at_1000_diff1\": 0.604153036897657,\n        \"nauc_recall_at_1000_max\": 0.49836049087161766,\n        \"nauc_recall_at_1000_std\": 0.4914469784736325,\n        \"nauc_recall_at_100_diff1\": 0.19683162305052707,\n        \"nauc_recall_at_100_max\": 0.07559457900716732,\n        \"nauc_recall_at_100_std\": -0.10709365405290024,\n        \"nauc_recall_at_10_diff1\": 0.3041464761589614,\n        \"nauc_recall_at_10_max\": 0.02771192688008908,\n        \"nauc_recall_at_10_std\": -0.30107264533528405,\n        \"nauc_recall_at_1_diff1\": 0.46018940673767755,\n        \"nauc_recall_at_1_max\": 0.026857409991088595,\n        \"nauc_recall_at_1_std\": -0.26072768511708483,\n        \"nauc_recall_at_20_diff1\": 0.29055647974103144,\n        \"nauc_recall_at_20_max\": 0.011652203062635029,\n        \"nauc_recall_at_20_std\": -0.30092242080512877,\n        \"nauc_recall_at_3_diff1\": 0.34551445060774777,\n        \"nauc_recall_at_3_max\": 0.011961831015589949,\n        \"nauc_recall_at_3_std\": -0.3023740962483907,\n        \"nauc_recall_at_5_diff1\": 0.32472988425610233,\n        \"nauc_recall_at_5_max\": 0.016604695108971373,\n        \"nauc_recall_at_5_std\": -0.31547424015605674,\n        \"ndcg_at_1\": 0.29664,\n        \"ndcg_at_10\": 0.36783,\n        \"ndcg_at_100\": 0.44805,\n        \"ndcg_at_1000\": 0.47639,\n        \"ndcg_at_20\": 0.39491,\n        \"ndcg_at_3\": 0.30936,\n        \"ndcg_at_5\": 0.33167,\n        \"precision_at_1\": 0.29664,\n        \"precision_at_10\": 0.09771,\n        \"precision_at_100\": 0.01621,\n        \"precision_at_1000\": 0.00195,\n        \"precision_at_20\": 0.0578,\n        \"precision_at_3\": 0.1998,\n        \"precision_at_5\": 0.15443,\n        \"recall_at_1\": 0.17171,\n        \"recall_at_10\": 0.47018,\n        \"recall_at_100\": 0.80877,\n        \"recall_at_1000\": 0.99745,\n        \"recall_at_20\": 0.56017,\n        \"recall_at_3\": 0.30961,\n        \"recall_at_5\": 0.38124\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.34224,\n        \"map_at_1\": 0.17882,\n        \"map_at_10\": 0.29102,\n        \"map_at_100\": 0.30843,\n        \"map_at_1000\": 0.30981,\n        \"map_at_20\": 0.29978,\n        \"map_at_3\": 0.25808,\n        \"map_at_5\": 0.27623,\n        \"mrr_at_1\": 0.25895765472312704,\n        \"mrr_at_10\": 0.3347745721524222,\n        \"mrr_at_100\": 0.34704620639973177,\n        \"mrr_at_1000\": 0.34790416138574237,\n        \"mrr_at_20\": 0.3413059184607473,\n        \"mrr_at_3\": 0.31026058631921827,\n        \"mrr_at_5\": 0.32491856677524417,\n        \"nauc_map_at_1000_diff1\": 0.4442606266867698,\n        \"nauc_map_at_1000_max\": 0.1708185281377609,\n        \"nauc_map_at_1000_std\": -0.2150207849454721,\n        \"nauc_map_at_100_diff1\": 0.44381219715728043,\n        \"nauc_map_at_100_max\": 0.1707274710341615,\n        \"nauc_map_at_100_std\": -0.21455708234165588,\n        \"nauc_map_at_10_diff1\": 0.4436015785611014,\n        \"nauc_map_at_10_max\": 0.16655090962737581,\n        \"nauc_map_at_10_std\": -0.22490018596457073,\n        \"nauc_map_at_1_diff1\": 0.5389347444540163,\n        \"nauc_map_at_1_max\": 0.1515899453580535,\n        \"nauc_map_at_1_std\": -0.1767816810758001,\n        \"nauc_map_at_20_diff1\": 0.4430880291336973,\n        \"nauc_map_at_20_max\": 0.16720914284848754,\n        \"nauc_map_at_20_std\": -0.22236181609399264,\n        \"nauc_map_at_3_diff1\": 0.4540839727614088,\n        \"nauc_map_at_3_max\": 0.1654335659396773,\n        \"nauc_map_at_3_std\": -0.21649157978042835,\n        \"nauc_map_at_5_diff1\": 0.446028297739072,\n        \"nauc_map_at_5_max\": 0.16686509996341534,\n        \"nauc_map_at_5_std\": -0.22249139471925608,\n        \"nauc_mrr_at_1000_diff1\": 0.47729996007831915,\n        \"nauc_mrr_at_1000_max\": 0.18441282412110485,\n        \"nauc_mrr_at_1000_std\": -0.20627941403812264,\n        \"nauc_mrr_at_100_diff1\": 0.4770835727205064,\n        \"nauc_mrr_at_100_max\": 0.18479601696449416,\n        \"nauc_mrr_at_100_std\": -0.20545326120890625,\n        \"nauc_mrr_at_10_diff1\": 0.4777617449135116,\n        \"nauc_mrr_at_10_max\": 0.17994374717776154,\n        \"nauc_mrr_at_10_std\": -0.21547996625752097,\n        \"nauc_mrr_at_1_diff1\": 0.5068810551795434,\n        \"nauc_mrr_at_1_max\": 0.18618278045779485,\n        \"nauc_mrr_at_1_std\": -0.19506776109325624,\n        \"nauc_mrr_at_20_diff1\": 0.47678901427838954,\n        \"nauc_mrr_at_20_max\": 0.18417263509377577,\n        \"nauc_mrr_at_20_std\": -0.2085117124654718,\n        \"nauc_mrr_at_3_diff1\": 0.4844441192011046,\n        \"nauc_mrr_at_3_max\": 0.1792234137967968,\n        \"nauc_mrr_at_3_std\": -0.21664277015642558,\n        \"nauc_mrr_at_5_diff1\": 0.47820491737651394,\n        \"nauc_mrr_at_5_max\": 0.17845755566828503,\n        \"nauc_mrr_at_5_std\": -0.2157898644431357,\n        \"nauc_ndcg_at_1000_diff1\": 0.4481873693885092,\n        \"nauc_ndcg_at_1000_max\": 0.18787360902505088,\n        \"nauc_ndcg_at_1000_std\": -0.19316289425075395,\n        \"nauc_ndcg_at_100_diff1\": 0.4394537819468697,\n        \"nauc_ndcg_at_100_max\": 0.19350311354898503,\n        \"nauc_ndcg_at_100_std\": -0.17390263754390844,\n        \"nauc_ndcg_at_10_diff1\": 0.4402180150810218,\n        \"nauc_ndcg_at_10_max\": 0.16592842467392824,\n        \"nauc_ndcg_at_10_std\": -0.23244228557748658,\n        \"nauc_ndcg_at_1_diff1\": 0.5133942160277655,\n        \"nauc_ndcg_at_1_max\": 0.19111862143910074,\n        \"nauc_ndcg_at_1_std\": -0.19122036203008314,\n        \"nauc_ndcg_at_20_diff1\": 0.43690865520526906,\n        \"nauc_ndcg_at_20_max\": 0.17219255964138427,\n        \"nauc_ndcg_at_20_std\": -0.21841228017116848,\n        \"nauc_ndcg_at_3_diff1\": 0.44994103943624364,\n        \"nauc_ndcg_at_3_max\": 0.16271644024934,\n        \"nauc_ndcg_at_3_std\": -0.2257117973448687,\n        \"nauc_ndcg_at_5_diff1\": 0.4419982475303065,\n        \"nauc_ndcg_at_5_max\": 0.16545612756504927,\n        \"nauc_ndcg_at_5_std\": -0.229005873748153,\n        \"nauc_precision_at_1000_diff1\": 0.02730691276697214,\n        \"nauc_precision_at_1000_max\": 0.19545611505796542,\n        \"nauc_precision_at_1000_std\": 0.13374115163843245,\n        \"nauc_precision_at_100_diff1\": 0.10858753845867798,\n        \"nauc_precision_at_100_max\": 0.22412725787013638,\n        \"nauc_precision_at_100_std\": 0.11797913299580332,\n        \"nauc_precision_at_10_diff1\": 0.24374020626851647,\n        \"nauc_precision_at_10_max\": 0.13709507229772783,\n        \"nauc_precision_at_10_std\": -0.19945109358534438,\n        \"nauc_precision_at_1_diff1\": 0.5133942160277655,\n        \"nauc_precision_at_1_max\": 0.19111862143910074,\n        \"nauc_precision_at_1_std\": -0.19122036203008314,\n        \"nauc_precision_at_20_diff1\": 0.21489905139680565,\n        \"nauc_precision_at_20_max\": 0.14602555693961008,\n        \"nauc_precision_at_20_std\": -0.13637072628292257,\n        \"nauc_precision_at_3_diff1\": 0.3042491138905916,\n        \"nauc_precision_at_3_max\": 0.1595855715203587,\n        \"nauc_precision_at_3_std\": -0.2197706922055072,\n        \"nauc_precision_at_5_diff1\": 0.2733108865826472,\n        \"nauc_precision_at_5_max\": 0.14881048996436866,\n        \"nauc_precision_at_5_std\": -0.21817734063690133,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.31997277429981313,\n        \"nauc_recall_at_100_max\": 0.25904864898037366,\n        \"nauc_recall_at_100_std\": 0.06524456028606167,\n        \"nauc_recall_at_10_diff1\": 0.3817894506993761,\n        \"nauc_recall_at_10_max\": 0.14522958635782565,\n        \"nauc_recall_at_10_std\": -0.25094904036841065,\n        \"nauc_recall_at_1_diff1\": 0.5389347444540163,\n        \"nauc_recall_at_1_max\": 0.1515899453580535,\n        \"nauc_recall_at_1_std\": -0.1767816810758001,\n        \"nauc_recall_at_20_diff1\": 0.358863155772006,\n        \"nauc_recall_at_20_max\": 0.16139314884864522,\n        \"nauc_recall_at_20_std\": -0.2036131731964118,\n        \"nauc_recall_at_3_diff1\": 0.40411661757221,\n        \"nauc_recall_at_3_max\": 0.1393116422204287,\n        \"nauc_recall_at_3_std\": -0.23447710699237967,\n        \"nauc_recall_at_5_diff1\": 0.3856211181381593,\n        \"nauc_recall_at_5_max\": 0.14440756509928318,\n        \"nauc_recall_at_5_std\": -0.2416137241970891,\n        \"ndcg_at_1\": 0.25733,\n        \"ndcg_at_10\": 0.34224,\n        \"ndcg_at_100\": 0.42225,\n        \"ndcg_at_1000\": 0.45136,\n        \"ndcg_at_20\": 0.36854,\n        \"ndcg_at_3\": 0.28972,\n        \"ndcg_at_5\": 0.31342,\n        \"precision_at_1\": 0.25733,\n        \"precision_at_10\": 0.0759,\n        \"precision_at_100\": 0.01362,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.04552,\n        \"precision_at_3\": 0.16721,\n        \"precision_at_5\": 0.1228,\n        \"recall_at_1\": 0.17882,\n        \"recall_at_10\": 0.44671,\n        \"recall_at_100\": 0.79306,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.53776,\n        \"recall_at_3\": 0.31319,\n        \"recall_at_5\": 0.37015\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/dragonkue/BGE-m3-ko/dragonkue__BGE-m3-ko/no_revision_available/model_meta.json",
    "content": "{\"name\": \"dragonkue/BGE-m3-ko\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": [], \"n_parameters\": null, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": null, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"Sentence Transformers\"], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"zero_shot_benchmarks\": null, \"loader\": null}"
  },
  {
    "path": "eval/results/intfloat/e5-mistral-7b-instruct/intfloat__e5-mistral-7b-instruct/07163b72af1488142a360786df853f237b1a3ca1/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 151.6671278476715,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.67849,\n        \"map_at_1\": 0.50877,\n        \"map_at_10\": 0.62073,\n        \"map_at_100\": 0.62583,\n        \"map_at_1000\": 0.62602,\n        \"map_at_20\": 0.62309,\n        \"map_at_3\": 0.59357,\n        \"map_at_5\": 0.6076,\n        \"mrr_at_1\": 0.5087719298245614,\n        \"mrr_at_10\": 0.6207323865218602,\n        \"mrr_at_100\": 0.6258257568399235,\n        \"mrr_at_1000\": 0.6260219632471632,\n        \"mrr_at_20\": 0.623094651834264,\n        \"mrr_at_3\": 0.5935672514619883,\n        \"mrr_at_5\": 0.6076023391812866,\n        \"nauc_map_at_1000_diff1\": 0.582288233790788,\n        \"nauc_map_at_1000_max\": 0.23044371638953698,\n        \"nauc_map_at_1000_std\": -0.41208734259159496,\n        \"nauc_map_at_100_diff1\": 0.5817918027086326,\n        \"nauc_map_at_100_max\": 0.2304667287527998,\n        \"nauc_map_at_100_std\": -0.41215377561858174,\n        \"nauc_map_at_10_diff1\": 0.5846846399924914,\n        \"nauc_map_at_10_max\": 0.23401910272999615,\n        \"nauc_map_at_10_std\": -0.4140334389430552,\n        \"nauc_map_at_1_diff1\": 0.6090728823575914,\n        \"nauc_map_at_1_max\": 0.21248155213502273,\n        \"nauc_map_at_1_std\": -0.35903170112785254,\n        \"nauc_map_at_20_diff1\": 0.5826702654390756,\n        \"nauc_map_at_20_max\": 0.22948806438882577,\n        \"nauc_map_at_20_std\": -0.4144789094616613,\n        \"nauc_map_at_3_diff1\": 0.5671123042755822,\n        \"nauc_map_at_3_max\": 0.23142735508369172,\n        \"nauc_map_at_3_std\": -0.39674000031475426,\n        \"nauc_map_at_5_diff1\": 0.5794706593498045,\n        \"nauc_map_at_5_max\": 0.23881979426157995,\n        \"nauc_map_at_5_std\": -0.39372881376091706,\n        \"nauc_mrr_at_1000_diff1\": 0.582288233790788,\n        \"nauc_mrr_at_1000_max\": 0.23044371638953698,\n        \"nauc_mrr_at_1000_std\": -0.41208734259159496,\n        \"nauc_mrr_at_100_diff1\": 0.5817918027086326,\n        \"nauc_mrr_at_100_max\": 0.2304667287527998,\n        \"nauc_mrr_at_100_std\": -0.41215377561858174,\n        \"nauc_mrr_at_10_diff1\": 0.5846846399924914,\n        \"nauc_mrr_at_10_max\": 0.23401910272999615,\n        \"nauc_mrr_at_10_std\": -0.4140334389430552,\n        \"nauc_mrr_at_1_diff1\": 0.6090728823575914,\n        \"nauc_mrr_at_1_max\": 0.21248155213502273,\n        \"nauc_mrr_at_1_std\": -0.35903170112785254,\n        \"nauc_mrr_at_20_diff1\": 0.5826702654390756,\n        \"nauc_mrr_at_20_max\": 0.22948806438882577,\n        \"nauc_mrr_at_20_std\": -0.4144789094616613,\n        \"nauc_mrr_at_3_diff1\": 0.5671123042755822,\n        \"nauc_mrr_at_3_max\": 0.23142735508369172,\n        \"nauc_mrr_at_3_std\": -0.39674000031475426,\n        \"nauc_mrr_at_5_diff1\": 0.5794706593498045,\n        \"nauc_mrr_at_5_max\": 0.23881979426157995,\n        \"nauc_mrr_at_5_std\": -0.39372881376091706,\n        \"nauc_ndcg_at_1000_diff1\": 0.5733224625227847,\n        \"nauc_ndcg_at_1000_max\": 0.23028659532099577,\n        \"nauc_ndcg_at_1000_std\": -0.4246935854927388,\n        \"nauc_ndcg_at_100_diff1\": 0.5614942543371718,\n        \"nauc_ndcg_at_100_max\": 0.2305352837673783,\n        \"nauc_ndcg_at_100_std\": -0.42624394933307364,\n        \"nauc_ndcg_at_10_diff1\": 0.57543116454026,\n        \"nauc_ndcg_at_10_max\": 0.24002962690822346,\n        \"nauc_ndcg_at_10_std\": -0.4453247064049292,\n        \"nauc_ndcg_at_1_diff1\": 0.6090728823575914,\n        \"nauc_ndcg_at_1_max\": 0.21248155213502273,\n        \"nauc_ndcg_at_1_std\": -0.35903170112785254,\n        \"nauc_ndcg_at_20_diff1\": 0.565557539829234,\n        \"nauc_ndcg_at_20_max\": 0.2218272444517468,\n        \"nauc_ndcg_at_20_std\": -0.4474161022413809,\n        \"nauc_ndcg_at_3_diff1\": 0.5438811101297,\n        \"nauc_ndcg_at_3_max\": 0.23675676717529345,\n        \"nauc_ndcg_at_3_std\": -0.40301874051380876,\n        \"nauc_ndcg_at_5_diff1\": 0.5668612106583857,\n        \"nauc_ndcg_at_5_max\": 0.2502845900216014,\n        \"nauc_ndcg_at_5_std\": -0.3985522286869084,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": -0.15663902232913457,\n        \"nauc_precision_at_100_max\": 0.24095945650359982,\n        \"nauc_precision_at_100_std\": -0.5227782238828026,\n        \"nauc_precision_at_10_diff1\": 0.5200476725127159,\n        \"nauc_precision_at_10_max\": 0.2734245435140121,\n        \"nauc_precision_at_10_std\": -0.6530978486978932,\n        \"nauc_precision_at_1_diff1\": 0.6090728823575914,\n        \"nauc_precision_at_1_max\": 0.21248155213502273,\n        \"nauc_precision_at_1_std\": -0.35903170112785254,\n        \"nauc_precision_at_20_diff1\": 0.4073558080534852,\n        \"nauc_precision_at_20_max\": 0.11918508664313493,\n        \"nauc_precision_at_20_std\": -0.7296703090179871,\n        \"nauc_precision_at_3_diff1\": 0.45878133440822105,\n        \"nauc_precision_at_3_max\": 0.25499625716929286,\n        \"nauc_precision_at_3_std\": -0.42238881381557775,\n        \"nauc_precision_at_5_diff1\": 0.5161458610560639,\n        \"nauc_precision_at_5_max\": 0.2988483896664812,\n        \"nauc_precision_at_5_std\": -0.41512583759679444,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": -0.1566390223291421,\n        \"nauc_recall_at_100_max\": 0.24095945650358844,\n        \"nauc_recall_at_100_std\": -0.5227782238828191,\n        \"nauc_recall_at_10_diff1\": 0.520047672512716,\n        \"nauc_recall_at_10_max\": 0.2734245435140122,\n        \"nauc_recall_at_10_std\": -0.6530978486978949,\n        \"nauc_recall_at_1_diff1\": 0.6090728823575914,\n        \"nauc_recall_at_1_max\": 0.21248155213502273,\n        \"nauc_recall_at_1_std\": -0.35903170112785254,\n        \"nauc_recall_at_20_diff1\": 0.40735580805348587,\n        \"nauc_recall_at_20_max\": 0.11918508664313392,\n        \"nauc_recall_at_20_std\": -0.729670309017987,\n        \"nauc_recall_at_3_diff1\": 0.45878133440822066,\n        \"nauc_recall_at_3_max\": 0.2549962571692935,\n        \"nauc_recall_at_3_std\": -0.4223888138155778,\n        \"nauc_recall_at_5_diff1\": 0.5161458610560639,\n        \"nauc_recall_at_5_max\": 0.29884838966647986,\n        \"nauc_recall_at_5_std\": -0.4151258375967945,\n        \"ndcg_at_1\": 0.50877,\n        \"ndcg_at_10\": 0.67849,\n        \"ndcg_at_100\": 0.70322,\n        \"ndcg_at_1000\": 0.70694,\n        \"ndcg_at_20\": 0.68726,\n        \"ndcg_at_3\": 0.62343,\n        \"ndcg_at_5\": 0.64872,\n        \"precision_at_1\": 0.50877,\n        \"precision_at_10\": 0.08596,\n        \"precision_at_100\": 0.00974,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04474,\n        \"precision_at_3\": 0.23684,\n        \"precision_at_5\": 0.15439,\n        \"recall_at_1\": 0.50877,\n        \"recall_at_10\": 0.85965,\n        \"recall_at_100\": 0.97368,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.89474,\n        \"recall_at_3\": 0.71053,\n        \"recall_at_5\": 0.77193\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/e5-mistral-7b-instruct/intfloat__e5-mistral-7b-instruct/07163b72af1488142a360786df853f237b1a3ca1/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 151.1522355079651,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.92403,\n        \"map_at_1\": 0.87,\n        \"map_at_10\": 0.9083,\n        \"map_at_100\": 0.90944,\n        \"map_at_1000\": 0.90947,\n        \"map_at_20\": 0.90918,\n        \"map_at_3\": 0.90241,\n        \"map_at_5\": 0.90624,\n        \"mrr_at_1\": 0.87,\n        \"mrr_at_10\": 0.9082954144620813,\n        \"mrr_at_100\": 0.909443837395513,\n        \"mrr_at_1000\": 0.9094705266851508,\n        \"mrr_at_20\": 0.9091781330268173,\n        \"mrr_at_3\": 0.9024074074074075,\n        \"mrr_at_5\": 0.9062407407407409,\n        \"nauc_map_at_1000_diff1\": 0.9087102061067024,\n        \"nauc_map_at_1000_max\": 0.766168221985831,\n        \"nauc_map_at_1000_std\": -0.1648800489468126,\n        \"nauc_map_at_100_diff1\": 0.9087248992727647,\n        \"nauc_map_at_100_max\": 0.7662386636292916,\n        \"nauc_map_at_100_std\": -0.16484587582543506,\n        \"nauc_map_at_10_diff1\": 0.9083597819986478,\n        \"nauc_map_at_10_max\": 0.7657665753111865,\n        \"nauc_map_at_10_std\": -0.16615363444355752,\n        \"nauc_map_at_1_diff1\": 0.9120154368987957,\n        \"nauc_map_at_1_max\": 0.7576958206818232,\n        \"nauc_map_at_1_std\": -0.1504110197733845,\n        \"nauc_map_at_20_diff1\": 0.9088535062630146,\n        \"nauc_map_at_20_max\": 0.7664545921257993,\n        \"nauc_map_at_20_std\": -0.16440632717917356,\n        \"nauc_map_at_3_diff1\": 0.9045838102108751,\n        \"nauc_map_at_3_max\": 0.763024859106417,\n        \"nauc_map_at_3_std\": -0.1770295998568004,\n        \"nauc_map_at_5_diff1\": 0.9085555990659762,\n        \"nauc_map_at_5_max\": 0.7647866209411698,\n        \"nauc_map_at_5_std\": -0.17732191665098596,\n        \"nauc_mrr_at_1000_diff1\": 0.9087102061067024,\n        \"nauc_mrr_at_1000_max\": 0.766168221985831,\n        \"nauc_mrr_at_1000_std\": -0.1648800489468126,\n        \"nauc_mrr_at_100_diff1\": 0.9087248992727647,\n        \"nauc_mrr_at_100_max\": 0.7662386636292916,\n        \"nauc_mrr_at_100_std\": -0.16484587582543506,\n        \"nauc_mrr_at_10_diff1\": 0.9083597819986478,\n        \"nauc_mrr_at_10_max\": 0.7657665753111865,\n        \"nauc_mrr_at_10_std\": -0.16615363444355752,\n        \"nauc_mrr_at_1_diff1\": 0.9120154368987957,\n        \"nauc_mrr_at_1_max\": 0.7576958206818232,\n        \"nauc_mrr_at_1_std\": -0.1504110197733845,\n        \"nauc_mrr_at_20_diff1\": 0.9088535062630146,\n        \"nauc_mrr_at_20_max\": 0.7664545921257993,\n        \"nauc_mrr_at_20_std\": -0.16440632717917356,\n        \"nauc_mrr_at_3_diff1\": 0.9045838102108751,\n        \"nauc_mrr_at_3_max\": 0.763024859106417,\n        \"nauc_mrr_at_3_std\": -0.1770295998568004,\n        \"nauc_mrr_at_5_diff1\": 0.9085555990659762,\n        \"nauc_mrr_at_5_max\": 0.7647866209411698,\n        \"nauc_mrr_at_5_std\": -0.17732191665098596,\n        \"nauc_ndcg_at_1000_diff1\": 0.9089940551247231,\n        \"nauc_ndcg_at_1000_max\": 0.7684755456124541,\n        \"nauc_ndcg_at_1000_std\": -0.1634540891579336,\n        \"nauc_ndcg_at_100_diff1\": 0.9094774523703856,\n        \"nauc_ndcg_at_100_max\": 0.7704651683565917,\n        \"nauc_ndcg_at_100_std\": -0.16088569042832504,\n        \"nauc_ndcg_at_10_diff1\": 0.9084825910977311,\n        \"nauc_ndcg_at_10_max\": 0.7694146916366845,\n        \"nauc_ndcg_at_10_std\": -0.16401000307785144,\n        \"nauc_ndcg_at_1_diff1\": 0.9120154368987957,\n        \"nauc_ndcg_at_1_max\": 0.7576958206818232,\n        \"nauc_ndcg_at_1_std\": -0.1504110197733845,\n        \"nauc_ndcg_at_20_diff1\": 0.9102490741608852,\n        \"nauc_ndcg_at_20_max\": 0.772394437957629,\n        \"nauc_ndcg_at_20_std\": -0.1554085967649596,\n        \"nauc_ndcg_at_3_diff1\": 0.9013487734702595,\n        \"nauc_ndcg_at_3_max\": 0.7633185143220046,\n        \"nauc_ndcg_at_3_std\": -0.1918571927274191,\n        \"nauc_ndcg_at_5_diff1\": 0.9092867089203742,\n        \"nauc_ndcg_at_5_max\": 0.7665885728237049,\n        \"nauc_ndcg_at_5_std\": -0.19472790384402736,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9673202614378776,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.18557422969188173,\n        \"nauc_precision_at_10_diff1\": 0.9115779645191425,\n        \"nauc_precision_at_10_max\": 0.8047619047619075,\n        \"nauc_precision_at_10_std\": -0.11591036414566304,\n        \"nauc_precision_at_1_diff1\": 0.9120154368987957,\n        \"nauc_precision_at_1_max\": 0.7576958206818232,\n        \"nauc_precision_at_1_std\": -0.1504110197733845,\n        \"nauc_precision_at_20_diff1\": 0.9416433239962602,\n        \"nauc_precision_at_20_max\": 0.8837868480725527,\n        \"nauc_precision_at_20_std\": 0.08346672002133163,\n        \"nauc_precision_at_3_diff1\": 0.8865719127157048,\n        \"nauc_precision_at_3_max\": 0.763685721202064,\n        \"nauc_precision_at_3_std\": -0.2611439637583455,\n        \"nauc_precision_at_5_diff1\": 0.9160860925566805,\n        \"nauc_precision_at_5_max\": 0.776628600158008,\n        \"nauc_precision_at_5_std\": -0.30469965764083523,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9673202614379001,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.18557422969189222,\n        \"nauc_recall_at_10_diff1\": 0.9115779645191382,\n        \"nauc_recall_at_10_max\": 0.8047619047619022,\n        \"nauc_recall_at_10_std\": -0.1159103641456544,\n        \"nauc_recall_at_1_diff1\": 0.9120154368987957,\n        \"nauc_recall_at_1_max\": 0.7576958206818232,\n        \"nauc_recall_at_1_std\": -0.1504110197733845,\n        \"nauc_recall_at_20_diff1\": 0.9416433239962608,\n        \"nauc_recall_at_20_max\": 0.8837868480725666,\n        \"nauc_recall_at_20_std\": 0.08346672002134754,\n        \"nauc_recall_at_3_diff1\": 0.8865719127157022,\n        \"nauc_recall_at_3_max\": 0.7636857212020612,\n        \"nauc_recall_at_3_std\": -0.2611439637583427,\n        \"nauc_recall_at_5_diff1\": 0.9160860925566815,\n        \"nauc_recall_at_5_max\": 0.7766286001580116,\n        \"nauc_recall_at_5_std\": -0.3046996576408323,\n        \"ndcg_at_1\": 0.87,\n        \"ndcg_at_10\": 0.92403,\n        \"ndcg_at_100\": 0.92919,\n        \"ndcg_at_1000\": 0.92979,\n        \"ndcg_at_20\": 0.92716,\n        \"ndcg_at_3\": 0.91213,\n        \"ndcg_at_5\": 0.91901,\n        \"precision_at_1\": 0.87,\n        \"precision_at_10\": 0.09722,\n        \"precision_at_100\": 0.00996,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04922,\n        \"precision_at_3\": 0.31333,\n        \"precision_at_5\": 0.19133,\n        \"recall_at_1\": 0.87,\n        \"recall_at_10\": 0.97222,\n        \"recall_at_100\": 0.99556,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98444,\n        \"recall_at_3\": 0.94,\n        \"recall_at_5\": 0.95667\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.9245,\n        \"map_at_1\": 0.86556,\n        \"map_at_10\": 0.90772,\n        \"map_at_100\": 0.90891,\n        \"map_at_1000\": 0.90892,\n        \"map_at_20\": 0.90867,\n        \"map_at_3\": 0.90167,\n        \"map_at_5\": 0.90572,\n        \"mrr_at_1\": 0.8655555555555555,\n        \"mrr_at_10\": 0.9077182539682542,\n        \"mrr_at_100\": 0.9089099946621724,\n        \"mrr_at_1000\": 0.9089200667955346,\n        \"mrr_at_20\": 0.9086737418355068,\n        \"mrr_at_3\": 0.9016666666666668,\n        \"mrr_at_5\": 0.9057222222222224,\n        \"nauc_map_at_1000_diff1\": 0.8907741421197661,\n        \"nauc_map_at_1000_max\": 0.6626465117689059,\n        \"nauc_map_at_1000_std\": -0.317136109087687,\n        \"nauc_map_at_100_diff1\": 0.8907816742896304,\n        \"nauc_map_at_100_max\": 0.6626847593795272,\n        \"nauc_map_at_100_std\": -0.31699708730779125,\n        \"nauc_map_at_10_diff1\": 0.890265368178002,\n        \"nauc_map_at_10_max\": 0.664564904987638,\n        \"nauc_map_at_10_std\": -0.3134820091469261,\n        \"nauc_map_at_1_diff1\": 0.8942004455054253,\n        \"nauc_map_at_1_max\": 0.6266975912367964,\n        \"nauc_map_at_1_std\": -0.3639052782013713,\n        \"nauc_map_at_20_diff1\": 0.8906411175863109,\n        \"nauc_map_at_20_max\": 0.6628476087242807,\n        \"nauc_map_at_20_std\": -0.31769612937316705,\n        \"nauc_map_at_3_diff1\": 0.8925822549268371,\n        \"nauc_map_at_3_max\": 0.6738326485879481,\n        \"nauc_map_at_3_std\": -0.3032972154887417,\n        \"nauc_map_at_5_diff1\": 0.8914108120590107,\n        \"nauc_map_at_5_max\": 0.6684705992434418,\n        \"nauc_map_at_5_std\": -0.3110940068516004,\n        \"nauc_mrr_at_1000_diff1\": 0.8907741421197661,\n        \"nauc_mrr_at_1000_max\": 0.6626465117689059,\n        \"nauc_mrr_at_1000_std\": -0.317136109087687,\n        \"nauc_mrr_at_100_diff1\": 0.8907816742896304,\n        \"nauc_mrr_at_100_max\": 0.6626847593795272,\n        \"nauc_mrr_at_100_std\": -0.31699708730779125,\n        \"nauc_mrr_at_10_diff1\": 0.890265368178002,\n        \"nauc_mrr_at_10_max\": 0.664564904987638,\n        \"nauc_mrr_at_10_std\": -0.3134820091469261,\n        \"nauc_mrr_at_1_diff1\": 0.8942004455054253,\n        \"nauc_mrr_at_1_max\": 0.6266975912367964,\n        \"nauc_mrr_at_1_std\": -0.3639052782013713,\n        \"nauc_mrr_at_20_diff1\": 0.8906411175863109,\n        \"nauc_mrr_at_20_max\": 0.6628476087242807,\n        \"nauc_mrr_at_20_std\": -0.31769612937316705,\n        \"nauc_mrr_at_3_diff1\": 0.8925822549268371,\n        \"nauc_mrr_at_3_max\": 0.6738326485879481,\n        \"nauc_mrr_at_3_std\": -0.3032972154887417,\n        \"nauc_mrr_at_5_diff1\": 0.8914108120590107,\n        \"nauc_mrr_at_5_max\": 0.6684705992434418,\n        \"nauc_mrr_at_5_std\": -0.3110940068516004,\n        \"nauc_ndcg_at_1000_diff1\": 0.8903604370829069,\n        \"nauc_ndcg_at_1000_max\": 0.6680529698253163,\n        \"nauc_ndcg_at_1000_std\": -0.3088091221018859,\n        \"nauc_ndcg_at_100_diff1\": 0.8905603260103219,\n        \"nauc_ndcg_at_100_max\": 0.6694191305565131,\n        \"nauc_ndcg_at_100_std\": -0.30395669406253056,\n        \"nauc_ndcg_at_10_diff1\": 0.8880903746847338,\n        \"nauc_ndcg_at_10_max\": 0.6771885807878589,\n        \"nauc_ndcg_at_10_std\": -0.2933321488974208,\n        \"nauc_ndcg_at_1_diff1\": 0.8942004455054253,\n        \"nauc_ndcg_at_1_max\": 0.6266975912367964,\n        \"nauc_ndcg_at_1_std\": -0.3639052782013713,\n        \"nauc_ndcg_at_20_diff1\": 0.8894301275693007,\n        \"nauc_ndcg_at_20_max\": 0.6705724282044567,\n        \"nauc_ndcg_at_20_std\": -0.3098295084689656,\n        \"nauc_ndcg_at_3_diff1\": 0.8933950544996908,\n        \"nauc_ndcg_at_3_max\": 0.6970050368317691,\n        \"nauc_ndcg_at_3_std\": -0.2711580447806635,\n        \"nauc_ndcg_at_5_diff1\": 0.8912467426056183,\n        \"nauc_ndcg_at_5_max\": 0.6876593267266466,\n        \"nauc_ndcg_at_5_std\": -0.28664735777263556,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9346405228757582,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.8611111111111238,\n        \"nauc_precision_at_10_diff1\": 0.8628299804770346,\n        \"nauc_precision_at_10_max\": 0.7927383074441847,\n        \"nauc_precision_at_10_std\": -0.10024615906969267,\n        \"nauc_precision_at_1_diff1\": 0.8942004455054253,\n        \"nauc_precision_at_1_max\": 0.6266975912367964,\n        \"nauc_precision_at_1_std\": -0.3639052782013713,\n        \"nauc_precision_at_20_diff1\": 0.8648247177658893,\n        \"nauc_precision_at_20_max\": 0.7647483235718557,\n        \"nauc_precision_at_20_std\": -0.26215940921825764,\n        \"nauc_precision_at_3_diff1\": 0.8981252631771672,\n        \"nauc_precision_at_3_max\": 0.8105582102121879,\n        \"nauc_precision_at_3_std\": -0.11257574925395346,\n        \"nauc_precision_at_5_diff1\": 0.8909030278778126,\n        \"nauc_precision_at_5_max\": 0.8157663065226051,\n        \"nauc_precision_at_5_std\": -0.12546351874082617,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.934640522875857,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.8611111111111373,\n        \"nauc_recall_at_10_diff1\": 0.8628299804770414,\n        \"nauc_recall_at_10_max\": 0.7927383074441877,\n        \"nauc_recall_at_10_std\": -0.10024615906969253,\n        \"nauc_recall_at_1_diff1\": 0.8942004455054253,\n        \"nauc_recall_at_1_max\": 0.6266975912367964,\n        \"nauc_recall_at_1_std\": -0.3639052782013713,\n        \"nauc_recall_at_20_diff1\": 0.8648247177658958,\n        \"nauc_recall_at_20_max\": 0.764748323571863,\n        \"nauc_recall_at_20_std\": -0.26215940921823416,\n        \"nauc_recall_at_3_diff1\": 0.8981252631771675,\n        \"nauc_recall_at_3_max\": 0.8105582102121894,\n        \"nauc_recall_at_3_std\": -0.11257574925395204,\n        \"nauc_recall_at_5_diff1\": 0.8909030278778138,\n        \"nauc_recall_at_5_max\": 0.8157663065226111,\n        \"nauc_recall_at_5_std\": -0.1254635187408309,\n        \"ndcg_at_1\": 0.86556,\n        \"ndcg_at_10\": 0.9245,\n        \"ndcg_at_100\": 0.92955,\n        \"ndcg_at_1000\": 0.92983,\n        \"ndcg_at_20\": 0.92773,\n        \"ndcg_at_3\": 0.91245,\n        \"ndcg_at_5\": 0.91976,\n        \"precision_at_1\": 0.86556,\n        \"precision_at_10\": 0.09756,\n        \"precision_at_100\": 0.00998,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04939,\n        \"precision_at_3\": 0.31444,\n        \"precision_at_5\": 0.19222,\n        \"recall_at_1\": 0.86556,\n        \"recall_at_10\": 0.97556,\n        \"recall_at_100\": 0.99778,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98778,\n        \"recall_at_3\": 0.94333,\n        \"recall_at_5\": 0.96111\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.84232,\n        \"map_at_1\": 0.74333,\n        \"map_at_10\": 0.81242,\n        \"map_at_100\": 0.81501,\n        \"map_at_1000\": 0.81505,\n        \"map_at_20\": 0.81411,\n        \"map_at_3\": 0.80111,\n        \"map_at_5\": 0.8075,\n        \"mrr_at_1\": 0.7433333333333333,\n        \"mrr_at_10\": 0.8124166666666669,\n        \"mrr_at_100\": 0.8150097968662406,\n        \"mrr_at_1000\": 0.8150519412628603,\n        \"mrr_at_20\": 0.8141131871033833,\n        \"mrr_at_3\": 0.8011111111111111,\n        \"mrr_at_5\": 0.8074999999999999,\n        \"nauc_map_at_1000_diff1\": 0.7479635701130208,\n        \"nauc_map_at_1000_max\": 0.7868132208331684,\n        \"nauc_map_at_1000_std\": 0.2267387051745361,\n        \"nauc_map_at_100_diff1\": 0.7479575405061689,\n        \"nauc_map_at_100_max\": 0.7868157515318333,\n        \"nauc_map_at_100_std\": 0.2269098553049622,\n        \"nauc_map_at_10_diff1\": 0.7476594262177979,\n        \"nauc_map_at_10_max\": 0.7872075996532419,\n        \"nauc_map_at_10_std\": 0.2254532093832398,\n        \"nauc_map_at_1_diff1\": 0.7735585317934608,\n        \"nauc_map_at_1_max\": 0.7814582351561841,\n        \"nauc_map_at_1_std\": 0.20220053408369135,\n        \"nauc_map_at_20_diff1\": 0.747521918347692,\n        \"nauc_map_at_20_max\": 0.7868505598851331,\n        \"nauc_map_at_20_std\": 0.22798988268232043,\n        \"nauc_map_at_3_diff1\": 0.743714669014021,\n        \"nauc_map_at_3_max\": 0.7877175737221868,\n        \"nauc_map_at_3_std\": 0.21726579839289906,\n        \"nauc_map_at_5_diff1\": 0.7453309061226726,\n        \"nauc_map_at_5_max\": 0.787680630486119,\n        \"nauc_map_at_5_std\": 0.22214427481440316,\n        \"nauc_mrr_at_1000_diff1\": 0.7479635701130208,\n        \"nauc_mrr_at_1000_max\": 0.7868132208331684,\n        \"nauc_mrr_at_1000_std\": 0.2267387051745361,\n        \"nauc_mrr_at_100_diff1\": 0.7479575405061689,\n        \"nauc_mrr_at_100_max\": 0.7868157515318333,\n        \"nauc_mrr_at_100_std\": 0.2269098553049622,\n        \"nauc_mrr_at_10_diff1\": 0.7476594262177979,\n        \"nauc_mrr_at_10_max\": 0.7872075996532419,\n        \"nauc_mrr_at_10_std\": 0.2254532093832398,\n        \"nauc_mrr_at_1_diff1\": 0.7735585317934608,\n        \"nauc_mrr_at_1_max\": 0.7814582351561841,\n        \"nauc_mrr_at_1_std\": 0.20220053408369135,\n        \"nauc_mrr_at_20_diff1\": 0.747521918347692,\n        \"nauc_mrr_at_20_max\": 0.7868505598851331,\n        \"nauc_mrr_at_20_std\": 0.22798988268232043,\n        \"nauc_mrr_at_3_diff1\": 0.743714669014021,\n        \"nauc_mrr_at_3_max\": 0.7877175737221868,\n        \"nauc_mrr_at_3_std\": 0.21726579839289906,\n        \"nauc_mrr_at_5_diff1\": 0.7453309061226726,\n        \"nauc_mrr_at_5_max\": 0.787680630486119,\n        \"nauc_mrr_at_5_std\": 0.22214427481440316,\n        \"nauc_ndcg_at_1000_diff1\": 0.7442360510715994,\n        \"nauc_ndcg_at_1000_max\": 0.7868278968005287,\n        \"nauc_ndcg_at_1000_std\": 0.23488350314372797,\n        \"nauc_ndcg_at_100_diff1\": 0.7436547317586959,\n        \"nauc_ndcg_at_100_max\": 0.7866619637977311,\n        \"nauc_ndcg_at_100_std\": 0.24083458929790327,\n        \"nauc_ndcg_at_10_diff1\": 0.7406837295936815,\n        \"nauc_ndcg_at_10_max\": 0.7880027249441579,\n        \"nauc_ndcg_at_10_std\": 0.23848502503860292,\n        \"nauc_ndcg_at_1_diff1\": 0.7735585317934608,\n        \"nauc_ndcg_at_1_max\": 0.7814582351561841,\n        \"nauc_ndcg_at_1_std\": 0.20220053408369135,\n        \"nauc_ndcg_at_20_diff1\": 0.739852926566927,\n        \"nauc_ndcg_at_20_max\": 0.7864134670603612,\n        \"nauc_ndcg_at_20_std\": 0.24891095256291795,\n        \"nauc_ndcg_at_3_diff1\": 0.7327962541689025,\n        \"nauc_ndcg_at_3_max\": 0.7895606209040222,\n        \"nauc_ndcg_at_3_std\": 0.2206452903850603,\n        \"nauc_ndcg_at_5_diff1\": 0.7351737326652631,\n        \"nauc_ndcg_at_5_max\": 0.7889553644488616,\n        \"nauc_ndcg_at_5_std\": 0.23093678509825147,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.6659663865546206,\n        \"nauc_precision_at_100_max\": 0.7610877684407207,\n        \"nauc_precision_at_100_std\": 0.9305555555555604,\n        \"nauc_precision_at_10_diff1\": 0.6949706436246802,\n        \"nauc_precision_at_10_max\": 0.7916726012438878,\n        \"nauc_precision_at_10_std\": 0.3400750130560682,\n        \"nauc_precision_at_1_diff1\": 0.7735585317934608,\n        \"nauc_precision_at_1_max\": 0.7814582351561841,\n        \"nauc_precision_at_1_std\": 0.20220053408369135,\n        \"nauc_precision_at_20_diff1\": 0.6595041525382113,\n        \"nauc_precision_at_20_max\": 0.7726792471374534,\n        \"nauc_precision_at_20_std\": 0.5227775320654573,\n        \"nauc_precision_at_3_diff1\": 0.6878544893694668,\n        \"nauc_precision_at_3_max\": 0.7969252711532735,\n        \"nauc_precision_at_3_std\": 0.2334986235032675,\n        \"nauc_precision_at_5_diff1\": 0.6849258221807228,\n        \"nauc_precision_at_5_max\": 0.7941280215790011,\n        \"nauc_precision_at_5_std\": 0.27671438945948545,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.6659663865546264,\n        \"nauc_recall_at_100_max\": 0.7610877684407182,\n        \"nauc_recall_at_100_std\": 0.9305555555555559,\n        \"nauc_recall_at_10_diff1\": 0.6949706436246803,\n        \"nauc_recall_at_10_max\": 0.7916726012438876,\n        \"nauc_recall_at_10_std\": 0.34007501305606896,\n        \"nauc_recall_at_1_diff1\": 0.7735585317934608,\n        \"nauc_recall_at_1_max\": 0.7814582351561841,\n        \"nauc_recall_at_1_std\": 0.20220053408369135,\n        \"nauc_recall_at_20_diff1\": 0.6595041525382099,\n        \"nauc_recall_at_20_max\": 0.7726792471374523,\n        \"nauc_recall_at_20_std\": 0.5227775320654581,\n        \"nauc_recall_at_3_diff1\": 0.6878544893694643,\n        \"nauc_recall_at_3_max\": 0.7969252711532728,\n        \"nauc_recall_at_3_std\": 0.23349862350326753,\n        \"nauc_recall_at_5_diff1\": 0.6849258221807234,\n        \"nauc_recall_at_5_max\": 0.7941280215790028,\n        \"nauc_recall_at_5_std\": 0.27671438945948845,\n        \"ndcg_at_1\": 0.74333,\n        \"ndcg_at_10\": 0.84232,\n        \"ndcg_at_100\": 0.85458,\n        \"ndcg_at_1000\": 0.85573,\n        \"ndcg_at_20\": 0.84832,\n        \"ndcg_at_3\": 0.81915,\n        \"ndcg_at_5\": 0.83086,\n        \"precision_at_1\": 0.74333,\n        \"precision_at_10\": 0.09344,\n        \"precision_at_100\": 0.00991,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04789,\n        \"precision_at_3\": 0.29037,\n        \"precision_at_5\": 0.18,\n        \"recall_at_1\": 0.74333,\n        \"recall_at_10\": 0.93444,\n        \"recall_at_100\": 0.99111,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.95778,\n        \"recall_at_3\": 0.87111,\n        \"recall_at_5\": 0.9\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/e5-mistral-7b-instruct/intfloat__e5-mistral-7b-instruct/07163b72af1488142a360786df853f237b1a3ca1/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 1837.136996269226,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.79317,\n        \"map_at_1\": 0.49126,\n        \"map_at_10\": 0.7495,\n        \"map_at_100\": 0.75455,\n        \"map_at_1000\": 0.75486,\n        \"map_at_20\": 0.7525,\n        \"map_at_3\": 0.70867,\n        \"map_at_5\": 0.73638,\n        \"mrr_at_1\": 0.7584459459459459,\n        \"mrr_at_10\": 0.8100875429000428,\n        \"mrr_at_100\": 0.8117765496291576,\n        \"mrr_at_1000\": 0.8119327347214493,\n        \"mrr_at_20\": 0.8106196684321683,\n        \"mrr_at_3\": 0.8037725225225222,\n        \"mrr_at_5\": 0.8077421171171169,\n        \"nauc_map_at_1000_diff1\": 0.5812617698951515,\n        \"nauc_map_at_1000_max\": 0.6610692477766553,\n        \"nauc_map_at_1000_std\": 0.27404270545327336,\n        \"nauc_map_at_100_diff1\": 0.5811909048005637,\n        \"nauc_map_at_100_max\": 0.6613587030835343,\n        \"nauc_map_at_100_std\": 0.27427743469134663,\n        \"nauc_map_at_10_diff1\": 0.5789105274892585,\n        \"nauc_map_at_10_max\": 0.6596737849213944,\n        \"nauc_map_at_10_std\": 0.2680503647538944,\n        \"nauc_map_at_1_diff1\": 0.579615004172223,\n        \"nauc_map_at_1_max\": 0.2908252007229241,\n        \"nauc_map_at_1_std\": 0.034824910006952516,\n        \"nauc_map_at_20_diff1\": 0.5815683585596179,\n        \"nauc_map_at_20_max\": 0.6629871010695796,\n        \"nauc_map_at_20_std\": 0.2750654700270136,\n        \"nauc_map_at_3_diff1\": 0.5702846943143143,\n        \"nauc_map_at_3_max\": 0.6094753352459681,\n        \"nauc_map_at_3_std\": 0.2032967213655951,\n        \"nauc_map_at_5_diff1\": 0.5800945455348301,\n        \"nauc_map_at_5_max\": 0.6508414550197733,\n        \"nauc_map_at_5_std\": 0.23763912270562051,\n        \"nauc_mrr_at_1000_diff1\": 0.6731537330578673,\n        \"nauc_mrr_at_1000_max\": 0.7153241852891469,\n        \"nauc_mrr_at_1000_std\": 0.3516402936461557,\n        \"nauc_mrr_at_100_diff1\": 0.6731642004771984,\n        \"nauc_mrr_at_100_max\": 0.7155000144086914,\n        \"nauc_mrr_at_100_std\": 0.35196033305591073,\n        \"nauc_mrr_at_10_diff1\": 0.6734370672138152,\n        \"nauc_mrr_at_10_max\": 0.7169363494428644,\n        \"nauc_mrr_at_10_std\": 0.35223055736252545,\n        \"nauc_mrr_at_1_diff1\": 0.66972023486555,\n        \"nauc_mrr_at_1_max\": 0.6301506150713375,\n        \"nauc_mrr_at_1_std\": 0.2455626983258168,\n        \"nauc_mrr_at_20_diff1\": 0.6736684272381803,\n        \"nauc_mrr_at_20_max\": 0.716476673430364,\n        \"nauc_mrr_at_20_std\": 0.35288033831367044,\n        \"nauc_mrr_at_3_diff1\": 0.6743708966504051,\n        \"nauc_mrr_at_3_max\": 0.7240735657936037,\n        \"nauc_mrr_at_3_std\": 0.35119546746688735,\n        \"nauc_mrr_at_5_diff1\": 0.6745833502417148,\n        \"nauc_mrr_at_5_max\": 0.720000059937184,\n        \"nauc_mrr_at_5_std\": 0.3557423062678047,\n        \"nauc_ndcg_at_1000_diff1\": 0.6070344828856682,\n        \"nauc_ndcg_at_1000_max\": 0.706969512634442,\n        \"nauc_ndcg_at_1000_std\": 0.34814483086269804,\n        \"nauc_ndcg_at_100_diff1\": 0.6041752800901181,\n        \"nauc_ndcg_at_100_max\": 0.713810430485531,\n        \"nauc_ndcg_at_100_std\": 0.3561084263782227,\n        \"nauc_ndcg_at_10_diff1\": 0.6002180308546468,\n        \"nauc_ndcg_at_10_max\": 0.7147996091069331,\n        \"nauc_ndcg_at_10_std\": 0.34075062854849214,\n        \"nauc_ndcg_at_1_diff1\": 0.66972023486555,\n        \"nauc_ndcg_at_1_max\": 0.6301506150713375,\n        \"nauc_ndcg_at_1_std\": 0.2455626983258168,\n        \"nauc_ndcg_at_20_diff1\": 0.6065870330170832,\n        \"nauc_ndcg_at_20_max\": 0.7221616714472898,\n        \"nauc_ndcg_at_20_std\": 0.35960801191696007,\n        \"nauc_ndcg_at_3_diff1\": 0.5893874932024313,\n        \"nauc_ndcg_at_3_max\": 0.6636957047260216,\n        \"nauc_ndcg_at_3_std\": 0.2543432449264493,\n        \"nauc_ndcg_at_5_diff1\": 0.6028280570221642,\n        \"nauc_ndcg_at_5_max\": 0.7012799112010517,\n        \"nauc_ndcg_at_5_std\": 0.2939975776821263,\n        \"nauc_precision_at_1000_diff1\": -0.2810181647289382,\n        \"nauc_precision_at_1000_max\": 0.04148207954816594,\n        \"nauc_precision_at_1000_std\": 0.19379188361125566,\n        \"nauc_precision_at_100_diff1\": -0.196651209135289,\n        \"nauc_precision_at_100_max\": 0.17030537047692557,\n        \"nauc_precision_at_100_std\": 0.271797207506889,\n        \"nauc_precision_at_10_diff1\": -0.08287152921145098,\n        \"nauc_precision_at_10_max\": 0.3031368102620088,\n        \"nauc_precision_at_10_std\": 0.30266327719783204,\n        \"nauc_precision_at_1_diff1\": 0.66972023486555,\n        \"nauc_precision_at_1_max\": 0.6301506150713375,\n        \"nauc_precision_at_1_std\": 0.2455626983258168,\n        \"nauc_precision_at_20_diff1\": -0.10296139278278182,\n        \"nauc_precision_at_20_max\": 0.27403214258088565,\n        \"nauc_precision_at_20_std\": 0.3105317173548736,\n        \"nauc_precision_at_3_diff1\": 0.05444938356841716,\n        \"nauc_precision_at_3_max\": 0.43831031607539994,\n        \"nauc_precision_at_3_std\": 0.2764742828725262,\n        \"nauc_precision_at_5_diff1\": -0.01105899214358065,\n        \"nauc_precision_at_5_max\": 0.38274325037052775,\n        \"nauc_precision_at_5_std\": 0.28187720011150214,\n        \"nauc_recall_at_1000_diff1\": 0.632396735941214,\n        \"nauc_recall_at_1000_max\": 0.9304343829172986,\n        \"nauc_recall_at_1000_std\": 0.8702336162445697,\n        \"nauc_recall_at_100_diff1\": 0.5680963222825306,\n        \"nauc_recall_at_100_max\": 0.8878032034318802,\n        \"nauc_recall_at_100_std\": 0.6909240094984084,\n        \"nauc_recall_at_10_diff1\": 0.5688992428586632,\n        \"nauc_recall_at_10_max\": 0.8248338917311779,\n        \"nauc_recall_at_10_std\": 0.4849807476605251,\n        \"nauc_recall_at_1_diff1\": 0.579615004172223,\n        \"nauc_recall_at_1_max\": 0.2908252007229241,\n        \"nauc_recall_at_1_std\": 0.034824910006952516,\n        \"nauc_recall_at_20_diff1\": 0.5974109466534318,\n        \"nauc_recall_at_20_max\": 0.87467624395276,\n        \"nauc_recall_at_20_std\": 0.5901505366736927,\n        \"nauc_recall_at_3_diff1\": 0.5567183508386466,\n        \"nauc_recall_at_3_max\": 0.6738919858737272,\n        \"nauc_recall_at_3_std\": 0.25640288050963517,\n        \"nauc_recall_at_5_diff1\": 0.5761474687351439,\n        \"nauc_recall_at_5_max\": 0.7635092315346151,\n        \"nauc_recall_at_5_std\": 0.3351164969852482,\n        \"ndcg_at_1\": 0.75845,\n        \"ndcg_at_10\": 0.79317,\n        \"ndcg_at_100\": 0.81138,\n        \"ndcg_at_1000\": 0.81813,\n        \"ndcg_at_20\": 0.79982,\n        \"ndcg_at_3\": 0.74868,\n        \"ndcg_at_5\": 0.77519,\n        \"precision_at_1\": 0.75845,\n        \"precision_at_10\": 0.15828,\n        \"precision_at_100\": 0.0174,\n        \"precision_at_1000\": 0.00185,\n        \"precision_at_20\": 0.08167,\n        \"precision_at_3\": 0.44764,\n        \"precision_at_5\": 0.29493,\n        \"recall_at_1\": 0.49126,\n        \"recall_at_10\": 0.85157,\n        \"recall_at_100\": 0.92359,\n        \"recall_at_1000\": 0.96523,\n        \"recall_at_20\": 0.87176,\n        \"recall_at_3\": 0.7543,\n        \"recall_at_5\": 0.81055\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/intfloat/e5-mistral-7b-instruct/intfloat__e5-mistral-7b-instruct/07163b72af1488142a360786df853f237b1a3ca1/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 133762.75083470345,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.58709,\n        \"map_at_1\": 0.3504,\n        \"map_at_10\": 0.49741,\n        \"map_at_100\": 0.5241,\n        \"map_at_1000\": 0.52528,\n        \"map_at_20\": 0.51372,\n        \"map_at_3\": 0.4474,\n        \"map_at_5\": 0.47131,\n        \"mrr_at_1\": 0.5774647887323944,\n        \"mrr_at_10\": 0.6715887920113273,\n        \"mrr_at_100\": 0.6762726144876823,\n        \"mrr_at_1000\": 0.6764729104287056,\n        \"mrr_at_20\": 0.6755270044236817,\n        \"mrr_at_3\": 0.6494522691705791,\n        \"mrr_at_5\": 0.6621283255086072,\n        \"nauc_map_at_1000_diff1\": 0.34120094391499245,\n        \"nauc_map_at_1000_max\": 0.366838210001104,\n        \"nauc_map_at_1000_std\": 0.04078157589429166,\n        \"nauc_map_at_100_diff1\": 0.34052366255683186,\n        \"nauc_map_at_100_max\": 0.36606971433584523,\n        \"nauc_map_at_100_std\": 0.039985295949039344,\n        \"nauc_map_at_10_diff1\": 0.33104969057528355,\n        \"nauc_map_at_10_max\": 0.35793214492098313,\n        \"nauc_map_at_10_std\": 0.007120775723603169,\n        \"nauc_map_at_1_diff1\": 0.36372917871224114,\n        \"nauc_map_at_1_max\": 0.31168079591945574,\n        \"nauc_map_at_1_std\": -0.11011005080540842,\n        \"nauc_map_at_20_diff1\": 0.33556661225722967,\n        \"nauc_map_at_20_max\": 0.3674680413455777,\n        \"nauc_map_at_20_std\": 0.026355815955895336,\n        \"nauc_map_at_3_diff1\": 0.34184935253502124,\n        \"nauc_map_at_3_max\": 0.3434521708155092,\n        \"nauc_map_at_3_std\": -0.010455588172976739,\n        \"nauc_map_at_5_diff1\": 0.3254317733853242,\n        \"nauc_map_at_5_max\": 0.34801016273643837,\n        \"nauc_map_at_5_std\": -0.004311953264131259,\n        \"nauc_mrr_at_1000_diff1\": 0.40435244338557286,\n        \"nauc_mrr_at_1000_max\": 0.4287767488366848,\n        \"nauc_mrr_at_1000_std\": 0.1619679098837795,\n        \"nauc_mrr_at_100_diff1\": 0.404405312972269,\n        \"nauc_mrr_at_100_max\": 0.42907346032870647,\n        \"nauc_mrr_at_100_std\": 0.16233412877435102,\n        \"nauc_mrr_at_10_diff1\": 0.4065372557651823,\n        \"nauc_mrr_at_10_max\": 0.42877016983432525,\n        \"nauc_mrr_at_10_std\": 0.16253075319632765,\n        \"nauc_mrr_at_1_diff1\": 0.3828166786427259,\n        \"nauc_mrr_at_1_max\": 0.3845585131308482,\n        \"nauc_mrr_at_1_std\": 0.0617774532017859,\n        \"nauc_mrr_at_20_diff1\": 0.4048662753915902,\n        \"nauc_mrr_at_20_max\": 0.42937621763492295,\n        \"nauc_mrr_at_20_std\": 0.1618932534605349,\n        \"nauc_mrr_at_3_diff1\": 0.413269450193848,\n        \"nauc_mrr_at_3_max\": 0.4276309165768991,\n        \"nauc_mrr_at_3_std\": 0.16769288191570964,\n        \"nauc_mrr_at_5_diff1\": 0.403247052594961,\n        \"nauc_mrr_at_5_max\": 0.41734670566846804,\n        \"nauc_mrr_at_5_std\": 0.1576369649565576,\n        \"nauc_ndcg_at_1000_diff1\": 0.3572118952727939,\n        \"nauc_ndcg_at_1000_max\": 0.4075069870231915,\n        \"nauc_ndcg_at_1000_std\": 0.14022543880428157,\n        \"nauc_ndcg_at_100_diff1\": 0.348312083182717,\n        \"nauc_ndcg_at_100_max\": 0.4025977066232255,\n        \"nauc_ndcg_at_100_std\": 0.13916190476906262,\n        \"nauc_ndcg_at_10_diff1\": 0.33986492065971163,\n        \"nauc_ndcg_at_10_max\": 0.3850661195073111,\n        \"nauc_ndcg_at_10_std\": 0.0635710202558746,\n        \"nauc_ndcg_at_1_diff1\": 0.3828166786427259,\n        \"nauc_ndcg_at_1_max\": 0.3845585131308482,\n        \"nauc_ndcg_at_1_std\": 0.0617774532017859,\n        \"nauc_ndcg_at_20_diff1\": 0.3414557704155679,\n        \"nauc_ndcg_at_20_max\": 0.40553747002915236,\n        \"nauc_ndcg_at_20_std\": 0.09985925201518564,\n        \"nauc_ndcg_at_3_diff1\": 0.3870890812358928,\n        \"nauc_ndcg_at_3_max\": 0.3846874567549218,\n        \"nauc_ndcg_at_3_std\": 0.12185414238392578,\n        \"nauc_ndcg_at_5_diff1\": 0.3490173675040339,\n        \"nauc_ndcg_at_5_max\": 0.3654450194590964,\n        \"nauc_ndcg_at_5_std\": 0.07813419411057466,\n        \"nauc_precision_at_1000_diff1\": -0.0032435172501387873,\n        \"nauc_precision_at_1000_max\": 0.0007242613045474486,\n        \"nauc_precision_at_1000_std\": 0.35043717667409324,\n        \"nauc_precision_at_100_diff1\": 0.0016471763775988892,\n        \"nauc_precision_at_100_max\": 0.01804901150100379,\n        \"nauc_precision_at_100_std\": 0.36596154349162197,\n        \"nauc_precision_at_10_diff1\": 0.05358186698251174,\n        \"nauc_precision_at_10_max\": 0.15257889925441642,\n        \"nauc_precision_at_10_std\": 0.3143054303042554,\n        \"nauc_precision_at_1_diff1\": 0.3828166786427259,\n        \"nauc_precision_at_1_max\": 0.3845585131308482,\n        \"nauc_precision_at_1_std\": 0.0617774532017859,\n        \"nauc_precision_at_20_diff1\": 0.02615997482157888,\n        \"nauc_precision_at_20_max\": 0.11229379876131261,\n        \"nauc_precision_at_20_std\": 0.3518356666804108,\n        \"nauc_precision_at_3_diff1\": 0.18578823830575417,\n        \"nauc_precision_at_3_max\": 0.2644100183947296,\n        \"nauc_precision_at_3_std\": 0.3200450616684121,\n        \"nauc_precision_at_5_diff1\": 0.06648526125065941,\n        \"nauc_precision_at_5_max\": 0.19948594661617416,\n        \"nauc_precision_at_5_std\": 0.30423437963537375,\n        \"nauc_recall_at_1000_diff1\": 0.1751491317505002,\n        \"nauc_recall_at_1000_max\": 0.6245630358343841,\n        \"nauc_recall_at_1000_std\": 0.6668652808132978,\n        \"nauc_recall_at_100_diff1\": 0.16490824289546413,\n        \"nauc_recall_at_100_max\": 0.41167715005311006,\n        \"nauc_recall_at_100_std\": 0.3490494435460939,\n        \"nauc_recall_at_10_diff1\": 0.24803168616915408,\n        \"nauc_recall_at_10_max\": 0.3346639265012337,\n        \"nauc_recall_at_10_std\": 0.04329675173685037,\n        \"nauc_recall_at_1_diff1\": 0.36372917871224114,\n        \"nauc_recall_at_1_max\": 0.31168079591945574,\n        \"nauc_recall_at_1_std\": -0.11011005080540842,\n        \"nauc_recall_at_20_diff1\": 0.2127800805100239,\n        \"nauc_recall_at_20_max\": 0.3910800445068547,\n        \"nauc_recall_at_20_std\": 0.13021536861777655,\n        \"nauc_recall_at_3_diff1\": 0.3307505105858759,\n        \"nauc_recall_at_3_max\": 0.3423307880427305,\n        \"nauc_recall_at_3_std\": 0.0678675786450557,\n        \"nauc_recall_at_5_diff1\": 0.2785049573246195,\n        \"nauc_recall_at_5_max\": 0.3273306187782061,\n        \"nauc_recall_at_5_std\": 0.0512487582690908,\n        \"ndcg_at_1\": 0.57746,\n        \"ndcg_at_10\": 0.58709,\n        \"ndcg_at_100\": 0.65388,\n        \"ndcg_at_1000\": 0.66799,\n        \"ndcg_at_20\": 0.62054,\n        \"ndcg_at_3\": 0.55051,\n        \"ndcg_at_5\": 0.5543,\n        \"precision_at_1\": 0.57746,\n        \"precision_at_10\": 0.14695,\n        \"precision_at_100\": 0.02258,\n        \"precision_at_1000\": 0.00251,\n        \"precision_at_20\": 0.0892,\n        \"precision_at_3\": 0.32394,\n        \"precision_at_5\": 0.23474,\n        \"recall_at_1\": 0.3504,\n        \"recall_at_10\": 0.6752,\n        \"recall_at_100\": 0.88583,\n        \"recall_at_1000\": 0.96565,\n        \"recall_at_20\": 0.76951,\n        \"recall_at_3\": 0.50691,\n        \"recall_at_5\": 0.56791\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/e5-mistral-7b-instruct/intfloat__e5-mistral-7b-instruct/07163b72af1488142a360786df853f237b1a3ca1/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 132131.55453968048,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.52444,\n        \"map_at_1\": 0.33729,\n        \"map_at_10\": 0.45818,\n        \"map_at_100\": 0.46723,\n        \"map_at_1000\": 0.46768,\n        \"map_at_20\": 0.46381,\n        \"map_at_3\": 0.42214,\n        \"map_at_5\": 0.44596,\n        \"mrr_at_1\": 0.3657957244655582,\n        \"mrr_at_10\": 0.4820891301888926,\n        \"mrr_at_100\": 0.48851420018324104,\n        \"mrr_at_1000\": 0.48892493071547677,\n        \"mrr_at_20\": 0.48601855229071494,\n        \"mrr_at_3\": 0.4481393507521775,\n        \"mrr_at_5\": 0.4705859065716547,\n        \"nauc_map_at_1000_diff1\": 0.3747847738730098,\n        \"nauc_map_at_1000_max\": 0.29507132501507005,\n        \"nauc_map_at_1000_std\": 0.14692325040190168,\n        \"nauc_map_at_100_diff1\": 0.3742629999508797,\n        \"nauc_map_at_100_max\": 0.2947400320768413,\n        \"nauc_map_at_100_std\": 0.14693435991367468,\n        \"nauc_map_at_10_diff1\": 0.37386694267676973,\n        \"nauc_map_at_10_max\": 0.293258808567027,\n        \"nauc_map_at_10_std\": 0.14830624087068858,\n        \"nauc_map_at_1_diff1\": 0.4420587257474029,\n        \"nauc_map_at_1_max\": 0.2554211294897347,\n        \"nauc_map_at_1_std\": 0.056532912085557045,\n        \"nauc_map_at_20_diff1\": 0.3739942760636949,\n        \"nauc_map_at_20_max\": 0.2951675912011361,\n        \"nauc_map_at_20_std\": 0.14714098733319284,\n        \"nauc_map_at_3_diff1\": 0.38800093134948943,\n        \"nauc_map_at_3_max\": 0.3045256019708319,\n        \"nauc_map_at_3_std\": 0.1320177261065248,\n        \"nauc_map_at_5_diff1\": 0.3751952574138427,\n        \"nauc_map_at_5_max\": 0.29712628643646033,\n        \"nauc_map_at_5_std\": 0.15608824289829076,\n        \"nauc_mrr_at_1000_diff1\": 0.3822359923443872,\n        \"nauc_mrr_at_1000_max\": 0.30608038572405405,\n        \"nauc_mrr_at_1000_std\": 0.14555736544858575,\n        \"nauc_mrr_at_100_diff1\": 0.38178414099765895,\n        \"nauc_mrr_at_100_max\": 0.30585503793768143,\n        \"nauc_mrr_at_100_std\": 0.14552587623032825,\n        \"nauc_mrr_at_10_diff1\": 0.3809713587160259,\n        \"nauc_mrr_at_10_max\": 0.30546951362746794,\n        \"nauc_mrr_at_10_std\": 0.14636774865250649,\n        \"nauc_mrr_at_1_diff1\": 0.44387058387933104,\n        \"nauc_mrr_at_1_max\": 0.2725338408610289,\n        \"nauc_mrr_at_1_std\": 0.060316174675716386,\n        \"nauc_mrr_at_20_diff1\": 0.38132444443784785,\n        \"nauc_mrr_at_20_max\": 0.3062138527415912,\n        \"nauc_mrr_at_20_std\": 0.14593941282612338,\n        \"nauc_mrr_at_3_diff1\": 0.3970687243852113,\n        \"nauc_mrr_at_3_max\": 0.31674852581835317,\n        \"nauc_mrr_at_3_std\": 0.13436456094929625,\n        \"nauc_mrr_at_5_diff1\": 0.38100138152706003,\n        \"nauc_mrr_at_5_max\": 0.3073873170760276,\n        \"nauc_mrr_at_5_std\": 0.15652611945867523,\n        \"nauc_ndcg_at_1000_diff1\": 0.3574233343909868,\n        \"nauc_ndcg_at_1000_max\": 0.30655290638796356,\n        \"nauc_ndcg_at_1000_std\": 0.17337480036547953,\n        \"nauc_ndcg_at_100_diff1\": 0.3457579810599418,\n        \"nauc_ndcg_at_100_max\": 0.3006748110933195,\n        \"nauc_ndcg_at_100_std\": 0.1733711765338111,\n        \"nauc_ndcg_at_10_diff1\": 0.343048050237238,\n        \"nauc_ndcg_at_10_max\": 0.29668116614702233,\n        \"nauc_ndcg_at_10_std\": 0.17411425259884278,\n        \"nauc_ndcg_at_1_diff1\": 0.44387058387933104,\n        \"nauc_ndcg_at_1_max\": 0.2725338408610289,\n        \"nauc_ndcg_at_1_std\": 0.060316174675716386,\n        \"nauc_ndcg_at_20_diff1\": 0.3436895854878777,\n        \"nauc_ndcg_at_20_max\": 0.3017373743013492,\n        \"nauc_ndcg_at_20_std\": 0.17328905930923563,\n        \"nauc_ndcg_at_3_diff1\": 0.3733606891804634,\n        \"nauc_ndcg_at_3_max\": 0.3191160889522387,\n        \"nauc_ndcg_at_3_std\": 0.14994318036782242,\n        \"nauc_ndcg_at_5_diff1\": 0.3467270461764592,\n        \"nauc_ndcg_at_5_max\": 0.3056709503441925,\n        \"nauc_ndcg_at_5_std\": 0.1944296520827874,\n        \"nauc_precision_at_1000_diff1\": -0.061608838519451925,\n        \"nauc_precision_at_1000_max\": 0.08385509548569188,\n        \"nauc_precision_at_1000_std\": 0.047319891697578075,\n        \"nauc_precision_at_100_diff1\": -0.053599905790753355,\n        \"nauc_precision_at_100_max\": 0.10630970652219067,\n        \"nauc_precision_at_100_std\": 0.10934924444876068,\n        \"nauc_precision_at_10_diff1\": 0.1060684588172504,\n        \"nauc_precision_at_10_max\": 0.20995640854645897,\n        \"nauc_precision_at_10_std\": 0.2090328516781496,\n        \"nauc_precision_at_1_diff1\": 0.44387058387933104,\n        \"nauc_precision_at_1_max\": 0.2725338408610289,\n        \"nauc_precision_at_1_std\": 0.060316174675716386,\n        \"nauc_precision_at_20_diff1\": 0.032771812626895394,\n        \"nauc_precision_at_20_max\": 0.17315833562162938,\n        \"nauc_precision_at_20_std\": 0.15246641294545024,\n        \"nauc_precision_at_3_diff1\": 0.28712758486735523,\n        \"nauc_precision_at_3_max\": 0.33407499991497946,\n        \"nauc_precision_at_3_std\": 0.18741372094200553,\n        \"nauc_precision_at_5_diff1\": 0.18376773280675154,\n        \"nauc_precision_at_5_max\": 0.2771584276813803,\n        \"nauc_precision_at_5_std\": 0.2790246716186412,\n        \"nauc_recall_at_1000_diff1\": 0.21578878928600623,\n        \"nauc_recall_at_1000_max\": 0.5562717296548295,\n        \"nauc_recall_at_1000_std\": 0.8184097949860857,\n        \"nauc_recall_at_100_diff1\": 0.12225055782258017,\n        \"nauc_recall_at_100_max\": 0.3027932391305674,\n        \"nauc_recall_at_100_std\": 0.38357849731180904,\n        \"nauc_recall_at_10_diff1\": 0.20049493517074157,\n        \"nauc_recall_at_10_max\": 0.274841557447575,\n        \"nauc_recall_at_10_std\": 0.25749112463598584,\n        \"nauc_recall_at_1_diff1\": 0.4420587257474029,\n        \"nauc_recall_at_1_max\": 0.2554211294897347,\n        \"nauc_recall_at_1_std\": 0.056532912085557045,\n        \"nauc_recall_at_20_diff1\": 0.18594136122692378,\n        \"nauc_recall_at_20_max\": 0.29793920886525604,\n        \"nauc_recall_at_20_std\": 0.28441311234475547,\n        \"nauc_recall_at_3_diff1\": 0.31239851875822006,\n        \"nauc_recall_at_3_max\": 0.34248353513370267,\n        \"nauc_recall_at_3_std\": 0.19423489820201745,\n        \"nauc_recall_at_5_diff1\": 0.23334772142792784,\n        \"nauc_recall_at_5_max\": 0.30945953842389773,\n        \"nauc_recall_at_5_std\": 0.31199421183422255,\n        \"ndcg_at_1\": 0.3658,\n        \"ndcg_at_10\": 0.52444,\n        \"ndcg_at_100\": 0.56324,\n        \"ndcg_at_1000\": 0.57441,\n        \"ndcg_at_20\": 0.54254,\n        \"ndcg_at_3\": 0.45385,\n        \"ndcg_at_5\": 0.49478,\n        \"precision_at_1\": 0.3658,\n        \"precision_at_10\": 0.07933,\n        \"precision_at_100\": 0.01012,\n        \"precision_at_1000\": 0.00111,\n        \"precision_at_20\": 0.0443,\n        \"precision_at_3\": 0.19082,\n        \"precision_at_5\": 0.13729,\n        \"recall_at_1\": 0.33729,\n        \"recall_at_10\": 0.70586,\n        \"recall_at_100\": 0.87688,\n        \"recall_at_1000\": 0.96002,\n        \"recall_at_20\": 0.77237,\n        \"recall_at_3\": 0.52059,\n        \"recall_at_5\": 0.6152\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/e5-mistral-7b-instruct/intfloat__e5-mistral-7b-instruct/07163b72af1488142a360786df853f237b1a3ca1/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 1299.6901452541351,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.2583,\n        \"map_at_1\": 0.185,\n        \"map_at_10\": 0.23136,\n        \"map_at_100\": 0.24019,\n        \"map_at_1000\": 0.24138,\n        \"map_at_20\": 0.23595,\n        \"map_at_3\": 0.21583,\n        \"map_at_5\": 0.22283,\n        \"mrr_at_1\": 0.185,\n        \"mrr_at_10\": 0.23136309523809528,\n        \"mrr_at_100\": 0.24019181484921373,\n        \"mrr_at_1000\": 0.24138093143174497,\n        \"mrr_at_20\": 0.23594689542483663,\n        \"mrr_at_3\": 0.21583333333333335,\n        \"mrr_at_5\": 0.22283333333333336,\n        \"nauc_map_at_1000_diff1\": 0.4064546850003172,\n        \"nauc_map_at_1000_max\": 0.35346841597131085,\n        \"nauc_map_at_1000_std\": 0.1057915128161012,\n        \"nauc_map_at_100_diff1\": 0.40622394733997047,\n        \"nauc_map_at_100_max\": 0.3530956009604433,\n        \"nauc_map_at_100_std\": 0.10514292708166764,\n        \"nauc_map_at_10_diff1\": 0.41099525660975966,\n        \"nauc_map_at_10_max\": 0.35835427780512297,\n        \"nauc_map_at_10_std\": 0.10416922751037618,\n        \"nauc_map_at_1_diff1\": 0.4786871453223328,\n        \"nauc_map_at_1_max\": 0.395247211943784,\n        \"nauc_map_at_1_std\": 0.09491839730766913,\n        \"nauc_map_at_20_diff1\": 0.4061435472624891,\n        \"nauc_map_at_20_max\": 0.3520833984840894,\n        \"nauc_map_at_20_std\": 0.09980601023243292,\n        \"nauc_map_at_3_diff1\": 0.42297446060463145,\n        \"nauc_map_at_3_max\": 0.3652839616730233,\n        \"nauc_map_at_3_std\": 0.10361345550841002,\n        \"nauc_map_at_5_diff1\": 0.4180173430004609,\n        \"nauc_map_at_5_max\": 0.363199626463278,\n        \"nauc_map_at_5_std\": 0.0970030789067568,\n        \"nauc_mrr_at_1000_diff1\": 0.4064546850003172,\n        \"nauc_mrr_at_1000_max\": 0.35346841597131085,\n        \"nauc_mrr_at_1000_std\": 0.1057915128161012,\n        \"nauc_mrr_at_100_diff1\": 0.40622394733997047,\n        \"nauc_mrr_at_100_max\": 0.3530956009604433,\n        \"nauc_mrr_at_100_std\": 0.10514292708166764,\n        \"nauc_mrr_at_10_diff1\": 0.41099525660975966,\n        \"nauc_mrr_at_10_max\": 0.35835427780512297,\n        \"nauc_mrr_at_10_std\": 0.10416922751037618,\n        \"nauc_mrr_at_1_diff1\": 0.4786871453223328,\n        \"nauc_mrr_at_1_max\": 0.395247211943784,\n        \"nauc_mrr_at_1_std\": 0.09491839730766913,\n        \"nauc_mrr_at_20_diff1\": 0.4061435472624891,\n        \"nauc_mrr_at_20_max\": 0.3520833984840894,\n        \"nauc_mrr_at_20_std\": 0.09980601023243292,\n        \"nauc_mrr_at_3_diff1\": 0.42297446060463145,\n        \"nauc_mrr_at_3_max\": 0.3652839616730233,\n        \"nauc_mrr_at_3_std\": 0.10361345550841002,\n        \"nauc_mrr_at_5_diff1\": 0.4180173430004609,\n        \"nauc_mrr_at_5_max\": 0.363199626463278,\n        \"nauc_mrr_at_5_std\": 0.0970030789067568,\n        \"nauc_ndcg_at_1000_diff1\": 0.36119623623825786,\n        \"nauc_ndcg_at_1000_max\": 0.3251781226472588,\n        \"nauc_ndcg_at_1000_std\": 0.13460027984602643,\n        \"nauc_ndcg_at_100_diff1\": 0.35902324967740534,\n        \"nauc_ndcg_at_100_max\": 0.3166841266454237,\n        \"nauc_ndcg_at_100_std\": 0.12282384956394275,\n        \"nauc_ndcg_at_10_diff1\": 0.3808438900368939,\n        \"nauc_ndcg_at_10_max\": 0.33894695737377734,\n        \"nauc_ndcg_at_10_std\": 0.11168733011205549,\n        \"nauc_ndcg_at_1_diff1\": 0.4786871453223328,\n        \"nauc_ndcg_at_1_max\": 0.395247211943784,\n        \"nauc_ndcg_at_1_std\": 0.09491839730766913,\n        \"nauc_ndcg_at_20_diff1\": 0.36436154083113964,\n        \"nauc_ndcg_at_20_max\": 0.31711980056360034,\n        \"nauc_ndcg_at_20_std\": 0.0956758519192603,\n        \"nauc_ndcg_at_3_diff1\": 0.4062661680506958,\n        \"nauc_ndcg_at_3_max\": 0.3550415994920533,\n        \"nauc_ndcg_at_3_std\": 0.10554574009628236,\n        \"nauc_ndcg_at_5_diff1\": 0.39721165056474383,\n        \"nauc_ndcg_at_5_max\": 0.3509364022396801,\n        \"nauc_ndcg_at_5_std\": 0.09459482118303365,\n        \"nauc_precision_at_1000_diff1\": 0.020582492678163988,\n        \"nauc_precision_at_1000_max\": 0.15686625447445454,\n        \"nauc_precision_at_1000_std\": 0.4483403839895867,\n        \"nauc_precision_at_100_diff1\": 0.19440095241531105,\n        \"nauc_precision_at_100_max\": 0.18578592301309582,\n        \"nauc_precision_at_100_std\": 0.19901872361917824,\n        \"nauc_precision_at_10_diff1\": 0.299049054010296,\n        \"nauc_precision_at_10_max\": 0.2850723287272922,\n        \"nauc_precision_at_10_std\": 0.13535285449006437,\n        \"nauc_precision_at_1_diff1\": 0.4786871453223328,\n        \"nauc_precision_at_1_max\": 0.395247211943784,\n        \"nauc_precision_at_1_std\": 0.09491839730766913,\n        \"nauc_precision_at_20_diff1\": 0.24434725789443065,\n        \"nauc_precision_at_20_max\": 0.21071869885036665,\n        \"nauc_precision_at_20_std\": 0.07820354400243278,\n        \"nauc_precision_at_3_diff1\": 0.3618335192516606,\n        \"nauc_precision_at_3_max\": 0.3274495650969326,\n        \"nauc_precision_at_3_std\": 0.11049381365879976,\n        \"nauc_precision_at_5_diff1\": 0.34233616576292103,\n        \"nauc_precision_at_5_max\": 0.318257051641632,\n        \"nauc_precision_at_5_std\": 0.08729284828842304,\n        \"nauc_recall_at_1000_diff1\": 0.0205824926781645,\n        \"nauc_recall_at_1000_max\": 0.1568662544744541,\n        \"nauc_recall_at_1000_std\": 0.4483403839895864,\n        \"nauc_recall_at_100_diff1\": 0.1944009524153109,\n        \"nauc_recall_at_100_max\": 0.18578592301309568,\n        \"nauc_recall_at_100_std\": 0.19901872361917805,\n        \"nauc_recall_at_10_diff1\": 0.29904905401029597,\n        \"nauc_recall_at_10_max\": 0.285072328727292,\n        \"nauc_recall_at_10_std\": 0.1353528544900643,\n        \"nauc_recall_at_1_diff1\": 0.4786871453223328,\n        \"nauc_recall_at_1_max\": 0.395247211943784,\n        \"nauc_recall_at_1_std\": 0.09491839730766913,\n        \"nauc_recall_at_20_diff1\": 0.2443472578944304,\n        \"nauc_recall_at_20_max\": 0.21071869885036645,\n        \"nauc_recall_at_20_std\": 0.0782035440024324,\n        \"nauc_recall_at_3_diff1\": 0.3618335192516606,\n        \"nauc_recall_at_3_max\": 0.32744956509693285,\n        \"nauc_recall_at_3_std\": 0.11049381365879964,\n        \"nauc_recall_at_5_diff1\": 0.34233616576292075,\n        \"nauc_recall_at_5_max\": 0.3182570516416317,\n        \"nauc_recall_at_5_std\": 0.08729284828842285,\n        \"ndcg_at_1\": 0.185,\n        \"ndcg_at_10\": 0.2583,\n        \"ndcg_at_100\": 0.30556,\n        \"ndcg_at_1000\": 0.3397,\n        \"ndcg_at_20\": 0.27566,\n        \"ndcg_at_3\": 0.22589,\n        \"ndcg_at_5\": 0.23837,\n        \"precision_at_1\": 0.185,\n        \"precision_at_10\": 0.0345,\n        \"precision_at_100\": 0.00575,\n        \"precision_at_1000\": 0.00085,\n        \"precision_at_20\": 0.02075,\n        \"precision_at_3\": 0.085,\n        \"precision_at_5\": 0.057,\n        \"recall_at_1\": 0.185,\n        \"recall_at_10\": 0.345,\n        \"recall_at_100\": 0.575,\n        \"recall_at_1000\": 0.85,\n        \"recall_at_20\": 0.415,\n        \"recall_at_3\": 0.255,\n        \"recall_at_5\": 0.285\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.26156,\n        \"map_at_1\": 0.19,\n        \"map_at_10\": 0.23683,\n        \"map_at_100\": 0.24172,\n        \"map_at_1000\": 0.24269,\n        \"map_at_20\": 0.23826,\n        \"map_at_3\": 0.22167,\n        \"map_at_5\": 0.23242,\n        \"mrr_at_1\": 0.19,\n        \"mrr_at_10\": 0.23683134920634924,\n        \"mrr_at_100\": 0.24171935489477314,\n        \"mrr_at_1000\": 0.2426884955745824,\n        \"mrr_at_20\": 0.23826008223802345,\n        \"mrr_at_3\": 0.22166666666666668,\n        \"mrr_at_5\": 0.23241666666666666,\n        \"nauc_map_at_1000_diff1\": 0.6641907155449482,\n        \"nauc_map_at_1000_max\": 0.48534236374028916,\n        \"nauc_map_at_1000_std\": 0.06895415579732908,\n        \"nauc_map_at_100_diff1\": 0.6640831057208721,\n        \"nauc_map_at_100_max\": 0.4851182715062897,\n        \"nauc_map_at_100_std\": 0.06883701661871983,\n        \"nauc_map_at_10_diff1\": 0.6667368173006674,\n        \"nauc_map_at_10_max\": 0.484255165057044,\n        \"nauc_map_at_10_std\": 0.0647646791295488,\n        \"nauc_map_at_1_diff1\": 0.7792611773409783,\n        \"nauc_map_at_1_max\": 0.5408925058429875,\n        \"nauc_map_at_1_std\": 0.03177071948615341,\n        \"nauc_map_at_20_diff1\": 0.6661193271608087,\n        \"nauc_map_at_20_max\": 0.483852716270148,\n        \"nauc_map_at_20_std\": 0.06292547073334602,\n        \"nauc_map_at_3_diff1\": 0.6930708041433866,\n        \"nauc_map_at_3_max\": 0.5016790465935429,\n        \"nauc_map_at_3_std\": 0.060037648187594314,\n        \"nauc_map_at_5_diff1\": 0.672557899855475,\n        \"nauc_map_at_5_max\": 0.4877426281333304,\n        \"nauc_map_at_5_std\": 0.06386821043253478,\n        \"nauc_mrr_at_1000_diff1\": 0.6641907155449482,\n        \"nauc_mrr_at_1000_max\": 0.48534236374028916,\n        \"nauc_mrr_at_1000_std\": 0.06895415579732908,\n        \"nauc_mrr_at_100_diff1\": 0.6640831057208721,\n        \"nauc_mrr_at_100_max\": 0.4851182715062897,\n        \"nauc_mrr_at_100_std\": 0.06883701661871983,\n        \"nauc_mrr_at_10_diff1\": 0.6667368173006674,\n        \"nauc_mrr_at_10_max\": 0.484255165057044,\n        \"nauc_mrr_at_10_std\": 0.0647646791295488,\n        \"nauc_mrr_at_1_diff1\": 0.7792611773409783,\n        \"nauc_mrr_at_1_max\": 0.5408925058429875,\n        \"nauc_mrr_at_1_std\": 0.03177071948615341,\n        \"nauc_mrr_at_20_diff1\": 0.6661193271608087,\n        \"nauc_mrr_at_20_max\": 0.483852716270148,\n        \"nauc_mrr_at_20_std\": 0.06292547073334602,\n        \"nauc_mrr_at_3_diff1\": 0.6930708041433866,\n        \"nauc_mrr_at_3_max\": 0.5016790465935429,\n        \"nauc_mrr_at_3_std\": 0.060037648187594314,\n        \"nauc_mrr_at_5_diff1\": 0.672557899855475,\n        \"nauc_mrr_at_5_max\": 0.4877426281333304,\n        \"nauc_mrr_at_5_std\": 0.06386821043253478,\n        \"nauc_ndcg_at_1000_diff1\": 0.606836185050386,\n        \"nauc_ndcg_at_1000_max\": 0.47775308221267027,\n        \"nauc_ndcg_at_1000_std\": 0.11672644277568842,\n        \"nauc_ndcg_at_100_diff1\": 0.6074586747481382,\n        \"nauc_ndcg_at_100_max\": 0.47423018408455725,\n        \"nauc_ndcg_at_100_std\": 0.11351861089617107,\n        \"nauc_ndcg_at_10_diff1\": 0.6232461471680374,\n        \"nauc_ndcg_at_10_max\": 0.45760043042235565,\n        \"nauc_ndcg_at_10_std\": 0.07464143181827516,\n        \"nauc_ndcg_at_1_diff1\": 0.7792611773409783,\n        \"nauc_ndcg_at_1_max\": 0.5408925058429875,\n        \"nauc_ndcg_at_1_std\": 0.03177071948615341,\n        \"nauc_ndcg_at_20_diff1\": 0.62074672565798,\n        \"nauc_ndcg_at_20_max\": 0.45647008618568724,\n        \"nauc_ndcg_at_20_std\": 0.06806576617201257,\n        \"nauc_ndcg_at_3_diff1\": 0.6706509022021202,\n        \"nauc_ndcg_at_3_max\": 0.488536091665009,\n        \"nauc_ndcg_at_3_std\": 0.06538872229154163,\n        \"nauc_ndcg_at_5_diff1\": 0.6366605288401967,\n        \"nauc_ndcg_at_5_max\": 0.4657904827493212,\n        \"nauc_ndcg_at_5_std\": 0.07236457264680732,\n        \"nauc_precision_at_1000_diff1\": 0.30311450207823304,\n        \"nauc_precision_at_1000_max\": 0.5260376928770715,\n        \"nauc_precision_at_1000_std\": 0.47865398849854834,\n        \"nauc_precision_at_100_diff1\": 0.4309027801270645,\n        \"nauc_precision_at_100_max\": 0.48441464421274844,\n        \"nauc_precision_at_100_std\": 0.3121942638312848,\n        \"nauc_precision_at_10_diff1\": 0.507081533691937,\n        \"nauc_precision_at_10_max\": 0.3854633138132969,\n        \"nauc_precision_at_10_std\": 0.10073133893319942,\n        \"nauc_precision_at_1_diff1\": 0.7792611773409783,\n        \"nauc_precision_at_1_max\": 0.5408925058429875,\n        \"nauc_precision_at_1_std\": 0.03177071948615341,\n        \"nauc_precision_at_20_diff1\": 0.49858290033065683,\n        \"nauc_precision_at_20_max\": 0.3825644255497824,\n        \"nauc_precision_at_20_std\": 0.07713352227995598,\n        \"nauc_precision_at_3_diff1\": 0.6116114018097193,\n        \"nauc_precision_at_3_max\": 0.45295741666907585,\n        \"nauc_precision_at_3_std\": 0.07882108062790914,\n        \"nauc_precision_at_5_diff1\": 0.5427227452539646,\n        \"nauc_precision_at_5_max\": 0.4074817874881226,\n        \"nauc_precision_at_5_std\": 0.09430071367437858,\n        \"nauc_recall_at_1000_diff1\": 0.30311450207823193,\n        \"nauc_recall_at_1000_max\": 0.5260376928770707,\n        \"nauc_recall_at_1000_std\": 0.47865398849854796,\n        \"nauc_recall_at_100_diff1\": 0.43090278012706423,\n        \"nauc_recall_at_100_max\": 0.4844146442127485,\n        \"nauc_recall_at_100_std\": 0.31219426383128435,\n        \"nauc_recall_at_10_diff1\": 0.5070815336919365,\n        \"nauc_recall_at_10_max\": 0.38546331381329646,\n        \"nauc_recall_at_10_std\": 0.10073133893319892,\n        \"nauc_recall_at_1_diff1\": 0.7792611773409783,\n        \"nauc_recall_at_1_max\": 0.5408925058429875,\n        \"nauc_recall_at_1_std\": 0.03177071948615341,\n        \"nauc_recall_at_20_diff1\": 0.49858290033065683,\n        \"nauc_recall_at_20_max\": 0.38256442554978215,\n        \"nauc_recall_at_20_std\": 0.07713352227995594,\n        \"nauc_recall_at_3_diff1\": 0.6116114018097193,\n        \"nauc_recall_at_3_max\": 0.4529574166690759,\n        \"nauc_recall_at_3_std\": 0.07882108062790905,\n        \"nauc_recall_at_5_diff1\": 0.5427227452539644,\n        \"nauc_recall_at_5_max\": 0.40748178748812197,\n        \"nauc_recall_at_5_std\": 0.0943007136743786,\n        \"ndcg_at_1\": 0.19,\n        \"ndcg_at_10\": 0.26156,\n        \"ndcg_at_100\": 0.29432,\n        \"ndcg_at_1000\": 0.32578,\n        \"ndcg_at_20\": 0.26668,\n        \"ndcg_at_3\": 0.23155,\n        \"ndcg_at_5\": 0.25049,\n        \"precision_at_1\": 0.19,\n        \"precision_at_10\": 0.034,\n        \"precision_at_100\": 0.00515,\n        \"precision_at_1000\": 0.00078,\n        \"precision_at_20\": 0.018,\n        \"precision_at_3\": 0.08667,\n        \"precision_at_5\": 0.061,\n        \"recall_at_1\": 0.19,\n        \"recall_at_10\": 0.34,\n        \"recall_at_100\": 0.515,\n        \"recall_at_1000\": 0.775,\n        \"recall_at_20\": 0.36,\n        \"recall_at_3\": 0.26,\n        \"recall_at_5\": 0.305\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/e5-mistral-7b-instruct/intfloat__e5-mistral-7b-instruct/07163b72af1488142a360786df853f237b1a3ca1/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 9.609801292419434,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.88733,\n        \"map_at_1\": 0.77922,\n        \"map_at_10\": 0.85491,\n        \"map_at_100\": 0.85572,\n        \"map_at_1000\": 0.85572,\n        \"map_at_20\": 0.85572,\n        \"map_at_3\": 0.84632,\n        \"map_at_5\": 0.85216,\n        \"mrr_at_1\": 0.7792207792207793,\n        \"mrr_at_10\": 0.854906204906205,\n        \"mrr_at_100\": 0.8557178932178933,\n        \"mrr_at_1000\": 0.8557178932178933,\n        \"mrr_at_20\": 0.8557178932178933,\n        \"mrr_at_3\": 0.8463203463203463,\n        \"mrr_at_5\": 0.8521645021645022,\n        \"nauc_map_at_1000_diff1\": 0.7934322885790674,\n        \"nauc_map_at_1000_max\": 0.42889149307066504,\n        \"nauc_map_at_1000_std\": -0.14898589679329766,\n        \"nauc_map_at_100_diff1\": 0.7934322885790674,\n        \"nauc_map_at_100_max\": 0.42889149307066504,\n        \"nauc_map_at_100_std\": -0.14898589679329766,\n        \"nauc_map_at_10_diff1\": 0.7946746897029425,\n        \"nauc_map_at_10_max\": 0.4315367969330446,\n        \"nauc_map_at_10_std\": -0.15509289492565895,\n        \"nauc_map_at_1_diff1\": 0.78246273000063,\n        \"nauc_map_at_1_max\": 0.4139400142694634,\n        \"nauc_map_at_1_std\": -0.14021417297508898,\n        \"nauc_map_at_20_diff1\": 0.7934322885790674,\n        \"nauc_map_at_20_max\": 0.42889149307066504,\n        \"nauc_map_at_20_std\": -0.14898589679329766,\n        \"nauc_map_at_3_diff1\": 0.8005529129446742,\n        \"nauc_map_at_3_max\": 0.4368327376511254,\n        \"nauc_map_at_3_std\": -0.13197873310791935,\n        \"nauc_map_at_5_diff1\": 0.7945644457362998,\n        \"nauc_map_at_5_max\": 0.42813807841768853,\n        \"nauc_map_at_5_std\": -0.15147615627835584,\n        \"nauc_mrr_at_1000_diff1\": 0.7934322885790674,\n        \"nauc_mrr_at_1000_max\": 0.42889149307066504,\n        \"nauc_mrr_at_1000_std\": -0.14898589679329766,\n        \"nauc_mrr_at_100_diff1\": 0.7934322885790674,\n        \"nauc_mrr_at_100_max\": 0.42889149307066504,\n        \"nauc_mrr_at_100_std\": -0.14898589679329766,\n        \"nauc_mrr_at_10_diff1\": 0.7946746897029425,\n        \"nauc_mrr_at_10_max\": 0.4315367969330446,\n        \"nauc_mrr_at_10_std\": -0.15509289492565895,\n        \"nauc_mrr_at_1_diff1\": 0.78246273000063,\n        \"nauc_mrr_at_1_max\": 0.4139400142694634,\n        \"nauc_mrr_at_1_std\": -0.14021417297508898,\n        \"nauc_mrr_at_20_diff1\": 0.7934322885790674,\n        \"nauc_mrr_at_20_max\": 0.42889149307066504,\n        \"nauc_mrr_at_20_std\": -0.14898589679329766,\n        \"nauc_mrr_at_3_diff1\": 0.8005529129446742,\n        \"nauc_mrr_at_3_max\": 0.4368327376511254,\n        \"nauc_mrr_at_3_std\": -0.13197873310791935,\n        \"nauc_mrr_at_5_diff1\": 0.7945644457362998,\n        \"nauc_mrr_at_5_max\": 0.42813807841768853,\n        \"nauc_mrr_at_5_std\": -0.15147615627835584,\n        \"nauc_ndcg_at_1000_diff1\": 0.7950512425953983,\n        \"nauc_ndcg_at_1000_max\": 0.4304110150291181,\n        \"nauc_ndcg_at_1000_std\": -0.1537557702365057,\n        \"nauc_ndcg_at_100_diff1\": 0.7950512425953983,\n        \"nauc_ndcg_at_100_max\": 0.4304110150291181,\n        \"nauc_ndcg_at_100_std\": -0.1537557702365057,\n        \"nauc_ndcg_at_10_diff1\": 0.8012433401285308,\n        \"nauc_ndcg_at_10_max\": 0.4436533826919126,\n        \"nauc_ndcg_at_10_std\": -0.18428922374139559,\n        \"nauc_ndcg_at_1_diff1\": 0.78246273000063,\n        \"nauc_ndcg_at_1_max\": 0.4139400142694634,\n        \"nauc_ndcg_at_1_std\": -0.14021417297508898,\n        \"nauc_ndcg_at_20_diff1\": 0.7950512425953983,\n        \"nauc_ndcg_at_20_max\": 0.4304110150291181,\n        \"nauc_ndcg_at_20_std\": -0.1537557702365057,\n        \"nauc_ndcg_at_3_diff1\": 0.8117962912647465,\n        \"nauc_ndcg_at_3_max\": 0.4465068871741506,\n        \"nauc_ndcg_at_3_std\": -0.13050839506151526,\n        \"nauc_ndcg_at_5_diff1\": 0.7999319493116879,\n        \"nauc_ndcg_at_5_max\": 0.4295215718616793,\n        \"nauc_ndcg_at_5_std\": -0.17119373043019556,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 1.0,\n        \"nauc_precision_at_10_max\": 0.868712702472296,\n        \"nauc_precision_at_10_std\": -1.1643653934883855,\n        \"nauc_precision_at_1_diff1\": 0.78246273000063,\n        \"nauc_precision_at_1_max\": 0.4139400142694634,\n        \"nauc_precision_at_1_std\": -0.14021417297508898,\n        \"nauc_precision_at_20_diff1\": 1.0,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 1.0,\n        \"nauc_precision_at_3_diff1\": 0.8847118713466388,\n        \"nauc_precision_at_3_max\": 0.5069794576105962,\n        \"nauc_precision_at_3_std\": -0.12278837016399671,\n        \"nauc_precision_at_5_diff1\": 0.8516155514202957,\n        \"nauc_precision_at_5_max\": 0.43608962587044786,\n        \"nauc_precision_at_5_std\": -0.3899875213628128,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 1.0,\n        \"nauc_recall_at_10_max\": 0.868712702472291,\n        \"nauc_recall_at_10_std\": -1.1643653934883855,\n        \"nauc_recall_at_1_diff1\": 0.78246273000063,\n        \"nauc_recall_at_1_max\": 0.4139400142694634,\n        \"nauc_recall_at_1_std\": -0.14021417297508898,\n        \"nauc_recall_at_20_diff1\": NaN,\n        \"nauc_recall_at_20_max\": NaN,\n        \"nauc_recall_at_20_std\": NaN,\n        \"nauc_recall_at_3_diff1\": 0.8847118713466364,\n        \"nauc_recall_at_3_max\": 0.5069794576105937,\n        \"nauc_recall_at_3_std\": -0.12278837016399707,\n        \"nauc_recall_at_5_diff1\": 0.8516155514202973,\n        \"nauc_recall_at_5_max\": 0.4360896258704462,\n        \"nauc_recall_at_5_std\": -0.3899875213628153,\n        \"ndcg_at_1\": 0.77922,\n        \"ndcg_at_10\": 0.88733,\n        \"ndcg_at_100\": 0.8905,\n        \"ndcg_at_1000\": 0.8905,\n        \"ndcg_at_20\": 0.8905,\n        \"ndcg_at_3\": 0.86905,\n        \"ndcg_at_5\": 0.87966,\n        \"precision_at_1\": 0.77922,\n        \"precision_at_10\": 0.0987,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.05,\n        \"precision_at_3\": 0.31169,\n        \"precision_at_5\": 0.19221,\n        \"recall_at_1\": 0.77922,\n        \"recall_at_10\": 0.98701,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 1.0,\n        \"recall_at_3\": 0.93506,\n        \"recall_at_5\": 0.96104\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/intfloat/e5-mistral-7b-instruct/intfloat__e5-mistral-7b-instruct/07163b72af1488142a360786df853f237b1a3ca1/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 94.5943055152893,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.39159,\n        \"map_at_1\": 0.21735,\n        \"map_at_10\": 0.33957,\n        \"map_at_100\": 0.35468,\n        \"map_at_1000\": 0.3557,\n        \"map_at_20\": 0.34729,\n        \"map_at_3\": 0.29888,\n        \"map_at_5\": 0.32449,\n        \"mrr_at_1\": 0.30275229357798167,\n        \"mrr_at_10\": 0.37696410368428707,\n        \"mrr_at_100\": 0.38764386663917805,\n        \"mrr_at_1000\": 0.3882795810575206,\n        \"mrr_at_20\": 0.38235277378984583,\n        \"mrr_at_3\": 0.3491335372069318,\n        \"mrr_at_5\": 0.3643476044852192,\n        \"nauc_map_at_1000_diff1\": 0.3891943906806401,\n        \"nauc_map_at_1000_max\": 0.10771105038677764,\n        \"nauc_map_at_1000_std\": -0.3757363720697668,\n        \"nauc_map_at_100_diff1\": 0.388758610656804,\n        \"nauc_map_at_100_max\": 0.10796740105799091,\n        \"nauc_map_at_100_std\": -0.3751089557776611,\n        \"nauc_map_at_10_diff1\": 0.38874252303050344,\n        \"nauc_map_at_10_max\": 0.10607471972305403,\n        \"nauc_map_at_10_std\": -0.38029646262612327,\n        \"nauc_map_at_1_diff1\": 0.4479663765266703,\n        \"nauc_map_at_1_max\": 0.08344061958550404,\n        \"nauc_map_at_1_std\": -0.3201619883425269,\n        \"nauc_map_at_20_diff1\": 0.38851894744700904,\n        \"nauc_map_at_20_max\": 0.10585408079995105,\n        \"nauc_map_at_20_std\": -0.378891310149093,\n        \"nauc_map_at_3_diff1\": 0.39575353829146903,\n        \"nauc_map_at_3_max\": 0.10038991688314625,\n        \"nauc_map_at_3_std\": -0.3661411633453306,\n        \"nauc_map_at_5_diff1\": 0.39095681780893704,\n        \"nauc_map_at_5_max\": 0.10539954891553001,\n        \"nauc_map_at_5_std\": -0.3800485827939017,\n        \"nauc_mrr_at_1000_diff1\": 0.4270858205611115,\n        \"nauc_mrr_at_1000_max\": 0.11229534024796844,\n        \"nauc_mrr_at_1000_std\": -0.3852042862872202,\n        \"nauc_mrr_at_100_diff1\": 0.4269618416359274,\n        \"nauc_mrr_at_100_max\": 0.11272734856956011,\n        \"nauc_mrr_at_100_std\": -0.3845620305871939,\n        \"nauc_mrr_at_10_diff1\": 0.42538900608630015,\n        \"nauc_mrr_at_10_max\": 0.10762120716999009,\n        \"nauc_mrr_at_10_std\": -0.38987371061908493,\n        \"nauc_mrr_at_1_diff1\": 0.45149239085362464,\n        \"nauc_mrr_at_1_max\": 0.11642553883873362,\n        \"nauc_mrr_at_1_std\": -0.37054638932671113,\n        \"nauc_mrr_at_20_diff1\": 0.4261287226213975,\n        \"nauc_mrr_at_20_max\": 0.110564345143684,\n        \"nauc_mrr_at_20_std\": -0.38730809677132183,\n        \"nauc_mrr_at_3_diff1\": 0.4303268324883733,\n        \"nauc_mrr_at_3_max\": 0.10677422466163869,\n        \"nauc_mrr_at_3_std\": -0.39157421166114276,\n        \"nauc_mrr_at_5_diff1\": 0.4292836011082437,\n        \"nauc_mrr_at_5_max\": 0.10930394647740294,\n        \"nauc_mrr_at_5_std\": -0.39440140898838644,\n        \"nauc_ndcg_at_1000_diff1\": 0.3954317519730454,\n        \"nauc_ndcg_at_1000_max\": 0.11984342194630304,\n        \"nauc_ndcg_at_1000_std\": -0.36646537585088207,\n        \"nauc_ndcg_at_100_diff1\": 0.38885374653122123,\n        \"nauc_ndcg_at_100_max\": 0.13219229899594778,\n        \"nauc_ndcg_at_100_std\": -0.34438208302966583,\n        \"nauc_ndcg_at_10_diff1\": 0.38506936963711735,\n        \"nauc_ndcg_at_10_max\": 0.10619487049571352,\n        \"nauc_ndcg_at_10_std\": -0.38661887757098545,\n        \"nauc_ndcg_at_1_diff1\": 0.4467339947356412,\n        \"nauc_ndcg_at_1_max\": 0.11249725870947681,\n        \"nauc_ndcg_at_1_std\": -0.3734570014392317,\n        \"nauc_ndcg_at_20_diff1\": 0.3836944317399486,\n        \"nauc_ndcg_at_20_max\": 0.10833552931509423,\n        \"nauc_ndcg_at_20_std\": -0.38000077174364627,\n        \"nauc_ndcg_at_3_diff1\": 0.3956121572163778,\n        \"nauc_ndcg_at_3_max\": 0.09514136816101489,\n        \"nauc_ndcg_at_3_std\": -0.3838862486285258,\n        \"nauc_ndcg_at_5_diff1\": 0.392382534513423,\n        \"nauc_ndcg_at_5_max\": 0.1062818876614154,\n        \"nauc_ndcg_at_5_std\": -0.39182388867854756,\n        \"nauc_precision_at_1000_diff1\": 0.024435045834388852,\n        \"nauc_precision_at_1000_max\": 0.12304493138177797,\n        \"nauc_precision_at_1000_std\": 0.00022105368792189542,\n        \"nauc_precision_at_100_diff1\": 0.08531016504572342,\n        \"nauc_precision_at_100_max\": 0.17074458774590445,\n        \"nauc_precision_at_100_std\": -0.021180430234989018,\n        \"nauc_precision_at_10_diff1\": 0.20730521488364595,\n        \"nauc_precision_at_10_max\": 0.09347162454934668,\n        \"nauc_precision_at_10_std\": -0.33210209387184353,\n        \"nauc_precision_at_1_diff1\": 0.4467339947356412,\n        \"nauc_precision_at_1_max\": 0.11249725870947681,\n        \"nauc_precision_at_1_std\": -0.3734570014392317,\n        \"nauc_precision_at_20_diff1\": 0.16466411716113014,\n        \"nauc_precision_at_20_max\": 0.09453559326766833,\n        \"nauc_precision_at_20_std\": -0.2651284275522984,\n        \"nauc_precision_at_3_diff1\": 0.2571689526504932,\n        \"nauc_precision_at_3_max\": 0.09392870266560792,\n        \"nauc_precision_at_3_std\": -0.36403711358480606,\n        \"nauc_precision_at_5_diff1\": 0.2313057952660572,\n        \"nauc_precision_at_5_max\": 0.1005096228621213,\n        \"nauc_precision_at_5_std\": -0.35598203053396,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.30446393761455715,\n        \"nauc_recall_at_100_max\": 0.3113812040722389,\n        \"nauc_recall_at_100_std\": -0.00927689901427721,\n        \"nauc_recall_at_10_diff1\": 0.3210558561521383,\n        \"nauc_recall_at_10_max\": 0.10285388430967961,\n        \"nauc_recall_at_10_std\": -0.3662555708281694,\n        \"nauc_recall_at_1_diff1\": 0.4479663765266703,\n        \"nauc_recall_at_1_max\": 0.08344061958550404,\n        \"nauc_recall_at_1_std\": -0.3201619883425269,\n        \"nauc_recall_at_20_diff1\": 0.30936939279334214,\n        \"nauc_recall_at_20_max\": 0.10513295799184674,\n        \"nauc_recall_at_20_std\": -0.3444937107201154,\n        \"nauc_recall_at_3_diff1\": 0.3687560732687906,\n        \"nauc_recall_at_3_max\": 0.08633837741190495,\n        \"nauc_recall_at_3_std\": -0.37472195139259223,\n        \"nauc_recall_at_5_diff1\": 0.35030217548059306,\n        \"nauc_recall_at_5_max\": 0.10254337088344546,\n        \"nauc_recall_at_5_std\": -0.3922881466749867,\n        \"ndcg_at_1\": 0.30428,\n        \"ndcg_at_10\": 0.39159,\n        \"ndcg_at_100\": 0.4628,\n        \"ndcg_at_1000\": 0.48665,\n        \"ndcg_at_20\": 0.41548,\n        \"ndcg_at_3\": 0.32701,\n        \"ndcg_at_5\": 0.35871,\n        \"precision_at_1\": 0.30428,\n        \"precision_at_10\": 0.0815,\n        \"precision_at_100\": 0.01321,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.04771,\n        \"precision_at_3\": 0.18145,\n        \"precision_at_5\": 0.13486,\n        \"recall_at_1\": 0.21735,\n        \"recall_at_10\": 0.50956,\n        \"recall_at_100\": 0.82378,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.59286,\n        \"recall_at_3\": 0.34207,\n        \"recall_at_5\": 0.41758\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.30289,\n        \"map_at_1\": 0.1449,\n        \"map_at_10\": 0.25037,\n        \"map_at_100\": 0.2719,\n        \"map_at_1000\": 0.2738,\n        \"map_at_20\": 0.26142,\n        \"map_at_3\": 0.21433,\n        \"map_at_5\": 0.23335,\n        \"mrr_at_1\": 0.25535168195718655,\n        \"mrr_at_10\": 0.31652407650114067,\n        \"mrr_at_100\": 0.32893544150439313,\n        \"mrr_at_1000\": 0.3298652873489474,\n        \"mrr_at_20\": 0.3234923981116145,\n        \"mrr_at_3\": 0.29332313965341494,\n        \"mrr_at_5\": 0.3036442405708461,\n        \"nauc_map_at_1000_diff1\": 0.43457739722073147,\n        \"nauc_map_at_1000_max\": 0.24823568710933047,\n        \"nauc_map_at_1000_std\": -0.25370312619154006,\n        \"nauc_map_at_100_diff1\": 0.4345210829420494,\n        \"nauc_map_at_100_max\": 0.24755923848907635,\n        \"nauc_map_at_100_std\": -0.25456713066896886,\n        \"nauc_map_at_10_diff1\": 0.43735696617222486,\n        \"nauc_map_at_10_max\": 0.2533196612617186,\n        \"nauc_map_at_10_std\": -0.2541926248122255,\n        \"nauc_map_at_1_diff1\": 0.513895321278906,\n        \"nauc_map_at_1_max\": 0.24223000175451737,\n        \"nauc_map_at_1_std\": -0.24997815873894727,\n        \"nauc_map_at_20_diff1\": 0.4344846713791249,\n        \"nauc_map_at_20_max\": 0.24896924180209015,\n        \"nauc_map_at_20_std\": -0.25480007677443606,\n        \"nauc_map_at_3_diff1\": 0.45882356448306344,\n        \"nauc_map_at_3_max\": 0.24690567099785007,\n        \"nauc_map_at_3_std\": -0.2680891538294646,\n        \"nauc_map_at_5_diff1\": 0.44188105522431037,\n        \"nauc_map_at_5_max\": 0.2599847120407283,\n        \"nauc_map_at_5_std\": -0.2540192836156989,\n        \"nauc_mrr_at_1000_diff1\": 0.42743462569458335,\n        \"nauc_mrr_at_1000_max\": 0.21087869381195828,\n        \"nauc_mrr_at_1000_std\": -0.2545229580464646,\n        \"nauc_mrr_at_100_diff1\": 0.4271337422418246,\n        \"nauc_mrr_at_100_max\": 0.21071192703945432,\n        \"nauc_mrr_at_100_std\": -0.25427735746920854,\n        \"nauc_mrr_at_10_diff1\": 0.4289419050692238,\n        \"nauc_mrr_at_10_max\": 0.21259491681047768,\n        \"nauc_mrr_at_10_std\": -0.2552518780658438,\n        \"nauc_mrr_at_1_diff1\": 0.49270414720254924,\n        \"nauc_mrr_at_1_max\": 0.2244713219451547,\n        \"nauc_mrr_at_1_std\": -0.27988538657714074,\n        \"nauc_mrr_at_20_diff1\": 0.4268017541903574,\n        \"nauc_mrr_at_20_max\": 0.2110709141279377,\n        \"nauc_mrr_at_20_std\": -0.25370678720300754,\n        \"nauc_mrr_at_3_diff1\": 0.4369492901076459,\n        \"nauc_mrr_at_3_max\": 0.20897815691328095,\n        \"nauc_mrr_at_3_std\": -0.2774844513650661,\n        \"nauc_mrr_at_5_diff1\": 0.42602748195671786,\n        \"nauc_mrr_at_5_max\": 0.21287624906794395,\n        \"nauc_mrr_at_5_std\": -0.25665096900549267,\n        \"nauc_ndcg_at_1000_diff1\": 0.41300503969412267,\n        \"nauc_ndcg_at_1000_max\": 0.2300953503802467,\n        \"nauc_ndcg_at_1000_std\": -0.23815762471091417,\n        \"nauc_ndcg_at_100_diff1\": 0.41043075355739245,\n        \"nauc_ndcg_at_100_max\": 0.22518919314821056,\n        \"nauc_ndcg_at_100_std\": -0.2348691263548975,\n        \"nauc_ndcg_at_10_diff1\": 0.41357986502094846,\n        \"nauc_ndcg_at_10_max\": 0.23671628803070013,\n        \"nauc_ndcg_at_10_std\": -0.24366171025120886,\n        \"nauc_ndcg_at_1_diff1\": 0.49270414720254924,\n        \"nauc_ndcg_at_1_max\": 0.2244713219451547,\n        \"nauc_ndcg_at_1_std\": -0.27988538657714074,\n        \"nauc_ndcg_at_20_diff1\": 0.4030648870554614,\n        \"nauc_ndcg_at_20_max\": 0.22447653862887834,\n        \"nauc_ndcg_at_20_std\": -0.24580859664545396,\n        \"nauc_ndcg_at_3_diff1\": 0.43591498372541754,\n        \"nauc_ndcg_at_3_max\": 0.23022420130524326,\n        \"nauc_ndcg_at_3_std\": -0.275943597231683,\n        \"nauc_ndcg_at_5_diff1\": 0.4163387471828433,\n        \"nauc_ndcg_at_5_max\": 0.24558196251102155,\n        \"nauc_ndcg_at_5_std\": -0.24487987161839542,\n        \"nauc_precision_at_1000_diff1\": 0.02963318795790098,\n        \"nauc_precision_at_1000_max\": 0.0345862628941379,\n        \"nauc_precision_at_1000_std\": -0.0014912651423470648,\n        \"nauc_precision_at_100_diff1\": 0.12575298288665557,\n        \"nauc_precision_at_100_max\": 0.08109371158290818,\n        \"nauc_precision_at_100_std\": -0.0663314119337897,\n        \"nauc_precision_at_10_diff1\": 0.2513590557182598,\n        \"nauc_precision_at_10_max\": 0.17806833312901688,\n        \"nauc_precision_at_10_std\": -0.18802949109663442,\n        \"nauc_precision_at_1_diff1\": 0.49270414720254924,\n        \"nauc_precision_at_1_max\": 0.2244713219451547,\n        \"nauc_precision_at_1_std\": -0.27988538657714074,\n        \"nauc_precision_at_20_diff1\": 0.20635944393151526,\n        \"nauc_precision_at_20_max\": 0.13210044050169437,\n        \"nauc_precision_at_20_std\": -0.17156740340146884,\n        \"nauc_precision_at_3_diff1\": 0.3224871343651754,\n        \"nauc_precision_at_3_max\": 0.19129830622213678,\n        \"nauc_precision_at_3_std\": -0.26513642202436344,\n        \"nauc_precision_at_5_diff1\": 0.2711364203214068,\n        \"nauc_precision_at_5_max\": 0.21229752056121295,\n        \"nauc_precision_at_5_std\": -0.1969404484233047,\n        \"nauc_recall_at_1000_diff1\": -0.15132967695572191,\n        \"nauc_recall_at_1000_max\": 0.052355064645871356,\n        \"nauc_recall_at_1000_std\": -0.5072703545177019,\n        \"nauc_recall_at_100_diff1\": 0.3325446864488442,\n        \"nauc_recall_at_100_max\": 0.16886679772995214,\n        \"nauc_recall_at_100_std\": -0.12914544330636796,\n        \"nauc_recall_at_10_diff1\": 0.3403494565493065,\n        \"nauc_recall_at_10_max\": 0.20907004765501053,\n        \"nauc_recall_at_10_std\": -0.2031678427789475,\n        \"nauc_recall_at_1_diff1\": 0.513895321278906,\n        \"nauc_recall_at_1_max\": 0.24223000175451737,\n        \"nauc_recall_at_1_std\": -0.24997815873894727,\n        \"nauc_recall_at_20_diff1\": 0.30140955640715916,\n        \"nauc_recall_at_20_max\": 0.169749129114769,\n        \"nauc_recall_at_20_std\": -0.21213574361710996,\n        \"nauc_recall_at_3_diff1\": 0.3971050364106523,\n        \"nauc_recall_at_3_max\": 0.2191021920161193,\n        \"nauc_recall_at_3_std\": -0.2627217888076737,\n        \"nauc_recall_at_5_diff1\": 0.35314778302843997,\n        \"nauc_recall_at_5_max\": 0.23612552135699924,\n        \"nauc_recall_at_5_std\": -0.2105323122479329,\n        \"ndcg_at_1\": 0.25535,\n        \"ndcg_at_10\": 0.30289,\n        \"ndcg_at_100\": 0.39278,\n        \"ndcg_at_1000\": 0.42741,\n        \"ndcg_at_20\": 0.33458,\n        \"ndcg_at_3\": 0.25616,\n        \"ndcg_at_5\": 0.26714,\n        \"precision_at_1\": 0.25535,\n        \"precision_at_10\": 0.08073,\n        \"precision_at_100\": 0.0155,\n        \"precision_at_1000\": 0.00195,\n        \"precision_at_20\": 0.05122,\n        \"precision_at_3\": 0.16871,\n        \"precision_at_5\": 0.12416,\n        \"recall_at_1\": 0.1449,\n        \"recall_at_10\": 0.38914,\n        \"recall_at_100\": 0.75882,\n        \"recall_at_1000\": 0.9949,\n        \"recall_at_20\": 0.49281,\n        \"recall_at_3\": 0.24873,\n        \"recall_at_5\": 0.29348\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.33516,\n        \"map_at_1\": 0.17789,\n        \"map_at_10\": 0.28585,\n        \"map_at_100\": 0.30276,\n        \"map_at_1000\": 0.30426,\n        \"map_at_20\": 0.29411,\n        \"map_at_3\": 0.25084,\n        \"map_at_5\": 0.27188,\n        \"mrr_at_1\": 0.254071661237785,\n        \"mrr_at_10\": 0.32666873481205716,\n        \"mrr_at_100\": 0.33855970002567226,\n        \"mrr_at_1000\": 0.339450666533862,\n        \"mrr_at_20\": 0.33222574515850084,\n        \"mrr_at_3\": 0.3023887079261674,\n        \"mrr_at_5\": 0.3162323561346363,\n        \"nauc_map_at_1000_diff1\": 0.3623821109817951,\n        \"nauc_map_at_1000_max\": 0.12124235930285585,\n        \"nauc_map_at_1000_std\": -0.27078210981271805,\n        \"nauc_map_at_100_diff1\": 0.36182945188768245,\n        \"nauc_map_at_100_max\": 0.12160822725357565,\n        \"nauc_map_at_100_std\": -0.269756265087917,\n        \"nauc_map_at_10_diff1\": 0.3594531472106089,\n        \"nauc_map_at_10_max\": 0.11644267913960468,\n        \"nauc_map_at_10_std\": -0.27938863769114985,\n        \"nauc_map_at_1_diff1\": 0.47650799669579064,\n        \"nauc_map_at_1_max\": 0.11520993165177627,\n        \"nauc_map_at_1_std\": -0.23923864658257737,\n        \"nauc_map_at_20_diff1\": 0.3614517084900315,\n        \"nauc_map_at_20_max\": 0.11809940522998419,\n        \"nauc_map_at_20_std\": -0.2790814301699091,\n        \"nauc_map_at_3_diff1\": 0.3935368289346951,\n        \"nauc_map_at_3_max\": 0.14310777366199712,\n        \"nauc_map_at_3_std\": -0.254047650022876,\n        \"nauc_map_at_5_diff1\": 0.3669713374981257,\n        \"nauc_map_at_5_max\": 0.12493130042571256,\n        \"nauc_map_at_5_std\": -0.2736289409957187,\n        \"nauc_mrr_at_1000_diff1\": 0.4014125402711222,\n        \"nauc_mrr_at_1000_max\": 0.1173756168405756,\n        \"nauc_mrr_at_1000_std\": -0.2759369390780343,\n        \"nauc_mrr_at_100_diff1\": 0.40111268807211997,\n        \"nauc_mrr_at_100_max\": 0.1176174391512065,\n        \"nauc_mrr_at_100_std\": -0.2751301876429702,\n        \"nauc_mrr_at_10_diff1\": 0.39855921326635346,\n        \"nauc_mrr_at_10_max\": 0.11145313304840819,\n        \"nauc_mrr_at_10_std\": -0.28540293545438655,\n        \"nauc_mrr_at_1_diff1\": 0.44667188955821263,\n        \"nauc_mrr_at_1_max\": 0.13775938038737565,\n        \"nauc_mrr_at_1_std\": -0.27021454271667966,\n        \"nauc_mrr_at_20_diff1\": 0.40045821059527936,\n        \"nauc_mrr_at_20_max\": 0.1151818052623516,\n        \"nauc_mrr_at_20_std\": -0.2816545399445711,\n        \"nauc_mrr_at_3_diff1\": 0.41784923702028376,\n        \"nauc_mrr_at_3_max\": 0.12978561892786436,\n        \"nauc_mrr_at_3_std\": -0.27246689193165147,\n        \"nauc_mrr_at_5_diff1\": 0.4040329598691815,\n        \"nauc_mrr_at_5_max\": 0.11773389677352912,\n        \"nauc_mrr_at_5_std\": -0.28203728671218703,\n        \"nauc_ndcg_at_1000_diff1\": 0.35829385829679256,\n        \"nauc_ndcg_at_1000_max\": 0.12048030635559533,\n        \"nauc_ndcg_at_1000_std\": -0.2575176498408982,\n        \"nauc_ndcg_at_100_diff1\": 0.34480447134518943,\n        \"nauc_ndcg_at_100_max\": 0.12848699770624952,\n        \"nauc_ndcg_at_100_std\": -0.23286213613495696,\n        \"nauc_ndcg_at_10_diff1\": 0.3397951173008745,\n        \"nauc_ndcg_at_10_max\": 0.0956984587173686,\n        \"nauc_ndcg_at_10_std\": -0.29463308607168387,\n        \"nauc_ndcg_at_1_diff1\": 0.44667188955821263,\n        \"nauc_ndcg_at_1_max\": 0.13775938038737565,\n        \"nauc_ndcg_at_1_std\": -0.27021454271667966,\n        \"nauc_ndcg_at_20_diff1\": 0.34546092462422556,\n        \"nauc_ndcg_at_20_max\": 0.103825487525219,\n        \"nauc_ndcg_at_20_std\": -0.287831046285804,\n        \"nauc_ndcg_at_3_diff1\": 0.3870074552696127,\n        \"nauc_ndcg_at_3_max\": 0.13717840697473688,\n        \"nauc_ndcg_at_3_std\": -0.2623881440202472,\n        \"nauc_ndcg_at_5_diff1\": 0.3533032866263907,\n        \"nauc_ndcg_at_5_max\": 0.11164256923018963,\n        \"nauc_ndcg_at_5_std\": -0.28502533536678604,\n        \"nauc_precision_at_1000_diff1\": -0.028850941984775703,\n        \"nauc_precision_at_1000_max\": 0.0731224248272666,\n        \"nauc_precision_at_1000_std\": 0.06700364217691929,\n        \"nauc_precision_at_100_diff1\": 0.018052177318166485,\n        \"nauc_precision_at_100_max\": 0.1290489006189328,\n        \"nauc_precision_at_100_std\": 0.06644339107714407,\n        \"nauc_precision_at_10_diff1\": 0.13866559995100966,\n        \"nauc_precision_at_10_max\": 0.049346880181758535,\n        \"nauc_precision_at_10_std\": -0.2830185639913429,\n        \"nauc_precision_at_1_diff1\": 0.44667188955821263,\n        \"nauc_precision_at_1_max\": 0.13775938038737565,\n        \"nauc_precision_at_1_std\": -0.27021454271667966,\n        \"nauc_precision_at_20_diff1\": 0.13138509701167267,\n        \"nauc_precision_at_20_max\": 0.05433073350201369,\n        \"nauc_precision_at_20_std\": -0.23818889843069824,\n        \"nauc_precision_at_3_diff1\": 0.26170965851451644,\n        \"nauc_precision_at_3_max\": 0.15716134103441157,\n        \"nauc_precision_at_3_std\": -0.2536287576129388,\n        \"nauc_precision_at_5_diff1\": 0.1852260129744341,\n        \"nauc_precision_at_5_max\": 0.09553256875989112,\n        \"nauc_precision_at_5_std\": -0.2854262606252807,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.1918191910367033,\n        \"nauc_recall_at_100_max\": 0.19270042996351033,\n        \"nauc_recall_at_100_std\": 0.027761018698510682,\n        \"nauc_recall_at_10_diff1\": 0.24171434563777844,\n        \"nauc_recall_at_10_max\": 0.03862247472832488,\n        \"nauc_recall_at_10_std\": -0.31189302591786877,\n        \"nauc_recall_at_1_diff1\": 0.47650799669579064,\n        \"nauc_recall_at_1_max\": 0.11520993165177627,\n        \"nauc_recall_at_1_std\": -0.23923864658257737,\n        \"nauc_recall_at_20_diff1\": 0.2499910733233376,\n        \"nauc_recall_at_20_max\": 0.06571614435108895,\n        \"nauc_recall_at_20_std\": -0.2827481665049045,\n        \"nauc_recall_at_3_diff1\": 0.3514230751546961,\n        \"nauc_recall_at_3_max\": 0.1405771234647246,\n        \"nauc_recall_at_3_std\": -0.24502339482009927,\n        \"nauc_recall_at_5_diff1\": 0.27781283077300545,\n        \"nauc_recall_at_5_max\": 0.07995060250278149,\n        \"nauc_recall_at_5_std\": -0.293485935538119,\n        \"ndcg_at_1\": 0.25407,\n        \"ndcg_at_10\": 0.33516,\n        \"ndcg_at_100\": 0.41319,\n        \"ndcg_at_1000\": 0.44511,\n        \"ndcg_at_20\": 0.35931,\n        \"ndcg_at_3\": 0.27928,\n        \"ndcg_at_5\": 0.30723,\n        \"precision_at_1\": 0.25407,\n        \"precision_at_10\": 0.07248,\n        \"precision_at_100\": 0.01322,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.04357,\n        \"precision_at_3\": 0.15635,\n        \"precision_at_5\": 0.11694,\n        \"recall_at_1\": 0.17789,\n        \"recall_at_10\": 0.43783,\n        \"recall_at_100\": 0.7735,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.51961,\n        \"recall_at_3\": 0.2982,\n        \"recall_at_5\": 0.36346\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/e5-mistral-7b-instruct/intfloat__e5-mistral-7b-instruct/07163b72af1488142a360786df853f237b1a3ca1/model_meta.json",
    "content": "{\"name\": \"intfloat/e5-mistral-7b-instruct\", \"revision\": \"07163b72af1488142a360786df853f237b1a3ca1\", \"release_date\": \"2024-02-08\", \"languages\": [\"eng_Latn\", \"fra_Latn\", \"deu_Latn\", \"ita_Latn\", \"spa_Latn\"], \"n_parameters\": 7111000000, \"memory_usage\": null, \"max_tokens\": 32768, \"embed_dim\": 4096, \"license\": \"mit\", \"open_weights\": true, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"GritLM\", \"PyTorch\"], \"reference\": \"https://huggingface.co/intfloat/e5-mistral-7b-instruct\", \"similarity_fn_name\": \"cosine\", \"use_instructions\": true, \"zero_shot_benchmarks\": null, \"loader\": \"instruct_wrapper\"}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-base/intfloat__multilingual-e5-base/d13f1b27baf31030b7fd040960d60d909913633f/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 12.844457387924194,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.79752,\n        \"map_at_1\": 0.64035,\n        \"map_at_10\": 0.74901,\n        \"map_at_100\": 0.75181,\n        \"map_at_1000\": 0.75189,\n        \"map_at_20\": 0.75103,\n        \"map_at_3\": 0.72222,\n        \"map_at_5\": 0.74196,\n        \"mrr_at_1\": 0.6403508771929824,\n        \"mrr_at_10\": 0.7490079365079366,\n        \"mrr_at_100\": 0.751808506456676,\n        \"mrr_at_1000\": 0.751886827258681,\n        \"mrr_at_20\": 0.7510283941204995,\n        \"mrr_at_3\": 0.7222222222222223,\n        \"mrr_at_5\": 0.7419590643274855,\n        \"nauc_map_at_1000_diff1\": 0.6723356332353837,\n        \"nauc_map_at_1000_max\": 0.27297805472316405,\n        \"nauc_map_at_1000_std\": -0.5726423683151028,\n        \"nauc_map_at_100_diff1\": 0.6722918045747075,\n        \"nauc_map_at_100_max\": 0.27314558762940006,\n        \"nauc_map_at_100_std\": -0.5730836867712397,\n        \"nauc_map_at_10_diff1\": 0.6658237829761234,\n        \"nauc_map_at_10_max\": 0.27610706400977403,\n        \"nauc_map_at_10_std\": -0.5733871417301553,\n        \"nauc_map_at_1_diff1\": 0.7112013453493657,\n        \"nauc_map_at_1_max\": 0.23271019903304435,\n        \"nauc_map_at_1_std\": -0.5640115753195888,\n        \"nauc_map_at_20_diff1\": 0.6702570196763116,\n        \"nauc_map_at_20_max\": 0.2741873392047378,\n        \"nauc_map_at_20_std\": -0.5717522349353029,\n        \"nauc_map_at_3_diff1\": 0.6752697621006652,\n        \"nauc_map_at_3_max\": 0.2570892542281406,\n        \"nauc_map_at_3_std\": -0.571317005989482,\n        \"nauc_map_at_5_diff1\": 0.6691055922420671,\n        \"nauc_map_at_5_max\": 0.28519256115613123,\n        \"nauc_map_at_5_std\": -0.5682331833213823,\n        \"nauc_mrr_at_1000_diff1\": 0.6723356332353837,\n        \"nauc_mrr_at_1000_max\": 0.27297805472316405,\n        \"nauc_mrr_at_1000_std\": -0.5726423683151028,\n        \"nauc_mrr_at_100_diff1\": 0.6722918045747075,\n        \"nauc_mrr_at_100_max\": 0.27314558762940006,\n        \"nauc_mrr_at_100_std\": -0.5730836867712397,\n        \"nauc_mrr_at_10_diff1\": 0.6658237829761234,\n        \"nauc_mrr_at_10_max\": 0.27610706400977403,\n        \"nauc_mrr_at_10_std\": -0.5733871417301553,\n        \"nauc_mrr_at_1_diff1\": 0.7112013453493657,\n        \"nauc_mrr_at_1_max\": 0.23271019903304435,\n        \"nauc_mrr_at_1_std\": -0.5640115753195888,\n        \"nauc_mrr_at_20_diff1\": 0.6702570196763116,\n        \"nauc_mrr_at_20_max\": 0.2741873392047378,\n        \"nauc_mrr_at_20_std\": -0.5717522349353029,\n        \"nauc_mrr_at_3_diff1\": 0.6752697621006652,\n        \"nauc_mrr_at_3_max\": 0.2570892542281406,\n        \"nauc_mrr_at_3_std\": -0.571317005989482,\n        \"nauc_mrr_at_5_diff1\": 0.6691055922420671,\n        \"nauc_mrr_at_5_max\": 0.28519256115613123,\n        \"nauc_mrr_at_5_std\": -0.5682331833213823,\n        \"nauc_ndcg_at_1000_diff1\": 0.6653614414214758,\n        \"nauc_ndcg_at_1000_max\": 0.2807112227353227,\n        \"nauc_ndcg_at_1000_std\": -0.5781138597877794,\n        \"nauc_ndcg_at_100_diff1\": 0.6644906484817493,\n        \"nauc_ndcg_at_100_max\": 0.2841887894561054,\n        \"nauc_ndcg_at_100_std\": -0.5873918400849422,\n        \"nauc_ndcg_at_10_diff1\": 0.6353600181941691,\n        \"nauc_ndcg_at_10_max\": 0.29752591673557843,\n        \"nauc_ndcg_at_10_std\": -0.5863892017597498,\n        \"nauc_ndcg_at_1_diff1\": 0.7112013453493657,\n        \"nauc_ndcg_at_1_max\": 0.23271019903304435,\n        \"nauc_ndcg_at_1_std\": -0.5640115753195888,\n        \"nauc_ndcg_at_20_diff1\": 0.651997768652368,\n        \"nauc_ndcg_at_20_max\": 0.29042238107218876,\n        \"nauc_ndcg_at_20_std\": -0.5788922792970898,\n        \"nauc_ndcg_at_3_diff1\": 0.6616914652317964,\n        \"nauc_ndcg_at_3_max\": 0.26336568473785094,\n        \"nauc_ndcg_at_3_std\": -0.5769159630372578,\n        \"nauc_ndcg_at_5_diff1\": 0.647354445410905,\n        \"nauc_ndcg_at_5_max\": 0.3201079312415651,\n        \"nauc_ndcg_at_5_std\": -0.5716641026307666,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 0.554759603617449,\n        \"nauc_precision_at_100_max\": 0.7224066624409552,\n        \"nauc_precision_at_100_std\": -1.7565359911142433,\n        \"nauc_precision_at_10_diff1\": 0.25703130513687805,\n        \"nauc_precision_at_10_max\": 0.5385542979657244,\n        \"nauc_precision_at_10_std\": -0.7577965278796114,\n        \"nauc_precision_at_1_diff1\": 0.7112013453493657,\n        \"nauc_precision_at_1_max\": 0.23271019903304435,\n        \"nauc_precision_at_1_std\": -0.5640115753195888,\n        \"nauc_precision_at_20_diff1\": 0.2664089692459977,\n        \"nauc_precision_at_20_max\": 0.6106419565585748,\n        \"nauc_precision_at_20_std\": -0.7326974857052104,\n        \"nauc_precision_at_3_diff1\": 0.6085926375473378,\n        \"nauc_precision_at_3_max\": 0.28660305534992264,\n        \"nauc_precision_at_3_std\": -0.6000744749701165,\n        \"nauc_precision_at_5_diff1\": 0.5125707346224895,\n        \"nauc_precision_at_5_max\": 0.5433636522514341,\n        \"nauc_precision_at_5_std\": -0.5930010397419233,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.5547596036174103,\n        \"nauc_recall_at_100_max\": 0.7224066624409369,\n        \"nauc_recall_at_100_std\": -1.756535991114336,\n        \"nauc_recall_at_10_diff1\": 0.25703130513688316,\n        \"nauc_recall_at_10_max\": 0.5385542979657265,\n        \"nauc_recall_at_10_std\": -0.7577965278796062,\n        \"nauc_recall_at_1_diff1\": 0.7112013453493657,\n        \"nauc_recall_at_1_max\": 0.23271019903304435,\n        \"nauc_recall_at_1_std\": -0.5640115753195888,\n        \"nauc_recall_at_20_diff1\": 0.26640896924600216,\n        \"nauc_recall_at_20_max\": 0.6106419565585729,\n        \"nauc_recall_at_20_std\": -0.7326974857051948,\n        \"nauc_recall_at_3_diff1\": 0.6085926375473392,\n        \"nauc_recall_at_3_max\": 0.2866030553499234,\n        \"nauc_recall_at_3_std\": -0.6000744749701153,\n        \"nauc_recall_at_5_diff1\": 0.5125707346224897,\n        \"nauc_recall_at_5_max\": 0.5433636522514345,\n        \"nauc_recall_at_5_std\": -0.5930010397419251,\n        \"ndcg_at_1\": 0.64035,\n        \"ndcg_at_10\": 0.79752,\n        \"ndcg_at_100\": 0.80827,\n        \"ndcg_at_1000\": 0.80956,\n        \"ndcg_at_20\": 0.80442,\n        \"ndcg_at_3\": 0.74645,\n        \"ndcg_at_5\": 0.78045,\n        \"precision_at_1\": 0.64035,\n        \"precision_at_10\": 0.09474,\n        \"precision_at_100\": 0.00991,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04868,\n        \"precision_at_3\": 0.27193,\n        \"precision_at_5\": 0.17895,\n        \"recall_at_1\": 0.64035,\n        \"recall_at_10\": 0.94737,\n        \"recall_at_100\": 0.99123,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.97368,\n        \"recall_at_3\": 0.81579,\n        \"recall_at_5\": 0.89474\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-base/intfloat__multilingual-e5-base/d13f1b27baf31030b7fd040960d60d909913633f/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 22.750174522399902,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.92868,\n        \"map_at_1\": 0.87778,\n        \"map_at_10\": 0.9138,\n        \"map_at_100\": 0.91467,\n        \"map_at_1000\": 0.91469,\n        \"map_at_20\": 0.91439,\n        \"map_at_3\": 0.90944,\n        \"map_at_5\": 0.91133,\n        \"mrr_at_1\": 0.8777777777777778,\n        \"mrr_at_10\": 0.9137985008818343,\n        \"mrr_at_100\": 0.9146685714948152,\n        \"mrr_at_1000\": 0.9146886305512084,\n        \"mrr_at_20\": 0.9143924634494812,\n        \"mrr_at_3\": 0.9094444444444447,\n        \"mrr_at_5\": 0.9113333333333336,\n        \"nauc_map_at_1000_diff1\": 0.9175700238097899,\n        \"nauc_map_at_1000_max\": 0.8209359588621885,\n        \"nauc_map_at_1000_std\": 0.14758622633517648,\n        \"nauc_map_at_100_diff1\": 0.9175628238240089,\n        \"nauc_map_at_100_max\": 0.8209388488088828,\n        \"nauc_map_at_100_std\": 0.14768093837442417,\n        \"nauc_map_at_10_diff1\": 0.9173620069052005,\n        \"nauc_map_at_10_max\": 0.8217179762219908,\n        \"nauc_map_at_10_std\": 0.14776156586300634,\n        \"nauc_map_at_1_diff1\": 0.9215546474219641,\n        \"nauc_map_at_1_max\": 0.799260933831841,\n        \"nauc_map_at_1_std\": 0.11366837666289938,\n        \"nauc_map_at_20_diff1\": 0.9174648784829924,\n        \"nauc_map_at_20_max\": 0.8212567907630953,\n        \"nauc_map_at_20_std\": 0.1480711029323691,\n        \"nauc_map_at_3_diff1\": 0.9191364960344942,\n        \"nauc_map_at_3_max\": 0.8260591982830046,\n        \"nauc_map_at_3_std\": 0.15475753853438384,\n        \"nauc_map_at_5_diff1\": 0.9182178325391143,\n        \"nauc_map_at_5_max\": 0.8243424595178229,\n        \"nauc_map_at_5_std\": 0.15253983585873487,\n        \"nauc_mrr_at_1000_diff1\": 0.9175700238097899,\n        \"nauc_mrr_at_1000_max\": 0.8209359588621885,\n        \"nauc_mrr_at_1000_std\": 0.14758622633517648,\n        \"nauc_mrr_at_100_diff1\": 0.9175628238240089,\n        \"nauc_mrr_at_100_max\": 0.8209388488088828,\n        \"nauc_mrr_at_100_std\": 0.14768093837442417,\n        \"nauc_mrr_at_10_diff1\": 0.9173620069052005,\n        \"nauc_mrr_at_10_max\": 0.8217179762219908,\n        \"nauc_mrr_at_10_std\": 0.14776156586300634,\n        \"nauc_mrr_at_1_diff1\": 0.9215546474219641,\n        \"nauc_mrr_at_1_max\": 0.799260933831841,\n        \"nauc_mrr_at_1_std\": 0.11366837666289938,\n        \"nauc_mrr_at_20_diff1\": 0.9174648784829924,\n        \"nauc_mrr_at_20_max\": 0.8212567907630953,\n        \"nauc_mrr_at_20_std\": 0.1480711029323691,\n        \"nauc_mrr_at_3_diff1\": 0.9191364960344942,\n        \"nauc_mrr_at_3_max\": 0.8260591982830046,\n        \"nauc_mrr_at_3_std\": 0.15475753853438384,\n        \"nauc_mrr_at_5_diff1\": 0.9182178325391143,\n        \"nauc_mrr_at_5_max\": 0.8243424595178229,\n        \"nauc_mrr_at_5_std\": 0.15253983585873487,\n        \"nauc_ndcg_at_1000_diff1\": 0.9167576396553385,\n        \"nauc_ndcg_at_1000_max\": 0.824184031484245,\n        \"nauc_ndcg_at_1000_std\": 0.15512298069474917,\n        \"nauc_ndcg_at_100_diff1\": 0.9167224172494681,\n        \"nauc_ndcg_at_100_max\": 0.8247226421327326,\n        \"nauc_ndcg_at_100_std\": 0.16028099913529092,\n        \"nauc_ndcg_at_10_diff1\": 0.9150957154475938,\n        \"nauc_ndcg_at_10_max\": 0.8289509732231671,\n        \"nauc_ndcg_at_10_std\": 0.1596542610882336,\n        \"nauc_ndcg_at_1_diff1\": 0.9215546474219641,\n        \"nauc_ndcg_at_1_max\": 0.799260933831841,\n        \"nauc_ndcg_at_1_std\": 0.11366837666289938,\n        \"nauc_ndcg_at_20_diff1\": 0.9154318158435176,\n        \"nauc_ndcg_at_20_max\": 0.82716744742434,\n        \"nauc_ndcg_at_20_std\": 0.16310395329427177,\n        \"nauc_ndcg_at_3_diff1\": 0.9190673661119936,\n        \"nauc_ndcg_at_3_max\": 0.8379775133293821,\n        \"nauc_ndcg_at_3_std\": 0.17381112073015367,\n        \"nauc_ndcg_at_5_diff1\": 0.9172056481173958,\n        \"nauc_ndcg_at_5_max\": 0.8350861313142242,\n        \"nauc_ndcg_at_5_std\": 0.16991899186101822,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9183006535947483,\n        \"nauc_precision_at_100_max\": 0.884687208216607,\n        \"nauc_precision_at_100_std\": 0.6765639589169249,\n        \"nauc_precision_at_10_diff1\": 0.8925222262818151,\n        \"nauc_precision_at_10_max\": 0.8906954085982189,\n        \"nauc_precision_at_10_std\": 0.2649697560183486,\n        \"nauc_precision_at_1_diff1\": 0.9215546474219641,\n        \"nauc_precision_at_1_max\": 0.799260933831841,\n        \"nauc_precision_at_1_std\": 0.11366837666289938,\n        \"nauc_precision_at_20_diff1\": 0.8873716153127876,\n        \"nauc_precision_at_20_max\": 0.8911647992530264,\n        \"nauc_precision_at_20_std\": 0.37704248366012,\n        \"nauc_precision_at_3_diff1\": 0.9192442934620643,\n        \"nauc_precision_at_3_max\": 0.8962492798537904,\n        \"nauc_precision_at_3_std\": 0.26736794008383474,\n        \"nauc_precision_at_5_diff1\": 0.911647992530343,\n        \"nauc_precision_at_5_max\": 0.8948412698412691,\n        \"nauc_precision_at_5_std\": 0.26683006535947623,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9183006535947761,\n        \"nauc_recall_at_100_max\": 0.8846872082166294,\n        \"nauc_recall_at_100_std\": 0.6765639589169213,\n        \"nauc_recall_at_10_diff1\": 0.8925222262818165,\n        \"nauc_recall_at_10_max\": 0.8906954085982204,\n        \"nauc_recall_at_10_std\": 0.2649697560183457,\n        \"nauc_recall_at_1_diff1\": 0.9215546474219641,\n        \"nauc_recall_at_1_max\": 0.799260933831841,\n        \"nauc_recall_at_1_std\": 0.11366837666289938,\n        \"nauc_recall_at_20_diff1\": 0.8873716153127925,\n        \"nauc_recall_at_20_max\": 0.891164799253035,\n        \"nauc_recall_at_20_std\": 0.3770424836601331,\n        \"nauc_recall_at_3_diff1\": 0.9192442934620657,\n        \"nauc_recall_at_3_max\": 0.8962492798537856,\n        \"nauc_recall_at_3_std\": 0.2673679400838344,\n        \"nauc_recall_at_5_diff1\": 0.9116479925303471,\n        \"nauc_recall_at_5_max\": 0.8948412698412709,\n        \"nauc_recall_at_5_std\": 0.26683006535947723,\n        \"ndcg_at_1\": 0.87778,\n        \"ndcg_at_10\": 0.92868,\n        \"ndcg_at_100\": 0.93292,\n        \"ndcg_at_1000\": 0.9336,\n        \"ndcg_at_20\": 0.93071,\n        \"ndcg_at_3\": 0.91932,\n        \"ndcg_at_5\": 0.92263,\n        \"precision_at_1\": 0.87778,\n        \"precision_at_10\": 0.09744,\n        \"precision_at_100\": 0.00994,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04911,\n        \"precision_at_3\": 0.31593,\n        \"precision_at_5\": 0.19111,\n        \"recall_at_1\": 0.87778,\n        \"recall_at_10\": 0.97444,\n        \"recall_at_100\": 0.99444,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98222,\n        \"recall_at_3\": 0.94778,\n        \"recall_at_5\": 0.95556\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.82283,\n        \"map_at_1\": 0.72667,\n        \"map_at_10\": 0.79085,\n        \"map_at_100\": 0.79349,\n        \"map_at_1000\": 0.79354,\n        \"map_at_20\": 0.79205,\n        \"map_at_3\": 0.77481,\n        \"map_at_5\": 0.78537,\n        \"mrr_at_1\": 0.7266666666666667,\n        \"mrr_at_10\": 0.7908456790123461,\n        \"mrr_at_100\": 0.7934928056608854,\n        \"mrr_at_1000\": 0.793538990477385,\n        \"mrr_at_20\": 0.7920526847879792,\n        \"mrr_at_3\": 0.774814814814815,\n        \"mrr_at_5\": 0.7853703703703707,\n        \"nauc_map_at_1000_diff1\": 0.8234897859527498,\n        \"nauc_map_at_1000_max\": 0.5617154161554866,\n        \"nauc_map_at_1000_std\": 0.1527782088522249,\n        \"nauc_map_at_100_diff1\": 0.8234845751578477,\n        \"nauc_map_at_100_max\": 0.5616623686340935,\n        \"nauc_map_at_100_std\": 0.15295319052202627,\n        \"nauc_map_at_10_diff1\": 0.8217154451358325,\n        \"nauc_map_at_10_max\": 0.5608609888078221,\n        \"nauc_map_at_10_std\": 0.15473708791377086,\n        \"nauc_map_at_1_diff1\": 0.8438314931821422,\n        \"nauc_map_at_1_max\": 0.560422261720963,\n        \"nauc_map_at_1_std\": 0.12586115183517807,\n        \"nauc_map_at_20_diff1\": 0.8227647973076403,\n        \"nauc_map_at_20_max\": 0.5619696743995988,\n        \"nauc_map_at_20_std\": 0.15390905856653878,\n        \"nauc_map_at_3_diff1\": 0.8260187927862362,\n        \"nauc_map_at_3_max\": 0.5660999527289668,\n        \"nauc_map_at_3_std\": 0.1494942169502371,\n        \"nauc_map_at_5_diff1\": 0.8215064787749222,\n        \"nauc_map_at_5_max\": 0.561880380615228,\n        \"nauc_map_at_5_std\": 0.14899699856383378,\n        \"nauc_mrr_at_1000_diff1\": 0.8234897859527498,\n        \"nauc_mrr_at_1000_max\": 0.5617154161554866,\n        \"nauc_mrr_at_1000_std\": 0.1527782088522249,\n        \"nauc_mrr_at_100_diff1\": 0.8234845751578477,\n        \"nauc_mrr_at_100_max\": 0.5616623686340935,\n        \"nauc_mrr_at_100_std\": 0.15295319052202627,\n        \"nauc_mrr_at_10_diff1\": 0.8217154451358325,\n        \"nauc_mrr_at_10_max\": 0.5608609888078221,\n        \"nauc_mrr_at_10_std\": 0.15473708791377086,\n        \"nauc_mrr_at_1_diff1\": 0.8438314931821422,\n        \"nauc_mrr_at_1_max\": 0.560422261720963,\n        \"nauc_mrr_at_1_std\": 0.12586115183517807,\n        \"nauc_mrr_at_20_diff1\": 0.8227647973076403,\n        \"nauc_mrr_at_20_max\": 0.5619696743995988,\n        \"nauc_mrr_at_20_std\": 0.15390905856653878,\n        \"nauc_mrr_at_3_diff1\": 0.8260187927862362,\n        \"nauc_mrr_at_3_max\": 0.5660999527289668,\n        \"nauc_mrr_at_3_std\": 0.1494942169502371,\n        \"nauc_mrr_at_5_diff1\": 0.8215064787749222,\n        \"nauc_mrr_at_5_max\": 0.561880380615228,\n        \"nauc_mrr_at_5_std\": 0.14899699856383378,\n        \"nauc_ndcg_at_1000_diff1\": 0.8197499082937609,\n        \"nauc_ndcg_at_1000_max\": 0.5606664898880551,\n        \"nauc_ndcg_at_1000_std\": 0.15969401918873752,\n        \"nauc_ndcg_at_100_diff1\": 0.8195860199960943,\n        \"nauc_ndcg_at_100_max\": 0.5588226115554171,\n        \"nauc_ndcg_at_100_std\": 0.16480730316388906,\n        \"nauc_ndcg_at_10_diff1\": 0.8101250409144324,\n        \"nauc_ndcg_at_10_max\": 0.5567023121807358,\n        \"nauc_ndcg_at_10_std\": 0.17417787453234748,\n        \"nauc_ndcg_at_1_diff1\": 0.8438314931821422,\n        \"nauc_ndcg_at_1_max\": 0.560422261720963,\n        \"nauc_ndcg_at_1_std\": 0.12586115183517807,\n        \"nauc_ndcg_at_20_diff1\": 0.8146190720348256,\n        \"nauc_ndcg_at_20_max\": 0.5624189349413797,\n        \"nauc_ndcg_at_20_std\": 0.17099815701792506,\n        \"nauc_ndcg_at_3_diff1\": 0.8195822806147087,\n        \"nauc_ndcg_at_3_max\": 0.5679585650218014,\n        \"nauc_ndcg_at_3_std\": 0.15628807596368502,\n        \"nauc_ndcg_at_5_diff1\": 0.8095848513111588,\n        \"nauc_ndcg_at_5_max\": 0.5587825702586793,\n        \"nauc_ndcg_at_5_std\": 0.15612029203237102,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.7980859010270617,\n        \"nauc_precision_at_100_max\": 0.3151260504201801,\n        \"nauc_precision_at_100_std\": 0.8045634920635055,\n        \"nauc_precision_at_10_diff1\": 0.7261735612119219,\n        \"nauc_precision_at_10_max\": 0.5223142397055406,\n        \"nauc_precision_at_10_std\": 0.3301871473226919,\n        \"nauc_precision_at_1_diff1\": 0.8438314931821422,\n        \"nauc_precision_at_1_max\": 0.560422261720963,\n        \"nauc_precision_at_1_std\": 0.12586115183517807,\n        \"nauc_precision_at_20_diff1\": 0.7486443295266831,\n        \"nauc_precision_at_20_max\": 0.5787096890038043,\n        \"nauc_precision_at_20_std\": 0.34637829490770417,\n        \"nauc_precision_at_3_diff1\": 0.7956186663829573,\n        \"nauc_precision_at_3_max\": 0.5747965263185904,\n        \"nauc_precision_at_3_std\": 0.18084222145384055,\n        \"nauc_precision_at_5_diff1\": 0.7492946102834129,\n        \"nauc_precision_at_5_max\": 0.5403959168269141,\n        \"nauc_precision_at_5_std\": 0.18949822978631403,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.7980859010270872,\n        \"nauc_recall_at_100_max\": 0.31512605042016767,\n        \"nauc_recall_at_100_std\": 0.8045634920634981,\n        \"nauc_recall_at_10_diff1\": 0.7261735612119232,\n        \"nauc_recall_at_10_max\": 0.5223142397055422,\n        \"nauc_recall_at_10_std\": 0.330187147322698,\n        \"nauc_recall_at_1_diff1\": 0.8438314931821422,\n        \"nauc_recall_at_1_max\": 0.560422261720963,\n        \"nauc_recall_at_1_std\": 0.12586115183517807,\n        \"nauc_recall_at_20_diff1\": 0.7486443295266847,\n        \"nauc_recall_at_20_max\": 0.5787096890038078,\n        \"nauc_recall_at_20_std\": 0.3463782949077075,\n        \"nauc_recall_at_3_diff1\": 0.7956186663829558,\n        \"nauc_recall_at_3_max\": 0.5747965263185886,\n        \"nauc_recall_at_3_std\": 0.18084222145383833,\n        \"nauc_recall_at_5_diff1\": 0.7492946102834147,\n        \"nauc_recall_at_5_max\": 0.5403959168269155,\n        \"nauc_recall_at_5_std\": 0.18949822978631597,\n        \"ndcg_at_1\": 0.72667,\n        \"ndcg_at_10\": 0.82283,\n        \"ndcg_at_100\": 0.83689,\n        \"ndcg_at_1000\": 0.83805,\n        \"ndcg_at_20\": 0.82747,\n        \"ndcg_at_3\": 0.79042,\n        \"ndcg_at_5\": 0.80955,\n        \"precision_at_1\": 0.72667,\n        \"precision_at_10\": 0.09233,\n        \"precision_at_100\": 0.00991,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04711,\n        \"precision_at_3\": 0.27852,\n        \"precision_at_5\": 0.17644,\n        \"recall_at_1\": 0.72667,\n        \"recall_at_10\": 0.92333,\n        \"recall_at_100\": 0.99111,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.94222,\n        \"recall_at_3\": 0.83556,\n        \"recall_at_5\": 0.88222\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.77524,\n        \"map_at_1\": 0.66444,\n        \"map_at_10\": 0.73824,\n        \"map_at_100\": 0.74246,\n        \"map_at_1000\": 0.74254,\n        \"map_at_20\": 0.74128,\n        \"map_at_3\": 0.71907,\n        \"map_at_5\": 0.73046,\n        \"mrr_at_1\": 0.6644444444444444,\n        \"mrr_at_10\": 0.7382402998236333,\n        \"mrr_at_100\": 0.7424622167121282,\n        \"mrr_at_1000\": 0.7425399479231359,\n        \"mrr_at_20\": 0.7412782930338401,\n        \"mrr_at_3\": 0.7190740740740743,\n        \"mrr_at_5\": 0.7304629629629632,\n        \"nauc_map_at_1000_diff1\": 0.7899720871622794,\n        \"nauc_map_at_1000_max\": 0.636679580496758,\n        \"nauc_map_at_1000_std\": 0.20278639246259875,\n        \"nauc_map_at_100_diff1\": 0.7899691659530444,\n        \"nauc_map_at_100_max\": 0.6367077990429704,\n        \"nauc_map_at_100_std\": 0.20293440007437535,\n        \"nauc_map_at_10_diff1\": 0.7880583637680022,\n        \"nauc_map_at_10_max\": 0.6359172299707678,\n        \"nauc_map_at_10_std\": 0.20454031162914182,\n        \"nauc_map_at_1_diff1\": 0.8195281021775603,\n        \"nauc_map_at_1_max\": 0.6255213235759166,\n        \"nauc_map_at_1_std\": 0.16194235584310274,\n        \"nauc_map_at_20_diff1\": 0.7896294447842023,\n        \"nauc_map_at_20_max\": 0.6373774697210272,\n        \"nauc_map_at_20_std\": 0.20461194000085434,\n        \"nauc_map_at_3_diff1\": 0.786610187688215,\n        \"nauc_map_at_3_max\": 0.6360744018755625,\n        \"nauc_map_at_3_std\": 0.19083591004405367,\n        \"nauc_map_at_5_diff1\": 0.7877762737592369,\n        \"nauc_map_at_5_max\": 0.6363189564576122,\n        \"nauc_map_at_5_std\": 0.19808412603436282,\n        \"nauc_mrr_at_1000_diff1\": 0.7899720871622794,\n        \"nauc_mrr_at_1000_max\": 0.636679580496758,\n        \"nauc_mrr_at_1000_std\": 0.20278639246259875,\n        \"nauc_mrr_at_100_diff1\": 0.7899691659530444,\n        \"nauc_mrr_at_100_max\": 0.6367077990429704,\n        \"nauc_mrr_at_100_std\": 0.20293440007437535,\n        \"nauc_mrr_at_10_diff1\": 0.7880583637680022,\n        \"nauc_mrr_at_10_max\": 0.6359172299707678,\n        \"nauc_mrr_at_10_std\": 0.20454031162914182,\n        \"nauc_mrr_at_1_diff1\": 0.8195281021775603,\n        \"nauc_mrr_at_1_max\": 0.6255213235759166,\n        \"nauc_mrr_at_1_std\": 0.16194235584310274,\n        \"nauc_mrr_at_20_diff1\": 0.7896294447842023,\n        \"nauc_mrr_at_20_max\": 0.6373774697210272,\n        \"nauc_mrr_at_20_std\": 0.20461194000085434,\n        \"nauc_mrr_at_3_diff1\": 0.786610187688215,\n        \"nauc_mrr_at_3_max\": 0.6360744018755625,\n        \"nauc_mrr_at_3_std\": 0.19083591004405367,\n        \"nauc_mrr_at_5_diff1\": 0.7877762737592369,\n        \"nauc_mrr_at_5_max\": 0.6363189564576122,\n        \"nauc_mrr_at_5_std\": 0.19808412603436282,\n        \"nauc_ndcg_at_1000_diff1\": 0.7861236191707828,\n        \"nauc_ndcg_at_1000_max\": 0.6399061578992061,\n        \"nauc_ndcg_at_1000_std\": 0.21488055303395148,\n        \"nauc_ndcg_at_100_diff1\": 0.7861182735886454,\n        \"nauc_ndcg_at_100_max\": 0.641147678776563,\n        \"nauc_ndcg_at_100_std\": 0.21969864365016378,\n        \"nauc_ndcg_at_10_diff1\": 0.776980790774603,\n        \"nauc_ndcg_at_10_max\": 0.6401755531081292,\n        \"nauc_ndcg_at_10_std\": 0.23416053780066517,\n        \"nauc_ndcg_at_1_diff1\": 0.8195281021775603,\n        \"nauc_ndcg_at_1_max\": 0.6255213235759166,\n        \"nauc_ndcg_at_1_std\": 0.16194235584310274,\n        \"nauc_ndcg_at_20_diff1\": 0.782997924515294,\n        \"nauc_ndcg_at_20_max\": 0.6474238317445925,\n        \"nauc_ndcg_at_20_std\": 0.23531316447325576,\n        \"nauc_ndcg_at_3_diff1\": 0.7757766754986003,\n        \"nauc_ndcg_at_3_max\": 0.6396965790529899,\n        \"nauc_ndcg_at_3_std\": 0.19901557248954965,\n        \"nauc_ndcg_at_5_diff1\": 0.777266463466251,\n        \"nauc_ndcg_at_5_max\": 0.6412025750548266,\n        \"nauc_ndcg_at_5_std\": 0.2148997990723823,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.7858309990662994,\n        \"nauc_precision_at_100_max\": 0.7740040460628638,\n        \"nauc_precision_at_100_std\": 0.7100451291627877,\n        \"nauc_precision_at_10_diff1\": 0.7104132857823072,\n        \"nauc_precision_at_10_max\": 0.6661694539730024,\n        \"nauc_precision_at_10_std\": 0.4357866811781495,\n        \"nauc_precision_at_1_diff1\": 0.8195281021775603,\n        \"nauc_precision_at_1_max\": 0.6255213235759166,\n        \"nauc_precision_at_1_std\": 0.16194235584310274,\n        \"nauc_precision_at_20_diff1\": 0.7337215587989555,\n        \"nauc_precision_at_20_max\": 0.7727816272707906,\n        \"nauc_precision_at_20_std\": 0.5824692450079442,\n        \"nauc_precision_at_3_diff1\": 0.7381955824071126,\n        \"nauc_precision_at_3_max\": 0.6523252831018433,\n        \"nauc_precision_at_3_std\": 0.2268243904737471,\n        \"nauc_precision_at_5_diff1\": 0.7334373079388574,\n        \"nauc_precision_at_5_max\": 0.6629504556598959,\n        \"nauc_precision_at_5_std\": 0.28992393552693146,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.7858309990662884,\n        \"nauc_recall_at_100_max\": 0.7740040460628713,\n        \"nauc_recall_at_100_std\": 0.7100451291627723,\n        \"nauc_recall_at_10_diff1\": 0.7104132857823081,\n        \"nauc_recall_at_10_max\": 0.6661694539730049,\n        \"nauc_recall_at_10_std\": 0.43578668117815195,\n        \"nauc_recall_at_1_diff1\": 0.8195281021775603,\n        \"nauc_recall_at_1_max\": 0.6255213235759166,\n        \"nauc_recall_at_1_std\": 0.16194235584310274,\n        \"nauc_recall_at_20_diff1\": 0.733721558798958,\n        \"nauc_recall_at_20_max\": 0.7727816272707918,\n        \"nauc_recall_at_20_std\": 0.5824692450079454,\n        \"nauc_recall_at_3_diff1\": 0.7381955824071117,\n        \"nauc_recall_at_3_max\": 0.6523252831018428,\n        \"nauc_recall_at_3_std\": 0.2268243904737469,\n        \"nauc_recall_at_5_diff1\": 0.7334373079388581,\n        \"nauc_recall_at_5_max\": 0.6629504556598974,\n        \"nauc_recall_at_5_std\": 0.2899239355269335,\n        \"ndcg_at_1\": 0.66444,\n        \"ndcg_at_10\": 0.77524,\n        \"ndcg_at_100\": 0.79551,\n        \"ndcg_at_1000\": 0.79729,\n        \"ndcg_at_20\": 0.78642,\n        \"ndcg_at_3\": 0.73594,\n        \"ndcg_at_5\": 0.7565,\n        \"precision_at_1\": 0.66444,\n        \"precision_at_10\": 0.08922,\n        \"precision_at_100\": 0.00987,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04683,\n        \"precision_at_3\": 0.26148,\n        \"precision_at_5\": 0.16689,\n        \"recall_at_1\": 0.66444,\n        \"recall_at_10\": 0.89222,\n        \"recall_at_100\": 0.98667,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.93667,\n        \"recall_at_3\": 0.78444,\n        \"recall_at_5\": 0.83444\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-base/intfloat__multilingual-e5-base/d13f1b27baf31030b7fd040960d60d909913633f/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 69.76440715789795,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.76355,\n        \"map_at_1\": 0.48055,\n        \"map_at_10\": 0.71596,\n        \"map_at_100\": 0.72269,\n        \"map_at_1000\": 0.72304,\n        \"map_at_20\": 0.72063,\n        \"map_at_3\": 0.6768,\n        \"map_at_5\": 0.70509,\n        \"mrr_at_1\": 0.7364864864864865,\n        \"mrr_at_10\": 0.7903548637923634,\n        \"mrr_at_100\": 0.7925485119906738,\n        \"mrr_at_1000\": 0.7927242938243799,\n        \"mrr_at_20\": 0.7919637160083169,\n        \"mrr_at_3\": 0.784065315315315,\n        \"mrr_at_5\": 0.788119369369369,\n        \"nauc_map_at_1000_diff1\": 0.6120886347168524,\n        \"nauc_map_at_1000_max\": 0.6567934929218409,\n        \"nauc_map_at_1000_std\": 0.3328898180127869,\n        \"nauc_map_at_100_diff1\": 0.6119223965896734,\n        \"nauc_map_at_100_max\": 0.657123268389259,\n        \"nauc_map_at_100_std\": 0.33351708700930727,\n        \"nauc_map_at_10_diff1\": 0.6065961876568182,\n        \"nauc_map_at_10_max\": 0.6528343968354539,\n        \"nauc_map_at_10_std\": 0.3226467274838311,\n        \"nauc_map_at_1_diff1\": 0.6018674995640366,\n        \"nauc_map_at_1_max\": 0.32940697064641544,\n        \"nauc_map_at_1_std\": 0.11559889953342109,\n        \"nauc_map_at_20_diff1\": 0.6107444546155024,\n        \"nauc_map_at_20_max\": 0.6570571699925494,\n        \"nauc_map_at_20_std\": 0.33129771879965536,\n        \"nauc_map_at_3_diff1\": 0.6073294597606239,\n        \"nauc_map_at_3_max\": 0.5870903892260443,\n        \"nauc_map_at_3_std\": 0.25101234031587527,\n        \"nauc_map_at_5_diff1\": 0.6037720970775445,\n        \"nauc_map_at_5_max\": 0.6388561752349948,\n        \"nauc_map_at_5_std\": 0.30314656514004323,\n        \"nauc_mrr_at_1000_diff1\": 0.7133054627456897,\n        \"nauc_mrr_at_1000_max\": 0.7553376166599368,\n        \"nauc_mrr_at_1000_std\": 0.46353672735350226,\n        \"nauc_mrr_at_100_diff1\": 0.7133556295202433,\n        \"nauc_mrr_at_100_max\": 0.755503983145516,\n        \"nauc_mrr_at_100_std\": 0.46382569286212155,\n        \"nauc_mrr_at_10_diff1\": 0.7130938288592268,\n        \"nauc_mrr_at_10_max\": 0.7571695366472795,\n        \"nauc_mrr_at_10_std\": 0.46358167542606876,\n        \"nauc_mrr_at_1_diff1\": 0.7039530934167848,\n        \"nauc_mrr_at_1_max\": 0.6858079847057547,\n        \"nauc_mrr_at_1_std\": 0.3765388440967593,\n        \"nauc_mrr_at_20_diff1\": 0.7134291595723251,\n        \"nauc_mrr_at_20_max\": 0.7560514342722913,\n        \"nauc_mrr_at_20_std\": 0.4641020982610976,\n        \"nauc_mrr_at_3_diff1\": 0.7087505118984042,\n        \"nauc_mrr_at_3_max\": 0.7518004256417345,\n        \"nauc_mrr_at_3_std\": 0.45155163434304196,\n        \"nauc_mrr_at_5_diff1\": 0.7149092216925744,\n        \"nauc_mrr_at_5_max\": 0.7571960903936084,\n        \"nauc_mrr_at_5_std\": 0.45999482268765096,\n        \"nauc_ndcg_at_1000_diff1\": 0.64424755653158,\n        \"nauc_ndcg_at_1000_max\": 0.7179995530658594,\n        \"nauc_ndcg_at_1000_std\": 0.4261845949670468,\n        \"nauc_ndcg_at_100_diff1\": 0.642682319085353,\n        \"nauc_ndcg_at_100_max\": 0.7256084162632179,\n        \"nauc_ndcg_at_100_std\": 0.44181624785201484,\n        \"nauc_ndcg_at_10_diff1\": 0.6278521640047413,\n        \"nauc_ndcg_at_10_max\": 0.7180933779096977,\n        \"nauc_ndcg_at_10_std\": 0.4070068316170624,\n        \"nauc_ndcg_at_1_diff1\": 0.7039530934167848,\n        \"nauc_ndcg_at_1_max\": 0.6858079847057547,\n        \"nauc_ndcg_at_1_std\": 0.3765388440967593,\n        \"nauc_ndcg_at_20_diff1\": 0.6373392342929015,\n        \"nauc_ndcg_at_20_max\": 0.7258280384831197,\n        \"nauc_ndcg_at_20_std\": 0.42983545353306446,\n        \"nauc_ndcg_at_3_diff1\": 0.6264794579305172,\n        \"nauc_ndcg_at_3_max\": 0.636290626191759,\n        \"nauc_ndcg_at_3_std\": 0.3056776331064701,\n        \"nauc_ndcg_at_5_diff1\": 0.625869075116017,\n        \"nauc_ndcg_at_5_max\": 0.6952466157901112,\n        \"nauc_ndcg_at_5_std\": 0.37196337183328204,\n        \"nauc_precision_at_1000_diff1\": -0.21994374172961523,\n        \"nauc_precision_at_1000_max\": 0.09521843731394646,\n        \"nauc_precision_at_1000_std\": 0.19015616075822983,\n        \"nauc_precision_at_100_diff1\": -0.11260045412571985,\n        \"nauc_precision_at_100_max\": 0.24458203344170185,\n        \"nauc_precision_at_100_std\": 0.3186218386991172,\n        \"nauc_precision_at_10_diff1\": -0.027536142258204773,\n        \"nauc_precision_at_10_max\": 0.3792982449178664,\n        \"nauc_precision_at_10_std\": 0.33785925216888235,\n        \"nauc_precision_at_1_diff1\": 0.7039530934167848,\n        \"nauc_precision_at_1_max\": 0.6858079847057547,\n        \"nauc_precision_at_1_std\": 0.3765388440967593,\n        \"nauc_precision_at_20_diff1\": -0.06191201640332512,\n        \"nauc_precision_at_20_max\": 0.3372528758223194,\n        \"nauc_precision_at_20_std\": 0.34947043305267833,\n        \"nauc_precision_at_3_diff1\": 0.1328685927957571,\n        \"nauc_precision_at_3_max\": 0.46127555813841487,\n        \"nauc_precision_at_3_std\": 0.29389070032941417,\n        \"nauc_precision_at_5_diff1\": 0.02893102490247378,\n        \"nauc_precision_at_5_max\": 0.41494796228331343,\n        \"nauc_precision_at_5_std\": 0.3198824993031576,\n        \"nauc_recall_at_1000_diff1\": 0.6723513136663745,\n        \"nauc_recall_at_1000_max\": 0.8988977438568299,\n        \"nauc_recall_at_1000_std\": 0.8912083424270899,\n        \"nauc_recall_at_100_diff1\": 0.6400112549494104,\n        \"nauc_recall_at_100_max\": 0.8895950225937042,\n        \"nauc_recall_at_100_std\": 0.842089393056033,\n        \"nauc_recall_at_10_diff1\": 0.5794086907748127,\n        \"nauc_recall_at_10_max\": 0.7969474008126761,\n        \"nauc_recall_at_10_std\": 0.5315121876669305,\n        \"nauc_recall_at_1_diff1\": 0.6018674995640366,\n        \"nauc_recall_at_1_max\": 0.32940697064641544,\n        \"nauc_recall_at_1_std\": 0.11559889953342109,\n        \"nauc_recall_at_20_diff1\": 0.6099124795283541,\n        \"nauc_recall_at_20_max\": 0.8447530472239648,\n        \"nauc_recall_at_20_std\": 0.6616877200292428,\n        \"nauc_recall_at_3_diff1\": 0.5897862739896276,\n        \"nauc_recall_at_3_max\": 0.6127205173754705,\n        \"nauc_recall_at_3_std\": 0.2903940935173204,\n        \"nauc_recall_at_5_diff1\": 0.5875005857489918,\n        \"nauc_recall_at_5_max\": 0.7295534419284448,\n        \"nauc_recall_at_5_std\": 0.42258075167199766,\n        \"ndcg_at_1\": 0.73649,\n        \"ndcg_at_10\": 0.76355,\n        \"ndcg_at_100\": 0.78456,\n        \"ndcg_at_1000\": 0.79272,\n        \"ndcg_at_20\": 0.77514,\n        \"ndcg_at_3\": 0.71865,\n        \"ndcg_at_5\": 0.7468,\n        \"precision_at_1\": 0.73649,\n        \"precision_at_10\": 0.15084,\n        \"precision_at_100\": 0.01681,\n        \"precision_at_1000\": 0.00181,\n        \"precision_at_20\": 0.07922,\n        \"precision_at_3\": 0.42342,\n        \"precision_at_5\": 0.28378,\n        \"recall_at_1\": 0.48055,\n        \"recall_at_10\": 0.82061,\n        \"recall_at_100\": 0.89764,\n        \"recall_at_1000\": 0.95011,\n        \"recall_at_20\": 0.85825,\n        \"recall_at_3\": 0.72275,\n        \"recall_at_5\": 0.77861\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-base/intfloat__multilingual-e5-base/d13f1b27baf31030b7fd040960d60d909913633f/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 10329.316873311996,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.6227,\n        \"map_at_1\": 0.3612,\n        \"map_at_10\": 0.5315,\n        \"map_at_100\": 0.55512,\n        \"map_at_1000\": 0.55614,\n        \"map_at_20\": 0.54556,\n        \"map_at_3\": 0.47674,\n        \"map_at_5\": 0.504,\n        \"mrr_at_1\": 0.5868544600938967,\n        \"mrr_at_10\": 0.6973116476637602,\n        \"mrr_at_100\": 0.7002104887131142,\n        \"mrr_at_1000\": 0.700290787057861,\n        \"mrr_at_20\": 0.6987682505288138,\n        \"mrr_at_3\": 0.6784037558685446,\n        \"mrr_at_5\": 0.6906103286384975,\n        \"nauc_map_at_1000_diff1\": 0.38764854132379667,\n        \"nauc_map_at_1000_max\": 0.3113912044438687,\n        \"nauc_map_at_1000_std\": -0.08692573899236988,\n        \"nauc_map_at_100_diff1\": 0.3875727487743683,\n        \"nauc_map_at_100_max\": 0.31084917316415417,\n        \"nauc_map_at_100_std\": -0.08769034073115611,\n        \"nauc_map_at_10_diff1\": 0.38338772006257255,\n        \"nauc_map_at_10_max\": 0.2976298129992829,\n        \"nauc_map_at_10_std\": -0.1240776524025288,\n        \"nauc_map_at_1_diff1\": 0.48702256214431855,\n        \"nauc_map_at_1_max\": 0.21748772342571,\n        \"nauc_map_at_1_std\": -0.20305923228318654,\n        \"nauc_map_at_20_diff1\": 0.38264216102917853,\n        \"nauc_map_at_20_max\": 0.30415154290066665,\n        \"nauc_map_at_20_std\": -0.09912139862787113,\n        \"nauc_map_at_3_diff1\": 0.4037090768200007,\n        \"nauc_map_at_3_max\": 0.27642763386759206,\n        \"nauc_map_at_3_std\": -0.1810076463974879,\n        \"nauc_map_at_5_diff1\": 0.3966359976722569,\n        \"nauc_map_at_5_max\": 0.286925678426597,\n        \"nauc_map_at_5_std\": -0.15198298329553037,\n        \"nauc_mrr_at_1000_diff1\": 0.41284389043719655,\n        \"nauc_mrr_at_1000_max\": 0.42117004847800693,\n        \"nauc_mrr_at_1000_std\": 0.18800705458167233,\n        \"nauc_mrr_at_100_diff1\": 0.41281828202187665,\n        \"nauc_mrr_at_100_max\": 0.4212382136233428,\n        \"nauc_mrr_at_100_std\": 0.18814564685189714,\n        \"nauc_mrr_at_10_diff1\": 0.4120268901923224,\n        \"nauc_mrr_at_10_max\": 0.422986788214752,\n        \"nauc_mrr_at_10_std\": 0.18811292303183347,\n        \"nauc_mrr_at_1_diff1\": 0.4487596742093259,\n        \"nauc_mrr_at_1_max\": 0.3610578163366466,\n        \"nauc_mrr_at_1_std\": 0.13225259650622362,\n        \"nauc_mrr_at_20_diff1\": 0.41392097470507366,\n        \"nauc_mrr_at_20_max\": 0.42359215144179657,\n        \"nauc_mrr_at_20_std\": 0.19097457002225834,\n        \"nauc_mrr_at_3_diff1\": 0.39752061736475947,\n        \"nauc_mrr_at_3_max\": 0.41555272255813586,\n        \"nauc_mrr_at_3_std\": 0.17157649602889363,\n        \"nauc_mrr_at_5_diff1\": 0.4135361139700035,\n        \"nauc_mrr_at_5_max\": 0.42384273859241994,\n        \"nauc_mrr_at_5_std\": 0.18309769773126172,\n        \"nauc_ndcg_at_1000_diff1\": 0.38558364488923336,\n        \"nauc_ndcg_at_1000_max\": 0.3735443153990054,\n        \"nauc_ndcg_at_1000_std\": 0.04997815724278142,\n        \"nauc_ndcg_at_100_diff1\": 0.38109696465625686,\n        \"nauc_ndcg_at_100_max\": 0.3708687670036079,\n        \"nauc_ndcg_at_100_std\": 0.04744258222085883,\n        \"nauc_ndcg_at_10_diff1\": 0.3655827203180003,\n        \"nauc_ndcg_at_10_max\": 0.3384549245590441,\n        \"nauc_ndcg_at_10_std\": -0.03945198134422429,\n        \"nauc_ndcg_at_1_diff1\": 0.4487596742093259,\n        \"nauc_ndcg_at_1_max\": 0.3610578163366466,\n        \"nauc_ndcg_at_1_std\": 0.13225259650622362,\n        \"nauc_ndcg_at_20_diff1\": 0.37125748141706266,\n        \"nauc_ndcg_at_20_max\": 0.3566575938179187,\n        \"nauc_ndcg_at_20_std\": 0.01618259053944107,\n        \"nauc_ndcg_at_3_diff1\": 0.3744884533156548,\n        \"nauc_ndcg_at_3_max\": 0.36185198492264975,\n        \"nauc_ndcg_at_3_std\": -0.022525070094551996,\n        \"nauc_ndcg_at_5_diff1\": 0.38897678279830183,\n        \"nauc_ndcg_at_5_max\": 0.3506678858363011,\n        \"nauc_ndcg_at_5_std\": -0.04899222506336306,\n        \"nauc_precision_at_1000_diff1\": -0.13646893822028466,\n        \"nauc_precision_at_1000_max\": 0.12066222521534775,\n        \"nauc_precision_at_1000_std\": 0.45459076243223984,\n        \"nauc_precision_at_100_diff1\": -0.12546392835057266,\n        \"nauc_precision_at_100_max\": 0.1385245545085449,\n        \"nauc_precision_at_100_std\": 0.4657881556877765,\n        \"nauc_precision_at_10_diff1\": -0.142336052719195,\n        \"nauc_precision_at_10_max\": 0.19599132675355047,\n        \"nauc_precision_at_10_std\": 0.41448405304099284,\n        \"nauc_precision_at_1_diff1\": 0.4487596742093259,\n        \"nauc_precision_at_1_max\": 0.3610578163366466,\n        \"nauc_precision_at_1_std\": 0.13225259650622362,\n        \"nauc_precision_at_20_diff1\": -0.13734760079468608,\n        \"nauc_precision_at_20_max\": 0.17268688686350742,\n        \"nauc_precision_at_20_std\": 0.4652441859623385,\n        \"nauc_precision_at_3_diff1\": -0.01385469062182767,\n        \"nauc_precision_at_3_max\": 0.2865712095373297,\n        \"nauc_precision_at_3_std\": 0.25408063870871217,\n        \"nauc_precision_at_5_diff1\": -0.0725893843825658,\n        \"nauc_precision_at_5_max\": 0.24986208705825372,\n        \"nauc_precision_at_5_std\": 0.33964597495569715,\n        \"nauc_recall_at_1000_diff1\": 0.43281509968634124,\n        \"nauc_recall_at_1000_max\": 0.7773981194084716,\n        \"nauc_recall_at_1000_std\": 0.7037305348610524,\n        \"nauc_recall_at_100_diff1\": 0.24616775664220159,\n        \"nauc_recall_at_100_max\": 0.4172532948489134,\n        \"nauc_recall_at_100_std\": 0.23724557640896274,\n        \"nauc_recall_at_10_diff1\": 0.26010019285097696,\n        \"nauc_recall_at_10_max\": 0.28609614869854244,\n        \"nauc_recall_at_10_std\": -0.09819697382128093,\n        \"nauc_recall_at_1_diff1\": 0.48702256214431855,\n        \"nauc_recall_at_1_max\": 0.21748772342571,\n        \"nauc_recall_at_1_std\": -0.20305923228318654,\n        \"nauc_recall_at_20_diff1\": 0.26857159375544104,\n        \"nauc_recall_at_20_max\": 0.34876939981112565,\n        \"nauc_recall_at_20_std\": 0.07342454797424504,\n        \"nauc_recall_at_3_diff1\": 0.33046767471167193,\n        \"nauc_recall_at_3_max\": 0.29281890571905794,\n        \"nauc_recall_at_3_std\": -0.18490968486067033,\n        \"nauc_recall_at_5_diff1\": 0.3280496356900794,\n        \"nauc_recall_at_5_max\": 0.2887980433798689,\n        \"nauc_recall_at_5_std\": -0.1628636660793256,\n        \"ndcg_at_1\": 0.58685,\n        \"ndcg_at_10\": 0.6227,\n        \"ndcg_at_100\": 0.68376,\n        \"ndcg_at_1000\": 0.69545,\n        \"ndcg_at_20\": 0.64963,\n        \"ndcg_at_3\": 0.58584,\n        \"ndcg_at_5\": 0.59175,\n        \"precision_at_1\": 0.58685,\n        \"precision_at_10\": 0.1554,\n        \"precision_at_100\": 0.0231,\n        \"precision_at_1000\": 0.00253,\n        \"precision_at_20\": 0.09108,\n        \"precision_at_3\": 0.35055,\n        \"precision_at_5\": 0.24977,\n        \"recall_at_1\": 0.3612,\n        \"recall_at_10\": 0.71449,\n        \"recall_at_100\": 0.91555,\n        \"recall_at_1000\": 0.98075,\n        \"recall_at_20\": 0.78997,\n        \"recall_at_3\": 0.54734,\n        \"recall_at_5\": 0.617\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-base/intfloat__multilingual-e5-base/d13f1b27baf31030b7fd040960d60d909913633f/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 10726.250535488129,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.58082,\n        \"map_at_1\": 0.43191,\n        \"map_at_10\": 0.5278,\n        \"map_at_100\": 0.53635,\n        \"map_at_1000\": 0.53672,\n        \"map_at_20\": 0.53278,\n        \"map_at_3\": 0.49637,\n        \"map_at_5\": 0.51579,\n        \"mrr_at_1\": 0.4655581947743468,\n        \"mrr_at_10\": 0.5515750480714849,\n        \"mrr_at_100\": 0.5582255676972496,\n        \"mrr_at_1000\": 0.5585150923017264,\n        \"mrr_at_20\": 0.5555904681690624,\n        \"mrr_at_3\": 0.5241488519398259,\n        \"mrr_at_5\": 0.5395882818685669,\n        \"nauc_map_at_1000_diff1\": 0.4185245174995054,\n        \"nauc_map_at_1000_max\": 0.40612966246897475,\n        \"nauc_map_at_1000_std\": 0.048795216003709785,\n        \"nauc_map_at_100_diff1\": 0.41815378361431316,\n        \"nauc_map_at_100_max\": 0.4058548055479725,\n        \"nauc_map_at_100_std\": 0.04868018064681098,\n        \"nauc_map_at_10_diff1\": 0.4175731631836936,\n        \"nauc_map_at_10_max\": 0.4036531634839384,\n        \"nauc_map_at_10_std\": 0.045235507009600294,\n        \"nauc_map_at_1_diff1\": 0.4730432659584148,\n        \"nauc_map_at_1_max\": 0.4116036341712533,\n        \"nauc_map_at_1_std\": 0.05590340783512278,\n        \"nauc_map_at_20_diff1\": 0.4172847311708526,\n        \"nauc_map_at_20_max\": 0.40438924348554933,\n        \"nauc_map_at_20_std\": 0.04522925358150473,\n        \"nauc_map_at_3_diff1\": 0.42754403200834207,\n        \"nauc_map_at_3_max\": 0.41230793882923544,\n        \"nauc_map_at_3_std\": 0.056123248270589544,\n        \"nauc_map_at_5_diff1\": 0.414617225536972,\n        \"nauc_map_at_5_max\": 0.4048782050759969,\n        \"nauc_map_at_5_std\": 0.048760891180866864,\n        \"nauc_mrr_at_1000_diff1\": 0.4391148789521434,\n        \"nauc_mrr_at_1000_max\": 0.43037019215564914,\n        \"nauc_mrr_at_1000_std\": 0.051646723959669176,\n        \"nauc_mrr_at_100_diff1\": 0.4389393375094754,\n        \"nauc_mrr_at_100_max\": 0.4301686328622996,\n        \"nauc_mrr_at_100_std\": 0.051420021276688044,\n        \"nauc_mrr_at_10_diff1\": 0.43897367091817935,\n        \"nauc_mrr_at_10_max\": 0.43005799762942876,\n        \"nauc_mrr_at_10_std\": 0.05127538650954391,\n        \"nauc_mrr_at_1_diff1\": 0.4974245661547362,\n        \"nauc_mrr_at_1_max\": 0.43988998412009594,\n        \"nauc_mrr_at_1_std\": 0.05137648799598571,\n        \"nauc_mrr_at_20_diff1\": 0.437611596877886,\n        \"nauc_mrr_at_20_max\": 0.42924562204504574,\n        \"nauc_mrr_at_20_std\": 0.04957879150663721,\n        \"nauc_mrr_at_3_diff1\": 0.4389111677101245,\n        \"nauc_mrr_at_3_max\": 0.4333270992230221,\n        \"nauc_mrr_at_3_std\": 0.05629367157218375,\n        \"nauc_mrr_at_5_diff1\": 0.4359000531297272,\n        \"nauc_mrr_at_5_max\": 0.4303383727731648,\n        \"nauc_mrr_at_5_std\": 0.055756374223376357,\n        \"nauc_ndcg_at_1000_diff1\": 0.41343247137897293,\n        \"nauc_ndcg_at_1000_max\": 0.4156390723661495,\n        \"nauc_ndcg_at_1000_std\": 0.05808562888891213,\n        \"nauc_ndcg_at_100_diff1\": 0.40359731894318585,\n        \"nauc_ndcg_at_100_max\": 0.40760147296813215,\n        \"nauc_ndcg_at_100_std\": 0.05489362113880834,\n        \"nauc_ndcg_at_10_diff1\": 0.4019025213111373,\n        \"nauc_ndcg_at_10_max\": 0.40016778751314225,\n        \"nauc_ndcg_at_10_std\": 0.0381379917740792,\n        \"nauc_ndcg_at_1_diff1\": 0.4974245661547362,\n        \"nauc_ndcg_at_1_max\": 0.43988998412009594,\n        \"nauc_ndcg_at_1_std\": 0.05137648799598571,\n        \"nauc_ndcg_at_20_diff1\": 0.3985959250925596,\n        \"nauc_ndcg_at_20_max\": 0.4006483776741761,\n        \"nauc_ndcg_at_20_std\": 0.035963086709961394,\n        \"nauc_ndcg_at_3_diff1\": 0.41339294018327666,\n        \"nauc_ndcg_at_3_max\": 0.4154232762476081,\n        \"nauc_ndcg_at_3_std\": 0.05749303837057296,\n        \"nauc_ndcg_at_5_diff1\": 0.3948810565781645,\n        \"nauc_ndcg_at_5_max\": 0.40297811344864953,\n        \"nauc_ndcg_at_5_std\": 0.048612021354227104,\n        \"nauc_precision_at_1000_diff1\": -0.023872356592962996,\n        \"nauc_precision_at_1000_max\": 0.08608031696531497,\n        \"nauc_precision_at_1000_std\": 0.07184301921198236,\n        \"nauc_precision_at_100_diff1\": -0.010290794691752425,\n        \"nauc_precision_at_100_max\": 0.11286433340170968,\n        \"nauc_precision_at_100_std\": 0.07282243793129542,\n        \"nauc_precision_at_10_diff1\": 0.17239822969194146,\n        \"nauc_precision_at_10_max\": 0.25491440587453856,\n        \"nauc_precision_at_10_std\": -0.01136630280583889,\n        \"nauc_precision_at_1_diff1\": 0.4974245661547362,\n        \"nauc_precision_at_1_max\": 0.43988998412009594,\n        \"nauc_precision_at_1_std\": 0.05137648799598571,\n        \"nauc_precision_at_20_diff1\": 0.09807534995702752,\n        \"nauc_precision_at_20_max\": 0.20243662205690297,\n        \"nauc_precision_at_20_std\": -0.009308783166631366,\n        \"nauc_precision_at_3_diff1\": 0.30403982399381463,\n        \"nauc_precision_at_3_max\": 0.376503959358296,\n        \"nauc_precision_at_3_std\": 0.05426784715124511,\n        \"nauc_precision_at_5_diff1\": 0.20336094469303898,\n        \"nauc_precision_at_5_max\": 0.301871787288159,\n        \"nauc_precision_at_5_std\": 0.031832913255998734,\n        \"nauc_recall_at_1000_diff1\": 0.4741332939793106,\n        \"nauc_recall_at_1000_max\": 0.6762796719315332,\n        \"nauc_recall_at_1000_std\": 0.439130909069932,\n        \"nauc_recall_at_100_diff1\": 0.24460260903502526,\n        \"nauc_recall_at_100_max\": 0.3520020445129798,\n        \"nauc_recall_at_100_std\": 0.13716817293473227,\n        \"nauc_recall_at_10_diff1\": 0.3106688966871937,\n        \"nauc_recall_at_10_max\": 0.3366772175043759,\n        \"nauc_recall_at_10_std\": -0.006124281457655288,\n        \"nauc_recall_at_1_diff1\": 0.4730432659584148,\n        \"nauc_recall_at_1_max\": 0.4116036341712533,\n        \"nauc_recall_at_1_std\": 0.05590340783512278,\n        \"nauc_recall_at_20_diff1\": 0.28199555631776185,\n        \"nauc_recall_at_20_max\": 0.3313221032143139,\n        \"nauc_recall_at_20_std\": -0.029706893887273177,\n        \"nauc_recall_at_3_diff1\": 0.3587914593094187,\n        \"nauc_recall_at_3_max\": 0.39924211690350325,\n        \"nauc_recall_at_3_std\": 0.05969615552219959,\n        \"nauc_recall_at_5_diff1\": 0.3017520123963702,\n        \"nauc_recall_at_5_max\": 0.3579689669410457,\n        \"nauc_recall_at_5_std\": 0.036385597059597576,\n        \"ndcg_at_1\": 0.46556,\n        \"ndcg_at_10\": 0.58082,\n        \"ndcg_at_100\": 0.61867,\n        \"ndcg_at_1000\": 0.62788,\n        \"ndcg_at_20\": 0.59634,\n        \"ndcg_at_3\": 0.52094,\n        \"ndcg_at_5\": 0.55244,\n        \"precision_at_1\": 0.46556,\n        \"precision_at_10\": 0.08171,\n        \"precision_at_100\": 0.01036,\n        \"precision_at_1000\": 0.00112,\n        \"precision_at_20\": 0.04466,\n        \"precision_at_3\": 0.20982,\n        \"precision_at_5\": 0.14394,\n        \"recall_at_1\": 0.43191,\n        \"recall_at_10\": 0.72169,\n        \"recall_at_100\": 0.88876,\n        \"recall_at_1000\": 0.95922,\n        \"recall_at_20\": 0.77672,\n        \"recall_at_3\": 0.56532,\n        \"recall_at_5\": 0.63737\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-base/intfloat__multilingual-e5-base/d13f1b27baf31030b7fd040960d60d909913633f/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 365.5563635826111,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.23766,\n        \"map_at_1\": 0.16,\n        \"map_at_10\": 0.20903,\n        \"map_at_100\": 0.21578,\n        \"map_at_1000\": 0.21688,\n        \"map_at_20\": 0.21168,\n        \"map_at_3\": 0.19167,\n        \"map_at_5\": 0.20242,\n        \"mrr_at_1\": 0.16,\n        \"mrr_at_10\": 0.20903174603174604,\n        \"mrr_at_100\": 0.215783785522135,\n        \"mrr_at_1000\": 0.2168796089420726,\n        \"mrr_at_20\": 0.21167943861693864,\n        \"mrr_at_3\": 0.19166666666666668,\n        \"mrr_at_5\": 0.20241666666666663,\n        \"nauc_map_at_1000_diff1\": 0.4056527499371557,\n        \"nauc_map_at_1000_max\": 0.45971918394837746,\n        \"nauc_map_at_1000_std\": 0.10888775044447328,\n        \"nauc_map_at_100_diff1\": 0.4057775934260692,\n        \"nauc_map_at_100_max\": 0.4593519956984368,\n        \"nauc_map_at_100_std\": 0.10843762042187415,\n        \"nauc_map_at_10_diff1\": 0.4111243025689681,\n        \"nauc_map_at_10_max\": 0.46241285085930794,\n        \"nauc_map_at_10_std\": 0.09961547366420115,\n        \"nauc_map_at_1_diff1\": 0.4773870794284836,\n        \"nauc_map_at_1_max\": 0.5224592871408816,\n        \"nauc_map_at_1_std\": 0.11363112613304648,\n        \"nauc_map_at_20_diff1\": 0.40796056090406,\n        \"nauc_map_at_20_max\": 0.46179111942523543,\n        \"nauc_map_at_20_std\": 0.10283069379805279,\n        \"nauc_map_at_3_diff1\": 0.4344793643094571,\n        \"nauc_map_at_3_max\": 0.48414054809763624,\n        \"nauc_map_at_3_std\": 0.10250367348103344,\n        \"nauc_map_at_5_diff1\": 0.42545269261198565,\n        \"nauc_map_at_5_max\": 0.4792715776070097,\n        \"nauc_map_at_5_std\": 0.10650287220411736,\n        \"nauc_mrr_at_1000_diff1\": 0.4056527499371557,\n        \"nauc_mrr_at_1000_max\": 0.45971918394837746,\n        \"nauc_mrr_at_1000_std\": 0.10888775044447328,\n        \"nauc_mrr_at_100_diff1\": 0.4057775934260692,\n        \"nauc_mrr_at_100_max\": 0.4593519956984368,\n        \"nauc_mrr_at_100_std\": 0.10843762042187415,\n        \"nauc_mrr_at_10_diff1\": 0.4111243025689681,\n        \"nauc_mrr_at_10_max\": 0.46241285085930794,\n        \"nauc_mrr_at_10_std\": 0.09961547366420115,\n        \"nauc_mrr_at_1_diff1\": 0.4773870794284836,\n        \"nauc_mrr_at_1_max\": 0.5224592871408816,\n        \"nauc_mrr_at_1_std\": 0.11363112613304648,\n        \"nauc_mrr_at_20_diff1\": 0.40796056090406,\n        \"nauc_mrr_at_20_max\": 0.46179111942523543,\n        \"nauc_mrr_at_20_std\": 0.10283069379805279,\n        \"nauc_mrr_at_3_diff1\": 0.4344793643094571,\n        \"nauc_mrr_at_3_max\": 0.48414054809763624,\n        \"nauc_mrr_at_3_std\": 0.10250367348103344,\n        \"nauc_mrr_at_5_diff1\": 0.42545269261198565,\n        \"nauc_mrr_at_5_max\": 0.4792715776070097,\n        \"nauc_mrr_at_5_std\": 0.10650287220411736,\n        \"nauc_ndcg_at_1000_diff1\": 0.357629836385146,\n        \"nauc_ndcg_at_1000_max\": 0.42579081969985966,\n        \"nauc_ndcg_at_1000_std\": 0.15118971276323878,\n        \"nauc_ndcg_at_100_diff1\": 0.3582291264246711,\n        \"nauc_ndcg_at_100_max\": 0.4188747272395376,\n        \"nauc_ndcg_at_100_std\": 0.14084513620696146,\n        \"nauc_ndcg_at_10_diff1\": 0.37899637323724716,\n        \"nauc_ndcg_at_10_max\": 0.43004170234676586,\n        \"nauc_ndcg_at_10_std\": 0.09353667167876474,\n        \"nauc_ndcg_at_1_diff1\": 0.4773870794284836,\n        \"nauc_ndcg_at_1_max\": 0.5224592871408816,\n        \"nauc_ndcg_at_1_std\": 0.11363112613304648,\n        \"nauc_ndcg_at_20_diff1\": 0.36734478358022304,\n        \"nauc_ndcg_at_20_max\": 0.4274639301201697,\n        \"nauc_ndcg_at_20_std\": 0.10651189016151837,\n        \"nauc_ndcg_at_3_diff1\": 0.42527666873945985,\n        \"nauc_ndcg_at_3_max\": 0.47536644100741793,\n        \"nauc_ndcg_at_3_std\": 0.10162267713534295,\n        \"nauc_ndcg_at_5_diff1\": 0.41059087810133726,\n        \"nauc_ndcg_at_5_max\": 0.4675405208954469,\n        \"nauc_ndcg_at_5_std\": 0.10930382183498212,\n        \"nauc_precision_at_1000_diff1\": 0.12434933487565131,\n        \"nauc_precision_at_1000_max\": 0.296620672560522,\n        \"nauc_precision_at_1000_std\": 0.48898148038856926,\n        \"nauc_precision_at_100_diff1\": 0.2187673059173419,\n        \"nauc_precision_at_100_max\": 0.3049123166854683,\n        \"nauc_precision_at_100_std\": 0.2800601647694252,\n        \"nauc_precision_at_10_diff1\": 0.29423786129861146,\n        \"nauc_precision_at_10_max\": 0.3431321643966932,\n        \"nauc_precision_at_10_std\": 0.07613398836388804,\n        \"nauc_precision_at_1_diff1\": 0.4773870794284836,\n        \"nauc_precision_at_1_max\": 0.5224592871408816,\n        \"nauc_precision_at_1_std\": 0.11363112613304648,\n        \"nauc_precision_at_20_diff1\": 0.25535068360777796,\n        \"nauc_precision_at_20_max\": 0.33514409955732005,\n        \"nauc_precision_at_20_std\": 0.12291228665822236,\n        \"nauc_precision_at_3_diff1\": 0.4023504827565167,\n        \"nauc_precision_at_3_max\": 0.45330303076524175,\n        \"nauc_precision_at_3_std\": 0.09998322173243263,\n        \"nauc_precision_at_5_diff1\": 0.3740083244874019,\n        \"nauc_precision_at_5_max\": 0.4389421196714906,\n        \"nauc_precision_at_5_std\": 0.11802335325995887,\n        \"nauc_recall_at_1000_diff1\": 0.12434933487565095,\n        \"nauc_recall_at_1000_max\": 0.2966206725605223,\n        \"nauc_recall_at_1000_std\": 0.48898148038856976,\n        \"nauc_recall_at_100_diff1\": 0.21876730591734192,\n        \"nauc_recall_at_100_max\": 0.304912316685468,\n        \"nauc_recall_at_100_std\": 0.2800601647694252,\n        \"nauc_recall_at_10_diff1\": 0.2942378612986113,\n        \"nauc_recall_at_10_max\": 0.34313216439669286,\n        \"nauc_recall_at_10_std\": 0.0761339883638881,\n        \"nauc_recall_at_1_diff1\": 0.4773870794284836,\n        \"nauc_recall_at_1_max\": 0.5224592871408816,\n        \"nauc_recall_at_1_std\": 0.11363112613304648,\n        \"nauc_recall_at_20_diff1\": 0.25535068360777774,\n        \"nauc_recall_at_20_max\": 0.33514409955731994,\n        \"nauc_recall_at_20_std\": 0.12291228665822235,\n        \"nauc_recall_at_3_diff1\": 0.40235048275651664,\n        \"nauc_recall_at_3_max\": 0.45330303076524137,\n        \"nauc_recall_at_3_std\": 0.0999832217324324,\n        \"nauc_recall_at_5_diff1\": 0.3740083244874014,\n        \"nauc_recall_at_5_max\": 0.4389421196714899,\n        \"nauc_recall_at_5_std\": 0.11802335325995847,\n        \"ndcg_at_1\": 0.16,\n        \"ndcg_at_10\": 0.23766,\n        \"ndcg_at_100\": 0.2765,\n        \"ndcg_at_1000\": 0.30876,\n        \"ndcg_at_20\": 0.24761,\n        \"ndcg_at_3\": 0.20155,\n        \"ndcg_at_5\": 0.22155,\n        \"precision_at_1\": 0.16,\n        \"precision_at_10\": 0.033,\n        \"precision_at_100\": 0.00525,\n        \"precision_at_1000\": 0.00079,\n        \"precision_at_20\": 0.0185,\n        \"precision_at_3\": 0.07667,\n        \"precision_at_5\": 0.056,\n        \"recall_at_1\": 0.16,\n        \"recall_at_10\": 0.33,\n        \"recall_at_100\": 0.525,\n        \"recall_at_1000\": 0.785,\n        \"recall_at_20\": 0.37,\n        \"recall_at_3\": 0.23,\n        \"recall_at_5\": 0.28\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.22486,\n        \"map_at_1\": 0.17,\n        \"map_at_10\": 0.20452,\n        \"map_at_100\": 0.21295,\n        \"map_at_1000\": 0.21427,\n        \"map_at_20\": 0.20945,\n        \"map_at_3\": 0.19417,\n        \"map_at_5\": 0.19992,\n        \"mrr_at_1\": 0.17,\n        \"mrr_at_10\": 0.20451984126984127,\n        \"mrr_at_100\": 0.2129479826793562,\n        \"mrr_at_1000\": 0.2142721941179602,\n        \"mrr_at_20\": 0.20945311712281525,\n        \"mrr_at_3\": 0.19416666666666665,\n        \"mrr_at_5\": 0.19991666666666666,\n        \"nauc_map_at_1000_diff1\": 0.5087580113845908,\n        \"nauc_map_at_1000_max\": 0.5179525106865259,\n        \"nauc_map_at_1000_std\": 0.0847410446203826,\n        \"nauc_map_at_100_diff1\": 0.5089305311988365,\n        \"nauc_map_at_100_max\": 0.5178971110642436,\n        \"nauc_map_at_100_std\": 0.08419962372042392,\n        \"nauc_map_at_10_diff1\": 0.5182162044962908,\n        \"nauc_map_at_10_max\": 0.5259011127234215,\n        \"nauc_map_at_10_std\": 0.08045608374070097,\n        \"nauc_map_at_1_diff1\": 0.5934927299730468,\n        \"nauc_map_at_1_max\": 0.5180696382405251,\n        \"nauc_map_at_1_std\": 0.023432772878123738,\n        \"nauc_map_at_20_diff1\": 0.5113697633838645,\n        \"nauc_map_at_20_max\": 0.5210348343486106,\n        \"nauc_map_at_20_std\": 0.08549340137837198,\n        \"nauc_map_at_3_diff1\": 0.525610817973501,\n        \"nauc_map_at_3_max\": 0.5258851216290541,\n        \"nauc_map_at_3_std\": 0.07157074713282353,\n        \"nauc_map_at_5_diff1\": 0.524481893074894,\n        \"nauc_map_at_5_max\": 0.5200983900181767,\n        \"nauc_map_at_5_std\": 0.08209387595688832,\n        \"nauc_mrr_at_1000_diff1\": 0.5087580113845908,\n        \"nauc_mrr_at_1000_max\": 0.5179525106865259,\n        \"nauc_mrr_at_1000_std\": 0.0847410446203826,\n        \"nauc_mrr_at_100_diff1\": 0.5089305311988365,\n        \"nauc_mrr_at_100_max\": 0.5178971110642436,\n        \"nauc_mrr_at_100_std\": 0.08419962372042392,\n        \"nauc_mrr_at_10_diff1\": 0.5182162044962908,\n        \"nauc_mrr_at_10_max\": 0.5259011127234215,\n        \"nauc_mrr_at_10_std\": 0.08045608374070097,\n        \"nauc_mrr_at_1_diff1\": 0.5934927299730468,\n        \"nauc_mrr_at_1_max\": 0.5180696382405251,\n        \"nauc_mrr_at_1_std\": 0.023432772878123738,\n        \"nauc_mrr_at_20_diff1\": 0.5113697633838645,\n        \"nauc_mrr_at_20_max\": 0.5210348343486106,\n        \"nauc_mrr_at_20_std\": 0.08549340137837198,\n        \"nauc_mrr_at_3_diff1\": 0.525610817973501,\n        \"nauc_mrr_at_3_max\": 0.5258851216290541,\n        \"nauc_mrr_at_3_std\": 0.07157074713282353,\n        \"nauc_mrr_at_5_diff1\": 0.524481893074894,\n        \"nauc_mrr_at_5_max\": 0.5200983900181767,\n        \"nauc_mrr_at_5_std\": 0.08209387595688832,\n        \"nauc_ndcg_at_1000_diff1\": 0.46291688826516936,\n        \"nauc_ndcg_at_1000_max\": 0.5076348172971382,\n        \"nauc_ndcg_at_1000_std\": 0.13996126632352657,\n        \"nauc_ndcg_at_100_diff1\": 0.45761311543315036,\n        \"nauc_ndcg_at_100_max\": 0.49986715299588624,\n        \"nauc_ndcg_at_100_std\": 0.11573952558693551,\n        \"nauc_ndcg_at_10_diff1\": 0.48659095860512674,\n        \"nauc_ndcg_at_10_max\": 0.5306997041080913,\n        \"nauc_ndcg_at_10_std\": 0.09827948773797913,\n        \"nauc_ndcg_at_1_diff1\": 0.5934927299730468,\n        \"nauc_ndcg_at_1_max\": 0.5180696382405251,\n        \"nauc_ndcg_at_1_std\": 0.023432772878123738,\n        \"nauc_ndcg_at_20_diff1\": 0.4662179168588857,\n        \"nauc_ndcg_at_20_max\": 0.5166720253899405,\n        \"nauc_ndcg_at_20_std\": 0.11924750957281219,\n        \"nauc_ndcg_at_3_diff1\": 0.5024480480565693,\n        \"nauc_ndcg_at_3_max\": 0.5281856243842368,\n        \"nauc_ndcg_at_3_std\": 0.08633380109016073,\n        \"nauc_ndcg_at_5_diff1\": 0.5002530444688492,\n        \"nauc_ndcg_at_5_max\": 0.5181217847759284,\n        \"nauc_ndcg_at_5_std\": 0.10348046484708498,\n        \"nauc_precision_at_1000_diff1\": 0.28709694740515956,\n        \"nauc_precision_at_1000_max\": 0.4903482159637017,\n        \"nauc_precision_at_1000_std\": 0.6286546567508802,\n        \"nauc_precision_at_100_diff1\": 0.3174783690136539,\n        \"nauc_precision_at_100_max\": 0.4325266189155581,\n        \"nauc_precision_at_100_std\": 0.20916714883315735,\n        \"nauc_precision_at_10_diff1\": 0.40477040781286505,\n        \"nauc_precision_at_10_max\": 0.5445586033542574,\n        \"nauc_precision_at_10_std\": 0.1402895485076166,\n        \"nauc_precision_at_1_diff1\": 0.5934927299730468,\n        \"nauc_precision_at_1_max\": 0.5180696382405251,\n        \"nauc_precision_at_1_std\": 0.023432772878123738,\n        \"nauc_precision_at_20_diff1\": 0.3454784640456575,\n        \"nauc_precision_at_20_max\": 0.502143450857708,\n        \"nauc_precision_at_20_std\": 0.21520901100195702,\n        \"nauc_precision_at_3_diff1\": 0.4409481246472753,\n        \"nauc_precision_at_3_max\": 0.5342047863821483,\n        \"nauc_precision_at_3_std\": 0.12512774362807152,\n        \"nauc_precision_at_5_diff1\": 0.4373746874020287,\n        \"nauc_precision_at_5_max\": 0.5119097093112275,\n        \"nauc_precision_at_5_std\": 0.15933565184423698,\n        \"nauc_recall_at_1000_diff1\": 0.28709694740516095,\n        \"nauc_recall_at_1000_max\": 0.49034821596370226,\n        \"nauc_recall_at_1000_std\": 0.628654656750879,\n        \"nauc_recall_at_100_diff1\": 0.3174783690136534,\n        \"nauc_recall_at_100_max\": 0.43252661891555766,\n        \"nauc_recall_at_100_std\": 0.20916714883315712,\n        \"nauc_recall_at_10_diff1\": 0.40477040781286494,\n        \"nauc_recall_at_10_max\": 0.5445586033542575,\n        \"nauc_recall_at_10_std\": 0.14028954850761638,\n        \"nauc_recall_at_1_diff1\": 0.5934927299730468,\n        \"nauc_recall_at_1_max\": 0.5180696382405251,\n        \"nauc_recall_at_1_std\": 0.023432772878123738,\n        \"nauc_recall_at_20_diff1\": 0.34547846404565713,\n        \"nauc_recall_at_20_max\": 0.5021434508577074,\n        \"nauc_recall_at_20_std\": 0.21520901100195683,\n        \"nauc_recall_at_3_diff1\": 0.44094812464727506,\n        \"nauc_recall_at_3_max\": 0.534204786382148,\n        \"nauc_recall_at_3_std\": 0.12512774362807147,\n        \"nauc_recall_at_5_diff1\": 0.43737468740202834,\n        \"nauc_recall_at_5_max\": 0.5119097093112275,\n        \"nauc_recall_at_5_std\": 0.15933565184423693,\n        \"ndcg_at_1\": 0.17,\n        \"ndcg_at_10\": 0.22486,\n        \"ndcg_at_100\": 0.26791,\n        \"ndcg_at_1000\": 0.30737,\n        \"ndcg_at_20\": 0.24349,\n        \"ndcg_at_3\": 0.20327,\n        \"ndcg_at_5\": 0.2136,\n        \"precision_at_1\": 0.17,\n        \"precision_at_10\": 0.029,\n        \"precision_at_100\": 0.00495,\n        \"precision_at_1000\": 0.00082,\n        \"precision_at_20\": 0.01825,\n        \"precision_at_3\": 0.07667,\n        \"precision_at_5\": 0.051,\n        \"recall_at_1\": 0.17,\n        \"recall_at_10\": 0.29,\n        \"recall_at_100\": 0.495,\n        \"recall_at_1000\": 0.815,\n        \"recall_at_20\": 0.365,\n        \"recall_at_3\": 0.23,\n        \"recall_at_5\": 0.255\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-base/intfloat__multilingual-e5-base/d13f1b27baf31030b7fd040960d60d909913633f/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 2.6252050399780273,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.77203,\n        \"map_at_1\": 0.58442,\n        \"map_at_10\": 0.7159,\n        \"map_at_100\": 0.71802,\n        \"map_at_1000\": 0.71802,\n        \"map_at_20\": 0.71677,\n        \"map_at_3\": 0.69264,\n        \"map_at_5\": 0.70238,\n        \"mrr_at_1\": 0.5844155844155844,\n        \"mrr_at_10\": 0.7159039373325088,\n        \"mrr_at_100\": 0.7180190902896827,\n        \"mrr_at_1000\": 0.7180190902896827,\n        \"mrr_at_20\": 0.7167697381983097,\n        \"mrr_at_3\": 0.6926406926406926,\n        \"mrr_at_5\": 0.7023809523809523,\n        \"nauc_map_at_1000_diff1\": 0.7049122955851462,\n        \"nauc_map_at_1000_max\": 0.1749739403055711,\n        \"nauc_map_at_1000_std\": -0.11753044732058268,\n        \"nauc_map_at_100_diff1\": 0.7049122955851462,\n        \"nauc_map_at_100_max\": 0.1749739403055711,\n        \"nauc_map_at_100_std\": -0.11753044732058268,\n        \"nauc_map_at_10_diff1\": 0.7059280638537124,\n        \"nauc_map_at_10_max\": 0.17576332204748918,\n        \"nauc_map_at_10_std\": -0.11259325010112323,\n        \"nauc_map_at_1_diff1\": 0.7730849905549931,\n        \"nauc_map_at_1_max\": 0.16323654437643398,\n        \"nauc_map_at_1_std\": -0.15463541123486912,\n        \"nauc_map_at_20_diff1\": 0.7048274115980733,\n        \"nauc_map_at_20_max\": 0.17371661217517576,\n        \"nauc_map_at_20_std\": -0.11626608139650574,\n        \"nauc_map_at_3_diff1\": 0.6895156048217616,\n        \"nauc_map_at_3_max\": 0.18438045879970635,\n        \"nauc_map_at_3_std\": -0.0969266403909441,\n        \"nauc_map_at_5_diff1\": 0.689721270225883,\n        \"nauc_map_at_5_max\": 0.18085499936323893,\n        \"nauc_map_at_5_std\": -0.11320280218313829,\n        \"nauc_mrr_at_1000_diff1\": 0.7049122955851462,\n        \"nauc_mrr_at_1000_max\": 0.1749739403055711,\n        \"nauc_mrr_at_1000_std\": -0.11753044732058268,\n        \"nauc_mrr_at_100_diff1\": 0.7049122955851462,\n        \"nauc_mrr_at_100_max\": 0.1749739403055711,\n        \"nauc_mrr_at_100_std\": -0.11753044732058268,\n        \"nauc_mrr_at_10_diff1\": 0.7059280638537124,\n        \"nauc_mrr_at_10_max\": 0.17576332204748918,\n        \"nauc_mrr_at_10_std\": -0.11259325010112323,\n        \"nauc_mrr_at_1_diff1\": 0.7730849905549931,\n        \"nauc_mrr_at_1_max\": 0.16323654437643398,\n        \"nauc_mrr_at_1_std\": -0.15463541123486912,\n        \"nauc_mrr_at_20_diff1\": 0.7048274115980733,\n        \"nauc_mrr_at_20_max\": 0.17371661217517576,\n        \"nauc_mrr_at_20_std\": -0.11626608139650574,\n        \"nauc_mrr_at_3_diff1\": 0.6895156048217616,\n        \"nauc_mrr_at_3_max\": 0.18438045879970635,\n        \"nauc_mrr_at_3_std\": -0.0969266403909441,\n        \"nauc_mrr_at_5_diff1\": 0.689721270225883,\n        \"nauc_mrr_at_5_max\": 0.18085499936323893,\n        \"nauc_mrr_at_5_std\": -0.11320280218313829,\n        \"nauc_ndcg_at_1000_diff1\": 0.6972930152328541,\n        \"nauc_ndcg_at_1000_max\": 0.17338517487228328,\n        \"nauc_ndcg_at_1000_std\": -0.1123379011258602,\n        \"nauc_ndcg_at_100_diff1\": 0.6972930152328541,\n        \"nauc_ndcg_at_100_max\": 0.17338517487228328,\n        \"nauc_ndcg_at_100_std\": -0.1123379011258602,\n        \"nauc_ndcg_at_10_diff1\": 0.7000221387691848,\n        \"nauc_ndcg_at_10_max\": 0.17175618246048177,\n        \"nauc_ndcg_at_10_std\": -0.08579200170290963,\n        \"nauc_ndcg_at_1_diff1\": 0.7730849905549931,\n        \"nauc_ndcg_at_1_max\": 0.16323654437643398,\n        \"nauc_ndcg_at_1_std\": -0.15463541123486912,\n        \"nauc_ndcg_at_20_diff1\": 0.6947883208861702,\n        \"nauc_ndcg_at_20_max\": 0.16214537299119408,\n        \"nauc_ndcg_at_20_std\": -0.10244557663552743,\n        \"nauc_ndcg_at_3_diff1\": 0.6574658310748505,\n        \"nauc_ndcg_at_3_max\": 0.19094549989384266,\n        \"nauc_ndcg_at_3_std\": -0.07151120593375672,\n        \"nauc_ndcg_at_5_diff1\": 0.6557380415427442,\n        \"nauc_ndcg_at_5_max\": 0.18463280081684605,\n        \"nauc_ndcg_at_5_std\": -0.1009792734356102,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.7120602067801151,\n        \"nauc_precision_at_10_max\": 0.09791382994502315,\n        \"nauc_precision_at_10_std\": 0.31479849081120154,\n        \"nauc_precision_at_1_diff1\": 0.7730849905549931,\n        \"nauc_precision_at_1_max\": 0.16323654437643398,\n        \"nauc_precision_at_1_std\": -0.15463541123486912,\n        \"nauc_precision_at_20_diff1\": 0.616080275706823,\n        \"nauc_precision_at_20_max\": -0.11031577525540454,\n        \"nauc_precision_at_20_std\": 0.1301604202575047,\n        \"nauc_precision_at_3_diff1\": 0.5312918444354878,\n        \"nauc_precision_at_3_max\": 0.2160886881649667,\n        \"nauc_precision_at_3_std\": 0.03003794963804101,\n        \"nauc_precision_at_5_diff1\": 0.4967070686214641,\n        \"nauc_precision_at_5_max\": 0.20013872348340253,\n        \"nauc_precision_at_5_std\": -0.04801064361272453,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.7120602067801166,\n        \"nauc_recall_at_10_max\": 0.09791382994501428,\n        \"nauc_recall_at_10_std\": 0.3147984908111977,\n        \"nauc_recall_at_1_diff1\": 0.7730849905549931,\n        \"nauc_recall_at_1_max\": 0.16323654437643398,\n        \"nauc_recall_at_1_std\": -0.15463541123486912,\n        \"nauc_recall_at_20_diff1\": 0.6160802757068197,\n        \"nauc_recall_at_20_max\": -0.1103157752554104,\n        \"nauc_recall_at_20_std\": 0.13016042025750219,\n        \"nauc_recall_at_3_diff1\": 0.5312918444354875,\n        \"nauc_recall_at_3_max\": 0.2160886881649647,\n        \"nauc_recall_at_3_std\": 0.03003794963803853,\n        \"nauc_recall_at_5_diff1\": 0.49670706862146197,\n        \"nauc_recall_at_5_max\": 0.20013872348340017,\n        \"nauc_recall_at_5_std\": -0.048010643612726514,\n        \"ndcg_at_1\": 0.58442,\n        \"ndcg_at_10\": 0.77203,\n        \"ndcg_at_100\": 0.78303,\n        \"ndcg_at_1000\": 0.78303,\n        \"ndcg_at_20\": 0.77528,\n        \"ndcg_at_3\": 0.72201,\n        \"ndcg_at_5\": 0.73879,\n        \"precision_at_1\": 0.58442,\n        \"precision_at_10\": 0.09481,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04805,\n        \"precision_at_3\": 0.2684,\n        \"precision_at_5\": 0.16883,\n        \"recall_at_1\": 0.58442,\n        \"recall_at_10\": 0.94805,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96104,\n        \"recall_at_3\": 0.80519,\n        \"recall_at_5\": 0.84416\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-base/intfloat__multilingual-e5-base/d13f1b27baf31030b7fd040960d60d909913633f/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 16.628807067871094,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.3607,\n        \"map_at_1\": 0.21481,\n        \"map_at_10\": 0.3182,\n        \"map_at_100\": 0.33387,\n        \"map_at_1000\": 0.33517,\n        \"map_at_20\": 0.32628,\n        \"map_at_3\": 0.2905,\n        \"map_at_5\": 0.30788,\n        \"mrr_at_1\": 0.30275229357798167,\n        \"mrr_at_10\": 0.36139568467550115,\n        \"mrr_at_100\": 0.3727459173479044,\n        \"mrr_at_1000\": 0.3735149401359442,\n        \"mrr_at_20\": 0.3669863817077084,\n        \"mrr_at_3\": 0.3440366972477066,\n        \"mrr_at_5\": 0.35328746177370046,\n        \"nauc_map_at_1000_diff1\": 0.42963585760689943,\n        \"nauc_map_at_1000_max\": 0.20892123488970232,\n        \"nauc_map_at_1000_std\": -0.2431027065544824,\n        \"nauc_map_at_100_diff1\": 0.42937913438871533,\n        \"nauc_map_at_100_max\": 0.2090349260230252,\n        \"nauc_map_at_100_std\": -0.24287170422372528,\n        \"nauc_map_at_10_diff1\": 0.4304977743091833,\n        \"nauc_map_at_10_max\": 0.20818062207572038,\n        \"nauc_map_at_10_std\": -0.2470407473817399,\n        \"nauc_map_at_1_diff1\": 0.48514432281307956,\n        \"nauc_map_at_1_max\": 0.15959686126723213,\n        \"nauc_map_at_1_std\": -0.20796331653269645,\n        \"nauc_map_at_20_diff1\": 0.4305756124522112,\n        \"nauc_map_at_20_max\": 0.20730123860183938,\n        \"nauc_map_at_20_std\": -0.24760022109278698,\n        \"nauc_map_at_3_diff1\": 0.4426742232767405,\n        \"nauc_map_at_3_max\": 0.21074344546441529,\n        \"nauc_map_at_3_std\": -0.2386688960545258,\n        \"nauc_map_at_5_diff1\": 0.4332746920752696,\n        \"nauc_map_at_5_max\": 0.2133348686910522,\n        \"nauc_map_at_5_std\": -0.24223475070935185,\n        \"nauc_mrr_at_1000_diff1\": 0.44625683270525074,\n        \"nauc_mrr_at_1000_max\": 0.2106574277517107,\n        \"nauc_mrr_at_1000_std\": -0.2677092441216044,\n        \"nauc_mrr_at_100_diff1\": 0.4461128558106053,\n        \"nauc_mrr_at_100_max\": 0.21078043248107986,\n        \"nauc_mrr_at_100_std\": -0.2674632995361709,\n        \"nauc_mrr_at_10_diff1\": 0.444987740964291,\n        \"nauc_mrr_at_10_max\": 0.20799867789822493,\n        \"nauc_mrr_at_10_std\": -0.2729638141198885,\n        \"nauc_mrr_at_1_diff1\": 0.48504640241831776,\n        \"nauc_mrr_at_1_max\": 0.22365383306396908,\n        \"nauc_mrr_at_1_std\": -0.26645605434126035,\n        \"nauc_mrr_at_20_diff1\": 0.4466793381008902,\n        \"nauc_mrr_at_20_max\": 0.21003273255434113,\n        \"nauc_mrr_at_20_std\": -0.2696298492568519,\n        \"nauc_mrr_at_3_diff1\": 0.4504803999602948,\n        \"nauc_mrr_at_3_max\": 0.20896914537040218,\n        \"nauc_mrr_at_3_std\": -0.2730896968385306,\n        \"nauc_mrr_at_5_diff1\": 0.44887921995905455,\n        \"nauc_mrr_at_5_max\": 0.20983553173203578,\n        \"nauc_mrr_at_5_std\": -0.2729058093449394,\n        \"nauc_ndcg_at_1000_diff1\": 0.42053386492803835,\n        \"nauc_ndcg_at_1000_max\": 0.21026761107634181,\n        \"nauc_ndcg_at_1000_std\": -0.23853119910664403,\n        \"nauc_ndcg_at_100_diff1\": 0.4124642636421199,\n        \"nauc_ndcg_at_100_max\": 0.21297954341153955,\n        \"nauc_ndcg_at_100_std\": -0.2270552761293387,\n        \"nauc_ndcg_at_10_diff1\": 0.4163086383546011,\n        \"nauc_ndcg_at_10_max\": 0.1999755251857054,\n        \"nauc_ndcg_at_10_std\": -0.2601310454387032,\n        \"nauc_ndcg_at_1_diff1\": 0.48504640241831776,\n        \"nauc_ndcg_at_1_max\": 0.22365383306396908,\n        \"nauc_ndcg_at_1_std\": -0.26645605434126035,\n        \"nauc_ndcg_at_20_diff1\": 0.41834947593121535,\n        \"nauc_ndcg_at_20_max\": 0.2003429851075697,\n        \"nauc_ndcg_at_20_std\": -0.25606159299219916,\n        \"nauc_ndcg_at_3_diff1\": 0.43553101733767347,\n        \"nauc_ndcg_at_3_max\": 0.20549898662174343,\n        \"nauc_ndcg_at_3_std\": -0.2533596592071201,\n        \"nauc_ndcg_at_5_diff1\": 0.4225304579550925,\n        \"nauc_ndcg_at_5_max\": 0.2068825667359891,\n        \"nauc_ndcg_at_5_std\": -0.2544813137224287,\n        \"nauc_precision_at_1000_diff1\": -0.018914124872467415,\n        \"nauc_precision_at_1000_max\": 0.13281207973414894,\n        \"nauc_precision_at_1000_std\": 0.03702777512602303,\n        \"nauc_precision_at_100_diff1\": 0.08052988850710768,\n        \"nauc_precision_at_100_max\": 0.1831172991717435,\n        \"nauc_precision_at_100_std\": 0.0015248727721582668,\n        \"nauc_precision_at_10_diff1\": 0.2383661017481684,\n        \"nauc_precision_at_10_max\": 0.1794621672513022,\n        \"nauc_precision_at_10_std\": -0.23894429362629943,\n        \"nauc_precision_at_1_diff1\": 0.48504640241831776,\n        \"nauc_precision_at_1_max\": 0.22365383306396908,\n        \"nauc_precision_at_1_std\": -0.26645605434126035,\n        \"nauc_precision_at_20_diff1\": 0.2085622758297434,\n        \"nauc_precision_at_20_max\": 0.16392545018550997,\n        \"nauc_precision_at_20_std\": -0.20028651530585947,\n        \"nauc_precision_at_3_diff1\": 0.3197277868626114,\n        \"nauc_precision_at_3_max\": 0.23054771411644534,\n        \"nauc_precision_at_3_std\": -0.26043053473303907,\n        \"nauc_precision_at_5_diff1\": 0.27302904750591267,\n        \"nauc_precision_at_5_max\": 0.211260301971109,\n        \"nauc_precision_at_5_std\": -0.24206268208121878,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.28168730538400805,\n        \"nauc_recall_at_100_max\": 0.22809734919206476,\n        \"nauc_recall_at_100_std\": -0.0639689151589093,\n        \"nauc_recall_at_10_diff1\": 0.34935722006409087,\n        \"nauc_recall_at_10_max\": 0.17132518446252754,\n        \"nauc_recall_at_10_std\": -0.2645301871034324,\n        \"nauc_recall_at_1_diff1\": 0.48514432281307956,\n        \"nauc_recall_at_1_max\": 0.15959686126723213,\n        \"nauc_recall_at_1_std\": -0.20796331653269645,\n        \"nauc_recall_at_20_diff1\": 0.3551238752877474,\n        \"nauc_recall_at_20_max\": 0.17073061417496116,\n        \"nauc_recall_at_20_std\": -0.25110422810336486,\n        \"nauc_recall_at_3_diff1\": 0.3936308854125494,\n        \"nauc_recall_at_3_max\": 0.18498685148507174,\n        \"nauc_recall_at_3_std\": -0.24862344210225615,\n        \"nauc_recall_at_5_diff1\": 0.3677562165817916,\n        \"nauc_recall_at_5_max\": 0.18766267088899702,\n        \"nauc_recall_at_5_std\": -0.25256901516345587,\n        \"ndcg_at_1\": 0.30275,\n        \"ndcg_at_10\": 0.3607,\n        \"ndcg_at_100\": 0.43626,\n        \"ndcg_at_1000\": 0.46606,\n        \"ndcg_at_20\": 0.38572,\n        \"ndcg_at_3\": 0.31866,\n        \"ndcg_at_5\": 0.33908,\n        \"precision_at_1\": 0.30275,\n        \"precision_at_10\": 0.07141,\n        \"precision_at_100\": 0.01248,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.04297,\n        \"precision_at_3\": 0.17482,\n        \"precision_at_5\": 0.12263,\n        \"recall_at_1\": 0.21481,\n        \"recall_at_10\": 0.44429,\n        \"recall_at_100\": 0.78193,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.53168,\n        \"recall_at_3\": 0.33372,\n        \"recall_at_5\": 0.38509\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.20148,\n        \"map_at_1\": 0.09414,\n        \"map_at_10\": 0.15803,\n        \"map_at_100\": 0.1757,\n        \"map_at_1000\": 0.17866,\n        \"map_at_20\": 0.16692,\n        \"map_at_3\": 0.13541,\n        \"map_at_5\": 0.14789,\n        \"mrr_at_1\": 0.17889908256880735,\n        \"mrr_at_10\": 0.2286703315373039,\n        \"mrr_at_100\": 0.241428725969669,\n        \"mrr_at_1000\": 0.2427723235325885,\n        \"mrr_at_20\": 0.23509999732785672,\n        \"mrr_at_3\": 0.20998980632008152,\n        \"mrr_at_5\": 0.21847604485219163,\n        \"nauc_map_at_1000_diff1\": 0.30539350162203316,\n        \"nauc_map_at_1000_max\": 0.24034173633656167,\n        \"nauc_map_at_1000_std\": -0.08103295111936148,\n        \"nauc_map_at_100_diff1\": 0.30489058048932155,\n        \"nauc_map_at_100_max\": 0.24119416853033185,\n        \"nauc_map_at_100_std\": -0.08083640255787466,\n        \"nauc_map_at_10_diff1\": 0.3056511815165923,\n        \"nauc_map_at_10_max\": 0.22596714633779053,\n        \"nauc_map_at_10_std\": -0.10241596640938393,\n        \"nauc_map_at_1_diff1\": 0.42383841325418287,\n        \"nauc_map_at_1_max\": 0.250405206326011,\n        \"nauc_map_at_1_std\": -0.13520336912467026,\n        \"nauc_map_at_20_diff1\": 0.3057776643050341,\n        \"nauc_map_at_20_max\": 0.23641728576352428,\n        \"nauc_map_at_20_std\": -0.09051814637606816,\n        \"nauc_map_at_3_diff1\": 0.3308851492829308,\n        \"nauc_map_at_3_max\": 0.22854232581291226,\n        \"nauc_map_at_3_std\": -0.10839033935341609,\n        \"nauc_map_at_5_diff1\": 0.31457141895678165,\n        \"nauc_map_at_5_max\": 0.2243829020636881,\n        \"nauc_map_at_5_std\": -0.11013395271043995,\n        \"nauc_mrr_at_1000_diff1\": 0.31889757879784597,\n        \"nauc_mrr_at_1000_max\": 0.22436637919163335,\n        \"nauc_mrr_at_1000_std\": -0.07825944228943346,\n        \"nauc_mrr_at_100_diff1\": 0.31855404076186933,\n        \"nauc_mrr_at_100_max\": 0.22480172438918175,\n        \"nauc_mrr_at_100_std\": -0.07726923319110378,\n        \"nauc_mrr_at_10_diff1\": 0.3177409232150682,\n        \"nauc_mrr_at_10_max\": 0.21907309827774715,\n        \"nauc_mrr_at_10_std\": -0.08561257776101205,\n        \"nauc_mrr_at_1_diff1\": 0.3948794314506051,\n        \"nauc_mrr_at_1_max\": 0.2504301745012543,\n        \"nauc_mrr_at_1_std\": -0.10573813009386544,\n        \"nauc_mrr_at_20_diff1\": 0.31854162686673243,\n        \"nauc_mrr_at_20_max\": 0.22334733477690014,\n        \"nauc_mrr_at_20_std\": -0.07996475055973579,\n        \"nauc_mrr_at_3_diff1\": 0.3306660624982572,\n        \"nauc_mrr_at_3_max\": 0.22066001330319143,\n        \"nauc_mrr_at_3_std\": -0.0935538960245645,\n        \"nauc_mrr_at_5_diff1\": 0.3215903882649284,\n        \"nauc_mrr_at_5_max\": 0.21498576898930763,\n        \"nauc_mrr_at_5_std\": -0.09712281554924904,\n        \"nauc_ndcg_at_1000_diff1\": 0.28568574379509243,\n        \"nauc_ndcg_at_1000_max\": 0.24343162091807738,\n        \"nauc_ndcg_at_1000_std\": -0.03778789550660657,\n        \"nauc_ndcg_at_100_diff1\": 0.2725495542324967,\n        \"nauc_ndcg_at_100_max\": 0.26547890081249387,\n        \"nauc_ndcg_at_100_std\": -0.01087246106286027,\n        \"nauc_ndcg_at_10_diff1\": 0.2790712927892886,\n        \"nauc_ndcg_at_10_max\": 0.2204802656578329,\n        \"nauc_ndcg_at_10_std\": -0.08315669038036567,\n        \"nauc_ndcg_at_1_diff1\": 0.4033369499664993,\n        \"nauc_ndcg_at_1_max\": 0.25281952813321773,\n        \"nauc_ndcg_at_1_std\": -0.10322278163978298,\n        \"nauc_ndcg_at_20_diff1\": 0.28192700653801284,\n        \"nauc_ndcg_at_20_max\": 0.24675490880933862,\n        \"nauc_ndcg_at_20_std\": -0.05094524679791449,\n        \"nauc_ndcg_at_3_diff1\": 0.30540317541255185,\n        \"nauc_ndcg_at_3_max\": 0.21933385751984275,\n        \"nauc_ndcg_at_3_std\": -0.09785653718888704,\n        \"nauc_ndcg_at_5_diff1\": 0.290223062445283,\n        \"nauc_ndcg_at_5_max\": 0.21300270312838201,\n        \"nauc_ndcg_at_5_std\": -0.10367682596724503,\n        \"nauc_precision_at_1000_diff1\": 0.02383291229758173,\n        \"nauc_precision_at_1000_max\": 0.027010048687200763,\n        \"nauc_precision_at_1000_std\": 0.09102651003545263,\n        \"nauc_precision_at_100_diff1\": 0.09759601754061357,\n        \"nauc_precision_at_100_max\": 0.2321220026260983,\n        \"nauc_precision_at_100_std\": 0.17556095540343836,\n        \"nauc_precision_at_10_diff1\": 0.18029298355404208,\n        \"nauc_precision_at_10_max\": 0.19742365753024946,\n        \"nauc_precision_at_10_std\": -0.022400643864277075,\n        \"nauc_precision_at_1_diff1\": 0.4033369499664993,\n        \"nauc_precision_at_1_max\": 0.25281952813321773,\n        \"nauc_precision_at_1_std\": -0.10322278163978298,\n        \"nauc_precision_at_20_diff1\": 0.17529097352342055,\n        \"nauc_precision_at_20_max\": 0.23367065227326117,\n        \"nauc_precision_at_20_std\": 0.04838154362383047,\n        \"nauc_precision_at_3_diff1\": 0.24438827121376572,\n        \"nauc_precision_at_3_max\": 0.21076596647953377,\n        \"nauc_precision_at_3_std\": -0.06626938359139384,\n        \"nauc_precision_at_5_diff1\": 0.20700221690766976,\n        \"nauc_precision_at_5_max\": 0.18749098508944212,\n        \"nauc_precision_at_5_std\": -0.07188348358340925,\n        \"nauc_recall_at_1000_diff1\": 0.5758326388163159,\n        \"nauc_recall_at_1000_max\": 0.8156349912513978,\n        \"nauc_recall_at_1000_std\": 0.7555715146667914,\n        \"nauc_recall_at_100_diff1\": 0.1418479527830795,\n        \"nauc_recall_at_100_max\": 0.31793376334708096,\n        \"nauc_recall_at_100_std\": 0.17142940080470698,\n        \"nauc_recall_at_10_diff1\": 0.1946626084556666,\n        \"nauc_recall_at_10_max\": 0.19458983448728884,\n        \"nauc_recall_at_10_std\": -0.051337513468547806,\n        \"nauc_recall_at_1_diff1\": 0.42383841325418287,\n        \"nauc_recall_at_1_max\": 0.250405206326011,\n        \"nauc_recall_at_1_std\": -0.13520336912467026,\n        \"nauc_recall_at_20_diff1\": 0.20122402738932615,\n        \"nauc_recall_at_20_max\": 0.2629741535771735,\n        \"nauc_recall_at_20_std\": 0.034103975248139094,\n        \"nauc_recall_at_3_diff1\": 0.24753555717964568,\n        \"nauc_recall_at_3_max\": 0.19120399927021967,\n        \"nauc_recall_at_3_std\": -0.08494071412694883,\n        \"nauc_recall_at_5_diff1\": 0.21679989815496223,\n        \"nauc_recall_at_5_max\": 0.18119340444328566,\n        \"nauc_recall_at_5_std\": -0.09814578598765797,\n        \"ndcg_at_1\": 0.17737,\n        \"ndcg_at_10\": 0.20148,\n        \"ndcg_at_100\": 0.28543,\n        \"ndcg_at_1000\": 0.34227,\n        \"ndcg_at_20\": 0.22923,\n        \"ndcg_at_3\": 0.16856,\n        \"ndcg_at_5\": 0.17856,\n        \"precision_at_1\": 0.17737,\n        \"precision_at_10\": 0.05291,\n        \"precision_at_100\": 0.01229,\n        \"precision_at_1000\": 0.00194,\n        \"precision_at_20\": 0.0354,\n        \"precision_at_3\": 0.11009,\n        \"precision_at_5\": 0.08135,\n        \"recall_at_1\": 0.09414,\n        \"recall_at_10\": 0.26055,\n        \"recall_at_100\": 0.61476,\n        \"recall_at_1000\": 0.99592,\n        \"recall_at_20\": 0.35497,\n        \"recall_at_3\": 0.16374,\n        \"recall_at_5\": 0.20064\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.29263,\n        \"map_at_1\": 0.14722,\n        \"map_at_10\": 0.24572,\n        \"map_at_100\": 0.26066,\n        \"map_at_1000\": 0.26234,\n        \"map_at_20\": 0.25264,\n        \"map_at_3\": 0.2117,\n        \"map_at_5\": 0.23153,\n        \"mrr_at_1\": 0.2182410423452769,\n        \"mrr_at_10\": 0.2844462540716614,\n        \"mrr_at_100\": 0.29499249139067935,\n        \"mrr_at_1000\": 0.2960265190976579,\n        \"mrr_at_20\": 0.2901179168210185,\n        \"mrr_at_3\": 0.26112920738327916,\n        \"mrr_at_5\": 0.2736699239956571,\n        \"nauc_map_at_1000_diff1\": 0.36364393096869635,\n        \"nauc_map_at_1000_max\": 0.1801080153267461,\n        \"nauc_map_at_1000_std\": -0.08999792998748074,\n        \"nauc_map_at_100_diff1\": 0.3630141643535187,\n        \"nauc_map_at_100_max\": 0.17991407524169148,\n        \"nauc_map_at_100_std\": -0.08982299640070364,\n        \"nauc_map_at_10_diff1\": 0.3658732019343366,\n        \"nauc_map_at_10_max\": 0.17822484528135826,\n        \"nauc_map_at_10_std\": -0.09279843246339788,\n        \"nauc_map_at_1_diff1\": 0.5070734238811194,\n        \"nauc_map_at_1_max\": 0.24529236270282476,\n        \"nauc_map_at_1_std\": -0.004688212359841111,\n        \"nauc_map_at_20_diff1\": 0.36207907758581914,\n        \"nauc_map_at_20_max\": 0.17525189915636535,\n        \"nauc_map_at_20_std\": -0.09435244487831614,\n        \"nauc_map_at_3_diff1\": 0.40295825342965635,\n        \"nauc_map_at_3_max\": 0.20104012126833412,\n        \"nauc_map_at_3_std\": -0.07628803518006758,\n        \"nauc_map_at_5_diff1\": 0.37612971547715945,\n        \"nauc_map_at_5_max\": 0.19077273609554368,\n        \"nauc_map_at_5_std\": -0.08499496025998478,\n        \"nauc_mrr_at_1000_diff1\": 0.3798619434872802,\n        \"nauc_mrr_at_1000_max\": 0.19885025712420953,\n        \"nauc_mrr_at_1000_std\": -0.10458091620949982,\n        \"nauc_mrr_at_100_diff1\": 0.37958597939618843,\n        \"nauc_mrr_at_100_max\": 0.19890610868394065,\n        \"nauc_mrr_at_100_std\": -0.10431192413324031,\n        \"nauc_mrr_at_10_diff1\": 0.3816613970826813,\n        \"nauc_mrr_at_10_max\": 0.19735653109654772,\n        \"nauc_mrr_at_10_std\": -0.10730444084305658,\n        \"nauc_mrr_at_1_diff1\": 0.4446874864765066,\n        \"nauc_mrr_at_1_max\": 0.23916999910934264,\n        \"nauc_mrr_at_1_std\": -0.08078870533756279,\n        \"nauc_mrr_at_20_diff1\": 0.37807188953601084,\n        \"nauc_mrr_at_20_max\": 0.19650524967244096,\n        \"nauc_mrr_at_20_std\": -0.10639377645047687,\n        \"nauc_mrr_at_3_diff1\": 0.3904534717117424,\n        \"nauc_mrr_at_3_max\": 0.21086282986637608,\n        \"nauc_mrr_at_3_std\": -0.1023624177806897,\n        \"nauc_mrr_at_5_diff1\": 0.38401972122916894,\n        \"nauc_mrr_at_5_max\": 0.20353606462281326,\n        \"nauc_mrr_at_5_std\": -0.10743586414085929,\n        \"nauc_ndcg_at_1000_diff1\": 0.3514196895142937,\n        \"nauc_ndcg_at_1000_max\": 0.1808114461842303,\n        \"nauc_ndcg_at_1000_std\": -0.08996523853646911,\n        \"nauc_ndcg_at_100_diff1\": 0.3395612777980135,\n        \"nauc_ndcg_at_100_max\": 0.1796525016824039,\n        \"nauc_ndcg_at_100_std\": -0.08122542384351605,\n        \"nauc_ndcg_at_10_diff1\": 0.34342650182736895,\n        \"nauc_ndcg_at_10_max\": 0.1598603925312353,\n        \"nauc_ndcg_at_10_std\": -0.10739253057810857,\n        \"nauc_ndcg_at_1_diff1\": 0.4446874864765066,\n        \"nauc_ndcg_at_1_max\": 0.23916999910934264,\n        \"nauc_ndcg_at_1_std\": -0.08078870533756279,\n        \"nauc_ndcg_at_20_diff1\": 0.3305328263689251,\n        \"nauc_ndcg_at_20_max\": 0.15180270912134258,\n        \"nauc_ndcg_at_20_std\": -0.10958156492422332,\n        \"nauc_ndcg_at_3_diff1\": 0.38377007939763225,\n        \"nauc_ndcg_at_3_max\": 0.19204739459298753,\n        \"nauc_ndcg_at_3_std\": -0.09359252897467076,\n        \"nauc_ndcg_at_5_diff1\": 0.3557709083054129,\n        \"nauc_ndcg_at_5_max\": 0.17921601582787194,\n        \"nauc_ndcg_at_5_std\": -0.1014947108412644,\n        \"nauc_precision_at_1000_diff1\": 0.006633055518163547,\n        \"nauc_precision_at_1000_max\": 0.08759636628632125,\n        \"nauc_precision_at_1000_std\": -0.014889287290916334,\n        \"nauc_precision_at_100_diff1\": 0.0617682685125337,\n        \"nauc_precision_at_100_max\": 0.11877558098393813,\n        \"nauc_precision_at_100_std\": -0.016417726786710003,\n        \"nauc_precision_at_10_diff1\": 0.13223329223196534,\n        \"nauc_precision_at_10_max\": 0.05442432624317679,\n        \"nauc_precision_at_10_std\": -0.17842192575142593,\n        \"nauc_precision_at_1_diff1\": 0.4446874864765066,\n        \"nauc_precision_at_1_max\": 0.23916999910934264,\n        \"nauc_precision_at_1_std\": -0.08078870533756279,\n        \"nauc_precision_at_20_diff1\": 0.09794018553176256,\n        \"nauc_precision_at_20_max\": 0.031054840058235694,\n        \"nauc_precision_at_20_std\": -0.16778270792399078,\n        \"nauc_precision_at_3_diff1\": 0.2205084203050175,\n        \"nauc_precision_at_3_max\": 0.1352735356527621,\n        \"nauc_precision_at_3_std\": -0.1604897997884064,\n        \"nauc_precision_at_5_diff1\": 0.15387150754118664,\n        \"nauc_precision_at_5_max\": 0.1003284578634536,\n        \"nauc_precision_at_5_std\": -0.16309786348639163,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.23543072434985665,\n        \"nauc_recall_at_100_max\": 0.1641127988377667,\n        \"nauc_recall_at_100_std\": 0.0010560715079287173,\n        \"nauc_recall_at_10_diff1\": 0.2634681061506411,\n        \"nauc_recall_at_10_max\": 0.09287986292947803,\n        \"nauc_recall_at_10_std\": -0.11951474652894345,\n        \"nauc_recall_at_1_diff1\": 0.5070734238811194,\n        \"nauc_recall_at_1_max\": 0.24529236270282476,\n        \"nauc_recall_at_1_std\": -0.004688212359841111,\n        \"nauc_recall_at_20_diff1\": 0.2156825749351031,\n        \"nauc_recall_at_20_max\": 0.06392647995897967,\n        \"nauc_recall_at_20_std\": -0.12668293400209021,\n        \"nauc_recall_at_3_diff1\": 0.35395455611773263,\n        \"nauc_recall_at_3_max\": 0.1744699445576355,\n        \"nauc_recall_at_3_std\": -0.08642018776428495,\n        \"nauc_recall_at_5_diff1\": 0.2927550794400118,\n        \"nauc_recall_at_5_max\": 0.1343446345451416,\n        \"nauc_recall_at_5_std\": -0.11348758147177891,\n        \"ndcg_at_1\": 0.21824,\n        \"ndcg_at_10\": 0.29263,\n        \"ndcg_at_100\": 0.3642,\n        \"ndcg_at_1000\": 0.40446,\n        \"ndcg_at_20\": 0.31466,\n        \"ndcg_at_3\": 0.23881,\n        \"ndcg_at_5\": 0.26406,\n        \"precision_at_1\": 0.21824,\n        \"precision_at_10\": 0.06759,\n        \"precision_at_100\": 0.01236,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.04072,\n        \"precision_at_3\": 0.14224,\n        \"precision_at_5\": 0.10749,\n        \"recall_at_1\": 0.14722,\n        \"recall_at_10\": 0.39091,\n        \"recall_at_100\": 0.70168,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.466,\n        \"recall_at_3\": 0.24872,\n        \"recall_at_5\": 0.31177\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-base/intfloat__multilingual-e5-base/d13f1b27baf31030b7fd040960d60d909913633f/model_meta.json",
    "content": "{\"name\": \"intfloat/multilingual-e5-base\", \"revision\": \"d13f1b27baf31030b7fd040960d60d909913633f\", \"release_date\": \"2024-02-08\", \"languages\": [\"afr_Latn\", \"amh_Latn\", \"ara_Latn\", \"asm_Latn\", \"aze_Latn\", \"bel_Latn\", \"bul_Latn\", \"ben_Latn\", \"ben_Beng\", \"bre_Latn\", \"bos_Latn\", \"cat_Latn\", \"ces_Latn\", \"cym_Latn\", \"dan_Latn\", \"deu_Latn\", \"ell_Latn\", \"eng_Latn\", \"epo_Latn\", \"spa_Latn\", \"est_Latn\", \"eus_Latn\", \"fas_Latn\", \"fin_Latn\", \"fra_Latn\", \"fry_Latn\", \"gle_Latn\", \"gla_Latn\", \"glg_Latn\", \"guj_Latn\", \"hau_Latn\", \"heb_Latn\", \"hin_Latn\", \"hin_Deva\", \"hrv_Latn\", \"hun_Latn\", \"hye_Latn\", \"ind_Latn\", \"isl_Latn\", \"ita_Latn\", \"jpn_Latn\", \"jav_Latn\", \"kat_Latn\", \"kaz_Latn\", \"khm_Latn\", \"kan_Latn\", \"kor_Latn\", \"kur_Latn\", \"kir_Latn\", \"lat_Latn\", \"lao_Latn\", \"lit_Latn\", \"lav_Latn\", \"mlg_Latn\", \"mkd_Latn\", \"mal_Latn\", \"mon_Latn\", \"mar_Latn\", \"msa_Latn\", \"mya_Latn\", \"nep_Latn\", \"nld_Latn\", \"nob_Latn\", \"orm_Latn\", \"ori_Latn\", \"pan_Latn\", \"pol_Latn\", \"pus_Latn\", \"por_Latn\", \"ron_Latn\", \"rus_Latn\", \"san_Latn\", \"snd_Latn\", \"sin_Latn\", \"slk_Latn\", \"slv_Latn\", \"som_Latn\", \"sqi_Latn\", \"srp_Latn\", \"sun_Latn\", \"swe_Latn\", \"swa_Latn\", \"tam_Latn\", \"tam_Taml\", \"tel_Latn\", \"tel_Telu\", \"tha_Latn\", \"tgl_Latn\", \"tur_Latn\", \"uig_Latn\", \"ukr_Latn\", \"urd_Latn\", \"urd_Arab\", \"uzb_Latn\", \"vie_Latn\", \"xho_Latn\", \"yid_Latn\", \"zho_Hant\", \"zho_Hans\"], \"n_parameters\": 278000000, \"memory_usage\": null, \"max_tokens\": 514, \"embed_dim\": 768, \"license\": \"mit\", \"open_weights\": true, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"Sentence Transformers\", \"PyTorch\"], \"reference\": \"https://huggingface.co/intfloat/multilingual-e5-base\", \"similarity_fn_name\": \"cosine\", \"use_instructions\": true, \"zero_shot_benchmarks\": null, \"loader\": \"sentence_transformers_loader\"}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large/intfloat__multilingual-e5-large/ab10c1a7f42e74530fe7ae5be82e6d4f11a719eb/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 18.56531572341919,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.81337,\n        \"map_at_1\": 0.67544,\n        \"map_at_10\": 0.77253,\n        \"map_at_100\": 0.77541,\n        \"map_at_1000\": 0.77541,\n        \"map_at_20\": 0.77446,\n        \"map_at_3\": 0.75585,\n        \"map_at_5\": 0.76637,\n        \"mrr_at_1\": 0.6754385964912281,\n        \"mrr_at_10\": 0.7725250626566417,\n        \"mrr_at_100\": 0.77540714333768,\n        \"mrr_at_1000\": 0.77540714333768,\n        \"mrr_at_20\": 0.7744555517581834,\n        \"mrr_at_3\": 0.7558479532163744,\n        \"mrr_at_5\": 0.766374269005848,\n        \"nauc_map_at_1000_diff1\": 0.6882626899425819,\n        \"nauc_map_at_1000_max\": 0.13028712605706078,\n        \"nauc_map_at_1000_std\": -0.6333480833690052,\n        \"nauc_map_at_100_diff1\": 0.6882626899425819,\n        \"nauc_map_at_100_max\": 0.13028712605706078,\n        \"nauc_map_at_100_std\": -0.6333480833690052,\n        \"nauc_map_at_10_diff1\": 0.6837187235611711,\n        \"nauc_map_at_10_max\": 0.13476353281143322,\n        \"nauc_map_at_10_std\": -0.63489540113429,\n        \"nauc_map_at_1_diff1\": 0.7283217227535123,\n        \"nauc_map_at_1_max\": 0.08574937709970755,\n        \"nauc_map_at_1_std\": -0.6246105689080378,\n        \"nauc_map_at_20_diff1\": 0.6838263576041446,\n        \"nauc_map_at_20_max\": 0.1313812162496074,\n        \"nauc_map_at_20_std\": -0.6315026415983667,\n        \"nauc_map_at_3_diff1\": 0.6952310170994932,\n        \"nauc_map_at_3_max\": 0.11334045087831807,\n        \"nauc_map_at_3_std\": -0.6298824326505806,\n        \"nauc_map_at_5_diff1\": 0.6844736565258235,\n        \"nauc_map_at_5_max\": 0.13942038403835927,\n        \"nauc_map_at_5_std\": -0.6274947494869828,\n        \"nauc_mrr_at_1000_diff1\": 0.6882626899425819,\n        \"nauc_mrr_at_1000_max\": 0.13028712605706078,\n        \"nauc_mrr_at_1000_std\": -0.6333480833690052,\n        \"nauc_mrr_at_100_diff1\": 0.6882626899425819,\n        \"nauc_mrr_at_100_max\": 0.13028712605706078,\n        \"nauc_mrr_at_100_std\": -0.6333480833690052,\n        \"nauc_mrr_at_10_diff1\": 0.6837187235611711,\n        \"nauc_mrr_at_10_max\": 0.13476353281143322,\n        \"nauc_mrr_at_10_std\": -0.63489540113429,\n        \"nauc_mrr_at_1_diff1\": 0.7283217227535123,\n        \"nauc_mrr_at_1_max\": 0.08574937709970755,\n        \"nauc_mrr_at_1_std\": -0.6246105689080378,\n        \"nauc_mrr_at_20_diff1\": 0.6838263576041446,\n        \"nauc_mrr_at_20_max\": 0.1313812162496074,\n        \"nauc_mrr_at_20_std\": -0.6315026415983667,\n        \"nauc_mrr_at_3_diff1\": 0.6952310170994932,\n        \"nauc_mrr_at_3_max\": 0.11334045087831807,\n        \"nauc_mrr_at_3_std\": -0.6298824326505806,\n        \"nauc_mrr_at_5_diff1\": 0.6844736565258235,\n        \"nauc_mrr_at_5_max\": 0.13942038403835927,\n        \"nauc_mrr_at_5_std\": -0.6274947494869828,\n        \"nauc_ndcg_at_1000_diff1\": 0.6798177496497114,\n        \"nauc_ndcg_at_1000_max\": 0.13930225357339482,\n        \"nauc_ndcg_at_1000_std\": -0.6349323465994774,\n        \"nauc_ndcg_at_100_diff1\": 0.6798177496497114,\n        \"nauc_ndcg_at_100_max\": 0.13930225357339482,\n        \"nauc_ndcg_at_100_std\": -0.6349323465994774,\n        \"nauc_ndcg_at_10_diff1\": 0.6534305228357417,\n        \"nauc_ndcg_at_10_max\": 0.16337846477607224,\n        \"nauc_ndcg_at_10_std\": -0.6439472422010555,\n        \"nauc_ndcg_at_1_diff1\": 0.7283217227535123,\n        \"nauc_ndcg_at_1_max\": 0.08574937709970755,\n        \"nauc_ndcg_at_1_std\": -0.6246105689080378,\n        \"nauc_ndcg_at_20_diff1\": 0.6532504040101259,\n        \"nauc_ndcg_at_20_max\": 0.15154965569273673,\n        \"nauc_ndcg_at_20_std\": -0.62529669477198,\n        \"nauc_ndcg_at_3_diff1\": 0.6802176246485789,\n        \"nauc_ndcg_at_3_max\": 0.11876515078143252,\n        \"nauc_ndcg_at_3_std\": -0.6295132308461416,\n        \"nauc_ndcg_at_5_diff1\": 0.65782040297904,\n        \"nauc_ndcg_at_5_max\": 0.1710880020518264,\n        \"nauc_ndcg_at_5_std\": -0.623544324755987,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.3576107205133529,\n        \"nauc_precision_at_10_max\": 0.4417872910038361,\n        \"nauc_precision_at_10_std\": -0.7449071731142188,\n        \"nauc_precision_at_1_diff1\": 0.7283217227535123,\n        \"nauc_precision_at_1_max\": 0.08574937709970755,\n        \"nauc_precision_at_1_std\": -0.6246105689080378,\n        \"nauc_precision_at_20_diff1\": 0.13838797981732007,\n        \"nauc_precision_at_20_max\": 0.4593222978687597,\n        \"nauc_precision_at_20_std\": -0.4558779704077904,\n        \"nauc_precision_at_3_diff1\": 0.6150080982680898,\n        \"nauc_precision_at_3_max\": 0.13934586595258922,\n        \"nauc_precision_at_3_std\": -0.6267492848843961,\n        \"nauc_precision_at_5_diff1\": 0.5019388400138272,\n        \"nauc_precision_at_5_max\": 0.3582921076932564,\n        \"nauc_precision_at_5_std\": -0.5967482390704195,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.3576107205133534,\n        \"nauc_recall_at_10_max\": 0.44178729100383596,\n        \"nauc_recall_at_10_std\": -0.7449071731142182,\n        \"nauc_recall_at_1_diff1\": 0.7283217227535123,\n        \"nauc_recall_at_1_max\": 0.08574937709970755,\n        \"nauc_recall_at_1_std\": -0.6246105689080378,\n        \"nauc_recall_at_20_diff1\": 0.13838797981732298,\n        \"nauc_recall_at_20_max\": 0.4593222978687574,\n        \"nauc_recall_at_20_std\": -0.45587797040779265,\n        \"nauc_recall_at_3_diff1\": 0.6150080982680903,\n        \"nauc_recall_at_3_max\": 0.13934586595258888,\n        \"nauc_recall_at_3_std\": -0.6267492848843966,\n        \"nauc_recall_at_5_diff1\": 0.5019388400138263,\n        \"nauc_recall_at_5_max\": 0.35829210769325465,\n        \"nauc_recall_at_5_std\": -0.5967482390704182,\n        \"ndcg_at_1\": 0.67544,\n        \"ndcg_at_10\": 0.81337,\n        \"ndcg_at_100\": 0.82677,\n        \"ndcg_at_1000\": 0.82677,\n        \"ndcg_at_20\": 0.82015,\n        \"ndcg_at_3\": 0.78039,\n        \"ndcg_at_5\": 0.79889,\n        \"precision_at_1\": 0.67544,\n        \"precision_at_10\": 0.09386,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04825,\n        \"precision_at_3\": 0.28363,\n        \"precision_at_5\": 0.17895,\n        \"recall_at_1\": 0.67544,\n        \"recall_at_10\": 0.9386,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96491,\n        \"recall_at_3\": 0.85088,\n        \"recall_at_5\": 0.89474\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large/intfloat__multilingual-e5-large/ab10c1a7f42e74530fe7ae5be82e6d4f11a719eb/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 45.867305755615234,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.94499,\n        \"map_at_1\": 0.90556,\n        \"map_at_10\": 0.93387,\n        \"map_at_100\": 0.93468,\n        \"map_at_1000\": 0.93472,\n        \"map_at_20\": 0.93447,\n        \"map_at_3\": 0.93093,\n        \"map_at_5\": 0.93248,\n        \"mrr_at_1\": 0.9055555555555556,\n        \"mrr_at_10\": 0.9338730158730159,\n        \"mrr_at_100\": 0.9346750637504948,\n        \"mrr_at_1000\": 0.9347165982343034,\n        \"mrr_at_20\": 0.9344692159692158,\n        \"mrr_at_3\": 0.9309259259259258,\n        \"mrr_at_5\": 0.9324814814814814,\n        \"nauc_map_at_1000_diff1\": 0.930227758709326,\n        \"nauc_map_at_1000_max\": 0.8265114039753071,\n        \"nauc_map_at_1000_std\": 0.20890868954346548,\n        \"nauc_map_at_100_diff1\": 0.9302376031901283,\n        \"nauc_map_at_100_max\": 0.8265563740476617,\n        \"nauc_map_at_100_std\": 0.20923759828213495,\n        \"nauc_map_at_10_diff1\": 0.9304875708217899,\n        \"nauc_map_at_10_max\": 0.8282339553413531,\n        \"nauc_map_at_10_std\": 0.2077632421187409,\n        \"nauc_map_at_1_diff1\": 0.9256329982973587,\n        \"nauc_map_at_1_max\": 0.7965178228154025,\n        \"nauc_map_at_1_std\": 0.18032075575328102,\n        \"nauc_map_at_20_diff1\": 0.9304567434737736,\n        \"nauc_map_at_20_max\": 0.8268189860529359,\n        \"nauc_map_at_20_std\": 0.20806536983957427,\n        \"nauc_map_at_3_diff1\": 0.931054638119769,\n        \"nauc_map_at_3_max\": 0.83250476240541,\n        \"nauc_map_at_3_std\": 0.21031933774403588,\n        \"nauc_map_at_5_diff1\": 0.9310392469293455,\n        \"nauc_map_at_5_max\": 0.8305281154334097,\n        \"nauc_map_at_5_std\": 0.21305404590067914,\n        \"nauc_mrr_at_1000_diff1\": 0.930227758709326,\n        \"nauc_mrr_at_1000_max\": 0.8265114039753071,\n        \"nauc_mrr_at_1000_std\": 0.20890868954346548,\n        \"nauc_mrr_at_100_diff1\": 0.9302376031901283,\n        \"nauc_mrr_at_100_max\": 0.8265563740476617,\n        \"nauc_mrr_at_100_std\": 0.20923759828213495,\n        \"nauc_mrr_at_10_diff1\": 0.9304875708217899,\n        \"nauc_mrr_at_10_max\": 0.8282339553413531,\n        \"nauc_mrr_at_10_std\": 0.2077632421187409,\n        \"nauc_mrr_at_1_diff1\": 0.9256329982973587,\n        \"nauc_mrr_at_1_max\": 0.7965178228154025,\n        \"nauc_mrr_at_1_std\": 0.18032075575328102,\n        \"nauc_mrr_at_20_diff1\": 0.9304567434737736,\n        \"nauc_mrr_at_20_max\": 0.8268189860529359,\n        \"nauc_mrr_at_20_std\": 0.20806536983957427,\n        \"nauc_mrr_at_3_diff1\": 0.931054638119769,\n        \"nauc_mrr_at_3_max\": 0.83250476240541,\n        \"nauc_mrr_at_3_std\": 0.21031933774403588,\n        \"nauc_mrr_at_5_diff1\": 0.9310392469293455,\n        \"nauc_mrr_at_5_max\": 0.8305281154334097,\n        \"nauc_mrr_at_5_std\": 0.21305404590067914,\n        \"nauc_ndcg_at_1000_diff1\": 0.9311047013723796,\n        \"nauc_ndcg_at_1000_max\": 0.8308367681918263,\n        \"nauc_ndcg_at_1000_std\": 0.21661583693444478,\n        \"nauc_ndcg_at_100_diff1\": 0.9311689837709294,\n        \"nauc_ndcg_at_100_max\": 0.8318347592999481,\n        \"nauc_ndcg_at_100_std\": 0.2253928671613762,\n        \"nauc_ndcg_at_10_diff1\": 0.9327072401603272,\n        \"nauc_ndcg_at_10_max\": 0.8392724958204727,\n        \"nauc_ndcg_at_10_std\": 0.2174409681677675,\n        \"nauc_ndcg_at_1_diff1\": 0.9256329982973587,\n        \"nauc_ndcg_at_1_max\": 0.7965178228154025,\n        \"nauc_ndcg_at_1_std\": 0.18032075575328102,\n        \"nauc_ndcg_at_20_diff1\": 0.9328766716345652,\n        \"nauc_ndcg_at_20_max\": 0.8337744839486585,\n        \"nauc_ndcg_at_20_std\": 0.2183668124786509,\n        \"nauc_ndcg_at_3_diff1\": 0.93419337625773,\n        \"nauc_ndcg_at_3_max\": 0.8486196504258102,\n        \"nauc_ndcg_at_3_std\": 0.2244037110917959,\n        \"nauc_ndcg_at_5_diff1\": 0.9343058150714209,\n        \"nauc_ndcg_at_5_max\": 0.845513221904975,\n        \"nauc_ndcg_at_5_std\": 0.23060011579652634,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9319172113289566,\n        \"nauc_precision_at_100_max\": 0.8856209150326616,\n        \"nauc_precision_at_100_std\": 0.7176314970432794,\n        \"nauc_precision_at_10_diff1\": 0.9509803921568587,\n        \"nauc_precision_at_10_max\": 0.9286205710354282,\n        \"nauc_precision_at_10_std\": 0.29566563467491047,\n        \"nauc_precision_at_1_diff1\": 0.9256329982973587,\n        \"nauc_precision_at_1_max\": 0.7965178228154025,\n        \"nauc_precision_at_1_std\": 0.18032075575328102,\n        \"nauc_precision_at_20_diff1\": 0.965958605664485,\n        \"nauc_precision_at_20_max\": 0.8978758169934673,\n        \"nauc_precision_at_20_std\": 0.3496342981637061,\n        \"nauc_precision_at_3_diff1\": 0.9505135387488309,\n        \"nauc_precision_at_3_max\": 0.9304388422035507,\n        \"nauc_precision_at_3_std\": 0.2962651727357632,\n        \"nauc_precision_at_5_diff1\": 0.9543610547667292,\n        \"nauc_precision_at_5_max\": 0.9346405228758145,\n        \"nauc_precision_at_5_std\": 0.33776039151291765,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9319172113289615,\n        \"nauc_recall_at_100_max\": 0.8856209150326758,\n        \"nauc_recall_at_100_std\": 0.7176314970432669,\n        \"nauc_recall_at_10_diff1\": 0.9509803921568633,\n        \"nauc_recall_at_10_max\": 0.9286205710354343,\n        \"nauc_recall_at_10_std\": 0.29566563467492946,\n        \"nauc_recall_at_1_diff1\": 0.9256329982973587,\n        \"nauc_recall_at_1_max\": 0.7965178228154025,\n        \"nauc_recall_at_1_std\": 0.18032075575328102,\n        \"nauc_recall_at_20_diff1\": 0.9659586056644808,\n        \"nauc_recall_at_20_max\": 0.8978758169934619,\n        \"nauc_recall_at_20_std\": 0.349634298163714,\n        \"nauc_recall_at_3_diff1\": 0.9505135387488312,\n        \"nauc_recall_at_3_max\": 0.9304388422035459,\n        \"nauc_recall_at_3_std\": 0.29626517273576003,\n        \"nauc_recall_at_5_diff1\": 0.9543610547667313,\n        \"nauc_recall_at_5_max\": 0.9346405228758145,\n        \"nauc_recall_at_5_std\": 0.3377603915129274,\n        \"ndcg_at_1\": 0.90556,\n        \"ndcg_at_10\": 0.94499,\n        \"ndcg_at_100\": 0.94834,\n        \"ndcg_at_1000\": 0.94925,\n        \"ndcg_at_20\": 0.94703,\n        \"ndcg_at_3\": 0.93872,\n        \"ndcg_at_5\": 0.94149,\n        \"precision_at_1\": 0.90556,\n        \"precision_at_10\": 0.09789,\n        \"precision_at_100\": 0.00993,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04933,\n        \"precision_at_3\": 0.32037,\n        \"precision_at_5\": 0.19356,\n        \"recall_at_1\": 0.90556,\n        \"recall_at_10\": 0.97889,\n        \"recall_at_100\": 0.99333,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98667,\n        \"recall_at_3\": 0.96111,\n        \"recall_at_5\": 0.96778\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.92031,\n        \"map_at_1\": 0.85667,\n        \"map_at_10\": 0.90067,\n        \"map_at_100\": 0.90155,\n        \"map_at_1000\": 0.90157,\n        \"map_at_20\": 0.90143,\n        \"map_at_3\": 0.89296,\n        \"map_at_5\": 0.89763,\n        \"mrr_at_1\": 0.8566666666666667,\n        \"mrr_at_10\": 0.9006693121693128,\n        \"mrr_at_100\": 0.9015503056196907,\n        \"mrr_at_1000\": 0.9015654504046813,\n        \"mrr_at_20\": 0.9014305278055285,\n        \"mrr_at_3\": 0.8929629629629634,\n        \"mrr_at_5\": 0.8976296296296301,\n        \"nauc_map_at_1000_diff1\": 0.92182025415712,\n        \"nauc_map_at_1000_max\": 0.6206471258944869,\n        \"nauc_map_at_1000_std\": 0.06596374693316626,\n        \"nauc_map_at_100_diff1\": 0.9218178893846458,\n        \"nauc_map_at_100_max\": 0.6206524888282047,\n        \"nauc_map_at_100_std\": 0.06610573144199076,\n        \"nauc_map_at_10_diff1\": 0.9218303582707491,\n        \"nauc_map_at_10_max\": 0.6203003887986447,\n        \"nauc_map_at_10_std\": 0.0620874618663675,\n        \"nauc_map_at_1_diff1\": 0.9290876344207575,\n        \"nauc_map_at_1_max\": 0.6200235118576627,\n        \"nauc_map_at_1_std\": 0.07183550742658158,\n        \"nauc_map_at_20_diff1\": 0.9217873327372612,\n        \"nauc_map_at_20_max\": 0.6202010281677299,\n        \"nauc_map_at_20_std\": 0.06578026510307823,\n        \"nauc_map_at_3_diff1\": 0.9181874296864884,\n        \"nauc_map_at_3_max\": 0.6291171775700318,\n        \"nauc_map_at_3_std\": 0.05984820578172109,\n        \"nauc_map_at_5_diff1\": 0.9211955728710669,\n        \"nauc_map_at_5_max\": 0.6236460096499931,\n        \"nauc_map_at_5_std\": 0.0627327727332104,\n        \"nauc_mrr_at_1000_diff1\": 0.92182025415712,\n        \"nauc_mrr_at_1000_max\": 0.6206471258944869,\n        \"nauc_mrr_at_1000_std\": 0.06596374693316626,\n        \"nauc_mrr_at_100_diff1\": 0.9218178893846458,\n        \"nauc_mrr_at_100_max\": 0.6206524888282047,\n        \"nauc_mrr_at_100_std\": 0.06610573144199076,\n        \"nauc_mrr_at_10_diff1\": 0.9218303582707491,\n        \"nauc_mrr_at_10_max\": 0.6203003887986447,\n        \"nauc_mrr_at_10_std\": 0.0620874618663675,\n        \"nauc_mrr_at_1_diff1\": 0.9290876344207575,\n        \"nauc_mrr_at_1_max\": 0.6200235118576627,\n        \"nauc_mrr_at_1_std\": 0.07183550742658158,\n        \"nauc_mrr_at_20_diff1\": 0.9217873327372612,\n        \"nauc_mrr_at_20_max\": 0.6202010281677299,\n        \"nauc_mrr_at_20_std\": 0.06578026510307823,\n        \"nauc_mrr_at_3_diff1\": 0.9181874296864884,\n        \"nauc_mrr_at_3_max\": 0.6291171775700318,\n        \"nauc_mrr_at_3_std\": 0.05984820578172109,\n        \"nauc_mrr_at_5_diff1\": 0.9211955728710669,\n        \"nauc_mrr_at_5_max\": 0.6236460096499931,\n        \"nauc_mrr_at_5_std\": 0.0627327727332104,\n        \"nauc_ndcg_at_1000_diff1\": 0.9214103710428968,\n        \"nauc_ndcg_at_1000_max\": 0.6185534050632435,\n        \"nauc_ndcg_at_1000_std\": 0.06803705027165456,\n        \"nauc_ndcg_at_100_diff1\": 0.9214411175848705,\n        \"nauc_ndcg_at_100_max\": 0.6181840377291484,\n        \"nauc_ndcg_at_100_std\": 0.07163635632943753,\n        \"nauc_ndcg_at_10_diff1\": 0.9213837866465251,\n        \"nauc_ndcg_at_10_max\": 0.6140930950462312,\n        \"nauc_ndcg_at_10_std\": 0.05677801630688054,\n        \"nauc_ndcg_at_1_diff1\": 0.9290876344207575,\n        \"nauc_ndcg_at_1_max\": 0.6200235118576627,\n        \"nauc_ndcg_at_1_std\": 0.07183550742658158,\n        \"nauc_ndcg_at_20_diff1\": 0.9212579184919344,\n        \"nauc_ndcg_at_20_max\": 0.6131029065007272,\n        \"nauc_ndcg_at_20_std\": 0.07210053998325393,\n        \"nauc_ndcg_at_3_diff1\": 0.914187763311422,\n        \"nauc_ndcg_at_3_max\": 0.6349271604621773,\n        \"nauc_ndcg_at_3_std\": 0.053555195873877144,\n        \"nauc_ndcg_at_5_diff1\": 0.9199620720983661,\n        \"nauc_ndcg_at_5_max\": 0.6233361968663719,\n        \"nauc_ndcg_at_5_std\": 0.05898324798893133,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9346405228757582,\n        \"nauc_precision_at_100_max\": 0.49603174603179234,\n        \"nauc_precision_at_100_std\": 0.9346405228757582,\n        \"nauc_precision_at_10_diff1\": 0.9211841599384868,\n        \"nauc_precision_at_10_max\": 0.5008787828856862,\n        \"nauc_precision_at_10_std\": -0.021502718734557884,\n        \"nauc_precision_at_1_diff1\": 0.9290876344207575,\n        \"nauc_precision_at_1_max\": 0.6200235118576627,\n        \"nauc_precision_at_1_std\": 0.07183550742658158,\n        \"nauc_precision_at_20_diff1\": 0.9183006535947696,\n        \"nauc_precision_at_20_max\": 0.3355508870214679,\n        \"nauc_precision_at_20_std\": 0.37219887955182474,\n        \"nauc_precision_at_3_diff1\": 0.895374816593309,\n        \"nauc_precision_at_3_max\": 0.6637404961984841,\n        \"nauc_precision_at_3_std\": 0.022817460317461912,\n        \"nauc_precision_at_5_diff1\": 0.9137582961112355,\n        \"nauc_precision_at_5_max\": 0.6175965881848202,\n        \"nauc_precision_at_5_std\": 0.034017210487790155,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.934640522875857,\n        \"nauc_recall_at_100_max\": 0.4960317460317535,\n        \"nauc_recall_at_100_std\": 0.934640522875857,\n        \"nauc_recall_at_10_diff1\": 0.9211841599384808,\n        \"nauc_recall_at_10_max\": 0.5008787828857026,\n        \"nauc_recall_at_10_std\": -0.021502718734554168,\n        \"nauc_recall_at_1_diff1\": 0.9290876344207575,\n        \"nauc_recall_at_1_max\": 0.6200235118576627,\n        \"nauc_recall_at_1_std\": 0.07183550742658158,\n        \"nauc_recall_at_20_diff1\": 0.9183006535947648,\n        \"nauc_recall_at_20_max\": 0.33555088702149116,\n        \"nauc_recall_at_20_std\": 0.37219887955183756,\n        \"nauc_recall_at_3_diff1\": 0.8953748165933032,\n        \"nauc_recall_at_3_max\": 0.6637404961984781,\n        \"nauc_recall_at_3_std\": 0.022817460317458665,\n        \"nauc_recall_at_5_diff1\": 0.9137582961112365,\n        \"nauc_recall_at_5_max\": 0.6175965881848232,\n        \"nauc_recall_at_5_std\": 0.03401721048779963,\n        \"ndcg_at_1\": 0.85667,\n        \"ndcg_at_10\": 0.92031,\n        \"ndcg_at_100\": 0.92405,\n        \"ndcg_at_1000\": 0.92436,\n        \"ndcg_at_20\": 0.92293,\n        \"ndcg_at_3\": 0.9045,\n        \"ndcg_at_5\": 0.91305,\n        \"precision_at_1\": 0.85667,\n        \"precision_at_10\": 0.09811,\n        \"precision_at_100\": 0.00998,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04956,\n        \"precision_at_3\": 0.31259,\n        \"precision_at_5\": 0.19178,\n        \"recall_at_1\": 0.85667,\n        \"recall_at_10\": 0.98111,\n        \"recall_at_100\": 0.99778,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.99111,\n        \"recall_at_3\": 0.93778,\n        \"recall_at_5\": 0.95889\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.86452,\n        \"map_at_1\": 0.78556,\n        \"map_at_10\": 0.83917,\n        \"map_at_100\": 0.8415,\n        \"map_at_1000\": 0.84155,\n        \"map_at_20\": 0.8408,\n        \"map_at_3\": 0.82722,\n        \"map_at_5\": 0.83533,\n        \"mrr_at_1\": 0.7855555555555556,\n        \"mrr_at_10\": 0.8391706349206354,\n        \"mrr_at_100\": 0.8415019369013431,\n        \"mrr_at_1000\": 0.8415523736896204,\n        \"mrr_at_20\": 0.8407976750011067,\n        \"mrr_at_3\": 0.8272222222222225,\n        \"mrr_at_5\": 0.8353333333333338,\n        \"nauc_map_at_1000_diff1\": 0.8927705645097672,\n        \"nauc_map_at_1000_max\": 0.7522985353992927,\n        \"nauc_map_at_1000_std\": 0.18996221933631463,\n        \"nauc_map_at_100_diff1\": 0.8927729415362704,\n        \"nauc_map_at_100_max\": 0.7523016927357646,\n        \"nauc_map_at_100_std\": 0.19022784908812126,\n        \"nauc_map_at_10_diff1\": 0.892782216866023,\n        \"nauc_map_at_10_max\": 0.7538520746576524,\n        \"nauc_map_at_10_std\": 0.19104920288263752,\n        \"nauc_map_at_1_diff1\": 0.9056590384024021,\n        \"nauc_map_at_1_max\": 0.7385293491488186,\n        \"nauc_map_at_1_std\": 0.14492300333008346,\n        \"nauc_map_at_20_diff1\": 0.8926494720845148,\n        \"nauc_map_at_20_max\": 0.7525637807150531,\n        \"nauc_map_at_20_std\": 0.1920752367370665,\n        \"nauc_map_at_3_diff1\": 0.8872650055085894,\n        \"nauc_map_at_3_max\": 0.7487353164254025,\n        \"nauc_map_at_3_std\": 0.16922961302361597,\n        \"nauc_map_at_5_diff1\": 0.8918257731962219,\n        \"nauc_map_at_5_max\": 0.7549879563198285,\n        \"nauc_map_at_5_std\": 0.1938393366249109,\n        \"nauc_mrr_at_1000_diff1\": 0.8927705645097672,\n        \"nauc_mrr_at_1000_max\": 0.7522985353992927,\n        \"nauc_mrr_at_1000_std\": 0.18996221933631463,\n        \"nauc_mrr_at_100_diff1\": 0.8927729415362704,\n        \"nauc_mrr_at_100_max\": 0.7523016927357646,\n        \"nauc_mrr_at_100_std\": 0.19022784908812126,\n        \"nauc_mrr_at_10_diff1\": 0.892782216866023,\n        \"nauc_mrr_at_10_max\": 0.7538520746576524,\n        \"nauc_mrr_at_10_std\": 0.19104920288263752,\n        \"nauc_mrr_at_1_diff1\": 0.9056590384024021,\n        \"nauc_mrr_at_1_max\": 0.7385293491488186,\n        \"nauc_mrr_at_1_std\": 0.14492300333008346,\n        \"nauc_mrr_at_20_diff1\": 0.8926494720845148,\n        \"nauc_mrr_at_20_max\": 0.7525637807150531,\n        \"nauc_mrr_at_20_std\": 0.1920752367370665,\n        \"nauc_mrr_at_3_diff1\": 0.8872650055085894,\n        \"nauc_mrr_at_3_max\": 0.7487353164254025,\n        \"nauc_mrr_at_3_std\": 0.16922961302361597,\n        \"nauc_mrr_at_5_diff1\": 0.8918257731962219,\n        \"nauc_mrr_at_5_max\": 0.7549879563198285,\n        \"nauc_mrr_at_5_std\": 0.1938393366249109,\n        \"nauc_ndcg_at_1000_diff1\": 0.8913558562559795,\n        \"nauc_ndcg_at_1000_max\": 0.7544397216354228,\n        \"nauc_ndcg_at_1000_std\": 0.20394034939099934,\n        \"nauc_ndcg_at_100_diff1\": 0.8913784112846709,\n        \"nauc_ndcg_at_100_max\": 0.7545109846083868,\n        \"nauc_ndcg_at_100_std\": 0.2122690068264438,\n        \"nauc_ndcg_at_10_diff1\": 0.8910240767840198,\n        \"nauc_ndcg_at_10_max\": 0.7616020409402215,\n        \"nauc_ndcg_at_10_std\": 0.2209162854297489,\n        \"nauc_ndcg_at_1_diff1\": 0.9056590384024021,\n        \"nauc_ndcg_at_1_max\": 0.7385293491488186,\n        \"nauc_ndcg_at_1_std\": 0.14492300333008346,\n        \"nauc_ndcg_at_20_diff1\": 0.8901705655943357,\n        \"nauc_ndcg_at_20_max\": 0.7563923945801978,\n        \"nauc_ndcg_at_20_std\": 0.2257500574997457,\n        \"nauc_ndcg_at_3_diff1\": 0.8796131863096975,\n        \"nauc_ndcg_at_3_max\": 0.7508780483627049,\n        \"nauc_ndcg_at_3_std\": 0.17629577865227775,\n        \"nauc_ndcg_at_5_diff1\": 0.8887001457995483,\n        \"nauc_ndcg_at_5_max\": 0.7639847302367411,\n        \"nauc_ndcg_at_5_std\": 0.22769495548405205,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8905488121174426,\n        \"nauc_precision_at_100_max\": 0.7622159975101201,\n        \"nauc_precision_at_100_std\": 0.956427015250545,\n        \"nauc_precision_at_10_diff1\": 0.8838816572380539,\n        \"nauc_precision_at_10_max\": 0.8229252485307802,\n        \"nauc_precision_at_10_std\": 0.4592555976638981,\n        \"nauc_precision_at_1_diff1\": 0.9056590384024021,\n        \"nauc_precision_at_1_max\": 0.7385293491488186,\n        \"nauc_precision_at_1_std\": 0.14492300333008346,\n        \"nauc_precision_at_20_diff1\": 0.8660431914701331,\n        \"nauc_precision_at_20_max\": 0.7901569229842433,\n        \"nauc_precision_at_20_std\": 0.6722237282009511,\n        \"nauc_precision_at_3_diff1\": 0.8490958744299489,\n        \"nauc_precision_at_3_max\": 0.7585772616396241,\n        \"nauc_precision_at_3_std\": 0.20325149361897543,\n        \"nauc_precision_at_5_diff1\": 0.8751474273920078,\n        \"nauc_precision_at_5_max\": 0.8139773453240927,\n        \"nauc_precision_at_5_std\": 0.41905621897881695,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8905488121174361,\n        \"nauc_recall_at_100_max\": 0.7622159975101154,\n        \"nauc_recall_at_100_std\": 0.9564270152505469,\n        \"nauc_recall_at_10_diff1\": 0.883881657238058,\n        \"nauc_recall_at_10_max\": 0.8229252485307852,\n        \"nauc_recall_at_10_std\": 0.459255597663904,\n        \"nauc_recall_at_1_diff1\": 0.9056590384024021,\n        \"nauc_recall_at_1_max\": 0.7385293491488186,\n        \"nauc_recall_at_1_std\": 0.14492300333008346,\n        \"nauc_recall_at_20_diff1\": 0.8660431914701362,\n        \"nauc_recall_at_20_max\": 0.7901569229842438,\n        \"nauc_recall_at_20_std\": 0.6722237282009564,\n        \"nauc_recall_at_3_diff1\": 0.8490958744299502,\n        \"nauc_recall_at_3_max\": 0.7585772616396222,\n        \"nauc_recall_at_3_std\": 0.20325149361897632,\n        \"nauc_recall_at_5_diff1\": 0.8751474273920088,\n        \"nauc_recall_at_5_max\": 0.8139773453240944,\n        \"nauc_recall_at_5_std\": 0.4190562189788191,\n        \"ndcg_at_1\": 0.78556,\n        \"ndcg_at_10\": 0.86452,\n        \"ndcg_at_100\": 0.87494,\n        \"ndcg_at_1000\": 0.87623,\n        \"ndcg_at_20\": 0.87024,\n        \"ndcg_at_3\": 0.84078,\n        \"ndcg_at_5\": 0.85541,\n        \"precision_at_1\": 0.78556,\n        \"precision_at_10\": 0.09433,\n        \"precision_at_100\": 0.0099,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04828,\n        \"precision_at_3\": 0.29333,\n        \"precision_at_5\": 0.18311,\n        \"recall_at_1\": 0.78556,\n        \"recall_at_10\": 0.94333,\n        \"recall_at_100\": 0.99,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96556,\n        \"recall_at_3\": 0.88,\n        \"recall_at_5\": 0.91556\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large/intfloat__multilingual-e5-large/ab10c1a7f42e74530fe7ae5be82e6d4f11a719eb/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 103.04216527938843,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.80348,\n        \"map_at_1\": 0.50664,\n        \"map_at_10\": 0.76374,\n        \"map_at_100\": 0.76914,\n        \"map_at_1000\": 0.76945,\n        \"map_at_20\": 0.76721,\n        \"map_at_3\": 0.7275,\n        \"map_at_5\": 0.75164,\n        \"mrr_at_1\": 0.768581081081081,\n        \"mrr_at_10\": 0.8201114060489061,\n        \"mrr_at_100\": 0.8218358869087574,\n        \"mrr_at_1000\": 0.8220410843903181,\n        \"mrr_at_20\": 0.821053386412326,\n        \"mrr_at_3\": 0.8153153153153152,\n        \"mrr_at_5\": 0.8185247747747747,\n        \"nauc_map_at_1000_diff1\": 0.6270232124471452,\n        \"nauc_map_at_1000_max\": 0.6423349743441891,\n        \"nauc_map_at_1000_std\": 0.279921772861948,\n        \"nauc_map_at_100_diff1\": 0.6270244327686766,\n        \"nauc_map_at_100_max\": 0.6426234475759284,\n        \"nauc_map_at_100_std\": 0.28050253193435104,\n        \"nauc_map_at_10_diff1\": 0.6267964661890997,\n        \"nauc_map_at_10_max\": 0.6451676187166451,\n        \"nauc_map_at_10_std\": 0.2716152727684029,\n        \"nauc_map_at_1_diff1\": 0.6764732370312437,\n        \"nauc_map_at_1_max\": 0.2905536892814776,\n        \"nauc_map_at_1_std\": -0.011034293163808993,\n        \"nauc_map_at_20_diff1\": 0.6278280584599769,\n        \"nauc_map_at_20_max\": 0.6448366164382613,\n        \"nauc_map_at_20_std\": 0.2819218324018119,\n        \"nauc_map_at_3_diff1\": 0.6061847436353337,\n        \"nauc_map_at_3_max\": 0.5780731469434045,\n        \"nauc_map_at_3_std\": 0.2027741002354236,\n        \"nauc_map_at_5_diff1\": 0.624348386827946,\n        \"nauc_map_at_5_max\": 0.6208855054942963,\n        \"nauc_map_at_5_std\": 0.24142157875599662,\n        \"nauc_mrr_at_1000_diff1\": 0.717726508368629,\n        \"nauc_mrr_at_1000_max\": 0.7127501760528012,\n        \"nauc_mrr_at_1000_std\": 0.38744516297651393,\n        \"nauc_mrr_at_100_diff1\": 0.7176454571697286,\n        \"nauc_mrr_at_100_max\": 0.7129788361602002,\n        \"nauc_mrr_at_100_std\": 0.38805260787614737,\n        \"nauc_mrr_at_10_diff1\": 0.7180161399152217,\n        \"nauc_mrr_at_10_max\": 0.7150939227839377,\n        \"nauc_mrr_at_10_std\": 0.38803096948772753,\n        \"nauc_mrr_at_1_diff1\": 0.7389675684828687,\n        \"nauc_mrr_at_1_max\": 0.619783943559237,\n        \"nauc_mrr_at_1_std\": 0.24520417021488036,\n        \"nauc_mrr_at_20_diff1\": 0.7178663921394264,\n        \"nauc_mrr_at_20_max\": 0.7139552353200426,\n        \"nauc_mrr_at_20_std\": 0.38946641086329103,\n        \"nauc_mrr_at_3_diff1\": 0.7173884183805199,\n        \"nauc_mrr_at_3_max\": 0.7146021491140149,\n        \"nauc_mrr_at_3_std\": 0.37798793931652225,\n        \"nauc_mrr_at_5_diff1\": 0.7175885111599681,\n        \"nauc_mrr_at_5_max\": 0.7148505549807599,\n        \"nauc_mrr_at_5_std\": 0.38756856589650296,\n        \"nauc_ndcg_at_1000_diff1\": 0.6472404381887801,\n        \"nauc_ndcg_at_1000_max\": 0.6964562175019898,\n        \"nauc_ndcg_at_1000_std\": 0.37195544642850276,\n        \"nauc_ndcg_at_100_diff1\": 0.6470735358009762,\n        \"nauc_ndcg_at_100_max\": 0.7043670261868529,\n        \"nauc_ndcg_at_100_std\": 0.3897900357789412,\n        \"nauc_ndcg_at_10_diff1\": 0.6465969495009757,\n        \"nauc_ndcg_at_10_max\": 0.7146099910954262,\n        \"nauc_ndcg_at_10_std\": 0.3679914038774038,\n        \"nauc_ndcg_at_1_diff1\": 0.7389675684828687,\n        \"nauc_ndcg_at_1_max\": 0.619783943559237,\n        \"nauc_ndcg_at_1_std\": 0.24520417021488036,\n        \"nauc_ndcg_at_20_diff1\": 0.6493928925737483,\n        \"nauc_ndcg_at_20_max\": 0.7134715845031814,\n        \"nauc_ndcg_at_20_std\": 0.3939633225716529,\n        \"nauc_ndcg_at_3_diff1\": 0.6178715093585547,\n        \"nauc_ndcg_at_3_max\": 0.6319521302138631,\n        \"nauc_ndcg_at_3_std\": 0.2680060266389483,\n        \"nauc_ndcg_at_5_diff1\": 0.6405997079687031,\n        \"nauc_ndcg_at_5_max\": 0.6764242485744868,\n        \"nauc_ndcg_at_5_std\": 0.31694007367796995,\n        \"nauc_precision_at_1000_diff1\": -0.3970271186614315,\n        \"nauc_precision_at_1000_max\": 0.001086350645082997,\n        \"nauc_precision_at_1000_std\": 0.1934852025821731,\n        \"nauc_precision_at_100_diff1\": -0.28632625129297085,\n        \"nauc_precision_at_100_max\": 0.13535950905854507,\n        \"nauc_precision_at_100_std\": 0.3011672467378491,\n        \"nauc_precision_at_10_diff1\": -0.16726338149009454,\n        \"nauc_precision_at_10_max\": 0.2909053191625467,\n        \"nauc_precision_at_10_std\": 0.3443975592990956,\n        \"nauc_precision_at_1_diff1\": 0.7389675684828687,\n        \"nauc_precision_at_1_max\": 0.619783943559237,\n        \"nauc_precision_at_1_std\": 0.24520417021488036,\n        \"nauc_precision_at_20_diff1\": -0.2060497574556575,\n        \"nauc_precision_at_20_max\": 0.23376163020027696,\n        \"nauc_precision_at_20_std\": 0.35240442591945115,\n        \"nauc_precision_at_3_diff1\": -0.06277299917404543,\n        \"nauc_precision_at_3_max\": 0.37286499375085813,\n        \"nauc_precision_at_3_std\": 0.30817315779367294,\n        \"nauc_precision_at_5_diff1\": -0.10813798215240919,\n        \"nauc_precision_at_5_max\": 0.32036525771869867,\n        \"nauc_precision_at_5_std\": 0.3122024855654004,\n        \"nauc_recall_at_1000_diff1\": 0.6123484988578439,\n        \"nauc_recall_at_1000_max\": 0.9389556221977473,\n        \"nauc_recall_at_1000_std\": 0.9317786678431724,\n        \"nauc_recall_at_100_diff1\": 0.6237038348199009,\n        \"nauc_recall_at_100_max\": 0.8941415813611865,\n        \"nauc_recall_at_100_std\": 0.8389314190049417,\n        \"nauc_recall_at_10_diff1\": 0.6232544482810121,\n        \"nauc_recall_at_10_max\": 0.8589984248699257,\n        \"nauc_recall_at_10_std\": 0.5629988195620854,\n        \"nauc_recall_at_1_diff1\": 0.6764732370312437,\n        \"nauc_recall_at_1_max\": 0.2905536892814776,\n        \"nauc_recall_at_1_std\": -0.011034293163808993,\n        \"nauc_recall_at_20_diff1\": 0.6390604871621653,\n        \"nauc_recall_at_20_max\": 0.8854683603368402,\n        \"nauc_recall_at_20_std\": 0.7169948683694372,\n        \"nauc_recall_at_3_diff1\": 0.5668709737247727,\n        \"nauc_recall_at_3_max\": 0.6343809223314516,\n        \"nauc_recall_at_3_std\": 0.2911839083650689,\n        \"nauc_recall_at_5_diff1\": 0.6047177057671275,\n        \"nauc_recall_at_5_max\": 0.7341251106852447,\n        \"nauc_recall_at_5_std\": 0.40014013976984053,\n        \"ndcg_at_1\": 0.76858,\n        \"ndcg_at_10\": 0.80348,\n        \"ndcg_at_100\": 0.82087,\n        \"ndcg_at_1000\": 0.82835,\n        \"ndcg_at_20\": 0.81154,\n        \"ndcg_at_3\": 0.76483,\n        \"ndcg_at_5\": 0.78681,\n        \"precision_at_1\": 0.76858,\n        \"precision_at_10\": 0.15794,\n        \"precision_at_100\": 0.0173,\n        \"precision_at_1000\": 0.00184,\n        \"precision_at_20\": 0.08201,\n        \"precision_at_3\": 0.45327,\n        \"precision_at_5\": 0.29628,\n        \"recall_at_1\": 0.50664,\n        \"recall_at_10\": 0.854,\n        \"recall_at_100\": 0.91833,\n        \"recall_at_1000\": 0.96585,\n        \"recall_at_20\": 0.87852,\n        \"recall_at_3\": 0.7696,\n        \"recall_at_5\": 0.8158\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large/intfloat__multilingual-e5-large/ab10c1a7f42e74530fe7ae5be82e6d4f11a719eb/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 22242.406965255737,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.66486,\n        \"map_at_1\": 0.39817,\n        \"map_at_10\": 0.57475,\n        \"map_at_100\": 0.59592,\n        \"map_at_1000\": 0.59688,\n        \"map_at_20\": 0.58615,\n        \"map_at_3\": 0.51008,\n        \"map_at_5\": 0.5453,\n        \"mrr_at_1\": 0.6291079812206573,\n        \"mrr_at_10\": 0.7366588419405322,\n        \"mrr_at_100\": 0.7396868370283863,\n        \"mrr_at_1000\": 0.7397718728043917,\n        \"mrr_at_20\": 0.7387440806454891,\n        \"mrr_at_3\": 0.7214397496087638,\n        \"mrr_at_5\": 0.7320031298904539,\n        \"nauc_map_at_1000_diff1\": 0.3837911965262718,\n        \"nauc_map_at_1000_max\": 0.40308399089236396,\n        \"nauc_map_at_1000_std\": -0.06379339452715582,\n        \"nauc_map_at_100_diff1\": 0.38278502675420284,\n        \"nauc_map_at_100_max\": 0.40238736979314654,\n        \"nauc_map_at_100_std\": -0.06544180548856873,\n        \"nauc_map_at_10_diff1\": 0.39089373824018875,\n        \"nauc_map_at_10_max\": 0.4041436760808993,\n        \"nauc_map_at_10_std\": -0.08672260660681444,\n        \"nauc_map_at_1_diff1\": 0.440509659668766,\n        \"nauc_map_at_1_max\": 0.3236573126938934,\n        \"nauc_map_at_1_std\": -0.18323841041068328,\n        \"nauc_map_at_20_diff1\": 0.381851663192607,\n        \"nauc_map_at_20_max\": 0.39906518685264364,\n        \"nauc_map_at_20_std\": -0.07929991459709138,\n        \"nauc_map_at_3_diff1\": 0.381696475066722,\n        \"nauc_map_at_3_max\": 0.3556494320690001,\n        \"nauc_map_at_3_std\": -0.16600412280283966,\n        \"nauc_map_at_5_diff1\": 0.3976892335685762,\n        \"nauc_map_at_5_max\": 0.3685040211177935,\n        \"nauc_map_at_5_std\": -0.14048277377163843,\n        \"nauc_mrr_at_1000_diff1\": 0.3872386048717649,\n        \"nauc_mrr_at_1000_max\": 0.45376262480676327,\n        \"nauc_mrr_at_1000_std\": 0.1599964264678888,\n        \"nauc_mrr_at_100_diff1\": 0.3872366940531705,\n        \"nauc_mrr_at_100_max\": 0.45385927820433125,\n        \"nauc_mrr_at_100_std\": 0.16019961717007042,\n        \"nauc_mrr_at_10_diff1\": 0.3887496116894425,\n        \"nauc_mrr_at_10_max\": 0.458533950697311,\n        \"nauc_mrr_at_10_std\": 0.1654565986975807,\n        \"nauc_mrr_at_1_diff1\": 0.4327839855313694,\n        \"nauc_mrr_at_1_max\": 0.43792362259344914,\n        \"nauc_mrr_at_1_std\": 0.08901866262287145,\n        \"nauc_mrr_at_20_diff1\": 0.38712698651768995,\n        \"nauc_mrr_at_20_max\": 0.4551012845906619,\n        \"nauc_mrr_at_20_std\": 0.1608626758894431,\n        \"nauc_mrr_at_3_diff1\": 0.3754946169140696,\n        \"nauc_mrr_at_3_max\": 0.4402042196432023,\n        \"nauc_mrr_at_3_std\": 0.16281847393521195,\n        \"nauc_mrr_at_5_diff1\": 0.39178041592492124,\n        \"nauc_mrr_at_5_max\": 0.45410519440021624,\n        \"nauc_mrr_at_5_std\": 0.16606088593627427,\n        \"nauc_ndcg_at_1000_diff1\": 0.3724402918583468,\n        \"nauc_ndcg_at_1000_max\": 0.4411204737374578,\n        \"nauc_ndcg_at_1000_std\": 0.05633736942813012,\n        \"nauc_ndcg_at_100_diff1\": 0.36306103475892026,\n        \"nauc_ndcg_at_100_max\": 0.4362276567346318,\n        \"nauc_ndcg_at_100_std\": 0.04076036137752997,\n        \"nauc_ndcg_at_10_diff1\": 0.38565581428440926,\n        \"nauc_ndcg_at_10_max\": 0.4477238632518685,\n        \"nauc_ndcg_at_10_std\": -0.0022715690211862934,\n        \"nauc_ndcg_at_1_diff1\": 0.4327839855313694,\n        \"nauc_ndcg_at_1_max\": 0.43792362259344914,\n        \"nauc_ndcg_at_1_std\": 0.08901866262287145,\n        \"nauc_ndcg_at_20_diff1\": 0.36334095594670834,\n        \"nauc_ndcg_at_20_max\": 0.43121289828585696,\n        \"nauc_ndcg_at_20_std\": 0.0014560776008887809,\n        \"nauc_ndcg_at_3_diff1\": 0.3504828896059918,\n        \"nauc_ndcg_at_3_max\": 0.3903649062281797,\n        \"nauc_ndcg_at_3_std\": 0.0009487492719896218,\n        \"nauc_ndcg_at_5_diff1\": 0.3955825272148319,\n        \"nauc_ndcg_at_5_max\": 0.40013532836706406,\n        \"nauc_ndcg_at_5_std\": -0.023625493066877553,\n        \"nauc_precision_at_1000_diff1\": -0.1674893792440607,\n        \"nauc_precision_at_1000_max\": 0.008713388862239432,\n        \"nauc_precision_at_1000_std\": 0.47802346731030876,\n        \"nauc_precision_at_100_diff1\": -0.18625122991805604,\n        \"nauc_precision_at_100_max\": 0.01634892796986117,\n        \"nauc_precision_at_100_std\": 0.46547302324700046,\n        \"nauc_precision_at_10_diff1\": -0.09628418614572895,\n        \"nauc_precision_at_10_max\": 0.16602575486623067,\n        \"nauc_precision_at_10_std\": 0.4560172223232804,\n        \"nauc_precision_at_1_diff1\": 0.4327839855313694,\n        \"nauc_precision_at_1_max\": 0.43792362259344914,\n        \"nauc_precision_at_1_std\": 0.08901866262287145,\n        \"nauc_precision_at_20_diff1\": -0.1642198896134193,\n        \"nauc_precision_at_20_max\": 0.08357456167411671,\n        \"nauc_precision_at_20_std\": 0.4430076721462144,\n        \"nauc_precision_at_3_diff1\": -0.051558683337445156,\n        \"nauc_precision_at_3_max\": 0.23528208450060462,\n        \"nauc_precision_at_3_std\": 0.3002556524367771,\n        \"nauc_precision_at_5_diff1\": -0.04581765133291948,\n        \"nauc_precision_at_5_max\": 0.15784094877764906,\n        \"nauc_precision_at_5_std\": 0.3609616652230924,\n        \"nauc_recall_at_1000_diff1\": 0.18069466870619919,\n        \"nauc_recall_at_1000_max\": 0.7884234926199413,\n        \"nauc_recall_at_1000_std\": 0.8396692861367822,\n        \"nauc_recall_at_100_diff1\": 0.09988559454231889,\n        \"nauc_recall_at_100_max\": 0.4024750413649136,\n        \"nauc_recall_at_100_std\": 0.12536806908524142,\n        \"nauc_recall_at_10_diff1\": 0.3336311951057095,\n        \"nauc_recall_at_10_max\": 0.462288877527675,\n        \"nauc_recall_at_10_std\": -0.01382064760940675,\n        \"nauc_recall_at_1_diff1\": 0.440509659668766,\n        \"nauc_recall_at_1_max\": 0.3236573126938934,\n        \"nauc_recall_at_1_std\": -0.18323841041068328,\n        \"nauc_recall_at_20_diff1\": 0.22916823976098807,\n        \"nauc_recall_at_20_max\": 0.3843913327854645,\n        \"nauc_recall_at_20_std\": -0.03841425001610077,\n        \"nauc_recall_at_3_diff1\": 0.30981968404029536,\n        \"nauc_recall_at_3_max\": 0.30174085683026775,\n        \"nauc_recall_at_3_std\": -0.16719772497653437,\n        \"nauc_recall_at_5_diff1\": 0.3646875535602896,\n        \"nauc_recall_at_5_max\": 0.3294498583147711,\n        \"nauc_recall_at_5_std\": -0.1518666939810128,\n        \"ndcg_at_1\": 0.62911,\n        \"ndcg_at_10\": 0.66486,\n        \"ndcg_at_100\": 0.71956,\n        \"ndcg_at_1000\": 0.72913,\n        \"ndcg_at_20\": 0.68729,\n        \"ndcg_at_3\": 0.623,\n        \"ndcg_at_5\": 0.63547,\n        \"precision_at_1\": 0.62911,\n        \"precision_at_10\": 0.16761,\n        \"precision_at_100\": 0.02324,\n        \"precision_at_1000\": 0.00253,\n        \"precision_at_20\": 0.09437,\n        \"precision_at_3\": 0.37089,\n        \"precision_at_5\": 0.27512,\n        \"recall_at_1\": 0.39817,\n        \"recall_at_10\": 0.75212,\n        \"recall_at_100\": 0.93362,\n        \"recall_at_1000\": 0.98208,\n        \"recall_at_20\": 0.81836,\n        \"recall_at_3\": 0.57548,\n        \"recall_at_5\": 0.6547\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large/intfloat__multilingual-e5-large/ab10c1a7f42e74530fe7ae5be82e6d4f11a719eb/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 23272.43692088127,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.64211,\n        \"map_at_1\": 0.46397,\n        \"map_at_10\": 0.58923,\n        \"map_at_100\": 0.59711,\n        \"map_at_1000\": 0.59734,\n        \"map_at_20\": 0.59392,\n        \"map_at_3\": 0.5644,\n        \"map_at_5\": 0.58063,\n        \"mrr_at_1\": 0.498812351543943,\n        \"mrr_at_10\": 0.6117925951061345,\n        \"mrr_at_100\": 0.6172461485002978,\n        \"mrr_at_1000\": 0.6174050167685023,\n        \"mrr_at_20\": 0.6147653071304376,\n        \"mrr_at_3\": 0.5918448139350755,\n        \"mrr_at_5\": 0.604790182106097,\n        \"nauc_map_at_1000_diff1\": 0.47931223136256057,\n        \"nauc_map_at_1000_max\": 0.4007334827100805,\n        \"nauc_map_at_1000_std\": 0.043487872418719056,\n        \"nauc_map_at_100_diff1\": 0.47925112843131884,\n        \"nauc_map_at_100_max\": 0.40077407832527784,\n        \"nauc_map_at_100_std\": 0.043456957506543874,\n        \"nauc_map_at_10_diff1\": 0.4806526770216943,\n        \"nauc_map_at_10_max\": 0.39632760172530024,\n        \"nauc_map_at_10_std\": 0.03950815662330351,\n        \"nauc_map_at_1_diff1\": 0.5321911659832964,\n        \"nauc_map_at_1_max\": 0.3954179793853281,\n        \"nauc_map_at_1_std\": 0.05094634517180547,\n        \"nauc_map_at_20_diff1\": 0.4800495551765683,\n        \"nauc_map_at_20_max\": 0.39902429014320684,\n        \"nauc_map_at_20_std\": 0.041856276283318505,\n        \"nauc_map_at_3_diff1\": 0.48229212227224766,\n        \"nauc_map_at_3_max\": 0.3995713838422883,\n        \"nauc_map_at_3_std\": 0.03690170493850673,\n        \"nauc_map_at_5_diff1\": 0.4783003027560702,\n        \"nauc_map_at_5_max\": 0.3993736834106997,\n        \"nauc_map_at_5_std\": 0.039477183473525135,\n        \"nauc_mrr_at_1000_diff1\": 0.495225038039527,\n        \"nauc_mrr_at_1000_max\": 0.4220848374925641,\n        \"nauc_mrr_at_1000_std\": 0.046087169293733715,\n        \"nauc_mrr_at_100_diff1\": 0.49509055545526093,\n        \"nauc_mrr_at_100_max\": 0.4220145500933536,\n        \"nauc_mrr_at_100_std\": 0.045971616948838695,\n        \"nauc_mrr_at_10_diff1\": 0.4963834416827471,\n        \"nauc_mrr_at_10_max\": 0.4197489896599539,\n        \"nauc_mrr_at_10_std\": 0.04347046617574166,\n        \"nauc_mrr_at_1_diff1\": 0.5502772419562014,\n        \"nauc_mrr_at_1_max\": 0.42432282839509594,\n        \"nauc_mrr_at_1_std\": 0.056539997728625516,\n        \"nauc_mrr_at_20_diff1\": 0.495834428313876,\n        \"nauc_mrr_at_20_max\": 0.4219989014934441,\n        \"nauc_mrr_at_20_std\": 0.045713852924685404,\n        \"nauc_mrr_at_3_diff1\": 0.49311673694395813,\n        \"nauc_mrr_at_3_max\": 0.42217278185884216,\n        \"nauc_mrr_at_3_std\": 0.045486376174776987,\n        \"nauc_mrr_at_5_diff1\": 0.49487684702992973,\n        \"nauc_mrr_at_5_max\": 0.4228996637119372,\n        \"nauc_mrr_at_5_std\": 0.042717981438324684,\n        \"nauc_ndcg_at_1000_diff1\": 0.46718225176412104,\n        \"nauc_ndcg_at_1000_max\": 0.41406232527666265,\n        \"nauc_ndcg_at_1000_std\": 0.057770566345204215,\n        \"nauc_ndcg_at_100_diff1\": 0.4637665823255492,\n        \"nauc_ndcg_at_100_max\": 0.41521149956451847,\n        \"nauc_ndcg_at_100_std\": 0.05925644569030309,\n        \"nauc_ndcg_at_10_diff1\": 0.4705926342509073,\n        \"nauc_ndcg_at_10_max\": 0.3960903500827478,\n        \"nauc_ndcg_at_10_std\": 0.03738347747999284,\n        \"nauc_ndcg_at_1_diff1\": 0.5502772419562014,\n        \"nauc_ndcg_at_1_max\": 0.42432282839509594,\n        \"nauc_ndcg_at_1_std\": 0.056539997728625516,\n        \"nauc_ndcg_at_20_diff1\": 0.4693735386172784,\n        \"nauc_ndcg_at_20_max\": 0.4051958577086621,\n        \"nauc_ndcg_at_20_std\": 0.04665714880742706,\n        \"nauc_ndcg_at_3_diff1\": 0.4691674613529208,\n        \"nauc_ndcg_at_3_max\": 0.40442677313868036,\n        \"nauc_ndcg_at_3_std\": 0.03658738600868339,\n        \"nauc_ndcg_at_5_diff1\": 0.4652513608671465,\n        \"nauc_ndcg_at_5_max\": 0.4032050160398976,\n        \"nauc_ndcg_at_5_std\": 0.03646578334852213,\n        \"nauc_precision_at_1000_diff1\": -0.1376901317798828,\n        \"nauc_precision_at_1000_max\": 0.07074525569946662,\n        \"nauc_precision_at_1000_std\": 0.06525116901031895,\n        \"nauc_precision_at_100_diff1\": -0.07291729186781257,\n        \"nauc_precision_at_100_max\": 0.1543057084796784,\n        \"nauc_precision_at_100_std\": 0.09579018179279059,\n        \"nauc_precision_at_10_diff1\": 0.17539177775898368,\n        \"nauc_precision_at_10_max\": 0.2194703262505171,\n        \"nauc_precision_at_10_std\": 0.00045100241308365505,\n        \"nauc_precision_at_1_diff1\": 0.5502772419562014,\n        \"nauc_precision_at_1_max\": 0.42432282839509594,\n        \"nauc_precision_at_1_std\": 0.056539997728625516,\n        \"nauc_precision_at_20_diff1\": 0.1001212988896256,\n        \"nauc_precision_at_20_max\": 0.19500946854026321,\n        \"nauc_precision_at_20_std\": 0.033877091949833134,\n        \"nauc_precision_at_3_diff1\": 0.3108146336952218,\n        \"nauc_precision_at_3_max\": 0.3399582145797798,\n        \"nauc_precision_at_3_std\": 0.012185139119488025,\n        \"nauc_precision_at_5_diff1\": 0.2176647197706826,\n        \"nauc_precision_at_5_max\": 0.279589656873362,\n        \"nauc_precision_at_5_std\": -8.576091514749797e-06,\n        \"nauc_recall_at_1000_diff1\": 0.17922367256077656,\n        \"nauc_recall_at_1000_max\": 0.6269115941767262,\n        \"nauc_recall_at_1000_std\": 0.5692952967604661,\n        \"nauc_recall_at_100_diff1\": 0.2351755934148718,\n        \"nauc_recall_at_100_max\": 0.527848439581095,\n        \"nauc_recall_at_100_std\": 0.32990668711326004,\n        \"nauc_recall_at_10_diff1\": 0.40367269891236246,\n        \"nauc_recall_at_10_max\": 0.3462384537056759,\n        \"nauc_recall_at_10_std\": 0.025491997823164098,\n        \"nauc_recall_at_1_diff1\": 0.5321911659832964,\n        \"nauc_recall_at_1_max\": 0.3954179793853281,\n        \"nauc_recall_at_1_std\": 0.05094634517180547,\n        \"nauc_recall_at_20_diff1\": 0.38960282862441376,\n        \"nauc_recall_at_20_max\": 0.3859266471606545,\n        \"nauc_recall_at_20_std\": 0.07772930796862623,\n        \"nauc_recall_at_3_diff1\": 0.4098250299008375,\n        \"nauc_recall_at_3_max\": 0.39022839382240526,\n        \"nauc_recall_at_3_std\": 0.027788026010023104,\n        \"nauc_recall_at_5_diff1\": 0.3912032247692726,\n        \"nauc_recall_at_5_max\": 0.37651414158503244,\n        \"nauc_recall_at_5_std\": 0.023162297288624345,\n        \"ndcg_at_1\": 0.49881,\n        \"ndcg_at_10\": 0.64211,\n        \"ndcg_at_100\": 0.67545,\n        \"ndcg_at_1000\": 0.68117,\n        \"ndcg_at_20\": 0.65623,\n        \"ndcg_at_3\": 0.5974,\n        \"ndcg_at_5\": 0.62353,\n        \"precision_at_1\": 0.49881,\n        \"precision_at_10\": 0.08884,\n        \"precision_at_100\": 0.01076,\n        \"precision_at_1000\": 0.00113,\n        \"precision_at_20\": 0.04786,\n        \"precision_at_3\": 0.24782,\n        \"precision_at_5\": 0.16437,\n        \"recall_at_1\": 0.46397,\n        \"recall_at_10\": 0.77672,\n        \"recall_at_100\": 0.9228,\n        \"recall_at_1000\": 0.96635,\n        \"recall_at_20\": 0.82779,\n        \"recall_at_3\": 0.66508,\n        \"recall_at_5\": 0.72328\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large/intfloat__multilingual-e5-large/ab10c1a7f42e74530fe7ae5be82e6d4f11a719eb/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 785.9183006286621,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.24596,\n        \"map_at_1\": 0.155,\n        \"map_at_10\": 0.21462,\n        \"map_at_100\": 0.22193,\n        \"map_at_1000\": 0.22312,\n        \"map_at_20\": 0.2179,\n        \"map_at_3\": 0.19833,\n        \"map_at_5\": 0.20833,\n        \"mrr_at_1\": 0.155,\n        \"mrr_at_10\": 0.21461706349206353,\n        \"mrr_at_100\": 0.22192636282777436,\n        \"mrr_at_1000\": 0.22311533240055414,\n        \"mrr_at_20\": 0.21790329991645788,\n        \"mrr_at_3\": 0.19833333333333333,\n        \"mrr_at_5\": 0.20833333333333337,\n        \"nauc_map_at_1000_diff1\": 0.4563057390364821,\n        \"nauc_map_at_1000_max\": 0.5455807690019324,\n        \"nauc_map_at_1000_std\": 0.07110024959719435,\n        \"nauc_map_at_100_diff1\": 0.4564613211456158,\n        \"nauc_map_at_100_max\": 0.545782541881912,\n        \"nauc_map_at_100_std\": 0.07148056047352806,\n        \"nauc_map_at_10_diff1\": 0.45678409482750154,\n        \"nauc_map_at_10_max\": 0.5462465519755866,\n        \"nauc_map_at_10_std\": 0.06327954999500235,\n        \"nauc_map_at_1_diff1\": 0.5704239896928506,\n        \"nauc_map_at_1_max\": 0.6534024410633671,\n        \"nauc_map_at_1_std\": 0.023663168661545685,\n        \"nauc_map_at_20_diff1\": 0.45630693262164523,\n        \"nauc_map_at_20_max\": 0.5449016727511192,\n        \"nauc_map_at_20_std\": 0.06628084219719646,\n        \"nauc_map_at_3_diff1\": 0.46690651146077067,\n        \"nauc_map_at_3_max\": 0.5624322695466907,\n        \"nauc_map_at_3_std\": 0.0561734805035326,\n        \"nauc_map_at_5_diff1\": 0.44601957495182504,\n        \"nauc_map_at_5_max\": 0.546357284460649,\n        \"nauc_map_at_5_std\": 0.05302593819749632,\n        \"nauc_mrr_at_1000_diff1\": 0.4563057390364821,\n        \"nauc_mrr_at_1000_max\": 0.5455807690019324,\n        \"nauc_mrr_at_1000_std\": 0.07110024959719435,\n        \"nauc_mrr_at_100_diff1\": 0.4564613211456158,\n        \"nauc_mrr_at_100_max\": 0.545782541881912,\n        \"nauc_mrr_at_100_std\": 0.07148056047352806,\n        \"nauc_mrr_at_10_diff1\": 0.45678409482750154,\n        \"nauc_mrr_at_10_max\": 0.5462465519755866,\n        \"nauc_mrr_at_10_std\": 0.06327954999500235,\n        \"nauc_mrr_at_1_diff1\": 0.5704239896928506,\n        \"nauc_mrr_at_1_max\": 0.6534024410633671,\n        \"nauc_mrr_at_1_std\": 0.023663168661545685,\n        \"nauc_mrr_at_20_diff1\": 0.45630693262164523,\n        \"nauc_mrr_at_20_max\": 0.5449016727511192,\n        \"nauc_mrr_at_20_std\": 0.06628084219719646,\n        \"nauc_mrr_at_3_diff1\": 0.46690651146077067,\n        \"nauc_mrr_at_3_max\": 0.5624322695466907,\n        \"nauc_mrr_at_3_std\": 0.0561734805035326,\n        \"nauc_mrr_at_5_diff1\": 0.44601957495182504,\n        \"nauc_mrr_at_5_max\": 0.546357284460649,\n        \"nauc_mrr_at_5_std\": 0.05302593819749632,\n        \"nauc_ndcg_at_1000_diff1\": 0.4223530675214165,\n        \"nauc_ndcg_at_1000_max\": 0.5155856879665851,\n        \"nauc_ndcg_at_1000_std\": 0.1227265877897248,\n        \"nauc_ndcg_at_100_diff1\": 0.4208279282960337,\n        \"nauc_ndcg_at_100_max\": 0.5117756592677707,\n        \"nauc_ndcg_at_100_std\": 0.127400673676403,\n        \"nauc_ndcg_at_10_diff1\": 0.42602576993830543,\n        \"nauc_ndcg_at_10_max\": 0.51468292285022,\n        \"nauc_ndcg_at_10_std\": 0.08414452558367269,\n        \"nauc_ndcg_at_1_diff1\": 0.5704239896928506,\n        \"nauc_ndcg_at_1_max\": 0.6534024410633671,\n        \"nauc_ndcg_at_1_std\": 0.023663168661545685,\n        \"nauc_ndcg_at_20_diff1\": 0.42282432452418245,\n        \"nauc_ndcg_at_20_max\": 0.5087229428962105,\n        \"nauc_ndcg_at_20_std\": 0.09178765600668244,\n        \"nauc_ndcg_at_3_diff1\": 0.4391634377402065,\n        \"nauc_ndcg_at_3_max\": 0.5392950770971048,\n        \"nauc_ndcg_at_3_std\": 0.06310962168128884,\n        \"nauc_ndcg_at_5_diff1\": 0.40367034656058765,\n        \"nauc_ndcg_at_5_max\": 0.512798841157178,\n        \"nauc_ndcg_at_5_std\": 0.058583454190707915,\n        \"nauc_precision_at_1000_diff1\": 0.2302029929333522,\n        \"nauc_precision_at_1000_max\": 0.40395940141333003,\n        \"nauc_precision_at_1000_std\": 0.5805736455590976,\n        \"nauc_precision_at_100_diff1\": 0.321829367933686,\n        \"nauc_precision_at_100_max\": 0.42366111021878955,\n        \"nauc_precision_at_100_std\": 0.33775847259369973,\n        \"nauc_precision_at_10_diff1\": 0.3558943452085937,\n        \"nauc_precision_at_10_max\": 0.441400183712985,\n        \"nauc_precision_at_10_std\": 0.14219913694547434,\n        \"nauc_precision_at_1_diff1\": 0.5704239896928506,\n        \"nauc_precision_at_1_max\": 0.6534024410633671,\n        \"nauc_precision_at_1_std\": 0.023663168661545685,\n        \"nauc_precision_at_20_diff1\": 0.3438542385785166,\n        \"nauc_precision_at_20_max\": 0.4207157742607733,\n        \"nauc_precision_at_20_std\": 0.16179440361822794,\n        \"nauc_precision_at_3_diff1\": 0.3702472349205655,\n        \"nauc_precision_at_3_max\": 0.4821627769636258,\n        \"nauc_precision_at_3_std\": 0.07985009879189534,\n        \"nauc_precision_at_5_diff1\": 0.2995270909336579,\n        \"nauc_precision_at_5_max\": 0.4312457775976221,\n        \"nauc_precision_at_5_std\": 0.07129441967301732,\n        \"nauc_recall_at_1000_diff1\": 0.23020299293335245,\n        \"nauc_recall_at_1000_max\": 0.40395940141332987,\n        \"nauc_recall_at_1000_std\": 0.5805736455590972,\n        \"nauc_recall_at_100_diff1\": 0.32182936793368594,\n        \"nauc_recall_at_100_max\": 0.4236611102187895,\n        \"nauc_recall_at_100_std\": 0.33775847259369934,\n        \"nauc_recall_at_10_diff1\": 0.35589434520859364,\n        \"nauc_recall_at_10_max\": 0.44140018371298445,\n        \"nauc_recall_at_10_std\": 0.14219913694547434,\n        \"nauc_recall_at_1_diff1\": 0.5704239896928506,\n        \"nauc_recall_at_1_max\": 0.6534024410633671,\n        \"nauc_recall_at_1_std\": 0.023663168661545685,\n        \"nauc_recall_at_20_diff1\": 0.34385423857851627,\n        \"nauc_recall_at_20_max\": 0.42071577426077317,\n        \"nauc_recall_at_20_std\": 0.16179440361822775,\n        \"nauc_recall_at_3_diff1\": 0.37024723492056555,\n        \"nauc_recall_at_3_max\": 0.48216277696362575,\n        \"nauc_recall_at_3_std\": 0.07985009879189547,\n        \"nauc_recall_at_5_diff1\": 0.29952709093365765,\n        \"nauc_recall_at_5_max\": 0.431245777597622,\n        \"nauc_recall_at_5_std\": 0.07129441967301701,\n        \"ndcg_at_1\": 0.155,\n        \"ndcg_at_10\": 0.24596,\n        \"ndcg_at_100\": 0.2866,\n        \"ndcg_at_1000\": 0.32479,\n        \"ndcg_at_20\": 0.25838,\n        \"ndcg_at_3\": 0.21286,\n        \"ndcg_at_5\": 0.23114,\n        \"precision_at_1\": 0.155,\n        \"precision_at_10\": 0.0345,\n        \"precision_at_100\": 0.00545,\n        \"precision_at_1000\": 0.00086,\n        \"precision_at_20\": 0.01975,\n        \"precision_at_3\": 0.085,\n        \"precision_at_5\": 0.06,\n        \"recall_at_1\": 0.155,\n        \"recall_at_10\": 0.345,\n        \"recall_at_100\": 0.545,\n        \"recall_at_1000\": 0.86,\n        \"recall_at_20\": 0.395,\n        \"recall_at_3\": 0.255,\n        \"recall_at_5\": 0.3\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.2708,\n        \"map_at_1\": 0.19,\n        \"map_at_10\": 0.23921,\n        \"map_at_100\": 0.24591,\n        \"map_at_1000\": 0.24682,\n        \"map_at_20\": 0.2428,\n        \"map_at_3\": 0.2225,\n        \"map_at_5\": 0.22825,\n        \"mrr_at_1\": 0.19,\n        \"mrr_at_10\": 0.23920634920634926,\n        \"mrr_at_100\": 0.24590719223302934,\n        \"mrr_at_1000\": 0.24682316999124865,\n        \"mrr_at_20\": 0.2428042409946435,\n        \"mrr_at_3\": 0.2225,\n        \"mrr_at_5\": 0.22825000000000004,\n        \"nauc_map_at_1000_diff1\": 0.578021990250392,\n        \"nauc_map_at_1000_max\": 0.523318979040455,\n        \"nauc_map_at_1000_std\": 0.10476750567563853,\n        \"nauc_map_at_100_diff1\": 0.5775438826446706,\n        \"nauc_map_at_100_max\": 0.522536444698086,\n        \"nauc_map_at_100_std\": 0.1043256942507403,\n        \"nauc_map_at_10_diff1\": 0.5780895156704443,\n        \"nauc_map_at_10_max\": 0.5268633688986352,\n        \"nauc_map_at_10_std\": 0.10257357841351267,\n        \"nauc_map_at_1_diff1\": 0.6510265162342577,\n        \"nauc_map_at_1_max\": 0.5271047366031646,\n        \"nauc_map_at_1_std\": 0.055958165890404005,\n        \"nauc_map_at_20_diff1\": 0.5787872676341045,\n        \"nauc_map_at_20_max\": 0.5247364919928256,\n        \"nauc_map_at_20_std\": 0.10278104143405609,\n        \"nauc_map_at_3_diff1\": 0.6171579403599334,\n        \"nauc_map_at_3_max\": 0.5469596217147008,\n        \"nauc_map_at_3_std\": 0.09000285041565309,\n        \"nauc_map_at_5_diff1\": 0.5979177152578171,\n        \"nauc_map_at_5_max\": 0.539514391080624,\n        \"nauc_map_at_5_std\": 0.09213374119424868,\n        \"nauc_mrr_at_1000_diff1\": 0.578021990250392,\n        \"nauc_mrr_at_1000_max\": 0.523318979040455,\n        \"nauc_mrr_at_1000_std\": 0.10476750567563853,\n        \"nauc_mrr_at_100_diff1\": 0.5775438826446706,\n        \"nauc_mrr_at_100_max\": 0.522536444698086,\n        \"nauc_mrr_at_100_std\": 0.1043256942507403,\n        \"nauc_mrr_at_10_diff1\": 0.5780895156704443,\n        \"nauc_mrr_at_10_max\": 0.5268633688986352,\n        \"nauc_mrr_at_10_std\": 0.10257357841351267,\n        \"nauc_mrr_at_1_diff1\": 0.6510265162342577,\n        \"nauc_mrr_at_1_max\": 0.5271047366031646,\n        \"nauc_mrr_at_1_std\": 0.055958165890404005,\n        \"nauc_mrr_at_20_diff1\": 0.5787872676341045,\n        \"nauc_mrr_at_20_max\": 0.5247364919928256,\n        \"nauc_mrr_at_20_std\": 0.10278104143405609,\n        \"nauc_mrr_at_3_diff1\": 0.6171579403599334,\n        \"nauc_mrr_at_3_max\": 0.5469596217147008,\n        \"nauc_mrr_at_3_std\": 0.09000285041565309,\n        \"nauc_mrr_at_5_diff1\": 0.5979177152578171,\n        \"nauc_mrr_at_5_max\": 0.539514391080624,\n        \"nauc_mrr_at_5_std\": 0.09213374119424868,\n        \"nauc_ndcg_at_1000_diff1\": 0.5288524441900466,\n        \"nauc_ndcg_at_1000_max\": 0.5043243755008304,\n        \"nauc_ndcg_at_1000_std\": 0.14684049480460046,\n        \"nauc_ndcg_at_100_diff1\": 0.5177677734480506,\n        \"nauc_ndcg_at_100_max\": 0.49039519277894145,\n        \"nauc_ndcg_at_100_std\": 0.1449929646229025,\n        \"nauc_ndcg_at_10_diff1\": 0.5294774420810564,\n        \"nauc_ndcg_at_10_max\": 0.5150527233958064,\n        \"nauc_ndcg_at_10_std\": 0.1307503383225075,\n        \"nauc_ndcg_at_1_diff1\": 0.6510265162342577,\n        \"nauc_ndcg_at_1_max\": 0.5271047366031646,\n        \"nauc_ndcg_at_1_std\": 0.055958165890404005,\n        \"nauc_ndcg_at_20_diff1\": 0.5311272743578979,\n        \"nauc_ndcg_at_20_max\": 0.5059964177926148,\n        \"nauc_ndcg_at_20_std\": 0.13017095675485332,\n        \"nauc_ndcg_at_3_diff1\": 0.606812226397841,\n        \"nauc_ndcg_at_3_max\": 0.5558310317804566,\n        \"nauc_ndcg_at_3_std\": 0.10534719216179274,\n        \"nauc_ndcg_at_5_diff1\": 0.5734308027380774,\n        \"nauc_ndcg_at_5_max\": 0.5423518753341231,\n        \"nauc_ndcg_at_5_std\": 0.10834330908441163,\n        \"nauc_precision_at_1000_diff1\": 0.2733106021961501,\n        \"nauc_precision_at_1000_max\": 0.4060192767202729,\n        \"nauc_precision_at_1000_std\": 0.4061535157193871,\n        \"nauc_precision_at_100_diff1\": 0.3053573361232372,\n        \"nauc_precision_at_100_max\": 0.3555323063602586,\n        \"nauc_precision_at_100_std\": 0.29667015404596153,\n        \"nauc_precision_at_10_diff1\": 0.3921055202735711,\n        \"nauc_precision_at_10_max\": 0.4774857515062697,\n        \"nauc_precision_at_10_std\": 0.20782934375508877,\n        \"nauc_precision_at_1_diff1\": 0.6510265162342577,\n        \"nauc_precision_at_1_max\": 0.5271047366031646,\n        \"nauc_precision_at_1_std\": 0.055958165890404005,\n        \"nauc_precision_at_20_diff1\": 0.396730436592059,\n        \"nauc_precision_at_20_max\": 0.44284116476570745,\n        \"nauc_precision_at_20_std\": 0.20331378184703042,\n        \"nauc_precision_at_3_diff1\": 0.5792535698676661,\n        \"nauc_precision_at_3_max\": 0.5802423139477403,\n        \"nauc_precision_at_3_std\": 0.14759513079364642,\n        \"nauc_precision_at_5_diff1\": 0.5061741961182923,\n        \"nauc_precision_at_5_max\": 0.5485831627817537,\n        \"nauc_precision_at_5_std\": 0.1515871598697858,\n        \"nauc_recall_at_1000_diff1\": 0.2733106021961501,\n        \"nauc_recall_at_1000_max\": 0.4060192767202733,\n        \"nauc_recall_at_1000_std\": 0.40615351571938707,\n        \"nauc_recall_at_100_diff1\": 0.30535733612323657,\n        \"nauc_recall_at_100_max\": 0.35553230636025834,\n        \"nauc_recall_at_100_std\": 0.2966701540459615,\n        \"nauc_recall_at_10_diff1\": 0.392105520273571,\n        \"nauc_recall_at_10_max\": 0.4774857515062694,\n        \"nauc_recall_at_10_std\": 0.20782934375508869,\n        \"nauc_recall_at_1_diff1\": 0.6510265162342577,\n        \"nauc_recall_at_1_max\": 0.5271047366031646,\n        \"nauc_recall_at_1_std\": 0.055958165890404005,\n        \"nauc_recall_at_20_diff1\": 0.3967304365920587,\n        \"nauc_recall_at_20_max\": 0.4428411647657072,\n        \"nauc_recall_at_20_std\": 0.20331378184703022,\n        \"nauc_recall_at_3_diff1\": 0.5792535698676662,\n        \"nauc_recall_at_3_max\": 0.5802423139477398,\n        \"nauc_recall_at_3_std\": 0.14759513079364625,\n        \"nauc_recall_at_5_diff1\": 0.506174196118292,\n        \"nauc_recall_at_5_max\": 0.5485831627817535,\n        \"nauc_recall_at_5_std\": 0.15158715986978555,\n        \"ndcg_at_1\": 0.19,\n        \"ndcg_at_10\": 0.2708,\n        \"ndcg_at_100\": 0.31019,\n        \"ndcg_at_1000\": 0.33916,\n        \"ndcg_at_20\": 0.28444,\n        \"ndcg_at_3\": 0.23339,\n        \"ndcg_at_5\": 0.24372,\n        \"precision_at_1\": 0.19,\n        \"precision_at_10\": 0.0375,\n        \"precision_at_100\": 0.00575,\n        \"precision_at_1000\": 0.00082,\n        \"precision_at_20\": 0.0215,\n        \"precision_at_3\": 0.08833,\n        \"precision_at_5\": 0.058,\n        \"recall_at_1\": 0.19,\n        \"recall_at_10\": 0.375,\n        \"recall_at_100\": 0.575,\n        \"recall_at_1000\": 0.815,\n        \"recall_at_20\": 0.43,\n        \"recall_at_3\": 0.265,\n        \"recall_at_5\": 0.29\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large/intfloat__multilingual-e5-large/ab10c1a7f42e74530fe7ae5be82e6d4f11a719eb/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 5.381413459777832,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.82534,\n        \"map_at_1\": 0.68831,\n        \"map_at_10\": 0.78566,\n        \"map_at_100\": 0.78832,\n        \"map_at_1000\": 0.78832,\n        \"map_at_20\": 0.78739,\n        \"map_at_3\": 0.77056,\n        \"map_at_5\": 0.77641,\n        \"mrr_at_1\": 0.6883116883116883,\n        \"mrr_at_10\": 0.785657596371882,\n        \"mrr_at_100\": 0.7883238694927007,\n        \"mrr_at_1000\": 0.7883238694927007,\n        \"mrr_at_20\": 0.7873891981034838,\n        \"mrr_at_3\": 0.7705627705627704,\n        \"mrr_at_5\": 0.7764069264069264,\n        \"nauc_map_at_1000_diff1\": 0.8042948615488029,\n        \"nauc_map_at_1000_max\": 0.22404852716375828,\n        \"nauc_map_at_1000_std\": -0.27881068564841477,\n        \"nauc_map_at_100_diff1\": 0.8042948615488029,\n        \"nauc_map_at_100_max\": 0.22404852716375828,\n        \"nauc_map_at_100_std\": -0.27881068564841477,\n        \"nauc_map_at_10_diff1\": 0.8025655422786346,\n        \"nauc_map_at_10_max\": 0.22230817835873698,\n        \"nauc_map_at_10_std\": -0.2806074153409453,\n        \"nauc_map_at_1_diff1\": 0.8302946692246838,\n        \"nauc_map_at_1_max\": 0.2317241170179748,\n        \"nauc_map_at_1_std\": -0.192793491783307,\n        \"nauc_map_at_20_diff1\": 0.8034037360099546,\n        \"nauc_map_at_20_max\": 0.2245496806184615,\n        \"nauc_map_at_20_std\": -0.27523588788328135,\n        \"nauc_map_at_3_diff1\": 0.8022516732629955,\n        \"nauc_map_at_3_max\": 0.2221615156737509,\n        \"nauc_map_at_3_std\": -0.30766923209187896,\n        \"nauc_map_at_5_diff1\": 0.8036926446757969,\n        \"nauc_map_at_5_max\": 0.2241716349857892,\n        \"nauc_map_at_5_std\": -0.3102630334004927,\n        \"nauc_mrr_at_1000_diff1\": 0.8042948615488029,\n        \"nauc_mrr_at_1000_max\": 0.22404852716375828,\n        \"nauc_mrr_at_1000_std\": -0.27881068564841477,\n        \"nauc_mrr_at_100_diff1\": 0.8042948615488029,\n        \"nauc_mrr_at_100_max\": 0.22404852716375828,\n        \"nauc_mrr_at_100_std\": -0.27881068564841477,\n        \"nauc_mrr_at_10_diff1\": 0.8025655422786346,\n        \"nauc_mrr_at_10_max\": 0.22230817835873698,\n        \"nauc_mrr_at_10_std\": -0.2806074153409453,\n        \"nauc_mrr_at_1_diff1\": 0.8302946692246838,\n        \"nauc_mrr_at_1_max\": 0.2317241170179748,\n        \"nauc_mrr_at_1_std\": -0.192793491783307,\n        \"nauc_mrr_at_20_diff1\": 0.8034037360099546,\n        \"nauc_mrr_at_20_max\": 0.2245496806184615,\n        \"nauc_mrr_at_20_std\": -0.27523588788328135,\n        \"nauc_mrr_at_3_diff1\": 0.8022516732629955,\n        \"nauc_mrr_at_3_max\": 0.2221615156737509,\n        \"nauc_mrr_at_3_std\": -0.30766923209187896,\n        \"nauc_mrr_at_5_diff1\": 0.8036926446757969,\n        \"nauc_mrr_at_5_max\": 0.2241716349857892,\n        \"nauc_mrr_at_5_std\": -0.3102630334004927,\n        \"nauc_ndcg_at_1000_diff1\": 0.800535416072367,\n        \"nauc_ndcg_at_1000_max\": 0.22376165537986312,\n        \"nauc_ndcg_at_1000_std\": -0.2845177705394917,\n        \"nauc_ndcg_at_100_diff1\": 0.800535416072367,\n        \"nauc_ndcg_at_100_max\": 0.22376165537986312,\n        \"nauc_ndcg_at_100_std\": -0.2845177705394917,\n        \"nauc_ndcg_at_10_diff1\": 0.791163555666361,\n        \"nauc_ndcg_at_10_max\": 0.21930105422089738,\n        \"nauc_ndcg_at_10_std\": -0.2823488334907109,\n        \"nauc_ndcg_at_1_diff1\": 0.8302946692246838,\n        \"nauc_ndcg_at_1_max\": 0.2317241170179748,\n        \"nauc_ndcg_at_1_std\": -0.192793491783307,\n        \"nauc_ndcg_at_20_diff1\": 0.7946105403995175,\n        \"nauc_ndcg_at_20_max\": 0.22971240795889006,\n        \"nauc_ndcg_at_20_std\": -0.2571618122570241,\n        \"nauc_ndcg_at_3_diff1\": 0.7916549180462429,\n        \"nauc_ndcg_at_3_max\": 0.2165935406595234,\n        \"nauc_ndcg_at_3_std\": -0.3575105094880901,\n        \"nauc_ndcg_at_5_diff1\": 0.7943239308426,\n        \"nauc_ndcg_at_5_max\": 0.22129779544783112,\n        \"nauc_ndcg_at_5_std\": -0.3642016640354031,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.6752521641350954,\n        \"nauc_precision_at_10_max\": 0.1981185792546289,\n        \"nauc_precision_at_10_std\": -0.18261458357571947,\n        \"nauc_precision_at_1_diff1\": 0.8302946692246838,\n        \"nauc_precision_at_1_max\": 0.2317241170179748,\n        \"nauc_precision_at_1_std\": -0.192793491783307,\n        \"nauc_precision_at_20_diff1\": 0.6387246499035996,\n        \"nauc_precision_at_20_max\": 0.4167090338610833,\n        \"nauc_precision_at_20_std\": 0.49717544202323205,\n        \"nauc_precision_at_3_diff1\": 0.7474623592532387,\n        \"nauc_precision_at_3_max\": 0.19238123933939982,\n        \"nauc_precision_at_3_std\": -0.5686316973323878,\n        \"nauc_precision_at_5_diff1\": 0.7498540019990121,\n        \"nauc_precision_at_5_max\": 0.20849567237675368,\n        \"nauc_precision_at_5_std\": -0.6310025883818912,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.6752521641350948,\n        \"nauc_recall_at_10_max\": 0.1981185792546231,\n        \"nauc_recall_at_10_std\": -0.18261458357572427,\n        \"nauc_recall_at_1_diff1\": 0.8302946692246838,\n        \"nauc_recall_at_1_max\": 0.2317241170179748,\n        \"nauc_recall_at_1_std\": -0.192793491783307,\n        \"nauc_recall_at_20_diff1\": 0.6387246499035979,\n        \"nauc_recall_at_20_max\": 0.41670903386108427,\n        \"nauc_recall_at_20_std\": 0.4971754420232289,\n        \"nauc_recall_at_3_diff1\": 0.7474623592532373,\n        \"nauc_recall_at_3_max\": 0.19238123933939866,\n        \"nauc_recall_at_3_std\": -0.5686316973323894,\n        \"nauc_recall_at_5_diff1\": 0.7498540019990096,\n        \"nauc_recall_at_5_max\": 0.2084956723767503,\n        \"nauc_recall_at_5_std\": -0.6310025883818963,\n        \"ndcg_at_1\": 0.68831,\n        \"ndcg_at_10\": 0.82534,\n        \"ndcg_at_100\": 0.83718,\n        \"ndcg_at_1000\": 0.83718,\n        \"ndcg_at_20\": 0.83183,\n        \"ndcg_at_3\": 0.79313,\n        \"ndcg_at_5\": 0.80375,\n        \"precision_at_1\": 0.68831,\n        \"precision_at_10\": 0.09481,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.0487,\n        \"precision_at_3\": 0.28571,\n        \"precision_at_5\": 0.17662,\n        \"recall_at_1\": 0.68831,\n        \"recall_at_10\": 0.94805,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.97403,\n        \"recall_at_3\": 0.85714,\n        \"recall_at_5\": 0.88312\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large/intfloat__multilingual-e5-large/ab10c1a7f42e74530fe7ae5be82e6d4f11a719eb/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 32.079678773880005,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.3571,\n        \"map_at_1\": 0.19353,\n        \"map_at_10\": 0.30797,\n        \"map_at_100\": 0.3219,\n        \"map_at_1000\": 0.32316,\n        \"map_at_20\": 0.31431,\n        \"map_at_3\": 0.27544,\n        \"map_at_5\": 0.29204,\n        \"mrr_at_1\": 0.2798165137614679,\n        \"mrr_at_10\": 0.34842240667928726,\n        \"mrr_at_100\": 0.3587165009528493,\n        \"mrr_at_1000\": 0.35953917996926965,\n        \"mrr_at_20\": 0.3533289999823643,\n        \"mrr_at_3\": 0.3256880733944955,\n        \"mrr_at_5\": 0.33639143730886856,\n        \"nauc_map_at_1000_diff1\": 0.5138549298770038,\n        \"nauc_map_at_1000_max\": 0.15706611767695436,\n        \"nauc_map_at_1000_std\": -0.21947882754711157,\n        \"nauc_map_at_100_diff1\": 0.5134957364907854,\n        \"nauc_map_at_100_max\": 0.1572239942298593,\n        \"nauc_map_at_100_std\": -0.21899257138513686,\n        \"nauc_map_at_10_diff1\": 0.517443829870831,\n        \"nauc_map_at_10_max\": 0.1576616812242588,\n        \"nauc_map_at_10_std\": -0.22424136385398943,\n        \"nauc_map_at_1_diff1\": 0.6026428255407352,\n        \"nauc_map_at_1_max\": 0.1333788664457722,\n        \"nauc_map_at_1_std\": -0.19186056452745517,\n        \"nauc_map_at_20_diff1\": 0.5129827770934847,\n        \"nauc_map_at_20_max\": 0.15655611825932708,\n        \"nauc_map_at_20_std\": -0.22167463561240425,\n        \"nauc_map_at_3_diff1\": 0.5443309558055008,\n        \"nauc_map_at_3_max\": 0.15847786314733434,\n        \"nauc_map_at_3_std\": -0.22563259495426558,\n        \"nauc_map_at_5_diff1\": 0.5307359022230224,\n        \"nauc_map_at_5_max\": 0.16149176531535286,\n        \"nauc_map_at_5_std\": -0.2313479654688125,\n        \"nauc_mrr_at_1000_diff1\": 0.5283827722446927,\n        \"nauc_mrr_at_1000_max\": 0.1506119471141864,\n        \"nauc_mrr_at_1000_std\": -0.21075871618386696,\n        \"nauc_mrr_at_100_diff1\": 0.5280079337854601,\n        \"nauc_mrr_at_100_max\": 0.15075854483196036,\n        \"nauc_mrr_at_100_std\": -0.21008844904204566,\n        \"nauc_mrr_at_10_diff1\": 0.5298360528677714,\n        \"nauc_mrr_at_10_max\": 0.14870326948232312,\n        \"nauc_mrr_at_10_std\": -0.214380021311685,\n        \"nauc_mrr_at_1_diff1\": 0.5743959063219708,\n        \"nauc_mrr_at_1_max\": 0.16265322563646364,\n        \"nauc_mrr_at_1_std\": -0.18833485079936244,\n        \"nauc_mrr_at_20_diff1\": 0.5279608493500507,\n        \"nauc_mrr_at_20_max\": 0.15013039546532891,\n        \"nauc_mrr_at_20_std\": -0.21149396060210648,\n        \"nauc_mrr_at_3_diff1\": 0.5421280864610498,\n        \"nauc_mrr_at_3_max\": 0.15026320651956152,\n        \"nauc_mrr_at_3_std\": -0.21799080721300038,\n        \"nauc_mrr_at_5_diff1\": 0.5370787309258472,\n        \"nauc_mrr_at_5_max\": 0.15248396940948003,\n        \"nauc_mrr_at_5_std\": -0.21967449720066567,\n        \"nauc_ndcg_at_1000_diff1\": 0.49811150509547963,\n        \"nauc_ndcg_at_1000_max\": 0.15640312953034563,\n        \"nauc_ndcg_at_1000_std\": -0.2042439819629608,\n        \"nauc_ndcg_at_100_diff1\": 0.4852555831694557,\n        \"nauc_ndcg_at_100_max\": 0.16115266284830218,\n        \"nauc_ndcg_at_100_std\": -0.18903752480149202,\n        \"nauc_ndcg_at_10_diff1\": 0.4959985025680068,\n        \"nauc_ndcg_at_10_max\": 0.15079190670828926,\n        \"nauc_ndcg_at_10_std\": -0.2242977737169114,\n        \"nauc_ndcg_at_1_diff1\": 0.5743959063219708,\n        \"nauc_ndcg_at_1_max\": 0.16265322563646364,\n        \"nauc_ndcg_at_1_std\": -0.18833485079936244,\n        \"nauc_ndcg_at_20_diff1\": 0.4847466273790778,\n        \"nauc_ndcg_at_20_max\": 0.1510848080108304,\n        \"nauc_ndcg_at_20_std\": -0.21481695964044425,\n        \"nauc_ndcg_at_3_diff1\": 0.5355513006467298,\n        \"nauc_ndcg_at_3_max\": 0.15115082409197186,\n        \"nauc_ndcg_at_3_std\": -0.2326831413567524,\n        \"nauc_ndcg_at_5_diff1\": 0.5195025224339292,\n        \"nauc_ndcg_at_5_max\": 0.1578451311010888,\n        \"nauc_ndcg_at_5_std\": -0.23854976550429074,\n        \"nauc_precision_at_1000_diff1\": -0.03589529200880238,\n        \"nauc_precision_at_1000_max\": 0.0721575870675354,\n        \"nauc_precision_at_1000_std\": 0.11651396952596191,\n        \"nauc_precision_at_100_diff1\": 0.08463744093830189,\n        \"nauc_precision_at_100_max\": 0.12889529870201247,\n        \"nauc_precision_at_100_std\": 0.07228197543698799,\n        \"nauc_precision_at_10_diff1\": 0.2548094988167048,\n        \"nauc_precision_at_10_max\": 0.10758428277045155,\n        \"nauc_precision_at_10_std\": -0.16332896820174375,\n        \"nauc_precision_at_1_diff1\": 0.5743959063219708,\n        \"nauc_precision_at_1_max\": 0.16265322563646364,\n        \"nauc_precision_at_1_std\": -0.18833485079936244,\n        \"nauc_precision_at_20_diff1\": 0.1884737665414867,\n        \"nauc_precision_at_20_max\": 0.10039935632406857,\n        \"nauc_precision_at_20_std\": -0.10994045270402089,\n        \"nauc_precision_at_3_diff1\": 0.38339762191899696,\n        \"nauc_precision_at_3_max\": 0.14601652881659463,\n        \"nauc_precision_at_3_std\": -0.20711924836563086,\n        \"nauc_precision_at_5_diff1\": 0.33200959009193537,\n        \"nauc_precision_at_5_max\": 0.13913915589491396,\n        \"nauc_precision_at_5_std\": -0.2129621767324046,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.30827274858191983,\n        \"nauc_recall_at_100_max\": 0.2011530724751607,\n        \"nauc_recall_at_100_std\": -0.010097304957252298,\n        \"nauc_recall_at_10_diff1\": 0.40650972514828604,\n        \"nauc_recall_at_10_max\": 0.1407876095206232,\n        \"nauc_recall_at_10_std\": -0.22041004043085902,\n        \"nauc_recall_at_1_diff1\": 0.6026428255407352,\n        \"nauc_recall_at_1_max\": 0.1333788664457722,\n        \"nauc_recall_at_1_std\": -0.19186056452745517,\n        \"nauc_recall_at_20_diff1\": 0.3669244580517796,\n        \"nauc_recall_at_20_max\": 0.14017332698852716,\n        \"nauc_recall_at_20_std\": -0.19365573286425647,\n        \"nauc_recall_at_3_diff1\": 0.5076772126959125,\n        \"nauc_recall_at_3_max\": 0.14378997670580718,\n        \"nauc_recall_at_3_std\": -0.2508505427267107,\n        \"nauc_recall_at_5_diff1\": 0.4695357175880984,\n        \"nauc_recall_at_5_max\": 0.15627328191656,\n        \"nauc_recall_at_5_std\": -0.25764388965660323,\n        \"ndcg_at_1\": 0.27982,\n        \"ndcg_at_10\": 0.3571,\n        \"ndcg_at_100\": 0.42603,\n        \"ndcg_at_1000\": 0.45678,\n        \"ndcg_at_20\": 0.37717,\n        \"ndcg_at_3\": 0.30518,\n        \"ndcg_at_5\": 0.32476,\n        \"precision_at_1\": 0.27982,\n        \"precision_at_10\": 0.07477,\n        \"precision_at_100\": 0.0124,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.04335,\n        \"precision_at_3\": 0.1738,\n        \"precision_at_5\": 0.12141,\n        \"recall_at_1\": 0.19353,\n        \"recall_at_10\": 0.46376,\n        \"recall_at_100\": 0.77339,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.53236,\n        \"recall_at_3\": 0.32531,\n        \"recall_at_5\": 0.37551\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.31094,\n        \"map_at_1\": 0.11333,\n        \"map_at_10\": 0.24545,\n        \"map_at_100\": 0.26562,\n        \"map_at_1000\": 0.26749,\n        \"map_at_20\": 0.25597,\n        \"map_at_3\": 0.19906,\n        \"map_at_5\": 0.22564,\n        \"mrr_at_1\": 0.20336391437308868,\n        \"mrr_at_10\": 0.3066459152468327,\n        \"mrr_at_100\": 0.3200820113927799,\n        \"mrr_at_1000\": 0.3208093102193586,\n        \"mrr_at_20\": 0.31510573567817174,\n        \"mrr_at_3\": 0.27777777777777796,\n        \"mrr_at_5\": 0.2939092762487259,\n        \"nauc_map_at_1000_diff1\": 0.11425958191910945,\n        \"nauc_map_at_1000_max\": 0.13522112373677148,\n        \"nauc_map_at_1000_std\": -0.23322284294211604,\n        \"nauc_map_at_100_diff1\": 0.11413610768701515,\n        \"nauc_map_at_100_max\": 0.13370690711946526,\n        \"nauc_map_at_100_std\": -0.23411130471182684,\n        \"nauc_map_at_10_diff1\": 0.1184495655302733,\n        \"nauc_map_at_10_max\": 0.13563441812048518,\n        \"nauc_map_at_10_std\": -0.24270965115117196,\n        \"nauc_map_at_1_diff1\": 0.1692354811812946,\n        \"nauc_map_at_1_max\": 0.21218528961951696,\n        \"nauc_map_at_1_std\": -0.17591883514018467,\n        \"nauc_map_at_20_diff1\": 0.11725028326714887,\n        \"nauc_map_at_20_max\": 0.13323610200660557,\n        \"nauc_map_at_20_std\": -0.2404168732861843,\n        \"nauc_map_at_3_diff1\": 0.11677334137424876,\n        \"nauc_map_at_3_max\": 0.16600746017544304,\n        \"nauc_map_at_3_std\": -0.2255894882300477,\n        \"nauc_map_at_5_diff1\": 0.12201030040561259,\n        \"nauc_map_at_5_max\": 0.14770064826124832,\n        \"nauc_map_at_5_std\": -0.23569636575078878,\n        \"nauc_mrr_at_1000_diff1\": 0.1039871361198157,\n        \"nauc_mrr_at_1000_max\": 0.13294927914886112,\n        \"nauc_mrr_at_1000_std\": -0.22912308332946335,\n        \"nauc_mrr_at_100_diff1\": 0.10377355588617188,\n        \"nauc_mrr_at_100_max\": 0.13239832936623644,\n        \"nauc_mrr_at_100_std\": -0.2290072339056491,\n        \"nauc_mrr_at_10_diff1\": 0.10754838047109636,\n        \"nauc_mrr_at_10_max\": 0.13026701471658167,\n        \"nauc_mrr_at_10_std\": -0.23916824363969363,\n        \"nauc_mrr_at_1_diff1\": 0.15805964434970776,\n        \"nauc_mrr_at_1_max\": 0.23059526255686508,\n        \"nauc_mrr_at_1_std\": -0.1766781943662403,\n        \"nauc_mrr_at_20_diff1\": 0.10352053698401652,\n        \"nauc_mrr_at_20_max\": 0.13038796281537302,\n        \"nauc_mrr_at_20_std\": -0.23313763025758455,\n        \"nauc_mrr_at_3_diff1\": 0.10803633282547864,\n        \"nauc_mrr_at_3_max\": 0.14947870220370624,\n        \"nauc_mrr_at_3_std\": -0.22835391953660417,\n        \"nauc_mrr_at_5_diff1\": 0.10620245353325078,\n        \"nauc_mrr_at_5_max\": 0.13468665184581083,\n        \"nauc_mrr_at_5_std\": -0.2341643874293665,\n        \"nauc_ndcg_at_1000_diff1\": 0.09251582953701985,\n        \"nauc_ndcg_at_1000_max\": 0.11518617431466921,\n        \"nauc_ndcg_at_1000_std\": -0.2210907355602964,\n        \"nauc_ndcg_at_100_diff1\": 0.08223322787581405,\n        \"nauc_ndcg_at_100_max\": 0.09834852768094031,\n        \"nauc_ndcg_at_100_std\": -0.21658736652593918,\n        \"nauc_ndcg_at_10_diff1\": 0.10156045352650941,\n        \"nauc_ndcg_at_10_max\": 0.10073501229237586,\n        \"nauc_ndcg_at_10_std\": -0.2622246009221012,\n        \"nauc_ndcg_at_1_diff1\": 0.15805964434970776,\n        \"nauc_ndcg_at_1_max\": 0.23059526255686508,\n        \"nauc_ndcg_at_1_std\": -0.1766781943662403,\n        \"nauc_ndcg_at_20_diff1\": 0.09221995427715365,\n        \"nauc_ndcg_at_20_max\": 0.09270514139435625,\n        \"nauc_ndcg_at_20_std\": -0.2513232750935288,\n        \"nauc_ndcg_at_3_diff1\": 0.1060598008256348,\n        \"nauc_ndcg_at_3_max\": 0.15037561069761582,\n        \"nauc_ndcg_at_3_std\": -0.24293322987087043,\n        \"nauc_ndcg_at_5_diff1\": 0.10662261587225039,\n        \"nauc_ndcg_at_5_max\": 0.11923002425610947,\n        \"nauc_ndcg_at_5_std\": -0.24917569135736384,\n        \"nauc_precision_at_1000_diff1\": -0.00545209595105802,\n        \"nauc_precision_at_1000_max\": 0.009575450938722765,\n        \"nauc_precision_at_1000_std\": 0.013030685694043514,\n        \"nauc_precision_at_100_diff1\": -0.012190888503449399,\n        \"nauc_precision_at_100_max\": -0.01150201764909971,\n        \"nauc_precision_at_100_std\": -0.028989227689994995,\n        \"nauc_precision_at_10_diff1\": 0.07100666295380739,\n        \"nauc_precision_at_10_max\": 0.023002780783397795,\n        \"nauc_precision_at_10_std\": -0.23243183541419282,\n        \"nauc_precision_at_1_diff1\": 0.15805964434970776,\n        \"nauc_precision_at_1_max\": 0.23059526255686508,\n        \"nauc_precision_at_1_std\": -0.1766781943662403,\n        \"nauc_precision_at_20_diff1\": 0.04742722206087879,\n        \"nauc_precision_at_20_max\": -0.0021771031283383964,\n        \"nauc_precision_at_20_std\": -0.19515025526504237,\n        \"nauc_precision_at_3_diff1\": 0.08617923357508446,\n        \"nauc_precision_at_3_max\": 0.13180630249788944,\n        \"nauc_precision_at_3_std\": -0.24183469944734207,\n        \"nauc_precision_at_5_diff1\": 0.0874821096786221,\n        \"nauc_precision_at_5_max\": 0.07866866827452602,\n        \"nauc_precision_at_5_std\": -0.24266623091805606,\n        \"nauc_recall_at_1000_diff1\": 0.7222547590617517,\n        \"nauc_recall_at_1000_max\": 0.869369819235015,\n        \"nauc_recall_at_1000_std\": 0.7222547590617517,\n        \"nauc_recall_at_100_diff1\": -0.054201511406694665,\n        \"nauc_recall_at_100_max\": -0.034624616677202624,\n        \"nauc_recall_at_100_std\": -0.07300396774406927,\n        \"nauc_recall_at_10_diff1\": 0.05828772902103733,\n        \"nauc_recall_at_10_max\": 0.028377440281751782,\n        \"nauc_recall_at_10_std\": -0.28217277278383585,\n        \"nauc_recall_at_1_diff1\": 0.1692354811812946,\n        \"nauc_recall_at_1_max\": 0.21218528961951696,\n        \"nauc_recall_at_1_std\": -0.17591883514018467,\n        \"nauc_recall_at_20_diff1\": 0.024863917911959483,\n        \"nauc_recall_at_20_max\": -0.0017203766062452103,\n        \"nauc_recall_at_20_std\": -0.24781992086304866,\n        \"nauc_recall_at_3_diff1\": 0.06276907993627277,\n        \"nauc_recall_at_3_max\": 0.10532900063127473,\n        \"nauc_recall_at_3_std\": -0.2467354814385313,\n        \"nauc_recall_at_5_diff1\": 0.07359713001358666,\n        \"nauc_recall_at_5_max\": 0.05871797288722992,\n        \"nauc_recall_at_5_std\": -0.2559901740274049,\n        \"ndcg_at_1\": 0.20336,\n        \"ndcg_at_10\": 0.31094,\n        \"ndcg_at_100\": 0.39884,\n        \"ndcg_at_1000\": 0.42943,\n        \"ndcg_at_20\": 0.34327,\n        \"ndcg_at_3\": 0.24829,\n        \"ndcg_at_5\": 0.27407,\n        \"precision_at_1\": 0.20336,\n        \"precision_at_10\": 0.0867,\n        \"precision_at_100\": 0.0158,\n        \"precision_at_1000\": 0.00195,\n        \"precision_at_20\": 0.05367,\n        \"precision_at_3\": 0.1682,\n        \"precision_at_5\": 0.13272,\n        \"recall_at_1\": 0.11333,\n        \"recall_at_10\": 0.43379,\n        \"recall_at_100\": 0.7987,\n        \"recall_at_1000\": 0.99847,\n        \"recall_at_20\": 0.54123,\n        \"recall_at_3\": 0.26741,\n        \"recall_at_5\": 0.34264\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.34022,\n        \"map_at_1\": 0.18219,\n        \"map_at_10\": 0.29275,\n        \"map_at_100\": 0.30851,\n        \"map_at_1000\": 0.30996,\n        \"map_at_20\": 0.30086,\n        \"map_at_3\": 0.25706,\n        \"map_at_5\": 0.2773,\n        \"mrr_at_1\": 0.25732899022801303,\n        \"mrr_at_10\": 0.32775838891474063,\n        \"mrr_at_100\": 0.33930894289400076,\n        \"mrr_at_1000\": 0.34010859395124843,\n        \"mrr_at_20\": 0.33415785156577893,\n        \"mrr_at_3\": 0.3056460369163953,\n        \"mrr_at_5\": 0.3163952225841477,\n        \"nauc_map_at_1000_diff1\": 0.43378857137081317,\n        \"nauc_map_at_1000_max\": 0.15535049635339068,\n        \"nauc_map_at_1000_std\": -0.13077142854953677,\n        \"nauc_map_at_100_diff1\": 0.4333201230465107,\n        \"nauc_map_at_100_max\": 0.1554593261211638,\n        \"nauc_map_at_100_std\": -0.13057160318147662,\n        \"nauc_map_at_10_diff1\": 0.4346209427682855,\n        \"nauc_map_at_10_max\": 0.156591838771751,\n        \"nauc_map_at_10_std\": -0.1320605005830169,\n        \"nauc_map_at_1_diff1\": 0.5225535776695338,\n        \"nauc_map_at_1_max\": 0.15584196650847043,\n        \"nauc_map_at_1_std\": -0.08921387429404619,\n        \"nauc_map_at_20_diff1\": 0.43355620094562536,\n        \"nauc_map_at_20_max\": 0.15424228962802783,\n        \"nauc_map_at_20_std\": -0.13123767883247464,\n        \"nauc_map_at_3_diff1\": 0.45188009332621976,\n        \"nauc_map_at_3_max\": 0.15456738468260678,\n        \"nauc_map_at_3_std\": -0.12090759593450583,\n        \"nauc_map_at_5_diff1\": 0.4359700028114134,\n        \"nauc_map_at_5_max\": 0.1624127622487365,\n        \"nauc_map_at_5_std\": -0.12398811036745316,\n        \"nauc_mrr_at_1000_diff1\": 0.47154484905734406,\n        \"nauc_mrr_at_1000_max\": 0.18288056423097326,\n        \"nauc_mrr_at_1000_std\": -0.12756826523652975,\n        \"nauc_mrr_at_100_diff1\": 0.4714010642831594,\n        \"nauc_mrr_at_100_max\": 0.18303134467603407,\n        \"nauc_mrr_at_100_std\": -0.12749949375579667,\n        \"nauc_mrr_at_10_diff1\": 0.47336164375825707,\n        \"nauc_mrr_at_10_max\": 0.17949764221735748,\n        \"nauc_mrr_at_10_std\": -0.13149193189339925,\n        \"nauc_mrr_at_1_diff1\": 0.505606121700976,\n        \"nauc_mrr_at_1_max\": 0.1971297183494224,\n        \"nauc_mrr_at_1_std\": -0.11120789239003809,\n        \"nauc_mrr_at_20_diff1\": 0.4709653518631757,\n        \"nauc_mrr_at_20_max\": 0.1834552198970404,\n        \"nauc_mrr_at_20_std\": -0.12617556743828223,\n        \"nauc_mrr_at_3_diff1\": 0.48088063281998156,\n        \"nauc_mrr_at_3_max\": 0.18655389744378906,\n        \"nauc_mrr_at_3_std\": -0.13278801543058455,\n        \"nauc_mrr_at_5_diff1\": 0.47522461248833187,\n        \"nauc_mrr_at_5_max\": 0.18535019838518463,\n        \"nauc_mrr_at_5_std\": -0.1299630665463673,\n        \"nauc_ndcg_at_1000_diff1\": 0.43226978854923204,\n        \"nauc_ndcg_at_1000_max\": 0.16318872909152207,\n        \"nauc_ndcg_at_1000_std\": -0.12677086508048077,\n        \"nauc_ndcg_at_100_diff1\": 0.4197454292188696,\n        \"nauc_ndcg_at_100_max\": 0.16471287955051728,\n        \"nauc_ndcg_at_100_std\": -0.1242050691448354,\n        \"nauc_ndcg_at_10_diff1\": 0.42789163679262,\n        \"nauc_ndcg_at_10_max\": 0.15174365698596645,\n        \"nauc_ndcg_at_10_std\": -0.13983430076673511,\n        \"nauc_ndcg_at_1_diff1\": 0.505606121700976,\n        \"nauc_ndcg_at_1_max\": 0.1971297183494224,\n        \"nauc_ndcg_at_1_std\": -0.11120789239003809,\n        \"nauc_ndcg_at_20_diff1\": 0.4228092278846085,\n        \"nauc_ndcg_at_20_max\": 0.1521780768329811,\n        \"nauc_ndcg_at_20_std\": -0.13081564253954298,\n        \"nauc_ndcg_at_3_diff1\": 0.44538947482989755,\n        \"nauc_ndcg_at_3_max\": 0.15294276809515184,\n        \"nauc_ndcg_at_3_std\": -0.13479945201257715,\n        \"nauc_ndcg_at_5_diff1\": 0.4332480000238585,\n        \"nauc_ndcg_at_5_max\": 0.16421233739990027,\n        \"nauc_ndcg_at_5_std\": -0.13024612438239955,\n        \"nauc_precision_at_1000_diff1\": 0.007813782679524005,\n        \"nauc_precision_at_1000_max\": 0.12181094948854453,\n        \"nauc_precision_at_1000_std\": 0.026396427608266396,\n        \"nauc_precision_at_100_diff1\": 0.08275612190388706,\n        \"nauc_precision_at_100_max\": 0.1470704819648003,\n        \"nauc_precision_at_100_std\": -0.014471486575332319,\n        \"nauc_precision_at_10_diff1\": 0.227080207545651,\n        \"nauc_precision_at_10_max\": 0.10356769209172943,\n        \"nauc_precision_at_10_std\": -0.16004221638654986,\n        \"nauc_precision_at_1_diff1\": 0.505606121700976,\n        \"nauc_precision_at_1_max\": 0.1971297183494224,\n        \"nauc_precision_at_1_std\": -0.11120789239003809,\n        \"nauc_precision_at_20_diff1\": 0.18498933751641064,\n        \"nauc_precision_at_20_max\": 0.09046124563031495,\n        \"nauc_precision_at_20_std\": -0.1278407870889799,\n        \"nauc_precision_at_3_diff1\": 0.30644575638980337,\n        \"nauc_precision_at_3_max\": 0.1458981532783693,\n        \"nauc_precision_at_3_std\": -0.14357842661749431,\n        \"nauc_precision_at_5_diff1\": 0.2517676981179563,\n        \"nauc_precision_at_5_max\": 0.14297124191463026,\n        \"nauc_precision_at_5_std\": -0.1488828633233652,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.2597346348531165,\n        \"nauc_recall_at_100_max\": 0.16776282781560076,\n        \"nauc_recall_at_100_std\": -0.08738029961423872,\n        \"nauc_recall_at_10_diff1\": 0.36399932536981683,\n        \"nauc_recall_at_10_max\": 0.11894029557077423,\n        \"nauc_recall_at_10_std\": -0.14673953529637915,\n        \"nauc_recall_at_1_diff1\": 0.5225535776695338,\n        \"nauc_recall_at_1_max\": 0.15584196650847043,\n        \"nauc_recall_at_1_std\": -0.08921387429404619,\n        \"nauc_recall_at_20_diff1\": 0.33968994682381265,\n        \"nauc_recall_at_20_max\": 0.11705223183609517,\n        \"nauc_recall_at_20_std\": -0.1150270696095652,\n        \"nauc_recall_at_3_diff1\": 0.4222884972688852,\n        \"nauc_recall_at_3_max\": 0.13077819571940505,\n        \"nauc_recall_at_3_std\": -0.14150932434179694,\n        \"nauc_recall_at_5_diff1\": 0.3873390941681804,\n        \"nauc_recall_at_5_max\": 0.14812299412156793,\n        \"nauc_recall_at_5_std\": -0.13082787279472374,\n        \"ndcg_at_1\": 0.25733,\n        \"ndcg_at_10\": 0.34022,\n        \"ndcg_at_100\": 0.41412,\n        \"ndcg_at_1000\": 0.44655,\n        \"ndcg_at_20\": 0.3661,\n        \"ndcg_at_3\": 0.28539,\n        \"ndcg_at_5\": 0.30887,\n        \"precision_at_1\": 0.25733,\n        \"precision_at_10\": 0.07557,\n        \"precision_at_100\": 0.01313,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.0456,\n        \"precision_at_3\": 0.1645,\n        \"precision_at_5\": 0.12117,\n        \"recall_at_1\": 0.18219,\n        \"recall_at_10\": 0.4428,\n        \"recall_at_100\": 0.76261,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.53298,\n        \"recall_at_3\": 0.30131,\n        \"recall_at_5\": 0.35681\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large/intfloat__multilingual-e5-large/ab10c1a7f42e74530fe7ae5be82e6d4f11a719eb/model_meta.json",
    "content": "{\"name\": \"intfloat/multilingual-e5-large\", \"revision\": \"ab10c1a7f42e74530fe7ae5be82e6d4f11a719eb\", \"release_date\": \"2024-02-08\", \"languages\": [\"afr_Latn\", \"amh_Latn\", \"ara_Latn\", \"asm_Latn\", \"aze_Latn\", \"bel_Latn\", \"bul_Latn\", \"ben_Latn\", \"ben_Beng\", \"bre_Latn\", \"bos_Latn\", \"cat_Latn\", \"ces_Latn\", \"cym_Latn\", \"dan_Latn\", \"deu_Latn\", \"ell_Latn\", \"eng_Latn\", \"epo_Latn\", \"spa_Latn\", \"est_Latn\", \"eus_Latn\", \"fas_Latn\", \"fin_Latn\", \"fra_Latn\", \"fry_Latn\", \"gle_Latn\", \"gla_Latn\", \"glg_Latn\", \"guj_Latn\", \"hau_Latn\", \"heb_Latn\", \"hin_Latn\", \"hin_Deva\", \"hrv_Latn\", \"hun_Latn\", \"hye_Latn\", \"ind_Latn\", \"isl_Latn\", \"ita_Latn\", \"jpn_Latn\", \"jav_Latn\", \"kat_Latn\", \"kaz_Latn\", \"khm_Latn\", \"kan_Latn\", \"kor_Latn\", \"kur_Latn\", \"kir_Latn\", \"lat_Latn\", \"lao_Latn\", \"lit_Latn\", \"lav_Latn\", \"mlg_Latn\", \"mkd_Latn\", \"mal_Latn\", \"mon_Latn\", \"mar_Latn\", \"msa_Latn\", \"mya_Latn\", \"nep_Latn\", \"nld_Latn\", \"nob_Latn\", \"orm_Latn\", \"ori_Latn\", \"pan_Latn\", \"pol_Latn\", \"pus_Latn\", \"por_Latn\", \"ron_Latn\", \"rus_Latn\", \"san_Latn\", \"snd_Latn\", \"sin_Latn\", \"slk_Latn\", \"slv_Latn\", \"som_Latn\", \"sqi_Latn\", \"srp_Latn\", \"sun_Latn\", \"swe_Latn\", \"swa_Latn\", \"tam_Latn\", \"tam_Taml\", \"tel_Latn\", \"tel_Telu\", \"tha_Latn\", \"tgl_Latn\", \"tur_Latn\", \"uig_Latn\", \"ukr_Latn\", \"urd_Latn\", \"urd_Arab\", \"uzb_Latn\", \"vie_Latn\", \"xho_Latn\", \"yid_Latn\", \"zho_Hant\", \"zho_Hans\"], \"n_parameters\": 560000000, \"memory_usage\": null, \"max_tokens\": 514, \"embed_dim\": 1024, \"license\": \"mit\", \"open_weights\": true, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"Sentence Transformers\", \"PyTorch\"], \"reference\": \"https://huggingface.co/intfloat/multilingual-e5-large\", \"similarity_fn_name\": \"cosine\", \"use_instructions\": true, \"zero_shot_benchmarks\": null, \"loader\": \"sentence_transformers_loader\"}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large-instruct/intfloat__multilingual-e5-large-instruct/baa7be480a7de1539afce709c8f13f833a510e0a/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 9.748866319656372,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.77996,\n        \"map_at_1\": 0.63158,\n        \"map_at_10\": 0.73422,\n        \"map_at_100\": 0.73798,\n        \"map_at_1000\": 0.73798,\n        \"map_at_20\": 0.73664,\n        \"map_at_3\": 0.71491,\n        \"map_at_5\": 0.72456,\n        \"mrr_at_1\": 0.631578947368421,\n        \"mrr_at_10\": 0.7342209690893903,\n        \"mrr_at_100\": 0.7379801603806115,\n        \"mrr_at_1000\": 0.7379801603806115,\n        \"mrr_at_20\": 0.7366366532052129,\n        \"mrr_at_3\": 0.7149122807017544,\n        \"mrr_at_5\": 0.7245614035087722,\n        \"nauc_map_at_1000_diff1\": 0.639926260318653,\n        \"nauc_map_at_1000_max\": 0.0690961457298233,\n        \"nauc_map_at_1000_std\": -0.4479754754387847,\n        \"nauc_map_at_100_diff1\": 0.639926260318653,\n        \"nauc_map_at_100_max\": 0.0690961457298233,\n        \"nauc_map_at_100_std\": -0.4479754754387847,\n        \"nauc_map_at_10_diff1\": 0.6413402133513847,\n        \"nauc_map_at_10_max\": 0.07409359198407652,\n        \"nauc_map_at_10_std\": -0.4506537175901882,\n        \"nauc_map_at_1_diff1\": 0.6755296859994486,\n        \"nauc_map_at_1_max\": 0.024150951562940618,\n        \"nauc_map_at_1_std\": -0.37759464704889256,\n        \"nauc_map_at_20_diff1\": 0.6402194895134982,\n        \"nauc_map_at_20_max\": 0.07059215552277907,\n        \"nauc_map_at_20_std\": -0.4524287048567066,\n        \"nauc_map_at_3_diff1\": 0.6077115138203844,\n        \"nauc_map_at_3_max\": 0.05784884520381813,\n        \"nauc_map_at_3_std\": -0.43069080633151685,\n        \"nauc_map_at_5_diff1\": 0.6327767915615091,\n        \"nauc_map_at_5_max\": 0.045230434391050546,\n        \"nauc_map_at_5_std\": -0.47052118506215285,\n        \"nauc_mrr_at_1000_diff1\": 0.639926260318653,\n        \"nauc_mrr_at_1000_max\": 0.0690961457298233,\n        \"nauc_mrr_at_1000_std\": -0.4479754754387847,\n        \"nauc_mrr_at_100_diff1\": 0.639926260318653,\n        \"nauc_mrr_at_100_max\": 0.0690961457298233,\n        \"nauc_mrr_at_100_std\": -0.4479754754387847,\n        \"nauc_mrr_at_10_diff1\": 0.6413402133513847,\n        \"nauc_mrr_at_10_max\": 0.07409359198407652,\n        \"nauc_mrr_at_10_std\": -0.4506537175901882,\n        \"nauc_mrr_at_1_diff1\": 0.6755296859994486,\n        \"nauc_mrr_at_1_max\": 0.024150951562940618,\n        \"nauc_mrr_at_1_std\": -0.37759464704889256,\n        \"nauc_mrr_at_20_diff1\": 0.6402194895134982,\n        \"nauc_mrr_at_20_max\": 0.07059215552277907,\n        \"nauc_mrr_at_20_std\": -0.4524287048567066,\n        \"nauc_mrr_at_3_diff1\": 0.6077115138203844,\n        \"nauc_mrr_at_3_max\": 0.05784884520381813,\n        \"nauc_mrr_at_3_std\": -0.43069080633151685,\n        \"nauc_mrr_at_5_diff1\": 0.6327767915615091,\n        \"nauc_mrr_at_5_max\": 0.045230434391050546,\n        \"nauc_mrr_at_5_std\": -0.47052118506215285,\n        \"nauc_ndcg_at_1000_diff1\": 0.6386861983810836,\n        \"nauc_ndcg_at_1000_max\": 0.07844222424411847,\n        \"nauc_ndcg_at_1000_std\": -0.4626464976834516,\n        \"nauc_ndcg_at_100_diff1\": 0.6386861983810836,\n        \"nauc_ndcg_at_100_max\": 0.07844222424411847,\n        \"nauc_ndcg_at_100_std\": -0.4626464976834516,\n        \"nauc_ndcg_at_10_diff1\": 0.6468051138280505,\n        \"nauc_ndcg_at_10_max\": 0.10832580287969389,\n        \"nauc_ndcg_at_10_std\": -0.48937782027332816,\n        \"nauc_ndcg_at_1_diff1\": 0.6755296859994486,\n        \"nauc_ndcg_at_1_max\": 0.024150951562940618,\n        \"nauc_ndcg_at_1_std\": -0.37759464704889256,\n        \"nauc_ndcg_at_20_diff1\": 0.6410441362879792,\n        \"nauc_ndcg_at_20_max\": 0.09238377122473308,\n        \"nauc_ndcg_at_20_std\": -0.4955340508129813,\n        \"nauc_ndcg_at_3_diff1\": 0.5783362178814786,\n        \"nauc_ndcg_at_3_max\": 0.06494448464990901,\n        \"nauc_ndcg_at_3_std\": -0.44777161440202856,\n        \"nauc_ndcg_at_5_diff1\": 0.6242306769679065,\n        \"nauc_ndcg_at_5_max\": 0.03631279046215516,\n        \"nauc_ndcg_at_5_std\": -0.5313356819910321,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.7260630395460898,\n        \"nauc_precision_at_10_max\": 0.4180512866096978,\n        \"nauc_precision_at_10_std\": -0.8142213143329762,\n        \"nauc_precision_at_1_diff1\": 0.6755296859994486,\n        \"nauc_precision_at_1_max\": 0.024150951562940618,\n        \"nauc_precision_at_1_std\": -0.37759464704889256,\n        \"nauc_precision_at_20_diff1\": 0.6874924403711331,\n        \"nauc_precision_at_20_max\": 0.39049602606361516,\n        \"nauc_precision_at_20_std\": -1.142232887868855,\n        \"nauc_precision_at_3_diff1\": 0.45951758918561936,\n        \"nauc_precision_at_3_max\": 0.09068385936815057,\n        \"nauc_precision_at_3_std\": -0.5145244386038328,\n        \"nauc_precision_at_5_diff1\": 0.5894327798332507,\n        \"nauc_precision_at_5_max\": -0.022828393192234623,\n        \"nauc_precision_at_5_std\": -0.8547226023738643,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.726063039546092,\n        \"nauc_recall_at_10_max\": 0.418051286609699,\n        \"nauc_recall_at_10_std\": -0.8142213143329806,\n        \"nauc_recall_at_1_diff1\": 0.6755296859994486,\n        \"nauc_recall_at_1_max\": 0.024150951562940618,\n        \"nauc_recall_at_1_std\": -0.37759464704889256,\n        \"nauc_recall_at_20_diff1\": 0.6874924403711355,\n        \"nauc_recall_at_20_max\": 0.3904960260636177,\n        \"nauc_recall_at_20_std\": -1.1422328878688501,\n        \"nauc_recall_at_3_diff1\": 0.4595175891856197,\n        \"nauc_recall_at_3_max\": 0.09068385936815089,\n        \"nauc_recall_at_3_std\": -0.514524438603832,\n        \"nauc_recall_at_5_diff1\": 0.5894327798332518,\n        \"nauc_recall_at_5_max\": -0.022828393192234387,\n        \"nauc_recall_at_5_std\": -0.8547226023738652,\n        \"ndcg_at_1\": 0.63158,\n        \"ndcg_at_10\": 0.77996,\n        \"ndcg_at_100\": 0.7974,\n        \"ndcg_at_1000\": 0.7974,\n        \"ndcg_at_20\": 0.78881,\n        \"ndcg_at_3\": 0.74091,\n        \"ndcg_at_5\": 0.75865,\n        \"precision_at_1\": 0.63158,\n        \"precision_at_10\": 0.09211,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04781,\n        \"precision_at_3\": 0.27193,\n        \"precision_at_5\": 0.17193,\n        \"recall_at_1\": 0.63158,\n        \"recall_at_10\": 0.92105,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.95614,\n        \"recall_at_3\": 0.81579,\n        \"recall_at_5\": 0.85965\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large-instruct/intfloat__multilingual-e5-large-instruct/baa7be480a7de1539afce709c8f13f833a510e0a/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 16.148106575012207,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.936,\n        \"map_at_1\": 0.89222,\n        \"map_at_10\": 0.92215,\n        \"map_at_100\": 0.9229,\n        \"map_at_1000\": 0.92291,\n        \"map_at_20\": 0.92262,\n        \"map_at_3\": 0.91574,\n        \"map_at_5\": 0.92019,\n        \"mrr_at_1\": 0.8922222222222222,\n        \"mrr_at_10\": 0.9221534391534393,\n        \"mrr_at_100\": 0.9228956584633163,\n        \"mrr_at_1000\": 0.9229125282281675,\n        \"mrr_at_20\": 0.9226224118302292,\n        \"mrr_at_3\": 0.9157407407407407,\n        \"mrr_at_5\": 0.9201851851851852,\n        \"nauc_map_at_1000_diff1\": 0.9070917036519953,\n        \"nauc_map_at_1000_max\": 0.78573770292274,\n        \"nauc_map_at_1000_std\": 0.15485444735095963,\n        \"nauc_map_at_100_diff1\": 0.9071028250822603,\n        \"nauc_map_at_100_max\": 0.7857848927895452,\n        \"nauc_map_at_100_std\": 0.15503091049967274,\n        \"nauc_map_at_10_diff1\": 0.9077458924057623,\n        \"nauc_map_at_10_max\": 0.7871315337230818,\n        \"nauc_map_at_10_std\": 0.15641366666149223,\n        \"nauc_map_at_1_diff1\": 0.9075378740027407,\n        \"nauc_map_at_1_max\": 0.7559884167257802,\n        \"nauc_map_at_1_std\": 0.11310212133285405,\n        \"nauc_map_at_20_diff1\": 0.9071830579397084,\n        \"nauc_map_at_20_max\": 0.7863069884342018,\n        \"nauc_map_at_20_std\": 0.15618718566694126,\n        \"nauc_map_at_3_diff1\": 0.9053657881969174,\n        \"nauc_map_at_3_max\": 0.7903874144498463,\n        \"nauc_map_at_3_std\": 0.1630929154666399,\n        \"nauc_map_at_5_diff1\": 0.9067110567499744,\n        \"nauc_map_at_5_max\": 0.7877141287356025,\n        \"nauc_map_at_5_std\": 0.15697911965481995,\n        \"nauc_mrr_at_1000_diff1\": 0.9070917036519953,\n        \"nauc_mrr_at_1000_max\": 0.78573770292274,\n        \"nauc_mrr_at_1000_std\": 0.15485444735095963,\n        \"nauc_mrr_at_100_diff1\": 0.9071028250822603,\n        \"nauc_mrr_at_100_max\": 0.7857848927895452,\n        \"nauc_mrr_at_100_std\": 0.15503091049967274,\n        \"nauc_mrr_at_10_diff1\": 0.9077458924057623,\n        \"nauc_mrr_at_10_max\": 0.7871315337230818,\n        \"nauc_mrr_at_10_std\": 0.15641366666149223,\n        \"nauc_mrr_at_1_diff1\": 0.9075378740027407,\n        \"nauc_mrr_at_1_max\": 0.7559884167257802,\n        \"nauc_mrr_at_1_std\": 0.11310212133285405,\n        \"nauc_mrr_at_20_diff1\": 0.9071830579397084,\n        \"nauc_mrr_at_20_max\": 0.7863069884342018,\n        \"nauc_mrr_at_20_std\": 0.15618718566694126,\n        \"nauc_mrr_at_3_diff1\": 0.9053657881969174,\n        \"nauc_mrr_at_3_max\": 0.7903874144498463,\n        \"nauc_mrr_at_3_std\": 0.1630929154666399,\n        \"nauc_mrr_at_5_diff1\": 0.9067110567499744,\n        \"nauc_mrr_at_5_max\": 0.7877141287356025,\n        \"nauc_mrr_at_5_std\": 0.15697911965481995,\n        \"nauc_ndcg_at_1000_diff1\": 0.9079724895902852,\n        \"nauc_ndcg_at_1000_max\": 0.7909080294027776,\n        \"nauc_ndcg_at_1000_std\": 0.1616801687839343,\n        \"nauc_ndcg_at_100_diff1\": 0.9083275859079337,\n        \"nauc_ndcg_at_100_max\": 0.7924334487329852,\n        \"nauc_ndcg_at_100_std\": 0.167477710657392,\n        \"nauc_ndcg_at_10_diff1\": 0.9115597785525953,\n        \"nauc_ndcg_at_10_max\": 0.8000791539278294,\n        \"nauc_ndcg_at_10_std\": 0.17191138233130876,\n        \"nauc_ndcg_at_1_diff1\": 0.9075378740027407,\n        \"nauc_ndcg_at_1_max\": 0.7559884167257802,\n        \"nauc_ndcg_at_1_std\": 0.11310212133285405,\n        \"nauc_ndcg_at_20_diff1\": 0.9088692422365905,\n        \"nauc_ndcg_at_20_max\": 0.796455678631563,\n        \"nauc_ndcg_at_20_std\": 0.17284696896394636,\n        \"nauc_ndcg_at_3_diff1\": 0.9058569690070104,\n        \"nauc_ndcg_at_3_max\": 0.8046835489465721,\n        \"nauc_ndcg_at_3_std\": 0.1804182130630102,\n        \"nauc_ndcg_at_5_diff1\": 0.9086374936067283,\n        \"nauc_ndcg_at_5_max\": 0.8012419491051281,\n        \"nauc_ndcg_at_5_std\": 0.17187022513100597,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9564270152505041,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.9564270152505041,\n        \"nauc_precision_at_10_diff1\": 0.9578603371172977,\n        \"nauc_precision_at_10_max\": 0.9324291119956715,\n        \"nauc_precision_at_10_std\": 0.33301390731730346,\n        \"nauc_precision_at_1_diff1\": 0.9075378740027407,\n        \"nauc_precision_at_1_max\": 0.7559884167257802,\n        \"nauc_precision_at_1_std\": 0.11310212133285405,\n        \"nauc_precision_at_20_diff1\": 0.9332788671023994,\n        \"nauc_precision_at_20_max\": 0.941059757236231,\n        \"nauc_precision_at_20_std\": 0.45992841581075417,\n        \"nauc_precision_at_3_diff1\": 0.9086777568170122,\n        \"nauc_precision_at_3_max\": 0.8677185159778196,\n        \"nauc_precision_at_3_std\": 0.25518778940147957,\n        \"nauc_precision_at_5_diff1\": 0.9227503501400542,\n        \"nauc_precision_at_5_max\": 0.8872403127917805,\n        \"nauc_precision_at_5_std\": 0.2647788281979385,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9564270152505339,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.9564270152505339,\n        \"nauc_recall_at_10_diff1\": 0.9578603371173053,\n        \"nauc_recall_at_10_max\": 0.9324291119956791,\n        \"nauc_recall_at_10_std\": 0.3330139073173117,\n        \"nauc_recall_at_1_diff1\": 0.9075378740027407,\n        \"nauc_recall_at_1_max\": 0.7559884167257802,\n        \"nauc_recall_at_1_std\": 0.11310212133285405,\n        \"nauc_recall_at_20_diff1\": 0.9332788671023909,\n        \"nauc_recall_at_20_max\": 0.9410597572362199,\n        \"nauc_recall_at_20_std\": 0.45992841581076965,\n        \"nauc_recall_at_3_diff1\": 0.908677756817013,\n        \"nauc_recall_at_3_max\": 0.8677185159778226,\n        \"nauc_recall_at_3_std\": 0.2551877894014712,\n        \"nauc_recall_at_5_diff1\": 0.9227503501400555,\n        \"nauc_recall_at_5_max\": 0.8872403127917826,\n        \"nauc_recall_at_5_std\": 0.2647788281979452,\n        \"ndcg_at_1\": 0.89222,\n        \"ndcg_at_10\": 0.936,\n        \"ndcg_at_100\": 0.93977,\n        \"ndcg_at_1000\": 0.94021,\n        \"ndcg_at_20\": 0.93788,\n        \"ndcg_at_3\": 0.9234,\n        \"ndcg_at_5\": 0.93129,\n        \"precision_at_1\": 0.89222,\n        \"precision_at_10\": 0.09789,\n        \"precision_at_100\": 0.00997,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04933,\n        \"precision_at_3\": 0.31519,\n        \"precision_at_5\": 0.19289,\n        \"recall_at_1\": 0.89222,\n        \"recall_at_10\": 0.97889,\n        \"recall_at_100\": 0.99667,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98667,\n        \"recall_at_3\": 0.94556,\n        \"recall_at_5\": 0.96444\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.92482,\n        \"map_at_1\": 0.86333,\n        \"map_at_10\": 0.9074,\n        \"map_at_100\": 0.90855,\n        \"map_at_1000\": 0.90856,\n        \"map_at_20\": 0.9084,\n        \"map_at_3\": 0.90074,\n        \"map_at_5\": 0.90502,\n        \"mrr_at_1\": 0.8633333333333333,\n        \"mrr_at_10\": 0.9073955026455032,\n        \"mrr_at_100\": 0.9085521299329449,\n        \"mrr_at_1000\": 0.9085648476044211,\n        \"mrr_at_20\": 0.908397048370733,\n        \"mrr_at_3\": 0.9007407407407411,\n        \"mrr_at_5\": 0.9050185185185189,\n        \"nauc_map_at_1000_diff1\": 0.8995815876496662,\n        \"nauc_map_at_1000_max\": 0.6350214249075169,\n        \"nauc_map_at_1000_std\": 0.018349457469257657,\n        \"nauc_map_at_100_diff1\": 0.8995914231410215,\n        \"nauc_map_at_100_max\": 0.6350594488184639,\n        \"nauc_map_at_100_std\": 0.01847406737095244,\n        \"nauc_map_at_10_diff1\": 0.8984256257105865,\n        \"nauc_map_at_10_max\": 0.6365719801653463,\n        \"nauc_map_at_10_std\": 0.019304767126614965,\n        \"nauc_map_at_1_diff1\": 0.903735259178841,\n        \"nauc_map_at_1_max\": 0.6099140135155323,\n        \"nauc_map_at_1_std\": 0.00646668712090879,\n        \"nauc_map_at_20_diff1\": 0.8996288037046547,\n        \"nauc_map_at_20_max\": 0.6350660515812196,\n        \"nauc_map_at_20_std\": 0.0186524974702766,\n        \"nauc_map_at_3_diff1\": 0.8988737870316825,\n        \"nauc_map_at_3_max\": 0.6374670650986446,\n        \"nauc_map_at_3_std\": 0.02077754928632171,\n        \"nauc_map_at_5_diff1\": 0.8984580242742688,\n        \"nauc_map_at_5_max\": 0.6373387612313168,\n        \"nauc_map_at_5_std\": 0.016254466520959136,\n        \"nauc_mrr_at_1000_diff1\": 0.8995815876496662,\n        \"nauc_mrr_at_1000_max\": 0.6350214249075169,\n        \"nauc_mrr_at_1000_std\": 0.018349457469257657,\n        \"nauc_mrr_at_100_diff1\": 0.8995914231410215,\n        \"nauc_mrr_at_100_max\": 0.6350594488184639,\n        \"nauc_mrr_at_100_std\": 0.01847406737095244,\n        \"nauc_mrr_at_10_diff1\": 0.8984256257105865,\n        \"nauc_mrr_at_10_max\": 0.6365719801653463,\n        \"nauc_mrr_at_10_std\": 0.019304767126614965,\n        \"nauc_mrr_at_1_diff1\": 0.903735259178841,\n        \"nauc_mrr_at_1_max\": 0.6099140135155323,\n        \"nauc_mrr_at_1_std\": 0.00646668712090879,\n        \"nauc_mrr_at_20_diff1\": 0.8996288037046547,\n        \"nauc_mrr_at_20_max\": 0.6350660515812196,\n        \"nauc_mrr_at_20_std\": 0.0186524974702766,\n        \"nauc_mrr_at_3_diff1\": 0.8988737870316825,\n        \"nauc_mrr_at_3_max\": 0.6374670650986446,\n        \"nauc_mrr_at_3_std\": 0.02077754928632171,\n        \"nauc_mrr_at_5_diff1\": 0.8984580242742688,\n        \"nauc_mrr_at_5_max\": 0.6373387612313168,\n        \"nauc_mrr_at_5_std\": 0.016254466520959136,\n        \"nauc_ndcg_at_1000_diff1\": 0.8993256215537422,\n        \"nauc_ndcg_at_1000_max\": 0.6393593719942897,\n        \"nauc_ndcg_at_1000_std\": 0.022454698103965824,\n        \"nauc_ndcg_at_100_diff1\": 0.8996789854457844,\n        \"nauc_ndcg_at_100_max\": 0.6409812520717987,\n        \"nauc_ndcg_at_100_std\": 0.027445863539626563,\n        \"nauc_ndcg_at_10_diff1\": 0.8956806520742397,\n        \"nauc_ndcg_at_10_max\": 0.6479653772824047,\n        \"nauc_ndcg_at_10_std\": 0.029215214302291608,\n        \"nauc_ndcg_at_1_diff1\": 0.903735259178841,\n        \"nauc_ndcg_at_1_max\": 0.6099140135155323,\n        \"nauc_ndcg_at_1_std\": 0.00646668712090879,\n        \"nauc_ndcg_at_20_diff1\": 0.9000089526843404,\n        \"nauc_ndcg_at_20_max\": 0.6413993358261516,\n        \"nauc_ndcg_at_20_std\": 0.026218032748382948,\n        \"nauc_ndcg_at_3_diff1\": 0.89658797647391,\n        \"nauc_ndcg_at_3_max\": 0.6481676790604936,\n        \"nauc_ndcg_at_3_std\": 0.028589359037325752,\n        \"nauc_ndcg_at_5_diff1\": 0.8958100284140829,\n        \"nauc_ndcg_at_5_max\": 0.6491416873953931,\n        \"nauc_ndcg_at_5_std\": 0.019473810166820073,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9564270152505041,\n        \"nauc_precision_at_100_max\": 0.9128540305010695,\n        \"nauc_precision_at_100_std\": 0.8513849984438455,\n        \"nauc_precision_at_10_diff1\": 0.86440242763772,\n        \"nauc_precision_at_10_max\": 0.7783146591970098,\n        \"nauc_precision_at_10_std\": 0.15574229691876484,\n        \"nauc_precision_at_1_diff1\": 0.903735259178841,\n        \"nauc_precision_at_1_max\": 0.6099140135155323,\n        \"nauc_precision_at_1_std\": 0.00646668712090879,\n        \"nauc_precision_at_20_diff1\": 0.9346405228758121,\n        \"nauc_precision_at_20_max\": 0.7672152194210989,\n        \"nauc_precision_at_20_std\": 0.2435807656395918,\n        \"nauc_precision_at_3_diff1\": 0.8853554493692909,\n        \"nauc_precision_at_3_max\": 0.6996393328573267,\n        \"nauc_precision_at_3_std\": 0.06751066439647656,\n        \"nauc_precision_at_5_diff1\": 0.8778978257969816,\n        \"nauc_precision_at_5_max\": 0.7289048952914466,\n        \"nauc_precision_at_5_std\": 0.03888221955448746,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9564270152505339,\n        \"nauc_recall_at_100_max\": 0.9128540305010676,\n        \"nauc_recall_at_100_std\": 0.8513849984438123,\n        \"nauc_recall_at_10_diff1\": 0.8644024276377222,\n        \"nauc_recall_at_10_max\": 0.7783146591970082,\n        \"nauc_recall_at_10_std\": 0.15574229691877126,\n        \"nauc_recall_at_1_diff1\": 0.903735259178841,\n        \"nauc_recall_at_1_max\": 0.6099140135155323,\n        \"nauc_recall_at_1_std\": 0.00646668712090879,\n        \"nauc_recall_at_20_diff1\": 0.9346405228758294,\n        \"nauc_recall_at_20_max\": 0.7672152194211065,\n        \"nauc_recall_at_20_std\": 0.24358076563958803,\n        \"nauc_recall_at_3_diff1\": 0.88535544936929,\n        \"nauc_recall_at_3_max\": 0.6996393328573252,\n        \"nauc_recall_at_3_std\": 0.0675106643964764,\n        \"nauc_recall_at_5_diff1\": 0.877897825796986,\n        \"nauc_recall_at_5_max\": 0.7289048952914498,\n        \"nauc_recall_at_5_std\": 0.038882219554492656,\n        \"ndcg_at_1\": 0.86333,\n        \"ndcg_at_10\": 0.92482,\n        \"ndcg_at_100\": 0.92935,\n        \"ndcg_at_1000\": 0.92976,\n        \"ndcg_at_20\": 0.92829,\n        \"ndcg_at_3\": 0.91177,\n        \"ndcg_at_5\": 0.91928,\n        \"precision_at_1\": 0.86333,\n        \"precision_at_10\": 0.09778,\n        \"precision_at_100\": 0.00997,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04956,\n        \"precision_at_3\": 0.31444,\n        \"precision_at_5\": 0.19222,\n        \"recall_at_1\": 0.86333,\n        \"recall_at_10\": 0.97778,\n        \"recall_at_100\": 0.99667,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.99111,\n        \"recall_at_3\": 0.94333,\n        \"recall_at_5\": 0.96111\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.86177,\n        \"map_at_1\": 0.77556,\n        \"map_at_10\": 0.83543,\n        \"map_at_100\": 0.83726,\n        \"map_at_1000\": 0.83736,\n        \"map_at_20\": 0.83663,\n        \"map_at_3\": 0.82537,\n        \"map_at_5\": 0.83059,\n        \"mrr_at_1\": 0.7755555555555556,\n        \"mrr_at_10\": 0.8354276895943563,\n        \"mrr_at_100\": 0.8372601744078978,\n        \"mrr_at_1000\": 0.8373594614287702,\n        \"mrr_at_20\": 0.8366342586244548,\n        \"mrr_at_3\": 0.8253703703703703,\n        \"mrr_at_5\": 0.8305925925925925,\n        \"nauc_map_at_1000_diff1\": 0.8563262993363897,\n        \"nauc_map_at_1000_max\": 0.7092525023180286,\n        \"nauc_map_at_1000_std\": 0.11447648643872059,\n        \"nauc_map_at_100_diff1\": 0.8562847147884489,\n        \"nauc_map_at_100_max\": 0.7093705485013881,\n        \"nauc_map_at_100_std\": 0.11480965523119875,\n        \"nauc_map_at_10_diff1\": 0.8557451506594478,\n        \"nauc_map_at_10_max\": 0.7103867572729406,\n        \"nauc_map_at_10_std\": 0.11659574990893444,\n        \"nauc_map_at_1_diff1\": 0.875583807055888,\n        \"nauc_map_at_1_max\": 0.6760802649127515,\n        \"nauc_map_at_1_std\": 0.039787623543968066,\n        \"nauc_map_at_20_diff1\": 0.8562644961141803,\n        \"nauc_map_at_20_max\": 0.7101451002121112,\n        \"nauc_map_at_20_std\": 0.11702640931466465,\n        \"nauc_map_at_3_diff1\": 0.852118141777768,\n        \"nauc_map_at_3_max\": 0.7078386195869544,\n        \"nauc_map_at_3_std\": 0.10955607768958464,\n        \"nauc_map_at_5_diff1\": 0.8549593365575148,\n        \"nauc_map_at_5_max\": 0.7133833504561998,\n        \"nauc_map_at_5_std\": 0.12167925414056359,\n        \"nauc_mrr_at_1000_diff1\": 0.8563262993363897,\n        \"nauc_mrr_at_1000_max\": 0.7092525023180286,\n        \"nauc_mrr_at_1000_std\": 0.11447648643872059,\n        \"nauc_mrr_at_100_diff1\": 0.8562847147884489,\n        \"nauc_mrr_at_100_max\": 0.7093705485013881,\n        \"nauc_mrr_at_100_std\": 0.11480965523119875,\n        \"nauc_mrr_at_10_diff1\": 0.8557451506594478,\n        \"nauc_mrr_at_10_max\": 0.7103867572729406,\n        \"nauc_mrr_at_10_std\": 0.11659574990893444,\n        \"nauc_mrr_at_1_diff1\": 0.875583807055888,\n        \"nauc_mrr_at_1_max\": 0.6760802649127515,\n        \"nauc_mrr_at_1_std\": 0.039787623543968066,\n        \"nauc_mrr_at_20_diff1\": 0.8562644961141803,\n        \"nauc_mrr_at_20_max\": 0.7101451002121112,\n        \"nauc_mrr_at_20_std\": 0.11702640931466465,\n        \"nauc_mrr_at_3_diff1\": 0.852118141777768,\n        \"nauc_mrr_at_3_max\": 0.7078386195869544,\n        \"nauc_mrr_at_3_std\": 0.10955607768958464,\n        \"nauc_mrr_at_5_diff1\": 0.8549593365575148,\n        \"nauc_mrr_at_5_max\": 0.7133833504561998,\n        \"nauc_mrr_at_5_std\": 0.12167925414056359,\n        \"nauc_ndcg_at_1000_diff1\": 0.8536060198678865,\n        \"nauc_ndcg_at_1000_max\": 0.7161415325431293,\n        \"nauc_ndcg_at_1000_std\": 0.13118419697584274,\n        \"nauc_ndcg_at_100_diff1\": 0.8524424740549038,\n        \"nauc_ndcg_at_100_max\": 0.719221257766969,\n        \"nauc_ndcg_at_100_std\": 0.14010098262195667,\n        \"nauc_ndcg_at_10_diff1\": 0.8500411904861312,\n        \"nauc_ndcg_at_10_max\": 0.7257669827316664,\n        \"nauc_ndcg_at_10_std\": 0.1531268391377476,\n        \"nauc_ndcg_at_1_diff1\": 0.875583807055888,\n        \"nauc_ndcg_at_1_max\": 0.6760802649127515,\n        \"nauc_ndcg_at_1_std\": 0.039787623543968066,\n        \"nauc_ndcg_at_20_diff1\": 0.8521602697274657,\n        \"nauc_ndcg_at_20_max\": 0.7255292199942737,\n        \"nauc_ndcg_at_20_std\": 0.15622394129449554,\n        \"nauc_ndcg_at_3_diff1\": 0.8430930583173746,\n        \"nauc_ndcg_at_3_max\": 0.7200938991115078,\n        \"nauc_ndcg_at_3_std\": 0.1371129407859106,\n        \"nauc_ndcg_at_5_diff1\": 0.8485407560921437,\n        \"nauc_ndcg_at_5_max\": 0.7320543787124469,\n        \"nauc_ndcg_at_5_std\": 0.16299385867300736,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.7805788982259647,\n        \"nauc_precision_at_100_max\": 0.9069884364002117,\n        \"nauc_precision_at_100_std\": 0.6863463334051753,\n        \"nauc_precision_at_10_diff1\": 0.8101462807345137,\n        \"nauc_precision_at_10_max\": 0.8443089654162306,\n        \"nauc_precision_at_10_std\": 0.4376979549989915,\n        \"nauc_precision_at_1_diff1\": 0.875583807055888,\n        \"nauc_precision_at_1_max\": 0.6760802649127515,\n        \"nauc_precision_at_1_std\": 0.039787623543968066,\n        \"nauc_precision_at_20_diff1\": 0.819937234152921,\n        \"nauc_precision_at_20_max\": 0.8925718435522375,\n        \"nauc_precision_at_20_std\": 0.59440813362382,\n        \"nauc_precision_at_3_diff1\": 0.8058400081111246,\n        \"nauc_precision_at_3_max\": 0.7706994921331332,\n        \"nauc_precision_at_3_std\": 0.25120053828357747,\n        \"nauc_precision_at_5_diff1\": 0.8185249709639927,\n        \"nauc_precision_at_5_max\": 0.8277424791054608,\n        \"nauc_precision_at_5_std\": 0.3745872332672881,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.7805788982259576,\n        \"nauc_recall_at_100_max\": 0.9069884364002062,\n        \"nauc_recall_at_100_std\": 0.6863463334051649,\n        \"nauc_recall_at_10_diff1\": 0.8101462807345169,\n        \"nauc_recall_at_10_max\": 0.8443089654162333,\n        \"nauc_recall_at_10_std\": 0.4376979549989933,\n        \"nauc_recall_at_1_diff1\": 0.875583807055888,\n        \"nauc_recall_at_1_max\": 0.6760802649127515,\n        \"nauc_recall_at_1_std\": 0.039787623543968066,\n        \"nauc_recall_at_20_diff1\": 0.8199372341529212,\n        \"nauc_recall_at_20_max\": 0.892571843552236,\n        \"nauc_recall_at_20_std\": 0.5944081336238212,\n        \"nauc_recall_at_3_diff1\": 0.8058400081111227,\n        \"nauc_recall_at_3_max\": 0.7706994921331336,\n        \"nauc_recall_at_3_std\": 0.25120053828357475,\n        \"nauc_recall_at_5_diff1\": 0.8185249709639958,\n        \"nauc_recall_at_5_max\": 0.8277424791054628,\n        \"nauc_recall_at_5_std\": 0.37458723326729154,\n        \"ndcg_at_1\": 0.77556,\n        \"ndcg_at_10\": 0.86177,\n        \"ndcg_at_100\": 0.87073,\n        \"ndcg_at_1000\": 0.87273,\n        \"ndcg_at_20\": 0.86605,\n        \"ndcg_at_3\": 0.84088,\n        \"ndcg_at_5\": 0.8504,\n        \"precision_at_1\": 0.77556,\n        \"precision_at_10\": 0.09433,\n        \"precision_at_100\": 0.00986,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.048,\n        \"precision_at_3\": 0.29519,\n        \"precision_at_5\": 0.18178,\n        \"recall_at_1\": 0.77556,\n        \"recall_at_10\": 0.94333,\n        \"recall_at_100\": 0.98556,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96,\n        \"recall_at_3\": 0.88556,\n        \"recall_at_5\": 0.90889\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large-instruct/intfloat__multilingual-e5-large-instruct/baa7be480a7de1539afce709c8f13f833a510e0a/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 115.93965744972229,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.79793,\n        \"map_at_1\": 0.49126,\n        \"map_at_10\": 0.75434,\n        \"map_at_100\": 0.75957,\n        \"map_at_1000\": 0.75987,\n        \"map_at_20\": 0.75755,\n        \"map_at_3\": 0.71057,\n        \"map_at_5\": 0.74279,\n        \"mrr_at_1\": 0.7516891891891891,\n        \"mrr_at_10\": 0.8103858322608322,\n        \"mrr_at_100\": 0.8120290293768601,\n        \"mrr_at_1000\": 0.8121733425939148,\n        \"mrr_at_20\": 0.8110783812989694,\n        \"mrr_at_3\": 0.804617117117117,\n        \"mrr_at_5\": 0.8087556306306305,\n        \"nauc_map_at_1000_diff1\": 0.5309640525572018,\n        \"nauc_map_at_1000_max\": 0.6034757137873261,\n        \"nauc_map_at_1000_std\": 0.2524830874626602,\n        \"nauc_map_at_100_diff1\": 0.5310950999887473,\n        \"nauc_map_at_100_max\": 0.6038898477176643,\n        \"nauc_map_at_100_std\": 0.2529213111665448,\n        \"nauc_map_at_10_diff1\": 0.5287408922081819,\n        \"nauc_map_at_10_max\": 0.6048810878714043,\n        \"nauc_map_at_10_std\": 0.24514186826715573,\n        \"nauc_map_at_1_diff1\": 0.5839831914566329,\n        \"nauc_map_at_1_max\": 0.24134429916197642,\n        \"nauc_map_at_1_std\": -0.005362833464650543,\n        \"nauc_map_at_20_diff1\": 0.531847319431841,\n        \"nauc_map_at_20_max\": 0.6053733911651847,\n        \"nauc_map_at_20_std\": 0.25267089208288807,\n        \"nauc_map_at_3_diff1\": 0.5175569859756408,\n        \"nauc_map_at_3_max\": 0.5267407209649851,\n        \"nauc_map_at_3_std\": 0.18034284700192835,\n        \"nauc_map_at_5_diff1\": 0.5340789493854458,\n        \"nauc_map_at_5_max\": 0.5841825317705776,\n        \"nauc_map_at_5_std\": 0.2178539895872495,\n        \"nauc_mrr_at_1000_diff1\": 0.6129207681904467,\n        \"nauc_mrr_at_1000_max\": 0.6810699075110801,\n        \"nauc_mrr_at_1000_std\": 0.33656350406575714,\n        \"nauc_mrr_at_100_diff1\": 0.6129612079444606,\n        \"nauc_mrr_at_100_max\": 0.681293581685122,\n        \"nauc_mrr_at_100_std\": 0.336959957396225,\n        \"nauc_mrr_at_10_diff1\": 0.6133305000787206,\n        \"nauc_mrr_at_10_max\": 0.6834511087649037,\n        \"nauc_mrr_at_10_std\": 0.33747039829177455,\n        \"nauc_mrr_at_1_diff1\": 0.6254310300227522,\n        \"nauc_mrr_at_1_max\": 0.5816815042949867,\n        \"nauc_mrr_at_1_std\": 0.21266545672024523,\n        \"nauc_mrr_at_20_diff1\": 0.612875409327525,\n        \"nauc_mrr_at_20_max\": 0.6823877732414835,\n        \"nauc_mrr_at_20_std\": 0.3375268307975658,\n        \"nauc_mrr_at_3_diff1\": 0.6176288728475821,\n        \"nauc_mrr_at_3_max\": 0.6849689448598965,\n        \"nauc_mrr_at_3_std\": 0.3393152904117805,\n        \"nauc_mrr_at_5_diff1\": 0.6155674459330454,\n        \"nauc_mrr_at_5_max\": 0.684849646628972,\n        \"nauc_mrr_at_5_std\": 0.33727860792942294,\n        \"nauc_ndcg_at_1000_diff1\": 0.542637450430811,\n        \"nauc_ndcg_at_1000_max\": 0.659613284461409,\n        \"nauc_ndcg_at_1000_std\": 0.33200269100657104,\n        \"nauc_ndcg_at_100_diff1\": 0.547672333085176,\n        \"nauc_ndcg_at_100_max\": 0.6700030728702414,\n        \"nauc_ndcg_at_100_std\": 0.3469653351483253,\n        \"nauc_ndcg_at_10_diff1\": 0.5436935978103205,\n        \"nauc_ndcg_at_10_max\": 0.6788066553801092,\n        \"nauc_ndcg_at_10_std\": 0.32641262078820005,\n        \"nauc_ndcg_at_1_diff1\": 0.6254310300227522,\n        \"nauc_ndcg_at_1_max\": 0.5816815042949867,\n        \"nauc_ndcg_at_1_std\": 0.21266545672024523,\n        \"nauc_ndcg_at_20_diff1\": 0.5487238316054067,\n        \"nauc_ndcg_at_20_max\": 0.6788721621002779,\n        \"nauc_ndcg_at_20_std\": 0.3455664306916214,\n        \"nauc_ndcg_at_3_diff1\": 0.5290660234984015,\n        \"nauc_ndcg_at_3_max\": 0.5808423803809595,\n        \"nauc_ndcg_at_3_std\": 0.23792804741859436,\n        \"nauc_ndcg_at_5_diff1\": 0.54973349540624,\n        \"nauc_ndcg_at_5_max\": 0.6465132469014665,\n        \"nauc_ndcg_at_5_std\": 0.2816044773825405,\n        \"nauc_precision_at_1000_diff1\": -0.3624723519954685,\n        \"nauc_precision_at_1000_max\": 0.05033883591861056,\n        \"nauc_precision_at_1000_std\": 0.1988482841500978,\n        \"nauc_precision_at_100_diff1\": -0.249229073110791,\n        \"nauc_precision_at_100_max\": 0.18182050204914146,\n        \"nauc_precision_at_100_std\": 0.29041396174885464,\n        \"nauc_precision_at_10_diff1\": -0.150896797806953,\n        \"nauc_precision_at_10_max\": 0.3288052265753716,\n        \"nauc_precision_at_10_std\": 0.3191898156600829,\n        \"nauc_precision_at_1_diff1\": 0.6254310300227522,\n        \"nauc_precision_at_1_max\": 0.5816815042949867,\n        \"nauc_precision_at_1_std\": 0.21266545672024523,\n        \"nauc_precision_at_20_diff1\": -0.17002101345912066,\n        \"nauc_precision_at_20_max\": 0.2862629611332116,\n        \"nauc_precision_at_20_std\": 0.3255332095997299,\n        \"nauc_precision_at_3_diff1\": -0.028585511987222784,\n        \"nauc_precision_at_3_max\": 0.41995825306109386,\n        \"nauc_precision_at_3_std\": 0.30634819262268315,\n        \"nauc_precision_at_5_diff1\": -0.08964145017856276,\n        \"nauc_precision_at_5_max\": 0.3681815785470059,\n        \"nauc_precision_at_5_std\": 0.2954266706591043,\n        \"nauc_recall_at_1000_diff1\": 0.275303091358477,\n        \"nauc_recall_at_1000_max\": 0.876861475892877,\n        \"nauc_recall_at_1000_std\": 0.907974334424692,\n        \"nauc_recall_at_100_diff1\": 0.5072766102427224,\n        \"nauc_recall_at_100_max\": 0.8821544361345515,\n        \"nauc_recall_at_100_std\": 0.7751863280665128,\n        \"nauc_recall_at_10_diff1\": 0.503098333242494,\n        \"nauc_recall_at_10_max\": 0.8343898880673456,\n        \"nauc_recall_at_10_std\": 0.49474065180833804,\n        \"nauc_recall_at_1_diff1\": 0.5839831914566329,\n        \"nauc_recall_at_1_max\": 0.24134429916197642,\n        \"nauc_recall_at_1_std\": -0.005362833464650543,\n        \"nauc_recall_at_20_diff1\": 0.5195860953935559,\n        \"nauc_recall_at_20_max\": 0.860889980047164,\n        \"nauc_recall_at_20_std\": 0.6144360815190124,\n        \"nauc_recall_at_3_diff1\": 0.4913567468163894,\n        \"nauc_recall_at_3_max\": 0.5795842824553967,\n        \"nauc_recall_at_3_std\": 0.24546706094062273,\n        \"nauc_recall_at_5_diff1\": 0.5209857740942301,\n        \"nauc_recall_at_5_max\": 0.7195409453404005,\n        \"nauc_recall_at_5_std\": 0.34618966424185427,\n        \"ndcg_at_1\": 0.75169,\n        \"ndcg_at_10\": 0.79793,\n        \"ndcg_at_100\": 0.81554,\n        \"ndcg_at_1000\": 0.82268,\n        \"ndcg_at_20\": 0.80494,\n        \"ndcg_at_3\": 0.75097,\n        \"ndcg_at_5\": 0.7824,\n        \"precision_at_1\": 0.75169,\n        \"precision_at_10\": 0.15895,\n        \"precision_at_100\": 0.01743,\n        \"precision_at_1000\": 0.00185,\n        \"precision_at_20\": 0.08201,\n        \"precision_at_3\": 0.44538,\n        \"precision_at_5\": 0.29865,\n        \"recall_at_1\": 0.49126,\n        \"recall_at_10\": 0.85782,\n        \"recall_at_100\": 0.9252,\n        \"recall_at_1000\": 0.97095,\n        \"recall_at_20\": 0.87913,\n        \"recall_at_3\": 0.75884,\n        \"recall_at_5\": 0.8227\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large-instruct/intfloat__multilingual-e5-large-instruct/baa7be480a7de1539afce709c8f13f833a510e0a/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 15485.132284641266,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.59914,\n        \"map_at_1\": 0.32696,\n        \"map_at_10\": 0.5021,\n        \"map_at_100\": 0.52536,\n        \"map_at_1000\": 0.52675,\n        \"map_at_20\": 0.51557,\n        \"map_at_3\": 0.44841,\n        \"map_at_5\": 0.48126,\n        \"mrr_at_1\": 0.5539906103286385,\n        \"mrr_at_10\": 0.6759538713764065,\n        \"mrr_at_100\": 0.6785929910661365,\n        \"mrr_at_1000\": 0.6788143429529052,\n        \"mrr_at_20\": 0.6780745834211364,\n        \"mrr_at_3\": 0.6533646322378714,\n        \"mrr_at_5\": 0.6683881064162753,\n        \"nauc_map_at_1000_diff1\": 0.37998530220717786,\n        \"nauc_map_at_1000_max\": 0.35683758932659904,\n        \"nauc_map_at_1000_std\": 0.09661911895952302,\n        \"nauc_map_at_100_diff1\": 0.3801636369285897,\n        \"nauc_map_at_100_max\": 0.3557813147855278,\n        \"nauc_map_at_100_std\": 0.09699912793782361,\n        \"nauc_map_at_10_diff1\": 0.385840730245925,\n        \"nauc_map_at_10_max\": 0.3388006342199373,\n        \"nauc_map_at_10_std\": 0.07469794277413962,\n        \"nauc_map_at_1_diff1\": 0.4710151650817007,\n        \"nauc_map_at_1_max\": 0.27386484996995075,\n        \"nauc_map_at_1_std\": -0.03826587437569447,\n        \"nauc_map_at_20_diff1\": 0.38004667201099374,\n        \"nauc_map_at_20_max\": 0.34736178062506173,\n        \"nauc_map_at_20_std\": 0.08691126593765994,\n        \"nauc_map_at_3_diff1\": 0.3959381990501782,\n        \"nauc_map_at_3_max\": 0.31783964379609697,\n        \"nauc_map_at_3_std\": 0.021876203870068035,\n        \"nauc_map_at_5_diff1\": 0.4013815389612924,\n        \"nauc_map_at_5_max\": 0.32284760433197945,\n        \"nauc_map_at_5_std\": 0.04644907393464365,\n        \"nauc_mrr_at_1000_diff1\": 0.35046511606892405,\n        \"nauc_mrr_at_1000_max\": 0.45610342631191003,\n        \"nauc_mrr_at_1000_std\": 0.21587784888890976,\n        \"nauc_mrr_at_100_diff1\": 0.35057490500672683,\n        \"nauc_mrr_at_100_max\": 0.4564646189984297,\n        \"nauc_mrr_at_100_std\": 0.21625860865160604,\n        \"nauc_mrr_at_10_diff1\": 0.3496031909413219,\n        \"nauc_mrr_at_10_max\": 0.45310738338234763,\n        \"nauc_mrr_at_10_std\": 0.2168338658348742,\n        \"nauc_mrr_at_1_diff1\": 0.36316059808304396,\n        \"nauc_mrr_at_1_max\": 0.42616112853710764,\n        \"nauc_mrr_at_1_std\": 0.14727968392145732,\n        \"nauc_mrr_at_20_diff1\": 0.34931996988824954,\n        \"nauc_mrr_at_20_max\": 0.4564065340592655,\n        \"nauc_mrr_at_20_std\": 0.21678796014048907,\n        \"nauc_mrr_at_3_diff1\": 0.35144112092691926,\n        \"nauc_mrr_at_3_max\": 0.46118986626841046,\n        \"nauc_mrr_at_3_std\": 0.2187047520665188,\n        \"nauc_mrr_at_5_diff1\": 0.3513761270515314,\n        \"nauc_mrr_at_5_max\": 0.45557184060456873,\n        \"nauc_mrr_at_5_std\": 0.22411204059806153,\n        \"nauc_ndcg_at_1000_diff1\": 0.3622965432026116,\n        \"nauc_ndcg_at_1000_max\": 0.4132309696262614,\n        \"nauc_ndcg_at_1000_std\": 0.18060337350151817,\n        \"nauc_ndcg_at_100_diff1\": 0.36621225660226114,\n        \"nauc_ndcg_at_100_max\": 0.41503010576140476,\n        \"nauc_ndcg_at_100_std\": 0.19534523527606712,\n        \"nauc_ndcg_at_10_diff1\": 0.3577638445537456,\n        \"nauc_ndcg_at_10_max\": 0.35826634923716805,\n        \"nauc_ndcg_at_10_std\": 0.1341988805236967,\n        \"nauc_ndcg_at_1_diff1\": 0.36316059808304396,\n        \"nauc_ndcg_at_1_max\": 0.42616112853710764,\n        \"nauc_ndcg_at_1_std\": 0.14727968392145732,\n        \"nauc_ndcg_at_20_diff1\": 0.3515739876801084,\n        \"nauc_ndcg_at_20_max\": 0.3812795972772258,\n        \"nauc_ndcg_at_20_std\": 0.1566067661903798,\n        \"nauc_ndcg_at_3_diff1\": 0.3430068358868766,\n        \"nauc_ndcg_at_3_max\": 0.39775892927028483,\n        \"nauc_ndcg_at_3_std\": 0.13676734265757323,\n        \"nauc_ndcg_at_5_diff1\": 0.36733201434120677,\n        \"nauc_ndcg_at_5_max\": 0.36933935830633907,\n        \"nauc_ndcg_at_5_std\": 0.12597735688319697,\n        \"nauc_precision_at_1000_diff1\": -0.19002674680239415,\n        \"nauc_precision_at_1000_max\": 0.174509429358778,\n        \"nauc_precision_at_1000_std\": 0.28167232364321076,\n        \"nauc_precision_at_100_diff1\": -0.17309643394949184,\n        \"nauc_precision_at_100_max\": 0.20656825090247774,\n        \"nauc_precision_at_100_std\": 0.3512037726617336,\n        \"nauc_precision_at_10_diff1\": -0.16528090511957233,\n        \"nauc_precision_at_10_max\": 0.2619352359421429,\n        \"nauc_precision_at_10_std\": 0.3941957192775191,\n        \"nauc_precision_at_1_diff1\": 0.36316059808304396,\n        \"nauc_precision_at_1_max\": 0.42616112853710764,\n        \"nauc_precision_at_1_std\": 0.14727968392145732,\n        \"nauc_precision_at_20_diff1\": -0.1898576802938022,\n        \"nauc_precision_at_20_max\": 0.23701631812155186,\n        \"nauc_precision_at_20_std\": 0.3740218709201864,\n        \"nauc_precision_at_3_diff1\": -0.00568419245193641,\n        \"nauc_precision_at_3_max\": 0.3415257396991487,\n        \"nauc_precision_at_3_std\": 0.31916275229293856,\n        \"nauc_precision_at_5_diff1\": -0.08655168669277556,\n        \"nauc_precision_at_5_max\": 0.2761786653681346,\n        \"nauc_precision_at_5_std\": 0.35947192558173247,\n        \"nauc_recall_at_1000_diff1\": 0.1827229283366921,\n        \"nauc_recall_at_1000_max\": 0.537327498086783,\n        \"nauc_recall_at_1000_std\": 0.6550227733454026,\n        \"nauc_recall_at_100_diff1\": 0.33523387191444975,\n        \"nauc_recall_at_100_max\": 0.4826282458217185,\n        \"nauc_recall_at_100_std\": 0.4726203131645689,\n        \"nauc_recall_at_10_diff1\": 0.2385680261998446,\n        \"nauc_recall_at_10_max\": 0.20787374315415943,\n        \"nauc_recall_at_10_std\": 0.10710738932195062,\n        \"nauc_recall_at_1_diff1\": 0.4710151650817007,\n        \"nauc_recall_at_1_max\": 0.27386484996995075,\n        \"nauc_recall_at_1_std\": -0.03826587437569447,\n        \"nauc_recall_at_20_diff1\": 0.2070919483692747,\n        \"nauc_recall_at_20_max\": 0.26472298029628866,\n        \"nauc_recall_at_20_std\": 0.16965356881445673,\n        \"nauc_recall_at_3_diff1\": 0.32594635843508896,\n        \"nauc_recall_at_3_max\": 0.2711469727674023,\n        \"nauc_recall_at_3_std\": 0.040071374394099774,\n        \"nauc_recall_at_5_diff1\": 0.3328227607824658,\n        \"nauc_recall_at_5_max\": 0.2458408375382006,\n        \"nauc_recall_at_5_std\": 0.0837219650224051,\n        \"ndcg_at_1\": 0.55399,\n        \"ndcg_at_10\": 0.59914,\n        \"ndcg_at_100\": 0.6601,\n        \"ndcg_at_1000\": 0.67563,\n        \"ndcg_at_20\": 0.62687,\n        \"ndcg_at_3\": 0.56408,\n        \"ndcg_at_5\": 0.57624,\n        \"precision_at_1\": 0.55399,\n        \"precision_at_10\": 0.1507,\n        \"precision_at_100\": 0.02258,\n        \"precision_at_1000\": 0.00254,\n        \"precision_at_20\": 0.08873,\n        \"precision_at_3\": 0.34585,\n        \"precision_at_5\": 0.2507,\n        \"recall_at_1\": 0.32696,\n        \"recall_at_10\": 0.70681,\n        \"recall_at_100\": 0.89928,\n        \"recall_at_1000\": 0.98818,\n        \"recall_at_20\": 0.78447,\n        \"recall_at_3\": 0.53559,\n        \"recall_at_5\": 0.62288\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large-instruct/intfloat__multilingual-e5-large-instruct/baa7be480a7de1539afce709c8f13f833a510e0a/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 15758.073652267456,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.52877,\n        \"map_at_1\": 0.34917,\n        \"map_at_10\": 0.46706,\n        \"map_at_100\": 0.47604,\n        \"map_at_1000\": 0.47636,\n        \"map_at_20\": 0.47197,\n        \"map_at_3\": 0.4391,\n        \"map_at_5\": 0.45143,\n        \"mrr_at_1\": 0.37767220902612825,\n        \"mrr_at_10\": 0.49347830185122343,\n        \"mrr_at_100\": 0.5003179443111394,\n        \"mrr_at_1000\": 0.5005908363684997,\n        \"mrr_at_20\": 0.49746038430543127,\n        \"mrr_at_3\": 0.46991290577988926,\n        \"mrr_at_5\": 0.48131433095803655,\n        \"nauc_map_at_1000_diff1\": 0.35159452922876405,\n        \"nauc_map_at_1000_max\": 0.2933510225495975,\n        \"nauc_map_at_1000_std\": 0.15655234071328542,\n        \"nauc_map_at_100_diff1\": 0.35135462350016194,\n        \"nauc_map_at_100_max\": 0.2931871700688513,\n        \"nauc_map_at_100_std\": 0.15653088767109508,\n        \"nauc_map_at_10_diff1\": 0.35298293783124035,\n        \"nauc_map_at_10_max\": 0.2946430155110729,\n        \"nauc_map_at_10_std\": 0.1554238628320712,\n        \"nauc_map_at_1_diff1\": 0.39952097513531726,\n        \"nauc_map_at_1_max\": 0.28310443294341225,\n        \"nauc_map_at_1_std\": 0.11174270301882441,\n        \"nauc_map_at_20_diff1\": 0.35065372123850846,\n        \"nauc_map_at_20_max\": 0.29286040418768033,\n        \"nauc_map_at_20_std\": 0.15621968993533264,\n        \"nauc_map_at_3_diff1\": 0.35035525763761394,\n        \"nauc_map_at_3_max\": 0.2942433675582027,\n        \"nauc_map_at_3_std\": 0.15340354705473352,\n        \"nauc_map_at_5_diff1\": 0.3564998458591775,\n        \"nauc_map_at_5_max\": 0.29450450428040004,\n        \"nauc_map_at_5_std\": 0.15635827772340125,\n        \"nauc_mrr_at_1000_diff1\": 0.37081278081751473,\n        \"nauc_mrr_at_1000_max\": 0.31358131772038333,\n        \"nauc_mrr_at_1000_std\": 0.173869859041972,\n        \"nauc_mrr_at_100_diff1\": 0.37048775784895055,\n        \"nauc_mrr_at_100_max\": 0.3133560463765259,\n        \"nauc_mrr_at_100_std\": 0.17378936217140808,\n        \"nauc_mrr_at_10_diff1\": 0.37372919724000586,\n        \"nauc_mrr_at_10_max\": 0.3168249122844439,\n        \"nauc_mrr_at_10_std\": 0.1737668241296463,\n        \"nauc_mrr_at_1_diff1\": 0.4164640284913696,\n        \"nauc_mrr_at_1_max\": 0.3053029955918928,\n        \"nauc_mrr_at_1_std\": 0.139614777902049,\n        \"nauc_mrr_at_20_diff1\": 0.3702719030948478,\n        \"nauc_mrr_at_20_max\": 0.3139466229592053,\n        \"nauc_mrr_at_20_std\": 0.17374029768386537,\n        \"nauc_mrr_at_3_diff1\": 0.3643024059691536,\n        \"nauc_mrr_at_3_max\": 0.31685793544673635,\n        \"nauc_mrr_at_3_std\": 0.18021454208347543,\n        \"nauc_mrr_at_5_diff1\": 0.3743438414059076,\n        \"nauc_mrr_at_5_max\": 0.3160663712710881,\n        \"nauc_mrr_at_5_std\": 0.1742876218746978,\n        \"nauc_ndcg_at_1000_diff1\": 0.3509610363029608,\n        \"nauc_ndcg_at_1000_max\": 0.3038698080687019,\n        \"nauc_ndcg_at_1000_std\": 0.17682837434987447,\n        \"nauc_ndcg_at_100_diff1\": 0.3426920404078895,\n        \"nauc_ndcg_at_100_max\": 0.29853443276775044,\n        \"nauc_ndcg_at_100_std\": 0.17719600663478413,\n        \"nauc_ndcg_at_10_diff1\": 0.3504725576888753,\n        \"nauc_ndcg_at_10_max\": 0.30796980063919227,\n        \"nauc_ndcg_at_10_std\": 0.17240955500640734,\n        \"nauc_ndcg_at_1_diff1\": 0.4164640284913696,\n        \"nauc_ndcg_at_1_max\": 0.3053029955918928,\n        \"nauc_ndcg_at_1_std\": 0.139614777902049,\n        \"nauc_ndcg_at_20_diff1\": 0.3417554990631716,\n        \"nauc_ndcg_at_20_max\": 0.3011309322625806,\n        \"nauc_ndcg_at_20_std\": 0.17512377335026105,\n        \"nauc_ndcg_at_3_diff1\": 0.3426012622485198,\n        \"nauc_ndcg_at_3_max\": 0.3065766498363075,\n        \"nauc_ndcg_at_3_std\": 0.17298978991080857,\n        \"nauc_ndcg_at_5_diff1\": 0.3559184262752043,\n        \"nauc_ndcg_at_5_max\": 0.3065662492821051,\n        \"nauc_ndcg_at_5_std\": 0.17306806837418015,\n        \"nauc_precision_at_1000_diff1\": -0.018564106784191587,\n        \"nauc_precision_at_1000_max\": 0.05069824786767223,\n        \"nauc_precision_at_1000_std\": 0.07088435598406208,\n        \"nauc_precision_at_100_diff1\": 0.021787558199151093,\n        \"nauc_precision_at_100_max\": 0.08798976218503793,\n        \"nauc_precision_at_100_std\": 0.11717271772508196,\n        \"nauc_precision_at_10_diff1\": 0.22242723366799524,\n        \"nauc_precision_at_10_max\": 0.2650261328739618,\n        \"nauc_precision_at_10_std\": 0.17830127753303943,\n        \"nauc_precision_at_1_diff1\": 0.4164640284913696,\n        \"nauc_precision_at_1_max\": 0.3053029955918928,\n        \"nauc_precision_at_1_std\": 0.139614777902049,\n        \"nauc_precision_at_20_diff1\": 0.14379218215003164,\n        \"nauc_precision_at_20_max\": 0.2007146705369895,\n        \"nauc_precision_at_20_std\": 0.16873847049962112,\n        \"nauc_precision_at_3_diff1\": 0.30237337077540904,\n        \"nauc_precision_at_3_max\": 0.32960480137299625,\n        \"nauc_precision_at_3_std\": 0.21900953203517579,\n        \"nauc_precision_at_5_diff1\": 0.31830807697094476,\n        \"nauc_precision_at_5_max\": 0.32377527941214673,\n        \"nauc_precision_at_5_std\": 0.22023081005719566,\n        \"nauc_recall_at_1000_diff1\": 0.4080842443883318,\n        \"nauc_recall_at_1000_max\": 0.4279897557390411,\n        \"nauc_recall_at_1000_std\": 0.5205164184089071,\n        \"nauc_recall_at_100_diff1\": 0.21150817061450922,\n        \"nauc_recall_at_100_max\": 0.24558122864310847,\n        \"nauc_recall_at_100_std\": 0.31297332981382747,\n        \"nauc_recall_at_10_diff1\": 0.3099356523371667,\n        \"nauc_recall_at_10_max\": 0.3212431729034941,\n        \"nauc_recall_at_10_std\": 0.2088569211424609,\n        \"nauc_recall_at_1_diff1\": 0.39952097513531726,\n        \"nauc_recall_at_1_max\": 0.28310443294341225,\n        \"nauc_recall_at_1_std\": 0.11174270301882441,\n        \"nauc_recall_at_20_diff1\": 0.2669571566077889,\n        \"nauc_recall_at_20_max\": 0.29451938489866986,\n        \"nauc_recall_at_20_std\": 0.23244804522019819,\n        \"nauc_recall_at_3_diff1\": 0.29743384251464644,\n        \"nauc_recall_at_3_max\": 0.31274945290783196,\n        \"nauc_recall_at_3_std\": 0.20077907888230528,\n        \"nauc_recall_at_5_diff1\": 0.3294058068556948,\n        \"nauc_recall_at_5_max\": 0.31355500993302904,\n        \"nauc_recall_at_5_std\": 0.20196346725135705,\n        \"ndcg_at_1\": 0.37767,\n        \"ndcg_at_10\": 0.52877,\n        \"ndcg_at_100\": 0.57106,\n        \"ndcg_at_1000\": 0.58064,\n        \"ndcg_at_20\": 0.54516,\n        \"ndcg_at_3\": 0.47401,\n        \"ndcg_at_5\": 0.49453,\n        \"precision_at_1\": 0.37767,\n        \"precision_at_10\": 0.07767,\n        \"precision_at_100\": 0.01033,\n        \"precision_at_1000\": 0.00112,\n        \"precision_at_20\": 0.04287,\n        \"precision_at_3\": 0.19794,\n        \"precision_at_5\": 0.13017,\n        \"recall_at_1\": 0.34917,\n        \"recall_at_10\": 0.6924,\n        \"recall_at_100\": 0.88282,\n        \"recall_at_1000\": 0.95962,\n        \"recall_at_20\": 0.75297,\n        \"recall_at_3\": 0.54592,\n        \"recall_at_5\": 0.59184\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large-instruct/intfloat__multilingual-e5-large-instruct/baa7be480a7de1539afce709c8f13f833a510e0a/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 156.01362895965576,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.27973,\n        \"map_at_1\": 0.195,\n        \"map_at_10\": 0.24843,\n        \"map_at_100\": 0.25742,\n        \"map_at_1000\": 0.2584,\n        \"map_at_20\": 0.25311,\n        \"map_at_3\": 0.23167,\n        \"map_at_5\": 0.24192,\n        \"mrr_at_1\": 0.195,\n        \"mrr_at_10\": 0.24843055555555552,\n        \"mrr_at_100\": 0.25742438448832583,\n        \"mrr_at_1000\": 0.2584015199014167,\n        \"mrr_at_20\": 0.2531069340016709,\n        \"mrr_at_3\": 0.2316666666666667,\n        \"mrr_at_5\": 0.24191666666666667,\n        \"nauc_map_at_1000_diff1\": 0.37031347443432666,\n        \"nauc_map_at_1000_max\": 0.2622894003441827,\n        \"nauc_map_at_1000_std\": 0.013574527284489435,\n        \"nauc_map_at_100_diff1\": 0.3700960181079339,\n        \"nauc_map_at_100_max\": 0.2624294930320296,\n        \"nauc_map_at_100_std\": 0.014387284984817918,\n        \"nauc_map_at_10_diff1\": 0.37487007427582286,\n        \"nauc_map_at_10_max\": 0.2596346953674767,\n        \"nauc_map_at_10_std\": 0.0011087064876853859,\n        \"nauc_map_at_1_diff1\": 0.4043965637946514,\n        \"nauc_map_at_1_max\": 0.2943012692215825,\n        \"nauc_map_at_1_std\": -0.007264460972054072,\n        \"nauc_map_at_20_diff1\": 0.37227605205579717,\n        \"nauc_map_at_20_max\": 0.2617885226011628,\n        \"nauc_map_at_20_std\": 0.009761427845345803,\n        \"nauc_map_at_3_diff1\": 0.3926946162680841,\n        \"nauc_map_at_3_max\": 0.262287901437037,\n        \"nauc_map_at_3_std\": -0.008466116434885087,\n        \"nauc_map_at_5_diff1\": 0.37943573073662135,\n        \"nauc_map_at_5_max\": 0.2675365688661934,\n        \"nauc_map_at_5_std\": 0.007650126294619136,\n        \"nauc_mrr_at_1000_diff1\": 0.37031347443432666,\n        \"nauc_mrr_at_1000_max\": 0.2622894003441827,\n        \"nauc_mrr_at_1000_std\": 0.013574527284489435,\n        \"nauc_mrr_at_100_diff1\": 0.3700960181079339,\n        \"nauc_mrr_at_100_max\": 0.2624294930320296,\n        \"nauc_mrr_at_100_std\": 0.014387284984817918,\n        \"nauc_mrr_at_10_diff1\": 0.37487007427582286,\n        \"nauc_mrr_at_10_max\": 0.2596346953674767,\n        \"nauc_mrr_at_10_std\": 0.0011087064876853859,\n        \"nauc_mrr_at_1_diff1\": 0.4043965637946514,\n        \"nauc_mrr_at_1_max\": 0.2943012692215825,\n        \"nauc_mrr_at_1_std\": -0.007264460972054072,\n        \"nauc_mrr_at_20_diff1\": 0.37227605205579717,\n        \"nauc_mrr_at_20_max\": 0.2617885226011628,\n        \"nauc_mrr_at_20_std\": 0.009761427845345803,\n        \"nauc_mrr_at_3_diff1\": 0.3926946162680841,\n        \"nauc_mrr_at_3_max\": 0.262287901437037,\n        \"nauc_mrr_at_3_std\": -0.008466116434885087,\n        \"nauc_mrr_at_5_diff1\": 0.37943573073662135,\n        \"nauc_mrr_at_5_max\": 0.2675365688661934,\n        \"nauc_mrr_at_5_std\": 0.007650126294619136,\n        \"nauc_ndcg_at_1000_diff1\": 0.34473693918340026,\n        \"nauc_ndcg_at_1000_max\": 0.26152522423937735,\n        \"nauc_ndcg_at_1000_std\": 0.05348864560421092,\n        \"nauc_ndcg_at_100_diff1\": 0.33551532170894127,\n        \"nauc_ndcg_at_100_max\": 0.261071278946091,\n        \"nauc_ndcg_at_100_std\": 0.07134924854819213,\n        \"nauc_ndcg_at_10_diff1\": 0.3603914540915809,\n        \"nauc_ndcg_at_10_max\": 0.24699310480834577,\n        \"nauc_ndcg_at_10_std\": 0.0051495493067397966,\n        \"nauc_ndcg_at_1_diff1\": 0.4043965637946514,\n        \"nauc_ndcg_at_1_max\": 0.2943012692215825,\n        \"nauc_ndcg_at_1_std\": -0.007264460972054072,\n        \"nauc_ndcg_at_20_diff1\": 0.3506191349557638,\n        \"nauc_ndcg_at_20_max\": 0.25338465815346495,\n        \"nauc_ndcg_at_20_std\": 0.03777487888250446,\n        \"nauc_ndcg_at_3_diff1\": 0.39259849910667133,\n        \"nauc_ndcg_at_3_max\": 0.25729722647928605,\n        \"nauc_ndcg_at_3_std\": -0.006994806000349935,\n        \"nauc_ndcg_at_5_diff1\": 0.36957000381323657,\n        \"nauc_ndcg_at_5_max\": 0.26672553727809484,\n        \"nauc_ndcg_at_5_std\": 0.019961780151738107,\n        \"nauc_precision_at_1000_diff1\": 0.15944161629016781,\n        \"nauc_precision_at_1000_max\": 0.3266186764237976,\n        \"nauc_precision_at_1000_std\": 0.4211541520839966,\n        \"nauc_precision_at_100_diff1\": 0.18989474005137313,\n        \"nauc_precision_at_100_max\": 0.27414843100938263,\n        \"nauc_precision_at_100_std\": 0.33297509889557114,\n        \"nauc_precision_at_10_diff1\": 0.32048449562030523,\n        \"nauc_precision_at_10_max\": 0.20979648064876646,\n        \"nauc_precision_at_10_std\": 0.013567956748889061,\n        \"nauc_precision_at_1_diff1\": 0.4043965637946514,\n        \"nauc_precision_at_1_max\": 0.2943012692215825,\n        \"nauc_precision_at_1_std\": -0.007264460972054072,\n        \"nauc_precision_at_20_diff1\": 0.2840764748248545,\n        \"nauc_precision_at_20_max\": 0.23000720225234061,\n        \"nauc_precision_at_20_std\": 0.13421069861847706,\n        \"nauc_precision_at_3_diff1\": 0.393299122570101,\n        \"nauc_precision_at_3_max\": 0.24547261407627474,\n        \"nauc_precision_at_3_std\": -0.0026177466602957254,\n        \"nauc_precision_at_5_diff1\": 0.34252639426981407,\n        \"nauc_precision_at_5_max\": 0.26717125321191304,\n        \"nauc_precision_at_5_std\": 0.05449268416077547,\n        \"nauc_recall_at_1000_diff1\": 0.15944161629016776,\n        \"nauc_recall_at_1000_max\": 0.32661867642379955,\n        \"nauc_recall_at_1000_std\": 0.4211541520839954,\n        \"nauc_recall_at_100_diff1\": 0.18989474005137233,\n        \"nauc_recall_at_100_max\": 0.2741484310093828,\n        \"nauc_recall_at_100_std\": 0.33297509889557103,\n        \"nauc_recall_at_10_diff1\": 0.320484495620305,\n        \"nauc_recall_at_10_max\": 0.20979648064876663,\n        \"nauc_recall_at_10_std\": 0.013567956748888922,\n        \"nauc_recall_at_1_diff1\": 0.4043965637946514,\n        \"nauc_recall_at_1_max\": 0.2943012692215825,\n        \"nauc_recall_at_1_std\": -0.007264460972054072,\n        \"nauc_recall_at_20_diff1\": 0.2840764748248544,\n        \"nauc_recall_at_20_max\": 0.23000720225234056,\n        \"nauc_recall_at_20_std\": 0.13421069861847698,\n        \"nauc_recall_at_3_diff1\": 0.3932991225701008,\n        \"nauc_recall_at_3_max\": 0.24547261407627485,\n        \"nauc_recall_at_3_std\": -0.002617746660295337,\n        \"nauc_recall_at_5_diff1\": 0.34252639426981396,\n        \"nauc_recall_at_5_max\": 0.26717125321191293,\n        \"nauc_recall_at_5_std\": 0.054492684160775344,\n        \"ndcg_at_1\": 0.195,\n        \"ndcg_at_10\": 0.27973,\n        \"ndcg_at_100\": 0.32804,\n        \"ndcg_at_1000\": 0.36022,\n        \"ndcg_at_20\": 0.29721,\n        \"ndcg_at_3\": 0.24524,\n        \"ndcg_at_5\": 0.26374,\n        \"precision_at_1\": 0.195,\n        \"precision_at_10\": 0.038,\n        \"precision_at_100\": 0.00615,\n        \"precision_at_1000\": 0.00088,\n        \"precision_at_20\": 0.0225,\n        \"precision_at_3\": 0.095,\n        \"precision_at_5\": 0.066,\n        \"recall_at_1\": 0.195,\n        \"recall_at_10\": 0.38,\n        \"recall_at_100\": 0.615,\n        \"recall_at_1000\": 0.88,\n        \"recall_at_20\": 0.45,\n        \"recall_at_3\": 0.285,\n        \"recall_at_5\": 0.33\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.25519,\n        \"map_at_1\": 0.185,\n        \"map_at_10\": 0.22778,\n        \"map_at_100\": 0.23672,\n        \"map_at_1000\": 0.23741,\n        \"map_at_20\": 0.23146,\n        \"map_at_3\": 0.2125,\n        \"map_at_5\": 0.2195,\n        \"mrr_at_1\": 0.185,\n        \"mrr_at_10\": 0.2277757936507937,\n        \"mrr_at_100\": 0.23671519344932127,\n        \"mrr_at_1000\": 0.23740747825554465,\n        \"mrr_at_20\": 0.23145719762263883,\n        \"mrr_at_3\": 0.2125,\n        \"mrr_at_5\": 0.2195,\n        \"nauc_map_at_1000_diff1\": 0.5869585562951857,\n        \"nauc_map_at_1000_max\": 0.5011097999591789,\n        \"nauc_map_at_1000_std\": 0.01990522057034222,\n        \"nauc_map_at_100_diff1\": 0.586789824608114,\n        \"nauc_map_at_100_max\": 0.501131079804156,\n        \"nauc_map_at_100_std\": 0.01993246864662988,\n        \"nauc_map_at_10_diff1\": 0.5924721588279078,\n        \"nauc_map_at_10_max\": 0.5011676903737305,\n        \"nauc_map_at_10_std\": 0.012874084824344068,\n        \"nauc_map_at_1_diff1\": 0.651087320461199,\n        \"nauc_map_at_1_max\": 0.5621184934623409,\n        \"nauc_map_at_1_std\": -0.018363825238884145,\n        \"nauc_map_at_20_diff1\": 0.5913314151914077,\n        \"nauc_map_at_20_max\": 0.5006391866466549,\n        \"nauc_map_at_20_std\": 0.01619429521386921,\n        \"nauc_map_at_3_diff1\": 0.6003973094947634,\n        \"nauc_map_at_3_max\": 0.5116586338153044,\n        \"nauc_map_at_3_std\": -0.0058836469811811,\n        \"nauc_map_at_5_diff1\": 0.5905229761539248,\n        \"nauc_map_at_5_max\": 0.5048739528519287,\n        \"nauc_map_at_5_std\": 5.919621017967373e-05,\n        \"nauc_mrr_at_1000_diff1\": 0.5869585562951857,\n        \"nauc_mrr_at_1000_max\": 0.5011097999591789,\n        \"nauc_mrr_at_1000_std\": 0.01990522057034222,\n        \"nauc_mrr_at_100_diff1\": 0.586789824608114,\n        \"nauc_mrr_at_100_max\": 0.501131079804156,\n        \"nauc_mrr_at_100_std\": 0.01993246864662988,\n        \"nauc_mrr_at_10_diff1\": 0.5924721588279078,\n        \"nauc_mrr_at_10_max\": 0.5011676903737305,\n        \"nauc_mrr_at_10_std\": 0.012874084824344068,\n        \"nauc_mrr_at_1_diff1\": 0.651087320461199,\n        \"nauc_mrr_at_1_max\": 0.5621184934623409,\n        \"nauc_mrr_at_1_std\": -0.018363825238884145,\n        \"nauc_mrr_at_20_diff1\": 0.5913314151914077,\n        \"nauc_mrr_at_20_max\": 0.5006391866466549,\n        \"nauc_mrr_at_20_std\": 0.01619429521386921,\n        \"nauc_mrr_at_3_diff1\": 0.6003973094947634,\n        \"nauc_mrr_at_3_max\": 0.5116586338153044,\n        \"nauc_mrr_at_3_std\": -0.0058836469811811,\n        \"nauc_mrr_at_5_diff1\": 0.5905229761539248,\n        \"nauc_mrr_at_5_max\": 0.5048739528519287,\n        \"nauc_mrr_at_5_std\": 5.919621017967373e-05,\n        \"nauc_ndcg_at_1000_diff1\": 0.5474277213838976,\n        \"nauc_ndcg_at_1000_max\": 0.48324954770196255,\n        \"nauc_ndcg_at_1000_std\": 0.07899952050880038,\n        \"nauc_ndcg_at_100_diff1\": 0.5456123914207058,\n        \"nauc_ndcg_at_100_max\": 0.48216591461373676,\n        \"nauc_ndcg_at_100_std\": 0.08457994661231409,\n        \"nauc_ndcg_at_10_diff1\": 0.575580762992824,\n        \"nauc_ndcg_at_10_max\": 0.4793335268719782,\n        \"nauc_ndcg_at_10_std\": 0.040740678566620746,\n        \"nauc_ndcg_at_1_diff1\": 0.651087320461199,\n        \"nauc_ndcg_at_1_max\": 0.5621184934623409,\n        \"nauc_ndcg_at_1_std\": -0.018363825238884145,\n        \"nauc_ndcg_at_20_diff1\": 0.572879929091265,\n        \"nauc_ndcg_at_20_max\": 0.4769023482742165,\n        \"nauc_ndcg_at_20_std\": 0.05178662087884135,\n        \"nauc_ndcg_at_3_diff1\": 0.5855254292976456,\n        \"nauc_ndcg_at_3_max\": 0.4983773170371353,\n        \"nauc_ndcg_at_3_std\": -0.001382877447712404,\n        \"nauc_ndcg_at_5_diff1\": 0.5691214837490666,\n        \"nauc_ndcg_at_5_max\": 0.48658320797924554,\n        \"nauc_ndcg_at_5_std\": 0.009253991821409535,\n        \"nauc_precision_at_1000_diff1\": 0.27137205030380085,\n        \"nauc_precision_at_1000_max\": 0.4270736187650138,\n        \"nauc_precision_at_1000_std\": 0.5035325702981494,\n        \"nauc_precision_at_100_diff1\": 0.3866719995077383,\n        \"nauc_precision_at_100_max\": 0.4385902839737872,\n        \"nauc_precision_at_100_std\": 0.3674583884564506,\n        \"nauc_precision_at_10_diff1\": 0.5359859373657675,\n        \"nauc_precision_at_10_max\": 0.42305531875524544,\n        \"nauc_precision_at_10_std\": 0.12263172154926895,\n        \"nauc_precision_at_1_diff1\": 0.651087320461199,\n        \"nauc_precision_at_1_max\": 0.5621184934623409,\n        \"nauc_precision_at_1_std\": -0.018363825238884145,\n        \"nauc_precision_at_20_diff1\": 0.5297566941297631,\n        \"nauc_precision_at_20_max\": 0.41496524201853774,\n        \"nauc_precision_at_20_std\": 0.15807801235839364,\n        \"nauc_precision_at_3_diff1\": 0.5460095623390954,\n        \"nauc_precision_at_3_max\": 0.4635307098197868,\n        \"nauc_precision_at_3_std\": 0.010820154468554766,\n        \"nauc_precision_at_5_diff1\": 0.5126333873400752,\n        \"nauc_precision_at_5_max\": 0.4385789708922289,\n        \"nauc_precision_at_5_std\": 0.03457595396390869,\n        \"nauc_recall_at_1000_diff1\": 0.27137205030380174,\n        \"nauc_recall_at_1000_max\": 0.4270736187650142,\n        \"nauc_recall_at_1000_std\": 0.5035325702981486,\n        \"nauc_recall_at_100_diff1\": 0.38667199950773756,\n        \"nauc_recall_at_100_max\": 0.4385902839737867,\n        \"nauc_recall_at_100_std\": 0.36745838845644985,\n        \"nauc_recall_at_10_diff1\": 0.535985937365767,\n        \"nauc_recall_at_10_max\": 0.42305531875524555,\n        \"nauc_recall_at_10_std\": 0.122631721549269,\n        \"nauc_recall_at_1_diff1\": 0.651087320461199,\n        \"nauc_recall_at_1_max\": 0.5621184934623409,\n        \"nauc_recall_at_1_std\": -0.018363825238884145,\n        \"nauc_recall_at_20_diff1\": 0.5297566941297629,\n        \"nauc_recall_at_20_max\": 0.41496524201853785,\n        \"nauc_recall_at_20_std\": 0.1580780123583932,\n        \"nauc_recall_at_3_diff1\": 0.5460095623390951,\n        \"nauc_recall_at_3_max\": 0.46353070981978667,\n        \"nauc_recall_at_3_std\": 0.010820154468554456,\n        \"nauc_recall_at_5_diff1\": 0.5126333873400747,\n        \"nauc_recall_at_5_max\": 0.43857897089222847,\n        \"nauc_recall_at_5_std\": 0.03457595396390839,\n        \"ndcg_at_1\": 0.185,\n        \"ndcg_at_10\": 0.25519,\n        \"ndcg_at_100\": 0.30897,\n        \"ndcg_at_1000\": 0.3333,\n        \"ndcg_at_20\": 0.26893,\n        \"ndcg_at_3\": 0.22208,\n        \"ndcg_at_5\": 0.23456,\n        \"precision_at_1\": 0.185,\n        \"precision_at_10\": 0.0345,\n        \"precision_at_100\": 0.0062,\n        \"precision_at_1000\": 0.00083,\n        \"precision_at_20\": 0.02,\n        \"precision_at_3\": 0.08333,\n        \"precision_at_5\": 0.056,\n        \"recall_at_1\": 0.185,\n        \"recall_at_10\": 0.345,\n        \"recall_at_100\": 0.62,\n        \"recall_at_1000\": 0.825,\n        \"recall_at_20\": 0.4,\n        \"recall_at_3\": 0.25,\n        \"recall_at_5\": 0.28\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large-instruct/intfloat__multilingual-e5-large-instruct/baa7be480a7de1539afce709c8f13f833a510e0a/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 1.2370071411132812,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.84967,\n        \"map_at_1\": 0.72727,\n        \"map_at_10\": 0.81335,\n        \"map_at_100\": 0.8154,\n        \"map_at_1000\": 0.8154,\n        \"map_at_20\": 0.81453,\n        \"map_at_3\": 0.80519,\n        \"map_at_5\": 0.80844,\n        \"mrr_at_1\": 0.7272727272727273,\n        \"mrr_at_10\": 0.8133477633477633,\n        \"mrr_at_100\": 0.8153980669402747,\n        \"mrr_at_1000\": 0.8153980669402747,\n        \"mrr_at_20\": 0.8145284008920373,\n        \"mrr_at_3\": 0.8051948051948052,\n        \"mrr_at_5\": 0.8084415584415584,\n        \"nauc_map_at_1000_diff1\": 0.8206571496909262,\n        \"nauc_map_at_1000_max\": 0.27777799731256525,\n        \"nauc_map_at_1000_std\": -0.18126304477876914,\n        \"nauc_map_at_100_diff1\": 0.8206571496909262,\n        \"nauc_map_at_100_max\": 0.27777799731256525,\n        \"nauc_map_at_100_std\": -0.18126304477876914,\n        \"nauc_map_at_10_diff1\": 0.8190794622023716,\n        \"nauc_map_at_10_max\": 0.27448093578803834,\n        \"nauc_map_at_10_std\": -0.18103424295415874,\n        \"nauc_map_at_1_diff1\": 0.8502933860364167,\n        \"nauc_map_at_1_max\": 0.2578662916557108,\n        \"nauc_map_at_1_std\": -0.17339023849413804,\n        \"nauc_map_at_20_diff1\": 0.8187291485858915,\n        \"nauc_map_at_20_max\": 0.2755314745647117,\n        \"nauc_map_at_20_std\": -0.17835635325681093,\n        \"nauc_map_at_3_diff1\": 0.8202919737719437,\n        \"nauc_map_at_3_max\": 0.2832246049725774,\n        \"nauc_map_at_3_std\": -0.2237173829465317,\n        \"nauc_map_at_5_diff1\": 0.822121513194672,\n        \"nauc_map_at_5_max\": 0.27813762918636437,\n        \"nauc_map_at_5_std\": -0.20610079524493233,\n        \"nauc_mrr_at_1000_diff1\": 0.8206571496909262,\n        \"nauc_mrr_at_1000_max\": 0.27777799731256525,\n        \"nauc_mrr_at_1000_std\": -0.18126304477876914,\n        \"nauc_mrr_at_100_diff1\": 0.8206571496909262,\n        \"nauc_mrr_at_100_max\": 0.27777799731256525,\n        \"nauc_mrr_at_100_std\": -0.18126304477876914,\n        \"nauc_mrr_at_10_diff1\": 0.8190794622023716,\n        \"nauc_mrr_at_10_max\": 0.27448093578803834,\n        \"nauc_mrr_at_10_std\": -0.18103424295415874,\n        \"nauc_mrr_at_1_diff1\": 0.8502933860364167,\n        \"nauc_mrr_at_1_max\": 0.2578662916557108,\n        \"nauc_mrr_at_1_std\": -0.17339023849413804,\n        \"nauc_mrr_at_20_diff1\": 0.8187291485858915,\n        \"nauc_mrr_at_20_max\": 0.2755314745647117,\n        \"nauc_mrr_at_20_std\": -0.17835635325681093,\n        \"nauc_mrr_at_3_diff1\": 0.8202919737719437,\n        \"nauc_mrr_at_3_max\": 0.2832246049725774,\n        \"nauc_mrr_at_3_std\": -0.2237173829465317,\n        \"nauc_mrr_at_5_diff1\": 0.822121513194672,\n        \"nauc_mrr_at_5_max\": 0.27813762918636437,\n        \"nauc_mrr_at_5_std\": -0.20610079524493233,\n        \"nauc_ndcg_at_1000_diff1\": 0.8152844323746344,\n        \"nauc_ndcg_at_1000_max\": 0.27496694113179954,\n        \"nauc_ndcg_at_1000_std\": -0.18043690881056673,\n        \"nauc_ndcg_at_100_diff1\": 0.8152844323746344,\n        \"nauc_ndcg_at_100_max\": 0.27496694113179954,\n        \"nauc_ndcg_at_100_std\": -0.18043690881056673,\n        \"nauc_ndcg_at_10_diff1\": 0.8028630815222548,\n        \"nauc_ndcg_at_10_max\": 0.25653467116330825,\n        \"nauc_ndcg_at_10_std\": -0.16801671661837783,\n        \"nauc_ndcg_at_1_diff1\": 0.8502933860364167,\n        \"nauc_ndcg_at_1_max\": 0.2578662916557108,\n        \"nauc_ndcg_at_1_std\": -0.17339023849413804,\n        \"nauc_ndcg_at_20_diff1\": 0.801072318229471,\n        \"nauc_ndcg_at_20_max\": 0.2600943671088392,\n        \"nauc_ndcg_at_20_std\": -0.1573447636079357,\n        \"nauc_ndcg_at_3_diff1\": 0.8088899419035144,\n        \"nauc_ndcg_at_3_max\": 0.2789511826471411,\n        \"nauc_ndcg_at_3_std\": -0.27327533046798197,\n        \"nauc_ndcg_at_5_diff1\": 0.8121263422915855,\n        \"nauc_ndcg_at_5_max\": 0.2686030984088624,\n        \"nauc_ndcg_at_5_std\": -0.2398529803942681,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.5938250215675132,\n        \"nauc_precision_at_10_max\": -0.012909070638074602,\n        \"nauc_precision_at_10_std\": 0.09099141428707733,\n        \"nauc_precision_at_1_diff1\": 0.8502933860364167,\n        \"nauc_precision_at_1_max\": 0.2578662916557108,\n        \"nauc_precision_at_1_std\": -0.17339023849413804,\n        \"nauc_precision_at_20_diff1\": 0.4563811811151188,\n        \"nauc_precision_at_20_max\": -0.08218269674418595,\n        \"nauc_precision_at_20_std\": 0.4167090338610833,\n        \"nauc_precision_at_3_diff1\": 0.7466686222564458,\n        \"nauc_precision_at_3_max\": 0.2460394253480639,\n        \"nauc_precision_at_3_std\": -0.5646971914957185,\n        \"nauc_precision_at_5_diff1\": 0.7506796183748052,\n        \"nauc_precision_at_5_max\": 0.1945715538625944,\n        \"nauc_precision_at_5_std\": -0.46475249116360745,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.5938250215675056,\n        \"nauc_recall_at_10_max\": -0.012909070638077955,\n        \"nauc_recall_at_10_std\": 0.09099141428707062,\n        \"nauc_recall_at_1_diff1\": 0.8502933860364167,\n        \"nauc_recall_at_1_max\": 0.2578662916557108,\n        \"nauc_recall_at_1_std\": -0.17339023849413804,\n        \"nauc_recall_at_20_diff1\": 0.45638118111511516,\n        \"nauc_recall_at_20_max\": -0.08218269674420323,\n        \"nauc_recall_at_20_std\": 0.41670903386108427,\n        \"nauc_recall_at_3_diff1\": 0.7466686222564456,\n        \"nauc_recall_at_3_max\": 0.24603942534806478,\n        \"nauc_recall_at_3_std\": -0.5646971914957211,\n        \"nauc_recall_at_5_diff1\": 0.7506796183748019,\n        \"nauc_recall_at_5_max\": 0.19457155386259348,\n        \"nauc_recall_at_5_std\": -0.4647524911636102,\n        \"ndcg_at_1\": 0.72727,\n        \"ndcg_at_10\": 0.84967,\n        \"ndcg_at_100\": 0.85854,\n        \"ndcg_at_1000\": 0.85854,\n        \"ndcg_at_20\": 0.85329,\n        \"ndcg_at_3\": 0.83178,\n        \"ndcg_at_5\": 0.83738,\n        \"precision_at_1\": 0.72727,\n        \"precision_at_10\": 0.0961,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.0487,\n        \"precision_at_3\": 0.30303,\n        \"precision_at_5\": 0.18442,\n        \"recall_at_1\": 0.72727,\n        \"recall_at_10\": 0.96104,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.97403,\n        \"recall_at_3\": 0.90909,\n        \"recall_at_5\": 0.92208\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large-instruct/intfloat__multilingual-e5-large-instruct/baa7be480a7de1539afce709c8f13f833a510e0a/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 15.38088846206665,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.39712,\n        \"map_at_1\": 0.21888,\n        \"map_at_10\": 0.34649,\n        \"map_at_100\": 0.36244,\n        \"map_at_1000\": 0.36348,\n        \"map_at_20\": 0.35434,\n        \"map_at_3\": 0.3126,\n        \"map_at_5\": 0.3326,\n        \"mrr_at_1\": 0.308868501529052,\n        \"mrr_at_10\": 0.38503592058637925,\n        \"mrr_at_100\": 0.39587904262412565,\n        \"mrr_at_1000\": 0.39658384769232136,\n        \"mrr_at_20\": 0.38983454673818096,\n        \"mrr_at_3\": 0.3621304791029564,\n        \"mrr_at_5\": 0.3748980632008156,\n        \"nauc_map_at_1000_diff1\": 0.4938793438182075,\n        \"nauc_map_at_1000_max\": 0.14033836376799186,\n        \"nauc_map_at_1000_std\": -0.3457665113560473,\n        \"nauc_map_at_100_diff1\": 0.4934107716477553,\n        \"nauc_map_at_100_max\": 0.14040961141910815,\n        \"nauc_map_at_100_std\": -0.3453077860764266,\n        \"nauc_map_at_10_diff1\": 0.4986170384156942,\n        \"nauc_map_at_10_max\": 0.13992927666625024,\n        \"nauc_map_at_10_std\": -0.35133889099460003,\n        \"nauc_map_at_1_diff1\": 0.5758611494040373,\n        \"nauc_map_at_1_max\": 0.10719703322248628,\n        \"nauc_map_at_1_std\": -0.28511277812214025,\n        \"nauc_map_at_20_diff1\": 0.494103847934402,\n        \"nauc_map_at_20_max\": 0.13794317465299416,\n        \"nauc_map_at_20_std\": -0.35012909945307236,\n        \"nauc_map_at_3_diff1\": 0.4976826016047651,\n        \"nauc_map_at_3_max\": 0.1332308266451902,\n        \"nauc_map_at_3_std\": -0.33494850589834707,\n        \"nauc_map_at_5_diff1\": 0.4963791581597089,\n        \"nauc_map_at_5_max\": 0.1412028729309117,\n        \"nauc_map_at_5_std\": -0.34317404873296514,\n        \"nauc_mrr_at_1000_diff1\": 0.5064923389173324,\n        \"nauc_mrr_at_1000_max\": 0.14160753046392952,\n        \"nauc_mrr_at_1000_std\": -0.34244539779260885,\n        \"nauc_mrr_at_100_diff1\": 0.5061203037903881,\n        \"nauc_mrr_at_100_max\": 0.14207692937458782,\n        \"nauc_mrr_at_100_std\": -0.3417835774278715,\n        \"nauc_mrr_at_10_diff1\": 0.5086495218767871,\n        \"nauc_mrr_at_10_max\": 0.13896416587385885,\n        \"nauc_mrr_at_10_std\": -0.34874817852780676,\n        \"nauc_mrr_at_1_diff1\": 0.5412822906602741,\n        \"nauc_mrr_at_1_max\": 0.1528688773246987,\n        \"nauc_mrr_at_1_std\": -0.32880812723190067,\n        \"nauc_mrr_at_20_diff1\": 0.5068209639387778,\n        \"nauc_mrr_at_20_max\": 0.1412416216860168,\n        \"nauc_mrr_at_20_std\": -0.3447064065860721,\n        \"nauc_mrr_at_3_diff1\": 0.5113245114527545,\n        \"nauc_mrr_at_3_max\": 0.1334620103163377,\n        \"nauc_mrr_at_3_std\": -0.3452484558664774,\n        \"nauc_mrr_at_5_diff1\": 0.5050392938404901,\n        \"nauc_mrr_at_5_max\": 0.13518516881793208,\n        \"nauc_mrr_at_5_std\": -0.34621161778044895,\n        \"nauc_ndcg_at_1000_diff1\": 0.48504903786795533,\n        \"nauc_ndcg_at_1000_max\": 0.14709538742126532,\n        \"nauc_ndcg_at_1000_std\": -0.33563187850448717,\n        \"nauc_ndcg_at_100_diff1\": 0.4739085606140208,\n        \"nauc_ndcg_at_100_max\": 0.15608766027510723,\n        \"nauc_ndcg_at_100_std\": -0.3196535192612011,\n        \"nauc_ndcg_at_10_diff1\": 0.49173786614731635,\n        \"nauc_ndcg_at_10_max\": 0.13803761133061102,\n        \"nauc_ndcg_at_10_std\": -0.3619033788429885,\n        \"nauc_ndcg_at_1_diff1\": 0.5364706142040498,\n        \"nauc_ndcg_at_1_max\": 0.14834968074029853,\n        \"nauc_ndcg_at_1_std\": -0.3323893090055653,\n        \"nauc_ndcg_at_20_diff1\": 0.47820599954723897,\n        \"nauc_ndcg_at_20_max\": 0.13696761061378762,\n        \"nauc_ndcg_at_20_std\": -0.35283836547606195,\n        \"nauc_ndcg_at_3_diff1\": 0.4911113875408138,\n        \"nauc_ndcg_at_3_max\": 0.1252264225375447,\n        \"nauc_ndcg_at_3_std\": -0.3456584703342219,\n        \"nauc_ndcg_at_5_diff1\": 0.48601696759888824,\n        \"nauc_ndcg_at_5_max\": 0.13635614344430816,\n        \"nauc_ndcg_at_5_std\": -0.34912630424542496,\n        \"nauc_precision_at_1000_diff1\": -0.04754090125061955,\n        \"nauc_precision_at_1000_max\": 0.12006674175244639,\n        \"nauc_precision_at_1000_std\": 0.0032772165349477457,\n        \"nauc_precision_at_100_diff1\": 0.037625935735913524,\n        \"nauc_precision_at_100_max\": 0.1609741460344705,\n        \"nauc_precision_at_100_std\": -0.03399066106569336,\n        \"nauc_precision_at_10_diff1\": 0.2643227750602363,\n        \"nauc_precision_at_10_max\": 0.12545697636574826,\n        \"nauc_precision_at_10_std\": -0.3254097435964989,\n        \"nauc_precision_at_1_diff1\": 0.5364706142040498,\n        \"nauc_precision_at_1_max\": 0.14834968074029853,\n        \"nauc_precision_at_1_std\": -0.3323893090055653,\n        \"nauc_precision_at_20_diff1\": 0.1849450135640393,\n        \"nauc_precision_at_20_max\": 0.10621803554038761,\n        \"nauc_precision_at_20_std\": -0.26546287801724017,\n        \"nauc_precision_at_3_diff1\": 0.3062650294584825,\n        \"nauc_precision_at_3_max\": 0.14135329779907302,\n        \"nauc_precision_at_3_std\": -0.3246514267708076,\n        \"nauc_precision_at_5_diff1\": 0.280497812612027,\n        \"nauc_precision_at_5_max\": 0.14083496728899678,\n        \"nauc_precision_at_5_std\": -0.31740076848026383,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.29660023226530086,\n        \"nauc_recall_at_100_max\": 0.2946376260903222,\n        \"nauc_recall_at_100_std\": -0.06881895301140882,\n        \"nauc_recall_at_10_diff1\": 0.44724745606511856,\n        \"nauc_recall_at_10_max\": 0.13565799896280048,\n        \"nauc_recall_at_10_std\": -0.3757092863613126,\n        \"nauc_recall_at_1_diff1\": 0.5758611494040373,\n        \"nauc_recall_at_1_max\": 0.10719703322248628,\n        \"nauc_recall_at_1_std\": -0.28511277812214025,\n        \"nauc_recall_at_20_diff1\": 0.39856512009507705,\n        \"nauc_recall_at_20_max\": 0.13265107059328365,\n        \"nauc_recall_at_20_std\": -0.34315879068741667,\n        \"nauc_recall_at_3_diff1\": 0.4474915398846289,\n        \"nauc_recall_at_3_max\": 0.10849069030862127,\n        \"nauc_recall_at_3_std\": -0.3296936110277511,\n        \"nauc_recall_at_5_diff1\": 0.43224188656662843,\n        \"nauc_recall_at_5_max\": 0.1290461802519051,\n        \"nauc_recall_at_5_std\": -0.34324505890807,\n        \"ndcg_at_1\": 0.3104,\n        \"ndcg_at_10\": 0.39712,\n        \"ndcg_at_100\": 0.47154,\n        \"ndcg_at_1000\": 0.49429,\n        \"ndcg_at_20\": 0.42036,\n        \"ndcg_at_3\": 0.34439,\n        \"ndcg_at_5\": 0.36926,\n        \"precision_at_1\": 0.3104,\n        \"precision_at_10\": 0.08135,\n        \"precision_at_100\": 0.01338,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.04763,\n        \"precision_at_3\": 0.1947,\n        \"precision_at_5\": 0.13731,\n        \"recall_at_1\": 0.21888,\n        \"recall_at_10\": 0.50757,\n        \"recall_at_100\": 0.83588,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.58723,\n        \"recall_at_3\": 0.36993,\n        \"recall_at_5\": 0.43282\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.34845,\n        \"map_at_1\": 0.16119,\n        \"map_at_10\": 0.28906,\n        \"map_at_100\": 0.30919,\n        \"map_at_1000\": 0.31078,\n        \"map_at_20\": 0.29904,\n        \"map_at_3\": 0.24913,\n        \"map_at_5\": 0.27061,\n        \"mrr_at_1\": 0.2874617737003058,\n        \"mrr_at_10\": 0.3652213484782293,\n        \"mrr_at_100\": 0.3766134383278123,\n        \"mrr_at_1000\": 0.3773370430145179,\n        \"mrr_at_20\": 0.3708954194258964,\n        \"mrr_at_3\": 0.34225280326197777,\n        \"mrr_at_5\": 0.3528032619775741,\n        \"nauc_map_at_1000_diff1\": 0.4132604156431238,\n        \"nauc_map_at_1000_max\": 0.09075253024474995,\n        \"nauc_map_at_1000_std\": -0.2796985466621365,\n        \"nauc_map_at_100_diff1\": 0.4132467642757701,\n        \"nauc_map_at_100_max\": 0.09036616100866424,\n        \"nauc_map_at_100_std\": -0.2805355536802595,\n        \"nauc_map_at_10_diff1\": 0.41451380109993435,\n        \"nauc_map_at_10_max\": 0.08555211183537512,\n        \"nauc_map_at_10_std\": -0.28279220949434414,\n        \"nauc_map_at_1_diff1\": 0.4735449804969548,\n        \"nauc_map_at_1_max\": 0.11557448945335527,\n        \"nauc_map_at_1_std\": -0.23419923263440692,\n        \"nauc_map_at_20_diff1\": 0.4126951196771288,\n        \"nauc_map_at_20_max\": 0.08846849382878437,\n        \"nauc_map_at_20_std\": -0.28257251222521484,\n        \"nauc_map_at_3_diff1\": 0.4296265167051265,\n        \"nauc_map_at_3_max\": 0.08354629304605858,\n        \"nauc_map_at_3_std\": -0.28401903390380767,\n        \"nauc_map_at_5_diff1\": 0.4176921026491939,\n        \"nauc_map_at_5_max\": 0.08287614745727191,\n        \"nauc_map_at_5_std\": -0.2837474030167906,\n        \"nauc_mrr_at_1000_diff1\": 0.395373266028508,\n        \"nauc_mrr_at_1000_max\": 0.08380487419692623,\n        \"nauc_mrr_at_1000_std\": -0.27874877237229806,\n        \"nauc_mrr_at_100_diff1\": 0.39523289730559685,\n        \"nauc_mrr_at_100_max\": 0.08421407730333434,\n        \"nauc_mrr_at_100_std\": -0.2782364358582657,\n        \"nauc_mrr_at_10_diff1\": 0.3931608274769371,\n        \"nauc_mrr_at_10_max\": 0.07677456596398377,\n        \"nauc_mrr_at_10_std\": -0.2851697681540037,\n        \"nauc_mrr_at_1_diff1\": 0.43740382846764175,\n        \"nauc_mrr_at_1_max\": 0.11677365601832777,\n        \"nauc_mrr_at_1_std\": -0.2698572961246088,\n        \"nauc_mrr_at_20_diff1\": 0.3932095949508548,\n        \"nauc_mrr_at_20_max\": 0.08176630490903718,\n        \"nauc_mrr_at_20_std\": -0.28086195541525866,\n        \"nauc_mrr_at_3_diff1\": 0.40540297010919407,\n        \"nauc_mrr_at_3_max\": 0.07698017878099053,\n        \"nauc_mrr_at_3_std\": -0.2843971691113085,\n        \"nauc_mrr_at_5_diff1\": 0.398503783285173,\n        \"nauc_mrr_at_5_max\": 0.07601327253854948,\n        \"nauc_mrr_at_5_std\": -0.2857619928392789,\n        \"nauc_ndcg_at_1000_diff1\": 0.3942960671833233,\n        \"nauc_ndcg_at_1000_max\": 0.0969243382982282,\n        \"nauc_ndcg_at_1000_std\": -0.2650061994030209,\n        \"nauc_ndcg_at_100_diff1\": 0.3904512263504864,\n        \"nauc_ndcg_at_100_max\": 0.1058727472654733,\n        \"nauc_ndcg_at_100_std\": -0.2582671262785743,\n        \"nauc_ndcg_at_10_diff1\": 0.3905532311603214,\n        \"nauc_ndcg_at_10_max\": 0.0737115809616373,\n        \"nauc_ndcg_at_10_std\": -0.28794085319068563,\n        \"nauc_ndcg_at_1_diff1\": 0.43740382846764175,\n        \"nauc_ndcg_at_1_max\": 0.11677365601832777,\n        \"nauc_ndcg_at_1_std\": -0.2698572961246088,\n        \"nauc_ndcg_at_20_diff1\": 0.3878286297478578,\n        \"nauc_ndcg_at_20_max\": 0.08743825748382349,\n        \"nauc_ndcg_at_20_std\": -0.2805671934768294,\n        \"nauc_ndcg_at_3_diff1\": 0.41076728730433737,\n        \"nauc_ndcg_at_3_max\": 0.06933067063194023,\n        \"nauc_ndcg_at_3_std\": -0.2975432980702906,\n        \"nauc_ndcg_at_5_diff1\": 0.4026825956038753,\n        \"nauc_ndcg_at_5_max\": 0.06965207776580915,\n        \"nauc_ndcg_at_5_std\": -0.2916394094727,\n        \"nauc_precision_at_1000_diff1\": 0.0012120654272292776,\n        \"nauc_precision_at_1000_max\": 0.068882805437944,\n        \"nauc_precision_at_1000_std\": 0.018982569283596245,\n        \"nauc_precision_at_100_diff1\": 0.06892898098463235,\n        \"nauc_precision_at_100_max\": 0.09762536800572956,\n        \"nauc_precision_at_100_std\": -0.039848205836443336,\n        \"nauc_precision_at_10_diff1\": 0.2076939403725245,\n        \"nauc_precision_at_10_max\": 0.051045685159536135,\n        \"nauc_precision_at_10_std\": -0.2167052980022179,\n        \"nauc_precision_at_1_diff1\": 0.43740382846764175,\n        \"nauc_precision_at_1_max\": 0.11677365601832777,\n        \"nauc_precision_at_1_std\": -0.2698572961246088,\n        \"nauc_precision_at_20_diff1\": 0.17003887782278732,\n        \"nauc_precision_at_20_max\": 0.06507220082927256,\n        \"nauc_precision_at_20_std\": -0.18406382211925656,\n        \"nauc_precision_at_3_diff1\": 0.29603688125001487,\n        \"nauc_precision_at_3_max\": 0.04197210075871776,\n        \"nauc_precision_at_3_std\": -0.27903914892926,\n        \"nauc_precision_at_5_diff1\": 0.2511492722761761,\n        \"nauc_precision_at_5_max\": 0.043131129659799046,\n        \"nauc_precision_at_5_std\": -0.2500670288977752,\n        \"nauc_recall_at_1000_diff1\": 0.6789912062843171,\n        \"nauc_recall_at_1000_max\": -0.0754372826685466,\n        \"nauc_recall_at_1000_std\": -0.4366799748609778,\n        \"nauc_recall_at_100_diff1\": 0.29981693556672984,\n        \"nauc_recall_at_100_max\": 0.23338288447757893,\n        \"nauc_recall_at_100_std\": -0.08434646011183694,\n        \"nauc_recall_at_10_diff1\": 0.3240730506559147,\n        \"nauc_recall_at_10_max\": 0.04714641182874439,\n        \"nauc_recall_at_10_std\": -0.27583519148160984,\n        \"nauc_recall_at_1_diff1\": 0.4735449804969548,\n        \"nauc_recall_at_1_max\": 0.11557448945335527,\n        \"nauc_recall_at_1_std\": -0.23419923263440692,\n        \"nauc_recall_at_20_diff1\": 0.3106510813655099,\n        \"nauc_recall_at_20_max\": 0.09511191745520513,\n        \"nauc_recall_at_20_std\": -0.24451933307554488,\n        \"nauc_recall_at_3_diff1\": 0.3815838931025316,\n        \"nauc_recall_at_3_max\": 0.04154397826629648,\n        \"nauc_recall_at_3_std\": -0.2861390949842987,\n        \"nauc_recall_at_5_diff1\": 0.3583749177827193,\n        \"nauc_recall_at_5_max\": 0.0396709372361749,\n        \"nauc_recall_at_5_std\": -0.2899291033734086,\n        \"ndcg_at_1\": 0.28746,\n        \"ndcg_at_10\": 0.34845,\n        \"ndcg_at_100\": 0.435,\n        \"ndcg_at_1000\": 0.46333,\n        \"ndcg_at_20\": 0.37639,\n        \"ndcg_at_3\": 0.30097,\n        \"ndcg_at_5\": 0.31384,\n        \"precision_at_1\": 0.28746,\n        \"precision_at_10\": 0.09174,\n        \"precision_at_100\": 0.01619,\n        \"precision_at_1000\": 0.00195,\n        \"precision_at_20\": 0.05573,\n        \"precision_at_3\": 0.19929,\n        \"precision_at_5\": 0.14495,\n        \"recall_at_1\": 0.16119,\n        \"recall_at_10\": 0.44134,\n        \"recall_at_100\": 0.8066,\n        \"recall_at_1000\": 0.99694,\n        \"recall_at_20\": 0.53196,\n        \"recall_at_3\": 0.29962,\n        \"recall_at_5\": 0.3542\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.37352,\n        \"map_at_1\": 0.19463,\n        \"map_at_10\": 0.31834,\n        \"map_at_100\": 0.33443,\n        \"map_at_1000\": 0.33558,\n        \"map_at_20\": 0.32649,\n        \"map_at_3\": 0.27894,\n        \"map_at_5\": 0.30041,\n        \"mrr_at_1\": 0.2752442996742671,\n        \"mrr_at_10\": 0.35836435551419243,\n        \"mrr_at_100\": 0.369324949585393,\n        \"mrr_at_1000\": 0.37001485561127806,\n        \"mrr_at_20\": 0.3638920526358,\n        \"mrr_at_3\": 0.33197611292073836,\n        \"mrr_at_5\": 0.34630836047774155,\n        \"nauc_map_at_1000_diff1\": 0.4385039701306293,\n        \"nauc_map_at_1000_max\": 0.04109853971012122,\n        \"nauc_map_at_1000_std\": -0.3014883929232645,\n        \"nauc_map_at_100_diff1\": 0.43787844081868205,\n        \"nauc_map_at_100_max\": 0.04147338706535819,\n        \"nauc_map_at_100_std\": -0.3008286696906349,\n        \"nauc_map_at_10_diff1\": 0.4421977965125799,\n        \"nauc_map_at_10_max\": 0.034228741506822404,\n        \"nauc_map_at_10_std\": -0.3125065142395519,\n        \"nauc_map_at_1_diff1\": 0.5581508907427222,\n        \"nauc_map_at_1_max\": 0.0333779502484941,\n        \"nauc_map_at_1_std\": -0.2292104531599672,\n        \"nauc_map_at_20_diff1\": 0.44129038398015746,\n        \"nauc_map_at_20_max\": 0.03795484756429189,\n        \"nauc_map_at_20_std\": -0.30987390225868416,\n        \"nauc_map_at_3_diff1\": 0.45291200776206947,\n        \"nauc_map_at_3_max\": 0.04254275361818072,\n        \"nauc_map_at_3_std\": -0.2798266220542301,\n        \"nauc_map_at_5_diff1\": 0.4464396026810503,\n        \"nauc_map_at_5_max\": 0.034295293776766,\n        \"nauc_map_at_5_std\": -0.2993714371137663,\n        \"nauc_mrr_at_1000_diff1\": 0.46507435682818815,\n        \"nauc_mrr_at_1000_max\": 0.05139897729335335,\n        \"nauc_mrr_at_1000_std\": -0.2930435001253733,\n        \"nauc_mrr_at_100_diff1\": 0.46470644818935436,\n        \"nauc_mrr_at_100_max\": 0.051808627157288,\n        \"nauc_mrr_at_100_std\": -0.29242180585091254,\n        \"nauc_mrr_at_10_diff1\": 0.46679584828865944,\n        \"nauc_mrr_at_10_max\": 0.04669594755620027,\n        \"nauc_mrr_at_10_std\": -0.30011366716993615,\n        \"nauc_mrr_at_1_diff1\": 0.523765306788138,\n        \"nauc_mrr_at_1_max\": 0.07101697112154846,\n        \"nauc_mrr_at_1_std\": -0.2720158381402068,\n        \"nauc_mrr_at_20_diff1\": 0.4664255834677069,\n        \"nauc_mrr_at_20_max\": 0.0499587264407141,\n        \"nauc_mrr_at_20_std\": -0.2969349667469947,\n        \"nauc_mrr_at_3_diff1\": 0.4729610660750291,\n        \"nauc_mrr_at_3_max\": 0.050329267957550605,\n        \"nauc_mrr_at_3_std\": -0.29555486383633967,\n        \"nauc_mrr_at_5_diff1\": 0.46488455928143696,\n        \"nauc_mrr_at_5_max\": 0.040193067387784505,\n        \"nauc_mrr_at_5_std\": -0.29932901376821935,\n        \"nauc_ndcg_at_1000_diff1\": 0.42690516618900637,\n        \"nauc_ndcg_at_1000_max\": 0.05619517165396485,\n        \"nauc_ndcg_at_1000_std\": -0.28541751450799574,\n        \"nauc_ndcg_at_100_diff1\": 0.40892391546541423,\n        \"nauc_ndcg_at_100_max\": 0.06798408580650303,\n        \"nauc_ndcg_at_100_std\": -0.2647801256659749,\n        \"nauc_ndcg_at_10_diff1\": 0.4307636665886242,\n        \"nauc_ndcg_at_10_max\": 0.03143040834478728,\n        \"nauc_ndcg_at_10_std\": -0.32725097959553556,\n        \"nauc_ndcg_at_1_diff1\": 0.523765306788138,\n        \"nauc_ndcg_at_1_max\": 0.07101697112154846,\n        \"nauc_ndcg_at_1_std\": -0.2720158381402068,\n        \"nauc_ndcg_at_20_diff1\": 0.4283767677265797,\n        \"nauc_ndcg_at_20_max\": 0.043394654891873476,\n        \"nauc_ndcg_at_20_std\": -0.3167498438789006,\n        \"nauc_ndcg_at_3_diff1\": 0.444387646756086,\n        \"nauc_ndcg_at_3_max\": 0.039069892868760496,\n        \"nauc_ndcg_at_3_std\": -0.29060607655626514,\n        \"nauc_ndcg_at_5_diff1\": 0.4334668500292305,\n        \"nauc_ndcg_at_5_max\": 0.022543720407902403,\n        \"nauc_ndcg_at_5_std\": -0.30996646120190485,\n        \"nauc_precision_at_1000_diff1\": -0.07809179169050465,\n        \"nauc_precision_at_1000_max\": 0.15769782136238175,\n        \"nauc_precision_at_1000_std\": 0.0632262670206087,\n        \"nauc_precision_at_100_diff1\": -0.03266071890007152,\n        \"nauc_precision_at_100_max\": 0.17990596259954394,\n        \"nauc_precision_at_100_std\": 0.042071449268137315,\n        \"nauc_precision_at_10_diff1\": 0.1969497261484465,\n        \"nauc_precision_at_10_max\": 0.041005225200070675,\n        \"nauc_precision_at_10_std\": -0.315577687963074,\n        \"nauc_precision_at_1_diff1\": 0.523765306788138,\n        \"nauc_precision_at_1_max\": 0.07101697112154846,\n        \"nauc_precision_at_1_std\": -0.2720158381402068,\n        \"nauc_precision_at_20_diff1\": 0.157261472122755,\n        \"nauc_precision_at_20_max\": 0.07202715790374091,\n        \"nauc_precision_at_20_std\": -0.25184817016670064,\n        \"nauc_precision_at_3_diff1\": 0.27458187398964146,\n        \"nauc_precision_at_3_max\": 0.06826016185057171,\n        \"nauc_precision_at_3_std\": -0.2858467909073881,\n        \"nauc_precision_at_5_diff1\": 0.2344017397441233,\n        \"nauc_precision_at_5_max\": 0.024898959077200182,\n        \"nauc_precision_at_5_std\": -0.31566360786536113,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.1511433306946275,\n        \"nauc_recall_at_100_max\": 0.22028163178567373,\n        \"nauc_recall_at_100_std\": 0.028221514320504418,\n        \"nauc_recall_at_10_diff1\": 0.35766545994972215,\n        \"nauc_recall_at_10_max\": 0.015348344799469206,\n        \"nauc_recall_at_10_std\": -0.3570225338139556,\n        \"nauc_recall_at_1_diff1\": 0.5581508907427222,\n        \"nauc_recall_at_1_max\": 0.0333779502484941,\n        \"nauc_recall_at_1_std\": -0.2292104531599672,\n        \"nauc_recall_at_20_diff1\": 0.34682430009895354,\n        \"nauc_recall_at_20_max\": 0.05228464701534023,\n        \"nauc_recall_at_20_std\": -0.3241105035389205,\n        \"nauc_recall_at_3_diff1\": 0.4024982484586635,\n        \"nauc_recall_at_3_max\": 0.022559669627852694,\n        \"nauc_recall_at_3_std\": -0.2846336396017293,\n        \"nauc_recall_at_5_diff1\": 0.37282768111220693,\n        \"nauc_recall_at_5_max\": -0.009473898791724066,\n        \"nauc_recall_at_5_std\": -0.31952254883598674,\n        \"ndcg_at_1\": 0.27524,\n        \"ndcg_at_10\": 0.37352,\n        \"ndcg_at_100\": 0.44766,\n        \"ndcg_at_1000\": 0.47325,\n        \"ndcg_at_20\": 0.3975,\n        \"ndcg_at_3\": 0.3106,\n        \"ndcg_at_5\": 0.33838,\n        \"precision_at_1\": 0.27524,\n        \"precision_at_10\": 0.08274,\n        \"precision_at_100\": 0.01391,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.04886,\n        \"precision_at_3\": 0.17644,\n        \"precision_at_5\": 0.13127,\n        \"recall_at_1\": 0.19463,\n        \"recall_at_10\": 0.49377,\n        \"recall_at_100\": 0.81522,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.57375,\n        \"recall_at_3\": 0.33201,\n        \"recall_at_5\": 0.39823\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/intfloat/multilingual-e5-large-instruct/intfloat__multilingual-e5-large-instruct/baa7be480a7de1539afce709c8f13f833a510e0a/model_meta.json",
    "content": "{\"name\": \"intfloat/multilingual-e5-large-instruct\", \"revision\": \"baa7be480a7de1539afce709c8f13f833a510e0a\", \"release_date\": \"2024-02-08\", \"languages\": [\"afr_Latn\", \"amh_Latn\", \"ara_Latn\", \"asm_Latn\", \"aze_Latn\", \"bel_Latn\", \"bul_Latn\", \"ben_Latn\", \"ben_Beng\", \"bre_Latn\", \"bos_Latn\", \"cat_Latn\", \"ces_Latn\", \"cym_Latn\", \"dan_Latn\", \"deu_Latn\", \"ell_Latn\", \"eng_Latn\", \"epo_Latn\", \"spa_Latn\", \"est_Latn\", \"eus_Latn\", \"fas_Latn\", \"fin_Latn\", \"fra_Latn\", \"fry_Latn\", \"gle_Latn\", \"gla_Latn\", \"glg_Latn\", \"guj_Latn\", \"hau_Latn\", \"heb_Latn\", \"hin_Latn\", \"hin_Deva\", \"hrv_Latn\", \"hun_Latn\", \"hye_Latn\", \"ind_Latn\", \"isl_Latn\", \"ita_Latn\", \"jpn_Latn\", \"jav_Latn\", \"kat_Latn\", \"kaz_Latn\", \"khm_Latn\", \"kan_Latn\", \"kor_Latn\", \"kur_Latn\", \"kir_Latn\", \"lat_Latn\", \"lao_Latn\", \"lit_Latn\", \"lav_Latn\", \"mlg_Latn\", \"mkd_Latn\", \"mal_Latn\", \"mon_Latn\", \"mar_Latn\", \"msa_Latn\", \"mya_Latn\", \"nep_Latn\", \"nld_Latn\", \"nob_Latn\", \"orm_Latn\", \"ori_Latn\", \"pan_Latn\", \"pol_Latn\", \"pus_Latn\", \"por_Latn\", \"ron_Latn\", \"rus_Latn\", \"san_Latn\", \"snd_Latn\", \"sin_Latn\", \"slk_Latn\", \"slv_Latn\", \"som_Latn\", \"sqi_Latn\", \"srp_Latn\", \"sun_Latn\", \"swe_Latn\", \"swa_Latn\", \"tam_Latn\", \"tam_Taml\", \"tel_Latn\", \"tel_Telu\", \"tha_Latn\", \"tgl_Latn\", \"tur_Latn\", \"uig_Latn\", \"ukr_Latn\", \"urd_Latn\", \"urd_Arab\", \"uzb_Latn\", \"vie_Latn\", \"xho_Latn\", \"yid_Latn\", \"zho_Hant\", \"zho_Hans\"], \"n_parameters\": 560000000, \"memory_usage\": null, \"max_tokens\": 514, \"embed_dim\": 1024, \"license\": \"mit\", \"open_weights\": true, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"GritLM\", \"PyTorch\"], \"reference\": \"https://huggingface.co/intfloat/multilingual-e5-large-instruct\", \"similarity_fn_name\": \"cosine\", \"use_instructions\": true, \"zero_shot_benchmarks\": null, \"loader\": \"instruct_wrapper\"}"
  },
  {
    "path": "eval/results/jhgan/ko-sroberta-multitask/jhgan__ko-sroberta-multitask/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 1.926253318786621,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.58332,\n        \"map_at_1\": 0.4386,\n        \"map_at_10\": 0.53697,\n        \"map_at_100\": 0.54586,\n        \"map_at_1000\": 0.54614,\n        \"map_at_20\": 0.54221,\n        \"map_at_3\": 0.51608,\n        \"map_at_5\": 0.53056,\n        \"mrr_at_1\": 0.43859649122807015,\n        \"mrr_at_10\": 0.5369743803954331,\n        \"mrr_at_100\": 0.5458626227782769,\n        \"mrr_at_1000\": 0.5461427541033771,\n        \"mrr_at_20\": 0.5422120953763044,\n        \"mrr_at_3\": 0.5160818713450293,\n        \"mrr_at_5\": 0.5305555555555557,\n        \"nauc_map_at_1000_diff1\": 0.5517346332846484,\n        \"nauc_map_at_1000_max\": 0.3738554420856829,\n        \"nauc_map_at_1000_std\": -0.041467320778462574,\n        \"nauc_map_at_100_diff1\": 0.5517907504543731,\n        \"nauc_map_at_100_max\": 0.37428072978767696,\n        \"nauc_map_at_100_std\": -0.04094065029665378,\n        \"nauc_map_at_10_diff1\": 0.5437860017629315,\n        \"nauc_map_at_10_max\": 0.37427453041429154,\n        \"nauc_map_at_10_std\": -0.043857670246423446,\n        \"nauc_map_at_1_diff1\": 0.6202229707603372,\n        \"nauc_map_at_1_max\": 0.34550605993013117,\n        \"nauc_map_at_1_std\": -0.06910356233222696,\n        \"nauc_map_at_20_diff1\": 0.5507431969965568,\n        \"nauc_map_at_20_max\": 0.37486396950221434,\n        \"nauc_map_at_20_std\": -0.044013189768391754,\n        \"nauc_map_at_3_diff1\": 0.550991292328967,\n        \"nauc_map_at_3_max\": 0.36829768923991496,\n        \"nauc_map_at_3_std\": -0.029483143290972333,\n        \"nauc_map_at_5_diff1\": 0.5436380533907215,\n        \"nauc_map_at_5_max\": 0.3612882940446798,\n        \"nauc_map_at_5_std\": -0.04342390129159417,\n        \"nauc_mrr_at_1000_diff1\": 0.5517346332846484,\n        \"nauc_mrr_at_1000_max\": 0.3738554420856829,\n        \"nauc_mrr_at_1000_std\": -0.041467320778462574,\n        \"nauc_mrr_at_100_diff1\": 0.5517907504543731,\n        \"nauc_mrr_at_100_max\": 0.37428072978767696,\n        \"nauc_mrr_at_100_std\": -0.04094065029665378,\n        \"nauc_mrr_at_10_diff1\": 0.5437860017629315,\n        \"nauc_mrr_at_10_max\": 0.37427453041429154,\n        \"nauc_mrr_at_10_std\": -0.043857670246423446,\n        \"nauc_mrr_at_1_diff1\": 0.6202229707603372,\n        \"nauc_mrr_at_1_max\": 0.34550605993013117,\n        \"nauc_mrr_at_1_std\": -0.06910356233222696,\n        \"nauc_mrr_at_20_diff1\": 0.5507431969965568,\n        \"nauc_mrr_at_20_max\": 0.37486396950221434,\n        \"nauc_mrr_at_20_std\": -0.044013189768391754,\n        \"nauc_mrr_at_3_diff1\": 0.550991292328967,\n        \"nauc_mrr_at_3_max\": 0.36829768923991496,\n        \"nauc_mrr_at_3_std\": -0.029483143290972333,\n        \"nauc_mrr_at_5_diff1\": 0.5436380533907215,\n        \"nauc_mrr_at_5_max\": 0.3612882940446798,\n        \"nauc_mrr_at_5_std\": -0.04342390129159417,\n        \"nauc_ndcg_at_1000_diff1\": 0.541609472661349,\n        \"nauc_ndcg_at_1000_max\": 0.385806640077638,\n        \"nauc_ndcg_at_1000_std\": -0.039003526996751414,\n        \"nauc_ndcg_at_100_diff1\": 0.5430909554997655,\n        \"nauc_ndcg_at_100_max\": 0.39736728259191517,\n        \"nauc_ndcg_at_100_std\": -0.023662216602588205,\n        \"nauc_ndcg_at_10_diff1\": 0.5082666270294448,\n        \"nauc_ndcg_at_10_max\": 0.4006411092235243,\n        \"nauc_ndcg_at_10_std\": -0.05061806791160763,\n        \"nauc_ndcg_at_1_diff1\": 0.6202229707603372,\n        \"nauc_ndcg_at_1_max\": 0.34550605993013117,\n        \"nauc_ndcg_at_1_std\": -0.06910356233222696,\n        \"nauc_ndcg_at_20_diff1\": 0.5347847565766581,\n        \"nauc_ndcg_at_20_max\": 0.40239235073804375,\n        \"nauc_ndcg_at_20_std\": -0.05250049718351136,\n        \"nauc_ndcg_at_3_diff1\": 0.5252751824223435,\n        \"nauc_ndcg_at_3_max\": 0.37436810249463026,\n        \"nauc_ndcg_at_3_std\": -0.025330820273204355,\n        \"nauc_ndcg_at_5_diff1\": 0.5100034314502537,\n        \"nauc_ndcg_at_5_max\": 0.3635626974773759,\n        \"nauc_ndcg_at_5_std\": -0.05091061686797668,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 0.5949706437682594,\n        \"nauc_precision_at_100_max\": 0.8249538540540309,\n        \"nauc_precision_at_100_std\": 0.5525122873546001,\n        \"nauc_precision_at_10_diff1\": 0.3623729064886154,\n        \"nauc_precision_at_10_max\": 0.527440761323421,\n        \"nauc_precision_at_10_std\": -0.08346085656775253,\n        \"nauc_precision_at_1_diff1\": 0.6202229707603372,\n        \"nauc_precision_at_1_max\": 0.34550605993013117,\n        \"nauc_precision_at_1_std\": -0.06910356233222696,\n        \"nauc_precision_at_20_diff1\": 0.4845052106706362,\n        \"nauc_precision_at_20_max\": 0.5732796252269216,\n        \"nauc_precision_at_20_std\": -0.10933275275973593,\n        \"nauc_precision_at_3_diff1\": 0.4431620932912698,\n        \"nauc_precision_at_3_max\": 0.3930005010668853,\n        \"nauc_precision_at_3_std\": -0.015383329296425807,\n        \"nauc_precision_at_5_diff1\": 0.3893931298353917,\n        \"nauc_precision_at_5_max\": 0.3706176726143006,\n        \"nauc_precision_at_5_std\": -0.08465041790219158,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.5949706437682629,\n        \"nauc_recall_at_100_max\": 0.8249538540540327,\n        \"nauc_recall_at_100_std\": 0.5525122873545996,\n        \"nauc_recall_at_10_diff1\": 0.3623729064886153,\n        \"nauc_recall_at_10_max\": 0.5274407613234211,\n        \"nauc_recall_at_10_std\": -0.08346085656775215,\n        \"nauc_recall_at_1_diff1\": 0.6202229707603372,\n        \"nauc_recall_at_1_max\": 0.34550605993013117,\n        \"nauc_recall_at_1_std\": -0.06910356233222696,\n        \"nauc_recall_at_20_diff1\": 0.4845052106706359,\n        \"nauc_recall_at_20_max\": 0.5732796252269218,\n        \"nauc_recall_at_20_std\": -0.1093327527597355,\n        \"nauc_recall_at_3_diff1\": 0.44316209329126927,\n        \"nauc_recall_at_3_max\": 0.3930005010668845,\n        \"nauc_recall_at_3_std\": -0.015383329296426449,\n        \"nauc_recall_at_5_diff1\": 0.38939312983539126,\n        \"nauc_recall_at_5_max\": 0.3706176726142997,\n        \"nauc_recall_at_5_std\": -0.08465041790219185,\n        \"ndcg_at_1\": 0.4386,\n        \"ndcg_at_10\": 0.58332,\n        \"ndcg_at_100\": 0.62923,\n        \"ndcg_at_1000\": 0.63615,\n        \"ndcg_at_20\": 0.60298,\n        \"ndcg_at_3\": 0.54125,\n        \"ndcg_at_5\": 0.56692,\n        \"precision_at_1\": 0.4386,\n        \"precision_at_10\": 0.07281,\n        \"precision_at_100\": 0.00947,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04035,\n        \"precision_at_3\": 0.20468,\n        \"precision_at_5\": 0.13509,\n        \"recall_at_1\": 0.4386,\n        \"recall_at_10\": 0.72807,\n        \"recall_at_100\": 0.94737,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.80702,\n        \"recall_at_3\": 0.61404,\n        \"recall_at_5\": 0.67544\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/jhgan/ko-sroberta-multitask/jhgan__ko-sroberta-multitask/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 14.881865978240967,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.81636,\n        \"map_at_1\": 0.71111,\n        \"map_at_10\": 0.78502,\n        \"map_at_100\": 0.78852,\n        \"map_at_1000\": 0.78858,\n        \"map_at_20\": 0.78742,\n        \"map_at_3\": 0.77278,\n        \"map_at_5\": 0.78217,\n        \"mrr_at_1\": 0.7111111111111111,\n        \"mrr_at_10\": 0.785019400352734,\n        \"mrr_at_100\": 0.7885154478476163,\n        \"mrr_at_1000\": 0.7885840708869507,\n        \"mrr_at_20\": 0.7874219215310551,\n        \"mrr_at_3\": 0.7727777777777781,\n        \"mrr_at_5\": 0.782166666666667,\n        \"nauc_map_at_1000_diff1\": 0.7460104277733405,\n        \"nauc_map_at_1000_max\": 0.6691811197505108,\n        \"nauc_map_at_1000_std\": 0.1255105150080002,\n        \"nauc_map_at_100_diff1\": 0.7459543272981454,\n        \"nauc_map_at_100_max\": 0.6691892038435562,\n        \"nauc_map_at_100_std\": 0.12558031284678517,\n        \"nauc_map_at_10_diff1\": 0.7430599248125045,\n        \"nauc_map_at_10_max\": 0.668437348080883,\n        \"nauc_map_at_10_std\": 0.12674252500632405,\n        \"nauc_map_at_1_diff1\": 0.7834916962736507,\n        \"nauc_map_at_1_max\": 0.6615425927456003,\n        \"nauc_map_at_1_std\": 0.09969635627530353,\n        \"nauc_map_at_20_diff1\": 0.7456399948953604,\n        \"nauc_map_at_20_max\": 0.6699521349766611,\n        \"nauc_map_at_20_std\": 0.12686929393460583,\n        \"nauc_map_at_3_diff1\": 0.7412164858825709,\n        \"nauc_map_at_3_max\": 0.6673170148889498,\n        \"nauc_map_at_3_std\": 0.12768602289395178,\n        \"nauc_map_at_5_diff1\": 0.7415733714008201,\n        \"nauc_map_at_5_max\": 0.6662297485125583,\n        \"nauc_map_at_5_std\": 0.12559583058273427,\n        \"nauc_mrr_at_1000_diff1\": 0.7460104277733405,\n        \"nauc_mrr_at_1000_max\": 0.6691811197505108,\n        \"nauc_mrr_at_1000_std\": 0.1255105150080002,\n        \"nauc_mrr_at_100_diff1\": 0.7459543272981454,\n        \"nauc_mrr_at_100_max\": 0.6691892038435562,\n        \"nauc_mrr_at_100_std\": 0.12558031284678517,\n        \"nauc_mrr_at_10_diff1\": 0.7430599248125045,\n        \"nauc_mrr_at_10_max\": 0.668437348080883,\n        \"nauc_mrr_at_10_std\": 0.12674252500632405,\n        \"nauc_mrr_at_1_diff1\": 0.7834916962736507,\n        \"nauc_mrr_at_1_max\": 0.6615425927456003,\n        \"nauc_mrr_at_1_std\": 0.09969635627530353,\n        \"nauc_mrr_at_20_diff1\": 0.7456399948953604,\n        \"nauc_mrr_at_20_max\": 0.6699521349766611,\n        \"nauc_mrr_at_20_std\": 0.12686929393460583,\n        \"nauc_mrr_at_3_diff1\": 0.7412164858825709,\n        \"nauc_mrr_at_3_max\": 0.6673170148889498,\n        \"nauc_mrr_at_3_std\": 0.12768602289395178,\n        \"nauc_mrr_at_5_diff1\": 0.7415733714008201,\n        \"nauc_mrr_at_5_max\": 0.6662297485125583,\n        \"nauc_mrr_at_5_std\": 0.12559583058273427,\n        \"nauc_ndcg_at_1000_diff1\": 0.7403877052308159,\n        \"nauc_ndcg_at_1000_max\": 0.6711504381026011,\n        \"nauc_ndcg_at_1000_std\": 0.13147530447063688,\n        \"nauc_ndcg_at_100_diff1\": 0.7385280349845585,\n        \"nauc_ndcg_at_100_max\": 0.6712436908129258,\n        \"nauc_ndcg_at_100_std\": 0.1322414189580357,\n        \"nauc_ndcg_at_10_diff1\": 0.7273219314921056,\n        \"nauc_ndcg_at_10_max\": 0.6717930792030385,\n        \"nauc_ndcg_at_10_std\": 0.1420570858544101,\n        \"nauc_ndcg_at_1_diff1\": 0.7834916962736507,\n        \"nauc_ndcg_at_1_max\": 0.6615425927456003,\n        \"nauc_ndcg_at_1_std\": 0.09969635627530353,\n        \"nauc_ndcg_at_20_diff1\": 0.7370348876719133,\n        \"nauc_ndcg_at_20_max\": 0.6779629792122771,\n        \"nauc_ndcg_at_20_std\": 0.14419940200337705,\n        \"nauc_ndcg_at_3_diff1\": 0.7242474640949236,\n        \"nauc_ndcg_at_3_max\": 0.667543486664276,\n        \"nauc_ndcg_at_3_std\": 0.14052838438895446,\n        \"nauc_ndcg_at_5_diff1\": 0.7238051330078697,\n        \"nauc_ndcg_at_5_max\": 0.665008106581145,\n        \"nauc_ndcg_at_5_std\": 0.13686426047249073,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.5729458450046719,\n        \"nauc_precision_at_100_max\": 0.6769374416433434,\n        \"nauc_precision_at_100_std\": 0.16938997821350255,\n        \"nauc_precision_at_10_diff1\": 0.631185807656393,\n        \"nauc_precision_at_10_max\": 0.697094871703954,\n        \"nauc_precision_at_10_std\": 0.24538760651939961,\n        \"nauc_precision_at_1_diff1\": 0.7834916962736507,\n        \"nauc_precision_at_1_max\": 0.6615425927456003,\n        \"nauc_precision_at_1_std\": 0.09969635627530353,\n        \"nauc_precision_at_20_diff1\": 0.6812324929971952,\n        \"nauc_precision_at_20_max\": 0.7779271708683456,\n        \"nauc_precision_at_20_std\": 0.33409897292250024,\n        \"nauc_precision_at_3_diff1\": 0.6554203539823014,\n        \"nauc_precision_at_3_max\": 0.6675597632456034,\n        \"nauc_precision_at_3_std\": 0.19331111366509504,\n        \"nauc_precision_at_5_diff1\": 0.6320571924901426,\n        \"nauc_precision_at_5_max\": 0.6564250875736125,\n        \"nauc_precision_at_5_std\": 0.19454705113153592,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.5729458450046645,\n        \"nauc_recall_at_100_max\": 0.6769374416433231,\n        \"nauc_recall_at_100_std\": 0.16938997821351892,\n        \"nauc_recall_at_10_diff1\": 0.631185807656395,\n        \"nauc_recall_at_10_max\": 0.6970948717039557,\n        \"nauc_recall_at_10_std\": 0.24538760651940017,\n        \"nauc_recall_at_1_diff1\": 0.7834916962736507,\n        \"nauc_recall_at_1_max\": 0.6615425927456003,\n        \"nauc_recall_at_1_std\": 0.09969635627530353,\n        \"nauc_recall_at_20_diff1\": 0.6812324929972007,\n        \"nauc_recall_at_20_max\": 0.7779271708683464,\n        \"nauc_recall_at_20_std\": 0.33409897292250357,\n        \"nauc_recall_at_3_diff1\": 0.6554203539822998,\n        \"nauc_recall_at_3_max\": 0.6675597632456036,\n        \"nauc_recall_at_3_std\": 0.1933111136650955,\n        \"nauc_recall_at_5_diff1\": 0.6320571924901449,\n        \"nauc_recall_at_5_max\": 0.6564250875736146,\n        \"nauc_recall_at_5_std\": 0.19454705113153728,\n        \"ndcg_at_1\": 0.71111,\n        \"ndcg_at_10\": 0.81636,\n        \"ndcg_at_100\": 0.83256,\n        \"ndcg_at_1000\": 0.83428,\n        \"ndcg_at_20\": 0.82472,\n        \"ndcg_at_3\": 0.79237,\n        \"ndcg_at_5\": 0.80929,\n        \"precision_at_1\": 0.71111,\n        \"precision_at_10\": 0.09122,\n        \"precision_at_100\": 0.00987,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04722,\n        \"precision_at_3\": 0.28296,\n        \"precision_at_5\": 0.178,\n        \"recall_at_1\": 0.71111,\n        \"recall_at_10\": 0.91222,\n        \"recall_at_100\": 0.98667,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.94444,\n        \"recall_at_3\": 0.84889,\n        \"recall_at_5\": 0.89\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.38503,\n        \"map_at_1\": 0.25111,\n        \"map_at_10\": 0.33623,\n        \"map_at_100\": 0.34861,\n        \"map_at_1000\": 0.34944,\n        \"map_at_20\": 0.34335,\n        \"map_at_3\": 0.3087,\n        \"map_at_5\": 0.32426,\n        \"mrr_at_1\": 0.2511111111111111,\n        \"mrr_at_10\": 0.33623368606701926,\n        \"mrr_at_100\": 0.3486067336694853,\n        \"mrr_at_1000\": 0.3494351883870817,\n        \"mrr_at_20\": 0.34335314480077095,\n        \"mrr_at_3\": 0.3087037037037038,\n        \"mrr_at_5\": 0.3242592592592592,\n        \"nauc_map_at_1000_diff1\": 0.4154567226238162,\n        \"nauc_map_at_1000_max\": 0.4158309147498473,\n        \"nauc_map_at_1000_std\": 0.17888546818703868,\n        \"nauc_map_at_100_diff1\": 0.4152326250614072,\n        \"nauc_map_at_100_max\": 0.41600557985805253,\n        \"nauc_map_at_100_std\": 0.17935211886089916,\n        \"nauc_map_at_10_diff1\": 0.41510374037744324,\n        \"nauc_map_at_10_max\": 0.4157099886442739,\n        \"nauc_map_at_10_std\": 0.1765358033571632,\n        \"nauc_map_at_1_diff1\": 0.4554212032327214,\n        \"nauc_map_at_1_max\": 0.4215474516380579,\n        \"nauc_map_at_1_std\": 0.16045332489371625,\n        \"nauc_map_at_20_diff1\": 0.41400658612862834,\n        \"nauc_map_at_20_max\": 0.4159250228040855,\n        \"nauc_map_at_20_std\": 0.1805880886003614,\n        \"nauc_map_at_3_diff1\": 0.42562381034249075,\n        \"nauc_map_at_3_max\": 0.41471323056725135,\n        \"nauc_map_at_3_std\": 0.16381294055280307,\n        \"nauc_map_at_5_diff1\": 0.4212331205561075,\n        \"nauc_map_at_5_max\": 0.41586765905095485,\n        \"nauc_map_at_5_std\": 0.17257668694334635,\n        \"nauc_mrr_at_1000_diff1\": 0.4154567226238162,\n        \"nauc_mrr_at_1000_max\": 0.4158309147498473,\n        \"nauc_mrr_at_1000_std\": 0.17888546818703868,\n        \"nauc_mrr_at_100_diff1\": 0.4152326250614072,\n        \"nauc_mrr_at_100_max\": 0.41600557985805253,\n        \"nauc_mrr_at_100_std\": 0.17935211886089916,\n        \"nauc_mrr_at_10_diff1\": 0.41510374037744324,\n        \"nauc_mrr_at_10_max\": 0.4157099886442739,\n        \"nauc_mrr_at_10_std\": 0.1765358033571632,\n        \"nauc_mrr_at_1_diff1\": 0.4554212032327214,\n        \"nauc_mrr_at_1_max\": 0.4215474516380579,\n        \"nauc_mrr_at_1_std\": 0.16045332489371625,\n        \"nauc_mrr_at_20_diff1\": 0.41400658612862834,\n        \"nauc_mrr_at_20_max\": 0.4159250228040855,\n        \"nauc_mrr_at_20_std\": 0.1805880886003614,\n        \"nauc_mrr_at_3_diff1\": 0.42562381034249075,\n        \"nauc_mrr_at_3_max\": 0.41471323056725135,\n        \"nauc_mrr_at_3_std\": 0.16381294055280307,\n        \"nauc_mrr_at_5_diff1\": 0.4212331205561075,\n        \"nauc_mrr_at_5_max\": 0.41586765905095485,\n        \"nauc_mrr_at_5_std\": 0.17257668694334635,\n        \"nauc_ndcg_at_1000_diff1\": 0.4059833739794044,\n        \"nauc_ndcg_at_1000_max\": 0.4159984209283889,\n        \"nauc_ndcg_at_1000_std\": 0.18892348858073468,\n        \"nauc_ndcg_at_100_diff1\": 0.4004914557560742,\n        \"nauc_ndcg_at_100_max\": 0.42053802814260877,\n        \"nauc_ndcg_at_100_std\": 0.20103630157858776,\n        \"nauc_ndcg_at_10_diff1\": 0.39660555776825546,\n        \"nauc_ndcg_at_10_max\": 0.4147810458283918,\n        \"nauc_ndcg_at_10_std\": 0.19015467037702996,\n        \"nauc_ndcg_at_1_diff1\": 0.4554212032327214,\n        \"nauc_ndcg_at_1_max\": 0.4215474516380579,\n        \"nauc_ndcg_at_1_std\": 0.16045332489371625,\n        \"nauc_ndcg_at_20_diff1\": 0.39183960842200916,\n        \"nauc_ndcg_at_20_max\": 0.4164531901222306,\n        \"nauc_ndcg_at_20_std\": 0.20561997894391823,\n        \"nauc_ndcg_at_3_diff1\": 0.4183527595068305,\n        \"nauc_ndcg_at_3_max\": 0.41205328463590385,\n        \"nauc_ndcg_at_3_std\": 0.16473954554940762,\n        \"nauc_ndcg_at_5_diff1\": 0.41106019452382037,\n        \"nauc_ndcg_at_5_max\": 0.414430081220993,\n        \"nauc_ndcg_at_5_std\": 0.1798219427802208,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.3173059058716875,\n        \"nauc_precision_at_100_max\": 0.48874488150355705,\n        \"nauc_precision_at_100_std\": 0.3851970481788937,\n        \"nauc_precision_at_10_diff1\": 0.3379013591127392,\n        \"nauc_precision_at_10_max\": 0.4135948408179432,\n        \"nauc_precision_at_10_std\": 0.2362789028073475,\n        \"nauc_precision_at_1_diff1\": 0.4554212032327214,\n        \"nauc_precision_at_1_max\": 0.4215474516380579,\n        \"nauc_precision_at_1_std\": 0.16045332489371625,\n        \"nauc_precision_at_20_diff1\": 0.3074462375210219,\n        \"nauc_precision_at_20_max\": 0.4227394711418037,\n        \"nauc_precision_at_20_std\": 0.31148602712276796,\n        \"nauc_precision_at_3_diff1\": 0.3991111406019204,\n        \"nauc_precision_at_3_max\": 0.4046560538220088,\n        \"nauc_precision_at_3_std\": 0.16723019756277682,\n        \"nauc_precision_at_5_diff1\": 0.38311471951228393,\n        \"nauc_precision_at_5_max\": 0.410868853532377,\n        \"nauc_precision_at_5_std\": 0.2013298704322076,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.3173059058716864,\n        \"nauc_recall_at_100_max\": 0.4887448815035555,\n        \"nauc_recall_at_100_std\": 0.3851970481788933,\n        \"nauc_recall_at_10_diff1\": 0.33790135911273933,\n        \"nauc_recall_at_10_max\": 0.4135948408179429,\n        \"nauc_recall_at_10_std\": 0.23627890280734765,\n        \"nauc_recall_at_1_diff1\": 0.4554212032327214,\n        \"nauc_recall_at_1_max\": 0.4215474516380579,\n        \"nauc_recall_at_1_std\": 0.16045332489371625,\n        \"nauc_recall_at_20_diff1\": 0.3074462375210217,\n        \"nauc_recall_at_20_max\": 0.4227394711418042,\n        \"nauc_recall_at_20_std\": 0.311486027122768,\n        \"nauc_recall_at_3_diff1\": 0.3991111406019202,\n        \"nauc_recall_at_3_max\": 0.4046560538220091,\n        \"nauc_recall_at_3_std\": 0.1672301975627768,\n        \"nauc_recall_at_5_diff1\": 0.3831147195122837,\n        \"nauc_recall_at_5_max\": 0.41086885353237734,\n        \"nauc_recall_at_5_std\": 0.2013298704322081,\n        \"ndcg_at_1\": 0.25111,\n        \"ndcg_at_10\": 0.38503,\n        \"ndcg_at_100\": 0.44957,\n        \"ndcg_at_1000\": 0.46889,\n        \"ndcg_at_20\": 0.41091,\n        \"ndcg_at_3\": 0.32758,\n        \"ndcg_at_5\": 0.35555,\n        \"precision_at_1\": 0.25111,\n        \"precision_at_10\": 0.05422,\n        \"precision_at_100\": 0.00854,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.03222,\n        \"precision_at_3\": 0.12741,\n        \"precision_at_5\": 0.09,\n        \"recall_at_1\": 0.25111,\n        \"recall_at_10\": 0.54222,\n        \"recall_at_100\": 0.85444,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.64444,\n        \"recall_at_3\": 0.38222,\n        \"recall_at_5\": 0.45\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.57379,\n        \"map_at_1\": 0.41556,\n        \"map_at_10\": 0.5192,\n        \"map_at_100\": 0.52712,\n        \"map_at_1000\": 0.52746,\n        \"map_at_20\": 0.52356,\n        \"map_at_3\": 0.48759,\n        \"map_at_5\": 0.5087,\n        \"mrr_at_1\": 0.41555555555555557,\n        \"mrr_at_10\": 0.5191979717813047,\n        \"mrr_at_100\": 0.5271212900559807,\n        \"mrr_at_1000\": 0.5274581721766388,\n        \"mrr_at_20\": 0.5235614299223684,\n        \"mrr_at_3\": 0.4875925925925923,\n        \"mrr_at_5\": 0.5087037037037031,\n        \"nauc_map_at_1000_diff1\": 0.5585832359996836,\n        \"nauc_map_at_1000_max\": 0.3777517058797167,\n        \"nauc_map_at_1000_std\": 0.10864198894559263,\n        \"nauc_map_at_100_diff1\": 0.5583640887580703,\n        \"nauc_map_at_100_max\": 0.3778017746569433,\n        \"nauc_map_at_100_std\": 0.10892037540374716,\n        \"nauc_map_at_10_diff1\": 0.5568130166322439,\n        \"nauc_map_at_10_max\": 0.37526350602597447,\n        \"nauc_map_at_10_std\": 0.10705131891830384,\n        \"nauc_map_at_1_diff1\": 0.6112996413770887,\n        \"nauc_map_at_1_max\": 0.3748486565301294,\n        \"nauc_map_at_1_std\": 0.07824565238022668,\n        \"nauc_map_at_20_diff1\": 0.5571447630522545,\n        \"nauc_map_at_20_max\": 0.37715294322911946,\n        \"nauc_map_at_20_std\": 0.10884717375853395,\n        \"nauc_map_at_3_diff1\": 0.5601493741691581,\n        \"nauc_map_at_3_max\": 0.3785858586871427,\n        \"nauc_map_at_3_std\": 0.10364894814143376,\n        \"nauc_map_at_5_diff1\": 0.5586379573886199,\n        \"nauc_map_at_5_max\": 0.3782769675070838,\n        \"nauc_map_at_5_std\": 0.10784039363976371,\n        \"nauc_mrr_at_1000_diff1\": 0.5585832359996836,\n        \"nauc_mrr_at_1000_max\": 0.3777517058797167,\n        \"nauc_mrr_at_1000_std\": 0.10864198894559263,\n        \"nauc_mrr_at_100_diff1\": 0.5583640887580703,\n        \"nauc_mrr_at_100_max\": 0.3778017746569433,\n        \"nauc_mrr_at_100_std\": 0.10892037540374716,\n        \"nauc_mrr_at_10_diff1\": 0.5568130166322439,\n        \"nauc_mrr_at_10_max\": 0.37526350602597447,\n        \"nauc_mrr_at_10_std\": 0.10705131891830384,\n        \"nauc_mrr_at_1_diff1\": 0.6112996413770887,\n        \"nauc_mrr_at_1_max\": 0.3748486565301294,\n        \"nauc_mrr_at_1_std\": 0.07824565238022668,\n        \"nauc_mrr_at_20_diff1\": 0.5571447630522545,\n        \"nauc_mrr_at_20_max\": 0.37715294322911946,\n        \"nauc_mrr_at_20_std\": 0.10884717375853395,\n        \"nauc_mrr_at_3_diff1\": 0.5601493741691581,\n        \"nauc_mrr_at_3_max\": 0.3785858586871427,\n        \"nauc_mrr_at_3_std\": 0.10364894814143376,\n        \"nauc_mrr_at_5_diff1\": 0.5586379573886199,\n        \"nauc_mrr_at_5_max\": 0.3782769675070838,\n        \"nauc_mrr_at_5_std\": 0.10784039363976371,\n        \"nauc_ndcg_at_1000_diff1\": 0.5477809675932058,\n        \"nauc_ndcg_at_1000_max\": 0.37861192244266095,\n        \"nauc_ndcg_at_1000_std\": 0.11744180418719868,\n        \"nauc_ndcg_at_100_diff1\": 0.5425101873218164,\n        \"nauc_ndcg_at_100_max\": 0.3798599781503716,\n        \"nauc_ndcg_at_100_std\": 0.12566306929003634,\n        \"nauc_ndcg_at_10_diff1\": 0.5334566852145959,\n        \"nauc_ndcg_at_10_max\": 0.37091057534300936,\n        \"nauc_ndcg_at_10_std\": 0.11898284694817188,\n        \"nauc_ndcg_at_1_diff1\": 0.6112996413770887,\n        \"nauc_ndcg_at_1_max\": 0.3748486565301294,\n        \"nauc_ndcg_at_1_std\": 0.07824565238022668,\n        \"nauc_ndcg_at_20_diff1\": 0.5334288621204861,\n        \"nauc_ndcg_at_20_max\": 0.3768878936587119,\n        \"nauc_ndcg_at_20_std\": 0.12506099443640833,\n        \"nauc_ndcg_at_3_diff1\": 0.5429609926684678,\n        \"nauc_ndcg_at_3_max\": 0.3794746016162753,\n        \"nauc_ndcg_at_3_std\": 0.11178884413936593,\n        \"nauc_ndcg_at_5_diff1\": 0.5394538018456475,\n        \"nauc_ndcg_at_5_max\": 0.37921389986002785,\n        \"nauc_ndcg_at_5_std\": 0.12042972274581841,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.3670186023127206,\n        \"nauc_precision_at_100_max\": 0.4221432162608671,\n        \"nauc_precision_at_100_std\": 0.41216871363930435,\n        \"nauc_precision_at_10_diff1\": 0.43143142452187516,\n        \"nauc_precision_at_10_max\": 0.3472467649603327,\n        \"nauc_precision_at_10_std\": 0.1698648922267003,\n        \"nauc_precision_at_1_diff1\": 0.6112996413770887,\n        \"nauc_precision_at_1_max\": 0.3748486565301294,\n        \"nauc_precision_at_1_std\": 0.07824565238022668,\n        \"nauc_precision_at_20_diff1\": 0.40364263714887605,\n        \"nauc_precision_at_20_max\": 0.3747221128684894,\n        \"nauc_precision_at_20_std\": 0.21668828011022712,\n        \"nauc_precision_at_3_diff1\": 0.4900076623182607,\n        \"nauc_precision_at_3_max\": 0.38209105789789044,\n        \"nauc_precision_at_3_std\": 0.13673463159027632,\n        \"nauc_precision_at_5_diff1\": 0.47218228840184173,\n        \"nauc_precision_at_5_max\": 0.38251136393494295,\n        \"nauc_precision_at_5_std\": 0.1659566162311902,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.3670186023127214,\n        \"nauc_recall_at_100_max\": 0.4221432162608645,\n        \"nauc_recall_at_100_std\": 0.41216871363930163,\n        \"nauc_recall_at_10_diff1\": 0.431431424521877,\n        \"nauc_recall_at_10_max\": 0.3472467649603337,\n        \"nauc_recall_at_10_std\": 0.1698648922267015,\n        \"nauc_recall_at_1_diff1\": 0.6112996413770887,\n        \"nauc_recall_at_1_max\": 0.3748486565301294,\n        \"nauc_recall_at_1_std\": 0.07824565238022668,\n        \"nauc_recall_at_20_diff1\": 0.4036426371488774,\n        \"nauc_recall_at_20_max\": 0.37472211286848983,\n        \"nauc_recall_at_20_std\": 0.21668828011022812,\n        \"nauc_recall_at_3_diff1\": 0.49000766231826093,\n        \"nauc_recall_at_3_max\": 0.38209105789789033,\n        \"nauc_recall_at_3_std\": 0.13673463159027632,\n        \"nauc_recall_at_5_diff1\": 0.47218228840184223,\n        \"nauc_recall_at_5_max\": 0.38251136393494284,\n        \"nauc_recall_at_5_std\": 0.16595661623118982,\n        \"ndcg_at_1\": 0.41556,\n        \"ndcg_at_10\": 0.57379,\n        \"ndcg_at_100\": 0.61458,\n        \"ndcg_at_1000\": 0.62228,\n        \"ndcg_at_20\": 0.58958,\n        \"ndcg_at_3\": 0.51051,\n        \"ndcg_at_5\": 0.54853,\n        \"precision_at_1\": 0.41556,\n        \"precision_at_10\": 0.07467,\n        \"precision_at_100\": 0.00942,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04044,\n        \"precision_at_3\": 0.19222,\n        \"precision_at_5\": 0.13378,\n        \"recall_at_1\": 0.41556,\n        \"recall_at_10\": 0.74667,\n        \"recall_at_100\": 0.94222,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.80889,\n        \"recall_at_3\": 0.57667,\n        \"recall_at_5\": 0.66889\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/jhgan/ko-sroberta-multitask/jhgan__ko-sroberta-multitask/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 20.74926519393921,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.65097,\n        \"map_at_1\": 0.37409,\n        \"map_at_10\": 0.58031,\n        \"map_at_100\": 0.59031,\n        \"map_at_1000\": 0.5909,\n        \"map_at_20\": 0.5873,\n        \"map_at_3\": 0.53023,\n        \"map_at_5\": 0.56176,\n        \"mrr_at_1\": 0.5844594594594594,\n        \"mrr_at_10\": 0.6746159105534107,\n        \"mrr_at_100\": 0.677604599211867,\n        \"mrr_at_1000\": 0.6777892991738226,\n        \"mrr_at_20\": 0.6764324160197807,\n        \"mrr_at_3\": 0.6573761261261261,\n        \"mrr_at_5\": 0.6688626126126125,\n        \"nauc_map_at_1000_diff1\": 0.30437588062635906,\n        \"nauc_map_at_1000_max\": 0.4390854193045797,\n        \"nauc_map_at_1000_std\": 0.14446283271908086,\n        \"nauc_map_at_100_diff1\": 0.30444645347431776,\n        \"nauc_map_at_100_max\": 0.43931312052110805,\n        \"nauc_map_at_100_std\": 0.14435130630753498,\n        \"nauc_map_at_10_diff1\": 0.30418203912088493,\n        \"nauc_map_at_10_max\": 0.4366218414760577,\n        \"nauc_map_at_10_std\": 0.1378511395654776,\n        \"nauc_map_at_1_diff1\": 0.4087465742894733,\n        \"nauc_map_at_1_max\": 0.25766176850386774,\n        \"nauc_map_at_1_std\": 0.055245934886855,\n        \"nauc_map_at_20_diff1\": 0.30456349353261336,\n        \"nauc_map_at_20_max\": 0.4391665415776432,\n        \"nauc_map_at_20_std\": 0.1421171019566587,\n        \"nauc_map_at_3_diff1\": 0.31526050997633975,\n        \"nauc_map_at_3_max\": 0.37018839340712634,\n        \"nauc_map_at_3_std\": 0.08429713272536982,\n        \"nauc_map_at_5_diff1\": 0.3069323555381713,\n        \"nauc_map_at_5_max\": 0.41802740453050763,\n        \"nauc_map_at_5_std\": 0.11909808743170387,\n        \"nauc_mrr_at_1000_diff1\": 0.36515183653248784,\n        \"nauc_mrr_at_1000_max\": 0.48358232224139225,\n        \"nauc_mrr_at_1000_std\": 0.21146982434985648,\n        \"nauc_mrr_at_100_diff1\": 0.36507238696029265,\n        \"nauc_mrr_at_100_max\": 0.4838076218430697,\n        \"nauc_mrr_at_100_std\": 0.2116090849112434,\n        \"nauc_mrr_at_10_diff1\": 0.3665187269649373,\n        \"nauc_mrr_at_10_max\": 0.48677214917328243,\n        \"nauc_mrr_at_10_std\": 0.21174175553184899,\n        \"nauc_mrr_at_1_diff1\": 0.40917227698428543,\n        \"nauc_mrr_at_1_max\": 0.41704874435036265,\n        \"nauc_mrr_at_1_std\": 0.16145322996342915,\n        \"nauc_mrr_at_20_diff1\": 0.36586886928481055,\n        \"nauc_mrr_at_20_max\": 0.48521303884222944,\n        \"nauc_mrr_at_20_std\": 0.21170653563898306,\n        \"nauc_mrr_at_3_diff1\": 0.3675254317772204,\n        \"nauc_mrr_at_3_max\": 0.4654506632776554,\n        \"nauc_mrr_at_3_std\": 0.19152422350584644,\n        \"nauc_mrr_at_5_diff1\": 0.36640859610853055,\n        \"nauc_mrr_at_5_max\": 0.4833872713977703,\n        \"nauc_mrr_at_5_std\": 0.20526088902278128,\n        \"nauc_ndcg_at_1000_diff1\": 0.2932746108713316,\n        \"nauc_ndcg_at_1000_max\": 0.4890279378297942,\n        \"nauc_ndcg_at_1000_std\": 0.21070421679328963,\n        \"nauc_ndcg_at_100_diff1\": 0.29457269198991803,\n        \"nauc_ndcg_at_100_max\": 0.4970625190600618,\n        \"nauc_ndcg_at_100_std\": 0.21366100392466914,\n        \"nauc_ndcg_at_10_diff1\": 0.29879033994280735,\n        \"nauc_ndcg_at_10_max\": 0.4960716816141179,\n        \"nauc_ndcg_at_10_std\": 0.19260925022449377,\n        \"nauc_ndcg_at_1_diff1\": 0.40917227698428543,\n        \"nauc_ndcg_at_1_max\": 0.41704874435036265,\n        \"nauc_ndcg_at_1_std\": 0.16145322996342915,\n        \"nauc_ndcg_at_20_diff1\": 0.29662820381530053,\n        \"nauc_ndcg_at_20_max\": 0.49791452080604626,\n        \"nauc_ndcg_at_20_std\": 0.20205453789312205,\n        \"nauc_ndcg_at_3_diff1\": 0.31592108768743415,\n        \"nauc_ndcg_at_3_max\": 0.4039815215837218,\n        \"nauc_ndcg_at_3_std\": 0.11043780715322889,\n        \"nauc_ndcg_at_5_diff1\": 0.3049782661130862,\n        \"nauc_ndcg_at_5_max\": 0.4628313056055861,\n        \"nauc_ndcg_at_5_std\": 0.1576020257597286,\n        \"nauc_precision_at_1000_diff1\": -0.21147644159242057,\n        \"nauc_precision_at_1000_max\": 0.1475822618299784,\n        \"nauc_precision_at_1000_std\": 0.21746299221018425,\n        \"nauc_precision_at_100_diff1\": -0.15702369326136553,\n        \"nauc_precision_at_100_max\": 0.28589498077169495,\n        \"nauc_precision_at_100_std\": 0.2743788996380555,\n        \"nauc_precision_at_10_diff1\": -0.07291814728827116,\n        \"nauc_precision_at_10_max\": 0.40126112733846653,\n        \"nauc_precision_at_10_std\": 0.2539708185779428,\n        \"nauc_precision_at_1_diff1\": 0.40917227698428543,\n        \"nauc_precision_at_1_max\": 0.41704874435036265,\n        \"nauc_precision_at_1_std\": 0.16145322996342915,\n        \"nauc_precision_at_20_diff1\": -0.1024753137898999,\n        \"nauc_precision_at_20_max\": 0.3563278273399836,\n        \"nauc_precision_at_20_std\": 0.25837994338439596,\n        \"nauc_precision_at_3_diff1\": 0.04041036837743305,\n        \"nauc_precision_at_3_max\": 0.3779530001169553,\n        \"nauc_precision_at_3_std\": 0.1542555866037716,\n        \"nauc_precision_at_5_diff1\": -0.0149201805828455,\n        \"nauc_precision_at_5_max\": 0.41480676647959547,\n        \"nauc_precision_at_5_std\": 0.21427245371226203,\n        \"nauc_recall_at_1000_diff1\": -0.15379458116866024,\n        \"nauc_recall_at_1000_max\": 0.7442018036133632,\n        \"nauc_recall_at_1000_std\": 0.7578319183569155,\n        \"nauc_recall_at_100_diff1\": 0.11383562452978276,\n        \"nauc_recall_at_100_max\": 0.6856710794648846,\n        \"nauc_recall_at_100_std\": 0.4913330834868765,\n        \"nauc_recall_at_10_diff1\": 0.2037742079617328,\n        \"nauc_recall_at_10_max\": 0.596721438173084,\n        \"nauc_recall_at_10_std\": 0.2821691194081661,\n        \"nauc_recall_at_1_diff1\": 0.4087465742894733,\n        \"nauc_recall_at_1_max\": 0.25766176850386774,\n        \"nauc_recall_at_1_std\": 0.055245934886855,\n        \"nauc_recall_at_20_diff1\": 0.17475890305806785,\n        \"nauc_recall_at_20_max\": 0.6203287851827303,\n        \"nauc_recall_at_20_std\": 0.3347291769139317,\n        \"nauc_recall_at_3_diff1\": 0.26487208047481864,\n        \"nauc_recall_at_3_max\": 0.3756905143946326,\n        \"nauc_recall_at_3_std\": 0.08518989523236246,\n        \"nauc_recall_at_5_diff1\": 0.2342458831468749,\n        \"nauc_recall_at_5_max\": 0.5001635759627852,\n        \"nauc_recall_at_5_std\": 0.1804476515557575,\n        \"ndcg_at_1\": 0.58446,\n        \"ndcg_at_10\": 0.65097,\n        \"ndcg_at_100\": 0.68332,\n        \"ndcg_at_1000\": 0.69489,\n        \"ndcg_at_20\": 0.66748,\n        \"ndcg_at_3\": 0.58339,\n        \"ndcg_at_5\": 0.6209,\n        \"precision_at_1\": 0.58446,\n        \"precision_at_10\": 0.13801,\n        \"precision_at_100\": 0.01645,\n        \"precision_at_1000\": 0.00182,\n        \"precision_at_20\": 0.07441,\n        \"precision_at_3\": 0.3491,\n        \"precision_at_5\": 0.24291,\n        \"recall_at_1\": 0.37409,\n        \"recall_at_10\": 0.7541,\n        \"recall_at_100\": 0.87558,\n        \"recall_at_1000\": 0.94941,\n        \"recall_at_20\": 0.80756,\n        \"recall_at_3\": 0.60173,\n        \"recall_at_5\": 0.68135\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/jhgan/ko-sroberta-multitask/jhgan__ko-sroberta-multitask/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 5007.700176239014,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.36698,\n        \"map_at_1\": 0.19445,\n        \"map_at_10\": 0.28928,\n        \"map_at_100\": 0.30966,\n        \"map_at_1000\": 0.31195,\n        \"map_at_20\": 0.29975,\n        \"map_at_3\": 0.24441,\n        \"map_at_5\": 0.27145,\n        \"mrr_at_1\": 0.28169014084507044,\n        \"mrr_at_10\": 0.39602615694165005,\n        \"mrr_at_100\": 0.4042702928182023,\n        \"mrr_at_1000\": 0.40451989571053387,\n        \"mrr_at_20\": 0.40173810805814913,\n        \"mrr_at_3\": 0.3482003129890454,\n        \"mrr_at_5\": 0.3805946791862286,\n        \"nauc_map_at_1000_diff1\": 0.4084812687318048,\n        \"nauc_map_at_1000_max\": 0.29140202294213974,\n        \"nauc_map_at_1000_std\": -0.10630821534195593,\n        \"nauc_map_at_100_diff1\": 0.40742723296453154,\n        \"nauc_map_at_100_max\": 0.28975427407538223,\n        \"nauc_map_at_100_std\": -0.1106351903100884,\n        \"nauc_map_at_10_diff1\": 0.4121116125647296,\n        \"nauc_map_at_10_max\": 0.2894274577639449,\n        \"nauc_map_at_10_std\": -0.12285121600162507,\n        \"nauc_map_at_1_diff1\": 0.4761051522790686,\n        \"nauc_map_at_1_max\": 0.3119569418707627,\n        \"nauc_map_at_1_std\": -0.14522459005957955,\n        \"nauc_map_at_20_diff1\": 0.40590849052549394,\n        \"nauc_map_at_20_max\": 0.28201228278198365,\n        \"nauc_map_at_20_std\": -0.1205107948403296,\n        \"nauc_map_at_3_diff1\": 0.4408380154587492,\n        \"nauc_map_at_3_max\": 0.30494179600376997,\n        \"nauc_map_at_3_std\": -0.1382146965430355,\n        \"nauc_map_at_5_diff1\": 0.41801699399093833,\n        \"nauc_map_at_5_max\": 0.3025665385521116,\n        \"nauc_map_at_5_std\": -0.13301925778263518,\n        \"nauc_mrr_at_1000_diff1\": 0.41134115398046606,\n        \"nauc_mrr_at_1000_max\": 0.3125498108612434,\n        \"nauc_mrr_at_1000_std\": 0.044174739506616,\n        \"nauc_mrr_at_100_diff1\": 0.4111987547500878,\n        \"nauc_mrr_at_100_max\": 0.31258283685850924,\n        \"nauc_mrr_at_100_std\": 0.044483320664040475,\n        \"nauc_mrr_at_10_diff1\": 0.41212585672574054,\n        \"nauc_mrr_at_10_max\": 0.3120882974896019,\n        \"nauc_mrr_at_10_std\": 0.045639875989178576,\n        \"nauc_mrr_at_1_diff1\": 0.45527743554327094,\n        \"nauc_mrr_at_1_max\": 0.32212490304705027,\n        \"nauc_mrr_at_1_std\": -0.03182439808400793,\n        \"nauc_mrr_at_20_diff1\": 0.41136406408372556,\n        \"nauc_mrr_at_20_max\": 0.3134288175021971,\n        \"nauc_mrr_at_20_std\": 0.04672064188547081,\n        \"nauc_mrr_at_3_diff1\": 0.44480535457371284,\n        \"nauc_mrr_at_3_max\": 0.2981907381271467,\n        \"nauc_mrr_at_3_std\": 0.008714004445038616,\n        \"nauc_mrr_at_5_diff1\": 0.4163770936930242,\n        \"nauc_mrr_at_5_max\": 0.3126931142367139,\n        \"nauc_mrr_at_5_std\": 0.026265454008010135,\n        \"nauc_ndcg_at_1000_diff1\": 0.38205007930521095,\n        \"nauc_ndcg_at_1000_max\": 0.3092002379525429,\n        \"nauc_ndcg_at_1000_std\": 0.016782053477124366,\n        \"nauc_ndcg_at_100_diff1\": 0.36866426092238114,\n        \"nauc_ndcg_at_100_max\": 0.2853766989148958,\n        \"nauc_ndcg_at_100_std\": -0.021193940154560918,\n        \"nauc_ndcg_at_10_diff1\": 0.3805717938979542,\n        \"nauc_ndcg_at_10_max\": 0.272095190874917,\n        \"nauc_ndcg_at_10_std\": -0.07059390730970473,\n        \"nauc_ndcg_at_1_diff1\": 0.45527743554327094,\n        \"nauc_ndcg_at_1_max\": 0.32212490304705027,\n        \"nauc_ndcg_at_1_std\": -0.03182439808400793,\n        \"nauc_ndcg_at_20_diff1\": 0.36175602830379566,\n        \"nauc_ndcg_at_20_max\": 0.25454157242306663,\n        \"nauc_ndcg_at_20_std\": -0.06349740896234377,\n        \"nauc_ndcg_at_3_diff1\": 0.43204065984406287,\n        \"nauc_ndcg_at_3_max\": 0.2867720765234763,\n        \"nauc_ndcg_at_3_std\": -0.07158473283164735,\n        \"nauc_ndcg_at_5_diff1\": 0.39748832233752823,\n        \"nauc_ndcg_at_5_max\": 0.29677453559710093,\n        \"nauc_ndcg_at_5_std\": -0.07779659140585396,\n        \"nauc_precision_at_1000_diff1\": 0.021860807014730633,\n        \"nauc_precision_at_1000_max\": 0.1700264921174884,\n        \"nauc_precision_at_1000_std\": 0.5077164288944549,\n        \"nauc_precision_at_100_diff1\": 0.0026157449960968254,\n        \"nauc_precision_at_100_max\": 0.13205715256460054,\n        \"nauc_precision_at_100_std\": 0.4236211729103046,\n        \"nauc_precision_at_10_diff1\": 0.15964955193684693,\n        \"nauc_precision_at_10_max\": 0.14733342867957075,\n        \"nauc_precision_at_10_std\": 0.2156510659448347,\n        \"nauc_precision_at_1_diff1\": 0.45527743554327094,\n        \"nauc_precision_at_1_max\": 0.32212490304705027,\n        \"nauc_precision_at_1_std\": -0.03182439808400793,\n        \"nauc_precision_at_20_diff1\": 0.0701739835664581,\n        \"nauc_precision_at_20_max\": 0.05933737286117831,\n        \"nauc_precision_at_20_std\": 0.265477884150881,\n        \"nauc_precision_at_3_diff1\": 0.37724174833700597,\n        \"nauc_precision_at_3_max\": 0.24736180718912662,\n        \"nauc_precision_at_3_std\": 0.03344389979387605,\n        \"nauc_precision_at_5_diff1\": 0.22976789382336985,\n        \"nauc_precision_at_5_max\": 0.21889460837802935,\n        \"nauc_precision_at_5_std\": 0.10690416667822458,\n        \"nauc_recall_at_1000_diff1\": 0.04980217844861664,\n        \"nauc_recall_at_1000_max\": 0.29036332846210466,\n        \"nauc_recall_at_1000_std\": 0.48176575107864594,\n        \"nauc_recall_at_100_diff1\": 0.12291797709788775,\n        \"nauc_recall_at_100_max\": 0.1316840073623182,\n        \"nauc_recall_at_100_std\": 0.03737203628432888,\n        \"nauc_recall_at_10_diff1\": 0.2600474672179701,\n        \"nauc_recall_at_10_max\": 0.17919696888471337,\n        \"nauc_recall_at_10_std\": -0.08346349816900192,\n        \"nauc_recall_at_1_diff1\": 0.4761051522790686,\n        \"nauc_recall_at_1_max\": 0.3119569418707627,\n        \"nauc_recall_at_1_std\": -0.14522459005957955,\n        \"nauc_recall_at_20_diff1\": 0.16428844908711895,\n        \"nauc_recall_at_20_max\": 0.09292750326518946,\n        \"nauc_recall_at_20_std\": -0.0829316444707036,\n        \"nauc_recall_at_3_diff1\": 0.3765871397580306,\n        \"nauc_recall_at_3_max\": 0.25291263723238044,\n        \"nauc_recall_at_3_std\": -0.1234198085587421,\n        \"nauc_recall_at_5_diff1\": 0.29894607365177606,\n        \"nauc_recall_at_5_max\": 0.25233533039098743,\n        \"nauc_recall_at_5_std\": -0.11015172084505716,\n        \"ndcg_at_1\": 0.28169,\n        \"ndcg_at_10\": 0.36698,\n        \"ndcg_at_100\": 0.44518,\n        \"ndcg_at_1000\": 0.47453,\n        \"ndcg_at_20\": 0.39691,\n        \"ndcg_at_3\": 0.29756,\n        \"ndcg_at_5\": 0.33325,\n        \"precision_at_1\": 0.28169,\n        \"precision_at_10\": 0.09484,\n        \"precision_at_100\": 0.0184,\n        \"precision_at_1000\": 0.00243,\n        \"precision_at_20\": 0.06009,\n        \"precision_at_3\": 0.16432,\n        \"precision_at_5\": 0.14085,\n        \"recall_at_1\": 0.19445,\n        \"recall_at_10\": 0.48427,\n        \"recall_at_100\": 0.7644,\n        \"recall_at_1000\": 0.92632,\n        \"recall_at_20\": 0.57682,\n        \"recall_at_3\": 0.29714,\n        \"recall_at_5\": 0.39071\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/jhgan/ko-sroberta-multitask/jhgan__ko-sroberta-multitask/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 5739.107554197311,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.29475,\n        \"map_at_1\": 0.15994,\n        \"map_at_10\": 0.24016,\n        \"map_at_100\": 0.25386,\n        \"map_at_1000\": 0.2545,\n        \"map_at_20\": 0.24889,\n        \"map_at_3\": 0.21002,\n        \"map_at_5\": 0.22369,\n        \"mrr_at_1\": 0.171021377672209,\n        \"mrr_at_10\": 0.2549004637484446,\n        \"mrr_at_100\": 0.26794031250774775,\n        \"mrr_at_1000\": 0.26847337014089206,\n        \"mrr_at_20\": 0.2639186069456764,\n        \"mrr_at_3\": 0.22525732383214553,\n        \"mrr_at_5\": 0.23867775138558972,\n        \"nauc_map_at_1000_diff1\": 0.2832741558778889,\n        \"nauc_map_at_1000_max\": 0.30161766318839106,\n        \"nauc_map_at_1000_std\": 0.04624985557103702,\n        \"nauc_map_at_100_diff1\": 0.28351451499813074,\n        \"nauc_map_at_100_max\": 0.3017353312134317,\n        \"nauc_map_at_100_std\": 0.046188252226174134,\n        \"nauc_map_at_10_diff1\": 0.2873674844384835,\n        \"nauc_map_at_10_max\": 0.2961876664066545,\n        \"nauc_map_at_10_std\": 0.03522190540459761,\n        \"nauc_map_at_1_diff1\": 0.3532324565822577,\n        \"nauc_map_at_1_max\": 0.31141505949053216,\n        \"nauc_map_at_1_std\": -0.0017967262011835588,\n        \"nauc_map_at_20_diff1\": 0.2834184172144873,\n        \"nauc_map_at_20_max\": 0.3021113046991481,\n        \"nauc_map_at_20_std\": 0.04309878962922,\n        \"nauc_map_at_3_diff1\": 0.29965140104816035,\n        \"nauc_map_at_3_max\": 0.2857684495528775,\n        \"nauc_map_at_3_std\": 0.02136024520165048,\n        \"nauc_map_at_5_diff1\": 0.2900758061449452,\n        \"nauc_map_at_5_max\": 0.2943250232991835,\n        \"nauc_map_at_5_std\": 0.029069130820721243,\n        \"nauc_mrr_at_1000_diff1\": 0.28276618529454395,\n        \"nauc_mrr_at_1000_max\": 0.2912140553907691,\n        \"nauc_mrr_at_1000_std\": 0.03867367679906866,\n        \"nauc_mrr_at_100_diff1\": 0.28295833248122726,\n        \"nauc_mrr_at_100_max\": 0.29122806177171007,\n        \"nauc_mrr_at_100_std\": 0.03849294096824469,\n        \"nauc_mrr_at_10_diff1\": 0.2859160120511703,\n        \"nauc_mrr_at_10_max\": 0.28592697013598267,\n        \"nauc_mrr_at_10_std\": 0.03010924502414894,\n        \"nauc_mrr_at_1_diff1\": 0.35540723505482436,\n        \"nauc_mrr_at_1_max\": 0.29163834385425874,\n        \"nauc_mrr_at_1_std\": 0.0005053015896857002,\n        \"nauc_mrr_at_20_diff1\": 0.28269824716550424,\n        \"nauc_mrr_at_20_max\": 0.2917184843577354,\n        \"nauc_mrr_at_20_std\": 0.03713132895915048,\n        \"nauc_mrr_at_3_diff1\": 0.2977194535633791,\n        \"nauc_mrr_at_3_max\": 0.2784285287605545,\n        \"nauc_mrr_at_3_std\": 0.018894261124117226,\n        \"nauc_mrr_at_5_diff1\": 0.28836334301901656,\n        \"nauc_mrr_at_5_max\": 0.28161635076441177,\n        \"nauc_mrr_at_5_std\": 0.024303594069320034,\n        \"nauc_ndcg_at_1000_diff1\": 0.24307593673364616,\n        \"nauc_ndcg_at_1000_max\": 0.30427955135745827,\n        \"nauc_ndcg_at_1000_std\": 0.09256710826288128,\n        \"nauc_ndcg_at_100_diff1\": 0.2459229848753632,\n        \"nauc_ndcg_at_100_max\": 0.3048337087510945,\n        \"nauc_ndcg_at_100_std\": 0.09015904011893983,\n        \"nauc_ndcg_at_10_diff1\": 0.2614472292832507,\n        \"nauc_ndcg_at_10_max\": 0.293958878411953,\n        \"nauc_ndcg_at_10_std\": 0.050346231843163544,\n        \"nauc_ndcg_at_1_diff1\": 0.35540723505482436,\n        \"nauc_ndcg_at_1_max\": 0.29163834385425874,\n        \"nauc_ndcg_at_1_std\": 0.0005053015896857002,\n        \"nauc_ndcg_at_20_diff1\": 0.2485736870889863,\n        \"nauc_ndcg_at_20_max\": 0.3115124284024338,\n        \"nauc_ndcg_at_20_std\": 0.07518431151250228,\n        \"nauc_ndcg_at_3_diff1\": 0.28398424015189655,\n        \"nauc_ndcg_at_3_max\": 0.27606340962541187,\n        \"nauc_ndcg_at_3_std\": 0.02569983191968628,\n        \"nauc_ndcg_at_5_diff1\": 0.2678088098509297,\n        \"nauc_ndcg_at_5_max\": 0.2866300761568848,\n        \"nauc_ndcg_at_5_std\": 0.03716130547179914,\n        \"nauc_precision_at_1000_diff1\": -0.07783157126497497,\n        \"nauc_precision_at_1000_max\": 0.13358263047313396,\n        \"nauc_precision_at_1000_std\": 0.24496327497755185,\n        \"nauc_precision_at_100_diff1\": 0.017689799956194612,\n        \"nauc_precision_at_100_max\": 0.20403447718635603,\n        \"nauc_precision_at_100_std\": 0.23161778135054684,\n        \"nauc_precision_at_10_diff1\": 0.17140859062943214,\n        \"nauc_precision_at_10_max\": 0.27080895548185246,\n        \"nauc_precision_at_10_std\": 0.1111213686879615,\n        \"nauc_precision_at_1_diff1\": 0.35540723505482436,\n        \"nauc_precision_at_1_max\": 0.29163834385425874,\n        \"nauc_precision_at_1_std\": 0.0005053015896857002,\n        \"nauc_precision_at_20_diff1\": 0.10519977097057016,\n        \"nauc_precision_at_20_max\": 0.30075017277433147,\n        \"nauc_precision_at_20_std\": 0.1781342399350624,\n        \"nauc_precision_at_3_diff1\": 0.24146327962265618,\n        \"nauc_precision_at_3_max\": 0.2445917921216271,\n        \"nauc_precision_at_3_std\": 0.04325814748725382,\n        \"nauc_precision_at_5_diff1\": 0.19315517422178646,\n        \"nauc_precision_at_5_max\": 0.2584422143296543,\n        \"nauc_precision_at_5_std\": 0.06843086536044221,\n        \"nauc_recall_at_1000_diff1\": -0.08690101389912284,\n        \"nauc_recall_at_1000_max\": 0.29308317670098727,\n        \"nauc_recall_at_1000_std\": 0.5138372988334909,\n        \"nauc_recall_at_100_diff1\": 0.08061134719287578,\n        \"nauc_recall_at_100_max\": 0.2971842687439878,\n        \"nauc_recall_at_100_std\": 0.2959580996054577,\n        \"nauc_recall_at_10_diff1\": 0.19210787059840054,\n        \"nauc_recall_at_10_max\": 0.2878230698778371,\n        \"nauc_recall_at_10_std\": 0.08857407115755006,\n        \"nauc_recall_at_1_diff1\": 0.3532324565822577,\n        \"nauc_recall_at_1_max\": 0.31141505949053216,\n        \"nauc_recall_at_1_std\": -0.0017967262011835588,\n        \"nauc_recall_at_20_diff1\": 0.14136043973459164,\n        \"nauc_recall_at_20_max\": 0.34190086037125317,\n        \"nauc_recall_at_20_std\": 0.17748696144241338,\n        \"nauc_recall_at_3_diff1\": 0.24367381453168466,\n        \"nauc_recall_at_3_max\": 0.25134463133508317,\n        \"nauc_recall_at_3_std\": 0.03721642499267232,\n        \"nauc_recall_at_5_diff1\": 0.2099661026221608,\n        \"nauc_recall_at_5_max\": 0.26844222350013386,\n        \"nauc_recall_at_5_std\": 0.05834148443622969,\n        \"ndcg_at_1\": 0.17102,\n        \"ndcg_at_10\": 0.29475,\n        \"ndcg_at_100\": 0.35874,\n        \"ndcg_at_1000\": 0.3762,\n        \"ndcg_at_20\": 0.32582,\n        \"ndcg_at_3\": 0.23167,\n        \"ndcg_at_5\": 0.25587,\n        \"precision_at_1\": 0.17102,\n        \"precision_at_10\": 0.05131,\n        \"precision_at_100\": 0.00853,\n        \"precision_at_1000\": 0.00101,\n        \"precision_at_20\": 0.03242,\n        \"precision_at_3\": 0.10214,\n        \"precision_at_5\": 0.07506,\n        \"recall_at_1\": 0.15994,\n        \"recall_at_10\": 0.4521,\n        \"recall_at_100\": 0.73872,\n        \"recall_at_1000\": 0.8749,\n        \"recall_at_20\": 0.56968,\n        \"recall_at_3\": 0.28029,\n        \"recall_at_5\": 0.3369\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/jhgan/ko-sroberta-multitask/jhgan__ko-sroberta-multitask/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 85.13093566894531,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.20416,\n        \"map_at_1\": 0.135,\n        \"map_at_10\": 0.17894,\n        \"map_at_100\": 0.18859,\n        \"map_at_1000\": 0.18957,\n        \"map_at_20\": 0.18362,\n        \"map_at_3\": 0.1625,\n        \"map_at_5\": 0.1735,\n        \"mrr_at_1\": 0.135,\n        \"mrr_at_10\": 0.17894047619047626,\n        \"mrr_at_100\": 0.18858983326557305,\n        \"mrr_at_1000\": 0.18956992828534505,\n        \"mrr_at_20\": 0.1836249715197084,\n        \"mrr_at_3\": 0.1625,\n        \"mrr_at_5\": 0.1735,\n        \"nauc_map_at_1000_diff1\": 0.28100437217058716,\n        \"nauc_map_at_1000_max\": 0.2448855574076613,\n        \"nauc_map_at_1000_std\": 0.022598480125543625,\n        \"nauc_map_at_100_diff1\": 0.2818682896804877,\n        \"nauc_map_at_100_max\": 0.24413728054766345,\n        \"nauc_map_at_100_std\": 0.022166492634078164,\n        \"nauc_map_at_10_diff1\": 0.28819146637250814,\n        \"nauc_map_at_10_max\": 0.2467101224318175,\n        \"nauc_map_at_10_std\": 0.014691870202771925,\n        \"nauc_map_at_1_diff1\": 0.3201864740929537,\n        \"nauc_map_at_1_max\": 0.25431057957280867,\n        \"nauc_map_at_1_std\": 0.00884444880131574,\n        \"nauc_map_at_20_diff1\": 0.28311700608141116,\n        \"nauc_map_at_20_max\": 0.24345349652236448,\n        \"nauc_map_at_20_std\": 0.018089583525167617,\n        \"nauc_map_at_3_diff1\": 0.27856041375056345,\n        \"nauc_map_at_3_max\": 0.2593722568859576,\n        \"nauc_map_at_3_std\": 0.017636592251666545,\n        \"nauc_map_at_5_diff1\": 0.28811910521569867,\n        \"nauc_map_at_5_max\": 0.25953710224194465,\n        \"nauc_map_at_5_std\": 0.024596692690859713,\n        \"nauc_mrr_at_1000_diff1\": 0.28100437217058716,\n        \"nauc_mrr_at_1000_max\": 0.2448855574076613,\n        \"nauc_mrr_at_1000_std\": 0.022598480125543625,\n        \"nauc_mrr_at_100_diff1\": 0.2818682896804877,\n        \"nauc_mrr_at_100_max\": 0.24413728054766345,\n        \"nauc_mrr_at_100_std\": 0.022166492634078164,\n        \"nauc_mrr_at_10_diff1\": 0.28819146637250814,\n        \"nauc_mrr_at_10_max\": 0.2467101224318175,\n        \"nauc_mrr_at_10_std\": 0.014691870202771925,\n        \"nauc_mrr_at_1_diff1\": 0.3201864740929537,\n        \"nauc_mrr_at_1_max\": 0.25431057957280867,\n        \"nauc_mrr_at_1_std\": 0.00884444880131574,\n        \"nauc_mrr_at_20_diff1\": 0.28311700608141116,\n        \"nauc_mrr_at_20_max\": 0.24345349652236448,\n        \"nauc_mrr_at_20_std\": 0.018089583525167617,\n        \"nauc_mrr_at_3_diff1\": 0.27856041375056345,\n        \"nauc_mrr_at_3_max\": 0.2593722568859576,\n        \"nauc_mrr_at_3_std\": 0.017636592251666545,\n        \"nauc_mrr_at_5_diff1\": 0.28811910521569867,\n        \"nauc_mrr_at_5_max\": 0.25953710224194465,\n        \"nauc_mrr_at_5_std\": 0.024596692690859713,\n        \"nauc_ndcg_at_1000_diff1\": 0.24243284227693745,\n        \"nauc_ndcg_at_1000_max\": 0.2608444179252126,\n        \"nauc_ndcg_at_1000_std\": 0.07399856069567344,\n        \"nauc_ndcg_at_100_diff1\": 0.26198693575850857,\n        \"nauc_ndcg_at_100_max\": 0.23388406296093836,\n        \"nauc_ndcg_at_100_std\": 0.060943683503428735,\n        \"nauc_ndcg_at_10_diff1\": 0.2857293233276634,\n        \"nauc_ndcg_at_10_max\": 0.2343710688976858,\n        \"nauc_ndcg_at_10_std\": 0.013418260645036978,\n        \"nauc_ndcg_at_1_diff1\": 0.3201864740929537,\n        \"nauc_ndcg_at_1_max\": 0.25431057957280867,\n        \"nauc_ndcg_at_1_std\": 0.00884444880131574,\n        \"nauc_ndcg_at_20_diff1\": 0.27044040348149756,\n        \"nauc_ndcg_at_20_max\": 0.22410170866757315,\n        \"nauc_ndcg_at_20_std\": 0.02671959107582927,\n        \"nauc_ndcg_at_3_diff1\": 0.26546702841368613,\n        \"nauc_ndcg_at_3_max\": 0.2592203101653777,\n        \"nauc_ndcg_at_3_std\": 0.02261190025854227,\n        \"nauc_ndcg_at_5_diff1\": 0.2839466403374545,\n        \"nauc_ndcg_at_5_max\": 0.26065311707716504,\n        \"nauc_ndcg_at_5_std\": 0.03478102079103265,\n        \"nauc_precision_at_1000_diff1\": -0.08150677387377493,\n        \"nauc_precision_at_1000_max\": 0.5487801519991193,\n        \"nauc_precision_at_1000_std\": 0.516989756581121,\n        \"nauc_precision_at_100_diff1\": 0.20105868139695682,\n        \"nauc_precision_at_100_max\": 0.22047249593217744,\n        \"nauc_precision_at_100_std\": 0.21731600522357344,\n        \"nauc_precision_at_10_diff1\": 0.28463493514498056,\n        \"nauc_precision_at_10_max\": 0.201947381907077,\n        \"nauc_precision_at_10_std\": 0.007271518500820812,\n        \"nauc_precision_at_1_diff1\": 0.3201864740929537,\n        \"nauc_precision_at_1_max\": 0.25431057957280867,\n        \"nauc_precision_at_1_std\": 0.00884444880131574,\n        \"nauc_precision_at_20_diff1\": 0.2394694094977542,\n        \"nauc_precision_at_20_max\": 0.17202101843387688,\n        \"nauc_precision_at_20_std\": 0.05227644896321772,\n        \"nauc_precision_at_3_diff1\": 0.23210035169215806,\n        \"nauc_precision_at_3_max\": 0.25841549092766,\n        \"nauc_precision_at_3_std\": 0.03581988749145475,\n        \"nauc_precision_at_5_diff1\": 0.2768752365614542,\n        \"nauc_precision_at_5_max\": 0.26370943202986424,\n        \"nauc_precision_at_5_std\": 0.060849172127680186,\n        \"nauc_recall_at_1000_diff1\": -0.08150677387377446,\n        \"nauc_recall_at_1000_max\": 0.5487801519991184,\n        \"nauc_recall_at_1000_std\": 0.5169897565811207,\n        \"nauc_recall_at_100_diff1\": 0.20105868139695665,\n        \"nauc_recall_at_100_max\": 0.22047249593217721,\n        \"nauc_recall_at_100_std\": 0.21731600522357278,\n        \"nauc_recall_at_10_diff1\": 0.2846349351449803,\n        \"nauc_recall_at_10_max\": 0.20194738190707712,\n        \"nauc_recall_at_10_std\": 0.007271518500820617,\n        \"nauc_recall_at_1_diff1\": 0.3201864740929537,\n        \"nauc_recall_at_1_max\": 0.25431057957280867,\n        \"nauc_recall_at_1_std\": 0.00884444880131574,\n        \"nauc_recall_at_20_diff1\": 0.23946940949775433,\n        \"nauc_recall_at_20_max\": 0.17202101843387663,\n        \"nauc_recall_at_20_std\": 0.05227644896321764,\n        \"nauc_recall_at_3_diff1\": 0.23210035169215812,\n        \"nauc_recall_at_3_max\": 0.2584154909276601,\n        \"nauc_recall_at_3_std\": 0.03581988749145466,\n        \"nauc_recall_at_5_diff1\": 0.27687523656145396,\n        \"nauc_recall_at_5_max\": 0.26370943202986435,\n        \"nauc_recall_at_5_std\": 0.0608491721276802,\n        \"ndcg_at_1\": 0.135,\n        \"ndcg_at_10\": 0.20416,\n        \"ndcg_at_100\": 0.25717,\n        \"ndcg_at_1000\": 0.29012,\n        \"ndcg_at_20\": 0.22164,\n        \"ndcg_at_3\": 0.17089,\n        \"ndcg_at_5\": 0.19111,\n        \"precision_at_1\": 0.135,\n        \"precision_at_10\": 0.0285,\n        \"precision_at_100\": 0.00545,\n        \"precision_at_1000\": 0.00082,\n        \"precision_at_20\": 0.01775,\n        \"precision_at_3\": 0.065,\n        \"precision_at_5\": 0.049,\n        \"recall_at_1\": 0.135,\n        \"recall_at_10\": 0.285,\n        \"recall_at_100\": 0.545,\n        \"recall_at_1000\": 0.82,\n        \"recall_at_20\": 0.355,\n        \"recall_at_3\": 0.195,\n        \"recall_at_5\": 0.245\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.21749,\n        \"map_at_1\": 0.15,\n        \"map_at_10\": 0.19059,\n        \"map_at_100\": 0.19693,\n        \"map_at_1000\": 0.19789,\n        \"map_at_20\": 0.1941,\n        \"map_at_3\": 0.17167,\n        \"map_at_5\": 0.18367,\n        \"mrr_at_1\": 0.15,\n        \"mrr_at_10\": 0.19058928571428577,\n        \"mrr_at_100\": 0.19692929063561926,\n        \"mrr_at_1000\": 0.1978932938205996,\n        \"mrr_at_20\": 0.19410260521212538,\n        \"mrr_at_3\": 0.17166666666666663,\n        \"mrr_at_5\": 0.18366666666666664,\n        \"nauc_map_at_1000_diff1\": 0.5218625299201293,\n        \"nauc_map_at_1000_max\": 0.37079832709704313,\n        \"nauc_map_at_1000_std\": 0.009330179985214605,\n        \"nauc_map_at_100_diff1\": 0.5222179195043319,\n        \"nauc_map_at_100_max\": 0.3704980486474256,\n        \"nauc_map_at_100_std\": 0.009062073587896,\n        \"nauc_map_at_10_diff1\": 0.5320962166651869,\n        \"nauc_map_at_10_max\": 0.3681883848210749,\n        \"nauc_map_at_10_std\": 0.0030555217218802477,\n        \"nauc_map_at_1_diff1\": 0.6160870879951618,\n        \"nauc_map_at_1_max\": 0.3586936800725733,\n        \"nauc_map_at_1_std\": -0.047001310351778965,\n        \"nauc_map_at_20_diff1\": 0.5246292934312703,\n        \"nauc_map_at_20_max\": 0.37074115444677463,\n        \"nauc_map_at_20_std\": 0.0036769872659049526,\n        \"nauc_map_at_3_diff1\": 0.5500650589473496,\n        \"nauc_map_at_3_max\": 0.3712530444251005,\n        \"nauc_map_at_3_std\": -0.02759014986305762,\n        \"nauc_map_at_5_diff1\": 0.5332310454698315,\n        \"nauc_map_at_5_max\": 0.3669794799749638,\n        \"nauc_map_at_5_std\": -0.01690970869827071,\n        \"nauc_mrr_at_1000_diff1\": 0.5218625299201293,\n        \"nauc_mrr_at_1000_max\": 0.37079832709704313,\n        \"nauc_mrr_at_1000_std\": 0.009330179985214605,\n        \"nauc_mrr_at_100_diff1\": 0.5222179195043319,\n        \"nauc_mrr_at_100_max\": 0.3704980486474256,\n        \"nauc_mrr_at_100_std\": 0.009062073587896,\n        \"nauc_mrr_at_10_diff1\": 0.5320962166651869,\n        \"nauc_mrr_at_10_max\": 0.3681883848210749,\n        \"nauc_mrr_at_10_std\": 0.0030555217218802477,\n        \"nauc_mrr_at_1_diff1\": 0.6160870879951618,\n        \"nauc_mrr_at_1_max\": 0.3586936800725733,\n        \"nauc_mrr_at_1_std\": -0.047001310351778965,\n        \"nauc_mrr_at_20_diff1\": 0.5246292934312703,\n        \"nauc_mrr_at_20_max\": 0.37074115444677463,\n        \"nauc_mrr_at_20_std\": 0.0036769872659049526,\n        \"nauc_mrr_at_3_diff1\": 0.5500650589473496,\n        \"nauc_mrr_at_3_max\": 0.3712530444251005,\n        \"nauc_mrr_at_3_std\": -0.02759014986305762,\n        \"nauc_mrr_at_5_diff1\": 0.5332310454698315,\n        \"nauc_mrr_at_5_max\": 0.3669794799749638,\n        \"nauc_mrr_at_5_std\": -0.01690970869827071,\n        \"nauc_ndcg_at_1000_diff1\": 0.45623846273278934,\n        \"nauc_ndcg_at_1000_max\": 0.3816000840131088,\n        \"nauc_ndcg_at_1000_std\": 0.07607811884916021,\n        \"nauc_ndcg_at_100_diff1\": 0.4625424763168331,\n        \"nauc_ndcg_at_100_max\": 0.3701486410068145,\n        \"nauc_ndcg_at_100_std\": 0.06926544745696855,\n        \"nauc_ndcg_at_10_diff1\": 0.5033392272393276,\n        \"nauc_ndcg_at_10_max\": 0.3673632410841749,\n        \"nauc_ndcg_at_10_std\": 0.0382763210269878,\n        \"nauc_ndcg_at_1_diff1\": 0.6160870879951618,\n        \"nauc_ndcg_at_1_max\": 0.3586936800725733,\n        \"nauc_ndcg_at_1_std\": -0.047001310351778965,\n        \"nauc_ndcg_at_20_diff1\": 0.4768549616277589,\n        \"nauc_ndcg_at_20_max\": 0.3755630641369249,\n        \"nauc_ndcg_at_20_std\": 0.04045437434263005,\n        \"nauc_ndcg_at_3_diff1\": 0.5310771757487783,\n        \"nauc_ndcg_at_3_max\": 0.37335629078608895,\n        \"nauc_ndcg_at_3_std\": -0.019784525871146607,\n        \"nauc_ndcg_at_5_diff1\": 0.5016003002896496,\n        \"nauc_ndcg_at_5_max\": 0.36466226068816154,\n        \"nauc_ndcg_at_5_std\": -0.0034444712035437866,\n        \"nauc_precision_at_1000_diff1\": 0.13158213158213095,\n        \"nauc_precision_at_1000_max\": 0.479479479479479,\n        \"nauc_precision_at_1000_std\": 0.4335434335434332,\n        \"nauc_precision_at_100_diff1\": 0.28989340439706884,\n        \"nauc_precision_at_100_max\": 0.35896735509660244,\n        \"nauc_precision_at_100_std\": 0.25167221852098587,\n        \"nauc_precision_at_10_diff1\": 0.4385222425145065,\n        \"nauc_precision_at_10_max\": 0.36427719409382264,\n        \"nauc_precision_at_10_std\": 0.12881182313814574,\n        \"nauc_precision_at_1_diff1\": 0.6160870879951618,\n        \"nauc_precision_at_1_max\": 0.3586936800725733,\n        \"nauc_precision_at_1_std\": -0.047001310351778965,\n        \"nauc_precision_at_20_diff1\": 0.35300215189209067,\n        \"nauc_precision_at_20_max\": 0.38977457618222877,\n        \"nauc_precision_at_20_std\": 0.13397496457250815,\n        \"nauc_precision_at_3_diff1\": 0.48228931223764915,\n        \"nauc_precision_at_3_max\": 0.37834194381659647,\n        \"nauc_precision_at_3_std\": 0.0008879560865352576,\n        \"nauc_precision_at_5_diff1\": 0.4219908571928522,\n        \"nauc_precision_at_5_max\": 0.35699964274517537,\n        \"nauc_precision_at_5_std\": 0.030096896257573547,\n        \"nauc_recall_at_1000_diff1\": 0.13158213158213183,\n        \"nauc_recall_at_1000_max\": 0.47947947947947983,\n        \"nauc_recall_at_1000_std\": 0.43354343354343294,\n        \"nauc_recall_at_100_diff1\": 0.28989340439706857,\n        \"nauc_recall_at_100_max\": 0.3589673550966022,\n        \"nauc_recall_at_100_std\": 0.25167221852098587,\n        \"nauc_recall_at_10_diff1\": 0.438522242514506,\n        \"nauc_recall_at_10_max\": 0.3642771940938223,\n        \"nauc_recall_at_10_std\": 0.12881182313814532,\n        \"nauc_recall_at_1_diff1\": 0.6160870879951618,\n        \"nauc_recall_at_1_max\": 0.3586936800725733,\n        \"nauc_recall_at_1_std\": -0.047001310351778965,\n        \"nauc_recall_at_20_diff1\": 0.35300215189209033,\n        \"nauc_recall_at_20_max\": 0.3897745761822284,\n        \"nauc_recall_at_20_std\": 0.13397496457250832,\n        \"nauc_recall_at_3_diff1\": 0.4822893122376495,\n        \"nauc_recall_at_3_max\": 0.3783419438165969,\n        \"nauc_recall_at_3_std\": 0.0008879560865352862,\n        \"nauc_recall_at_5_diff1\": 0.4219908571928522,\n        \"nauc_recall_at_5_max\": 0.35699964274517537,\n        \"nauc_recall_at_5_std\": 0.030096896257573457,\n        \"ndcg_at_1\": 0.15,\n        \"ndcg_at_10\": 0.21749,\n        \"ndcg_at_100\": 0.25537,\n        \"ndcg_at_1000\": 0.28733,\n        \"ndcg_at_20\": 0.23103,\n        \"ndcg_at_3\": 0.17893,\n        \"ndcg_at_5\": 0.20108,\n        \"precision_at_1\": 0.15,\n        \"precision_at_10\": 0.0305,\n        \"precision_at_100\": 0.005,\n        \"precision_at_1000\": 0.00077,\n        \"precision_at_20\": 0.018,\n        \"precision_at_3\": 0.06667,\n        \"precision_at_5\": 0.051,\n        \"recall_at_1\": 0.15,\n        \"recall_at_10\": 0.305,\n        \"recall_at_100\": 0.5,\n        \"recall_at_1000\": 0.765,\n        \"recall_at_20\": 0.36,\n        \"recall_at_3\": 0.2,\n        \"recall_at_5\": 0.255\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/jhgan/ko-sroberta-multitask/jhgan__ko-sroberta-multitask/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 0.5960137844085693,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.69212,\n        \"map_at_1\": 0.51948,\n        \"map_at_10\": 0.62536,\n        \"map_at_100\": 0.63083,\n        \"map_at_1000\": 0.63083,\n        \"map_at_20\": 0.6294,\n        \"map_at_3\": 0.58658,\n        \"map_at_5\": 0.60087,\n        \"mrr_at_1\": 0.5194805194805194,\n        \"mrr_at_10\": 0.6253555967841682,\n        \"mrr_at_100\": 0.6308311676381538,\n        \"mrr_at_1000\": 0.6308311676381538,\n        \"mrr_at_20\": 0.629400037192245,\n        \"mrr_at_3\": 0.5865800865800868,\n        \"mrr_at_5\": 0.600865800865801,\n        \"nauc_map_at_1000_diff1\": 0.5904540290551432,\n        \"nauc_map_at_1000_max\": 0.1705997040097517,\n        \"nauc_map_at_1000_std\": -0.07632464300606626,\n        \"nauc_map_at_100_diff1\": 0.5904540290551432,\n        \"nauc_map_at_100_max\": 0.1705997040097517,\n        \"nauc_map_at_100_std\": -0.07632464300606626,\n        \"nauc_map_at_10_diff1\": 0.5810613919569926,\n        \"nauc_map_at_10_max\": 0.165288215922278,\n        \"nauc_map_at_10_std\": -0.07756012340475889,\n        \"nauc_map_at_1_diff1\": 0.6191580005022813,\n        \"nauc_map_at_1_max\": 0.17833218944439605,\n        \"nauc_map_at_1_std\": -0.09107595840831198,\n        \"nauc_map_at_20_diff1\": 0.5884560790280374,\n        \"nauc_map_at_20_max\": 0.17054182222192502,\n        \"nauc_map_at_20_std\": -0.07343464303680558,\n        \"nauc_map_at_3_diff1\": 0.6090085648305908,\n        \"nauc_map_at_3_max\": 0.19453931071063257,\n        \"nauc_map_at_3_std\": -0.06795354806260433,\n        \"nauc_map_at_5_diff1\": 0.5957441004664911,\n        \"nauc_map_at_5_max\": 0.17021323168919492,\n        \"nauc_map_at_5_std\": -0.08837204248824297,\n        \"nauc_mrr_at_1000_diff1\": 0.5904540290551432,\n        \"nauc_mrr_at_1000_max\": 0.1705997040097517,\n        \"nauc_mrr_at_1000_std\": -0.07632464300606626,\n        \"nauc_mrr_at_100_diff1\": 0.5904540290551432,\n        \"nauc_mrr_at_100_max\": 0.1705997040097517,\n        \"nauc_mrr_at_100_std\": -0.07632464300606626,\n        \"nauc_mrr_at_10_diff1\": 0.5810613919569926,\n        \"nauc_mrr_at_10_max\": 0.165288215922278,\n        \"nauc_mrr_at_10_std\": -0.07756012340475889,\n        \"nauc_mrr_at_1_diff1\": 0.6191580005022813,\n        \"nauc_mrr_at_1_max\": 0.17833218944439605,\n        \"nauc_mrr_at_1_std\": -0.09107595840831198,\n        \"nauc_mrr_at_20_diff1\": 0.5884560790280374,\n        \"nauc_mrr_at_20_max\": 0.17054182222192502,\n        \"nauc_mrr_at_20_std\": -0.07343464303680558,\n        \"nauc_mrr_at_3_diff1\": 0.6090085648305908,\n        \"nauc_mrr_at_3_max\": 0.19453931071063257,\n        \"nauc_mrr_at_3_std\": -0.06795354806260433,\n        \"nauc_mrr_at_5_diff1\": 0.5957441004664911,\n        \"nauc_mrr_at_5_max\": 0.17021323168919492,\n        \"nauc_mrr_at_5_std\": -0.08837204248824297,\n        \"nauc_ndcg_at_1000_diff1\": 0.5832707848906321,\n        \"nauc_ndcg_at_1000_max\": 0.165379178631264,\n        \"nauc_ndcg_at_1000_std\": -0.07407865099638525,\n        \"nauc_ndcg_at_100_diff1\": 0.5832707848906321,\n        \"nauc_ndcg_at_100_max\": 0.165379178631264,\n        \"nauc_ndcg_at_100_std\": -0.07407865099638525,\n        \"nauc_ndcg_at_10_diff1\": 0.5414290115530259,\n        \"nauc_ndcg_at_10_max\": 0.1416500440311118,\n        \"nauc_ndcg_at_10_std\": -0.07114074202061504,\n        \"nauc_ndcg_at_1_diff1\": 0.6191580005022813,\n        \"nauc_ndcg_at_1_max\": 0.17833218944439605,\n        \"nauc_ndcg_at_1_std\": -0.09107595840831198,\n        \"nauc_ndcg_at_20_diff1\": 0.5701308148180418,\n        \"nauc_ndcg_at_20_max\": 0.16441559243571785,\n        \"nauc_ndcg_at_20_std\": -0.05461644829084728,\n        \"nauc_ndcg_at_3_diff1\": 0.606960998871192,\n        \"nauc_ndcg_at_3_max\": 0.19845868240059197,\n        \"nauc_ndcg_at_3_std\": -0.06157170762240057,\n        \"nauc_ndcg_at_5_diff1\": 0.5820742198586897,\n        \"nauc_ndcg_at_5_max\": 0.15190511865290174,\n        \"nauc_ndcg_at_5_std\": -0.10189164153807106,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.13376374524588608,\n        \"nauc_precision_at_10_max\": -0.08900787547969854,\n        \"nauc_precision_at_10_std\": 0.007388603659539997,\n        \"nauc_precision_at_1_diff1\": 0.6191580005022813,\n        \"nauc_precision_at_1_max\": 0.17833218944439605,\n        \"nauc_precision_at_1_std\": -0.09107595840831198,\n        \"nauc_precision_at_20_diff1\": 0.22227871181478126,\n        \"nauc_precision_at_20_max\": 0.1301604202575047,\n        \"nauc_precision_at_20_std\": 0.4627549073276905,\n        \"nauc_precision_at_3_diff1\": 0.6007076905121849,\n        \"nauc_precision_at_3_max\": 0.21083305884213124,\n        \"nauc_precision_at_3_std\": -0.041012324527044994,\n        \"nauc_precision_at_5_diff1\": 0.5262303207900256,\n        \"nauc_precision_at_5_max\": 0.07201028555000641,\n        \"nauc_precision_at_5_std\": -0.16349277608293908,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.13376374524588425,\n        \"nauc_recall_at_10_max\": -0.08900787547969922,\n        \"nauc_recall_at_10_std\": 0.007388603659539275,\n        \"nauc_recall_at_1_diff1\": 0.6191580005022813,\n        \"nauc_recall_at_1_max\": 0.17833218944439605,\n        \"nauc_recall_at_1_std\": -0.09107595840831198,\n        \"nauc_recall_at_20_diff1\": 0.22227871181477624,\n        \"nauc_recall_at_20_max\": 0.13016042025750219,\n        \"nauc_recall_at_20_std\": 0.4627549073276888,\n        \"nauc_recall_at_3_diff1\": 0.6007076905121846,\n        \"nauc_recall_at_3_max\": 0.21083305884213052,\n        \"nauc_recall_at_3_std\": -0.04101232452704562,\n        \"nauc_recall_at_5_diff1\": 0.5262303207900242,\n        \"nauc_recall_at_5_max\": 0.0720102855500049,\n        \"nauc_recall_at_5_std\": -0.16349277608294063,\n        \"ndcg_at_1\": 0.51948,\n        \"ndcg_at_10\": 0.69212,\n        \"ndcg_at_100\": 0.71389,\n        \"ndcg_at_1000\": 0.71389,\n        \"ndcg_at_20\": 0.70581,\n        \"ndcg_at_3\": 0.60931,\n        \"ndcg_at_5\": 0.63556,\n        \"precision_at_1\": 0.51948,\n        \"precision_at_10\": 0.09091,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04805,\n        \"precision_at_3\": 0.22511,\n        \"precision_at_5\": 0.14805,\n        \"recall_at_1\": 0.51948,\n        \"recall_at_10\": 0.90909,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96104,\n        \"recall_at_3\": 0.67532,\n        \"recall_at_5\": 0.74026\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/jhgan/ko-sroberta-multitask/jhgan__ko-sroberta-multitask/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 13.350108623504639,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.27961,\n        \"map_at_1\": 0.16284,\n        \"map_at_10\": 0.23808,\n        \"map_at_100\": 0.25039,\n        \"map_at_1000\": 0.25208,\n        \"map_at_20\": 0.24277,\n        \"map_at_3\": 0.21111,\n        \"map_at_5\": 0.22575,\n        \"mrr_at_1\": 0.22935779816513763,\n        \"mrr_at_10\": 0.28000218435998236,\n        \"mrr_at_100\": 0.2899681942422444,\n        \"mrr_at_1000\": 0.2908827646075394,\n        \"mrr_at_20\": 0.2841006872311016,\n        \"mrr_at_3\": 0.2599388379204893,\n        \"mrr_at_5\": 0.2701070336391437,\n        \"nauc_map_at_1000_diff1\": 0.4214155757637042,\n        \"nauc_map_at_1000_max\": 0.23550404240073378,\n        \"nauc_map_at_1000_std\": -0.19082976954284206,\n        \"nauc_map_at_100_diff1\": 0.4211832097906042,\n        \"nauc_map_at_100_max\": 0.23510982131035243,\n        \"nauc_map_at_100_std\": -0.19112693116109628,\n        \"nauc_map_at_10_diff1\": 0.42491758063652063,\n        \"nauc_map_at_10_max\": 0.23377930427998797,\n        \"nauc_map_at_10_std\": -0.19215120573331193,\n        \"nauc_map_at_1_diff1\": 0.49508894472645903,\n        \"nauc_map_at_1_max\": 0.21200110623130414,\n        \"nauc_map_at_1_std\": -0.16844296221187263,\n        \"nauc_map_at_20_diff1\": 0.42293177758553196,\n        \"nauc_map_at_20_max\": 0.23276599466098036,\n        \"nauc_map_at_20_std\": -0.19372732595358427,\n        \"nauc_map_at_3_diff1\": 0.4391343104593348,\n        \"nauc_map_at_3_max\": 0.2417851004872019,\n        \"nauc_map_at_3_std\": -0.18125653720105458,\n        \"nauc_map_at_5_diff1\": 0.4290256686549028,\n        \"nauc_map_at_5_max\": 0.23842288309676038,\n        \"nauc_map_at_5_std\": -0.18596085451344127,\n        \"nauc_mrr_at_1000_diff1\": 0.4339308328759577,\n        \"nauc_mrr_at_1000_max\": 0.23052512484010262,\n        \"nauc_mrr_at_1000_std\": -0.212731603813038,\n        \"nauc_mrr_at_100_diff1\": 0.4336604877516317,\n        \"nauc_mrr_at_100_max\": 0.2306537175917452,\n        \"nauc_mrr_at_100_std\": -0.21254894869650906,\n        \"nauc_mrr_at_10_diff1\": 0.43651305267929,\n        \"nauc_mrr_at_10_max\": 0.227822365310929,\n        \"nauc_mrr_at_10_std\": -0.2157135899647547,\n        \"nauc_mrr_at_1_diff1\": 0.4779620643287542,\n        \"nauc_mrr_at_1_max\": 0.251649276278888,\n        \"nauc_mrr_at_1_std\": -0.2048346984958598,\n        \"nauc_mrr_at_20_diff1\": 0.4345827687718731,\n        \"nauc_mrr_at_20_max\": 0.22710692119239329,\n        \"nauc_mrr_at_20_std\": -0.21598034826399987,\n        \"nauc_mrr_at_3_diff1\": 0.4432033544402822,\n        \"nauc_mrr_at_3_max\": 0.23478668550178164,\n        \"nauc_mrr_at_3_std\": -0.21090263477523583,\n        \"nauc_mrr_at_5_diff1\": 0.4377288835397934,\n        \"nauc_mrr_at_5_max\": 0.23140937321857954,\n        \"nauc_mrr_at_5_std\": -0.21287979163279244,\n        \"nauc_ndcg_at_1000_diff1\": 0.4068622705032811,\n        \"nauc_ndcg_at_1000_max\": 0.2362348940380059,\n        \"nauc_ndcg_at_1000_std\": -0.19296527934696367,\n        \"nauc_ndcg_at_100_diff1\": 0.3954240766125709,\n        \"nauc_ndcg_at_100_max\": 0.23784433171873276,\n        \"nauc_ndcg_at_100_std\": -0.18906422912246504,\n        \"nauc_ndcg_at_10_diff1\": 0.41014774605731696,\n        \"nauc_ndcg_at_10_max\": 0.2198857724678368,\n        \"nauc_ndcg_at_10_std\": -0.20708819629924666,\n        \"nauc_ndcg_at_1_diff1\": 0.47163133066509216,\n        \"nauc_ndcg_at_1_max\": 0.24733983446418387,\n        \"nauc_ndcg_at_1_std\": -0.20786115681188994,\n        \"nauc_ndcg_at_20_diff1\": 0.40431506990372906,\n        \"nauc_ndcg_at_20_max\": 0.21529530278570344,\n        \"nauc_ndcg_at_20_std\": -0.21132627060527578,\n        \"nauc_ndcg_at_3_diff1\": 0.4303012919013767,\n        \"nauc_ndcg_at_3_max\": 0.23437231251585022,\n        \"nauc_ndcg_at_3_std\": -0.19030054330589352,\n        \"nauc_ndcg_at_5_diff1\": 0.4187378333666249,\n        \"nauc_ndcg_at_5_max\": 0.22940131285810786,\n        \"nauc_ndcg_at_5_std\": -0.19693896936170513,\n        \"nauc_precision_at_1000_diff1\": -0.001251120709928727,\n        \"nauc_precision_at_1000_max\": 0.1408970362643088,\n        \"nauc_precision_at_1000_std\": 0.006519872959041239,\n        \"nauc_precision_at_100_diff1\": 0.11767955785983104,\n        \"nauc_precision_at_100_max\": 0.21887911815573843,\n        \"nauc_precision_at_100_std\": -0.06463301427250882,\n        \"nauc_precision_at_10_diff1\": 0.2566620319642375,\n        \"nauc_precision_at_10_max\": 0.19484544050157246,\n        \"nauc_precision_at_10_std\": -0.20866446979622968,\n        \"nauc_precision_at_1_diff1\": 0.47163133066509216,\n        \"nauc_precision_at_1_max\": 0.24733983446418387,\n        \"nauc_precision_at_1_std\": -0.20786115681188994,\n        \"nauc_precision_at_20_diff1\": 0.22333251838170926,\n        \"nauc_precision_at_20_max\": 0.16681753275124725,\n        \"nauc_precision_at_20_std\": -0.20802685122153342,\n        \"nauc_precision_at_3_diff1\": 0.3222914812111711,\n        \"nauc_precision_at_3_max\": 0.25677046804837805,\n        \"nauc_precision_at_3_std\": -0.1971581914636415,\n        \"nauc_precision_at_5_diff1\": 0.29348323841539453,\n        \"nauc_precision_at_5_max\": 0.2282958661223689,\n        \"nauc_precision_at_5_std\": -0.20241263344179536,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.2608078592841538,\n        \"nauc_recall_at_100_max\": 0.2544835738790891,\n        \"nauc_recall_at_100_std\": -0.12233805846621212,\n        \"nauc_recall_at_10_diff1\": 0.34864154401985253,\n        \"nauc_recall_at_10_max\": 0.179329618645416,\n        \"nauc_recall_at_10_std\": -0.214286105443704,\n        \"nauc_recall_at_1_diff1\": 0.49508894472645903,\n        \"nauc_recall_at_1_max\": 0.21200110623130414,\n        \"nauc_recall_at_1_std\": -0.16844296221187263,\n        \"nauc_recall_at_20_diff1\": 0.3301717345342511,\n        \"nauc_recall_at_20_max\": 0.16383958678364147,\n        \"nauc_recall_at_20_std\": -0.22609209261541532,\n        \"nauc_recall_at_3_diff1\": 0.40434566144584727,\n        \"nauc_recall_at_3_max\": 0.2192093599150267,\n        \"nauc_recall_at_3_std\": -0.18206254394044408,\n        \"nauc_recall_at_5_diff1\": 0.3756229824887185,\n        \"nauc_recall_at_5_max\": 0.20583583054847093,\n        \"nauc_recall_at_5_std\": -0.19328068106011442,\n        \"ndcg_at_1\": 0.23089,\n        \"ndcg_at_10\": 0.27961,\n        \"ndcg_at_100\": 0.34801,\n        \"ndcg_at_1000\": 0.39067,\n        \"ndcg_at_20\": 0.2953,\n        \"ndcg_at_3\": 0.23296,\n        \"ndcg_at_5\": 0.25242,\n        \"precision_at_1\": 0.23089,\n        \"precision_at_10\": 0.05749,\n        \"precision_at_100\": 0.01095,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.03364,\n        \"precision_at_3\": 0.12538,\n        \"precision_at_5\": 0.09113,\n        \"recall_at_1\": 0.16284,\n        \"recall_at_10\": 0.36318,\n        \"recall_at_100\": 0.67806,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.41723,\n        \"recall_at_3\": 0.2395,\n        \"recall_at_5\": 0.28619\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.1836,\n        \"map_at_1\": 0.08759,\n        \"map_at_10\": 0.14392,\n        \"map_at_100\": 0.15878,\n        \"map_at_1000\": 0.16133,\n        \"map_at_20\": 0.15078,\n        \"map_at_3\": 0.12174,\n        \"map_at_5\": 0.13335,\n        \"mrr_at_1\": 0.15137614678899083,\n        \"mrr_at_10\": 0.20600759671860588,\n        \"mrr_at_100\": 0.2157491629989898,\n        \"mrr_at_1000\": 0.21708576403816518,\n        \"mrr_at_20\": 0.21068637974846255,\n        \"mrr_at_3\": 0.18603465851172268,\n        \"mrr_at_5\": 0.19589704383282366,\n        \"nauc_map_at_1000_diff1\": 0.3323837585455884,\n        \"nauc_map_at_1000_max\": 0.14303424039470392,\n        \"nauc_map_at_1000_std\": -0.019450779897357603,\n        \"nauc_map_at_100_diff1\": 0.33238455031441677,\n        \"nauc_map_at_100_max\": 0.1420330658354713,\n        \"nauc_map_at_100_std\": -0.020605907819890888,\n        \"nauc_map_at_10_diff1\": 0.33895092286545214,\n        \"nauc_map_at_10_max\": 0.14064565959195846,\n        \"nauc_map_at_10_std\": -0.03210504177476584,\n        \"nauc_map_at_1_diff1\": 0.4190187012199572,\n        \"nauc_map_at_1_max\": 0.15134792821012716,\n        \"nauc_map_at_1_std\": -0.04697241262575727,\n        \"nauc_map_at_20_diff1\": 0.3338336698929536,\n        \"nauc_map_at_20_max\": 0.13920479083694737,\n        \"nauc_map_at_20_std\": -0.027631683392214904,\n        \"nauc_map_at_3_diff1\": 0.3629507638191468,\n        \"nauc_map_at_3_max\": 0.16126202951274413,\n        \"nauc_map_at_3_std\": -0.02681843523976257,\n        \"nauc_map_at_5_diff1\": 0.3465080154020162,\n        \"nauc_map_at_5_max\": 0.1419158062834336,\n        \"nauc_map_at_5_std\": -0.03513882062880755,\n        \"nauc_mrr_at_1000_diff1\": 0.3165662315528989,\n        \"nauc_mrr_at_1000_max\": 0.10440424338855178,\n        \"nauc_mrr_at_1000_std\": -0.03650895468546071,\n        \"nauc_mrr_at_100_diff1\": 0.3162235285389014,\n        \"nauc_mrr_at_100_max\": 0.10451230472237277,\n        \"nauc_mrr_at_100_std\": -0.03624916629178117,\n        \"nauc_mrr_at_10_diff1\": 0.3181664664556047,\n        \"nauc_mrr_at_10_max\": 0.0959551433749828,\n        \"nauc_mrr_at_10_std\": -0.04665592310685699,\n        \"nauc_mrr_at_1_diff1\": 0.401585102884664,\n        \"nauc_mrr_at_1_max\": 0.1326972078174377,\n        \"nauc_mrr_at_1_std\": -0.05207300122030268,\n        \"nauc_mrr_at_20_diff1\": 0.3163325090017384,\n        \"nauc_mrr_at_20_max\": 0.10160977429351967,\n        \"nauc_mrr_at_20_std\": -0.0400209730294806,\n        \"nauc_mrr_at_3_diff1\": 0.3359875539979813,\n        \"nauc_mrr_at_3_max\": 0.11955416883057066,\n        \"nauc_mrr_at_3_std\": -0.03476235016257288,\n        \"nauc_mrr_at_5_diff1\": 0.32252659352575813,\n        \"nauc_mrr_at_5_max\": 0.10046345533893442,\n        \"nauc_mrr_at_5_std\": -0.045529883380858664,\n        \"nauc_ndcg_at_1000_diff1\": 0.2931526330921674,\n        \"nauc_ndcg_at_1000_max\": 0.14343734872583952,\n        \"nauc_ndcg_at_1000_std\": 0.01531556734099745,\n        \"nauc_ndcg_at_100_diff1\": 0.28793660618185096,\n        \"nauc_ndcg_at_100_max\": 0.14080051473350946,\n        \"nauc_ndcg_at_100_std\": 0.01939473783704219,\n        \"nauc_ndcg_at_10_diff1\": 0.30274490180366037,\n        \"nauc_ndcg_at_10_max\": 0.11207325709525649,\n        \"nauc_ndcg_at_10_std\": -0.037138795222154526,\n        \"nauc_ndcg_at_1_diff1\": 0.401585102884664,\n        \"nauc_ndcg_at_1_max\": 0.1326972078174377,\n        \"nauc_ndcg_at_1_std\": -0.05207300122030268,\n        \"nauc_ndcg_at_20_diff1\": 0.2924643035488461,\n        \"nauc_ndcg_at_20_max\": 0.11576477873988932,\n        \"nauc_ndcg_at_20_std\": -0.021628226067522374,\n        \"nauc_ndcg_at_3_diff1\": 0.3381531011543047,\n        \"nauc_ndcg_at_3_max\": 0.1483085845798095,\n        \"nauc_ndcg_at_3_std\": -0.02020927671457784,\n        \"nauc_ndcg_at_5_diff1\": 0.31836406385775057,\n        \"nauc_ndcg_at_5_max\": 0.11859396452974193,\n        \"nauc_ndcg_at_5_std\": -0.0398300926768745,\n        \"nauc_precision_at_1000_diff1\": 0.01897509499484508,\n        \"nauc_precision_at_1000_max\": 0.1272058228791155,\n        \"nauc_precision_at_1000_std\": 0.15277529372849502,\n        \"nauc_precision_at_100_diff1\": 0.11516779002559407,\n        \"nauc_precision_at_100_max\": 0.14853048761591342,\n        \"nauc_precision_at_100_std\": 0.14492486506295213,\n        \"nauc_precision_at_10_diff1\": 0.21251133142026507,\n        \"nauc_precision_at_10_max\": 0.0749955278240198,\n        \"nauc_precision_at_10_std\": -0.021005872981786113,\n        \"nauc_precision_at_1_diff1\": 0.401585102884664,\n        \"nauc_precision_at_1_max\": 0.1326972078174377,\n        \"nauc_precision_at_1_std\": -0.05207300122030268,\n        \"nauc_precision_at_20_diff1\": 0.17961078306722833,\n        \"nauc_precision_at_20_max\": 0.07124907605202703,\n        \"nauc_precision_at_20_std\": 0.018615517877496685,\n        \"nauc_precision_at_3_diff1\": 0.2861280133449851,\n        \"nauc_precision_at_3_max\": 0.13997648217997413,\n        \"nauc_precision_at_3_std\": -0.0045893982638058025,\n        \"nauc_precision_at_5_diff1\": 0.23365603097222445,\n        \"nauc_precision_at_5_max\": 0.07201622385482957,\n        \"nauc_precision_at_5_std\": -0.037993705245915846,\n        \"nauc_recall_at_1000_diff1\": 0.15524576455683287,\n        \"nauc_recall_at_1000_max\": 0.3777839196641194,\n        \"nauc_recall_at_1000_std\": 0.37249201078606803,\n        \"nauc_recall_at_100_diff1\": 0.18838026703717084,\n        \"nauc_recall_at_100_max\": 0.16705539370590955,\n        \"nauc_recall_at_100_std\": 0.13071431855660154,\n        \"nauc_recall_at_10_diff1\": 0.2259821503446232,\n        \"nauc_recall_at_10_max\": 0.07734043989687381,\n        \"nauc_recall_at_10_std\": -0.03896354343756332,\n        \"nauc_recall_at_1_diff1\": 0.4190187012199572,\n        \"nauc_recall_at_1_max\": 0.15134792821012716,\n        \"nauc_recall_at_1_std\": -0.04697241262575727,\n        \"nauc_recall_at_20_diff1\": 0.20419825567192415,\n        \"nauc_recall_at_20_max\": 0.09223973482857481,\n        \"nauc_recall_at_20_std\": -0.0010681016439537414,\n        \"nauc_recall_at_3_diff1\": 0.3084967319100879,\n        \"nauc_recall_at_3_max\": 0.15205899480484425,\n        \"nauc_recall_at_3_std\": -0.016393168209809336,\n        \"nauc_recall_at_5_diff1\": 0.27003956265333967,\n        \"nauc_recall_at_5_max\": 0.09709950457509019,\n        \"nauc_recall_at_5_std\": -0.04449121016608349,\n        \"ndcg_at_1\": 0.15138,\n        \"ndcg_at_10\": 0.1836,\n        \"ndcg_at_100\": 0.25502,\n        \"ndcg_at_1000\": 0.31552,\n        \"ndcg_at_20\": 0.20472,\n        \"ndcg_at_3\": 0.15104,\n        \"ndcg_at_5\": 0.16047,\n        \"precision_at_1\": 0.15138,\n        \"precision_at_10\": 0.05,\n        \"precision_at_100\": 0.01125,\n        \"precision_at_1000\": 0.0019,\n        \"precision_at_20\": 0.03287,\n        \"precision_at_3\": 0.09837,\n        \"precision_at_5\": 0.07615,\n        \"recall_at_1\": 0.08759,\n        \"recall_at_10\": 0.23626,\n        \"recall_at_100\": 0.53598,\n        \"recall_at_1000\": 0.96376,\n        \"recall_at_20\": 0.30341,\n        \"recall_at_3\": 0.14518,\n        \"recall_at_5\": 0.1764\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.13208,\n        \"map_at_1\": 0.05869,\n        \"map_at_10\": 0.10211,\n        \"map_at_100\": 0.11408,\n        \"map_at_1000\": 0.11686,\n        \"map_at_20\": 0.10762,\n        \"map_at_3\": 0.08392,\n        \"map_at_5\": 0.09327,\n        \"mrr_at_1\": 0.08957654723127036,\n        \"mrr_at_10\": 0.1315637764334833,\n        \"mrr_at_100\": 0.14213263563289533,\n        \"mrr_at_1000\": 0.14378913837763863,\n        \"mrr_at_20\": 0.13754496155982124,\n        \"mrr_at_3\": 0.11427795874049947,\n        \"mrr_at_5\": 0.122828447339848,\n        \"nauc_map_at_1000_diff1\": 0.21560922855620007,\n        \"nauc_map_at_1000_max\": 0.19561583483776016,\n        \"nauc_map_at_1000_std\": -0.08618144873074722,\n        \"nauc_map_at_100_diff1\": 0.21524058773854432,\n        \"nauc_map_at_100_max\": 0.19431477445319648,\n        \"nauc_map_at_100_std\": -0.08676346645432348,\n        \"nauc_map_at_10_diff1\": 0.21422950284520126,\n        \"nauc_map_at_10_max\": 0.19885627844058584,\n        \"nauc_map_at_10_std\": -0.09151289850316742,\n        \"nauc_map_at_1_diff1\": 0.3538976408299393,\n        \"nauc_map_at_1_max\": 0.23850048629684373,\n        \"nauc_map_at_1_std\": -0.06908623232628476,\n        \"nauc_map_at_20_diff1\": 0.21693053893599712,\n        \"nauc_map_at_20_max\": 0.19072627724433514,\n        \"nauc_map_at_20_std\": -0.09462057211855156,\n        \"nauc_map_at_3_diff1\": 0.24575719829487122,\n        \"nauc_map_at_3_max\": 0.2063557681660242,\n        \"nauc_map_at_3_std\": -0.08734603877301897,\n        \"nauc_map_at_5_diff1\": 0.22781099520034429,\n        \"nauc_map_at_5_max\": 0.20325106012746608,\n        \"nauc_map_at_5_std\": -0.09807300505119161,\n        \"nauc_mrr_at_1000_diff1\": 0.24945463442366622,\n        \"nauc_mrr_at_1000_max\": 0.19118543371597183,\n        \"nauc_mrr_at_1000_std\": -0.09983062611158049,\n        \"nauc_mrr_at_100_diff1\": 0.24891535170964876,\n        \"nauc_mrr_at_100_max\": 0.19110971717545924,\n        \"nauc_mrr_at_100_std\": -0.09915074234087376,\n        \"nauc_mrr_at_10_diff1\": 0.24941942040095283,\n        \"nauc_mrr_at_10_max\": 0.1919868661708655,\n        \"nauc_mrr_at_10_std\": -0.10432343680920428,\n        \"nauc_mrr_at_1_diff1\": 0.3376404249877776,\n        \"nauc_mrr_at_1_max\": 0.21146912532087958,\n        \"nauc_mrr_at_1_std\": -0.12859947809219066,\n        \"nauc_mrr_at_20_diff1\": 0.24938581241814445,\n        \"nauc_mrr_at_20_max\": 0.18738807630665177,\n        \"nauc_mrr_at_20_std\": -0.10443144645359773,\n        \"nauc_mrr_at_3_diff1\": 0.2957268343270363,\n        \"nauc_mrr_at_3_max\": 0.21399609341337603,\n        \"nauc_mrr_at_3_std\": -0.10290389227513133,\n        \"nauc_mrr_at_5_diff1\": 0.26434737424521426,\n        \"nauc_mrr_at_5_max\": 0.2040101668123861,\n        \"nauc_mrr_at_5_std\": -0.1039001693931301,\n        \"nauc_ndcg_at_1000_diff1\": 0.1987438343299619,\n        \"nauc_ndcg_at_1000_max\": 0.1924612516252132,\n        \"nauc_ndcg_at_1000_std\": -0.06685289419687576,\n        \"nauc_ndcg_at_100_diff1\": 0.1838404743726864,\n        \"nauc_ndcg_at_100_max\": 0.1848659194171432,\n        \"nauc_ndcg_at_100_std\": -0.05906364514428352,\n        \"nauc_ndcg_at_10_diff1\": 0.18242977368934568,\n        \"nauc_ndcg_at_10_max\": 0.18123187262386636,\n        \"nauc_ndcg_at_10_std\": -0.0917795439461141,\n        \"nauc_ndcg_at_1_diff1\": 0.3376404249877776,\n        \"nauc_ndcg_at_1_max\": 0.21146912532087958,\n        \"nauc_ndcg_at_1_std\": -0.12859947809219066,\n        \"nauc_ndcg_at_20_diff1\": 0.18990385592671677,\n        \"nauc_ndcg_at_20_max\": 0.16079696958979647,\n        \"nauc_ndcg_at_20_std\": -0.09728697788201912,\n        \"nauc_ndcg_at_3_diff1\": 0.2517920264760545,\n        \"nauc_ndcg_at_3_max\": 0.20648883858241032,\n        \"nauc_ndcg_at_3_std\": -0.08518847040847785,\n        \"nauc_ndcg_at_5_diff1\": 0.21041924820244198,\n        \"nauc_ndcg_at_5_max\": 0.19530185319315377,\n        \"nauc_ndcg_at_5_std\": -0.09941341807558633,\n        \"nauc_precision_at_1000_diff1\": 0.03513800086318182,\n        \"nauc_precision_at_1000_max\": 0.1255489280293357,\n        \"nauc_precision_at_1000_std\": 0.09356806987379775,\n        \"nauc_precision_at_100_diff1\": 0.09880744710648004,\n        \"nauc_precision_at_100_max\": 0.19393587366376208,\n        \"nauc_precision_at_100_std\": 0.049293428739512556,\n        \"nauc_precision_at_10_diff1\": 0.10686341522204414,\n        \"nauc_precision_at_10_max\": 0.15110569691521045,\n        \"nauc_precision_at_10_std\": -0.1006454762936947,\n        \"nauc_precision_at_1_diff1\": 0.3376404249877776,\n        \"nauc_precision_at_1_max\": 0.21146912532087958,\n        \"nauc_precision_at_1_std\": -0.12859947809219066,\n        \"nauc_precision_at_20_diff1\": 0.1380424489755519,\n        \"nauc_precision_at_20_max\": 0.11046126212037552,\n        \"nauc_precision_at_20_std\": -0.10974323144810633,\n        \"nauc_precision_at_3_diff1\": 0.21406006876255954,\n        \"nauc_precision_at_3_max\": 0.19917630927345578,\n        \"nauc_precision_at_3_std\": -0.10243766390060259,\n        \"nauc_precision_at_5_diff1\": 0.1586259842576393,\n        \"nauc_precision_at_5_max\": 0.1825289897633917,\n        \"nauc_precision_at_5_std\": -0.1173922587116099,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.09876684110940794,\n        \"nauc_recall_at_100_max\": 0.152107667117311,\n        \"nauc_recall_at_100_std\": 0.0035501001547093764,\n        \"nauc_recall_at_10_diff1\": 0.09242510783637202,\n        \"nauc_recall_at_10_max\": 0.1455731287806074,\n        \"nauc_recall_at_10_std\": -0.07703531519035574,\n        \"nauc_recall_at_1_diff1\": 0.3538976408299393,\n        \"nauc_recall_at_1_max\": 0.23850048629684373,\n        \"nauc_recall_at_1_std\": -0.06908623232628476,\n        \"nauc_recall_at_20_diff1\": 0.11102806918077908,\n        \"nauc_recall_at_20_max\": 0.09446327110879274,\n        \"nauc_recall_at_20_std\": -0.08584496849591045,\n        \"nauc_recall_at_3_diff1\": 0.20353526483578888,\n        \"nauc_recall_at_3_max\": 0.1895890169712471,\n        \"nauc_recall_at_3_std\": -0.0771361002484376,\n        \"nauc_recall_at_5_diff1\": 0.13559382090130945,\n        \"nauc_recall_at_5_max\": 0.1663957063451556,\n        \"nauc_recall_at_5_std\": -0.09905717747836443,\n        \"ndcg_at_1\": 0.08958,\n        \"ndcg_at_10\": 0.13208,\n        \"ndcg_at_100\": 0.19471,\n        \"ndcg_at_1000\": 0.26676,\n        \"ndcg_at_20\": 0.15152,\n        \"ndcg_at_3\": 0.09829,\n        \"ndcg_at_5\": 0.11236,\n        \"precision_at_1\": 0.08958,\n        \"precision_at_10\": 0.03257,\n        \"precision_at_100\": 0.00827,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.02191,\n        \"precision_at_3\": 0.05917,\n        \"precision_at_5\": 0.04723,\n        \"recall_at_1\": 0.05869,\n        \"recall_at_10\": 0.19125,\n        \"recall_at_100\": 0.46301,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.25857,\n        \"recall_at_3\": 0.10437,\n        \"recall_at_5\": 0.1374\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/jhgan/ko-sroberta-multitask/jhgan__ko-sroberta-multitask/no_revision_available/model_meta.json",
    "content": "{\"name\": \"jhgan/ko-sroberta-multitask\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": [], \"n_parameters\": null, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": null, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"Sentence Transformers\"], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"zero_shot_benchmarks\": null, \"loader\": null}"
  },
  {
    "path": "eval/results/jinaai/jina-embeddings-v3/jinaai__jina-embeddings-v3/215a6e121fa0183376388ac6b1ae230326bfeaed/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 41.10066056251526,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.76104,\n        \"map_at_1\": 0.59649,\n        \"map_at_10\": 0.70926,\n        \"map_at_100\": 0.71425,\n        \"map_at_1000\": 0.71425,\n        \"map_at_20\": 0.71406,\n        \"map_at_3\": 0.69006,\n        \"map_at_5\": 0.70058,\n        \"mrr_at_1\": 0.5964912280701754,\n        \"mrr_at_10\": 0.7092592592592594,\n        \"mrr_at_100\": 0.7142522444779211,\n        \"mrr_at_1000\": 0.7142522444779211,\n        \"mrr_at_20\": 0.7140560706350181,\n        \"mrr_at_3\": 0.6900584795321638,\n        \"mrr_at_5\": 0.7005847953216374,\n        \"nauc_map_at_1000_diff1\": 0.5239958070884113,\n        \"nauc_map_at_1000_max\": 0.3096268445996021,\n        \"nauc_map_at_1000_std\": -0.09860198242005956,\n        \"nauc_map_at_100_diff1\": 0.5239958070884113,\n        \"nauc_map_at_100_max\": 0.3096268445996021,\n        \"nauc_map_at_100_std\": -0.09860198242005956,\n        \"nauc_map_at_10_diff1\": 0.5257485700639195,\n        \"nauc_map_at_10_max\": 0.3004730187357267,\n        \"nauc_map_at_10_std\": -0.10570448325456437,\n        \"nauc_map_at_1_diff1\": 0.5270656332483367,\n        \"nauc_map_at_1_max\": 0.2997382273345491,\n        \"nauc_map_at_1_std\": -0.08460522678016429,\n        \"nauc_map_at_20_diff1\": 0.52420233068558,\n        \"nauc_map_at_20_max\": 0.3102036982325753,\n        \"nauc_map_at_20_std\": -0.09806415639379118,\n        \"nauc_map_at_3_diff1\": 0.5253492012809279,\n        \"nauc_map_at_3_max\": 0.3144296142174382,\n        \"nauc_map_at_3_std\": -0.1121978163326179,\n        \"nauc_map_at_5_diff1\": 0.5269886990139881,\n        \"nauc_map_at_5_max\": 0.31118773097573915,\n        \"nauc_map_at_5_std\": -0.09722073597757512,\n        \"nauc_mrr_at_1000_diff1\": 0.5239958070884113,\n        \"nauc_mrr_at_1000_max\": 0.3096268445996021,\n        \"nauc_mrr_at_1000_std\": -0.09860198242005956,\n        \"nauc_mrr_at_100_diff1\": 0.5239958070884113,\n        \"nauc_mrr_at_100_max\": 0.3096268445996021,\n        \"nauc_mrr_at_100_std\": -0.09860198242005956,\n        \"nauc_mrr_at_10_diff1\": 0.5257485700639195,\n        \"nauc_mrr_at_10_max\": 0.3004730187357267,\n        \"nauc_mrr_at_10_std\": -0.10570448325456437,\n        \"nauc_mrr_at_1_diff1\": 0.5270656332483367,\n        \"nauc_mrr_at_1_max\": 0.2997382273345491,\n        \"nauc_mrr_at_1_std\": -0.08460522678016429,\n        \"nauc_mrr_at_20_diff1\": 0.52420233068558,\n        \"nauc_mrr_at_20_max\": 0.3102036982325753,\n        \"nauc_mrr_at_20_std\": -0.09806415639379118,\n        \"nauc_mrr_at_3_diff1\": 0.5253492012809279,\n        \"nauc_mrr_at_3_max\": 0.3144296142174382,\n        \"nauc_mrr_at_3_std\": -0.1121978163326179,\n        \"nauc_mrr_at_5_diff1\": 0.5269886990139881,\n        \"nauc_mrr_at_5_max\": 0.31118773097573915,\n        \"nauc_mrr_at_5_std\": -0.09722073597757512,\n        \"nauc_ndcg_at_1000_diff1\": 0.5257901238239717,\n        \"nauc_ndcg_at_1000_max\": 0.3126792178348435,\n        \"nauc_ndcg_at_1000_std\": -0.0967700334246146,\n        \"nauc_ndcg_at_100_diff1\": 0.5257901238239717,\n        \"nauc_ndcg_at_100_max\": 0.3126792178348435,\n        \"nauc_ndcg_at_100_std\": -0.0967700334246146,\n        \"nauc_ndcg_at_10_diff1\": 0.533232658128605,\n        \"nauc_ndcg_at_10_max\": 0.28188484529812124,\n        \"nauc_ndcg_at_10_std\": -0.1187167303529919,\n        \"nauc_ndcg_at_1_diff1\": 0.5270656332483367,\n        \"nauc_ndcg_at_1_max\": 0.2997382273345491,\n        \"nauc_ndcg_at_1_std\": -0.08460522678016429,\n        \"nauc_ndcg_at_20_diff1\": 0.5294503341807054,\n        \"nauc_ndcg_at_20_max\": 0.3227331547901982,\n        \"nauc_ndcg_at_20_std\": -0.0874396499178423,\n        \"nauc_ndcg_at_3_diff1\": 0.5304384782368492,\n        \"nauc_ndcg_at_3_max\": 0.32058457218018066,\n        \"nauc_ndcg_at_3_std\": -0.12308251548793804,\n        \"nauc_ndcg_at_5_diff1\": 0.5345686226982408,\n        \"nauc_ndcg_at_5_max\": 0.31397010350723664,\n        \"nauc_ndcg_at_5_std\": -0.09551990374421933,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.6096638560941005,\n        \"nauc_precision_at_10_max\": 0.07507825251175508,\n        \"nauc_precision_at_10_std\": -0.2479500686091432,\n        \"nauc_precision_at_1_diff1\": 0.5270656332483367,\n        \"nauc_precision_at_1_max\": 0.2997382273345491,\n        \"nauc_precision_at_1_std\": -0.08460522678016429,\n        \"nauc_precision_at_20_diff1\": 0.7773798018086919,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 0.539967216074137,\n        \"nauc_precision_at_3_diff1\": 0.554747649217572,\n        \"nauc_precision_at_3_max\": 0.3469283752456029,\n        \"nauc_precision_at_3_std\": -0.16937634560817524,\n        \"nauc_precision_at_5_diff1\": 0.5794871062690461,\n        \"nauc_precision_at_5_max\": 0.3264628971418981,\n        \"nauc_precision_at_5_std\": -0.0814431864235027,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.6096638560941018,\n        \"nauc_recall_at_10_max\": 0.07507825251175473,\n        \"nauc_recall_at_10_std\": -0.24795006860914381,\n        \"nauc_recall_at_1_diff1\": 0.5270656332483367,\n        \"nauc_recall_at_1_max\": 0.2997382273345491,\n        \"nauc_recall_at_1_std\": -0.08460522678016429,\n        \"nauc_recall_at_20_diff1\": 0.7773798018086994,\n        \"nauc_recall_at_20_max\": 1.0,\n        \"nauc_recall_at_20_std\": 0.5399672160741448,\n        \"nauc_recall_at_3_diff1\": 0.5547476492175731,\n        \"nauc_recall_at_3_max\": 0.34692837524560327,\n        \"nauc_recall_at_3_std\": -0.1693763456081746,\n        \"nauc_recall_at_5_diff1\": 0.5794871062690465,\n        \"nauc_recall_at_5_max\": 0.3264628971418974,\n        \"nauc_recall_at_5_std\": -0.08144318642350515,\n        \"ndcg_at_1\": 0.59649,\n        \"ndcg_at_10\": 0.76104,\n        \"ndcg_at_100\": 0.77992,\n        \"ndcg_at_1000\": 0.77992,\n        \"ndcg_at_20\": 0.77722,\n        \"ndcg_at_3\": 0.72222,\n        \"ndcg_at_5\": 0.74072,\n        \"precision_at_1\": 0.59649,\n        \"precision_at_10\": 0.09211,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04912,\n        \"precision_at_3\": 0.27193,\n        \"precision_at_5\": 0.17193,\n        \"recall_at_1\": 0.59649,\n        \"recall_at_10\": 0.92105,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98246,\n        \"recall_at_3\": 0.81579,\n        \"recall_at_5\": 0.85965\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/jinaai/jina-embeddings-v3/jinaai__jina-embeddings-v3/215a6e121fa0183376388ac6b1ae230326bfeaed/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 57.27869248390198,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.91203,\n        \"map_at_1\": 0.85222,\n        \"map_at_10\": 0.89425,\n        \"map_at_100\": 0.89538,\n        \"map_at_1000\": 0.89543,\n        \"map_at_20\": 0.89498,\n        \"map_at_3\": 0.88704,\n        \"map_at_5\": 0.89204,\n        \"mrr_at_1\": 0.8522222222222222,\n        \"mrr_at_10\": 0.8942500000000002,\n        \"mrr_at_100\": 0.8953839155802804,\n        \"mrr_at_1000\": 0.8954270182792048,\n        \"mrr_at_20\": 0.8949815662732332,\n        \"mrr_at_3\": 0.8870370370370371,\n        \"mrr_at_5\": 0.8920370370370372,\n        \"nauc_map_at_1000_diff1\": 0.9020917639244876,\n        \"nauc_map_at_1000_max\": 0.8337947139919248,\n        \"nauc_map_at_1000_std\": -0.13942249660085268,\n        \"nauc_map_at_100_diff1\": 0.9021144491033539,\n        \"nauc_map_at_100_max\": 0.8338652988739003,\n        \"nauc_map_at_100_std\": -0.1391935604293546,\n        \"nauc_map_at_10_diff1\": 0.9021967915206724,\n        \"nauc_map_at_10_max\": 0.8348616633465842,\n        \"nauc_map_at_10_std\": -0.1370753656652194,\n        \"nauc_map_at_1_diff1\": 0.9145342061089405,\n        \"nauc_map_at_1_max\": 0.8262609677253842,\n        \"nauc_map_at_1_std\": -0.1763595581390236,\n        \"nauc_map_at_20_diff1\": 0.902147551209322,\n        \"nauc_map_at_20_max\": 0.8341413002501225,\n        \"nauc_map_at_20_std\": -0.1390126071598066,\n        \"nauc_map_at_3_diff1\": 0.8945147579693029,\n        \"nauc_map_at_3_max\": 0.8294443132624945,\n        \"nauc_map_at_3_std\": -0.139357733175914,\n        \"nauc_map_at_5_diff1\": 0.9012312541128398,\n        \"nauc_map_at_5_max\": 0.8347399861132424,\n        \"nauc_map_at_5_std\": -0.13882816867958603,\n        \"nauc_mrr_at_1000_diff1\": 0.9020917639244876,\n        \"nauc_mrr_at_1000_max\": 0.8337947139919248,\n        \"nauc_mrr_at_1000_std\": -0.13942249660085268,\n        \"nauc_mrr_at_100_diff1\": 0.9021144491033539,\n        \"nauc_mrr_at_100_max\": 0.8338652988739003,\n        \"nauc_mrr_at_100_std\": -0.1391935604293546,\n        \"nauc_mrr_at_10_diff1\": 0.9021967915206724,\n        \"nauc_mrr_at_10_max\": 0.8348616633465842,\n        \"nauc_mrr_at_10_std\": -0.1370753656652194,\n        \"nauc_mrr_at_1_diff1\": 0.9145342061089405,\n        \"nauc_mrr_at_1_max\": 0.8262609677253842,\n        \"nauc_mrr_at_1_std\": -0.1763595581390236,\n        \"nauc_mrr_at_20_diff1\": 0.902147551209322,\n        \"nauc_mrr_at_20_max\": 0.8341413002501225,\n        \"nauc_mrr_at_20_std\": -0.1390126071598066,\n        \"nauc_mrr_at_3_diff1\": 0.8945147579693029,\n        \"nauc_mrr_at_3_max\": 0.8294443132624945,\n        \"nauc_mrr_at_3_std\": -0.139357733175914,\n        \"nauc_mrr_at_5_diff1\": 0.9012312541128398,\n        \"nauc_mrr_at_5_max\": 0.8347399861132424,\n        \"nauc_mrr_at_5_std\": -0.13882816867958603,\n        \"nauc_ndcg_at_1000_diff1\": 0.9015621894371831,\n        \"nauc_ndcg_at_1000_max\": 0.8368285497658826,\n        \"nauc_ndcg_at_1000_std\": -0.13046781497976448,\n        \"nauc_ndcg_at_100_diff1\": 0.9021755169669389,\n        \"nauc_ndcg_at_100_max\": 0.8386747960567419,\n        \"nauc_ndcg_at_100_std\": -0.12445994533332687,\n        \"nauc_ndcg_at_10_diff1\": 0.9023787269981611,\n        \"nauc_ndcg_at_10_max\": 0.8439996596181932,\n        \"nauc_ndcg_at_10_std\": -0.11394157814254431,\n        \"nauc_ndcg_at_1_diff1\": 0.9145342061089405,\n        \"nauc_ndcg_at_1_max\": 0.8262609677253842,\n        \"nauc_ndcg_at_1_std\": -0.1763595581390236,\n        \"nauc_ndcg_at_20_diff1\": 0.9022049378154124,\n        \"nauc_ndcg_at_20_max\": 0.8410091236224608,\n        \"nauc_ndcg_at_20_std\": -0.12123038116426346,\n        \"nauc_ndcg_at_3_diff1\": 0.8865681442555119,\n        \"nauc_ndcg_at_3_max\": 0.8313441701334897,\n        \"nauc_ndcg_at_3_std\": -0.12506625223359308,\n        \"nauc_ndcg_at_5_diff1\": 0.8995328660323624,\n        \"nauc_ndcg_at_5_max\": 0.8424065352194856,\n        \"nauc_ndcg_at_5_std\": -0.12271550695612689,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9564270152505334,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.4064737005913334,\n        \"nauc_precision_at_10_diff1\": 0.9137877373171471,\n        \"nauc_precision_at_10_max\": 0.9339402427637699,\n        \"nauc_precision_at_10_std\": 0.1071739807033904,\n        \"nauc_precision_at_1_diff1\": 0.9145342061089405,\n        \"nauc_precision_at_1_max\": 0.8262609677253842,\n        \"nauc_precision_at_1_std\": -0.1763595581390236,\n        \"nauc_precision_at_20_diff1\": 0.9172502334267043,\n        \"nauc_precision_at_20_max\": 0.9344070961718046,\n        \"nauc_precision_at_20_std\": 0.11559290382819244,\n        \"nauc_precision_at_3_diff1\": 0.8521582992171257,\n        \"nauc_precision_at_3_max\": 0.8398836457660015,\n        \"nauc_precision_at_3_std\": -0.06337714573008646,\n        \"nauc_precision_at_5_diff1\": 0.8934018051665107,\n        \"nauc_precision_at_5_max\": 0.8921049901442025,\n        \"nauc_precision_at_5_std\": -0.026247536051460216,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9564270152505339,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.4064737005913486,\n        \"nauc_recall_at_10_diff1\": 0.9137877373171508,\n        \"nauc_recall_at_10_max\": 0.9339402427637726,\n        \"nauc_recall_at_10_std\": 0.10717398070338875,\n        \"nauc_recall_at_1_diff1\": 0.9145342061089405,\n        \"nauc_recall_at_1_max\": 0.8262609677253842,\n        \"nauc_recall_at_1_std\": -0.1763595581390236,\n        \"nauc_recall_at_20_diff1\": 0.9172502334267004,\n        \"nauc_recall_at_20_max\": 0.9344070961717991,\n        \"nauc_recall_at_20_std\": 0.11559290382819323,\n        \"nauc_recall_at_3_diff1\": 0.8521582992171224,\n        \"nauc_recall_at_3_max\": 0.839883645765999,\n        \"nauc_recall_at_3_std\": -0.06337714573008725,\n        \"nauc_recall_at_5_diff1\": 0.8934018051665108,\n        \"nauc_recall_at_5_max\": 0.8921049901442053,\n        \"nauc_recall_at_5_std\": -0.026247536051455612,\n        \"ndcg_at_1\": 0.85222,\n        \"ndcg_at_10\": 0.91203,\n        \"ndcg_at_100\": 0.9177,\n        \"ndcg_at_1000\": 0.9186,\n        \"ndcg_at_20\": 0.91479,\n        \"ndcg_at_3\": 0.89756,\n        \"ndcg_at_5\": 0.90665,\n        \"precision_at_1\": 0.85222,\n        \"precision_at_10\": 0.09667,\n        \"precision_at_100\": 0.00993,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04889,\n        \"precision_at_3\": 0.30926,\n        \"precision_at_5\": 0.19,\n        \"recall_at_1\": 0.85222,\n        \"recall_at_10\": 0.96667,\n        \"recall_at_100\": 0.99333,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.97778,\n        \"recall_at_3\": 0.92778,\n        \"recall_at_5\": 0.95\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.9109,\n        \"map_at_1\": 0.84222,\n        \"map_at_10\": 0.88998,\n        \"map_at_100\": 0.89082,\n        \"map_at_1000\": 0.89085,\n        \"map_at_20\": 0.89051,\n        \"map_at_3\": 0.88093,\n        \"map_at_5\": 0.88681,\n        \"mrr_at_1\": 0.8422222222222222,\n        \"mrr_at_10\": 0.8899757495590832,\n        \"mrr_at_100\": 0.890822716078263,\n        \"mrr_at_1000\": 0.890851807543744,\n        \"mrr_at_20\": 0.8905073602629074,\n        \"mrr_at_3\": 0.8809259259259262,\n        \"mrr_at_5\": 0.8868148148148152,\n        \"nauc_map_at_1000_diff1\": 0.8793289073281108,\n        \"nauc_map_at_1000_max\": 0.7645882618060904,\n        \"nauc_map_at_1000_std\": -0.20608621707079874,\n        \"nauc_map_at_100_diff1\": 0.8793283088179963,\n        \"nauc_map_at_100_max\": 0.7646368045228797,\n        \"nauc_map_at_100_std\": -0.20601745471532495,\n        \"nauc_map_at_10_diff1\": 0.8784631740060715,\n        \"nauc_map_at_10_max\": 0.7645963195365795,\n        \"nauc_map_at_10_std\": -0.20413278583470437,\n        \"nauc_map_at_1_diff1\": 0.8904469551525532,\n        \"nauc_map_at_1_max\": 0.7414745652684358,\n        \"nauc_map_at_1_std\": -0.2645336390381344,\n        \"nauc_map_at_20_diff1\": 0.8791660884950596,\n        \"nauc_map_at_20_max\": 0.7646298819142401,\n        \"nauc_map_at_20_std\": -0.20490132009022927,\n        \"nauc_map_at_3_diff1\": 0.8767390557772566,\n        \"nauc_map_at_3_max\": 0.7669129126156815,\n        \"nauc_map_at_3_std\": -0.20528469001054214,\n        \"nauc_map_at_5_diff1\": 0.8791163628524895,\n        \"nauc_map_at_5_max\": 0.767040239258405,\n        \"nauc_map_at_5_std\": -0.20443632861492111,\n        \"nauc_mrr_at_1000_diff1\": 0.8793289073281108,\n        \"nauc_mrr_at_1000_max\": 0.7645882618060904,\n        \"nauc_mrr_at_1000_std\": -0.20608621707079874,\n        \"nauc_mrr_at_100_diff1\": 0.8793283088179963,\n        \"nauc_mrr_at_100_max\": 0.7646368045228797,\n        \"nauc_mrr_at_100_std\": -0.20601745471532495,\n        \"nauc_mrr_at_10_diff1\": 0.8784631740060715,\n        \"nauc_mrr_at_10_max\": 0.7645963195365795,\n        \"nauc_mrr_at_10_std\": -0.20413278583470437,\n        \"nauc_mrr_at_1_diff1\": 0.8904469551525532,\n        \"nauc_mrr_at_1_max\": 0.7414745652684358,\n        \"nauc_mrr_at_1_std\": -0.2645336390381344,\n        \"nauc_mrr_at_20_diff1\": 0.8791660884950596,\n        \"nauc_mrr_at_20_max\": 0.7646298819142401,\n        \"nauc_mrr_at_20_std\": -0.20490132009022927,\n        \"nauc_mrr_at_3_diff1\": 0.8767390557772566,\n        \"nauc_mrr_at_3_max\": 0.7669129126156815,\n        \"nauc_mrr_at_3_std\": -0.20528469001054214,\n        \"nauc_mrr_at_5_diff1\": 0.8791163628524895,\n        \"nauc_mrr_at_5_max\": 0.767040239258405,\n        \"nauc_mrr_at_5_std\": -0.20443632861492111,\n        \"nauc_ndcg_at_1000_diff1\": 0.8781291299916675,\n        \"nauc_ndcg_at_1000_max\": 0.7685134207651526,\n        \"nauc_ndcg_at_1000_std\": -0.19370618376382695,\n        \"nauc_ndcg_at_100_diff1\": 0.8780237661206428,\n        \"nauc_ndcg_at_100_max\": 0.7700858390514594,\n        \"nauc_ndcg_at_100_std\": -0.1906833920754185,\n        \"nauc_ndcg_at_10_diff1\": 0.8742177171336183,\n        \"nauc_ndcg_at_10_max\": 0.7708266681095408,\n        \"nauc_ndcg_at_10_std\": -0.17522437091850582,\n        \"nauc_ndcg_at_1_diff1\": 0.8904469551525532,\n        \"nauc_ndcg_at_1_max\": 0.7414745652684358,\n        \"nauc_ndcg_at_1_std\": -0.2645336390381344,\n        \"nauc_ndcg_at_20_diff1\": 0.8767375659903873,\n        \"nauc_ndcg_at_20_max\": 0.7702559043816767,\n        \"nauc_ndcg_at_20_std\": -0.1802098019957146,\n        \"nauc_ndcg_at_3_diff1\": 0.8723314505390427,\n        \"nauc_ndcg_at_3_max\": 0.7773943742824141,\n        \"nauc_ndcg_at_3_std\": -0.1809413234611165,\n        \"nauc_ndcg_at_5_diff1\": 0.8767596497220361,\n        \"nauc_ndcg_at_5_max\": 0.7782724004984772,\n        \"nauc_ndcg_at_5_std\": -0.17687341992420602,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8627450980391947,\n        \"nauc_precision_at_100_max\": 0.9477124183006403,\n        \"nauc_precision_at_100_std\": 0.17665732959849742,\n        \"nauc_precision_at_10_diff1\": 0.8208131737543488,\n        \"nauc_precision_at_10_max\": 0.8309141838553583,\n        \"nauc_precision_at_10_std\": 0.18203038791273896,\n        \"nauc_precision_at_1_diff1\": 0.8904469551525532,\n        \"nauc_precision_at_1_max\": 0.7414745652684358,\n        \"nauc_precision_at_1_std\": -0.2645336390381344,\n        \"nauc_precision_at_20_diff1\": 0.8403361344537821,\n        \"nauc_precision_at_20_max\": 0.838811079987551,\n        \"nauc_precision_at_20_std\": 0.2273887332710908,\n        \"nauc_precision_at_3_diff1\": 0.8531675296381216,\n        \"nauc_precision_at_3_max\": 0.8244277508983406,\n        \"nauc_precision_at_3_std\": -0.07173980703392634,\n        \"nauc_precision_at_5_diff1\": 0.8637548042472811,\n        \"nauc_precision_at_5_max\": 0.8511823333984757,\n        \"nauc_precision_at_5_std\": 0.003984539552250845,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8627450980392323,\n        \"nauc_recall_at_100_max\": 0.9477124183006633,\n        \"nauc_recall_at_100_std\": 0.17665732959849603,\n        \"nauc_recall_at_10_diff1\": 0.8208131737543504,\n        \"nauc_recall_at_10_max\": 0.8309141838553625,\n        \"nauc_recall_at_10_std\": 0.1820303879127387,\n        \"nauc_recall_at_1_diff1\": 0.8904469551525532,\n        \"nauc_recall_at_1_max\": 0.7414745652684358,\n        \"nauc_recall_at_1_std\": -0.2645336390381344,\n        \"nauc_recall_at_20_diff1\": 0.8403361344537867,\n        \"nauc_recall_at_20_max\": 0.8388110799875537,\n        \"nauc_recall_at_20_std\": 0.22738873327109257,\n        \"nauc_recall_at_3_diff1\": 0.8531675296381188,\n        \"nauc_recall_at_3_max\": 0.8244277508983399,\n        \"nauc_recall_at_3_std\": -0.07173980703392417,\n        \"nauc_recall_at_5_diff1\": 0.8637548042472826,\n        \"nauc_recall_at_5_max\": 0.8511823333984765,\n        \"nauc_recall_at_5_std\": 0.003984539552254944,\n        \"ndcg_at_1\": 0.84222,\n        \"ndcg_at_10\": 0.9109,\n        \"ndcg_at_100\": 0.91498,\n        \"ndcg_at_1000\": 0.91571,\n        \"ndcg_at_20\": 0.91286,\n        \"ndcg_at_3\": 0.89274,\n        \"ndcg_at_5\": 0.9033,\n        \"precision_at_1\": 0.84222,\n        \"precision_at_10\": 0.09756,\n        \"precision_at_100\": 0.00994,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04917,\n        \"precision_at_3\": 0.30889,\n        \"precision_at_5\": 0.19044,\n        \"recall_at_1\": 0.84222,\n        \"recall_at_10\": 0.97556,\n        \"recall_at_100\": 0.99444,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98333,\n        \"recall_at_3\": 0.92667,\n        \"recall_at_5\": 0.95222\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.87617,\n        \"map_at_1\": 0.80333,\n        \"map_at_10\": 0.85398,\n        \"map_at_100\": 0.8561,\n        \"map_at_1000\": 0.85615,\n        \"map_at_20\": 0.8554,\n        \"map_at_3\": 0.84444,\n        \"map_at_5\": 0.85078,\n        \"mrr_at_1\": 0.8033333333333333,\n        \"mrr_at_10\": 0.8539775132275135,\n        \"mrr_at_100\": 0.8560964976509596,\n        \"mrr_at_1000\": 0.8561516994848337,\n        \"mrr_at_20\": 0.8554018242965613,\n        \"mrr_at_3\": 0.8444444444444446,\n        \"mrr_at_5\": 0.850777777777778,\n        \"nauc_map_at_1000_diff1\": 0.856390879963964,\n        \"nauc_map_at_1000_max\": 0.7431504658889044,\n        \"nauc_map_at_1000_std\": -0.03859630853653877,\n        \"nauc_map_at_100_diff1\": 0.8563949613083448,\n        \"nauc_map_at_100_max\": 0.7432512772690879,\n        \"nauc_map_at_100_std\": -0.0383305630011282,\n        \"nauc_map_at_10_diff1\": 0.8555895378186136,\n        \"nauc_map_at_10_max\": 0.7446655324173755,\n        \"nauc_map_at_10_std\": -0.03790518210814961,\n        \"nauc_map_at_1_diff1\": 0.870348447180458,\n        \"nauc_map_at_1_max\": 0.7173073562324179,\n        \"nauc_map_at_1_std\": -0.09652623923962796,\n        \"nauc_map_at_20_diff1\": 0.8566700428604839,\n        \"nauc_map_at_20_max\": 0.7443445689375534,\n        \"nauc_map_at_20_std\": -0.03640168482969062,\n        \"nauc_map_at_3_diff1\": 0.8514236742689241,\n        \"nauc_map_at_3_max\": 0.7390426052889324,\n        \"nauc_map_at_3_std\": -0.039633762417797626,\n        \"nauc_map_at_5_diff1\": 0.8528231089195483,\n        \"nauc_map_at_5_max\": 0.7411566867600459,\n        \"nauc_map_at_5_std\": -0.04003385146956129,\n        \"nauc_mrr_at_1000_diff1\": 0.856390879963964,\n        \"nauc_mrr_at_1000_max\": 0.7431504658889044,\n        \"nauc_mrr_at_1000_std\": -0.03859630853653877,\n        \"nauc_mrr_at_100_diff1\": 0.8563949613083448,\n        \"nauc_mrr_at_100_max\": 0.7432512772690879,\n        \"nauc_mrr_at_100_std\": -0.0383305630011282,\n        \"nauc_mrr_at_10_diff1\": 0.8555895378186136,\n        \"nauc_mrr_at_10_max\": 0.7446655324173755,\n        \"nauc_mrr_at_10_std\": -0.03790518210814961,\n        \"nauc_mrr_at_1_diff1\": 0.870348447180458,\n        \"nauc_mrr_at_1_max\": 0.7173073562324179,\n        \"nauc_mrr_at_1_std\": -0.09652623923962796,\n        \"nauc_mrr_at_20_diff1\": 0.8566700428604839,\n        \"nauc_mrr_at_20_max\": 0.7443445689375534,\n        \"nauc_mrr_at_20_std\": -0.03640168482969062,\n        \"nauc_mrr_at_3_diff1\": 0.8514236742689241,\n        \"nauc_mrr_at_3_max\": 0.7390426052889324,\n        \"nauc_mrr_at_3_std\": -0.039633762417797626,\n        \"nauc_mrr_at_5_diff1\": 0.8528231089195483,\n        \"nauc_mrr_at_5_max\": 0.7411566867600459,\n        \"nauc_mrr_at_5_std\": -0.04003385146956129,\n        \"nauc_ndcg_at_1000_diff1\": 0.8551568401764285,\n        \"nauc_ndcg_at_1000_max\": 0.7496569905288137,\n        \"nauc_ndcg_at_1000_std\": -0.024187597548567658,\n        \"nauc_ndcg_at_100_diff1\": 0.8549084962983187,\n        \"nauc_ndcg_at_100_max\": 0.7522749195374062,\n        \"nauc_ndcg_at_100_std\": -0.016738618446300355,\n        \"nauc_ndcg_at_10_diff1\": 0.8533642901306143,\n        \"nauc_ndcg_at_10_max\": 0.7624729405925561,\n        \"nauc_ndcg_at_10_std\": -0.007143010527758984,\n        \"nauc_ndcg_at_1_diff1\": 0.870348447180458,\n        \"nauc_ndcg_at_1_max\": 0.7173073562324179,\n        \"nauc_ndcg_at_1_std\": -0.09652623923962796,\n        \"nauc_ndcg_at_20_diff1\": 0.8573483667416811,\n        \"nauc_ndcg_at_20_max\": 0.7609706238162958,\n        \"nauc_ndcg_at_20_std\": -0.0017325455148094052,\n        \"nauc_ndcg_at_3_diff1\": 0.8433223914045559,\n        \"nauc_ndcg_at_3_max\": 0.7467564185298718,\n        \"nauc_ndcg_at_3_std\": -0.01610650093526701,\n        \"nauc_ndcg_at_5_diff1\": 0.8454774209016609,\n        \"nauc_ndcg_at_5_max\": 0.7515843383252132,\n        \"nauc_ndcg_at_5_std\": -0.015396728354773289,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8231792717086875,\n        \"nauc_precision_at_100_max\": 0.9836601307189621,\n        \"nauc_precision_at_100_std\": 0.6563375350140266,\n        \"nauc_precision_at_10_diff1\": 0.8464052287581659,\n        \"nauc_precision_at_10_max\": 0.9017833800186726,\n        \"nauc_precision_at_10_std\": 0.22231559290382727,\n        \"nauc_precision_at_1_diff1\": 0.870348447180458,\n        \"nauc_precision_at_1_max\": 0.7173073562324179,\n        \"nauc_precision_at_1_std\": -0.09652623923962796,\n        \"nauc_precision_at_20_diff1\": 0.8883928571428547,\n        \"nauc_precision_at_20_max\": 0.9554300887021441,\n        \"nauc_precision_at_20_std\": 0.40242763772175133,\n        \"nauc_precision_at_3_diff1\": 0.8102429610569564,\n        \"nauc_precision_at_3_max\": 0.7776040378049395,\n        \"nauc_precision_at_3_std\": 0.07962294027413584,\n        \"nauc_precision_at_5_diff1\": 0.807296251834067,\n        \"nauc_precision_at_5_max\": 0.8067627050820332,\n        \"nauc_precision_at_5_std\": 0.11367213552087513,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8231792717086877,\n        \"nauc_recall_at_100_max\": 0.9836601307189647,\n        \"nauc_recall_at_100_std\": 0.656337535014012,\n        \"nauc_recall_at_10_diff1\": 0.8464052287581701,\n        \"nauc_recall_at_10_max\": 0.9017833800186756,\n        \"nauc_recall_at_10_std\": 0.22231559290383007,\n        \"nauc_recall_at_1_diff1\": 0.870348447180458,\n        \"nauc_recall_at_1_max\": 0.7173073562324179,\n        \"nauc_recall_at_1_std\": -0.09652623923962796,\n        \"nauc_recall_at_20_diff1\": 0.888392857142854,\n        \"nauc_recall_at_20_max\": 0.9554300887021479,\n        \"nauc_recall_at_20_std\": 0.4024276377217557,\n        \"nauc_recall_at_3_diff1\": 0.8102429610569536,\n        \"nauc_recall_at_3_max\": 0.7776040378049385,\n        \"nauc_recall_at_3_std\": 0.07962294027413575,\n        \"nauc_recall_at_5_diff1\": 0.8072962518340645,\n        \"nauc_recall_at_5_max\": 0.8067627050820312,\n        \"nauc_recall_at_5_std\": 0.11367213552087382,\n        \"ndcg_at_1\": 0.80333,\n        \"ndcg_at_10\": 0.87617,\n        \"ndcg_at_100\": 0.88626,\n        \"ndcg_at_1000\": 0.88746,\n        \"ndcg_at_20\": 0.88128,\n        \"ndcg_at_3\": 0.85733,\n        \"ndcg_at_5\": 0.86875,\n        \"precision_at_1\": 0.80333,\n        \"precision_at_10\": 0.09444,\n        \"precision_at_100\": 0.00991,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04822,\n        \"precision_at_3\": 0.29815,\n        \"precision_at_5\": 0.18444,\n        \"recall_at_1\": 0.80333,\n        \"recall_at_10\": 0.94444,\n        \"recall_at_100\": 0.99111,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96444,\n        \"recall_at_3\": 0.89444,\n        \"recall_at_5\": 0.92222\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/jinaai/jina-embeddings-v3/jinaai__jina-embeddings-v3/215a6e121fa0183376388ac6b1ae230326bfeaed/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 223.86375641822815,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.19.4\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.79807,\n        \"map_at_1\": 0.49486,\n        \"map_at_10\": 0.7529,\n        \"map_at_100\": 0.75814,\n        \"map_at_1000\": 0.75847,\n        \"map_at_20\": 0.7557,\n        \"map_at_3\": 0.71293,\n        \"map_at_5\": 0.74013,\n        \"mrr_at_1\": 0.7567567567567568,\n        \"mrr_at_10\": 0.8125087140712136,\n        \"mrr_at_100\": 0.8138507914768789,\n        \"mrr_at_1000\": 0.8140220957363901,\n        \"mrr_at_20\": 0.8129562972490598,\n        \"mrr_at_3\": 0.8051801801801798,\n        \"mrr_at_5\": 0.8092342342342338,\n        \"nauc_map_at_1000_diff1\": 0.5254239984606249,\n        \"nauc_map_at_1000_max\": 0.6076357258092393,\n        \"nauc_map_at_1000_std\": 0.16831170782698113,\n        \"nauc_map_at_100_diff1\": 0.5256160280279527,\n        \"nauc_map_at_100_max\": 0.6081500700165519,\n        \"nauc_map_at_100_std\": 0.16879223667707566,\n        \"nauc_map_at_10_diff1\": 0.5255581538726148,\n        \"nauc_map_at_10_max\": 0.6060662610276891,\n        \"nauc_map_at_10_std\": 0.15876076676111253,\n        \"nauc_map_at_1_diff1\": 0.5677261561403673,\n        \"nauc_map_at_1_max\": 0.28508354972378114,\n        \"nauc_map_at_1_std\": 0.007280734732612492,\n        \"nauc_map_at_20_diff1\": 0.5238966366214702,\n        \"nauc_map_at_20_max\": 0.6066736461021203,\n        \"nauc_map_at_20_std\": 0.16629182338592297,\n        \"nauc_map_at_3_diff1\": 0.5256290575169561,\n        \"nauc_map_at_3_max\": 0.5526053340090126,\n        \"nauc_map_at_3_std\": 0.10745590181814504,\n        \"nauc_map_at_5_diff1\": 0.5239196813503921,\n        \"nauc_map_at_5_max\": 0.5879505989347982,\n        \"nauc_map_at_5_std\": 0.12928009325744128,\n        \"nauc_mrr_at_1000_diff1\": 0.6045317079492099,\n        \"nauc_mrr_at_1000_max\": 0.6818506916734917,\n        \"nauc_mrr_at_1000_std\": 0.24684168932238623,\n        \"nauc_mrr_at_100_diff1\": 0.6044974400624296,\n        \"nauc_mrr_at_100_max\": 0.6821498379087556,\n        \"nauc_mrr_at_100_std\": 0.2473342205845724,\n        \"nauc_mrr_at_10_diff1\": 0.6052759747606176,\n        \"nauc_mrr_at_10_max\": 0.6836968268951451,\n        \"nauc_mrr_at_10_std\": 0.24698918584519347,\n        \"nauc_mrr_at_1_diff1\": 0.6255977425590653,\n        \"nauc_mrr_at_1_max\": 0.6085394560621038,\n        \"nauc_mrr_at_1_std\": 0.1886186491267808,\n        \"nauc_mrr_at_20_diff1\": 0.6048472825511458,\n        \"nauc_mrr_at_20_max\": 0.6833297533840166,\n        \"nauc_mrr_at_20_std\": 0.24723589434904442,\n        \"nauc_mrr_at_3_diff1\": 0.6053260554638301,\n        \"nauc_mrr_at_3_max\": 0.6787525540078904,\n        \"nauc_mrr_at_3_std\": 0.22958233180443266,\n        \"nauc_mrr_at_5_diff1\": 0.6068903852966356,\n        \"nauc_mrr_at_5_max\": 0.6817668951172293,\n        \"nauc_mrr_at_5_std\": 0.23765401001481948,\n        \"nauc_ndcg_at_1000_diff1\": 0.5341293298685438,\n        \"nauc_ndcg_at_1000_max\": 0.6606052848336096,\n        \"nauc_ndcg_at_1000_std\": 0.24354374496497427,\n        \"nauc_ndcg_at_100_diff1\": 0.538109131538343,\n        \"nauc_ndcg_at_100_max\": 0.6738354047774087,\n        \"nauc_ndcg_at_100_std\": 0.2607595035941354,\n        \"nauc_ndcg_at_10_diff1\": 0.5371973679564122,\n        \"nauc_ndcg_at_10_max\": 0.6675617107893623,\n        \"nauc_ndcg_at_10_std\": 0.2275146878229136,\n        \"nauc_ndcg_at_1_diff1\": 0.6255977425590653,\n        \"nauc_ndcg_at_1_max\": 0.6085394560621038,\n        \"nauc_ndcg_at_1_std\": 0.1886186491267808,\n        \"nauc_ndcg_at_20_diff1\": 0.5329460641472812,\n        \"nauc_ndcg_at_20_max\": 0.6703160563440603,\n        \"nauc_ndcg_at_20_std\": 0.24665172910639852,\n        \"nauc_ndcg_at_3_diff1\": 0.5339934869900126,\n        \"nauc_ndcg_at_3_max\": 0.6016187617062881,\n        \"nauc_ndcg_at_3_std\": 0.14319284440610835,\n        \"nauc_ndcg_at_5_diff1\": 0.5349249568810696,\n        \"nauc_ndcg_at_5_max\": 0.6360683663995738,\n        \"nauc_ndcg_at_5_std\": 0.17195232578453204,\n        \"nauc_precision_at_1000_diff1\": -0.3601704644023477,\n        \"nauc_precision_at_1000_max\": 0.006183725884216995,\n        \"nauc_precision_at_1000_std\": 0.1607732772589181,\n        \"nauc_precision_at_100_diff1\": -0.24363085502433576,\n        \"nauc_precision_at_100_max\": 0.15825274923442087,\n        \"nauc_precision_at_100_std\": 0.2571706793459895,\n        \"nauc_precision_at_10_diff1\": -0.15330981722695072,\n        \"nauc_precision_at_10_max\": 0.2705490424818717,\n        \"nauc_precision_at_10_std\": 0.2420369043349826,\n        \"nauc_precision_at_1_diff1\": 0.6255977425590653,\n        \"nauc_precision_at_1_max\": 0.6085394560621038,\n        \"nauc_precision_at_1_std\": 0.1886186491267808,\n        \"nauc_precision_at_20_diff1\": -0.1818736784887125,\n        \"nauc_precision_at_20_max\": 0.23765136032825976,\n        \"nauc_precision_at_20_std\": 0.26033290546867716,\n        \"nauc_precision_at_3_diff1\": -0.018528841312410074,\n        \"nauc_precision_at_3_max\": 0.37026854207409304,\n        \"nauc_precision_at_3_std\": 0.18878760818610282,\n        \"nauc_precision_at_5_diff1\": -0.09487222809490398,\n        \"nauc_precision_at_5_max\": 0.30644126690762064,\n        \"nauc_precision_at_5_std\": 0.186628279906234,\n        \"nauc_recall_at_1000_diff1\": 0.269619819244052,\n        \"nauc_recall_at_1000_max\": 0.9169502263402253,\n        \"nauc_recall_at_1000_std\": 0.9105457073478973,\n        \"nauc_recall_at_100_diff1\": 0.4796192580516074,\n        \"nauc_recall_at_100_max\": 0.9314620341130307,\n        \"nauc_recall_at_100_std\": 0.736430564541567,\n        \"nauc_recall_at_10_diff1\": 0.49088061271022754,\n        \"nauc_recall_at_10_max\": 0.7916733282343257,\n        \"nauc_recall_at_10_std\": 0.3813267309899073,\n        \"nauc_recall_at_1_diff1\": 0.5677261561403673,\n        \"nauc_recall_at_1_max\": 0.28508354972378114,\n        \"nauc_recall_at_1_std\": 0.007280734732612492,\n        \"nauc_recall_at_20_diff1\": 0.4703645522060505,\n        \"nauc_recall_at_20_max\": 0.8261306027221935,\n        \"nauc_recall_at_20_std\": 0.4863410668980038,\n        \"nauc_recall_at_3_diff1\": 0.4974352305750985,\n        \"nauc_recall_at_3_max\": 0.6019940531052395,\n        \"nauc_recall_at_3_std\": 0.1376677180157724,\n        \"nauc_recall_at_5_diff1\": 0.49113118706864095,\n        \"nauc_recall_at_5_max\": 0.6838318771771169,\n        \"nauc_recall_at_5_std\": 0.2000724466684479,\n        \"ndcg_at_1\": 0.75676,\n        \"ndcg_at_10\": 0.79807,\n        \"ndcg_at_100\": 0.81503,\n        \"ndcg_at_1000\": 0.82257,\n        \"ndcg_at_20\": 0.80396,\n        \"ndcg_at_3\": 0.75288,\n        \"ndcg_at_5\": 0.77926,\n        \"precision_at_1\": 0.75676,\n        \"precision_at_10\": 0.15912,\n        \"precision_at_100\": 0.01738,\n        \"precision_at_1000\": 0.00185,\n        \"precision_at_20\": 0.08176,\n        \"precision_at_3\": 0.4482,\n        \"precision_at_5\": 0.29662,\n        \"recall_at_1\": 0.49486,\n        \"recall_at_10\": 0.85983,\n        \"recall_at_100\": 0.92379,\n        \"recall_at_1000\": 0.97179,\n        \"recall_at_20\": 0.87769,\n        \"recall_at_3\": 0.76166,\n        \"recall_at_5\": 0.81523\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/jinaai/jina-embeddings-v3/jinaai__jina-embeddings-v3/215a6e121fa0183376388ac6b1ae230326bfeaed/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 25491.57020497322,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.63716,\n        \"map_at_1\": 0.35427,\n        \"map_at_10\": 0.53931,\n        \"map_at_100\": 0.56379,\n        \"map_at_1000\": 0.56456,\n        \"map_at_20\": 0.55514,\n        \"map_at_3\": 0.47065,\n        \"map_at_5\": 0.50777,\n        \"mrr_at_1\": 0.5868544600938967,\n        \"mrr_at_10\": 0.7000670690811536,\n        \"mrr_at_100\": 0.7034974166221164,\n        \"mrr_at_1000\": 0.7035448268034526,\n        \"mrr_at_20\": 0.7023941629575432,\n        \"mrr_at_3\": 0.6776212832550861,\n        \"mrr_at_5\": 0.6907668231611894,\n        \"nauc_map_at_1000_diff1\": 0.3538606032876468,\n        \"nauc_map_at_1000_max\": 0.30569293033048445,\n        \"nauc_map_at_1000_std\": 0.05336084598734498,\n        \"nauc_map_at_100_diff1\": 0.3539638864548362,\n        \"nauc_map_at_100_max\": 0.3052910650189014,\n        \"nauc_map_at_100_std\": 0.053094415110458495,\n        \"nauc_map_at_10_diff1\": 0.36670236809047213,\n        \"nauc_map_at_10_max\": 0.29209555278562255,\n        \"nauc_map_at_10_std\": 0.027150365173378658,\n        \"nauc_map_at_1_diff1\": 0.5002958094670257,\n        \"nauc_map_at_1_max\": 0.23186362968659052,\n        \"nauc_map_at_1_std\": -0.07863597756490925,\n        \"nauc_map_at_20_diff1\": 0.35482695302369316,\n        \"nauc_map_at_20_max\": 0.29979355976346383,\n        \"nauc_map_at_20_std\": 0.045918334252931396,\n        \"nauc_map_at_3_diff1\": 0.3936843797578524,\n        \"nauc_map_at_3_max\": 0.25104131301314014,\n        \"nauc_map_at_3_std\": -0.042697716050571405,\n        \"nauc_map_at_5_diff1\": 0.3886516261861197,\n        \"nauc_map_at_5_max\": 0.2791491859907928,\n        \"nauc_map_at_5_std\": -0.006220989761089889,\n        \"nauc_mrr_at_1000_diff1\": 0.26291894061688476,\n        \"nauc_mrr_at_1000_max\": 0.4391066247779524,\n        \"nauc_mrr_at_1000_std\": 0.16581006216156477,\n        \"nauc_mrr_at_100_diff1\": 0.26288711136494536,\n        \"nauc_mrr_at_100_max\": 0.4391620469458485,\n        \"nauc_mrr_at_100_std\": 0.1658715626685403,\n        \"nauc_mrr_at_10_diff1\": 0.26327333945185516,\n        \"nauc_mrr_at_10_max\": 0.44341102883000105,\n        \"nauc_mrr_at_10_std\": 0.16561645302869527,\n        \"nauc_mrr_at_1_diff1\": 0.32704171564870577,\n        \"nauc_mrr_at_1_max\": 0.3808335590314431,\n        \"nauc_mrr_at_1_std\": 0.09589191598803506,\n        \"nauc_mrr_at_20_diff1\": 0.26233626230983836,\n        \"nauc_mrr_at_20_max\": 0.43936074098385325,\n        \"nauc_mrr_at_20_std\": 0.16439843164683948,\n        \"nauc_mrr_at_3_diff1\": 0.24495062088317518,\n        \"nauc_mrr_at_3_max\": 0.43702373111006576,\n        \"nauc_mrr_at_3_std\": 0.17206049009398258,\n        \"nauc_mrr_at_5_diff1\": 0.25894678361787016,\n        \"nauc_mrr_at_5_max\": 0.4448638903301484,\n        \"nauc_mrr_at_5_std\": 0.1670169640451593,\n        \"nauc_ndcg_at_1000_diff1\": 0.31157890959803164,\n        \"nauc_ndcg_at_1000_max\": 0.3787818528153347,\n        \"nauc_ndcg_at_1000_std\": 0.1378188447932894,\n        \"nauc_ndcg_at_100_diff1\": 0.31408540427491544,\n        \"nauc_ndcg_at_100_max\": 0.3798291424552418,\n        \"nauc_ndcg_at_100_std\": 0.14054899933149664,\n        \"nauc_ndcg_at_10_diff1\": 0.3340133128816092,\n        \"nauc_ndcg_at_10_max\": 0.3530631227422352,\n        \"nauc_ndcg_at_10_std\": 0.08413970348393185,\n        \"nauc_ndcg_at_1_diff1\": 0.32704171564870577,\n        \"nauc_ndcg_at_1_max\": 0.3808335590314431,\n        \"nauc_ndcg_at_1_std\": 0.09589191598803506,\n        \"nauc_ndcg_at_20_diff1\": 0.31345342246852975,\n        \"nauc_ndcg_at_20_max\": 0.3609002826111666,\n        \"nauc_ndcg_at_20_std\": 0.11523614914186356,\n        \"nauc_ndcg_at_3_diff1\": 0.3049869785748296,\n        \"nauc_ndcg_at_3_max\": 0.31520128443479706,\n        \"nauc_ndcg_at_3_std\": 0.05417152725470993,\n        \"nauc_ndcg_at_5_diff1\": 0.34478365245075243,\n        \"nauc_ndcg_at_5_max\": 0.338438239943765,\n        \"nauc_ndcg_at_5_std\": 0.05851861662259562,\n        \"nauc_precision_at_1000_diff1\": -0.26629851978468416,\n        \"nauc_precision_at_1000_max\": 0.11562956098174823,\n        \"nauc_precision_at_1000_std\": 0.27421924351585414,\n        \"nauc_precision_at_100_diff1\": -0.2527735638671963,\n        \"nauc_precision_at_100_max\": 0.1365209282494595,\n        \"nauc_precision_at_100_std\": 0.2957988594298787,\n        \"nauc_precision_at_10_diff1\": -0.22643208215831126,\n        \"nauc_precision_at_10_max\": 0.20607697750630086,\n        \"nauc_precision_at_10_std\": 0.32229173147305973,\n        \"nauc_precision_at_1_diff1\": 0.32704171564870577,\n        \"nauc_precision_at_1_max\": 0.3808335590314431,\n        \"nauc_precision_at_1_std\": 0.09589191598803506,\n        \"nauc_precision_at_20_diff1\": -0.2662570792892436,\n        \"nauc_precision_at_20_max\": 0.16827088690376713,\n        \"nauc_precision_at_20_std\": 0.32503195274576097,\n        \"nauc_precision_at_3_diff1\": -0.13026666909692144,\n        \"nauc_precision_at_3_max\": 0.2600232366878702,\n        \"nauc_precision_at_3_std\": 0.22074812382745637,\n        \"nauc_precision_at_5_diff1\": -0.16903010461344328,\n        \"nauc_precision_at_5_max\": 0.258303257695209,\n        \"nauc_precision_at_5_std\": 0.2947510670253368,\n        \"nauc_recall_at_1000_diff1\": 0.2964611316607367,\n        \"nauc_recall_at_1000_max\": 0.6546561478690773,\n        \"nauc_recall_at_1000_std\": 0.649403837651015,\n        \"nauc_recall_at_100_diff1\": 0.28004258527111986,\n        \"nauc_recall_at_100_max\": 0.45743295110839927,\n        \"nauc_recall_at_100_std\": 0.35274895339401297,\n        \"nauc_recall_at_10_diff1\": 0.2994792481317373,\n        \"nauc_recall_at_10_max\": 0.3025812872802068,\n        \"nauc_recall_at_10_std\": 0.04293106237441407,\n        \"nauc_recall_at_1_diff1\": 0.5002958094670257,\n        \"nauc_recall_at_1_max\": 0.23186362968659052,\n        \"nauc_recall_at_1_std\": -0.07863597756490925,\n        \"nauc_recall_at_20_diff1\": 0.2364476758056192,\n        \"nauc_recall_at_20_max\": 0.30283747367825137,\n        \"nauc_recall_at_20_std\": 0.13645724497263667,\n        \"nauc_recall_at_3_diff1\": 0.33947285515212827,\n        \"nauc_recall_at_3_max\": 0.22402624108514535,\n        \"nauc_recall_at_3_std\": -0.058609048229718526,\n        \"nauc_recall_at_5_diff1\": 0.3510054602379324,\n        \"nauc_recall_at_5_max\": 0.27941319302455747,\n        \"nauc_recall_at_5_std\": -0.005699858068950503,\n        \"ndcg_at_1\": 0.58685,\n        \"ndcg_at_10\": 0.63716,\n        \"ndcg_at_100\": 0.6936,\n        \"ndcg_at_1000\": 0.70286,\n        \"ndcg_at_20\": 0.66546,\n        \"ndcg_at_3\": 0.5878,\n        \"ndcg_at_5\": 0.60371,\n        \"precision_at_1\": 0.58685,\n        \"precision_at_10\": 0.16761,\n        \"precision_at_100\": 0.02352,\n        \"precision_at_1000\": 0.00252,\n        \"precision_at_20\": 0.09765,\n        \"precision_at_3\": 0.35681,\n        \"precision_at_5\": 0.26479,\n        \"recall_at_1\": 0.35427,\n        \"recall_at_10\": 0.7454,\n        \"recall_at_100\": 0.9241,\n        \"recall_at_1000\": 0.97746,\n        \"recall_at_20\": 0.82278,\n        \"recall_at_3\": 0.54536,\n        \"recall_at_5\": 0.64111\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/jinaai/jina-embeddings-v3/jinaai__jina-embeddings-v3/215a6e121fa0183376388ac6b1ae230326bfeaed/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 25669.12554335594,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.55759,\n        \"map_at_1\": 0.39509,\n        \"map_at_10\": 0.50117,\n        \"map_at_100\": 0.50963,\n        \"map_at_1000\": 0.51001,\n        \"map_at_20\": 0.50643,\n        \"map_at_3\": 0.47037,\n        \"map_at_5\": 0.48954,\n        \"mrr_at_1\": 0.4251781472684085,\n        \"mrr_at_10\": 0.5239405421709459,\n        \"mrr_at_100\": 0.5305428352926489,\n        \"mrr_at_1000\": 0.5308327496755653,\n        \"mrr_at_20\": 0.5283895013787722,\n        \"mrr_at_3\": 0.49683293745051477,\n        \"mrr_at_5\": 0.5141726049089469,\n        \"nauc_map_at_1000_diff1\": 0.35768639217367965,\n        \"nauc_map_at_1000_max\": 0.3127376629580209,\n        \"nauc_map_at_1000_std\": 0.043092776426519014,\n        \"nauc_map_at_100_diff1\": 0.35758257680060296,\n        \"nauc_map_at_100_max\": 0.31288275659144477,\n        \"nauc_map_at_100_std\": 0.04331621897398727,\n        \"nauc_map_at_10_diff1\": 0.358366707566828,\n        \"nauc_map_at_10_max\": 0.3115301607781894,\n        \"nauc_map_at_10_std\": 0.04119729223137315,\n        \"nauc_map_at_1_diff1\": 0.3949573880581667,\n        \"nauc_map_at_1_max\": 0.2941296103717735,\n        \"nauc_map_at_1_std\": 0.01596221803523446,\n        \"nauc_map_at_20_diff1\": 0.3565999350909673,\n        \"nauc_map_at_20_max\": 0.31171024526967717,\n        \"nauc_map_at_20_std\": 0.04207850136539487,\n        \"nauc_map_at_3_diff1\": 0.37185946319709634,\n        \"nauc_map_at_3_max\": 0.31504489843931266,\n        \"nauc_map_at_3_std\": 0.026970161911460212,\n        \"nauc_map_at_5_diff1\": 0.3578279526186646,\n        \"nauc_map_at_5_max\": 0.3132459007812547,\n        \"nauc_map_at_5_std\": 0.03693394458808769,\n        \"nauc_mrr_at_1000_diff1\": 0.37550702514920065,\n        \"nauc_mrr_at_1000_max\": 0.32978063926834633,\n        \"nauc_mrr_at_1000_std\": 0.05199455641912942,\n        \"nauc_mrr_at_100_diff1\": 0.37550262283237407,\n        \"nauc_mrr_at_100_max\": 0.329873044791498,\n        \"nauc_mrr_at_100_std\": 0.0521235638902929,\n        \"nauc_mrr_at_10_diff1\": 0.37424020131037755,\n        \"nauc_mrr_at_10_max\": 0.3286138818338544,\n        \"nauc_mrr_at_10_std\": 0.051066433093199644,\n        \"nauc_mrr_at_1_diff1\": 0.4192345581167409,\n        \"nauc_mrr_at_1_max\": 0.3231101367860559,\n        \"nauc_mrr_at_1_std\": 0.021685405644284943,\n        \"nauc_mrr_at_20_diff1\": 0.3743936968494584,\n        \"nauc_mrr_at_20_max\": 0.32916353278399135,\n        \"nauc_mrr_at_20_std\": 0.05203860723902159,\n        \"nauc_mrr_at_3_diff1\": 0.3847302816551476,\n        \"nauc_mrr_at_3_max\": 0.3347963090797576,\n        \"nauc_mrr_at_3_std\": 0.04498844178608618,\n        \"nauc_mrr_at_5_diff1\": 0.3718607744339898,\n        \"nauc_mrr_at_5_max\": 0.32809428903031135,\n        \"nauc_mrr_at_5_std\": 0.05023093673209267,\n        \"nauc_ndcg_at_1000_diff1\": 0.35232958746898174,\n        \"nauc_ndcg_at_1000_max\": 0.3267938788741968,\n        \"nauc_ndcg_at_1000_std\": 0.07049668808261762,\n        \"nauc_ndcg_at_100_diff1\": 0.34657357607202904,\n        \"nauc_ndcg_at_100_max\": 0.3262411105412631,\n        \"nauc_ndcg_at_100_std\": 0.07721461181768907,\n        \"nauc_ndcg_at_10_diff1\": 0.3420391143687474,\n        \"nauc_ndcg_at_10_max\": 0.3163522985059599,\n        \"nauc_ndcg_at_10_std\": 0.06318839209229431,\n        \"nauc_ndcg_at_1_diff1\": 0.4192345581167409,\n        \"nauc_ndcg_at_1_max\": 0.3231101367860559,\n        \"nauc_ndcg_at_1_std\": 0.021685405644284943,\n        \"nauc_ndcg_at_20_diff1\": 0.3385432035839586,\n        \"nauc_ndcg_at_20_max\": 0.3184889703424418,\n        \"nauc_ndcg_at_20_std\": 0.06815622662433982,\n        \"nauc_ndcg_at_3_diff1\": 0.36622986860695933,\n        \"nauc_ndcg_at_3_max\": 0.32554490444430517,\n        \"nauc_ndcg_at_3_std\": 0.040110507562312735,\n        \"nauc_ndcg_at_5_diff1\": 0.3398974842672672,\n        \"nauc_ndcg_at_5_max\": 0.31829697901112036,\n        \"nauc_ndcg_at_5_std\": 0.05499807904087406,\n        \"nauc_precision_at_1000_diff1\": 0.026143237232001355,\n        \"nauc_precision_at_1000_max\": 0.11022017814202459,\n        \"nauc_precision_at_1000_std\": 0.12788466185750233,\n        \"nauc_precision_at_100_diff1\": 0.05807266851074599,\n        \"nauc_precision_at_100_max\": 0.17341475160832712,\n        \"nauc_precision_at_100_std\": 0.19119373356730543,\n        \"nauc_precision_at_10_diff1\": 0.18924741747564552,\n        \"nauc_precision_at_10_max\": 0.25807631150353,\n        \"nauc_precision_at_10_std\": 0.13675581065614384,\n        \"nauc_precision_at_1_diff1\": 0.4192345581167409,\n        \"nauc_precision_at_1_max\": 0.3231101367860559,\n        \"nauc_precision_at_1_std\": 0.021685405644284943,\n        \"nauc_precision_at_20_diff1\": 0.11656462987214906,\n        \"nauc_precision_at_20_max\": 0.22302218143130395,\n        \"nauc_precision_at_20_std\": 0.14814699825400385,\n        \"nauc_precision_at_3_diff1\": 0.32207915108527485,\n        \"nauc_precision_at_3_max\": 0.34216083411170406,\n        \"nauc_precision_at_3_std\": 0.06928379184934734,\n        \"nauc_precision_at_5_diff1\": 0.22531763594715176,\n        \"nauc_precision_at_5_max\": 0.3100051074487403,\n        \"nauc_precision_at_5_std\": 0.10760600326457498,\n        \"nauc_recall_at_1000_diff1\": 0.3934047833765424,\n        \"nauc_recall_at_1000_max\": 0.6125500319319205,\n        \"nauc_recall_at_1000_std\": 0.4713280539660798,\n        \"nauc_recall_at_100_diff1\": 0.25321522083323295,\n        \"nauc_recall_at_100_max\": 0.4060827868852693,\n        \"nauc_recall_at_100_std\": 0.34986498161422214,\n        \"nauc_recall_at_10_diff1\": 0.25080737050315377,\n        \"nauc_recall_at_10_max\": 0.3019992812742259,\n        \"nauc_recall_at_10_std\": 0.13096854230053764,\n        \"nauc_recall_at_1_diff1\": 0.3949573880581667,\n        \"nauc_recall_at_1_max\": 0.2941296103717735,\n        \"nauc_recall_at_1_std\": 0.01596221803523446,\n        \"nauc_recall_at_20_diff1\": 0.22151949169256163,\n        \"nauc_recall_at_20_max\": 0.31584000828616215,\n        \"nauc_recall_at_20_std\": 0.17824486465526673,\n        \"nauc_recall_at_3_diff1\": 0.3333329644687242,\n        \"nauc_recall_at_3_max\": 0.33303649355475684,\n        \"nauc_recall_at_3_std\": 0.060408299659899106,\n        \"nauc_recall_at_5_diff1\": 0.2568414426238719,\n        \"nauc_recall_at_5_max\": 0.3069180984271601,\n        \"nauc_recall_at_5_std\": 0.09745113228464206,\n        \"ndcg_at_1\": 0.42518,\n        \"ndcg_at_10\": 0.55759,\n        \"ndcg_at_100\": 0.59498,\n        \"ndcg_at_1000\": 0.60508,\n        \"ndcg_at_20\": 0.57564,\n        \"ndcg_at_3\": 0.49833,\n        \"ndcg_at_5\": 0.53163,\n        \"precision_at_1\": 0.42518,\n        \"precision_at_10\": 0.08005,\n        \"precision_at_100\": 0.01017,\n        \"precision_at_1000\": 0.00111,\n        \"precision_at_20\": 0.04454,\n        \"precision_at_3\": 0.20348,\n        \"precision_at_5\": 0.14109,\n        \"recall_at_1\": 0.39509,\n        \"recall_at_10\": 0.70823,\n        \"recall_at_100\": 0.87173,\n        \"recall_at_1000\": 0.95012,\n        \"recall_at_20\": 0.77553,\n        \"recall_at_3\": 0.55384,\n        \"recall_at_5\": 0.63222\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/jinaai/jina-embeddings-v3/jinaai__jina-embeddings-v3/215a6e121fa0183376388ac6b1ae230326bfeaed/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 18277.223182439804,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.30512,\n        \"map_at_1\": 0.195,\n        \"map_at_10\": 0.27131,\n        \"map_at_100\": 0.28206,\n        \"map_at_1000\": 0.28283,\n        \"map_at_20\": 0.27705,\n        \"map_at_3\": 0.25833,\n        \"map_at_5\": 0.26608,\n        \"mrr_at_1\": 0.195,\n        \"mrr_at_10\": 0.2713095238095238,\n        \"mrr_at_100\": 0.2820597065294532,\n        \"mrr_at_1000\": 0.282825812851299,\n        \"mrr_at_20\": 0.27705249274289523,\n        \"mrr_at_3\": 0.2583333333333333,\n        \"mrr_at_5\": 0.2660833333333333,\n        \"nauc_map_at_1000_diff1\": 0.3987585414361193,\n        \"nauc_map_at_1000_max\": 0.3473662893880687,\n        \"nauc_map_at_1000_std\": -0.09380515261794065,\n        \"nauc_map_at_100_diff1\": 0.3982652612420423,\n        \"nauc_map_at_100_max\": 0.34728774894924935,\n        \"nauc_map_at_100_std\": -0.09367496734064513,\n        \"nauc_map_at_10_diff1\": 0.4012067329787962,\n        \"nauc_map_at_10_max\": 0.35114595841736845,\n        \"nauc_map_at_10_std\": -0.09965138320034828,\n        \"nauc_map_at_1_diff1\": 0.4858458319949265,\n        \"nauc_map_at_1_max\": 0.3316695905710263,\n        \"nauc_map_at_1_std\": -0.15254544406282694,\n        \"nauc_map_at_20_diff1\": 0.3985792389914664,\n        \"nauc_map_at_20_max\": 0.34785847989247876,\n        \"nauc_map_at_20_std\": -0.09555232301049926,\n        \"nauc_map_at_3_diff1\": 0.3993831796412346,\n        \"nauc_map_at_3_max\": 0.33816652918508316,\n        \"nauc_map_at_3_std\": -0.12238405377787065,\n        \"nauc_map_at_5_diff1\": 0.4093754976901047,\n        \"nauc_map_at_5_max\": 0.3508738074287637,\n        \"nauc_map_at_5_std\": -0.11071043205048879,\n        \"nauc_mrr_at_1000_diff1\": 0.3987585414361193,\n        \"nauc_mrr_at_1000_max\": 0.3473662893880687,\n        \"nauc_mrr_at_1000_std\": -0.09380515261794065,\n        \"nauc_mrr_at_100_diff1\": 0.3982652612420423,\n        \"nauc_mrr_at_100_max\": 0.34728774894924935,\n        \"nauc_mrr_at_100_std\": -0.09367496734064513,\n        \"nauc_mrr_at_10_diff1\": 0.4012067329787962,\n        \"nauc_mrr_at_10_max\": 0.35114595841736845,\n        \"nauc_mrr_at_10_std\": -0.09965138320034828,\n        \"nauc_mrr_at_1_diff1\": 0.4858458319949265,\n        \"nauc_mrr_at_1_max\": 0.3316695905710263,\n        \"nauc_mrr_at_1_std\": -0.15254544406282694,\n        \"nauc_mrr_at_20_diff1\": 0.3985792389914664,\n        \"nauc_mrr_at_20_max\": 0.34785847989247876,\n        \"nauc_mrr_at_20_std\": -0.09555232301049926,\n        \"nauc_mrr_at_3_diff1\": 0.3993831796412346,\n        \"nauc_mrr_at_3_max\": 0.33816652918508316,\n        \"nauc_mrr_at_3_std\": -0.12238405377787065,\n        \"nauc_mrr_at_5_diff1\": 0.4093754976901047,\n        \"nauc_mrr_at_5_max\": 0.3508738074287637,\n        \"nauc_mrr_at_5_std\": -0.11071043205048879,\n        \"nauc_ndcg_at_1000_diff1\": 0.36310659576315085,\n        \"nauc_ndcg_at_1000_max\": 0.35153095780592464,\n        \"nauc_ndcg_at_1000_std\": -0.037921327018792604,\n        \"nauc_ndcg_at_100_diff1\": 0.35398837871625544,\n        \"nauc_ndcg_at_100_max\": 0.3444722430366631,\n        \"nauc_ndcg_at_100_std\": -0.03749615779295948,\n        \"nauc_ndcg_at_10_diff1\": 0.3775534480968359,\n        \"nauc_ndcg_at_10_max\": 0.36469609198907116,\n        \"nauc_ndcg_at_10_std\": -0.06592871290792952,\n        \"nauc_ndcg_at_1_diff1\": 0.4858458319949265,\n        \"nauc_ndcg_at_1_max\": 0.3316695905710263,\n        \"nauc_ndcg_at_1_std\": -0.15254544406282694,\n        \"nauc_ndcg_at_20_diff1\": 0.3644847342354063,\n        \"nauc_ndcg_at_20_max\": 0.3530827407169127,\n        \"nauc_ndcg_at_20_std\": -0.05043897349253442,\n        \"nauc_ndcg_at_3_diff1\": 0.3797573603059863,\n        \"nauc_ndcg_at_3_max\": 0.3405088627197903,\n        \"nauc_ndcg_at_3_std\": -0.11319623713123547,\n        \"nauc_ndcg_at_5_diff1\": 0.39656109885163643,\n        \"nauc_ndcg_at_5_max\": 0.3629088460780966,\n        \"nauc_ndcg_at_5_std\": -0.09186138574375118,\n        \"nauc_precision_at_1000_diff1\": 0.03953229398663588,\n        \"nauc_precision_at_1000_max\": 0.4081689468660505,\n        \"nauc_precision_at_1000_std\": 0.5251352211263127,\n        \"nauc_precision_at_100_diff1\": 0.14331346383780955,\n        \"nauc_precision_at_100_max\": 0.3019261483142932,\n        \"nauc_precision_at_100_std\": 0.21624003979717482,\n        \"nauc_precision_at_10_diff1\": 0.3135551623028535,\n        \"nauc_precision_at_10_max\": 0.4040585401139285,\n        \"nauc_precision_at_10_std\": 0.032686619218001235,\n        \"nauc_precision_at_1_diff1\": 0.4858458319949265,\n        \"nauc_precision_at_1_max\": 0.3316695905710263,\n        \"nauc_precision_at_1_std\": -0.15254544406282694,\n        \"nauc_precision_at_20_diff1\": 0.25659903034656145,\n        \"nauc_precision_at_20_max\": 0.3622965756203322,\n        \"nauc_precision_at_20_std\": 0.09387947832911026,\n        \"nauc_precision_at_3_diff1\": 0.330077230076566,\n        \"nauc_precision_at_3_max\": 0.34674511418496706,\n        \"nauc_precision_at_3_std\": -0.08911009436280216,\n        \"nauc_precision_at_5_diff1\": 0.3666605727418748,\n        \"nauc_precision_at_5_max\": 0.3969887305919381,\n        \"nauc_precision_at_5_std\": -0.039873855756800025,\n        \"nauc_recall_at_1000_diff1\": 0.03953229398663671,\n        \"nauc_recall_at_1000_max\": 0.4081689468660511,\n        \"nauc_recall_at_1000_std\": 0.5251352211263131,\n        \"nauc_recall_at_100_diff1\": 0.1433134638378088,\n        \"nauc_recall_at_100_max\": 0.3019261483142927,\n        \"nauc_recall_at_100_std\": 0.2162400397971738,\n        \"nauc_recall_at_10_diff1\": 0.31355516230285324,\n        \"nauc_recall_at_10_max\": 0.40405854011392833,\n        \"nauc_recall_at_10_std\": 0.03268661921800123,\n        \"nauc_recall_at_1_diff1\": 0.4858458319949265,\n        \"nauc_recall_at_1_max\": 0.3316695905710263,\n        \"nauc_recall_at_1_std\": -0.15254544406282694,\n        \"nauc_recall_at_20_diff1\": 0.2565990303465613,\n        \"nauc_recall_at_20_max\": 0.36229657562033213,\n        \"nauc_recall_at_20_std\": 0.09387947832911028,\n        \"nauc_recall_at_3_diff1\": 0.330077230076566,\n        \"nauc_recall_at_3_max\": 0.34674511418496695,\n        \"nauc_recall_at_3_std\": -0.0891100943628021,\n        \"nauc_recall_at_5_diff1\": 0.36666057274187436,\n        \"nauc_recall_at_5_max\": 0.39698873059193784,\n        \"nauc_recall_at_5_std\": -0.03987385575680014,\n        \"ndcg_at_1\": 0.195,\n        \"ndcg_at_10\": 0.30512,\n        \"ndcg_at_100\": 0.36182,\n        \"ndcg_at_1000\": 0.38562,\n        \"ndcg_at_20\": 0.3264,\n        \"ndcg_at_3\": 0.27809,\n        \"ndcg_at_5\": 0.29229,\n        \"precision_at_1\": 0.195,\n        \"precision_at_10\": 0.041,\n        \"precision_at_100\": 0.00685,\n        \"precision_at_1000\": 0.00088,\n        \"precision_at_20\": 0.02475,\n        \"precision_at_3\": 0.11167,\n        \"precision_at_5\": 0.074,\n        \"recall_at_1\": 0.195,\n        \"recall_at_10\": 0.41,\n        \"recall_at_100\": 0.685,\n        \"recall_at_1000\": 0.88,\n        \"recall_at_20\": 0.495,\n        \"recall_at_3\": 0.335,\n        \"recall_at_5\": 0.37\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.32286,\n        \"map_at_1\": 0.235,\n        \"map_at_10\": 0.28976,\n        \"map_at_100\": 0.29636,\n        \"map_at_1000\": 0.29717,\n        \"map_at_20\": 0.29224,\n        \"map_at_3\": 0.27083,\n        \"map_at_5\": 0.28308,\n        \"mrr_at_1\": 0.235,\n        \"mrr_at_10\": 0.289763888888889,\n        \"mrr_at_100\": 0.29636360098283915,\n        \"mrr_at_1000\": 0.29716967927805255,\n        \"mrr_at_20\": 0.2922370448179273,\n        \"mrr_at_3\": 0.27083333333333337,\n        \"mrr_at_5\": 0.28308333333333335,\n        \"nauc_map_at_1000_diff1\": 0.49987230321102,\n        \"nauc_map_at_1000_max\": 0.37241054403503265,\n        \"nauc_map_at_1000_std\": -0.014615828090165943,\n        \"nauc_map_at_100_diff1\": 0.4999165899809139,\n        \"nauc_map_at_100_max\": 0.37225331598738776,\n        \"nauc_map_at_100_std\": -0.015118425056351593,\n        \"nauc_map_at_10_diff1\": 0.49672665674569366,\n        \"nauc_map_at_10_max\": 0.3697606912534292,\n        \"nauc_map_at_10_std\": -0.020212373283840207,\n        \"nauc_map_at_1_diff1\": 0.571295785504311,\n        \"nauc_map_at_1_max\": 0.40229277029222615,\n        \"nauc_map_at_1_std\": -0.035268157395582166,\n        \"nauc_map_at_20_diff1\": 0.5009344455788867,\n        \"nauc_map_at_20_max\": 0.37195164827322513,\n        \"nauc_map_at_20_std\": -0.018461911265518847,\n        \"nauc_map_at_3_diff1\": 0.5100392656898904,\n        \"nauc_map_at_3_max\": 0.36405669989453676,\n        \"nauc_map_at_3_std\": -0.04279185609333193,\n        \"nauc_map_at_5_diff1\": 0.5063385834276932,\n        \"nauc_map_at_5_max\": 0.37114301949476286,\n        \"nauc_map_at_5_std\": -0.022538869520912948,\n        \"nauc_mrr_at_1000_diff1\": 0.49987230321102,\n        \"nauc_mrr_at_1000_max\": 0.37241054403503265,\n        \"nauc_mrr_at_1000_std\": -0.014615828090165943,\n        \"nauc_mrr_at_100_diff1\": 0.4999165899809139,\n        \"nauc_mrr_at_100_max\": 0.37225331598738776,\n        \"nauc_mrr_at_100_std\": -0.015118425056351593,\n        \"nauc_mrr_at_10_diff1\": 0.49672665674569366,\n        \"nauc_mrr_at_10_max\": 0.3697606912534292,\n        \"nauc_mrr_at_10_std\": -0.020212373283840207,\n        \"nauc_mrr_at_1_diff1\": 0.571295785504311,\n        \"nauc_mrr_at_1_max\": 0.40229277029222615,\n        \"nauc_mrr_at_1_std\": -0.035268157395582166,\n        \"nauc_mrr_at_20_diff1\": 0.5009344455788867,\n        \"nauc_mrr_at_20_max\": 0.37195164827322513,\n        \"nauc_mrr_at_20_std\": -0.018461911265518847,\n        \"nauc_mrr_at_3_diff1\": 0.5100392656898904,\n        \"nauc_mrr_at_3_max\": 0.36405669989453676,\n        \"nauc_mrr_at_3_std\": -0.04279185609333193,\n        \"nauc_mrr_at_5_diff1\": 0.5063385834276932,\n        \"nauc_mrr_at_5_max\": 0.37114301949476286,\n        \"nauc_mrr_at_5_std\": -0.022538869520912948,\n        \"nauc_ndcg_at_1000_diff1\": 0.4773076374940932,\n        \"nauc_ndcg_at_1000_max\": 0.38199768395620914,\n        \"nauc_ndcg_at_1000_std\": 0.03989285210339253,\n        \"nauc_ndcg_at_100_diff1\": 0.46702331084570764,\n        \"nauc_ndcg_at_100_max\": 0.372772171990568,\n        \"nauc_ndcg_at_100_std\": 0.03503234220335347,\n        \"nauc_ndcg_at_10_diff1\": 0.46391339381565455,\n        \"nauc_ndcg_at_10_max\": 0.36411117503372015,\n        \"nauc_ndcg_at_10_std\": -3.265755317002024e-07,\n        \"nauc_ndcg_at_1_diff1\": 0.571295785504311,\n        \"nauc_ndcg_at_1_max\": 0.40229277029222615,\n        \"nauc_ndcg_at_1_std\": -0.035268157395582166,\n        \"nauc_ndcg_at_20_diff1\": 0.4787179235043199,\n        \"nauc_ndcg_at_20_max\": 0.3726808078472696,\n        \"nauc_ndcg_at_20_std\": 0.007987911883677817,\n        \"nauc_ndcg_at_3_diff1\": 0.4945273149712954,\n        \"nauc_ndcg_at_3_max\": 0.35345218197867073,\n        \"nauc_ndcg_at_3_std\": -0.04348168510957773,\n        \"nauc_ndcg_at_5_diff1\": 0.48712478424651734,\n        \"nauc_ndcg_at_5_max\": 0.3657748679819708,\n        \"nauc_ndcg_at_5_std\": -0.007269476847689231,\n        \"nauc_precision_at_1000_diff1\": 0.42128930501023487,\n        \"nauc_precision_at_1000_max\": 0.5748179469109707,\n        \"nauc_precision_at_1000_std\": 0.575690459411389,\n        \"nauc_precision_at_100_diff1\": 0.3335762077124369,\n        \"nauc_precision_at_100_max\": 0.3844074648615614,\n        \"nauc_precision_at_100_std\": 0.2778639590090725,\n        \"nauc_precision_at_10_diff1\": 0.36711708782562363,\n        \"nauc_precision_at_10_max\": 0.3518422182049919,\n        \"nauc_precision_at_10_std\": 0.06350548178590516,\n        \"nauc_precision_at_1_diff1\": 0.571295785504311,\n        \"nauc_precision_at_1_max\": 0.40229277029222615,\n        \"nauc_precision_at_1_std\": -0.035268157395582166,\n        \"nauc_precision_at_20_diff1\": 0.4210910814065983,\n        \"nauc_precision_at_20_max\": 0.3851363358145596,\n        \"nauc_precision_at_20_std\": 0.09729434451530505,\n        \"nauc_precision_at_3_diff1\": 0.4534210103821043,\n        \"nauc_precision_at_3_max\": 0.32502943380070665,\n        \"nauc_precision_at_3_std\": -0.04488654607727709,\n        \"nauc_precision_at_5_diff1\": 0.43536883243771396,\n        \"nauc_precision_at_5_max\": 0.3532258589806222,\n        \"nauc_precision_at_5_std\": 0.03872333496173276,\n        \"nauc_recall_at_1000_diff1\": 0.4212893050102354,\n        \"nauc_recall_at_1000_max\": 0.5748179469109707,\n        \"nauc_recall_at_1000_std\": 0.5756904594113896,\n        \"nauc_recall_at_100_diff1\": 0.3335762077124369,\n        \"nauc_recall_at_100_max\": 0.38440746486156113,\n        \"nauc_recall_at_100_std\": 0.2778639590090725,\n        \"nauc_recall_at_10_diff1\": 0.3671170878256232,\n        \"nauc_recall_at_10_max\": 0.35184221820499156,\n        \"nauc_recall_at_10_std\": 0.06350548178590472,\n        \"nauc_recall_at_1_diff1\": 0.571295785504311,\n        \"nauc_recall_at_1_max\": 0.40229277029222615,\n        \"nauc_recall_at_1_std\": -0.035268157395582166,\n        \"nauc_recall_at_20_diff1\": 0.4210910814065985,\n        \"nauc_recall_at_20_max\": 0.38513633581455947,\n        \"nauc_recall_at_20_std\": 0.09729434451530516,\n        \"nauc_recall_at_3_diff1\": 0.45342101038210425,\n        \"nauc_recall_at_3_max\": 0.3250294338007064,\n        \"nauc_recall_at_3_std\": -0.04488654607727737,\n        \"nauc_recall_at_5_diff1\": 0.4353688324377136,\n        \"nauc_recall_at_5_max\": 0.3532258589806219,\n        \"nauc_recall_at_5_std\": 0.03872333496173255,\n        \"ndcg_at_1\": 0.235,\n        \"ndcg_at_10\": 0.32286,\n        \"ndcg_at_100\": 0.36221,\n        \"ndcg_at_1000\": 0.38925,\n        \"ndcg_at_20\": 0.33177,\n        \"ndcg_at_3\": 0.28339,\n        \"ndcg_at_5\": 0.30576,\n        \"precision_at_1\": 0.235,\n        \"precision_at_10\": 0.043,\n        \"precision_at_100\": 0.0063,\n        \"precision_at_1000\": 0.00086,\n        \"precision_at_20\": 0.02325,\n        \"precision_at_3\": 0.10667,\n        \"precision_at_5\": 0.075,\n        \"recall_at_1\": 0.235,\n        \"recall_at_10\": 0.43,\n        \"recall_at_100\": 0.63,\n        \"recall_at_1000\": 0.855,\n        \"recall_at_20\": 0.465,\n        \"recall_at_3\": 0.32,\n        \"recall_at_5\": 0.375\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/jinaai/jina-embeddings-v3/jinaai__jina-embeddings-v3/215a6e121fa0183376388ac6b1ae230326bfeaed/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 2.920142412185669,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.83059,\n        \"map_at_1\": 0.72727,\n        \"map_at_10\": 0.79388,\n        \"map_at_100\": 0.79692,\n        \"map_at_1000\": 0.79692,\n        \"map_at_20\": 0.79649,\n        \"map_at_3\": 0.77273,\n        \"map_at_5\": 0.78571,\n        \"mrr_at_1\": 0.7272727272727273,\n        \"mrr_at_10\": 0.7938775510204082,\n        \"mrr_at_100\": 0.7969205864163847,\n        \"mrr_at_1000\": 0.7969205864163847,\n        \"mrr_at_20\": 0.7964876859834844,\n        \"mrr_at_3\": 0.7727272727272728,\n        \"mrr_at_5\": 0.7857142857142858,\n        \"nauc_map_at_1000_diff1\": 0.7711878770997442,\n        \"nauc_map_at_1000_max\": 0.4194451984915928,\n        \"nauc_map_at_1000_std\": -0.12084263394274973,\n        \"nauc_map_at_100_diff1\": 0.7711878770997442,\n        \"nauc_map_at_100_max\": 0.4194451984915928,\n        \"nauc_map_at_100_std\": -0.12084263394274973,\n        \"nauc_map_at_10_diff1\": 0.7731327921140855,\n        \"nauc_map_at_10_max\": 0.4149630080279758,\n        \"nauc_map_at_10_std\": -0.11395438175046349,\n        \"nauc_map_at_1_diff1\": 0.7684401693767324,\n        \"nauc_map_at_1_max\": 0.41777799933942383,\n        \"nauc_map_at_1_std\": -0.11502937969975355,\n        \"nauc_map_at_20_diff1\": 0.7706768155924971,\n        \"nauc_map_at_20_max\": 0.42081663944031555,\n        \"nauc_map_at_20_std\": -0.11924645739568039,\n        \"nauc_map_at_3_diff1\": 0.7705914898088022,\n        \"nauc_map_at_3_max\": 0.4117800788620658,\n        \"nauc_map_at_3_std\": -0.14835870908303095,\n        \"nauc_map_at_5_diff1\": 0.7784917987924511,\n        \"nauc_map_at_5_max\": 0.4193041458114639,\n        \"nauc_map_at_5_std\": -0.14401255779763072,\n        \"nauc_mrr_at_1000_diff1\": 0.7711878770997442,\n        \"nauc_mrr_at_1000_max\": 0.4194451984915928,\n        \"nauc_mrr_at_1000_std\": -0.12084263394274973,\n        \"nauc_mrr_at_100_diff1\": 0.7711878770997442,\n        \"nauc_mrr_at_100_max\": 0.4194451984915928,\n        \"nauc_mrr_at_100_std\": -0.12084263394274973,\n        \"nauc_mrr_at_10_diff1\": 0.7731327921140855,\n        \"nauc_mrr_at_10_max\": 0.4149630080279758,\n        \"nauc_mrr_at_10_std\": -0.11395438175046349,\n        \"nauc_mrr_at_1_diff1\": 0.7684401693767324,\n        \"nauc_mrr_at_1_max\": 0.41777799933942383,\n        \"nauc_mrr_at_1_std\": -0.11502937969975355,\n        \"nauc_mrr_at_20_diff1\": 0.7706768155924971,\n        \"nauc_mrr_at_20_max\": 0.42081663944031555,\n        \"nauc_mrr_at_20_std\": -0.11924645739568039,\n        \"nauc_mrr_at_3_diff1\": 0.7705914898088022,\n        \"nauc_mrr_at_3_max\": 0.4117800788620658,\n        \"nauc_mrr_at_3_std\": -0.14835870908303095,\n        \"nauc_mrr_at_5_diff1\": 0.7784917987924511,\n        \"nauc_mrr_at_5_max\": 0.4193041458114639,\n        \"nauc_mrr_at_5_std\": -0.14401255779763072,\n        \"nauc_ndcg_at_1000_diff1\": 0.77360058189681,\n        \"nauc_ndcg_at_1000_max\": 0.4194356326749995,\n        \"nauc_ndcg_at_1000_std\": -0.11839678586793939,\n        \"nauc_ndcg_at_100_diff1\": 0.77360058189681,\n        \"nauc_ndcg_at_100_max\": 0.4194356326749995,\n        \"nauc_ndcg_at_100_std\": -0.11839678586793939,\n        \"nauc_ndcg_at_10_diff1\": 0.7811901296021619,\n        \"nauc_ndcg_at_10_max\": 0.40235956792512756,\n        \"nauc_ndcg_at_10_std\": -0.08244172952345144,\n        \"nauc_ndcg_at_1_diff1\": 0.7684401693767324,\n        \"nauc_ndcg_at_1_max\": 0.41777799933942383,\n        \"nauc_ndcg_at_1_std\": -0.11502937969975355,\n        \"nauc_ndcg_at_20_diff1\": 0.7696320195793978,\n        \"nauc_ndcg_at_20_max\": 0.4299680418339879,\n        \"nauc_ndcg_at_20_std\": -0.10618302323604849,\n        \"nauc_ndcg_at_3_diff1\": 0.7798864907322665,\n        \"nauc_ndcg_at_3_max\": 0.40461393835085435,\n        \"nauc_ndcg_at_3_std\": -0.17216329739386393,\n        \"nauc_ndcg_at_5_diff1\": 0.7960670192269287,\n        \"nauc_ndcg_at_5_max\": 0.4182363168980118,\n        \"nauc_ndcg_at_5_std\": -0.16648908400791346,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.8558898391832962,\n        \"nauc_precision_at_10_max\": 0.24031819702144644,\n        \"nauc_precision_at_10_std\": 0.3456539015073844,\n        \"nauc_precision_at_1_diff1\": 0.7684401693767324,\n        \"nauc_precision_at_1_max\": 0.41777799933942383,\n        \"nauc_precision_at_1_std\": -0.11502937969975355,\n        \"nauc_precision_at_20_diff1\": 0.5548466542608996,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 0.5548466542608996,\n        \"nauc_precision_at_3_diff1\": 0.8174093269102958,\n        \"nauc_precision_at_3_max\": 0.3763299073053593,\n        \"nauc_precision_at_3_std\": -0.2641254997849845,\n        \"nauc_precision_at_5_diff1\": 0.8889212754660993,\n        \"nauc_precision_at_5_max\": 0.4130763535290174,\n        \"nauc_precision_at_5_std\": -0.2802349509686518,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.855889839183298,\n        \"nauc_recall_at_10_max\": 0.24031819702144214,\n        \"nauc_recall_at_10_std\": 0.3456539015073782,\n        \"nauc_recall_at_1_diff1\": 0.7684401693767324,\n        \"nauc_recall_at_1_max\": 0.41777799933942383,\n        \"nauc_recall_at_1_std\": -0.11502937969975355,\n        \"nauc_recall_at_20_diff1\": 0.5548466542608921,\n        \"nauc_recall_at_20_max\": 1.0,\n        \"nauc_recall_at_20_std\": 0.5548466542608921,\n        \"nauc_recall_at_3_diff1\": 0.8174093269102954,\n        \"nauc_recall_at_3_max\": 0.3763299073053579,\n        \"nauc_recall_at_3_std\": -0.264125499784987,\n        \"nauc_recall_at_5_diff1\": 0.8889212754660999,\n        \"nauc_recall_at_5_max\": 0.4130763535290157,\n        \"nauc_recall_at_5_std\": -0.28023495096865575,\n        \"ndcg_at_1\": 0.72727,\n        \"ndcg_at_10\": 0.83059,\n        \"ndcg_at_100\": 0.84295,\n        \"ndcg_at_1000\": 0.84295,\n        \"ndcg_at_20\": 0.84033,\n        \"ndcg_at_3\": 0.78772,\n        \"ndcg_at_5\": 0.8101,\n        \"precision_at_1\": 0.72727,\n        \"precision_at_10\": 0.09481,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04935,\n        \"precision_at_3\": 0.27706,\n        \"precision_at_5\": 0.17662,\n        \"recall_at_1\": 0.72727,\n        \"recall_at_10\": 0.94805,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98701,\n        \"recall_at_3\": 0.83117,\n        \"recall_at_5\": 0.88312\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/jinaai/jina-embeddings-v3/jinaai__jina-embeddings-v3/215a6e121fa0183376388ac6b1ae230326bfeaed/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 56.67747497558594,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.41272,\n        \"map_at_1\": 0.2278,\n        \"map_at_10\": 0.36059,\n        \"map_at_100\": 0.37682,\n        \"map_at_1000\": 0.3779,\n        \"map_at_20\": 0.37011,\n        \"map_at_3\": 0.31887,\n        \"map_at_5\": 0.34439,\n        \"mrr_at_1\": 0.3256880733944954,\n        \"mrr_at_10\": 0.39670889762632877,\n        \"mrr_at_100\": 0.40823785596071943,\n        \"mrr_at_1000\": 0.40895929543989445,\n        \"mrr_at_20\": 0.40345750777926914,\n        \"mrr_at_3\": 0.37079510703363927,\n        \"mrr_at_5\": 0.3851681957186544,\n        \"nauc_map_at_1000_diff1\": 0.3986349246433768,\n        \"nauc_map_at_1000_max\": 0.270056315928616,\n        \"nauc_map_at_1000_std\": -0.2995773555241248,\n        \"nauc_map_at_100_diff1\": 0.3981539647860276,\n        \"nauc_map_at_100_max\": 0.26985257487081127,\n        \"nauc_map_at_100_std\": -0.29917691881901637,\n        \"nauc_map_at_10_diff1\": 0.4005826917242611,\n        \"nauc_map_at_10_max\": 0.26944691669751575,\n        \"nauc_map_at_10_std\": -0.3080734589306485,\n        \"nauc_map_at_1_diff1\": 0.5537918873542623,\n        \"nauc_map_at_1_max\": 0.23598262232798495,\n        \"nauc_map_at_1_std\": -0.280734302808289,\n        \"nauc_map_at_20_diff1\": 0.39753222673837235,\n        \"nauc_map_at_20_max\": 0.26668810318015923,\n        \"nauc_map_at_20_std\": -0.30326743096985315,\n        \"nauc_map_at_3_diff1\": 0.43653927487324706,\n        \"nauc_map_at_3_max\": 0.28162209617369505,\n        \"nauc_map_at_3_std\": -0.2983177222727111,\n        \"nauc_map_at_5_diff1\": 0.40367560513004136,\n        \"nauc_map_at_5_max\": 0.2699722571975168,\n        \"nauc_map_at_5_std\": -0.3091694992647524,\n        \"nauc_mrr_at_1000_diff1\": 0.41742567194309316,\n        \"nauc_mrr_at_1000_max\": 0.2820274297138866,\n        \"nauc_mrr_at_1000_std\": -0.3018893641253346,\n        \"nauc_mrr_at_100_diff1\": 0.4172364490671897,\n        \"nauc_mrr_at_100_max\": 0.2822267655441534,\n        \"nauc_mrr_at_100_std\": -0.30138980130897775,\n        \"nauc_mrr_at_10_diff1\": 0.4157358712718055,\n        \"nauc_mrr_at_10_max\": 0.2816783228400729,\n        \"nauc_mrr_at_10_std\": -0.306050948512259,\n        \"nauc_mrr_at_1_diff1\": 0.46818090820086133,\n        \"nauc_mrr_at_1_max\": 0.29005758430178175,\n        \"nauc_mrr_at_1_std\": -0.3121692789770937,\n        \"nauc_mrr_at_20_diff1\": 0.415385717783091,\n        \"nauc_mrr_at_20_max\": 0.28080951122709097,\n        \"nauc_mrr_at_20_std\": -0.3021692911975301,\n        \"nauc_mrr_at_3_diff1\": 0.4311479156241253,\n        \"nauc_mrr_at_3_max\": 0.2794712072601227,\n        \"nauc_mrr_at_3_std\": -0.3142678714409581,\n        \"nauc_mrr_at_5_diff1\": 0.4191764166827879,\n        \"nauc_mrr_at_5_max\": 0.27731591547418033,\n        \"nauc_mrr_at_5_std\": -0.3115256041998101,\n        \"nauc_ndcg_at_1000_diff1\": 0.3871236683473045,\n        \"nauc_ndcg_at_1000_max\": 0.27785009471536276,\n        \"nauc_ndcg_at_1000_std\": -0.28313792161123275,\n        \"nauc_ndcg_at_100_diff1\": 0.3796164282303305,\n        \"nauc_ndcg_at_100_max\": 0.27848400403373913,\n        \"nauc_ndcg_at_100_std\": -0.2703759465076034,\n        \"nauc_ndcg_at_10_diff1\": 0.37786294135057596,\n        \"nauc_ndcg_at_10_max\": 0.2666940160427433,\n        \"nauc_ndcg_at_10_std\": -0.3054250955363569,\n        \"nauc_ndcg_at_1_diff1\": 0.46818090820086133,\n        \"nauc_ndcg_at_1_max\": 0.29005758430178175,\n        \"nauc_ndcg_at_1_std\": -0.3121692789770937,\n        \"nauc_ndcg_at_20_diff1\": 0.3681411672128963,\n        \"nauc_ndcg_at_20_max\": 0.2595929246670804,\n        \"nauc_ndcg_at_20_std\": -0.2894346139742596,\n        \"nauc_ndcg_at_3_diff1\": 0.4159717306246669,\n        \"nauc_ndcg_at_3_max\": 0.2761781698823905,\n        \"nauc_ndcg_at_3_std\": -0.3077653844871884,\n        \"nauc_ndcg_at_5_diff1\": 0.38586966345751245,\n        \"nauc_ndcg_at_5_max\": 0.26496204815418567,\n        \"nauc_ndcg_at_5_std\": -0.31286943575059006,\n        \"nauc_precision_at_1000_diff1\": -0.14270436916844806,\n        \"nauc_precision_at_1000_max\": 0.16425763194215595,\n        \"nauc_precision_at_1000_std\": 0.06244073872574862,\n        \"nauc_precision_at_100_diff1\": -0.07711500789191686,\n        \"nauc_precision_at_100_max\": 0.18697597542703154,\n        \"nauc_precision_at_100_std\": 0.028796920726206685,\n        \"nauc_precision_at_10_diff1\": 0.05996282095605551,\n        \"nauc_precision_at_10_max\": 0.19845035281828807,\n        \"nauc_precision_at_10_std\": -0.21365705395109136,\n        \"nauc_precision_at_1_diff1\": 0.46818090820086133,\n        \"nauc_precision_at_1_max\": 0.29005758430178175,\n        \"nauc_precision_at_1_std\": -0.3121692789770937,\n        \"nauc_precision_at_20_diff1\": -0.00267670668235737,\n        \"nauc_precision_at_20_max\": 0.1562177469875502,\n        \"nauc_precision_at_20_std\": -0.15212370508658465,\n        \"nauc_precision_at_3_diff1\": 0.1820797182649027,\n        \"nauc_precision_at_3_max\": 0.2695441385762009,\n        \"nauc_precision_at_3_std\": -0.2555002518667556,\n        \"nauc_precision_at_5_diff1\": 0.09317805884242907,\n        \"nauc_precision_at_5_max\": 0.21814113346085354,\n        \"nauc_precision_at_5_std\": -0.24796979874344902,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.2682562964253447,\n        \"nauc_recall_at_100_max\": 0.3042738281713388,\n        \"nauc_recall_at_100_std\": -0.05638100774172797,\n        \"nauc_recall_at_10_diff1\": 0.2840213882598167,\n        \"nauc_recall_at_10_max\": 0.23509166753266306,\n        \"nauc_recall_at_10_std\": -0.287616611982279,\n        \"nauc_recall_at_1_diff1\": 0.5537918873542623,\n        \"nauc_recall_at_1_max\": 0.23598262232798495,\n        \"nauc_recall_at_1_std\": -0.280734302808289,\n        \"nauc_recall_at_20_diff1\": 0.2360234237411498,\n        \"nauc_recall_at_20_max\": 0.20401243027726493,\n        \"nauc_recall_at_20_std\": -0.22432250204647355,\n        \"nauc_recall_at_3_diff1\": 0.3880967451963076,\n        \"nauc_recall_at_3_max\": 0.26597328508638085,\n        \"nauc_recall_at_3_std\": -0.2925767551949979,\n        \"nauc_recall_at_5_diff1\": 0.31396729989609323,\n        \"nauc_recall_at_5_max\": 0.23783285556474018,\n        \"nauc_recall_at_5_std\": -0.3109615047535852,\n        \"ndcg_at_1\": 0.32569,\n        \"ndcg_at_10\": 0.41272,\n        \"ndcg_at_100\": 0.48506,\n        \"ndcg_at_1000\": 0.50662,\n        \"ndcg_at_20\": 0.44224,\n        \"ndcg_at_3\": 0.3491,\n        \"ndcg_at_5\": 0.37955,\n        \"precision_at_1\": 0.32569,\n        \"precision_at_10\": 0.08685,\n        \"precision_at_100\": 0.01369,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.05161,\n        \"precision_at_3\": 0.19725,\n        \"precision_at_5\": 0.14495,\n        \"recall_at_1\": 0.2278,\n        \"recall_at_10\": 0.5329,\n        \"recall_at_100\": 0.84544,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.63693,\n        \"recall_at_3\": 0.36621,\n        \"recall_at_5\": 0.4408\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.37842,\n        \"map_at_1\": 0.1815,\n        \"map_at_10\": 0.32196,\n        \"map_at_100\": 0.33971,\n        \"map_at_1000\": 0.3412,\n        \"map_at_20\": 0.33094,\n        \"map_at_3\": 0.27112,\n        \"map_at_5\": 0.30222,\n        \"mrr_at_1\": 0.308868501529052,\n        \"mrr_at_10\": 0.3830026455026454,\n        \"mrr_at_100\": 0.3926271293660191,\n        \"mrr_at_1000\": 0.39333624218330904,\n        \"mrr_at_20\": 0.3874286203634769,\n        \"mrr_at_3\": 0.3588175331294598,\n        \"mrr_at_5\": 0.3708970438328237,\n        \"nauc_map_at_1000_diff1\": 0.34960257110425647,\n        \"nauc_map_at_1000_max\": 0.17485055091809065,\n        \"nauc_map_at_1000_std\": -0.3643929345214113,\n        \"nauc_map_at_100_diff1\": 0.3498111374525095,\n        \"nauc_map_at_100_max\": 0.17383876312682625,\n        \"nauc_map_at_100_std\": -0.36514910056851757,\n        \"nauc_map_at_10_diff1\": 0.3517695153014903,\n        \"nauc_map_at_10_max\": 0.1712516330827489,\n        \"nauc_map_at_10_std\": -0.3709969243384287,\n        \"nauc_map_at_1_diff1\": 0.4389487356981317,\n        \"nauc_map_at_1_max\": 0.13070144601986813,\n        \"nauc_map_at_1_std\": -0.3257177968261257,\n        \"nauc_map_at_20_diff1\": 0.35150108432175453,\n        \"nauc_map_at_20_max\": 0.1732034757031926,\n        \"nauc_map_at_20_std\": -0.3694300615140005,\n        \"nauc_map_at_3_diff1\": 0.37487194965631493,\n        \"nauc_map_at_3_max\": 0.1554453027838439,\n        \"nauc_map_at_3_std\": -0.3660209323134048,\n        \"nauc_map_at_5_diff1\": 0.3582798160112775,\n        \"nauc_map_at_5_max\": 0.17274661077722417,\n        \"nauc_map_at_5_std\": -0.3662379164960217,\n        \"nauc_mrr_at_1000_diff1\": 0.33320372878371957,\n        \"nauc_mrr_at_1000_max\": 0.17229056799897927,\n        \"nauc_mrr_at_1000_std\": -0.3572354959222832,\n        \"nauc_mrr_at_100_diff1\": 0.33304522516161006,\n        \"nauc_mrr_at_100_max\": 0.17227506166169268,\n        \"nauc_mrr_at_100_std\": -0.35686316755936126,\n        \"nauc_mrr_at_10_diff1\": 0.32924862992084486,\n        \"nauc_mrr_at_10_max\": 0.17008699502436947,\n        \"nauc_mrr_at_10_std\": -0.36143807221850954,\n        \"nauc_mrr_at_1_diff1\": 0.40000594128429456,\n        \"nauc_mrr_at_1_max\": 0.18713315063533922,\n        \"nauc_mrr_at_1_std\": -0.36482574431254056,\n        \"nauc_mrr_at_20_diff1\": 0.3321526172498427,\n        \"nauc_mrr_at_20_max\": 0.1716268070758386,\n        \"nauc_mrr_at_20_std\": -0.3582418906714954,\n        \"nauc_mrr_at_3_diff1\": 0.34332399650158973,\n        \"nauc_mrr_at_3_max\": 0.166974823366417,\n        \"nauc_mrr_at_3_std\": -0.3667690569859602,\n        \"nauc_mrr_at_5_diff1\": 0.3332286480105909,\n        \"nauc_mrr_at_5_max\": 0.1709185280029645,\n        \"nauc_mrr_at_5_std\": -0.3629173129534889,\n        \"nauc_ndcg_at_1000_diff1\": 0.32373166349302934,\n        \"nauc_ndcg_at_1000_max\": 0.1858059225739381,\n        \"nauc_ndcg_at_1000_std\": -0.34015450334779784,\n        \"nauc_ndcg_at_100_diff1\": 0.3242121817496865,\n        \"nauc_ndcg_at_100_max\": 0.18022093662951252,\n        \"nauc_ndcg_at_100_std\": -0.3375038271705809,\n        \"nauc_ndcg_at_10_diff1\": 0.32455074708282194,\n        \"nauc_ndcg_at_10_max\": 0.16615377791035843,\n        \"nauc_ndcg_at_10_std\": -0.3731626507503713,\n        \"nauc_ndcg_at_1_diff1\": 0.40000594128429456,\n        \"nauc_ndcg_at_1_max\": 0.18713315063533922,\n        \"nauc_ndcg_at_1_std\": -0.36482574431254056,\n        \"nauc_ndcg_at_20_diff1\": 0.32698955871944246,\n        \"nauc_ndcg_at_20_max\": 0.16997034992597687,\n        \"nauc_ndcg_at_20_std\": -0.36750360083621514,\n        \"nauc_ndcg_at_3_diff1\": 0.3436379653839748,\n        \"nauc_ndcg_at_3_max\": 0.16313575812628048,\n        \"nauc_ndcg_at_3_std\": -0.36953626791892746,\n        \"nauc_ndcg_at_5_diff1\": 0.3365356003484116,\n        \"nauc_ndcg_at_5_max\": 0.17035446999498027,\n        \"nauc_ndcg_at_5_std\": -0.37041579827735527,\n        \"nauc_precision_at_1000_diff1\": -0.11479120592320564,\n        \"nauc_precision_at_1000_max\": 0.18532885988969905,\n        \"nauc_precision_at_1000_std\": 0.09181657680195955,\n        \"nauc_precision_at_100_diff1\": -0.027723270420175344,\n        \"nauc_precision_at_100_max\": 0.1804800858662913,\n        \"nauc_precision_at_100_std\": -0.002671742958024478,\n        \"nauc_precision_at_10_diff1\": 0.10625793640540403,\n        \"nauc_precision_at_10_max\": 0.17103040268214398,\n        \"nauc_precision_at_10_std\": -0.24522215545298606,\n        \"nauc_precision_at_1_diff1\": 0.40000594128429456,\n        \"nauc_precision_at_1_max\": 0.18713315063533922,\n        \"nauc_precision_at_1_std\": -0.36482574431254056,\n        \"nauc_precision_at_20_diff1\": 0.08115934112015194,\n        \"nauc_precision_at_20_max\": 0.17243668491400857,\n        \"nauc_precision_at_20_std\": -0.19145773832420498,\n        \"nauc_precision_at_3_diff1\": 0.20449380728257122,\n        \"nauc_precision_at_3_max\": 0.18721037486519035,\n        \"nauc_precision_at_3_std\": -0.3022611337135435,\n        \"nauc_precision_at_5_diff1\": 0.1525188864909601,\n        \"nauc_precision_at_5_max\": 0.19713305548617693,\n        \"nauc_precision_at_5_std\": -0.26661909838876846,\n        \"nauc_recall_at_1000_diff1\": 0.31723599245329515,\n        \"nauc_recall_at_1000_max\": 0.8078769144027147,\n        \"nauc_recall_at_1000_std\": 0.5661298338911104,\n        \"nauc_recall_at_100_diff1\": 0.26528024492414976,\n        \"nauc_recall_at_100_max\": 0.17958589910696324,\n        \"nauc_recall_at_100_std\": -0.16203827885804548,\n        \"nauc_recall_at_10_diff1\": 0.26503688174517775,\n        \"nauc_recall_at_10_max\": 0.13462330096229136,\n        \"nauc_recall_at_10_std\": -0.3740352999875769,\n        \"nauc_recall_at_1_diff1\": 0.4389487356981317,\n        \"nauc_recall_at_1_max\": 0.13070144601986813,\n        \"nauc_recall_at_1_std\": -0.3257177968261257,\n        \"nauc_recall_at_20_diff1\": 0.27969933464128294,\n        \"nauc_recall_at_20_max\": 0.1362455670688532,\n        \"nauc_recall_at_20_std\": -0.36929345951037745,\n        \"nauc_recall_at_3_diff1\": 0.3270194544815536,\n        \"nauc_recall_at_3_max\": 0.1300087809804867,\n        \"nauc_recall_at_3_std\": -0.37113956325500835,\n        \"nauc_recall_at_5_diff1\": 0.2922894050062497,\n        \"nauc_recall_at_5_max\": 0.1490330127476058,\n        \"nauc_recall_at_5_std\": -0.37110288849601253,\n        \"ndcg_at_1\": 0.30887,\n        \"ndcg_at_10\": 0.37842,\n        \"ndcg_at_100\": 0.45658,\n        \"ndcg_at_1000\": 0.48338,\n        \"ndcg_at_20\": 0.40231,\n        \"ndcg_at_3\": 0.32192,\n        \"ndcg_at_5\": 0.34213,\n        \"precision_at_1\": 0.30887,\n        \"precision_at_10\": 0.10046,\n        \"precision_at_100\": 0.01654,\n        \"precision_at_1000\": 0.00195,\n        \"precision_at_20\": 0.05894,\n        \"precision_at_3\": 0.21254,\n        \"precision_at_5\": 0.16116,\n        \"recall_at_1\": 0.1815,\n        \"recall_at_10\": 0.47497,\n        \"recall_at_100\": 0.81081,\n        \"recall_at_1000\": 0.99541,\n        \"recall_at_20\": 0.55089,\n        \"recall_at_3\": 0.31254,\n        \"recall_at_5\": 0.38252\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.40223,\n        \"map_at_1\": 0.21299,\n        \"map_at_10\": 0.34846,\n        \"map_at_100\": 0.36474,\n        \"map_at_1000\": 0.36602,\n        \"map_at_20\": 0.3575,\n        \"map_at_3\": 0.3062,\n        \"map_at_5\": 0.33126,\n        \"mrr_at_1\": 0.30944625407166126,\n        \"mrr_at_10\": 0.3896153249573444,\n        \"mrr_at_100\": 0.4003699212287417,\n        \"mrr_at_1000\": 0.4011819839650043,\n        \"mrr_at_20\": 0.3959947132991476,\n        \"mrr_at_3\": 0.3637350705754616,\n        \"mrr_at_5\": 0.37741585233441916,\n        \"nauc_map_at_1000_diff1\": 0.3938221230645532,\n        \"nauc_map_at_1000_max\": 0.19625194395439952,\n        \"nauc_map_at_1000_std\": -0.294610595078822,\n        \"nauc_map_at_100_diff1\": 0.39295853338115067,\n        \"nauc_map_at_100_max\": 0.19638087558933384,\n        \"nauc_map_at_100_std\": -0.29389410176273423,\n        \"nauc_map_at_10_diff1\": 0.3996875180636347,\n        \"nauc_map_at_10_max\": 0.19161522554768412,\n        \"nauc_map_at_10_std\": -0.30393649399067396,\n        \"nauc_map_at_1_diff1\": 0.5313204171828388,\n        \"nauc_map_at_1_max\": 0.128356899752893,\n        \"nauc_map_at_1_std\": -0.30478917758174107,\n        \"nauc_map_at_20_diff1\": 0.3928799169599587,\n        \"nauc_map_at_20_max\": 0.19069973379303265,\n        \"nauc_map_at_20_std\": -0.2999390962991156,\n        \"nauc_map_at_3_diff1\": 0.42998007649481695,\n        \"nauc_map_at_3_max\": 0.1981280295393313,\n        \"nauc_map_at_3_std\": -0.30182869125853073,\n        \"nauc_map_at_5_diff1\": 0.4095094249935181,\n        \"nauc_map_at_5_max\": 0.19213544756315376,\n        \"nauc_map_at_5_std\": -0.3121213859877235,\n        \"nauc_mrr_at_1000_diff1\": 0.41329312260501055,\n        \"nauc_mrr_at_1000_max\": 0.22256546352384424,\n        \"nauc_mrr_at_1000_std\": -0.2615215661882381,\n        \"nauc_mrr_at_100_diff1\": 0.4128214900473252,\n        \"nauc_mrr_at_100_max\": 0.22302683998816905,\n        \"nauc_mrr_at_100_std\": -0.26068224887493174,\n        \"nauc_mrr_at_10_diff1\": 0.4150293639606534,\n        \"nauc_mrr_at_10_max\": 0.22143723479359165,\n        \"nauc_mrr_at_10_std\": -0.26424389757331473,\n        \"nauc_mrr_at_1_diff1\": 0.45950523789844566,\n        \"nauc_mrr_at_1_max\": 0.212384855922023,\n        \"nauc_mrr_at_1_std\": -0.2903672779891095,\n        \"nauc_mrr_at_20_diff1\": 0.41203878019046625,\n        \"nauc_mrr_at_20_max\": 0.2214042859918071,\n        \"nauc_mrr_at_20_std\": -0.26177487417580636,\n        \"nauc_mrr_at_3_diff1\": 0.4296857380310018,\n        \"nauc_mrr_at_3_max\": 0.22033601859056587,\n        \"nauc_mrr_at_3_std\": -0.27386519411362786,\n        \"nauc_mrr_at_5_diff1\": 0.41735491637004696,\n        \"nauc_mrr_at_5_max\": 0.2186850687203513,\n        \"nauc_mrr_at_5_std\": -0.2726504552695364,\n        \"nauc_ndcg_at_1000_diff1\": 0.38055336452170857,\n        \"nauc_ndcg_at_1000_max\": 0.21849504565789374,\n        \"nauc_ndcg_at_1000_std\": -0.2606109672159647,\n        \"nauc_ndcg_at_100_diff1\": 0.36409748024563005,\n        \"nauc_ndcg_at_100_max\": 0.22659367268973427,\n        \"nauc_ndcg_at_100_std\": -0.24038803575013593,\n        \"nauc_ndcg_at_10_diff1\": 0.3784656842619079,\n        \"nauc_ndcg_at_10_max\": 0.19918626187829117,\n        \"nauc_ndcg_at_10_std\": -0.2823101234456151,\n        \"nauc_ndcg_at_1_diff1\": 0.45950523789844566,\n        \"nauc_ndcg_at_1_max\": 0.212384855922023,\n        \"nauc_ndcg_at_1_std\": -0.2903672779891095,\n        \"nauc_ndcg_at_20_diff1\": 0.36056300913528344,\n        \"nauc_ndcg_at_20_max\": 0.19460362878213833,\n        \"nauc_ndcg_at_20_std\": -0.271733284598135,\n        \"nauc_ndcg_at_3_diff1\": 0.4132197548547503,\n        \"nauc_ndcg_at_3_max\": 0.20930222238796498,\n        \"nauc_ndcg_at_3_std\": -0.2901717567296085,\n        \"nauc_ndcg_at_5_diff1\": 0.39295566654495695,\n        \"nauc_ndcg_at_5_max\": 0.19730365676943964,\n        \"nauc_ndcg_at_5_std\": -0.30373276370527186,\n        \"nauc_precision_at_1000_diff1\": -0.10224146102287582,\n        \"nauc_precision_at_1000_max\": 0.260939691014381,\n        \"nauc_precision_at_1000_std\": 0.17467020896444718,\n        \"nauc_precision_at_100_diff1\": -0.07151893728003765,\n        \"nauc_precision_at_100_max\": 0.2909177879066712,\n        \"nauc_precision_at_100_std\": 0.14859534211857378,\n        \"nauc_precision_at_10_diff1\": 0.07640552089770371,\n        \"nauc_precision_at_10_max\": 0.20909361194189371,\n        \"nauc_precision_at_10_std\": -0.12620522925239366,\n        \"nauc_precision_at_1_diff1\": 0.45950523789844566,\n        \"nauc_precision_at_1_max\": 0.212384855922023,\n        \"nauc_precision_at_1_std\": -0.2903672779891095,\n        \"nauc_precision_at_20_diff1\": 0.005183844322358487,\n        \"nauc_precision_at_20_max\": 0.1895615818885953,\n        \"nauc_precision_at_20_std\": -0.07614703524831418,\n        \"nauc_precision_at_3_diff1\": 0.20528382610923085,\n        \"nauc_precision_at_3_max\": 0.2568535683149407,\n        \"nauc_precision_at_3_std\": -0.21011193797063527,\n        \"nauc_precision_at_5_diff1\": 0.1350809038263745,\n        \"nauc_precision_at_5_max\": 0.21494250884185573,\n        \"nauc_precision_at_5_std\": -0.20641992216879387,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.16128929663116692,\n        \"nauc_recall_at_100_max\": 0.3322887006507102,\n        \"nauc_recall_at_100_std\": 0.03544452371521469,\n        \"nauc_recall_at_10_diff1\": 0.2895975117034754,\n        \"nauc_recall_at_10_max\": 0.17920042543312975,\n        \"nauc_recall_at_10_std\": -0.24172817505144845,\n        \"nauc_recall_at_1_diff1\": 0.5313204171828388,\n        \"nauc_recall_at_1_max\": 0.128356899752893,\n        \"nauc_recall_at_1_std\": -0.30478917758174107,\n        \"nauc_recall_at_20_diff1\": 0.21900103521061778,\n        \"nauc_recall_at_20_max\": 0.1523084242145846,\n        \"nauc_recall_at_20_std\": -0.20233485015860317,\n        \"nauc_recall_at_3_diff1\": 0.39265123892543263,\n        \"nauc_recall_at_3_max\": 0.20090609438025173,\n        \"nauc_recall_at_3_std\": -0.2828331887306345,\n        \"nauc_recall_at_5_diff1\": 0.33216577481355436,\n        \"nauc_recall_at_5_max\": 0.17840365515545123,\n        \"nauc_recall_at_5_std\": -0.30304571681383957,\n        \"ndcg_at_1\": 0.30945,\n        \"ndcg_at_10\": 0.40223,\n        \"ndcg_at_100\": 0.47296,\n        \"ndcg_at_1000\": 0.49856,\n        \"ndcg_at_20\": 0.42947,\n        \"ndcg_at_3\": 0.34064,\n        \"ndcg_at_5\": 0.3688,\n        \"precision_at_1\": 0.30945,\n        \"precision_at_10\": 0.08925,\n        \"precision_at_100\": 0.01419,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.05252,\n        \"precision_at_3\": 0.19815,\n        \"precision_at_5\": 0.14593,\n        \"recall_at_1\": 0.21299,\n        \"recall_at_10\": 0.51805,\n        \"recall_at_100\": 0.81796,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.61218,\n        \"recall_at_3\": 0.3574,\n        \"recall_at_5\": 0.4282\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/jinaai/jina-embeddings-v3/jinaai__jina-embeddings-v3/215a6e121fa0183376388ac6b1ae230326bfeaed/model_meta.json",
    "content": "{\"name\": \"jinaai/jina-embeddings-v3\", \"revision\": \"215a6e121fa0183376388ac6b1ae230326bfeaed\", \"release_date\": \"2024-09-18\", \"languages\": [\"afr_Latn\", \"amh_Latn\", \"ara_Latn\", \"asm_Latn\", \"aze_Latn\", \"bel_Latn\", \"bul_Latn\", \"ben_Latn\", \"ben_Beng\", \"bre_Latn\", \"bos_Latn\", \"cat_Latn\", \"ces_Latn\", \"cym_Latn\", \"dan_Latn\", \"deu_Latn\", \"ell_Latn\", \"eng_Latn\", \"epo_Latn\", \"spa_Latn\", \"est_Latn\", \"eus_Latn\", \"fas_Latn\", \"fin_Latn\", \"fra_Latn\", \"fry_Latn\", \"gle_Latn\", \"gla_Latn\", \"glg_Latn\", \"guj_Latn\", \"hau_Latn\", \"heb_Latn\", \"hin_Latn\", \"hin_Deva\", \"hrv_Latn\", \"hun_Latn\", \"hye_Latn\", \"ind_Latn\", \"isl_Latn\", \"ita_Latn\", \"jpn_Latn\", \"jav_Latn\", \"kat_Latn\", \"kaz_Latn\", \"khm_Latn\", \"kan_Latn\", \"kor_Latn\", \"kur_Latn\", \"kir_Latn\", \"lat_Latn\", \"lao_Latn\", \"lit_Latn\", \"lav_Latn\", \"mlg_Latn\", \"mkd_Latn\", \"mal_Latn\", \"mon_Latn\", \"mar_Latn\", \"msa_Latn\", \"mya_Latn\", \"nep_Latn\", \"nld_Latn\", \"nob_Latn\", \"orm_Latn\", \"ori_Latn\", \"pan_Latn\", \"pol_Latn\", \"pus_Latn\", \"por_Latn\", \"ron_Latn\", \"rus_Latn\", \"san_Latn\", \"snd_Latn\", \"sin_Latn\", \"slk_Latn\", \"slv_Latn\", \"som_Latn\", \"sqi_Latn\", \"srp_Latn\", \"sun_Latn\", \"swe_Latn\", \"swa_Latn\", \"tam_Latn\", \"tam_Taml\", \"tel_Latn\", \"tel_Telu\", \"tha_Latn\", \"tgl_Latn\", \"tur_Latn\", \"uig_Latn\", \"ukr_Latn\", \"urd_Latn\", \"urd_Arab\", \"uzb_Latn\", \"vie_Latn\", \"xho_Latn\", \"yid_Latn\", \"zho_Hant\", \"zho_Hans\"], \"n_parameters\": 572000000, \"memory_usage\": null, \"max_tokens\": 8194, \"embed_dim\": 4096, \"license\": \"cc-by-nc-4.0\", \"open_weights\": true, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"Sentence Transformers\", \"PyTorch\"], \"reference\": \"https://huggingface.co/jinaai/jina-embeddings-v3\", \"similarity_fn_name\": \"cosine\", \"use_instructions\": false, \"zero_shot_benchmarks\": null, \"loader\": \"JinaWrapper\"}"
  },
  {
    "path": "eval/results/nlpai-lab/KURE-v1/nlpai-lab__KURE-v1/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"task_name\": \"AutoRAGRetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.73684,\n        \"ndcg_at_3\": 0.84847,\n        \"ndcg_at_5\": 0.86243,\n        \"ndcg_at_10\": 0.87076,\n        \"ndcg_at_20\": 0.8751,\n        \"ndcg_at_100\": 0.8751,\n        \"ndcg_at_1000\": 0.8751,\n        \"map_at_1\": 0.73684,\n        \"map_at_3\": 0.8231,\n        \"map_at_5\": 0.83056,\n        \"map_at_10\": 0.83388,\n        \"map_at_20\": 0.83501,\n        \"map_at_100\": 0.83501,\n        \"map_at_1000\": 0.83501,\n        \"recall_at_1\": 0.73684,\n        \"recall_at_3\": 0.92105,\n        \"recall_at_5\": 0.95614,\n        \"recall_at_10\": 0.98246,\n        \"recall_at_20\": 1.0,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.73684,\n        \"precision_at_3\": 0.30702,\n        \"precision_at_5\": 0.19123,\n        \"precision_at_10\": 0.09825,\n        \"precision_at_20\": 0.05,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.736842,\n        \"mrr_at_3\": 0.823099,\n        \"mrr_at_5\": 0.830556,\n        \"mrr_at_10\": 0.83388,\n        \"mrr_at_20\": 0.835013,\n        \"mrr_at_100\": 0.835013,\n        \"mrr_at_1000\": 0.835013,\n        \"nauc_ndcg_at_1_max\": 0.071494,\n        \"nauc_ndcg_at_1_std\": -0.574049,\n        \"nauc_ndcg_at_1_diff1\": 0.85592,\n        \"nauc_ndcg_at_3_max\": 0.225962,\n        \"nauc_ndcg_at_3_std\": -0.62872,\n        \"nauc_ndcg_at_3_diff1\": 0.813741,\n        \"nauc_ndcg_at_5_max\": 0.210624,\n        \"nauc_ndcg_at_5_std\": -0.666077,\n        \"nauc_ndcg_at_5_diff1\": 0.836702,\n        \"nauc_ndcg_at_10_max\": 0.164149,\n        \"nauc_ndcg_at_10_std\": -0.641323,\n        \"nauc_ndcg_at_10_diff1\": 0.835098,\n        \"nauc_ndcg_at_20_max\": 0.149825,\n        \"nauc_ndcg_at_20_std\": -0.628672,\n        \"nauc_ndcg_at_20_diff1\": 0.839869,\n        \"nauc_ndcg_at_100_max\": 0.149825,\n        \"nauc_ndcg_at_100_std\": -0.628672,\n        \"nauc_ndcg_at_100_diff1\": 0.839869,\n        \"nauc_ndcg_at_1000_max\": 0.149825,\n        \"nauc_ndcg_at_1000_std\": -0.628672,\n        \"nauc_ndcg_at_1000_diff1\": 0.839869,\n        \"nauc_map_at_1_max\": 0.071494,\n        \"nauc_map_at_1_std\": -0.574049,\n        \"nauc_map_at_1_diff1\": 0.85592,\n        \"nauc_map_at_3_max\": 0.168506,\n        \"nauc_map_at_3_std\": -0.616759,\n        \"nauc_map_at_3_diff1\": 0.829642,\n        \"nauc_map_at_5_max\": 0.158708,\n        \"nauc_map_at_5_std\": -0.633542,\n        \"nauc_map_at_5_diff1\": 0.840851,\n        \"nauc_map_at_10_max\": 0.142977,\n        \"nauc_map_at_10_std\": -0.625369,\n        \"nauc_map_at_10_diff1\": 0.840596,\n        \"nauc_map_at_20_max\": 0.140008,\n        \"nauc_map_at_20_std\": -0.622612,\n        \"nauc_map_at_20_diff1\": 0.841608,\n        \"nauc_map_at_100_max\": 0.140008,\n        \"nauc_map_at_100_std\": -0.622612,\n        \"nauc_map_at_100_diff1\": 0.841608,\n        \"nauc_map_at_1000_max\": 0.140008,\n        \"nauc_map_at_1000_std\": -0.622612,\n        \"nauc_map_at_1000_diff1\": 0.841608,\n        \"nauc_recall_at_1_max\": 0.071494,\n        \"nauc_recall_at_1_std\": -0.574049,\n        \"nauc_recall_at_1_diff1\": 0.85592,\n        \"nauc_recall_at_3_max\": 0.567546,\n        \"nauc_recall_at_3_std\": -0.693225,\n        \"nauc_recall_at_3_diff1\": 0.719042,\n        \"nauc_recall_at_5_max\": 0.734426,\n        \"nauc_recall_at_5_std\": -0.999727,\n        \"nauc_recall_at_5_diff1\": 0.803349,\n        \"nauc_recall_at_10_max\": 0.539967,\n        \"nauc_recall_at_10_std\": -0.962931,\n        \"nauc_recall_at_10_diff1\": 0.712274,\n        \"nauc_recall_at_20_max\": NaN,\n        \"nauc_recall_at_20_std\": NaN,\n        \"nauc_recall_at_20_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.071494,\n        \"nauc_precision_at_1_std\": -0.574049,\n        \"nauc_precision_at_1_diff1\": 0.85592,\n        \"nauc_precision_at_3_max\": 0.567546,\n        \"nauc_precision_at_3_std\": -0.693225,\n        \"nauc_precision_at_3_diff1\": 0.719042,\n        \"nauc_precision_at_5_max\": 0.734426,\n        \"nauc_precision_at_5_std\": -0.999727,\n        \"nauc_precision_at_5_diff1\": 0.803349,\n        \"nauc_precision_at_10_max\": 0.539967,\n        \"nauc_precision_at_10_std\": -0.962931,\n        \"nauc_precision_at_10_diff1\": 0.712274,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 1.0,\n        \"nauc_precision_at_20_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_mrr_at_1_max\": 0.071494,\n        \"nauc_mrr_at_1_std\": -0.574049,\n        \"nauc_mrr_at_1_diff1\": 0.85592,\n        \"nauc_mrr_at_3_max\": 0.168506,\n        \"nauc_mrr_at_3_std\": -0.616759,\n        \"nauc_mrr_at_3_diff1\": 0.829642,\n        \"nauc_mrr_at_5_max\": 0.158708,\n        \"nauc_mrr_at_5_std\": -0.633542,\n        \"nauc_mrr_at_5_diff1\": 0.840851,\n        \"nauc_mrr_at_10_max\": 0.142977,\n        \"nauc_mrr_at_10_std\": -0.625369,\n        \"nauc_mrr_at_10_diff1\": 0.840596,\n        \"nauc_mrr_at_20_max\": 0.140008,\n        \"nauc_mrr_at_20_std\": -0.622612,\n        \"nauc_mrr_at_20_diff1\": 0.841608,\n        \"nauc_mrr_at_100_max\": 0.140008,\n        \"nauc_mrr_at_100_std\": -0.622612,\n        \"nauc_mrr_at_100_diff1\": 0.841608,\n        \"nauc_mrr_at_1000_max\": 0.140008,\n        \"nauc_mrr_at_1000_std\": -0.622612,\n        \"nauc_mrr_at_1000_diff1\": 0.841608,\n        \"main_score\": 0.87076,\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 23.355713367462158,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KURE-v1/nlpai-lab__KURE-v1/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"task_name\": \"BelebeleRetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.90778,\n        \"ndcg_at_3\": 0.94389,\n        \"ndcg_at_5\": 0.948,\n        \"ndcg_at_10\": 0.95019,\n        \"ndcg_at_20\": 0.95047,\n        \"ndcg_at_100\": 0.95212,\n        \"ndcg_at_1000\": 0.95285,\n        \"map_at_1\": 0.90778,\n        \"map_at_3\": 0.93556,\n        \"map_at_5\": 0.93783,\n        \"map_at_10\": 0.93876,\n        \"map_at_20\": 0.93883,\n        \"map_at_100\": 0.93907,\n        \"map_at_1000\": 0.9391,\n        \"recall_at_1\": 0.90778,\n        \"recall_at_3\": 0.96778,\n        \"recall_at_5\": 0.97778,\n        \"recall_at_10\": 0.98444,\n        \"recall_at_20\": 0.98556,\n        \"recall_at_100\": 0.99444,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.90778,\n        \"precision_at_3\": 0.32259,\n        \"precision_at_5\": 0.19556,\n        \"precision_at_10\": 0.09844,\n        \"precision_at_20\": 0.04928,\n        \"precision_at_100\": 0.00994,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.907778,\n        \"mrr_at_3\": 0.935556,\n        \"mrr_at_5\": 0.937833,\n        \"mrr_at_10\": 0.938756,\n        \"mrr_at_20\": 0.93883,\n        \"mrr_at_100\": 0.939068,\n        \"mrr_at_1000\": 0.939097,\n        \"nauc_ndcg_at_1_max\": 0.803545,\n        \"nauc_ndcg_at_1_std\": -0.058582,\n        \"nauc_ndcg_at_1_diff1\": 0.924882,\n        \"nauc_ndcg_at_3_max\": 0.84107,\n        \"nauc_ndcg_at_3_std\": -0.042141,\n        \"nauc_ndcg_at_3_diff1\": 0.930107,\n        \"nauc_ndcg_at_5_max\": 0.838696,\n        \"nauc_ndcg_at_5_std\": -0.006393,\n        \"nauc_ndcg_at_5_diff1\": 0.928079,\n        \"nauc_ndcg_at_10_max\": 0.835397,\n        \"nauc_ndcg_at_10_std\": -0.034705,\n        \"nauc_ndcg_at_10_diff1\": 0.928834,\n        \"nauc_ndcg_at_20_max\": 0.834474,\n        \"nauc_ndcg_at_20_std\": -0.035588,\n        \"nauc_ndcg_at_20_diff1\": 0.929168,\n        \"nauc_ndcg_at_100_max\": 0.832028,\n        \"nauc_ndcg_at_100_std\": -0.023947,\n        \"nauc_ndcg_at_100_diff1\": 0.928054,\n        \"nauc_ndcg_at_1000_max\": 0.829818,\n        \"nauc_ndcg_at_1000_std\": -0.034697,\n        \"nauc_ndcg_at_1000_diff1\": 0.927751,\n        \"nauc_map_at_1_max\": 0.803545,\n        \"nauc_map_at_1_std\": -0.058582,\n        \"nauc_map_at_1_diff1\": 0.924882,\n        \"nauc_map_at_3_max\": 0.828584,\n        \"nauc_map_at_3_std\": -0.050976,\n        \"nauc_map_at_3_diff1\": 0.927852,\n        \"nauc_map_at_5_max\": 0.827058,\n        \"nauc_map_at_5_std\": -0.034059,\n        \"nauc_map_at_5_diff1\": 0.926786,\n        \"nauc_map_at_10_max\": 0.825674,\n        \"nauc_map_at_10_std\": -0.044254,\n        \"nauc_map_at_10_diff1\": 0.926887,\n        \"nauc_map_at_20_max\": 0.825463,\n        \"nauc_map_at_20_std\": -0.044456,\n        \"nauc_map_at_20_diff1\": 0.926957,\n        \"nauc_map_at_100_max\": 0.825211,\n        \"nauc_map_at_100_std\": -0.042846,\n        \"nauc_map_at_100_diff1\": 0.926884,\n        \"nauc_map_at_1000_max\": 0.825138,\n        \"nauc_map_at_1000_std\": -0.043204,\n        \"nauc_map_at_1000_diff1\": 0.926874,\n        \"nauc_recall_at_1_max\": 0.803545,\n        \"nauc_recall_at_1_std\": -0.058582,\n        \"nauc_recall_at_1_diff1\": 0.924882,\n        \"nauc_recall_at_3_max\": 0.912747,\n        \"nauc_recall_at_3_std\": 0.011462,\n        \"nauc_recall_at_3_diff1\": 0.943495,\n        \"nauc_recall_at_5_max\": 0.931139,\n        \"nauc_recall_at_5_std\": 0.231162,\n        \"nauc_recall_at_5_diff1\": 0.938492,\n        \"nauc_recall_at_10_max\": 0.940143,\n        \"nauc_recall_at_10_std\": 0.058023,\n        \"nauc_recall_at_10_diff1\": 0.953315,\n        \"nauc_recall_at_20_max\": 0.935538,\n        \"nauc_recall_at_20_std\": 0.053042,\n        \"nauc_recall_at_20_diff1\": 0.959779,\n        \"nauc_recall_at_100_max\": 0.973856,\n        \"nauc_recall_at_100_std\": 0.661158,\n        \"nauc_recall_at_100_diff1\": 0.947712,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.803545,\n        \"nauc_precision_at_1_std\": -0.058582,\n        \"nauc_precision_at_1_diff1\": 0.924882,\n        \"nauc_precision_at_3_max\": 0.912747,\n        \"nauc_precision_at_3_std\": 0.011462,\n        \"nauc_precision_at_3_diff1\": 0.943495,\n        \"nauc_precision_at_5_max\": 0.931139,\n        \"nauc_precision_at_5_std\": 0.231162,\n        \"nauc_precision_at_5_diff1\": 0.938492,\n        \"nauc_precision_at_10_max\": 0.940143,\n        \"nauc_precision_at_10_std\": 0.058023,\n        \"nauc_precision_at_10_diff1\": 0.953315,\n        \"nauc_precision_at_20_max\": 0.935538,\n        \"nauc_precision_at_20_std\": 0.053042,\n        \"nauc_precision_at_20_diff1\": 0.959779,\n        \"nauc_precision_at_100_max\": 0.973856,\n        \"nauc_precision_at_100_std\": 0.661158,\n        \"nauc_precision_at_100_diff1\": 0.947712,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.803545,\n        \"nauc_mrr_at_1_std\": -0.058582,\n        \"nauc_mrr_at_1_diff1\": 0.924882,\n        \"nauc_mrr_at_3_max\": 0.828584,\n        \"nauc_mrr_at_3_std\": -0.050976,\n        \"nauc_mrr_at_3_diff1\": 0.927852,\n        \"nauc_mrr_at_5_max\": 0.827058,\n        \"nauc_mrr_at_5_std\": -0.034059,\n        \"nauc_mrr_at_5_diff1\": 0.926786,\n        \"nauc_mrr_at_10_max\": 0.825674,\n        \"nauc_mrr_at_10_std\": -0.044254,\n        \"nauc_mrr_at_10_diff1\": 0.926887,\n        \"nauc_mrr_at_20_max\": 0.825463,\n        \"nauc_mrr_at_20_std\": -0.044456,\n        \"nauc_mrr_at_20_diff1\": 0.926957,\n        \"nauc_mrr_at_100_max\": 0.825211,\n        \"nauc_mrr_at_100_std\": -0.042846,\n        \"nauc_mrr_at_100_diff1\": 0.926884,\n        \"nauc_mrr_at_1000_max\": 0.825138,\n        \"nauc_mrr_at_1000_std\": -0.043204,\n        \"nauc_mrr_at_1000_diff1\": 0.926874,\n        \"main_score\": 0.95019,\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.85556,\n        \"ndcg_at_3\": 0.91315,\n        \"ndcg_at_5\": 0.91587,\n        \"ndcg_at_10\": 0.92367,\n        \"ndcg_at_20\": 0.92533,\n        \"ndcg_at_100\": 0.92614,\n        \"ndcg_at_1000\": 0.92671,\n        \"map_at_1\": 0.85556,\n        \"map_at_3\": 0.89889,\n        \"map_at_5\": 0.90039,\n        \"map_at_10\": 0.90376,\n        \"map_at_20\": 0.9042,\n        \"map_at_100\": 0.90431,\n        \"map_at_1000\": 0.90433,\n        \"recall_at_1\": 0.85556,\n        \"recall_at_3\": 0.95444,\n        \"recall_at_5\": 0.96111,\n        \"recall_at_10\": 0.98444,\n        \"recall_at_20\": 0.99111,\n        \"recall_at_100\": 0.99556,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.85556,\n        \"precision_at_3\": 0.31815,\n        \"precision_at_5\": 0.19222,\n        \"precision_at_10\": 0.09844,\n        \"precision_at_20\": 0.04956,\n        \"precision_at_100\": 0.00996,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.855556,\n        \"mrr_at_3\": 0.898889,\n        \"mrr_at_5\": 0.900389,\n        \"mrr_at_10\": 0.903761,\n        \"mrr_at_20\": 0.904204,\n        \"mrr_at_100\": 0.904305,\n        \"mrr_at_1000\": 0.904328,\n        \"nauc_ndcg_at_1_max\": 0.740968,\n        \"nauc_ndcg_at_1_std\": -0.085018,\n        \"nauc_ndcg_at_1_diff1\": 0.906555,\n        \"nauc_ndcg_at_3_max\": 0.7718,\n        \"nauc_ndcg_at_3_std\": -0.020834,\n        \"nauc_ndcg_at_3_diff1\": 0.887238,\n        \"nauc_ndcg_at_5_max\": 0.766817,\n        \"nauc_ndcg_at_5_std\": -0.024873,\n        \"nauc_ndcg_at_5_diff1\": 0.88571,\n        \"nauc_ndcg_at_10_max\": 0.764196,\n        \"nauc_ndcg_at_10_std\": -0.011096,\n        \"nauc_ndcg_at_10_diff1\": 0.886106,\n        \"nauc_ndcg_at_20_max\": 0.760449,\n        \"nauc_ndcg_at_20_std\": -0.027665,\n        \"nauc_ndcg_at_20_diff1\": 0.887146,\n        \"nauc_ndcg_at_100_max\": 0.761483,\n        \"nauc_ndcg_at_100_std\": -0.02794,\n        \"nauc_ndcg_at_100_diff1\": 0.89009,\n        \"nauc_ndcg_at_1000_max\": 0.759555,\n        \"nauc_ndcg_at_1000_std\": -0.034295,\n        \"nauc_ndcg_at_1000_diff1\": 0.890284,\n        \"nauc_map_at_1_max\": 0.740968,\n        \"nauc_map_at_1_std\": -0.085018,\n        \"nauc_map_at_1_diff1\": 0.906555,\n        \"nauc_map_at_3_max\": 0.76093,\n        \"nauc_map_at_3_std\": -0.043628,\n        \"nauc_map_at_3_diff1\": 0.892675,\n        \"nauc_map_at_5_max\": 0.758503,\n        \"nauc_map_at_5_std\": -0.045672,\n        \"nauc_map_at_5_diff1\": 0.892024,\n        \"nauc_map_at_10_max\": 0.7573,\n        \"nauc_map_at_10_std\": -0.041865,\n        \"nauc_map_at_10_diff1\": 0.892401,\n        \"nauc_map_at_20_max\": 0.756524,\n        \"nauc_map_at_20_std\": -0.045332,\n        \"nauc_map_at_20_diff1\": 0.892601,\n        \"nauc_map_at_100_max\": 0.756602,\n        \"nauc_map_at_100_std\": -0.045248,\n        \"nauc_map_at_100_diff1\": 0.892845,\n        \"nauc_map_at_1000_max\": 0.756542,\n        \"nauc_map_at_1000_std\": -0.04542,\n        \"nauc_map_at_1000_diff1\": 0.89285,\n        \"nauc_recall_at_1_max\": 0.740968,\n        \"nauc_recall_at_1_std\": -0.085018,\n        \"nauc_recall_at_1_diff1\": 0.906555,\n        \"nauc_recall_at_3_max\": 0.839755,\n        \"nauc_recall_at_3_std\": 0.121815,\n        \"nauc_recall_at_3_diff1\": 0.854433,\n        \"nauc_recall_at_5_max\": 0.825023,\n        \"nauc_recall_at_5_std\": 0.123436,\n        \"nauc_recall_at_5_diff1\": 0.84115,\n        \"nauc_recall_at_10_max\": 0.87445,\n        \"nauc_recall_at_10_std\": 0.546552,\n        \"nauc_recall_at_10_diff1\": 0.779445,\n        \"nauc_recall_at_20_max\": 0.831349,\n        \"nauc_recall_at_20_std\": 0.411881,\n        \"nauc_recall_at_20_diff1\": 0.737162,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.780696,\n        \"nauc_recall_at_100_diff1\": 0.865196,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.740968,\n        \"nauc_precision_at_1_std\": -0.085018,\n        \"nauc_precision_at_1_diff1\": 0.906555,\n        \"nauc_precision_at_3_max\": 0.839755,\n        \"nauc_precision_at_3_std\": 0.121815,\n        \"nauc_precision_at_3_diff1\": 0.854433,\n        \"nauc_precision_at_5_max\": 0.825023,\n        \"nauc_precision_at_5_std\": 0.123436,\n        \"nauc_precision_at_5_diff1\": 0.84115,\n        \"nauc_precision_at_10_max\": 0.87445,\n        \"nauc_precision_at_10_std\": 0.546552,\n        \"nauc_precision_at_10_diff1\": 0.779445,\n        \"nauc_precision_at_20_max\": 0.831349,\n        \"nauc_precision_at_20_std\": 0.411881,\n        \"nauc_precision_at_20_diff1\": 0.737162,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.780696,\n        \"nauc_precision_at_100_diff1\": 0.865196,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.740968,\n        \"nauc_mrr_at_1_std\": -0.085018,\n        \"nauc_mrr_at_1_diff1\": 0.906555,\n        \"nauc_mrr_at_3_max\": 0.76093,\n        \"nauc_mrr_at_3_std\": -0.043628,\n        \"nauc_mrr_at_3_diff1\": 0.892675,\n        \"nauc_mrr_at_5_max\": 0.758503,\n        \"nauc_mrr_at_5_std\": -0.045672,\n        \"nauc_mrr_at_5_diff1\": 0.892024,\n        \"nauc_mrr_at_10_max\": 0.7573,\n        \"nauc_mrr_at_10_std\": -0.041865,\n        \"nauc_mrr_at_10_diff1\": 0.892401,\n        \"nauc_mrr_at_20_max\": 0.756524,\n        \"nauc_mrr_at_20_std\": -0.045332,\n        \"nauc_mrr_at_20_diff1\": 0.892601,\n        \"nauc_mrr_at_100_max\": 0.756602,\n        \"nauc_mrr_at_100_std\": -0.045248,\n        \"nauc_mrr_at_100_diff1\": 0.892845,\n        \"nauc_mrr_at_1000_max\": 0.756542,\n        \"nauc_mrr_at_1000_std\": -0.04542,\n        \"nauc_mrr_at_1000_diff1\": 0.89285,\n        \"main_score\": 0.92367,\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.84,\n        \"ndcg_at_3\": 0.8923,\n        \"ndcg_at_5\": 0.90148,\n        \"ndcg_at_10\": 0.90577,\n        \"ndcg_at_20\": 0.91004,\n        \"ndcg_at_100\": 0.91226,\n        \"ndcg_at_1000\": 0.91319,\n        \"map_at_1\": 0.84,\n        \"map_at_3\": 0.87963,\n        \"map_at_5\": 0.88474,\n        \"map_at_10\": 0.88649,\n        \"map_at_20\": 0.88769,\n        \"map_at_100\": 0.88798,\n        \"map_at_1000\": 0.88803,\n        \"recall_at_1\": 0.84,\n        \"recall_at_3\": 0.92889,\n        \"recall_at_5\": 0.95111,\n        \"recall_at_10\": 0.96444,\n        \"recall_at_20\": 0.98111,\n        \"recall_at_100\": 0.99333,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.84,\n        \"precision_at_3\": 0.30963,\n        \"precision_at_5\": 0.19022,\n        \"precision_at_10\": 0.09644,\n        \"precision_at_20\": 0.04906,\n        \"precision_at_100\": 0.00993,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.84,\n        \"mrr_at_3\": 0.87963,\n        \"mrr_at_5\": 0.884741,\n        \"mrr_at_10\": 0.886493,\n        \"mrr_at_20\": 0.887693,\n        \"mrr_at_100\": 0.887978,\n        \"mrr_at_1000\": 0.888027,\n        \"nauc_ndcg_at_1_max\": 0.669871,\n        \"nauc_ndcg_at_1_std\": -0.013885,\n        \"nauc_ndcg_at_1_diff1\": 0.884402,\n        \"nauc_ndcg_at_3_max\": 0.727295,\n        \"nauc_ndcg_at_3_std\": 0.071507,\n        \"nauc_ndcg_at_3_diff1\": 0.873162,\n        \"nauc_ndcg_at_5_max\": 0.71879,\n        \"nauc_ndcg_at_5_std\": 0.044811,\n        \"nauc_ndcg_at_5_diff1\": 0.876589,\n        \"nauc_ndcg_at_10_max\": 0.718449,\n        \"nauc_ndcg_at_10_std\": 0.060303,\n        \"nauc_ndcg_at_10_diff1\": 0.877957,\n        \"nauc_ndcg_at_20_max\": 0.719446,\n        \"nauc_ndcg_at_20_std\": 0.069762,\n        \"nauc_ndcg_at_20_diff1\": 0.880694,\n        \"nauc_ndcg_at_100_max\": 0.714788,\n        \"nauc_ndcg_at_100_std\": 0.056841,\n        \"nauc_ndcg_at_100_diff1\": 0.879395,\n        \"nauc_ndcg_at_1000_max\": 0.712396,\n        \"nauc_ndcg_at_1000_std\": 0.050198,\n        \"nauc_ndcg_at_1000_diff1\": 0.878525,\n        \"nauc_map_at_1_max\": 0.669871,\n        \"nauc_map_at_1_std\": -0.013885,\n        \"nauc_map_at_1_diff1\": 0.884402,\n        \"nauc_map_at_3_max\": 0.711326,\n        \"nauc_map_at_3_std\": 0.04492,\n        \"nauc_map_at_3_diff1\": 0.875477,\n        \"nauc_map_at_5_max\": 0.706614,\n        \"nauc_map_at_5_std\": 0.030796,\n        \"nauc_map_at_5_diff1\": 0.877186,\n        \"nauc_map_at_10_max\": 0.70648,\n        \"nauc_map_at_10_std\": 0.036856,\n        \"nauc_map_at_10_diff1\": 0.877641,\n        \"nauc_map_at_20_max\": 0.70693,\n        \"nauc_map_at_20_std\": 0.03963,\n        \"nauc_map_at_20_diff1\": 0.878354,\n        \"nauc_map_at_100_max\": 0.706407,\n        \"nauc_map_at_100_std\": 0.03814,\n        \"nauc_map_at_100_diff1\": 0.878192,\n        \"nauc_map_at_1000_max\": 0.706298,\n        \"nauc_map_at_1000_std\": 0.037843,\n        \"nauc_map_at_1000_diff1\": 0.878154,\n        \"nauc_recall_at_1_max\": 0.669871,\n        \"nauc_recall_at_1_std\": -0.013885,\n        \"nauc_recall_at_1_diff1\": 0.884402,\n        \"nauc_recall_at_3_max\": 0.801317,\n        \"nauc_recall_at_3_std\": 0.196932,\n        \"nauc_recall_at_3_diff1\": 0.863051,\n        \"nauc_recall_at_5_max\": 0.793874,\n        \"nauc_recall_at_5_std\": 0.128873,\n        \"nauc_recall_at_5_diff1\": 0.875021,\n        \"nauc_recall_at_10_max\": 0.816279,\n        \"nauc_recall_at_10_std\": 0.267419,\n        \"nauc_recall_at_10_diff1\": 0.885636,\n        \"nauc_recall_at_20_max\": 0.905943,\n        \"nauc_recall_at_20_std\": 0.583512,\n        \"nauc_recall_at_20_diff1\": 0.937524,\n        \"nauc_recall_at_100_max\": 0.925692,\n        \"nauc_recall_at_100_std\": 0.643324,\n        \"nauc_recall_at_100_diff1\": 0.956427,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.669871,\n        \"nauc_precision_at_1_std\": -0.013885,\n        \"nauc_precision_at_1_diff1\": 0.884402,\n        \"nauc_precision_at_3_max\": 0.801317,\n        \"nauc_precision_at_3_std\": 0.196932,\n        \"nauc_precision_at_3_diff1\": 0.863051,\n        \"nauc_precision_at_5_max\": 0.793874,\n        \"nauc_precision_at_5_std\": 0.128873,\n        \"nauc_precision_at_5_diff1\": 0.875021,\n        \"nauc_precision_at_10_max\": 0.816279,\n        \"nauc_precision_at_10_std\": 0.267419,\n        \"nauc_precision_at_10_diff1\": 0.885636,\n        \"nauc_precision_at_20_max\": 0.905943,\n        \"nauc_precision_at_20_std\": 0.583512,\n        \"nauc_precision_at_20_diff1\": 0.937524,\n        \"nauc_precision_at_100_max\": 0.925692,\n        \"nauc_precision_at_100_std\": 0.643324,\n        \"nauc_precision_at_100_diff1\": 0.956427,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.669871,\n        \"nauc_mrr_at_1_std\": -0.013885,\n        \"nauc_mrr_at_1_diff1\": 0.884402,\n        \"nauc_mrr_at_3_max\": 0.711326,\n        \"nauc_mrr_at_3_std\": 0.04492,\n        \"nauc_mrr_at_3_diff1\": 0.875477,\n        \"nauc_mrr_at_5_max\": 0.706614,\n        \"nauc_mrr_at_5_std\": 0.030796,\n        \"nauc_mrr_at_5_diff1\": 0.877186,\n        \"nauc_mrr_at_10_max\": 0.70648,\n        \"nauc_mrr_at_10_std\": 0.036856,\n        \"nauc_mrr_at_10_diff1\": 0.877641,\n        \"nauc_mrr_at_20_max\": 0.70693,\n        \"nauc_mrr_at_20_std\": 0.03963,\n        \"nauc_mrr_at_20_diff1\": 0.878354,\n        \"nauc_mrr_at_100_max\": 0.706407,\n        \"nauc_mrr_at_100_std\": 0.03814,\n        \"nauc_mrr_at_100_diff1\": 0.878192,\n        \"nauc_mrr_at_1000_max\": 0.706298,\n        \"nauc_mrr_at_1000_std\": 0.037843,\n        \"nauc_mrr_at_1000_diff1\": 0.878154,\n        \"main_score\": 0.90577,\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 19.279202222824097,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KURE-v1/nlpai-lab__KURE-v1/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"task_name\": \"Ko-StrategyQA\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"ndcg_at_1\": 0.76182,\n        \"ndcg_at_3\": 0.7545,\n        \"ndcg_at_5\": 0.78417,\n        \"ndcg_at_10\": 0.7999,\n        \"ndcg_at_20\": 0.80687,\n        \"ndcg_at_100\": 0.8145,\n        \"ndcg_at_1000\": 0.82292,\n        \"map_at_1\": 0.49595,\n        \"map_at_3\": 0.71511,\n        \"map_at_5\": 0.74568,\n        \"map_at_10\": 0.7559,\n        \"map_at_20\": 0.75907,\n        \"map_at_100\": 0.76054,\n        \"map_at_1000\": 0.76093,\n        \"recall_at_1\": 0.49595,\n        \"recall_at_3\": 0.76143,\n        \"recall_at_5\": 0.82177,\n        \"recall_at_10\": 0.85963,\n        \"recall_at_20\": 0.88024,\n        \"recall_at_100\": 0.91352,\n        \"recall_at_1000\": 0.96824,\n        \"precision_at_1\": 0.76182,\n        \"precision_at_3\": 0.4482,\n        \"precision_at_5\": 0.3,\n        \"precision_at_10\": 0.15912,\n        \"precision_at_20\": 0.08226,\n        \"precision_at_100\": 0.01718,\n        \"precision_at_1000\": 0.00184,\n        \"mrr_at_1\": 0.761824,\n        \"mrr_at_3\": 0.808277,\n        \"mrr_at_5\": 0.812669,\n        \"mrr_at_10\": 0.815498,\n        \"mrr_at_20\": 0.816074,\n        \"mrr_at_100\": 0.816796,\n        \"mrr_at_1000\": 0.816951,\n        \"nauc_ndcg_at_1_max\": 0.614025,\n        \"nauc_ndcg_at_1_std\": 0.261642,\n        \"nauc_ndcg_at_1_diff1\": 0.701575,\n        \"nauc_ndcg_at_3_max\": 0.62098,\n        \"nauc_ndcg_at_3_std\": 0.230317,\n        \"nauc_ndcg_at_3_diff1\": 0.625084,\n        \"nauc_ndcg_at_5_max\": 0.668734,\n        \"nauc_ndcg_at_5_std\": 0.300087,\n        \"nauc_ndcg_at_5_diff1\": 0.630877,\n        \"nauc_ndcg_at_10_max\": 0.685111,\n        \"nauc_ndcg_at_10_std\": 0.344968,\n        \"nauc_ndcg_at_10_diff1\": 0.640037,\n        \"nauc_ndcg_at_20_max\": 0.689795,\n        \"nauc_ndcg_at_20_std\": 0.357351,\n        \"nauc_ndcg_at_20_diff1\": 0.641725,\n        \"nauc_ndcg_at_100_max\": 0.688772,\n        \"nauc_ndcg_at_100_std\": 0.361662,\n        \"nauc_ndcg_at_100_diff1\": 0.643659,\n        \"nauc_ndcg_at_1000_max\": 0.677585,\n        \"nauc_ndcg_at_1000_std\": 0.345124,\n        \"nauc_ndcg_at_1000_diff1\": 0.642909,\n        \"nauc_map_at_1_max\": 0.272905,\n        \"nauc_map_at_1_std\": 0.002876,\n        \"nauc_map_at_1_diff1\": 0.646467,\n        \"nauc_map_at_3_max\": 0.567092,\n        \"nauc_map_at_3_std\": 0.175638,\n        \"nauc_map_at_3_diff1\": 0.615539,\n        \"nauc_map_at_5_max\": 0.609239,\n        \"nauc_map_at_5_std\": 0.223555,\n        \"nauc_map_at_5_diff1\": 0.616314,\n        \"nauc_map_at_10_max\": 0.619726,\n        \"nauc_map_at_10_std\": 0.250831,\n        \"nauc_map_at_10_diff1\": 0.620354,\n        \"nauc_map_at_20_max\": 0.621416,\n        \"nauc_map_at_20_std\": 0.255703,\n        \"nauc_map_at_20_diff1\": 0.620546,\n        \"nauc_map_at_100_max\": 0.621935,\n        \"nauc_map_at_100_std\": 0.257508,\n        \"nauc_map_at_100_diff1\": 0.621364,\n        \"nauc_map_at_1000_max\": 0.621471,\n        \"nauc_map_at_1000_std\": 0.256787,\n        \"nauc_map_at_1000_diff1\": 0.6213,\n        \"nauc_recall_at_1_max\": 0.272905,\n        \"nauc_recall_at_1_std\": 0.002876,\n        \"nauc_recall_at_1_diff1\": 0.646467,\n        \"nauc_recall_at_3_max\": 0.638878,\n        \"nauc_recall_at_3_std\": 0.234589,\n        \"nauc_recall_at_3_diff1\": 0.59418,\n        \"nauc_recall_at_5_max\": 0.747306,\n        \"nauc_recall_at_5_std\": 0.391205,\n        \"nauc_recall_at_5_diff1\": 0.597477,\n        \"nauc_recall_at_10_max\": 0.811865,\n        \"nauc_recall_at_10_std\": 0.547802,\n        \"nauc_recall_at_10_diff1\": 0.622797,\n        \"nauc_recall_at_20_max\": 0.859455,\n        \"nauc_recall_at_20_std\": 0.63551,\n        \"nauc_recall_at_20_diff1\": 0.636328,\n        \"nauc_recall_at_100_max\": 0.901394,\n        \"nauc_recall_at_100_std\": 0.750433,\n        \"nauc_recall_at_100_diff1\": 0.646077,\n        \"nauc_recall_at_1000_max\": 0.916075,\n        \"nauc_recall_at_1000_std\": 0.879498,\n        \"nauc_recall_at_1000_diff1\": 0.662774,\n        \"nauc_precision_at_1_max\": 0.614025,\n        \"nauc_precision_at_1_std\": 0.261642,\n        \"nauc_precision_at_1_diff1\": 0.701575,\n        \"nauc_precision_at_3_max\": 0.404117,\n        \"nauc_precision_at_3_std\": 0.279052,\n        \"nauc_precision_at_3_diff1\": 0.014184,\n        \"nauc_precision_at_5_max\": 0.330371,\n        \"nauc_precision_at_5_std\": 0.305218,\n        \"nauc_precision_at_5_diff1\": -0.083218,\n        \"nauc_precision_at_10_max\": 0.278977,\n        \"nauc_precision_at_10_std\": 0.335057,\n        \"nauc_precision_at_10_diff1\": -0.133429,\n        \"nauc_precision_at_20_max\": 0.239069,\n        \"nauc_precision_at_20_std\": 0.330963,\n        \"nauc_precision_at_20_diff1\": -0.16744,\n        \"nauc_precision_at_100_max\": 0.176842,\n        \"nauc_precision_at_100_std\": 0.311736,\n        \"nauc_precision_at_100_diff1\": -0.225768,\n        \"nauc_precision_at_1000_max\": 0.025097,\n        \"nauc_precision_at_1000_std\": 0.201658,\n        \"nauc_precision_at_1000_diff1\": -0.352137,\n        \"nauc_mrr_at_1_max\": 0.614025,\n        \"nauc_mrr_at_1_std\": 0.261642,\n        \"nauc_mrr_at_1_diff1\": 0.701575,\n        \"nauc_mrr_at_3_max\": 0.701277,\n        \"nauc_mrr_at_3_std\": 0.3518,\n        \"nauc_mrr_at_3_diff1\": 0.695926,\n        \"nauc_mrr_at_5_max\": 0.702635,\n        \"nauc_mrr_at_5_std\": 0.367677,\n        \"nauc_mrr_at_5_diff1\": 0.695743,\n        \"nauc_mrr_at_10_max\": 0.702514,\n        \"nauc_mrr_at_10_std\": 0.37052,\n        \"nauc_mrr_at_10_diff1\": 0.699126,\n        \"nauc_mrr_at_20_max\": 0.70173,\n        \"nauc_mrr_at_20_std\": 0.369437,\n        \"nauc_mrr_at_20_diff1\": 0.698954,\n        \"nauc_mrr_at_100_max\": 0.700801,\n        \"nauc_mrr_at_100_std\": 0.368442,\n        \"nauc_mrr_at_100_diff1\": 0.698849,\n        \"nauc_mrr_at_1000_max\": 0.700591,\n        \"nauc_mrr_at_1000_std\": 0.368133,\n        \"nauc_mrr_at_1000_diff1\": 0.698854,\n        \"main_score\": 0.7999,\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 120.75947451591492,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KURE-v1/nlpai-lab__KURE-v1/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"task_name\": \"MIRACLRetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"ndcg_at_1\": 0.64319,\n        \"ndcg_at_3\": 0.63092,\n        \"ndcg_at_5\": 0.64564,\n        \"ndcg_at_10\": 0.68157,\n        \"ndcg_at_20\": 0.71623,\n        \"ndcg_at_100\": 0.73858,\n        \"ndcg_at_1000\": 0.7451,\n        \"map_at_1\": 0.40126,\n        \"map_at_3\": 0.51814,\n        \"map_at_5\": 0.55611,\n        \"map_at_10\": 0.59121,\n        \"map_at_20\": 0.61048,\n        \"map_at_100\": 0.61787,\n        \"map_at_1000\": 0.61845,\n        \"recall_at_1\": 0.40126,\n        \"recall_at_3\": 0.58407,\n        \"recall_at_5\": 0.66815,\n        \"recall_at_10\": 0.77895,\n        \"recall_at_20\": 0.87459,\n        \"recall_at_100\": 0.95436,\n        \"recall_at_1000\": 0.99296,\n        \"precision_at_1\": 0.64319,\n        \"precision_at_3\": 0.37715,\n        \"precision_at_5\": 0.28263,\n        \"precision_at_10\": 0.177,\n        \"precision_at_20\": 0.1061,\n        \"precision_at_100\": 0.02451,\n        \"precision_at_1000\": 0.00256,\n        \"mrr_at_1\": 0.643192,\n        \"mrr_at_3\": 0.722222,\n        \"mrr_at_5\": 0.731612,\n        \"mrr_at_10\": 0.740785,\n        \"mrr_at_20\": 0.743542,\n        \"mrr_at_100\": 0.743799,\n        \"mrr_at_1000\": 0.74388,\n        \"nauc_ndcg_at_1_max\": 0.418025,\n        \"nauc_ndcg_at_1_std\": 0.141527,\n        \"nauc_ndcg_at_1_diff1\": 0.350911,\n        \"nauc_ndcg_at_3_max\": 0.389608,\n        \"nauc_ndcg_at_3_std\": 0.066272,\n        \"nauc_ndcg_at_3_diff1\": 0.297137,\n        \"nauc_ndcg_at_5_max\": 0.3766,\n        \"nauc_ndcg_at_5_std\": 0.031175,\n        \"nauc_ndcg_at_5_diff1\": 0.313027,\n        \"nauc_ndcg_at_10_max\": 0.392274,\n        \"nauc_ndcg_at_10_std\": 0.06215,\n        \"nauc_ndcg_at_10_diff1\": 0.296271,\n        \"nauc_ndcg_at_20_max\": 0.41232,\n        \"nauc_ndcg_at_20_std\": 0.126069,\n        \"nauc_ndcg_at_20_diff1\": 0.290829,\n        \"nauc_ndcg_at_100_max\": 0.430835,\n        \"nauc_ndcg_at_100_std\": 0.145252,\n        \"nauc_ndcg_at_100_diff1\": 0.294684,\n        \"nauc_ndcg_at_1000_max\": 0.425904,\n        \"nauc_ndcg_at_1000_std\": 0.135031,\n        \"nauc_ndcg_at_1000_diff1\": 0.293088,\n        \"nauc_map_at_1_max\": 0.241848,\n        \"nauc_map_at_1_std\": -0.118254,\n        \"nauc_map_at_1_diff1\": 0.457322,\n        \"nauc_map_at_3_max\": 0.303597,\n        \"nauc_map_at_3_std\": -0.064791,\n        \"nauc_map_at_3_diff1\": 0.366994,\n        \"nauc_map_at_5_max\": 0.317647,\n        \"nauc_map_at_5_std\": -0.048155,\n        \"nauc_map_at_5_diff1\": 0.349392,\n        \"nauc_map_at_10_max\": 0.347327,\n        \"nauc_map_at_10_std\": -0.002871,\n        \"nauc_map_at_10_diff1\": 0.327944,\n        \"nauc_map_at_20_max\": 0.359119,\n        \"nauc_map_at_20_std\": 0.032617,\n        \"nauc_map_at_20_diff1\": 0.31913,\n        \"nauc_map_at_100_max\": 0.366819,\n        \"nauc_map_at_100_std\": 0.04224,\n        \"nauc_map_at_100_diff1\": 0.318221,\n        \"nauc_map_at_1000_max\": 0.366912,\n        \"nauc_map_at_1000_std\": 0.041759,\n        \"nauc_map_at_1000_diff1\": 0.318344,\n        \"nauc_recall_at_1_max\": 0.241848,\n        \"nauc_recall_at_1_std\": -0.118254,\n        \"nauc_recall_at_1_diff1\": 0.457322,\n        \"nauc_recall_at_3_max\": 0.299411,\n        \"nauc_recall_at_3_std\": -0.086247,\n        \"nauc_recall_at_3_diff1\": 0.317932,\n        \"nauc_recall_at_5_max\": 0.289107,\n        \"nauc_recall_at_5_std\": -0.113191,\n        \"nauc_recall_at_5_diff1\": 0.287347,\n        \"nauc_recall_at_10_max\": 0.329945,\n        \"nauc_recall_at_10_std\": 0.019325,\n        \"nauc_recall_at_10_diff1\": 0.211357,\n        \"nauc_recall_at_20_max\": 0.391822,\n        \"nauc_recall_at_20_std\": 0.255635,\n        \"nauc_recall_at_20_diff1\": 0.218277,\n        \"nauc_recall_at_100_max\": 0.647316,\n        \"nauc_recall_at_100_std\": 0.566925,\n        \"nauc_recall_at_100_diff1\": 0.353585,\n        \"nauc_recall_at_1000_max\": 1.0,\n        \"nauc_recall_at_1000_std\": 1.0,\n        \"nauc_recall_at_1000_diff1\": 0.609708,\n        \"nauc_precision_at_1_max\": 0.418025,\n        \"nauc_precision_at_1_std\": 0.141527,\n        \"nauc_precision_at_1_diff1\": 0.350911,\n        \"nauc_precision_at_3_max\": 0.277168,\n        \"nauc_precision_at_3_std\": 0.296765,\n        \"nauc_precision_at_3_diff1\": -0.152035,\n        \"nauc_precision_at_5_max\": 0.201806,\n        \"nauc_precision_at_5_std\": 0.301295,\n        \"nauc_precision_at_5_diff1\": -0.206681,\n        \"nauc_precision_at_10_max\": 0.178954,\n        \"nauc_precision_at_10_std\": 0.372459,\n        \"nauc_precision_at_10_diff1\": -0.270715,\n        \"nauc_precision_at_20_max\": 0.139584,\n        \"nauc_precision_at_20_std\": 0.417198,\n        \"nauc_precision_at_20_diff1\": -0.286054,\n        \"nauc_precision_at_100_max\": 0.117258,\n        \"nauc_precision_at_100_std\": 0.403073,\n        \"nauc_precision_at_100_diff1\": -0.271039,\n        \"nauc_precision_at_1000_max\": 0.09153,\n        \"nauc_precision_at_1000_std\": 0.370089,\n        \"nauc_precision_at_1000_diff1\": -0.279217,\n        \"nauc_mrr_at_1_max\": 0.418025,\n        \"nauc_mrr_at_1_std\": 0.141527,\n        \"nauc_mrr_at_1_diff1\": 0.350911,\n        \"nauc_mrr_at_3_max\": 0.476687,\n        \"nauc_mrr_at_3_std\": 0.19241,\n        \"nauc_mrr_at_3_diff1\": 0.294637,\n        \"nauc_mrr_at_5_max\": 0.468326,\n        \"nauc_mrr_at_5_std\": 0.172536,\n        \"nauc_mrr_at_5_diff1\": 0.29644,\n        \"nauc_mrr_at_10_max\": 0.472805,\n        \"nauc_mrr_at_10_std\": 0.186911,\n        \"nauc_mrr_at_10_diff1\": 0.299354,\n        \"nauc_mrr_at_20_max\": 0.469419,\n        \"nauc_mrr_at_20_std\": 0.186845,\n        \"nauc_mrr_at_20_diff1\": 0.299805,\n        \"nauc_mrr_at_100_max\": 0.469152,\n        \"nauc_mrr_at_100_std\": 0.186332,\n        \"nauc_mrr_at_100_diff1\": 0.300123,\n        \"nauc_mrr_at_1000_max\": 0.469017,\n        \"nauc_mrr_at_1000_std\": 0.186168,\n        \"nauc_mrr_at_1000_diff1\": 0.300252,\n        \"main_score\": 0.68157,\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 10866.9804418087,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KURE-v1/nlpai-lab__KURE-v1/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"task_name\": \"MrTidyRetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.44893,\n        \"ndcg_at_3\": 0.53551,\n        \"ndcg_at_5\": 0.56295,\n        \"ndcg_at_10\": 0.59092,\n        \"ndcg_at_20\": 0.60819,\n        \"ndcg_at_100\": 0.62813,\n        \"ndcg_at_1000\": 0.63513,\n        \"map_at_1\": 0.41449,\n        \"map_at_3\": 0.50205,\n        \"map_at_5\": 0.51788,\n        \"map_at_10\": 0.53133,\n        \"map_at_20\": 0.53695,\n        \"map_at_100\": 0.54014,\n        \"map_at_1000\": 0.54042,\n        \"recall_at_1\": 0.41449,\n        \"recall_at_3\": 0.60293,\n        \"recall_at_5\": 0.66667,\n        \"recall_at_10\": 0.74624,\n        \"recall_at_20\": 0.80918,\n        \"recall_at_100\": 0.91013,\n        \"recall_at_1000\": 0.96318,\n        \"precision_at_1\": 0.44893,\n        \"precision_at_3\": 0.22407,\n        \"precision_at_5\": 0.15012,\n        \"precision_at_10\": 0.08575,\n        \"precision_at_20\": 0.04691,\n        \"precision_at_100\": 0.01062,\n        \"precision_at_1000\": 0.00112,\n        \"mrr_at_1\": 0.448931,\n        \"mrr_at_3\": 0.532462,\n        \"mrr_at_5\": 0.54707,\n        \"mrr_at_10\": 0.55664,\n        \"mrr_at_20\": 0.560524,\n        \"mrr_at_100\": 0.563012,\n        \"mrr_at_1000\": 0.563258,\n        \"nauc_ndcg_at_1_max\": 0.46382,\n        \"nauc_ndcg_at_1_std\": 0.020944,\n        \"nauc_ndcg_at_1_diff1\": 0.541324,\n        \"nauc_ndcg_at_3_max\": 0.455264,\n        \"nauc_ndcg_at_3_std\": 0.091935,\n        \"nauc_ndcg_at_3_diff1\": 0.437052,\n        \"nauc_ndcg_at_5_max\": 0.445921,\n        \"nauc_ndcg_at_5_std\": 0.082727,\n        \"nauc_ndcg_at_5_diff1\": 0.434188,\n        \"nauc_ndcg_at_10_max\": 0.4541,\n        \"nauc_ndcg_at_10_std\": 0.088446,\n        \"nauc_ndcg_at_10_diff1\": 0.426756,\n        \"nauc_ndcg_at_20_max\": 0.450817,\n        \"nauc_ndcg_at_20_std\": 0.089577,\n        \"nauc_ndcg_at_20_diff1\": 0.420949,\n        \"nauc_ndcg_at_100_max\": 0.463446,\n        \"nauc_ndcg_at_100_std\": 0.089819,\n        \"nauc_ndcg_at_100_diff1\": 0.436819,\n        \"nauc_ndcg_at_1000_max\": 0.459856,\n        \"nauc_ndcg_at_1000_std\": 0.083848,\n        \"nauc_ndcg_at_1000_diff1\": 0.4413,\n        \"nauc_map_at_1_max\": 0.421572,\n        \"nauc_map_at_1_std\": 0.00283,\n        \"nauc_map_at_1_diff1\": 0.505448,\n        \"nauc_map_at_3_max\": 0.437627,\n        \"nauc_map_at_3_std\": 0.060121,\n        \"nauc_map_at_3_diff1\": 0.448115,\n        \"nauc_map_at_5_max\": 0.434329,\n        \"nauc_map_at_5_std\": 0.056771,\n        \"nauc_map_at_5_diff1\": 0.448608,\n        \"nauc_map_at_10_max\": 0.436934,\n        \"nauc_map_at_10_std\": 0.05951,\n        \"nauc_map_at_10_diff1\": 0.444649,\n        \"nauc_map_at_20_max\": 0.435557,\n        \"nauc_map_at_20_std\": 0.059837,\n        \"nauc_map_at_20_diff1\": 0.442731,\n        \"nauc_map_at_100_max\": 0.437744,\n        \"nauc_map_at_100_std\": 0.059625,\n        \"nauc_map_at_100_diff1\": 0.445463,\n        \"nauc_map_at_1000_max\": 0.437639,\n        \"nauc_map_at_1000_std\": 0.0595,\n        \"nauc_map_at_1000_diff1\": 0.445645,\n        \"nauc_recall_at_1_max\": 0.421572,\n        \"nauc_recall_at_1_std\": 0.00283,\n        \"nauc_recall_at_1_diff1\": 0.505448,\n        \"nauc_recall_at_3_max\": 0.457277,\n        \"nauc_recall_at_3_std\": 0.16318,\n        \"nauc_recall_at_3_diff1\": 0.362044,\n        \"nauc_recall_at_5_max\": 0.428103,\n        \"nauc_recall_at_5_std\": 0.137472,\n        \"nauc_recall_at_5_diff1\": 0.344122,\n        \"nauc_recall_at_10_max\": 0.459757,\n        \"nauc_recall_at_10_std\": 0.168446,\n        \"nauc_recall_at_10_diff1\": 0.300797,\n        \"nauc_recall_at_20_max\": 0.450426,\n        \"nauc_recall_at_20_std\": 0.198789,\n        \"nauc_recall_at_20_diff1\": 0.242019,\n        \"nauc_recall_at_100_max\": 0.630929,\n        \"nauc_recall_at_100_std\": 0.30797,\n        \"nauc_recall_at_100_diff1\": 0.299712,\n        \"nauc_recall_at_1000_max\": 0.683232,\n        \"nauc_recall_at_1000_std\": 0.282184,\n        \"nauc_recall_at_1000_diff1\": 0.353519,\n        \"nauc_precision_at_1_max\": 0.46382,\n        \"nauc_precision_at_1_std\": 0.020944,\n        \"nauc_precision_at_1_diff1\": 0.541324,\n        \"nauc_precision_at_3_max\": 0.4482,\n        \"nauc_precision_at_3_std\": 0.176583,\n        \"nauc_precision_at_3_diff1\": 0.351772,\n        \"nauc_precision_at_5_max\": 0.392259,\n        \"nauc_precision_at_5_std\": 0.167015,\n        \"nauc_precision_at_5_diff1\": 0.303985,\n        \"nauc_precision_at_10_max\": 0.308423,\n        \"nauc_precision_at_10_std\": 0.172186,\n        \"nauc_precision_at_10_diff1\": 0.172134,\n        \"nauc_precision_at_20_max\": 0.224559,\n        \"nauc_precision_at_20_std\": 0.169829,\n        \"nauc_precision_at_20_diff1\": 0.074729,\n        \"nauc_precision_at_100_max\": 0.184778,\n        \"nauc_precision_at_100_std\": 0.156845,\n        \"nauc_precision_at_100_diff1\": 0.047777,\n        \"nauc_precision_at_1000_max\": 0.077079,\n        \"nauc_precision_at_1000_std\": 0.109687,\n        \"nauc_precision_at_1000_diff1\": -0.01916,\n        \"nauc_mrr_at_1_max\": 0.46382,\n        \"nauc_mrr_at_1_std\": 0.020944,\n        \"nauc_mrr_at_1_diff1\": 0.541324,\n        \"nauc_mrr_at_3_max\": 0.484222,\n        \"nauc_mrr_at_3_std\": 0.087616,\n        \"nauc_mrr_at_3_diff1\": 0.482752,\n        \"nauc_mrr_at_5_max\": 0.476133,\n        \"nauc_mrr_at_5_std\": 0.080856,\n        \"nauc_mrr_at_5_diff1\": 0.477907,\n        \"nauc_mrr_at_10_max\": 0.480353,\n        \"nauc_mrr_at_10_std\": 0.080922,\n        \"nauc_mrr_at_10_diff1\": 0.478511,\n        \"nauc_mrr_at_20_max\": 0.479131,\n        \"nauc_mrr_at_20_std\": 0.079193,\n        \"nauc_mrr_at_20_diff1\": 0.478262,\n        \"nauc_mrr_at_100_max\": 0.480192,\n        \"nauc_mrr_at_100_std\": 0.079458,\n        \"nauc_mrr_at_100_diff1\": 0.479629,\n        \"nauc_mrr_at_1000_max\": 0.480079,\n        \"nauc_mrr_at_1000_std\": 0.079232,\n        \"nauc_mrr_at_1000_diff1\": 0.47984,\n        \"main_score\": 0.59092,\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 11014.441509008408,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KURE-v1/nlpai-lab__KURE-v1/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"task_name\": \"MultiLongDocRetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"ndcg_at_1\": 0.37,\n        \"ndcg_at_3\": 0.42797,\n        \"ndcg_at_5\": 0.45465,\n        \"ndcg_at_10\": 0.47528,\n        \"ndcg_at_20\": 0.49279,\n        \"ndcg_at_100\": 0.52728,\n        \"ndcg_at_1000\": 0.54311,\n        \"map_at_1\": 0.37,\n        \"map_at_3\": 0.415,\n        \"map_at_5\": 0.42975,\n        \"map_at_10\": 0.43803,\n        \"map_at_20\": 0.44274,\n        \"map_at_100\": 0.44755,\n        \"map_at_1000\": 0.44814,\n        \"recall_at_1\": 0.37,\n        \"recall_at_3\": 0.465,\n        \"recall_at_5\": 0.53,\n        \"recall_at_10\": 0.595,\n        \"recall_at_20\": 0.665,\n        \"recall_at_100\": 0.85,\n        \"recall_at_1000\": 0.975,\n        \"precision_at_1\": 0.37,\n        \"precision_at_3\": 0.155,\n        \"precision_at_5\": 0.106,\n        \"precision_at_10\": 0.0595,\n        \"precision_at_20\": 0.03325,\n        \"precision_at_100\": 0.0085,\n        \"precision_at_1000\": 0.00098,\n        \"mrr_at_1\": 0.37,\n        \"mrr_at_3\": 0.415,\n        \"mrr_at_5\": 0.42975,\n        \"mrr_at_10\": 0.438026,\n        \"mrr_at_20\": 0.442737,\n        \"mrr_at_100\": 0.447555,\n        \"mrr_at_1000\": 0.448138,\n        \"nauc_ndcg_at_1_max\": 0.452441,\n        \"nauc_ndcg_at_1_std\": -0.018203,\n        \"nauc_ndcg_at_1_diff1\": 0.65166,\n        \"nauc_ndcg_at_3_max\": 0.477151,\n        \"nauc_ndcg_at_3_std\": 0.037488,\n        \"nauc_ndcg_at_3_diff1\": 0.624535,\n        \"nauc_ndcg_at_5_max\": 0.468576,\n        \"nauc_ndcg_at_5_std\": 0.035081,\n        \"nauc_ndcg_at_5_diff1\": 0.610375,\n        \"nauc_ndcg_at_10_max\": 0.467701,\n        \"nauc_ndcg_at_10_std\": 0.051146,\n        \"nauc_ndcg_at_10_diff1\": 0.60673,\n        \"nauc_ndcg_at_20_max\": 0.491939,\n        \"nauc_ndcg_at_20_std\": 0.065654,\n        \"nauc_ndcg_at_20_diff1\": 0.601935,\n        \"nauc_ndcg_at_100_max\": 0.49402,\n        \"nauc_ndcg_at_100_std\": 0.083501,\n        \"nauc_ndcg_at_100_diff1\": 0.597839,\n        \"nauc_ndcg_at_1000_max\": 0.483865,\n        \"nauc_ndcg_at_1000_std\": 0.067484,\n        \"nauc_ndcg_at_1000_diff1\": 0.609425,\n        \"nauc_map_at_1_max\": 0.452441,\n        \"nauc_map_at_1_std\": -0.018203,\n        \"nauc_map_at_1_diff1\": 0.65166,\n        \"nauc_map_at_3_max\": 0.470701,\n        \"nauc_map_at_3_std\": 0.024512,\n        \"nauc_map_at_3_diff1\": 0.630357,\n        \"nauc_map_at_5_max\": 0.466168,\n        \"nauc_map_at_5_std\": 0.023049,\n        \"nauc_map_at_5_diff1\": 0.622837,\n        \"nauc_map_at_10_max\": 0.465591,\n        \"nauc_map_at_10_std\": 0.030054,\n        \"nauc_map_at_10_diff1\": 0.621022,\n        \"nauc_map_at_20_max\": 0.47138,\n        \"nauc_map_at_20_std\": 0.033448,\n        \"nauc_map_at_20_diff1\": 0.620108,\n        \"nauc_map_at_100_max\": 0.471999,\n        \"nauc_map_at_100_std\": 0.035941,\n        \"nauc_map_at_100_diff1\": 0.620158,\n        \"nauc_map_at_1000_max\": 0.471719,\n        \"nauc_map_at_1000_std\": 0.035547,\n        \"nauc_map_at_1000_diff1\": 0.62059,\n        \"nauc_recall_at_1_max\": 0.452441,\n        \"nauc_recall_at_1_std\": -0.018203,\n        \"nauc_recall_at_1_diff1\": 0.65166,\n        \"nauc_recall_at_3_max\": 0.496048,\n        \"nauc_recall_at_3_std\": 0.074911,\n        \"nauc_recall_at_3_diff1\": 0.60796,\n        \"nauc_recall_at_5_max\": 0.474398,\n        \"nauc_recall_at_5_std\": 0.07064,\n        \"nauc_recall_at_5_diff1\": 0.570888,\n        \"nauc_recall_at_10_max\": 0.473087,\n        \"nauc_recall_at_10_std\": 0.123547,\n        \"nauc_recall_at_10_diff1\": 0.558398,\n        \"nauc_recall_at_20_max\": 0.593887,\n        \"nauc_recall_at_20_std\": 0.204443,\n        \"nauc_recall_at_20_diff1\": 0.526963,\n        \"nauc_recall_at_100_max\": 0.694891,\n        \"nauc_recall_at_100_std\": 0.523706,\n        \"nauc_recall_at_100_diff1\": 0.397706,\n        \"nauc_recall_at_1000_max\": 0.645191,\n        \"nauc_recall_at_1000_std\": 0.973856,\n        \"nauc_recall_at_1000_diff1\": 0.482446,\n        \"nauc_precision_at_1_max\": 0.452441,\n        \"nauc_precision_at_1_std\": -0.018203,\n        \"nauc_precision_at_1_diff1\": 0.65166,\n        \"nauc_precision_at_3_max\": 0.496048,\n        \"nauc_precision_at_3_std\": 0.074911,\n        \"nauc_precision_at_3_diff1\": 0.60796,\n        \"nauc_precision_at_5_max\": 0.474398,\n        \"nauc_precision_at_5_std\": 0.07064,\n        \"nauc_precision_at_5_diff1\": 0.570888,\n        \"nauc_precision_at_10_max\": 0.473087,\n        \"nauc_precision_at_10_std\": 0.123547,\n        \"nauc_precision_at_10_diff1\": 0.558398,\n        \"nauc_precision_at_20_max\": 0.593887,\n        \"nauc_precision_at_20_std\": 0.204443,\n        \"nauc_precision_at_20_diff1\": 0.526963,\n        \"nauc_precision_at_100_max\": 0.694891,\n        \"nauc_precision_at_100_std\": 0.523706,\n        \"nauc_precision_at_100_diff1\": 0.397706,\n        \"nauc_precision_at_1000_max\": 0.645191,\n        \"nauc_precision_at_1000_std\": 0.973856,\n        \"nauc_precision_at_1000_diff1\": 0.482446,\n        \"nauc_mrr_at_1_max\": 0.452441,\n        \"nauc_mrr_at_1_std\": -0.018203,\n        \"nauc_mrr_at_1_diff1\": 0.65166,\n        \"nauc_mrr_at_3_max\": 0.470701,\n        \"nauc_mrr_at_3_std\": 0.024512,\n        \"nauc_mrr_at_3_diff1\": 0.630357,\n        \"nauc_mrr_at_5_max\": 0.466168,\n        \"nauc_mrr_at_5_std\": 0.023049,\n        \"nauc_mrr_at_5_diff1\": 0.622837,\n        \"nauc_mrr_at_10_max\": 0.465591,\n        \"nauc_mrr_at_10_std\": 0.030054,\n        \"nauc_mrr_at_10_diff1\": 0.621022,\n        \"nauc_mrr_at_20_max\": 0.47138,\n        \"nauc_mrr_at_20_std\": 0.033448,\n        \"nauc_mrr_at_20_diff1\": 0.620108,\n        \"nauc_mrr_at_100_max\": 0.471999,\n        \"nauc_mrr_at_100_std\": 0.035941,\n        \"nauc_mrr_at_100_diff1\": 0.620158,\n        \"nauc_mrr_at_1000_max\": 0.471719,\n        \"nauc_mrr_at_1000_std\": 0.035547,\n        \"nauc_mrr_at_1000_diff1\": 0.62059,\n        \"main_score\": 0.47528,\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ],\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.345,\n        \"ndcg_at_3\": 0.41678,\n        \"ndcg_at_5\": 0.43335,\n        \"ndcg_at_10\": 0.45209,\n        \"ndcg_at_20\": 0.47345,\n        \"ndcg_at_100\": 0.49803,\n        \"ndcg_at_1000\": 0.51884,\n        \"map_at_1\": 0.345,\n        \"map_at_3\": 0.4,\n        \"map_at_5\": 0.40925,\n        \"map_at_10\": 0.4166,\n        \"map_at_20\": 0.4224,\n        \"map_at_100\": 0.42592,\n        \"map_at_1000\": 0.42668,\n        \"recall_at_1\": 0.345,\n        \"recall_at_3\": 0.465,\n        \"recall_at_5\": 0.505,\n        \"recall_at_10\": 0.565,\n        \"recall_at_20\": 0.65,\n        \"recall_at_100\": 0.78,\n        \"recall_at_1000\": 0.945,\n        \"precision_at_1\": 0.345,\n        \"precision_at_3\": 0.155,\n        \"precision_at_5\": 0.101,\n        \"precision_at_10\": 0.0565,\n        \"precision_at_20\": 0.0325,\n        \"precision_at_100\": 0.0078,\n        \"precision_at_1000\": 0.00095,\n        \"mrr_at_1\": 0.345,\n        \"mrr_at_3\": 0.4,\n        \"mrr_at_5\": 0.40925,\n        \"mrr_at_10\": 0.416603,\n        \"mrr_at_20\": 0.422402,\n        \"mrr_at_100\": 0.425924,\n        \"mrr_at_1000\": 0.426684,\n        \"nauc_ndcg_at_1_max\": 0.454386,\n        \"nauc_ndcg_at_1_std\": -0.039274,\n        \"nauc_ndcg_at_1_diff1\": 0.651395,\n        \"nauc_ndcg_at_3_max\": 0.437897,\n        \"nauc_ndcg_at_3_std\": -0.001092,\n        \"nauc_ndcg_at_3_diff1\": 0.617187,\n        \"nauc_ndcg_at_5_max\": 0.444176,\n        \"nauc_ndcg_at_5_std\": 0.016693,\n        \"nauc_ndcg_at_5_diff1\": 0.61489,\n        \"nauc_ndcg_at_10_max\": 0.454201,\n        \"nauc_ndcg_at_10_std\": 0.034226,\n        \"nauc_ndcg_at_10_diff1\": 0.624684,\n        \"nauc_ndcg_at_20_max\": 0.452611,\n        \"nauc_ndcg_at_20_std\": 0.046561,\n        \"nauc_ndcg_at_20_diff1\": 0.617859,\n        \"nauc_ndcg_at_100_max\": 0.453509,\n        \"nauc_ndcg_at_100_std\": 0.05897,\n        \"nauc_ndcg_at_100_diff1\": 0.614857,\n        \"nauc_ndcg_at_1000_max\": 0.45323,\n        \"nauc_ndcg_at_1000_std\": 0.054619,\n        \"nauc_ndcg_at_1000_diff1\": 0.620109,\n        \"nauc_map_at_1_max\": 0.454386,\n        \"nauc_map_at_1_std\": -0.039274,\n        \"nauc_map_at_1_diff1\": 0.651395,\n        \"nauc_map_at_3_max\": 0.439205,\n        \"nauc_map_at_3_std\": -0.009306,\n        \"nauc_map_at_3_diff1\": 0.624352,\n        \"nauc_map_at_5_max\": 0.442441,\n        \"nauc_map_at_5_std\": 0.000586,\n        \"nauc_map_at_5_diff1\": 0.622811,\n        \"nauc_map_at_10_max\": 0.448083,\n        \"nauc_map_at_10_std\": 0.008808,\n        \"nauc_map_at_10_diff1\": 0.627215,\n        \"nauc_map_at_20_max\": 0.44701,\n        \"nauc_map_at_20_std\": 0.011688,\n        \"nauc_map_at_20_diff1\": 0.6251,\n        \"nauc_map_at_100_max\": 0.447019,\n        \"nauc_map_at_100_std\": 0.012824,\n        \"nauc_map_at_100_diff1\": 0.625064,\n        \"nauc_map_at_1000_max\": 0.446926,\n        \"nauc_map_at_1000_std\": 0.012784,\n        \"nauc_map_at_1000_diff1\": 0.625156,\n        \"nauc_recall_at_1_max\": 0.454386,\n        \"nauc_recall_at_1_std\": -0.039274,\n        \"nauc_recall_at_1_diff1\": 0.651395,\n        \"nauc_recall_at_3_max\": 0.435222,\n        \"nauc_recall_at_3_std\": 0.022206,\n        \"nauc_recall_at_3_diff1\": 0.596949,\n        \"nauc_recall_at_5_max\": 0.451595,\n        \"nauc_recall_at_5_std\": 0.06588,\n        \"nauc_recall_at_5_diff1\": 0.592213,\n        \"nauc_recall_at_10_max\": 0.475833,\n        \"nauc_recall_at_10_std\": 0.119504,\n        \"nauc_recall_at_10_diff1\": 0.620692,\n        \"nauc_recall_at_20_max\": 0.476833,\n        \"nauc_recall_at_20_std\": 0.190015,\n        \"nauc_recall_at_20_diff1\": 0.591529,\n        \"nauc_recall_at_100_max\": 0.495259,\n        \"nauc_recall_at_100_std\": 0.358893,\n        \"nauc_recall_at_100_diff1\": 0.548373,\n        \"nauc_recall_at_1000_max\": 0.622782,\n        \"nauc_recall_at_1000_std\": 0.898565,\n        \"nauc_recall_at_1000_diff1\": 0.636576,\n        \"nauc_precision_at_1_max\": 0.454386,\n        \"nauc_precision_at_1_std\": -0.039274,\n        \"nauc_precision_at_1_diff1\": 0.651395,\n        \"nauc_precision_at_3_max\": 0.435222,\n        \"nauc_precision_at_3_std\": 0.022206,\n        \"nauc_precision_at_3_diff1\": 0.596949,\n        \"nauc_precision_at_5_max\": 0.451595,\n        \"nauc_precision_at_5_std\": 0.06588,\n        \"nauc_precision_at_5_diff1\": 0.592213,\n        \"nauc_precision_at_10_max\": 0.475833,\n        \"nauc_precision_at_10_std\": 0.119504,\n        \"nauc_precision_at_10_diff1\": 0.620692,\n        \"nauc_precision_at_20_max\": 0.476833,\n        \"nauc_precision_at_20_std\": 0.190015,\n        \"nauc_precision_at_20_diff1\": 0.591529,\n        \"nauc_precision_at_100_max\": 0.495259,\n        \"nauc_precision_at_100_std\": 0.358893,\n        \"nauc_precision_at_100_diff1\": 0.548373,\n        \"nauc_precision_at_1000_max\": 0.622782,\n        \"nauc_precision_at_1000_std\": 0.898565,\n        \"nauc_precision_at_1000_diff1\": 0.636576,\n        \"nauc_mrr_at_1_max\": 0.454386,\n        \"nauc_mrr_at_1_std\": -0.039274,\n        \"nauc_mrr_at_1_diff1\": 0.651395,\n        \"nauc_mrr_at_3_max\": 0.439205,\n        \"nauc_mrr_at_3_std\": -0.009306,\n        \"nauc_mrr_at_3_diff1\": 0.624352,\n        \"nauc_mrr_at_5_max\": 0.442441,\n        \"nauc_mrr_at_5_std\": 0.000586,\n        \"nauc_mrr_at_5_diff1\": 0.622811,\n        \"nauc_mrr_at_10_max\": 0.448083,\n        \"nauc_mrr_at_10_std\": 0.008808,\n        \"nauc_mrr_at_10_diff1\": 0.627215,\n        \"nauc_mrr_at_20_max\": 0.44701,\n        \"nauc_mrr_at_20_std\": 0.011688,\n        \"nauc_mrr_at_20_diff1\": 0.6251,\n        \"nauc_mrr_at_100_max\": 0.447019,\n        \"nauc_mrr_at_100_std\": 0.012824,\n        \"nauc_mrr_at_100_diff1\": 0.625064,\n        \"nauc_mrr_at_1000_max\": 0.446926,\n        \"nauc_mrr_at_1000_std\": 0.012784,\n        \"nauc_mrr_at_1000_diff1\": 0.625156,\n        \"main_score\": 0.45209,\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 11572.161805391312,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KURE-v1/nlpai-lab__KURE-v1/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"task_name\": \"PublicHealthQA\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.68831,\n        \"ndcg_at_3\": 0.78154,\n        \"ndcg_at_5\": 0.80277,\n        \"ndcg_at_10\": 0.81925,\n        \"ndcg_at_20\": 0.82266,\n        \"ndcg_at_100\": 0.83027,\n        \"ndcg_at_1000\": 0.83027,\n        \"map_at_1\": 0.68831,\n        \"map_at_3\": 0.75974,\n        \"map_at_5\": 0.77143,\n        \"map_at_10\": 0.77803,\n        \"map_at_20\": 0.77902,\n        \"map_at_100\": 0.7802,\n        \"map_at_1000\": 0.7802,\n        \"recall_at_1\": 0.68831,\n        \"recall_at_3\": 0.84416,\n        \"recall_at_5\": 0.8961,\n        \"recall_at_10\": 0.94805,\n        \"recall_at_20\": 0.96104,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.68831,\n        \"precision_at_3\": 0.28139,\n        \"precision_at_5\": 0.17922,\n        \"precision_at_10\": 0.09481,\n        \"precision_at_20\": 0.04805,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.688312,\n        \"mrr_at_3\": 0.75974,\n        \"mrr_at_5\": 0.771429,\n        \"mrr_at_10\": 0.778025,\n        \"mrr_at_20\": 0.779024,\n        \"mrr_at_100\": 0.780204,\n        \"mrr_at_1000\": 0.780204,\n        \"nauc_ndcg_at_1_max\": 0.308626,\n        \"nauc_ndcg_at_1_std\": -0.228579,\n        \"nauc_ndcg_at_1_diff1\": 0.655737,\n        \"nauc_ndcg_at_3_max\": 0.318182,\n        \"nauc_ndcg_at_3_std\": -0.190897,\n        \"nauc_ndcg_at_3_diff1\": 0.625745,\n        \"nauc_ndcg_at_5_max\": 0.298169,\n        \"nauc_ndcg_at_5_std\": -0.22,\n        \"nauc_ndcg_at_5_diff1\": 0.611828,\n        \"nauc_ndcg_at_10_max\": 0.283477,\n        \"nauc_ndcg_at_10_std\": -0.216946,\n        \"nauc_ndcg_at_10_diff1\": 0.595781,\n        \"nauc_ndcg_at_20_max\": 0.281869,\n        \"nauc_ndcg_at_20_std\": -0.19649,\n        \"nauc_ndcg_at_20_diff1\": 0.593043,\n        \"nauc_ndcg_at_100_max\": 0.306941,\n        \"nauc_ndcg_at_100_std\": -0.206296,\n        \"nauc_ndcg_at_100_diff1\": 0.624753,\n        \"nauc_ndcg_at_1000_max\": 0.306941,\n        \"nauc_ndcg_at_1000_std\": -0.206296,\n        \"nauc_ndcg_at_1000_diff1\": 0.624753,\n        \"nauc_map_at_1_max\": 0.308626,\n        \"nauc_map_at_1_std\": -0.228579,\n        \"nauc_map_at_1_diff1\": 0.655737,\n        \"nauc_map_at_3_max\": 0.321412,\n        \"nauc_map_at_3_std\": -0.19738,\n        \"nauc_map_at_3_diff1\": 0.637696,\n        \"nauc_map_at_5_max\": 0.310439,\n        \"nauc_map_at_5_std\": -0.215003,\n        \"nauc_map_at_5_diff1\": 0.631938,\n        \"nauc_map_at_10_max\": 0.306275,\n        \"nauc_map_at_10_std\": -0.214431,\n        \"nauc_map_at_10_diff1\": 0.627561,\n        \"nauc_map_at_20_max\": 0.306011,\n        \"nauc_map_at_20_std\": -0.209564,\n        \"nauc_map_at_20_diff1\": 0.627074,\n        \"nauc_map_at_100_max\": 0.310676,\n        \"nauc_map_at_100_std\": -0.209687,\n        \"nauc_map_at_100_diff1\": 0.632279,\n        \"nauc_map_at_1000_max\": 0.310676,\n        \"nauc_map_at_1000_std\": -0.209687,\n        \"nauc_map_at_1000_diff1\": 0.632279,\n        \"nauc_recall_at_1_max\": 0.308626,\n        \"nauc_recall_at_1_std\": -0.228579,\n        \"nauc_recall_at_1_diff1\": 0.655737,\n        \"nauc_recall_at_3_max\": 0.301279,\n        \"nauc_recall_at_3_std\": -0.167045,\n        \"nauc_recall_at_3_diff1\": 0.574785,\n        \"nauc_recall_at_5_max\": 0.221933,\n        \"nauc_recall_at_5_std\": -0.252462,\n        \"nauc_recall_at_5_diff1\": 0.491378,\n        \"nauc_recall_at_10_max\": -0.003678,\n        \"nauc_recall_at_10_std\": -0.242704,\n        \"nauc_recall_at_10_diff1\": 0.208922,\n        \"nauc_recall_at_20_max\": -0.124209,\n        \"nauc_recall_at_20_std\": 0.064517,\n        \"nauc_recall_at_20_diff1\": 0.037695,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.308626,\n        \"nauc_precision_at_1_std\": -0.228579,\n        \"nauc_precision_at_1_diff1\": 0.655737,\n        \"nauc_precision_at_3_max\": 0.301279,\n        \"nauc_precision_at_3_std\": -0.167045,\n        \"nauc_precision_at_3_diff1\": 0.574785,\n        \"nauc_precision_at_5_max\": 0.221933,\n        \"nauc_precision_at_5_std\": -0.252462,\n        \"nauc_precision_at_5_diff1\": 0.491378,\n        \"nauc_precision_at_10_max\": -0.003678,\n        \"nauc_precision_at_10_std\": -0.242704,\n        \"nauc_precision_at_10_diff1\": 0.208922,\n        \"nauc_precision_at_20_max\": -0.124209,\n        \"nauc_precision_at_20_std\": 0.064517,\n        \"nauc_precision_at_20_diff1\": 0.037695,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.308626,\n        \"nauc_mrr_at_1_std\": -0.228579,\n        \"nauc_mrr_at_1_diff1\": 0.655737,\n        \"nauc_mrr_at_3_max\": 0.321412,\n        \"nauc_mrr_at_3_std\": -0.19738,\n        \"nauc_mrr_at_3_diff1\": 0.637696,\n        \"nauc_mrr_at_5_max\": 0.310439,\n        \"nauc_mrr_at_5_std\": -0.215003,\n        \"nauc_mrr_at_5_diff1\": 0.631938,\n        \"nauc_mrr_at_10_max\": 0.306275,\n        \"nauc_mrr_at_10_std\": -0.214431,\n        \"nauc_mrr_at_10_diff1\": 0.627561,\n        \"nauc_mrr_at_20_max\": 0.306011,\n        \"nauc_mrr_at_20_std\": -0.209564,\n        \"nauc_mrr_at_20_diff1\": 0.627074,\n        \"nauc_mrr_at_100_max\": 0.310676,\n        \"nauc_mrr_at_100_std\": -0.209687,\n        \"nauc_mrr_at_100_diff1\": 0.632279,\n        \"nauc_mrr_at_1000_max\": 0.310676,\n        \"nauc_mrr_at_1000_std\": -0.209687,\n        \"nauc_mrr_at_1000_diff1\": 0.632279,\n        \"main_score\": 0.81925,\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 1.9287936687469482,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KURE-v1/nlpai-lab__KURE-v1/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"task_name\": \"XPQARetrieval\",\n  \"mteb_version\": \"1.21.6\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.29969,\n        \"ndcg_at_3\": 0.32585,\n        \"ndcg_at_5\": 0.34837,\n        \"ndcg_at_10\": 0.38158,\n        \"ndcg_at_20\": 0.4036,\n        \"ndcg_at_100\": 0.45425,\n        \"ndcg_at_1000\": 0.47954,\n        \"map_at_1\": 0.20907,\n        \"map_at_3\": 0.2944,\n        \"map_at_5\": 0.31246,\n        \"map_at_10\": 0.32934,\n        \"map_at_20\": 0.33631,\n        \"map_at_100\": 0.34415,\n        \"map_at_1000\": 0.3453,\n        \"recall_at_1\": 0.20907,\n        \"recall_at_3\": 0.34778,\n        \"recall_at_5\": 0.40398,\n        \"recall_at_10\": 0.49478,\n        \"recall_at_20\": 0.57146,\n        \"recall_at_100\": 0.81863,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.29969,\n        \"precision_at_3\": 0.18145,\n        \"precision_at_5\": 0.12813,\n        \"precision_at_10\": 0.07859,\n        \"precision_at_20\": 0.04557,\n        \"precision_at_100\": 0.01306,\n        \"precision_at_1000\": 0.00156,\n        \"mrr_at_1\": 0.298165,\n        \"mrr_at_3\": 0.349388,\n        \"mrr_at_5\": 0.361315,\n        \"mrr_at_10\": 0.372384,\n        \"mrr_at_20\": 0.377904,\n        \"mrr_at_100\": 0.383454,\n        \"mrr_at_1000\": 0.384251,\n        \"nauc_ndcg_at_1_max\": 0.185255,\n        \"nauc_ndcg_at_1_std\": -0.293629,\n        \"nauc_ndcg_at_1_diff1\": 0.52904,\n        \"nauc_ndcg_at_3_max\": 0.182618,\n        \"nauc_ndcg_at_3_std\": -0.29233,\n        \"nauc_ndcg_at_3_diff1\": 0.478231,\n        \"nauc_ndcg_at_5_max\": 0.173084,\n        \"nauc_ndcg_at_5_std\": -0.308008,\n        \"nauc_ndcg_at_5_diff1\": 0.474155,\n        \"nauc_ndcg_at_10_max\": 0.180935,\n        \"nauc_ndcg_at_10_std\": -0.30623,\n        \"nauc_ndcg_at_10_diff1\": 0.482508,\n        \"nauc_ndcg_at_20_max\": 0.189305,\n        \"nauc_ndcg_at_20_std\": -0.295186,\n        \"nauc_ndcg_at_20_diff1\": 0.476185,\n        \"nauc_ndcg_at_100_max\": 0.212514,\n        \"nauc_ndcg_at_100_std\": -0.247023,\n        \"nauc_ndcg_at_100_diff1\": 0.475654,\n        \"nauc_ndcg_at_1000_max\": 0.197363,\n        \"nauc_ndcg_at_1000_std\": -0.276491,\n        \"nauc_ndcg_at_1000_diff1\": 0.480516,\n        \"nauc_map_at_1_max\": 0.142274,\n        \"nauc_map_at_1_std\": -0.26814,\n        \"nauc_map_at_1_diff1\": 0.542024,\n        \"nauc_map_at_3_max\": 0.184188,\n        \"nauc_map_at_3_std\": -0.286823,\n        \"nauc_map_at_3_diff1\": 0.479828,\n        \"nauc_map_at_5_max\": 0.179512,\n        \"nauc_map_at_5_std\": -0.301422,\n        \"nauc_map_at_5_diff1\": 0.477793,\n        \"nauc_map_at_10_max\": 0.181279,\n        \"nauc_map_at_10_std\": -0.303136,\n        \"nauc_map_at_10_diff1\": 0.480646,\n        \"nauc_map_at_20_max\": 0.183516,\n        \"nauc_map_at_20_std\": -0.301271,\n        \"nauc_map_at_20_diff1\": 0.479709,\n        \"nauc_map_at_100_max\": 0.186373,\n        \"nauc_map_at_100_std\": -0.294181,\n        \"nauc_map_at_100_diff1\": 0.479856,\n        \"nauc_map_at_1000_max\": 0.185876,\n        \"nauc_map_at_1000_std\": -0.295295,\n        \"nauc_map_at_1000_diff1\": 0.479925,\n        \"nauc_recall_at_1_max\": 0.142274,\n        \"nauc_recall_at_1_std\": -0.26814,\n        \"nauc_recall_at_1_diff1\": 0.542024,\n        \"nauc_recall_at_3_max\": 0.176409,\n        \"nauc_recall_at_3_std\": -0.273774,\n        \"nauc_recall_at_3_diff1\": 0.437992,\n        \"nauc_recall_at_5_max\": 0.151198,\n        \"nauc_recall_at_5_std\": -0.313378,\n        \"nauc_recall_at_5_diff1\": 0.427717,\n        \"nauc_recall_at_10_max\": 0.17051,\n        \"nauc_recall_at_10_std\": -0.301517,\n        \"nauc_recall_at_10_diff1\": 0.444929,\n        \"nauc_recall_at_20_max\": 0.200838,\n        \"nauc_recall_at_20_std\": -0.259205,\n        \"nauc_recall_at_20_diff1\": 0.416033,\n        \"nauc_recall_at_100_max\": 0.391323,\n        \"nauc_recall_at_100_std\": 0.138514,\n        \"nauc_recall_at_100_diff1\": 0.365729,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.185255,\n        \"nauc_precision_at_1_std\": -0.293629,\n        \"nauc_precision_at_1_diff1\": 0.52904,\n        \"nauc_precision_at_3_max\": 0.19322,\n        \"nauc_precision_at_3_std\": -0.265535,\n        \"nauc_precision_at_3_diff1\": 0.338089,\n        \"nauc_precision_at_5_max\": 0.168395,\n        \"nauc_precision_at_5_std\": -0.280409,\n        \"nauc_precision_at_5_diff1\": 0.312183,\n        \"nauc_precision_at_10_max\": 0.16462,\n        \"nauc_precision_at_10_std\": -0.256445,\n        \"nauc_precision_at_10_diff1\": 0.294712,\n        \"nauc_precision_at_20_max\": 0.167231,\n        \"nauc_precision_at_20_std\": -0.211221,\n        \"nauc_precision_at_20_diff1\": 0.252206,\n        \"nauc_precision_at_100_max\": 0.212522,\n        \"nauc_precision_at_100_std\": 0.06126,\n        \"nauc_precision_at_100_diff1\": 0.116848,\n        \"nauc_precision_at_1000_max\": 0.133829,\n        \"nauc_precision_at_1000_std\": 0.041224,\n        \"nauc_precision_at_1000_diff1\": 0.011564,\n        \"nauc_mrr_at_1_max\": 0.185517,\n        \"nauc_mrr_at_1_std\": -0.298726,\n        \"nauc_mrr_at_1_diff1\": 0.534802,\n        \"nauc_mrr_at_3_max\": 0.184778,\n        \"nauc_mrr_at_3_std\": -0.294455,\n        \"nauc_mrr_at_3_diff1\": 0.504579,\n        \"nauc_mrr_at_5_max\": 0.17654,\n        \"nauc_mrr_at_5_std\": -0.302472,\n        \"nauc_mrr_at_5_diff1\": 0.501237,\n        \"nauc_mrr_at_10_max\": 0.181937,\n        \"nauc_mrr_at_10_std\": -0.299648,\n        \"nauc_mrr_at_10_diff1\": 0.505392,\n        \"nauc_mrr_at_20_max\": 0.185438,\n        \"nauc_mrr_at_20_std\": -0.293949,\n        \"nauc_mrr_at_20_diff1\": 0.503537,\n        \"nauc_mrr_at_100_max\": 0.18721,\n        \"nauc_mrr_at_100_std\": -0.289807,\n        \"nauc_mrr_at_100_diff1\": 0.503231,\n        \"nauc_mrr_at_1000_max\": 0.186581,\n        \"nauc_mrr_at_1000_std\": -0.290973,\n        \"nauc_mrr_at_1000_diff1\": 0.503404,\n        \"main_score\": 0.38158,\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.28135,\n        \"ndcg_at_3\": 0.30664,\n        \"ndcg_at_5\": 0.33055,\n        \"ndcg_at_10\": 0.36466,\n        \"ndcg_at_20\": 0.3875,\n        \"ndcg_at_100\": 0.44398,\n        \"ndcg_at_1000\": 0.47303,\n        \"map_at_1\": 0.16195,\n        \"map_at_3\": 0.25435,\n        \"map_at_5\": 0.28328,\n        \"map_at_10\": 0.30242,\n        \"map_at_20\": 0.31044,\n        \"map_at_100\": 0.32028,\n        \"map_at_1000\": 0.32203,\n        \"recall_at_1\": 0.16195,\n        \"recall_at_3\": 0.31007,\n        \"recall_at_5\": 0.38665,\n        \"recall_at_10\": 0.47031,\n        \"recall_at_20\": 0.54559,\n        \"recall_at_100\": 0.80691,\n        \"recall_at_1000\": 0.99949,\n        \"precision_at_1\": 0.28135,\n        \"precision_at_3\": 0.20133,\n        \"precision_at_5\": 0.15566,\n        \"precision_at_10\": 0.09694,\n        \"precision_at_20\": 0.05604,\n        \"precision_at_100\": 0.01609,\n        \"precision_at_1000\": 0.00195,\n        \"mrr_at_1\": 0.281346,\n        \"mrr_at_3\": 0.345821,\n        \"mrr_at_5\": 0.360805,\n        \"mrr_at_10\": 0.371258,\n        \"mrr_at_20\": 0.376241,\n        \"mrr_at_100\": 0.382019,\n        \"mrr_at_1000\": 0.382721,\n        \"nauc_ndcg_at_1_max\": 0.094105,\n        \"nauc_ndcg_at_1_std\": -0.316474,\n        \"nauc_ndcg_at_1_diff1\": 0.516674,\n        \"nauc_ndcg_at_3_max\": 0.045168,\n        \"nauc_ndcg_at_3_std\": -0.343558,\n        \"nauc_ndcg_at_3_diff1\": 0.42946,\n        \"nauc_ndcg_at_5_max\": 0.033593,\n        \"nauc_ndcg_at_5_std\": -0.348724,\n        \"nauc_ndcg_at_5_diff1\": 0.405359,\n        \"nauc_ndcg_at_10_max\": 0.034196,\n        \"nauc_ndcg_at_10_std\": -0.347105,\n        \"nauc_ndcg_at_10_diff1\": 0.402682,\n        \"nauc_ndcg_at_20_max\": 0.038368,\n        \"nauc_ndcg_at_20_std\": -0.344478,\n        \"nauc_ndcg_at_20_diff1\": 0.401801,\n        \"nauc_ndcg_at_100_max\": 0.048155,\n        \"nauc_ndcg_at_100_std\": -0.320897,\n        \"nauc_ndcg_at_100_diff1\": 0.399984,\n        \"nauc_ndcg_at_1000_max\": 0.054938,\n        \"nauc_ndcg_at_1000_std\": -0.32543,\n        \"nauc_ndcg_at_1000_diff1\": 0.41171,\n        \"nauc_map_at_1_max\": 0.068529,\n        \"nauc_map_at_1_std\": -0.268016,\n        \"nauc_map_at_1_diff1\": 0.534787,\n        \"nauc_map_at_3_max\": 0.045564,\n        \"nauc_map_at_3_std\": -0.32845,\n        \"nauc_map_at_3_diff1\": 0.453435,\n        \"nauc_map_at_5_max\": 0.041195,\n        \"nauc_map_at_5_std\": -0.339515,\n        \"nauc_map_at_5_diff1\": 0.427519,\n        \"nauc_map_at_10_max\": 0.043165,\n        \"nauc_map_at_10_std\": -0.341514,\n        \"nauc_map_at_10_diff1\": 0.426386,\n        \"nauc_map_at_20_max\": 0.043427,\n        \"nauc_map_at_20_std\": -0.342731,\n        \"nauc_map_at_20_diff1\": 0.426351,\n        \"nauc_map_at_100_max\": 0.044002,\n        \"nauc_map_at_100_std\": -0.340526,\n        \"nauc_map_at_100_diff1\": 0.425798,\n        \"nauc_map_at_1000_max\": 0.045262,\n        \"nauc_map_at_1000_std\": -0.339585,\n        \"nauc_map_at_1000_diff1\": 0.426386,\n        \"nauc_recall_at_1_max\": 0.068529,\n        \"nauc_recall_at_1_std\": -0.268016,\n        \"nauc_recall_at_1_diff1\": 0.534787,\n        \"nauc_recall_at_3_max\": 0.024468,\n        \"nauc_recall_at_3_std\": -0.319048,\n        \"nauc_recall_at_3_diff1\": 0.381687,\n        \"nauc_recall_at_5_max\": 0.009382,\n        \"nauc_recall_at_5_std\": -0.331003,\n        \"nauc_recall_at_5_diff1\": 0.322401,\n        \"nauc_recall_at_10_max\": 0.001473,\n        \"nauc_recall_at_10_std\": -0.327362,\n        \"nauc_recall_at_10_diff1\": 0.312948,\n        \"nauc_recall_at_20_max\": 0.012057,\n        \"nauc_recall_at_20_std\": -0.315145,\n        \"nauc_recall_at_20_diff1\": 0.300354,\n        \"nauc_recall_at_100_max\": 0.044714,\n        \"nauc_recall_at_100_std\": -0.146942,\n        \"nauc_recall_at_100_diff1\": 0.240661,\n        \"nauc_recall_at_1000_max\": 1.0,\n        \"nauc_recall_at_1000_std\": 1.0,\n        \"nauc_recall_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1_max\": 0.094105,\n        \"nauc_precision_at_1_std\": -0.316474,\n        \"nauc_precision_at_1_diff1\": 0.516674,\n        \"nauc_precision_at_3_max\": 0.028083,\n        \"nauc_precision_at_3_std\": -0.354435,\n        \"nauc_precision_at_3_diff1\": 0.283145,\n        \"nauc_precision_at_5_max\": 0.017195,\n        \"nauc_precision_at_5_std\": -0.331981,\n        \"nauc_precision_at_5_diff1\": 0.203304,\n        \"nauc_precision_at_10_max\": 0.027622,\n        \"nauc_precision_at_10_std\": -0.292894,\n        \"nauc_precision_at_10_diff1\": 0.18355,\n        \"nauc_precision_at_20_max\": 0.037703,\n        \"nauc_precision_at_20_std\": -0.262081,\n        \"nauc_precision_at_20_diff1\": 0.165698,\n        \"nauc_precision_at_100_max\": 0.085114,\n        \"nauc_precision_at_100_std\": -0.092042,\n        \"nauc_precision_at_100_diff1\": 0.054652,\n        \"nauc_precision_at_1000_max\": 0.118011,\n        \"nauc_precision_at_1000_std\": -0.000622,\n        \"nauc_precision_at_1000_diff1\": -0.004351,\n        \"nauc_mrr_at_1_max\": 0.094105,\n        \"nauc_mrr_at_1_std\": -0.316474,\n        \"nauc_mrr_at_1_diff1\": 0.516674,\n        \"nauc_mrr_at_3_max\": 0.056857,\n        \"nauc_mrr_at_3_std\": -0.338862,\n        \"nauc_mrr_at_3_diff1\": 0.448368,\n        \"nauc_mrr_at_5_max\": 0.053247,\n        \"nauc_mrr_at_5_std\": -0.342588,\n        \"nauc_mrr_at_5_diff1\": 0.438226,\n        \"nauc_mrr_at_10_max\": 0.054761,\n        \"nauc_mrr_at_10_std\": -0.338175,\n        \"nauc_mrr_at_10_diff1\": 0.436671,\n        \"nauc_mrr_at_20_max\": 0.056653,\n        \"nauc_mrr_at_20_std\": -0.335522,\n        \"nauc_mrr_at_20_diff1\": 0.436089,\n        \"nauc_mrr_at_100_max\": 0.057628,\n        \"nauc_mrr_at_100_std\": -0.33298,\n        \"nauc_mrr_at_100_diff1\": 0.437037,\n        \"nauc_mrr_at_1000_max\": 0.05751,\n        \"nauc_mrr_at_1000_std\": -0.333511,\n        \"nauc_mrr_at_1000_diff1\": 0.437531,\n        \"main_score\": 0.36466,\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.26873,\n        \"ndcg_at_3\": 0.29532,\n        \"ndcg_at_5\": 0.31604,\n        \"ndcg_at_10\": 0.34995,\n        \"ndcg_at_20\": 0.37273,\n        \"ndcg_at_100\": 0.42723,\n        \"ndcg_at_1000\": 0.45554,\n        \"map_at_1\": 0.18754,\n        \"map_at_3\": 0.26398,\n        \"map_at_5\": 0.28046,\n        \"map_at_10\": 0.2974,\n        \"map_at_20\": 0.30502,\n        \"map_at_100\": 0.31386,\n        \"map_at_1000\": 0.31512,\n        \"recall_at_1\": 0.18754,\n        \"recall_at_3\": 0.31788,\n        \"recall_at_5\": 0.36674,\n        \"recall_at_10\": 0.45766,\n        \"recall_at_20\": 0.53428,\n        \"recall_at_100\": 0.79612,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.26873,\n        \"precision_at_3\": 0.16667,\n        \"precision_at_5\": 0.12085,\n        \"precision_at_10\": 0.07704,\n        \"precision_at_20\": 0.04577,\n        \"precision_at_100\": 0.01358,\n        \"precision_at_1000\": 0.00167,\n        \"mrr_at_1\": 0.267101,\n        \"mrr_at_3\": 0.316232,\n        \"mrr_at_5\": 0.329262,\n        \"mrr_at_10\": 0.341046,\n        \"mrr_at_20\": 0.346495,\n        \"mrr_at_100\": 0.352335,\n        \"mrr_at_1000\": 0.353085,\n        \"nauc_ndcg_at_1_max\": 0.185851,\n        \"nauc_ndcg_at_1_std\": -0.203731,\n        \"nauc_ndcg_at_1_diff1\": 0.462692,\n        \"nauc_ndcg_at_3_max\": 0.147801,\n        \"nauc_ndcg_at_3_std\": -0.231289,\n        \"nauc_ndcg_at_3_diff1\": 0.404865,\n        \"nauc_ndcg_at_5_max\": 0.1488,\n        \"nauc_ndcg_at_5_std\": -0.237314,\n        \"nauc_ndcg_at_5_diff1\": 0.393875,\n        \"nauc_ndcg_at_10_max\": 0.152161,\n        \"nauc_ndcg_at_10_std\": -0.241002,\n        \"nauc_ndcg_at_10_diff1\": 0.393157,\n        \"nauc_ndcg_at_20_max\": 0.15502,\n        \"nauc_ndcg_at_20_std\": -0.231115,\n        \"nauc_ndcg_at_20_diff1\": 0.394928,\n        \"nauc_ndcg_at_100_max\": 0.173095,\n        \"nauc_ndcg_at_100_std\": -0.18289,\n        \"nauc_ndcg_at_100_diff1\": 0.396386,\n        \"nauc_ndcg_at_1000_max\": 0.170924,\n        \"nauc_ndcg_at_1000_std\": -0.203439,\n        \"nauc_ndcg_at_1000_diff1\": 0.405588,\n        \"nauc_map_at_1_max\": 0.14769,\n        \"nauc_map_at_1_std\": -0.178742,\n        \"nauc_map_at_1_diff1\": 0.488624,\n        \"nauc_map_at_3_max\": 0.153568,\n        \"nauc_map_at_3_std\": -0.222758,\n        \"nauc_map_at_3_diff1\": 0.408914,\n        \"nauc_map_at_5_max\": 0.152616,\n        \"nauc_map_at_5_std\": -0.230648,\n        \"nauc_map_at_5_diff1\": 0.398317,\n        \"nauc_map_at_10_max\": 0.155737,\n        \"nauc_map_at_10_std\": -0.233697,\n        \"nauc_map_at_10_diff1\": 0.399552,\n        \"nauc_map_at_20_max\": 0.155004,\n        \"nauc_map_at_20_std\": -0.232309,\n        \"nauc_map_at_20_diff1\": 0.399328,\n        \"nauc_map_at_100_max\": 0.1576,\n        \"nauc_map_at_100_std\": -0.224424,\n        \"nauc_map_at_100_diff1\": 0.400345,\n        \"nauc_map_at_1000_max\": 0.157888,\n        \"nauc_map_at_1000_std\": -0.224825,\n        \"nauc_map_at_1000_diff1\": 0.400781,\n        \"nauc_recall_at_1_max\": 0.14769,\n        \"nauc_recall_at_1_std\": -0.178742,\n        \"nauc_recall_at_1_diff1\": 0.488624,\n        \"nauc_recall_at_3_max\": 0.120369,\n        \"nauc_recall_at_3_std\": -0.233571,\n        \"nauc_recall_at_3_diff1\": 0.364854,\n        \"nauc_recall_at_5_max\": 0.124395,\n        \"nauc_recall_at_5_std\": -0.247811,\n        \"nauc_recall_at_5_diff1\": 0.345413,\n        \"nauc_recall_at_10_max\": 0.128996,\n        \"nauc_recall_at_10_std\": -0.253887,\n        \"nauc_recall_at_10_diff1\": 0.331844,\n        \"nauc_recall_at_20_max\": 0.139756,\n        \"nauc_recall_at_20_std\": -0.222521,\n        \"nauc_recall_at_20_diff1\": 0.331895,\n        \"nauc_recall_at_100_max\": 0.211622,\n        \"nauc_recall_at_100_std\": 0.085916,\n        \"nauc_recall_at_100_diff1\": 0.275684,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.185851,\n        \"nauc_precision_at_1_std\": -0.203731,\n        \"nauc_precision_at_1_diff1\": 0.462692,\n        \"nauc_precision_at_3_max\": 0.148277,\n        \"nauc_precision_at_3_std\": -0.228099,\n        \"nauc_precision_at_3_diff1\": 0.277866,\n        \"nauc_precision_at_5_max\": 0.138236,\n        \"nauc_precision_at_5_std\": -0.233192,\n        \"nauc_precision_at_5_diff1\": 0.237999,\n        \"nauc_precision_at_10_max\": 0.131532,\n        \"nauc_precision_at_10_std\": -0.211085,\n        \"nauc_precision_at_10_diff1\": 0.219161,\n        \"nauc_precision_at_20_max\": 0.128112,\n        \"nauc_precision_at_20_std\": -0.157827,\n        \"nauc_precision_at_20_diff1\": 0.200437,\n        \"nauc_precision_at_100_max\": 0.202322,\n        \"nauc_precision_at_100_std\": 0.110302,\n        \"nauc_precision_at_100_diff1\": 0.107249,\n        \"nauc_precision_at_1000_max\": 0.182725,\n        \"nauc_precision_at_1000_std\": 0.115469,\n        \"nauc_precision_at_1000_diff1\": 0.049456,\n        \"nauc_mrr_at_1_max\": 0.18997,\n        \"nauc_mrr_at_1_std\": -0.199972,\n        \"nauc_mrr_at_1_diff1\": 0.468971,\n        \"nauc_mrr_at_3_max\": 0.162908,\n        \"nauc_mrr_at_3_std\": -0.222321,\n        \"nauc_mrr_at_3_diff1\": 0.434997,\n        \"nauc_mrr_at_5_max\": 0.166916,\n        \"nauc_mrr_at_5_std\": -0.22507,\n        \"nauc_mrr_at_5_diff1\": 0.432051,\n        \"nauc_mrr_at_10_max\": 0.167261,\n        \"nauc_mrr_at_10_std\": -0.223063,\n        \"nauc_mrr_at_10_diff1\": 0.428935,\n        \"nauc_mrr_at_20_max\": 0.169802,\n        \"nauc_mrr_at_20_std\": -0.217834,\n        \"nauc_mrr_at_20_diff1\": 0.43113,\n        \"nauc_mrr_at_100_max\": 0.171108,\n        \"nauc_mrr_at_100_std\": -0.214006,\n        \"nauc_mrr_at_100_diff1\": 0.431074,\n        \"nauc_mrr_at_1000_max\": 0.171026,\n        \"nauc_mrr_at_1000_std\": -0.214628,\n        \"nauc_mrr_at_1000_diff1\": 0.431278,\n        \"main_score\": 0.34995,\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 14.467206716537476,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KURE-v1/nlpai-lab__KURE-v1/no_revision_available/model_meta.json",
    "content": "{\"name\": \"nlpai-lab/KURE-v1\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": null, \"n_parameters\": null, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": null, \"public_training_data\": false, \"public_training_code\": null, \"framework\": [\"PyTorch\", \"Sentence Transformers\"], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"zero_shot_benchmarks\": null, \"adapted_from\": null, \"superseded_by\": null, \"loader\": null}"
  },
  {
    "path": "eval/results/nlpai-lab/KoE5/no_model_name_available/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 19.922383546829224,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.84339,\n        \"map_at_1\": 0.7193,\n        \"map_at_10\": 0.80894,\n        \"map_at_100\": 0.81076,\n        \"map_at_1000\": 0.81076,\n        \"map_at_20\": 0.80997,\n        \"map_at_3\": 0.79678,\n        \"map_at_5\": 0.80687,\n        \"mrr_at_1\": 0.7192982456140351,\n        \"mrr_at_10\": 0.8089424951267057,\n        \"mrr_at_100\": 0.8107636500019111,\n        \"mrr_at_1000\": 0.8107636500019111,\n        \"mrr_at_20\": 0.8099658869395712,\n        \"mrr_at_3\": 0.7967836257309943,\n        \"mrr_at_5\": 0.8068713450292399,\n        \"nauc_map_at_1000_diff1\": 0.6320942680079616,\n        \"nauc_map_at_1000_max\": -0.05701885689693603,\n        \"nauc_map_at_1000_std\": -0.6853683208954745,\n        \"nauc_map_at_100_diff1\": 0.6320942680079616,\n        \"nauc_map_at_100_max\": -0.05701885689693603,\n        \"nauc_map_at_100_std\": -0.6853683208954745,\n        \"nauc_map_at_10_diff1\": 0.633309415089511,\n        \"nauc_map_at_10_max\": -0.05429473185056241,\n        \"nauc_map_at_10_std\": -0.6918629844580086,\n        \"nauc_map_at_1_diff1\": 0.6674090056378712,\n        \"nauc_map_at_1_max\": -0.1251284973664897,\n        \"nauc_map_at_1_std\": -0.6485224985983171,\n        \"nauc_map_at_20_diff1\": 0.6326370926444672,\n        \"nauc_map_at_20_max\": -0.05507130571170382,\n        \"nauc_map_at_20_std\": -0.6854871094189069,\n        \"nauc_map_at_3_diff1\": 0.609689975413944,\n        \"nauc_map_at_3_max\": -0.02805045628386939,\n        \"nauc_map_at_3_std\": -0.6626074040597936,\n        \"nauc_map_at_5_diff1\": 0.6296484757032934,\n        \"nauc_map_at_5_max\": -0.05999223752680984,\n        \"nauc_map_at_5_std\": -0.6860149178877104,\n        \"nauc_mrr_at_1000_diff1\": 0.6320942680079616,\n        \"nauc_mrr_at_1000_max\": -0.05701885689693603,\n        \"nauc_mrr_at_1000_std\": -0.6853683208954745,\n        \"nauc_mrr_at_100_diff1\": 0.6320942680079616,\n        \"nauc_mrr_at_100_max\": -0.05701885689693603,\n        \"nauc_mrr_at_100_std\": -0.6853683208954745,\n        \"nauc_mrr_at_10_diff1\": 0.633309415089511,\n        \"nauc_mrr_at_10_max\": -0.05429473185056241,\n        \"nauc_mrr_at_10_std\": -0.6918629844580086,\n        \"nauc_mrr_at_1_diff1\": 0.6674090056378712,\n        \"nauc_mrr_at_1_max\": -0.1251284973664897,\n        \"nauc_mrr_at_1_std\": -0.6485224985983171,\n        \"nauc_mrr_at_20_diff1\": 0.6326370926444672,\n        \"nauc_mrr_at_20_max\": -0.05507130571170382,\n        \"nauc_mrr_at_20_std\": -0.6854871094189069,\n        \"nauc_mrr_at_3_diff1\": 0.609689975413944,\n        \"nauc_mrr_at_3_max\": -0.02805045628386939,\n        \"nauc_mrr_at_3_std\": -0.6626074040597936,\n        \"nauc_mrr_at_5_diff1\": 0.6296484757032934,\n        \"nauc_mrr_at_5_max\": -0.05999223752680984,\n        \"nauc_mrr_at_5_std\": -0.6860149178877104,\n        \"nauc_ndcg_at_1000_diff1\": 0.6334301799598651,\n        \"nauc_ndcg_at_1000_max\": -0.04468898576313594,\n        \"nauc_ndcg_at_1000_std\": -0.6952142682019876,\n        \"nauc_ndcg_at_100_diff1\": 0.6334301799598651,\n        \"nauc_ndcg_at_100_max\": -0.04468898576313594,\n        \"nauc_ndcg_at_100_std\": -0.6952142682019876,\n        \"nauc_ndcg_at_10_diff1\": 0.6436986997944144,\n        \"nauc_ndcg_at_10_max\": -0.02291530543046443,\n        \"nauc_ndcg_at_10_std\": -0.7310258910452394,\n        \"nauc_ndcg_at_1_diff1\": 0.6674090056378712,\n        \"nauc_ndcg_at_1_max\": -0.1251284973664897,\n        \"nauc_ndcg_at_1_std\": -0.6485224985983171,\n        \"nauc_ndcg_at_20_diff1\": 0.6399616809257035,\n        \"nauc_ndcg_at_20_max\": -0.02426566036832786,\n        \"nauc_ndcg_at_20_std\": -0.699937879968727,\n        \"nauc_ndcg_at_3_diff1\": 0.5919667530188153,\n        \"nauc_ndcg_at_3_max\": 0.020530667149423275,\n        \"nauc_ndcg_at_3_std\": -0.6630627158068408,\n        \"nauc_ndcg_at_5_diff1\": 0.6323477601323944,\n        \"nauc_ndcg_at_5_max\": -0.04307026006368585,\n        \"nauc_ndcg_at_5_std\": -0.7120648723045967,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.7836190936419349,\n        \"nauc_precision_at_10_max\": 0.2755948174983461,\n        \"nauc_precision_at_10_std\": -1.1385948830272972,\n        \"nauc_precision_at_1_diff1\": 0.6674090056378712,\n        \"nauc_precision_at_1_max\": -0.1251284973664897,\n        \"nauc_precision_at_1_std\": -0.6485224985983171,\n        \"nauc_precision_at_20_diff1\": 0.7867387395585554,\n        \"nauc_precision_at_20_max\": 0.4156498548585641,\n        \"nauc_precision_at_20_std\": -0.8296243289837735,\n        \"nauc_precision_at_3_diff1\": 0.5124419476805667,\n        \"nauc_precision_at_3_max\": 0.2518702236748006,\n        \"nauc_precision_at_3_std\": -0.6623529855930005,\n        \"nauc_precision_at_5_diff1\": 0.6723384771911648,\n        \"nauc_precision_at_5_max\": 0.0564740646866425,\n        \"nauc_precision_at_5_std\": -0.9091407205206298,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.7836190936419378,\n        \"nauc_recall_at_10_max\": 0.2755948174983493,\n        \"nauc_recall_at_10_std\": -1.13859488302729,\n        \"nauc_recall_at_1_diff1\": 0.6674090056378712,\n        \"nauc_recall_at_1_max\": -0.1251284973664897,\n        \"nauc_recall_at_1_std\": -0.6485224985983171,\n        \"nauc_recall_at_20_diff1\": 0.7867387395585571,\n        \"nauc_recall_at_20_max\": 0.41564985485856165,\n        \"nauc_recall_at_20_std\": -0.8296243289837761,\n        \"nauc_recall_at_3_diff1\": 0.5124419476805673,\n        \"nauc_recall_at_3_max\": 0.2518702236748035,\n        \"nauc_recall_at_3_std\": -0.6623529855929987,\n        \"nauc_recall_at_5_diff1\": 0.6723384771911676,\n        \"nauc_recall_at_5_max\": 0.05647406468664335,\n        \"nauc_recall_at_5_std\": -0.9091407205206277,\n        \"ndcg_at_1\": 0.7193,\n        \"ndcg_at_10\": 0.84339,\n        \"ndcg_at_100\": 0.85391,\n        \"ndcg_at_1000\": 0.85391,\n        \"ndcg_at_20\": 0.84758,\n        \"ndcg_at_3\": 0.81986,\n        \"ndcg_at_5\": 0.83798,\n        \"precision_at_1\": 0.7193,\n        \"precision_at_10\": 0.09474,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04825,\n        \"precision_at_3\": 0.29532,\n        \"precision_at_5\": 0.18596,\n        \"recall_at_1\": 0.7193,\n        \"recall_at_10\": 0.94737,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96491,\n        \"recall_at_3\": 0.88596,\n        \"recall_at_5\": 0.92982\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KoE5/no_model_name_available/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 26.43672013282776,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.94251,\n        \"map_at_1\": 0.89333,\n        \"map_at_10\": 0.92898,\n        \"map_at_100\": 0.9295,\n        \"map_at_1000\": 0.92952,\n        \"map_at_20\": 0.92937,\n        \"map_at_3\": 0.92426,\n        \"map_at_5\": 0.92793,\n        \"mrr_at_1\": 0.8933333333333333,\n        \"mrr_at_10\": 0.9289828042328042,\n        \"mrr_at_100\": 0.9294972174704905,\n        \"mrr_at_1000\": 0.9295225970670912,\n        \"mrr_at_20\": 0.9293730158730159,\n        \"mrr_at_3\": 0.9242592592592593,\n        \"mrr_at_5\": 0.927925925925926,\n        \"nauc_map_at_1000_diff1\": 0.9233864675994327,\n        \"nauc_map_at_1000_max\": 0.8090206958688105,\n        \"nauc_map_at_1000_std\": -0.10539329815363037,\n        \"nauc_map_at_100_diff1\": 0.9233917827008663,\n        \"nauc_map_at_100_max\": 0.8090898721437118,\n        \"nauc_map_at_100_std\": -0.10500435662013195,\n        \"nauc_map_at_10_diff1\": 0.9232644909975076,\n        \"nauc_map_at_10_max\": 0.8095876086490258,\n        \"nauc_map_at_10_std\": -0.10574632386413099,\n        \"nauc_map_at_1_diff1\": 0.9219914489683861,\n        \"nauc_map_at_1_max\": 0.7792078528281168,\n        \"nauc_map_at_1_std\": -0.1528791088099168,\n        \"nauc_map_at_20_diff1\": 0.9232443580286058,\n        \"nauc_map_at_20_max\": 0.8091726176091726,\n        \"nauc_map_at_20_std\": -0.10501053945253029,\n        \"nauc_map_at_3_diff1\": 0.9245096080767995,\n        \"nauc_map_at_3_max\": 0.8169103988574538,\n        \"nauc_map_at_3_std\": -0.09255968166715849,\n        \"nauc_map_at_5_diff1\": 0.9241431361588304,\n        \"nauc_map_at_5_max\": 0.811087360962672,\n        \"nauc_map_at_5_std\": -0.10305440425262838,\n        \"nauc_mrr_at_1000_diff1\": 0.9233864675994327,\n        \"nauc_mrr_at_1000_max\": 0.8090206958688105,\n        \"nauc_mrr_at_1000_std\": -0.10539329815363037,\n        \"nauc_mrr_at_100_diff1\": 0.9233917827008663,\n        \"nauc_mrr_at_100_max\": 0.8090898721437118,\n        \"nauc_mrr_at_100_std\": -0.10500435662013195,\n        \"nauc_mrr_at_10_diff1\": 0.9232644909975076,\n        \"nauc_mrr_at_10_max\": 0.8095876086490258,\n        \"nauc_mrr_at_10_std\": -0.10574632386413099,\n        \"nauc_mrr_at_1_diff1\": 0.9219914489683861,\n        \"nauc_mrr_at_1_max\": 0.7792078528281168,\n        \"nauc_mrr_at_1_std\": -0.1528791088099168,\n        \"nauc_mrr_at_20_diff1\": 0.9232443580286058,\n        \"nauc_mrr_at_20_max\": 0.8091726176091726,\n        \"nauc_mrr_at_20_std\": -0.10501053945253029,\n        \"nauc_mrr_at_3_diff1\": 0.9245096080767995,\n        \"nauc_mrr_at_3_max\": 0.8169103988574538,\n        \"nauc_mrr_at_3_std\": -0.09255968166715849,\n        \"nauc_mrr_at_5_diff1\": 0.9241431361588304,\n        \"nauc_mrr_at_5_max\": 0.811087360962672,\n        \"nauc_mrr_at_5_std\": -0.10305440425262838,\n        \"nauc_ndcg_at_1000_diff1\": 0.9234321310800012,\n        \"nauc_ndcg_at_1000_max\": 0.8134769479311467,\n        \"nauc_ndcg_at_1000_std\": -0.09530413213685224,\n        \"nauc_ndcg_at_100_diff1\": 0.9235614555171696,\n        \"nauc_ndcg_at_100_max\": 0.8155106567552204,\n        \"nauc_ndcg_at_100_std\": -0.08371598384355847,\n        \"nauc_ndcg_at_10_diff1\": 0.9225885992841035,\n        \"nauc_ndcg_at_10_max\": 0.8180141073001267,\n        \"nauc_ndcg_at_10_std\": -0.0908177224862573,\n        \"nauc_ndcg_at_1_diff1\": 0.9219914489683861,\n        \"nauc_ndcg_at_1_max\": 0.7792078528281168,\n        \"nauc_ndcg_at_1_std\": -0.1528791088099168,\n        \"nauc_ndcg_at_20_diff1\": 0.9225685571953032,\n        \"nauc_ndcg_at_20_max\": 0.8162028689364406,\n        \"nauc_ndcg_at_20_std\": -0.08806888636157015,\n        \"nauc_ndcg_at_3_diff1\": 0.9256420489413464,\n        \"nauc_ndcg_at_3_max\": 0.8331262056528227,\n        \"nauc_ndcg_at_3_std\": -0.06283685906042585,\n        \"nauc_ndcg_at_5_diff1\": 0.9251077899816641,\n        \"nauc_ndcg_at_5_max\": 0.8222650665358133,\n        \"nauc_ndcg_at_5_std\": -0.08101541630049999,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9346405228758011,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.9673202614378776,\n        \"nauc_precision_at_10_diff1\": 0.91067538126361,\n        \"nauc_precision_at_10_max\": 0.9038281979458412,\n        \"nauc_precision_at_10_std\": 0.05981948334889332,\n        \"nauc_precision_at_1_diff1\": 0.9219914489683861,\n        \"nauc_precision_at_1_max\": 0.7792078528281168,\n        \"nauc_precision_at_1_std\": -0.1528791088099168,\n        \"nauc_precision_at_20_diff1\": 0.9052287581699321,\n        \"nauc_precision_at_20_max\": 0.9096638655461987,\n        \"nauc_precision_at_20_std\": 0.17969187675070394,\n        \"nauc_precision_at_3_diff1\": 0.9315491962550828,\n        \"nauc_precision_at_3_max\": 0.9172912408206573,\n        \"nauc_precision_at_3_std\": 0.09368612309789238,\n        \"nauc_precision_at_5_diff1\": 0.9331550802138999,\n        \"nauc_precision_at_5_max\": 0.909918512859686,\n        \"nauc_precision_at_5_std\": 0.0995034377387245,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9346405228758294,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.9673202614379001,\n        \"nauc_recall_at_10_diff1\": 0.9106753812636191,\n        \"nauc_recall_at_10_max\": 0.9038281979458463,\n        \"nauc_recall_at_10_std\": 0.059819483348899666,\n        \"nauc_recall_at_1_diff1\": 0.9219914489683861,\n        \"nauc_recall_at_1_max\": 0.7792078528281168,\n        \"nauc_recall_at_1_std\": -0.1528791088099168,\n        \"nauc_recall_at_20_diff1\": 0.9052287581699371,\n        \"nauc_recall_at_20_max\": 0.9096638655462097,\n        \"nauc_recall_at_20_std\": 0.17969187675069964,\n        \"nauc_recall_at_3_diff1\": 0.9315491962550781,\n        \"nauc_recall_at_3_max\": 0.9172912408206558,\n        \"nauc_recall_at_3_std\": 0.09368612309788747,\n        \"nauc_recall_at_5_diff1\": 0.933155080213904,\n        \"nauc_recall_at_5_max\": 0.90991851285969,\n        \"nauc_recall_at_5_std\": 0.0995034377387257,\n        \"ndcg_at_1\": 0.89333,\n        \"ndcg_at_10\": 0.94251,\n        \"ndcg_at_100\": 0.94507,\n        \"ndcg_at_1000\": 0.94566,\n        \"ndcg_at_20\": 0.94393,\n        \"ndcg_at_3\": 0.93324,\n        \"ndcg_at_5\": 0.93998,\n        \"precision_at_1\": 0.89333,\n        \"precision_at_10\": 0.09833,\n        \"precision_at_100\": 0.00996,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04944,\n        \"precision_at_3\": 0.31963,\n        \"precision_at_5\": 0.19511,\n        \"recall_at_1\": 0.89333,\n        \"recall_at_10\": 0.98333,\n        \"recall_at_100\": 0.99556,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98889,\n        \"recall_at_3\": 0.95889,\n        \"recall_at_5\": 0.97556\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.93651,\n        \"map_at_1\": 0.88222,\n        \"map_at_10\": 0.92027,\n        \"map_at_100\": 0.92073,\n        \"map_at_1000\": 0.92075,\n        \"map_at_20\": 0.92059,\n        \"map_at_3\": 0.91481,\n        \"map_at_5\": 0.9177,\n        \"mrr_at_1\": 0.8822222222222222,\n        \"mrr_at_10\": 0.9202733686067022,\n        \"mrr_at_100\": 0.920731019983486,\n        \"mrr_at_1000\": 0.9207500928454461,\n        \"mrr_at_20\": 0.9205878863329845,\n        \"mrr_at_3\": 0.914814814814815,\n        \"mrr_at_5\": 0.917703703703704,\n        \"nauc_map_at_1000_diff1\": 0.910378752606316,\n        \"nauc_map_at_1000_max\": 0.7677636365954222,\n        \"nauc_map_at_1000_std\": -0.2069823724831138,\n        \"nauc_map_at_100_diff1\": 0.9103896986298576,\n        \"nauc_map_at_100_max\": 0.7678203461116878,\n        \"nauc_map_at_100_std\": -0.2066944275679903,\n        \"nauc_map_at_10_diff1\": 0.9103310767339169,\n        \"nauc_map_at_10_max\": 0.7685995087295452,\n        \"nauc_map_at_10_std\": -0.20497000510700775,\n        \"nauc_map_at_1_diff1\": 0.9139154970077102,\n        \"nauc_map_at_1_max\": 0.7432381431626621,\n        \"nauc_map_at_1_std\": -0.23120158869938737,\n        \"nauc_map_at_20_diff1\": 0.9103723300246829,\n        \"nauc_map_at_20_max\": 0.7677931632230002,\n        \"nauc_map_at_20_std\": -0.20619686634822945,\n        \"nauc_map_at_3_diff1\": 0.910729719718484,\n        \"nauc_map_at_3_max\": 0.775728484998148,\n        \"nauc_map_at_3_std\": -0.20419702020825395,\n        \"nauc_map_at_5_diff1\": 0.9096210108253402,\n        \"nauc_map_at_5_max\": 0.7711235413411344,\n        \"nauc_map_at_5_std\": -0.20651983963596712,\n        \"nauc_mrr_at_1000_diff1\": 0.910378752606316,\n        \"nauc_mrr_at_1000_max\": 0.7677636365954222,\n        \"nauc_mrr_at_1000_std\": -0.2069823724831138,\n        \"nauc_mrr_at_100_diff1\": 0.9103896986298576,\n        \"nauc_mrr_at_100_max\": 0.7678203461116878,\n        \"nauc_mrr_at_100_std\": -0.2066944275679903,\n        \"nauc_mrr_at_10_diff1\": 0.9103310767339169,\n        \"nauc_mrr_at_10_max\": 0.7685995087295452,\n        \"nauc_mrr_at_10_std\": -0.20497000510700775,\n        \"nauc_mrr_at_1_diff1\": 0.9139154970077102,\n        \"nauc_mrr_at_1_max\": 0.7432381431626621,\n        \"nauc_mrr_at_1_std\": -0.23120158869938737,\n        \"nauc_mrr_at_20_diff1\": 0.9103723300246829,\n        \"nauc_mrr_at_20_max\": 0.7677931632230002,\n        \"nauc_mrr_at_20_std\": -0.20619686634822945,\n        \"nauc_mrr_at_3_diff1\": 0.910729719718484,\n        \"nauc_mrr_at_3_max\": 0.775728484998148,\n        \"nauc_mrr_at_3_std\": -0.20419702020825395,\n        \"nauc_mrr_at_5_diff1\": 0.9096210108253402,\n        \"nauc_mrr_at_5_max\": 0.7711235413411344,\n        \"nauc_mrr_at_5_std\": -0.20651983963596712,\n        \"nauc_ndcg_at_1000_diff1\": 0.910309840690257,\n        \"nauc_ndcg_at_1000_max\": 0.7718917686412526,\n        \"nauc_ndcg_at_1000_std\": -0.19711219617555498,\n        \"nauc_ndcg_at_100_diff1\": 0.9106455864754731,\n        \"nauc_ndcg_at_100_max\": 0.7735693178069648,\n        \"nauc_ndcg_at_100_std\": -0.18860487479968238,\n        \"nauc_ndcg_at_10_diff1\": 0.9105233118069156,\n        \"nauc_ndcg_at_10_max\": 0.7772978942631096,\n        \"nauc_ndcg_at_10_std\": -0.18079113454823553,\n        \"nauc_ndcg_at_1_diff1\": 0.9139154970077102,\n        \"nauc_ndcg_at_1_max\": 0.7432381431626621,\n        \"nauc_ndcg_at_1_std\": -0.23120158869938737,\n        \"nauc_ndcg_at_20_diff1\": 0.9106919907682975,\n        \"nauc_ndcg_at_20_max\": 0.7737891995288245,\n        \"nauc_ndcg_at_20_std\": -0.18472650828540493,\n        \"nauc_ndcg_at_3_diff1\": 0.9102034992574379,\n        \"nauc_ndcg_at_3_max\": 0.7920840420808655,\n        \"nauc_ndcg_at_3_std\": -0.18397241078146917,\n        \"nauc_ndcg_at_5_diff1\": 0.9080144330930631,\n        \"nauc_ndcg_at_5_max\": 0.7840036131040621,\n        \"nauc_ndcg_at_5_std\": -0.18590531342613936,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.9564270152505041,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 0.9564270152505041,\n        \"nauc_precision_at_10_diff1\": 0.9223856209150375,\n        \"nauc_precision_at_10_max\": 0.9051120448179149,\n        \"nauc_precision_at_10_std\": 0.247782446311847,\n        \"nauc_precision_at_1_diff1\": 0.9139154970077102,\n        \"nauc_precision_at_1_max\": 0.7432381431626621,\n        \"nauc_precision_at_1_std\": -0.23120158869938737,\n        \"nauc_precision_at_20_diff1\": 0.9325980392156864,\n        \"nauc_precision_at_20_max\": 0.8740079365079182,\n        \"nauc_precision_at_20_std\": 0.37219887955182474,\n        \"nauc_precision_at_3_diff1\": 0.9079387852702043,\n        \"nauc_precision_at_3_max\": 0.8792671540160817,\n        \"nauc_precision_at_3_std\": -0.0728405183211521,\n        \"nauc_precision_at_5_diff1\": 0.8970588235294136,\n        \"nauc_precision_at_5_max\": 0.8727357609710571,\n        \"nauc_precision_at_5_std\": -0.034842826019295975,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.9564270152505339,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 0.9564270152505339,\n        \"nauc_recall_at_10_diff1\": 0.9223856209150244,\n        \"nauc_recall_at_10_max\": 0.9051120448179192,\n        \"nauc_recall_at_10_std\": 0.24778244631186175,\n        \"nauc_recall_at_1_diff1\": 0.9139154970077102,\n        \"nauc_recall_at_1_max\": 0.7432381431626621,\n        \"nauc_recall_at_1_std\": -0.23120158869938737,\n        \"nauc_recall_at_20_diff1\": 0.9325980392156854,\n        \"nauc_recall_at_20_max\": 0.8740079365079421,\n        \"nauc_recall_at_20_std\": 0.37219887955183756,\n        \"nauc_recall_at_3_diff1\": 0.9079387852702074,\n        \"nauc_recall_at_3_max\": 0.8792671540160791,\n        \"nauc_recall_at_3_std\": -0.07284051832114759,\n        \"nauc_recall_at_5_diff1\": 0.8970588235294114,\n        \"nauc_recall_at_5_max\": 0.8727357609710548,\n        \"nauc_recall_at_5_std\": -0.03484282601929706,\n        \"ndcg_at_1\": 0.88222,\n        \"ndcg_at_10\": 0.93651,\n        \"ndcg_at_100\": 0.93868,\n        \"ndcg_at_1000\": 0.93913,\n        \"ndcg_at_20\": 0.93764,\n        \"ndcg_at_3\": 0.92503,\n        \"ndcg_at_5\": 0.93014,\n        \"precision_at_1\": 0.88222,\n        \"precision_at_10\": 0.09867,\n        \"precision_at_100\": 0.00997,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04956,\n        \"precision_at_3\": 0.31815,\n        \"precision_at_5\": 0.19333,\n        \"recall_at_1\": 0.88222,\n        \"recall_at_10\": 0.98667,\n        \"recall_at_100\": 0.99667,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.99111,\n        \"recall_at_3\": 0.95444,\n        \"recall_at_5\": 0.96667\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.90391,\n        \"map_at_1\": 0.84111,\n        \"map_at_10\": 0.88401,\n        \"map_at_100\": 0.88545,\n        \"map_at_1000\": 0.8855,\n        \"map_at_20\": 0.88521,\n        \"map_at_3\": 0.87537,\n        \"map_at_5\": 0.88098,\n        \"mrr_at_1\": 0.8411111111111111,\n        \"mrr_at_10\": 0.8840101410934745,\n        \"mrr_at_100\": 0.885449650280911,\n        \"mrr_at_1000\": 0.885497211675456,\n        \"mrr_at_20\": 0.8852127172697349,\n        \"mrr_at_3\": 0.8753703703703706,\n        \"mrr_at_5\": 0.8809814814814817,\n        \"nauc_map_at_1000_diff1\": 0.8800205613602536,\n        \"nauc_map_at_1000_max\": 0.7926999370150674,\n        \"nauc_map_at_1000_std\": 0.013580948072772584,\n        \"nauc_map_at_100_diff1\": 0.8800259583134593,\n        \"nauc_map_at_100_max\": 0.7927774217656682,\n        \"nauc_map_at_100_std\": 0.01384112454071335,\n        \"nauc_map_at_10_diff1\": 0.8788222743852696,\n        \"nauc_map_at_10_max\": 0.7942137795875792,\n        \"nauc_map_at_10_std\": 0.015055468916451471,\n        \"nauc_map_at_1_diff1\": 0.8934627023392087,\n        \"nauc_map_at_1_max\": 0.7673828165206228,\n        \"nauc_map_at_1_std\": -0.04837270899521724,\n        \"nauc_map_at_20_diff1\": 0.87989605902825,\n        \"nauc_map_at_20_max\": 0.7930329844519671,\n        \"nauc_map_at_20_std\": 0.014740922003401985,\n        \"nauc_map_at_3_diff1\": 0.8784641018177448,\n        \"nauc_map_at_3_max\": 0.8000216517565892,\n        \"nauc_map_at_3_std\": 0.03202094054657089,\n        \"nauc_map_at_5_diff1\": 0.879274314209589,\n        \"nauc_map_at_5_max\": 0.7958737454163957,\n        \"nauc_map_at_5_std\": 0.017080187929437385,\n        \"nauc_mrr_at_1000_diff1\": 0.8800205613602536,\n        \"nauc_mrr_at_1000_max\": 0.7926999370150674,\n        \"nauc_mrr_at_1000_std\": 0.013580948072772584,\n        \"nauc_mrr_at_100_diff1\": 0.8800259583134593,\n        \"nauc_mrr_at_100_max\": 0.7927774217656682,\n        \"nauc_mrr_at_100_std\": 0.01384112454071335,\n        \"nauc_mrr_at_10_diff1\": 0.8788222743852696,\n        \"nauc_mrr_at_10_max\": 0.7942137795875792,\n        \"nauc_mrr_at_10_std\": 0.015055468916451471,\n        \"nauc_mrr_at_1_diff1\": 0.8934627023392087,\n        \"nauc_mrr_at_1_max\": 0.7673828165206228,\n        \"nauc_mrr_at_1_std\": -0.04837270899521724,\n        \"nauc_mrr_at_20_diff1\": 0.87989605902825,\n        \"nauc_mrr_at_20_max\": 0.7930329844519671,\n        \"nauc_mrr_at_20_std\": 0.014740922003401985,\n        \"nauc_mrr_at_3_diff1\": 0.8784641018177448,\n        \"nauc_mrr_at_3_max\": 0.8000216517565892,\n        \"nauc_mrr_at_3_std\": 0.03202094054657089,\n        \"nauc_mrr_at_5_diff1\": 0.879274314209589,\n        \"nauc_mrr_at_5_max\": 0.7958737454163957,\n        \"nauc_mrr_at_5_std\": 0.017080187929437385,\n        \"nauc_ndcg_at_1000_diff1\": 0.8782251801092046,\n        \"nauc_ndcg_at_1000_max\": 0.7977777090577682,\n        \"nauc_ndcg_at_1000_std\": 0.02751690045587376,\n        \"nauc_ndcg_at_100_diff1\": 0.8781033126465196,\n        \"nauc_ndcg_at_100_max\": 0.799971982790663,\n        \"nauc_ndcg_at_100_std\": 0.03584488608641146,\n        \"nauc_ndcg_at_10_diff1\": 0.8729708547646923,\n        \"nauc_ndcg_at_10_max\": 0.8066539438806426,\n        \"nauc_ndcg_at_10_std\": 0.042598080649337566,\n        \"nauc_ndcg_at_1_diff1\": 0.8934627023392087,\n        \"nauc_ndcg_at_1_max\": 0.7673828165206228,\n        \"nauc_ndcg_at_1_std\": -0.04837270899521724,\n        \"nauc_ndcg_at_20_diff1\": 0.8767445156889189,\n        \"nauc_ndcg_at_20_max\": 0.8021959993665218,\n        \"nauc_ndcg_at_20_std\": 0.04301016312041599,\n        \"nauc_ndcg_at_3_diff1\": 0.8735722119193429,\n        \"nauc_ndcg_at_3_max\": 0.8169566966858675,\n        \"nauc_ndcg_at_3_std\": 0.0728963995153794,\n        \"nauc_ndcg_at_5_diff1\": 0.8745160029013536,\n        \"nauc_ndcg_at_5_max\": 0.8102399907635793,\n        \"nauc_ndcg_at_5_std\": 0.04683902089586952,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8622782446311745,\n        \"nauc_precision_at_100_max\": 0.9813258636787873,\n        \"nauc_precision_at_100_std\": 0.7409630518874429,\n        \"nauc_precision_at_10_diff1\": 0.818183187253392,\n        \"nauc_precision_at_10_max\": 0.9192042408361156,\n        \"nauc_precision_at_10_std\": 0.2889671997831299,\n        \"nauc_precision_at_1_diff1\": 0.8934627023392087,\n        \"nauc_precision_at_1_max\": 0.7673828165206228,\n        \"nauc_precision_at_1_std\": -0.04837270899521724,\n        \"nauc_precision_at_20_diff1\": 0.835942220025268,\n        \"nauc_precision_at_20_max\": 0.9314823968803195,\n        \"nauc_precision_at_20_std\": 0.5027736584829903,\n        \"nauc_precision_at_3_diff1\": 0.8532737295831584,\n        \"nauc_precision_at_3_max\": 0.8908074645383278,\n        \"nauc_precision_at_3_std\": 0.25084737091183645,\n        \"nauc_precision_at_5_diff1\": 0.8470774976657317,\n        \"nauc_precision_at_5_max\": 0.8960317460317422,\n        \"nauc_precision_at_5_std\": 0.22169934640522632,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8622782446311739,\n        \"nauc_recall_at_100_max\": 0.9813258636788001,\n        \"nauc_recall_at_100_std\": 0.7409630518874236,\n        \"nauc_recall_at_10_diff1\": 0.8181831872533971,\n        \"nauc_recall_at_10_max\": 0.9192042408361157,\n        \"nauc_recall_at_10_std\": 0.288967199783136,\n        \"nauc_recall_at_1_diff1\": 0.8934627023392087,\n        \"nauc_recall_at_1_max\": 0.7673828165206228,\n        \"nauc_recall_at_1_std\": -0.04837270899521724,\n        \"nauc_recall_at_20_diff1\": 0.8359422200252595,\n        \"nauc_recall_at_20_max\": 0.9314823968803185,\n        \"nauc_recall_at_20_std\": 0.5027736584830049,\n        \"nauc_recall_at_3_diff1\": 0.8532737295831584,\n        \"nauc_recall_at_3_max\": 0.8908074645383278,\n        \"nauc_recall_at_3_std\": 0.25084737091183484,\n        \"nauc_recall_at_5_diff1\": 0.8470774976657335,\n        \"nauc_recall_at_5_max\": 0.8960317460317475,\n        \"nauc_recall_at_5_std\": 0.22169934640523029,\n        \"ndcg_at_1\": 0.84111,\n        \"ndcg_at_10\": 0.90391,\n        \"ndcg_at_100\": 0.90997,\n        \"ndcg_at_1000\": 0.91102,\n        \"ndcg_at_20\": 0.90799,\n        \"ndcg_at_3\": 0.88655,\n        \"ndcg_at_5\": 0.89687,\n        \"precision_at_1\": 0.84111,\n        \"precision_at_10\": 0.09656,\n        \"precision_at_100\": 0.00992,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04906,\n        \"precision_at_3\": 0.3063,\n        \"precision_at_5\": 0.18889,\n        \"recall_at_1\": 0.84111,\n        \"recall_at_10\": 0.96556,\n        \"recall_at_100\": 0.99222,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.98111,\n        \"recall_at_3\": 0.91889,\n        \"recall_at_5\": 0.94444\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KoE5/no_model_name_available/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 106.8914806842804,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.80008,\n        \"map_at_1\": 0.50224,\n        \"map_at_10\": 0.75801,\n        \"map_at_100\": 0.76353,\n        \"map_at_1000\": 0.76387,\n        \"map_at_20\": 0.76174,\n        \"map_at_3\": 0.71805,\n        \"map_at_5\": 0.74531,\n        \"mrr_at_1\": 0.7668918918918919,\n        \"mrr_at_10\": 0.8182526276276274,\n        \"mrr_at_100\": 0.8198681055223843,\n        \"mrr_at_1000\": 0.8200447358419406,\n        \"mrr_at_20\": 0.8190945409695407,\n        \"mrr_at_3\": 0.8127815315315313,\n        \"mrr_at_5\": 0.8163288288288286,\n        \"nauc_map_at_1000_diff1\": 0.5972954962902949,\n        \"nauc_map_at_1000_max\": 0.6368142914602937,\n        \"nauc_map_at_1000_std\": 0.19600667039933853,\n        \"nauc_map_at_100_diff1\": 0.5971892993449279,\n        \"nauc_map_at_100_max\": 0.6372732434536403,\n        \"nauc_map_at_100_std\": 0.1967226339429915,\n        \"nauc_map_at_10_diff1\": 0.5923749667778005,\n        \"nauc_map_at_10_max\": 0.6339909454890105,\n        \"nauc_map_at_10_std\": 0.18617034845772062,\n        \"nauc_map_at_1_diff1\": 0.6407039079056288,\n        \"nauc_map_at_1_max\": 0.29091469612516707,\n        \"nauc_map_at_1_std\": -0.041544183402294585,\n        \"nauc_map_at_20_diff1\": 0.5977171275491291,\n        \"nauc_map_at_20_max\": 0.6388580471049708,\n        \"nauc_map_at_20_std\": 0.1962525689943241,\n        \"nauc_map_at_3_diff1\": 0.5900738657305518,\n        \"nauc_map_at_3_max\": 0.5665593954782121,\n        \"nauc_map_at_3_std\": 0.10966603066350789,\n        \"nauc_map_at_5_diff1\": 0.5829464965480328,\n        \"nauc_map_at_5_max\": 0.6176087413110913,\n        \"nauc_map_at_5_std\": 0.16072461952483239,\n        \"nauc_mrr_at_1000_diff1\": 0.709824810350201,\n        \"nauc_mrr_at_1000_max\": 0.7345190416806782,\n        \"nauc_mrr_at_1000_std\": 0.3035269580763068,\n        \"nauc_mrr_at_100_diff1\": 0.7098141357802885,\n        \"nauc_mrr_at_100_max\": 0.7347853756149684,\n        \"nauc_mrr_at_100_std\": 0.30402465803211526,\n        \"nauc_mrr_at_10_diff1\": 0.7091332962479558,\n        \"nauc_mrr_at_10_max\": 0.7370409336686649,\n        \"nauc_mrr_at_10_std\": 0.30411076208664795,\n        \"nauc_mrr_at_1_diff1\": 0.7153536856458215,\n        \"nauc_mrr_at_1_max\": 0.6367168927299622,\n        \"nauc_mrr_at_1_std\": 0.1797255462450732,\n        \"nauc_mrr_at_20_diff1\": 0.7098668857166636,\n        \"nauc_mrr_at_20_max\": 0.7357816306698388,\n        \"nauc_mrr_at_20_std\": 0.30487672649515535,\n        \"nauc_mrr_at_3_diff1\": 0.7108485627220982,\n        \"nauc_mrr_at_3_max\": 0.7366049198735798,\n        \"nauc_mrr_at_3_std\": 0.2939209122656606,\n        \"nauc_mrr_at_5_diff1\": 0.7094065640103121,\n        \"nauc_mrr_at_5_max\": 0.736934209431478,\n        \"nauc_mrr_at_5_std\": 0.3008189699564541,\n        \"nauc_ndcg_at_1000_diff1\": 0.633209387968523,\n        \"nauc_ndcg_at_1000_max\": 0.7017740521622267,\n        \"nauc_ndcg_at_1000_std\": 0.2871940426224995,\n        \"nauc_ndcg_at_100_diff1\": 0.6317275921514075,\n        \"nauc_ndcg_at_100_max\": 0.7128265191344082,\n        \"nauc_ndcg_at_100_std\": 0.3053516131697575,\n        \"nauc_ndcg_at_10_diff1\": 0.6190533858054285,\n        \"nauc_ndcg_at_10_max\": 0.7093609962144929,\n        \"nauc_ndcg_at_10_std\": 0.2764905074705219,\n        \"nauc_ndcg_at_1_diff1\": 0.7153536856458215,\n        \"nauc_ndcg_at_1_max\": 0.6367168927299622,\n        \"nauc_ndcg_at_1_std\": 0.1797255462450732,\n        \"nauc_ndcg_at_20_diff1\": 0.6320458021594961,\n        \"nauc_ndcg_at_20_max\": 0.7209179402000162,\n        \"nauc_ndcg_at_20_std\": 0.3030488569549388,\n        \"nauc_ndcg_at_3_diff1\": 0.6066549910978404,\n        \"nauc_ndcg_at_3_max\": 0.6193225890761628,\n        \"nauc_ndcg_at_3_std\": 0.16695273529007681,\n        \"nauc_ndcg_at_5_diff1\": 0.603741227754187,\n        \"nauc_ndcg_at_5_max\": 0.6818212630051793,\n        \"nauc_ndcg_at_5_std\": 0.23294879593797604,\n        \"nauc_precision_at_1000_diff1\": -0.32933520104718034,\n        \"nauc_precision_at_1000_max\": 0.007161073542821553,\n        \"nauc_precision_at_1000_std\": 0.2063019640721369,\n        \"nauc_precision_at_100_diff1\": -0.23501168923658147,\n        \"nauc_precision_at_100_max\": 0.14969003532471672,\n        \"nauc_precision_at_100_std\": 0.3054829396918457,\n        \"nauc_precision_at_10_diff1\": -0.13980158620840913,\n        \"nauc_precision_at_10_max\": 0.28511337244894247,\n        \"nauc_precision_at_10_std\": 0.31819918857431584,\n        \"nauc_precision_at_1_diff1\": 0.7153536856458215,\n        \"nauc_precision_at_1_max\": 0.6367168927299622,\n        \"nauc_precision_at_1_std\": 0.1797255462450732,\n        \"nauc_precision_at_20_diff1\": -0.1568592411175028,\n        \"nauc_precision_at_20_max\": 0.24530994646011672,\n        \"nauc_precision_at_20_std\": 0.3275801664626258,\n        \"nauc_precision_at_3_diff1\": -0.0028509166513785832,\n        \"nauc_precision_at_3_max\": 0.3727369576620084,\n        \"nauc_precision_at_3_std\": 0.2417544691664725,\n        \"nauc_precision_at_5_diff1\": -0.0951242611766236,\n        \"nauc_precision_at_5_max\": 0.3373018586224311,\n        \"nauc_precision_at_5_std\": 0.2866663123426568,\n        \"nauc_recall_at_1000_diff1\": 0.722229751897174,\n        \"nauc_recall_at_1000_max\": 0.9825486195833247,\n        \"nauc_recall_at_1000_std\": 0.8508864855593524,\n        \"nauc_recall_at_100_diff1\": 0.6518817183992185,\n        \"nauc_recall_at_100_max\": 0.955087527405752,\n        \"nauc_recall_at_100_std\": 0.7621854034955842,\n        \"nauc_recall_at_10_diff1\": 0.5863070465583734,\n        \"nauc_recall_at_10_max\": 0.8449272103086174,\n        \"nauc_recall_at_10_std\": 0.45086935495626596,\n        \"nauc_recall_at_1_diff1\": 0.6407039079056288,\n        \"nauc_recall_at_1_max\": 0.29091469612516707,\n        \"nauc_recall_at_1_std\": -0.041544183402294585,\n        \"nauc_recall_at_20_diff1\": 0.6463966953750865,\n        \"nauc_recall_at_20_max\": 0.9284309177278965,\n        \"nauc_recall_at_20_std\": 0.604534239281333,\n        \"nauc_recall_at_3_diff1\": 0.570011423577929,\n        \"nauc_recall_at_3_max\": 0.6246426708462954,\n        \"nauc_recall_at_3_std\": 0.17855913256991598,\n        \"nauc_recall_at_5_diff1\": 0.5487110746355588,\n        \"nauc_recall_at_5_max\": 0.7484194405605811,\n        \"nauc_recall_at_5_std\": 0.3144622997742575,\n        \"ndcg_at_1\": 0.76689,\n        \"ndcg_at_10\": 0.80008,\n        \"ndcg_at_100\": 0.81776,\n        \"ndcg_at_1000\": 0.82521,\n        \"ndcg_at_20\": 0.80834,\n        \"ndcg_at_3\": 0.75702,\n        \"ndcg_at_5\": 0.78307,\n        \"precision_at_1\": 0.76689,\n        \"precision_at_10\": 0.15777,\n        \"precision_at_100\": 0.01733,\n        \"precision_at_1000\": 0.00184,\n        \"precision_at_20\": 0.08209,\n        \"precision_at_3\": 0.44707,\n        \"precision_at_5\": 0.29527,\n        \"recall_at_1\": 0.50224,\n        \"recall_at_10\": 0.85344,\n        \"recall_at_100\": 0.91914,\n        \"recall_at_1000\": 0.96585,\n        \"recall_at_20\": 0.87809,\n        \"recall_at_3\": 0.76087,\n        \"recall_at_5\": 0.81504\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KoE5/no_model_name_available/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 10921.967575788498,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.62347,\n        \"map_at_1\": 0.35651,\n        \"map_at_10\": 0.53094,\n        \"map_at_100\": 0.55538,\n        \"map_at_1000\": 0.55625,\n        \"map_at_20\": 0.5454,\n        \"map_at_3\": 0.47163,\n        \"map_at_5\": 0.50753,\n        \"mrr_at_1\": 0.5868544600938967,\n        \"mrr_at_10\": 0.7001993442134288,\n        \"mrr_at_100\": 0.7042101595780245,\n        \"mrr_at_1000\": 0.7042455978016589,\n        \"mrr_at_20\": 0.7028372924292561,\n        \"mrr_at_3\": 0.6768388106416277,\n        \"mrr_at_5\": 0.6930359937402192,\n        \"nauc_map_at_1000_diff1\": 0.3802267511775632,\n        \"nauc_map_at_1000_max\": 0.19048610042141606,\n        \"nauc_map_at_1000_std\": -0.014178318150586245,\n        \"nauc_map_at_100_diff1\": 0.3798002126801598,\n        \"nauc_map_at_100_max\": 0.18908979238980247,\n        \"nauc_map_at_100_std\": -0.015448262064090671,\n        \"nauc_map_at_10_diff1\": 0.383236046520275,\n        \"nauc_map_at_10_max\": 0.17506495777101685,\n        \"nauc_map_at_10_std\": -0.035756289573366726,\n        \"nauc_map_at_1_diff1\": 0.4462558550231808,\n        \"nauc_map_at_1_max\": 0.10671392419017076,\n        \"nauc_map_at_1_std\": -0.12190099242327268,\n        \"nauc_map_at_20_diff1\": 0.37968613381466515,\n        \"nauc_map_at_20_max\": 0.18078138323656373,\n        \"nauc_map_at_20_std\": -0.020758431921589562,\n        \"nauc_map_at_3_diff1\": 0.4047470483336675,\n        \"nauc_map_at_3_max\": 0.14357061794368886,\n        \"nauc_map_at_3_std\": -0.09101061405383064,\n        \"nauc_map_at_5_diff1\": 0.38433619003720515,\n        \"nauc_map_at_5_max\": 0.15338802662837325,\n        \"nauc_map_at_5_std\": -0.05731668390302651,\n        \"nauc_mrr_at_1000_diff1\": 0.3709714979476026,\n        \"nauc_mrr_at_1000_max\": 0.3447593541310457,\n        \"nauc_mrr_at_1000_std\": 0.1836084604512021,\n        \"nauc_mrr_at_100_diff1\": 0.37106380683123774,\n        \"nauc_mrr_at_100_max\": 0.3448363567876449,\n        \"nauc_mrr_at_100_std\": 0.1836612305412644,\n        \"nauc_mrr_at_10_diff1\": 0.3715556628849159,\n        \"nauc_mrr_at_10_max\": 0.3494585868210773,\n        \"nauc_mrr_at_10_std\": 0.1887786307193617,\n        \"nauc_mrr_at_1_diff1\": 0.3776020575107886,\n        \"nauc_mrr_at_1_max\": 0.2819192654012434,\n        \"nauc_mrr_at_1_std\": 0.12268082396371827,\n        \"nauc_mrr_at_20_diff1\": 0.371308797431876,\n        \"nauc_mrr_at_20_max\": 0.3479123610638993,\n        \"nauc_mrr_at_20_std\": 0.18697030952227978,\n        \"nauc_mrr_at_3_diff1\": 0.37969448696878133,\n        \"nauc_mrr_at_3_max\": 0.3489639252891714,\n        \"nauc_mrr_at_3_std\": 0.1625771762618304,\n        \"nauc_mrr_at_5_diff1\": 0.362153262385325,\n        \"nauc_mrr_at_5_max\": 0.33555805475045447,\n        \"nauc_mrr_at_5_std\": 0.18240974346590325,\n        \"nauc_ndcg_at_1000_diff1\": 0.3751583781231858,\n        \"nauc_ndcg_at_1000_max\": 0.27117548808207703,\n        \"nauc_ndcg_at_1000_std\": 0.0897526309335515,\n        \"nauc_ndcg_at_100_diff1\": 0.37616095285107065,\n        \"nauc_ndcg_at_100_max\": 0.2593365218742245,\n        \"nauc_ndcg_at_100_std\": 0.07530443478383826,\n        \"nauc_ndcg_at_10_diff1\": 0.37464050249950315,\n        \"nauc_ndcg_at_10_max\": 0.2317434244594817,\n        \"nauc_ndcg_at_10_std\": 0.03862097010400464,\n        \"nauc_ndcg_at_1_diff1\": 0.3776020575107886,\n        \"nauc_ndcg_at_1_max\": 0.2819192654012434,\n        \"nauc_ndcg_at_1_std\": 0.12268082396371827,\n        \"nauc_ndcg_at_20_diff1\": 0.37008298134554624,\n        \"nauc_ndcg_at_20_max\": 0.23833642905140717,\n        \"nauc_ndcg_at_20_std\": 0.06439132908022192,\n        \"nauc_ndcg_at_3_diff1\": 0.39060167641094196,\n        \"nauc_ndcg_at_3_max\": 0.2594239002284155,\n        \"nauc_ndcg_at_3_std\": 0.01734384126072765,\n        \"nauc_ndcg_at_5_diff1\": 0.36720392634007804,\n        \"nauc_ndcg_at_5_max\": 0.2288281724358362,\n        \"nauc_ndcg_at_5_std\": 0.017804644988806795,\n        \"nauc_precision_at_1000_diff1\": -0.16345669343223276,\n        \"nauc_precision_at_1000_max\": 0.26944451859423574,\n        \"nauc_precision_at_1000_std\": 0.3243173706214259,\n        \"nauc_precision_at_100_diff1\": -0.16268290130587268,\n        \"nauc_precision_at_100_max\": 0.2570365653119325,\n        \"nauc_precision_at_100_std\": 0.3157762055594767,\n        \"nauc_precision_at_10_diff1\": -0.11165331177359057,\n        \"nauc_precision_at_10_max\": 0.29596063735284117,\n        \"nauc_precision_at_10_std\": 0.3403527806817954,\n        \"nauc_precision_at_1_diff1\": 0.3776020575107886,\n        \"nauc_precision_at_1_max\": 0.2819192654012434,\n        \"nauc_precision_at_1_std\": 0.12268082396371827,\n        \"nauc_precision_at_20_diff1\": -0.1531559621460741,\n        \"nauc_precision_at_20_max\": 0.25594012686850015,\n        \"nauc_precision_at_20_std\": 0.34699541667336714,\n        \"nauc_precision_at_3_diff1\": 0.05941049842805729,\n        \"nauc_precision_at_3_max\": 0.2953259707934061,\n        \"nauc_precision_at_3_std\": 0.24270084666552041,\n        \"nauc_precision_at_5_diff1\": -0.058609200820664654,\n        \"nauc_precision_at_5_max\": 0.27794901240025927,\n        \"nauc_precision_at_5_std\": 0.29911869651570383,\n        \"nauc_recall_at_1000_diff1\": 0.3147765383896343,\n        \"nauc_recall_at_1000_max\": 0.5100056604290448,\n        \"nauc_recall_at_1000_std\": 0.7544025574496996,\n        \"nauc_recall_at_100_diff1\": 0.35124680620202603,\n        \"nauc_recall_at_100_max\": 0.20469848787224137,\n        \"nauc_recall_at_100_std\": 0.0946357651158954,\n        \"nauc_recall_at_10_diff1\": 0.3095506491637109,\n        \"nauc_recall_at_10_max\": 0.18283091699784212,\n        \"nauc_recall_at_10_std\": 0.03312080378888044,\n        \"nauc_recall_at_1_diff1\": 0.4462558550231808,\n        \"nauc_recall_at_1_max\": 0.10671392419017076,\n        \"nauc_recall_at_1_std\": -0.12190099242327268,\n        \"nauc_recall_at_20_diff1\": 0.2982577780687482,\n        \"nauc_recall_at_20_max\": 0.19323530530562696,\n        \"nauc_recall_at_20_std\": 0.1041300624127336,\n        \"nauc_recall_at_3_diff1\": 0.3845104615232557,\n        \"nauc_recall_at_3_max\": 0.13986804757783908,\n        \"nauc_recall_at_3_std\": -0.11043292330852067,\n        \"nauc_recall_at_5_diff1\": 0.3094744523243021,\n        \"nauc_recall_at_5_max\": 0.11320806360380156,\n        \"nauc_recall_at_5_std\": -0.047961070514019745,\n        \"ndcg_at_1\": 0.58685,\n        \"ndcg_at_10\": 0.62347,\n        \"ndcg_at_100\": 0.68754,\n        \"ndcg_at_1000\": 0.69732,\n        \"ndcg_at_20\": 0.65146,\n        \"ndcg_at_3\": 0.58375,\n        \"ndcg_at_5\": 0.59917,\n        \"precision_at_1\": 0.58685,\n        \"precision_at_10\": 0.15493,\n        \"precision_at_100\": 0.023,\n        \"precision_at_1000\": 0.00253,\n        \"precision_at_20\": 0.09085,\n        \"precision_at_3\": 0.35211,\n        \"precision_at_5\": 0.26197,\n        \"recall_at_1\": 0.35651,\n        \"recall_at_10\": 0.71945,\n        \"recall_at_100\": 0.93058,\n        \"recall_at_1000\": 0.98059,\n        \"recall_at_20\": 0.79728,\n        \"recall_at_3\": 0.54423,\n        \"recall_at_5\": 0.63246\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KoE5/no_model_name_available/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 11006.327818870544,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.58411,\n        \"map_at_1\": 0.41805,\n        \"map_at_10\": 0.52884,\n        \"map_at_100\": 0.53694,\n        \"map_at_1000\": 0.53737,\n        \"map_at_20\": 0.53353,\n        \"map_at_3\": 0.49947,\n        \"map_at_5\": 0.518,\n        \"mrr_at_1\": 0.4513064133016627,\n        \"mrr_at_10\": 0.5550852090638313,\n        \"mrr_at_100\": 0.5611461188146258,\n        \"mrr_at_1000\": 0.5614464312750885,\n        \"mrr_at_20\": 0.5586867393535322,\n        \"mrr_at_3\": 0.5304829770387967,\n        \"mrr_at_5\": 0.5473475851148061,\n        \"nauc_map_at_1000_diff1\": 0.41760449328203914,\n        \"nauc_map_at_1000_max\": 0.3294380596195165,\n        \"nauc_map_at_1000_std\": 0.07569114108854938,\n        \"nauc_map_at_100_diff1\": 0.4175111507844809,\n        \"nauc_map_at_100_max\": 0.3294347526478304,\n        \"nauc_map_at_100_std\": 0.07562793957644538,\n        \"nauc_map_at_10_diff1\": 0.41742159521872546,\n        \"nauc_map_at_10_max\": 0.3283152091268034,\n        \"nauc_map_at_10_std\": 0.07434936967786862,\n        \"nauc_map_at_1_diff1\": 0.475616107892548,\n        \"nauc_map_at_1_max\": 0.29980960217152125,\n        \"nauc_map_at_1_std\": 0.023147594033258674,\n        \"nauc_map_at_20_diff1\": 0.41792759661763335,\n        \"nauc_map_at_20_max\": 0.32761807208712435,\n        \"nauc_map_at_20_std\": 0.07385729953383378,\n        \"nauc_map_at_3_diff1\": 0.4161404356977857,\n        \"nauc_map_at_3_max\": 0.34133425026110237,\n        \"nauc_map_at_3_std\": 0.07560165310487228,\n        \"nauc_map_at_5_diff1\": 0.41369492120774864,\n        \"nauc_map_at_5_max\": 0.33197752287454557,\n        \"nauc_map_at_5_std\": 0.0735934727123139,\n        \"nauc_mrr_at_1000_diff1\": 0.43425006536052757,\n        \"nauc_mrr_at_1000_max\": 0.3310024020091237,\n        \"nauc_mrr_at_1000_std\": 0.07584614898943615,\n        \"nauc_mrr_at_100_diff1\": 0.43429153680356974,\n        \"nauc_mrr_at_100_max\": 0.3311383359189307,\n        \"nauc_mrr_at_100_std\": 0.07587475606863006,\n        \"nauc_mrr_at_10_diff1\": 0.4331602379893548,\n        \"nauc_mrr_at_10_max\": 0.3303249559514421,\n        \"nauc_mrr_at_10_std\": 0.07517353705770899,\n        \"nauc_mrr_at_1_diff1\": 0.48851459777795286,\n        \"nauc_mrr_at_1_max\": 0.3061725961829622,\n        \"nauc_mrr_at_1_std\": 0.027158195628080105,\n        \"nauc_mrr_at_20_diff1\": 0.4345712872238659,\n        \"nauc_mrr_at_20_max\": 0.33025249110418725,\n        \"nauc_mrr_at_20_std\": 0.0745997468122339,\n        \"nauc_mrr_at_3_diff1\": 0.43317807741797193,\n        \"nauc_mrr_at_3_max\": 0.3413812271379621,\n        \"nauc_mrr_at_3_std\": 0.07794841072340263,\n        \"nauc_mrr_at_5_diff1\": 0.43046488691373813,\n        \"nauc_mrr_at_5_max\": 0.33220204566899847,\n        \"nauc_mrr_at_5_std\": 0.07367571090077339,\n        \"nauc_ndcg_at_1000_diff1\": 0.4056461445113131,\n        \"nauc_ndcg_at_1000_max\": 0.33847251877738377,\n        \"nauc_ndcg_at_1000_std\": 0.09988485700168576,\n        \"nauc_ndcg_at_100_diff1\": 0.4050811335370705,\n        \"nauc_ndcg_at_100_max\": 0.3417355500075768,\n        \"nauc_ndcg_at_100_std\": 0.10283628039248967,\n        \"nauc_ndcg_at_10_diff1\": 0.4045446090303444,\n        \"nauc_ndcg_at_10_max\": 0.330830952664249,\n        \"nauc_ndcg_at_10_std\": 0.09445382646344905,\n        \"nauc_ndcg_at_1_diff1\": 0.48851459777795286,\n        \"nauc_ndcg_at_1_max\": 0.3061725961829622,\n        \"nauc_ndcg_at_1_std\": 0.027158195628080105,\n        \"nauc_ndcg_at_20_diff1\": 0.4072683827853017,\n        \"nauc_ndcg_at_20_max\": 0.328225670980137,\n        \"nauc_ndcg_at_20_std\": 0.09309495403978528,\n        \"nauc_ndcg_at_3_diff1\": 0.4027853090100297,\n        \"nauc_ndcg_at_3_max\": 0.3542400905704392,\n        \"nauc_ndcg_at_3_std\": 0.09533485495668449,\n        \"nauc_ndcg_at_5_diff1\": 0.39783018881462934,\n        \"nauc_ndcg_at_5_max\": 0.3374839089915202,\n        \"nauc_ndcg_at_5_std\": 0.09053126979087693,\n        \"nauc_precision_at_1000_diff1\": -0.09871951704278333,\n        \"nauc_precision_at_1000_max\": 0.05841793928506,\n        \"nauc_precision_at_1000_std\": 0.12773862644439057,\n        \"nauc_precision_at_100_diff1\": 0.003676016719144542,\n        \"nauc_precision_at_100_max\": 0.15404278753413259,\n        \"nauc_precision_at_100_std\": 0.16068194939581307,\n        \"nauc_precision_at_10_diff1\": 0.17936005392549736,\n        \"nauc_precision_at_10_max\": 0.21001566765138768,\n        \"nauc_precision_at_10_std\": 0.14187082726161146,\n        \"nauc_precision_at_1_diff1\": 0.48851459777795286,\n        \"nauc_precision_at_1_max\": 0.3061725961829622,\n        \"nauc_precision_at_1_std\": 0.027158195628080105,\n        \"nauc_precision_at_20_diff1\": 0.12500512313614456,\n        \"nauc_precision_at_20_max\": 0.1522781682963013,\n        \"nauc_precision_at_20_std\": 0.12870295520287567,\n        \"nauc_precision_at_3_diff1\": 0.28997975780125107,\n        \"nauc_precision_at_3_max\": 0.3658453521595714,\n        \"nauc_precision_at_3_std\": 0.16499998570789157,\n        \"nauc_precision_at_5_diff1\": 0.2345875365715847,\n        \"nauc_precision_at_5_max\": 0.2999744081349785,\n        \"nauc_precision_at_5_std\": 0.15568958648649867,\n        \"nauc_recall_at_1000_diff1\": 0.023859311683500334,\n        \"nauc_recall_at_1000_max\": 0.518210226146323,\n        \"nauc_recall_at_1000_std\": 0.5796703247407008,\n        \"nauc_recall_at_100_diff1\": 0.2654252637888202,\n        \"nauc_recall_at_100_max\": 0.4652171149717772,\n        \"nauc_recall_at_100_std\": 0.33527057410944405,\n        \"nauc_recall_at_10_diff1\": 0.33321285789728705,\n        \"nauc_recall_at_10_max\": 0.3258428005903868,\n        \"nauc_recall_at_10_std\": 0.1671009470268551,\n        \"nauc_recall_at_1_diff1\": 0.475616107892548,\n        \"nauc_recall_at_1_max\": 0.29980960217152125,\n        \"nauc_recall_at_1_std\": 0.023147594033258674,\n        \"nauc_recall_at_20_diff1\": 0.3382006406737999,\n        \"nauc_recall_at_20_max\": 0.30995358300824283,\n        \"nauc_recall_at_20_std\": 0.1733813033212232,\n        \"nauc_recall_at_3_diff1\": 0.34208486634308105,\n        \"nauc_recall_at_3_max\": 0.3867663480452235,\n        \"nauc_recall_at_3_std\": 0.14991917986638886,\n        \"nauc_recall_at_5_diff1\": 0.3192847012739187,\n        \"nauc_recall_at_5_max\": 0.34254888460256167,\n        \"nauc_recall_at_5_std\": 0.14054972085304943,\n        \"ndcg_at_1\": 0.45131,\n        \"ndcg_at_10\": 0.58411,\n        \"ndcg_at_100\": 0.62068,\n        \"ndcg_at_1000\": 0.63057,\n        \"ndcg_at_20\": 0.59975,\n        \"ndcg_at_3\": 0.53024,\n        \"ndcg_at_5\": 0.56183,\n        \"precision_at_1\": 0.45131,\n        \"precision_at_10\": 0.08314,\n        \"precision_at_100\": 0.01036,\n        \"precision_at_1000\": 0.00112,\n        \"precision_at_20\": 0.04525,\n        \"precision_at_3\": 0.21932,\n        \"precision_at_5\": 0.14917,\n        \"recall_at_1\": 0.41805,\n        \"recall_at_10\": 0.72447,\n        \"recall_at_100\": 0.88876,\n        \"recall_at_1000\": 0.96437,\n        \"recall_at_20\": 0.78345,\n        \"recall_at_3\": 0.58868,\n        \"recall_at_5\": 0.66192\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KoE5/no_model_name_available/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 374.64185643196106,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.30869,\n        \"map_at_1\": 0.225,\n        \"map_at_10\": 0.27839,\n        \"map_at_100\": 0.28562,\n        \"map_at_1000\": 0.28656,\n        \"map_at_20\": 0.28249,\n        \"map_at_3\": 0.25917,\n        \"map_at_5\": 0.27217,\n        \"mrr_at_1\": 0.225,\n        \"mrr_at_10\": 0.2783948412698413,\n        \"mrr_at_100\": 0.2856210546112084,\n        \"mrr_at_1000\": 0.2865550826753487,\n        \"mrr_at_20\": 0.28249013486513497,\n        \"mrr_at_3\": 0.2591666666666667,\n        \"mrr_at_5\": 0.2721666666666667,\n        \"nauc_map_at_1000_diff1\": 0.4955255586619396,\n        \"nauc_map_at_1000_max\": 0.44504849728519563,\n        \"nauc_map_at_1000_std\": -0.038992619454156975,\n        \"nauc_map_at_100_diff1\": 0.49560258641813304,\n        \"nauc_map_at_100_max\": 0.4450275819616694,\n        \"nauc_map_at_100_std\": -0.038660364252145515,\n        \"nauc_map_at_10_diff1\": 0.4962892380511699,\n        \"nauc_map_at_10_max\": 0.4440807062760643,\n        \"nauc_map_at_10_std\": -0.04468313245045792,\n        \"nauc_map_at_1_diff1\": 0.5586960705076397,\n        \"nauc_map_at_1_max\": 0.4705538236539276,\n        \"nauc_map_at_1_std\": -0.058784589924181264,\n        \"nauc_map_at_20_diff1\": 0.4974509233090044,\n        \"nauc_map_at_20_max\": 0.4436478366100422,\n        \"nauc_map_at_20_std\": -0.04357356693958735,\n        \"nauc_map_at_3_diff1\": 0.5062583328599041,\n        \"nauc_map_at_3_max\": 0.43715739329406483,\n        \"nauc_map_at_3_std\": -0.05578045127686905,\n        \"nauc_map_at_5_diff1\": 0.5039749240776535,\n        \"nauc_map_at_5_max\": 0.44506965120497405,\n        \"nauc_map_at_5_std\": -0.04750545663729009,\n        \"nauc_mrr_at_1000_diff1\": 0.4955255586619396,\n        \"nauc_mrr_at_1000_max\": 0.44504849728519563,\n        \"nauc_mrr_at_1000_std\": -0.038992619454156975,\n        \"nauc_mrr_at_100_diff1\": 0.49560258641813304,\n        \"nauc_mrr_at_100_max\": 0.4450275819616694,\n        \"nauc_mrr_at_100_std\": -0.038660364252145515,\n        \"nauc_mrr_at_10_diff1\": 0.4962892380511699,\n        \"nauc_mrr_at_10_max\": 0.4440807062760643,\n        \"nauc_mrr_at_10_std\": -0.04468313245045792,\n        \"nauc_mrr_at_1_diff1\": 0.5586960705076397,\n        \"nauc_mrr_at_1_max\": 0.4705538236539276,\n        \"nauc_mrr_at_1_std\": -0.058784589924181264,\n        \"nauc_mrr_at_20_diff1\": 0.4974509233090044,\n        \"nauc_mrr_at_20_max\": 0.4436478366100422,\n        \"nauc_mrr_at_20_std\": -0.04357356693958735,\n        \"nauc_mrr_at_3_diff1\": 0.5062583328599041,\n        \"nauc_mrr_at_3_max\": 0.43715739329406483,\n        \"nauc_mrr_at_3_std\": -0.05578045127686905,\n        \"nauc_mrr_at_5_diff1\": 0.5039749240776535,\n        \"nauc_mrr_at_5_max\": 0.44506965120497405,\n        \"nauc_mrr_at_5_std\": -0.04750545663729009,\n        \"nauc_ndcg_at_1000_diff1\": 0.4660598275346212,\n        \"nauc_ndcg_at_1000_max\": 0.45280397565939245,\n        \"nauc_ndcg_at_1000_std\": 0.008694053070665663,\n        \"nauc_ndcg_at_100_diff1\": 0.4651022132533749,\n        \"nauc_ndcg_at_100_max\": 0.44752944736864253,\n        \"nauc_ndcg_at_100_std\": 0.014536279874750873,\n        \"nauc_ndcg_at_10_diff1\": 0.46973038934283456,\n        \"nauc_ndcg_at_10_max\": 0.43947463568381123,\n        \"nauc_ndcg_at_10_std\": -0.030194439183616174,\n        \"nauc_ndcg_at_1_diff1\": 0.5586960705076397,\n        \"nauc_ndcg_at_1_max\": 0.4705538236539276,\n        \"nauc_ndcg_at_1_std\": -0.058784589924181264,\n        \"nauc_ndcg_at_20_diff1\": 0.47711457240048044,\n        \"nauc_ndcg_at_20_max\": 0.441598930338093,\n        \"nauc_ndcg_at_20_std\": -0.022550640444449096,\n        \"nauc_ndcg_at_3_diff1\": 0.4908716670181991,\n        \"nauc_ndcg_at_3_max\": 0.4258518504997637,\n        \"nauc_ndcg_at_3_std\": -0.05437443315310704,\n        \"nauc_ndcg_at_5_diff1\": 0.4859565184409851,\n        \"nauc_ndcg_at_5_max\": 0.4390595623034592,\n        \"nauc_ndcg_at_5_std\": -0.040078077863090804,\n        \"nauc_precision_at_1000_diff1\": 0.26713983690727916,\n        \"nauc_precision_at_1000_max\": 0.6180240947682804,\n        \"nauc_precision_at_1000_std\": 0.5043625625020973,\n        \"nauc_precision_at_100_diff1\": 0.3595962428150849,\n        \"nauc_precision_at_100_max\": 0.47169198757443165,\n        \"nauc_precision_at_100_std\": 0.27103824330207266,\n        \"nauc_precision_at_10_diff1\": 0.3953074527553725,\n        \"nauc_precision_at_10_max\": 0.4309367686028743,\n        \"nauc_precision_at_10_std\": 0.015925517579321397,\n        \"nauc_precision_at_1_diff1\": 0.5586960705076397,\n        \"nauc_precision_at_1_max\": 0.4705538236539276,\n        \"nauc_precision_at_1_std\": -0.058784589924181264,\n        \"nauc_precision_at_20_diff1\": 0.4278371209877518,\n        \"nauc_precision_at_20_max\": 0.4460086480936678,\n        \"nauc_precision_at_20_std\": 0.052184729598988976,\n        \"nauc_precision_at_3_diff1\": 0.44962159757930276,\n        \"nauc_precision_at_3_max\": 0.39509525767082015,\n        \"nauc_precision_at_3_std\": -0.050449163336410925,\n        \"nauc_precision_at_5_diff1\": 0.43724741510523296,\n        \"nauc_precision_at_5_max\": 0.42402771217131174,\n        \"nauc_precision_at_5_std\": -0.018671600272922646,\n        \"nauc_recall_at_1000_diff1\": 0.267139836907279,\n        \"nauc_recall_at_1000_max\": 0.6180240947682816,\n        \"nauc_recall_at_1000_std\": 0.5043625625020984,\n        \"nauc_recall_at_100_diff1\": 0.3595962428150849,\n        \"nauc_recall_at_100_max\": 0.47169198757443176,\n        \"nauc_recall_at_100_std\": 0.2710382433020728,\n        \"nauc_recall_at_10_diff1\": 0.39530745275537255,\n        \"nauc_recall_at_10_max\": 0.4309367686028742,\n        \"nauc_recall_at_10_std\": 0.015925517579321348,\n        \"nauc_recall_at_1_diff1\": 0.5586960705076397,\n        \"nauc_recall_at_1_max\": 0.4705538236539276,\n        \"nauc_recall_at_1_std\": -0.058784589924181264,\n        \"nauc_recall_at_20_diff1\": 0.4278371209877519,\n        \"nauc_recall_at_20_max\": 0.44600864809366825,\n        \"nauc_recall_at_20_std\": 0.05218472959898892,\n        \"nauc_recall_at_3_diff1\": 0.4496215975793028,\n        \"nauc_recall_at_3_max\": 0.3950952576708202,\n        \"nauc_recall_at_3_std\": -0.05044916333641102,\n        \"nauc_recall_at_5_diff1\": 0.4372474151052326,\n        \"nauc_recall_at_5_max\": 0.42402771217131147,\n        \"nauc_recall_at_5_std\": -0.018671600272923,\n        \"ndcg_at_1\": 0.225,\n        \"ndcg_at_10\": 0.30869,\n        \"ndcg_at_100\": 0.34748,\n        \"ndcg_at_1000\": 0.37894,\n        \"ndcg_at_20\": 0.32377,\n        \"ndcg_at_3\": 0.27089,\n        \"ndcg_at_5\": 0.29392,\n        \"precision_at_1\": 0.225,\n        \"precision_at_10\": 0.0405,\n        \"precision_at_100\": 0.00595,\n        \"precision_at_1000\": 0.00086,\n        \"precision_at_20\": 0.02325,\n        \"precision_at_3\": 0.10167,\n        \"precision_at_5\": 0.072,\n        \"recall_at_1\": 0.225,\n        \"recall_at_10\": 0.405,\n        \"recall_at_100\": 0.595,\n        \"recall_at_1000\": 0.855,\n        \"recall_at_20\": 0.465,\n        \"recall_at_3\": 0.305,\n        \"recall_at_5\": 0.36\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.29422,\n        \"map_at_1\": 0.21,\n        \"map_at_10\": 0.26295,\n        \"map_at_100\": 0.26991,\n        \"map_at_1000\": 0.27095,\n        \"map_at_20\": 0.26708,\n        \"map_at_3\": 0.24583,\n        \"map_at_5\": 0.25508,\n        \"mrr_at_1\": 0.21,\n        \"mrr_at_10\": 0.2629464285714287,\n        \"mrr_at_100\": 0.2699074844783189,\n        \"mrr_at_1000\": 0.27094814561293573,\n        \"mrr_at_20\": 0.26707917877616033,\n        \"mrr_at_3\": 0.24583333333333335,\n        \"mrr_at_5\": 0.25508333333333333,\n        \"nauc_map_at_1000_diff1\": 0.5993055629941758,\n        \"nauc_map_at_1000_max\": 0.5573641723030943,\n        \"nauc_map_at_1000_std\": -0.028809539494729766,\n        \"nauc_map_at_100_diff1\": 0.599754447437361,\n        \"nauc_map_at_100_max\": 0.5573981154342734,\n        \"nauc_map_at_100_std\": -0.02890453697300498,\n        \"nauc_map_at_10_diff1\": 0.6023176407829586,\n        \"nauc_map_at_10_max\": 0.5605663848880248,\n        \"nauc_map_at_10_std\": -0.029242256541835446,\n        \"nauc_map_at_1_diff1\": 0.6437597985652526,\n        \"nauc_map_at_1_max\": 0.5890224397041822,\n        \"nauc_map_at_1_std\": -0.06044626031323742,\n        \"nauc_map_at_20_diff1\": 0.5994845168527906,\n        \"nauc_map_at_20_max\": 0.5554448313082759,\n        \"nauc_map_at_20_std\": -0.035068836554058784,\n        \"nauc_map_at_3_diff1\": 0.6056887725170285,\n        \"nauc_map_at_3_max\": 0.5655388339621944,\n        \"nauc_map_at_3_std\": -0.04295974260959779,\n        \"nauc_map_at_5_diff1\": 0.6090842844289199,\n        \"nauc_map_at_5_max\": 0.5634194263131953,\n        \"nauc_map_at_5_std\": -0.03926705649959931,\n        \"nauc_mrr_at_1000_diff1\": 0.5993055629941758,\n        \"nauc_mrr_at_1000_max\": 0.5573641723030943,\n        \"nauc_mrr_at_1000_std\": -0.028809539494729766,\n        \"nauc_mrr_at_100_diff1\": 0.599754447437361,\n        \"nauc_mrr_at_100_max\": 0.5573981154342734,\n        \"nauc_mrr_at_100_std\": -0.02890453697300498,\n        \"nauc_mrr_at_10_diff1\": 0.6023176407829586,\n        \"nauc_mrr_at_10_max\": 0.5605663848880248,\n        \"nauc_mrr_at_10_std\": -0.029242256541835446,\n        \"nauc_mrr_at_1_diff1\": 0.6437597985652526,\n        \"nauc_mrr_at_1_max\": 0.5890224397041822,\n        \"nauc_mrr_at_1_std\": -0.06044626031323742,\n        \"nauc_mrr_at_20_diff1\": 0.5994845168527906,\n        \"nauc_mrr_at_20_max\": 0.5554448313082759,\n        \"nauc_mrr_at_20_std\": -0.035068836554058784,\n        \"nauc_mrr_at_3_diff1\": 0.6056887725170285,\n        \"nauc_mrr_at_3_max\": 0.5655388339621944,\n        \"nauc_mrr_at_3_std\": -0.04295974260959779,\n        \"nauc_mrr_at_5_diff1\": 0.6090842844289199,\n        \"nauc_mrr_at_5_max\": 0.5634194263131953,\n        \"nauc_mrr_at_5_std\": -0.03926705649959931,\n        \"nauc_ndcg_at_1000_diff1\": 0.5699912603235107,\n        \"nauc_ndcg_at_1000_max\": 0.5527261730583227,\n        \"nauc_ndcg_at_1000_std\": 0.015365660275101606,\n        \"nauc_ndcg_at_100_diff1\": 0.5802480477342637,\n        \"nauc_ndcg_at_100_max\": 0.5492838888900472,\n        \"nauc_ndcg_at_100_std\": 0.014018667337782901,\n        \"nauc_ndcg_at_10_diff1\": 0.5855860402088727,\n        \"nauc_ndcg_at_10_max\": 0.5495709356998074,\n        \"nauc_ndcg_at_10_std\": -0.009903153000061426,\n        \"nauc_ndcg_at_1_diff1\": 0.6437597985652526,\n        \"nauc_ndcg_at_1_max\": 0.5890224397041822,\n        \"nauc_ndcg_at_1_std\": -0.06044626031323742,\n        \"nauc_ndcg_at_20_diff1\": 0.5743342832932331,\n        \"nauc_ndcg_at_20_max\": 0.5334021632144429,\n        \"nauc_ndcg_at_20_std\": -0.0292445969650835,\n        \"nauc_ndcg_at_3_diff1\": 0.5941871898787882,\n        \"nauc_ndcg_at_3_max\": 0.5584074268194473,\n        \"nauc_ndcg_at_3_std\": -0.038877830654709296,\n        \"nauc_ndcg_at_5_diff1\": 0.6001032735514831,\n        \"nauc_ndcg_at_5_max\": 0.5546463616504773,\n        \"nauc_ndcg_at_5_std\": -0.03270964849256897,\n        \"nauc_precision_at_1000_diff1\": 0.3298034185484586,\n        \"nauc_precision_at_1000_max\": 0.6153536378009128,\n        \"nauc_precision_at_1000_std\": 0.41801151448259366,\n        \"nauc_precision_at_100_diff1\": 0.5279182261912579,\n        \"nauc_precision_at_100_max\": 0.5474934518207223,\n        \"nauc_precision_at_100_std\": 0.21157732688365083,\n        \"nauc_precision_at_10_diff1\": 0.5395469472814903,\n        \"nauc_precision_at_10_max\": 0.5205718967953392,\n        \"nauc_precision_at_10_std\": 0.04711825695354005,\n        \"nauc_precision_at_1_diff1\": 0.6437597985652526,\n        \"nauc_precision_at_1_max\": 0.5890224397041822,\n        \"nauc_precision_at_1_std\": -0.06044626031323742,\n        \"nauc_precision_at_20_diff1\": 0.4956242937110718,\n        \"nauc_precision_at_20_max\": 0.46506005098420566,\n        \"nauc_precision_at_20_std\": -0.02001918477832353,\n        \"nauc_precision_at_3_diff1\": 0.5635604476442821,\n        \"nauc_precision_at_3_max\": 0.5394072731978777,\n        \"nauc_precision_at_3_std\": -0.02834898816862272,\n        \"nauc_precision_at_5_diff1\": 0.5772732404093264,\n        \"nauc_precision_at_5_max\": 0.531154333981898,\n        \"nauc_precision_at_5_std\": -0.01529328171380355,\n        \"nauc_recall_at_1000_diff1\": 0.3298034185484597,\n        \"nauc_recall_at_1000_max\": 0.6153536378009135,\n        \"nauc_recall_at_1000_std\": 0.4180115144825946,\n        \"nauc_recall_at_100_diff1\": 0.5279182261912576,\n        \"nauc_recall_at_100_max\": 0.547493451820722,\n        \"nauc_recall_at_100_std\": 0.2115773268836503,\n        \"nauc_recall_at_10_diff1\": 0.5395469472814901,\n        \"nauc_recall_at_10_max\": 0.5205718967953392,\n        \"nauc_recall_at_10_std\": 0.04711825695353978,\n        \"nauc_recall_at_1_diff1\": 0.6437597985652526,\n        \"nauc_recall_at_1_max\": 0.5890224397041822,\n        \"nauc_recall_at_1_std\": -0.06044626031323742,\n        \"nauc_recall_at_20_diff1\": 0.4956242937110719,\n        \"nauc_recall_at_20_max\": 0.4650600509842053,\n        \"nauc_recall_at_20_std\": -0.020019184778323842,\n        \"nauc_recall_at_3_diff1\": 0.5635604476442824,\n        \"nauc_recall_at_3_max\": 0.5394072731978776,\n        \"nauc_recall_at_3_std\": -0.02834898816862281,\n        \"nauc_recall_at_5_diff1\": 0.5772732404093258,\n        \"nauc_recall_at_5_max\": 0.5311543339818973,\n        \"nauc_recall_at_5_std\": -0.015293281713804032,\n        \"ndcg_at_1\": 0.21,\n        \"ndcg_at_10\": 0.29422,\n        \"ndcg_at_100\": 0.33265,\n        \"ndcg_at_1000\": 0.36357,\n        \"ndcg_at_20\": 0.31017,\n        \"ndcg_at_3\": 0.25839,\n        \"ndcg_at_5\": 0.27496,\n        \"precision_at_1\": 0.21,\n        \"precision_at_10\": 0.0395,\n        \"precision_at_100\": 0.00585,\n        \"precision_at_1000\": 0.00084,\n        \"precision_at_20\": 0.023,\n        \"precision_at_3\": 0.09833,\n        \"precision_at_5\": 0.067,\n        \"recall_at_1\": 0.21,\n        \"recall_at_10\": 0.395,\n        \"recall_at_100\": 0.585,\n        \"recall_at_1000\": 0.835,\n        \"recall_at_20\": 0.46,\n        \"recall_at_3\": 0.295,\n        \"recall_at_5\": 0.335\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KoE5/no_model_name_available/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 2.5225961208343506,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.83507,\n        \"map_at_1\": 0.71429,\n        \"map_at_10\": 0.79848,\n        \"map_at_100\": 0.8006,\n        \"map_at_1000\": 0.8006,\n        \"map_at_20\": 0.79848,\n        \"map_at_3\": 0.78139,\n        \"map_at_5\": 0.79307,\n        \"mrr_at_1\": 0.7142857142857143,\n        \"mrr_at_10\": 0.7984848484848486,\n        \"mrr_at_100\": 0.8005995952099849,\n        \"mrr_at_1000\": 0.8005995952099849,\n        \"mrr_at_20\": 0.7984848484848486,\n        \"mrr_at_3\": 0.7813852813852814,\n        \"mrr_at_5\": 0.7930735930735933,\n        \"nauc_map_at_1000_diff1\": 0.7913266849850282,\n        \"nauc_map_at_1000_max\": 0.3344967478481731,\n        \"nauc_map_at_1000_std\": -0.27987464893738734,\n        \"nauc_map_at_100_diff1\": 0.7913266849850282,\n        \"nauc_map_at_100_max\": 0.3344967478481731,\n        \"nauc_map_at_100_std\": -0.27987464893738734,\n        \"nauc_map_at_10_diff1\": 0.7926589773096495,\n        \"nauc_map_at_10_max\": 0.3330035751571369,\n        \"nauc_map_at_10_std\": -0.27943277460446947,\n        \"nauc_map_at_1_diff1\": 0.7577173196038672,\n        \"nauc_map_at_1_max\": 0.32284171451891813,\n        \"nauc_map_at_1_std\": -0.20882769514998567,\n        \"nauc_map_at_20_diff1\": 0.7926589773096495,\n        \"nauc_map_at_20_max\": 0.3330035751571369,\n        \"nauc_map_at_20_std\": -0.27943277460446947,\n        \"nauc_map_at_3_diff1\": 0.8036211706145331,\n        \"nauc_map_at_3_max\": 0.3491022360132139,\n        \"nauc_map_at_3_std\": -0.29770470107793134,\n        \"nauc_map_at_5_diff1\": 0.792365609522334,\n        \"nauc_map_at_5_max\": 0.3310666097797035,\n        \"nauc_map_at_5_std\": -0.2977794052487303,\n        \"nauc_mrr_at_1000_diff1\": 0.7913266849850282,\n        \"nauc_mrr_at_1000_max\": 0.3344967478481731,\n        \"nauc_mrr_at_1000_std\": -0.27987464893738734,\n        \"nauc_mrr_at_100_diff1\": 0.7913266849850282,\n        \"nauc_mrr_at_100_max\": 0.3344967478481731,\n        \"nauc_mrr_at_100_std\": -0.27987464893738734,\n        \"nauc_mrr_at_10_diff1\": 0.7926589773096495,\n        \"nauc_mrr_at_10_max\": 0.3330035751571369,\n        \"nauc_mrr_at_10_std\": -0.27943277460446947,\n        \"nauc_mrr_at_1_diff1\": 0.7577173196038672,\n        \"nauc_mrr_at_1_max\": 0.32284171451891813,\n        \"nauc_mrr_at_1_std\": -0.20882769514998567,\n        \"nauc_mrr_at_20_diff1\": 0.7926589773096495,\n        \"nauc_mrr_at_20_max\": 0.3330035751571369,\n        \"nauc_mrr_at_20_std\": -0.27943277460446947,\n        \"nauc_mrr_at_3_diff1\": 0.8036211706145331,\n        \"nauc_mrr_at_3_max\": 0.3491022360132139,\n        \"nauc_mrr_at_3_std\": -0.29770470107793134,\n        \"nauc_mrr_at_5_diff1\": 0.792365609522334,\n        \"nauc_mrr_at_5_max\": 0.3310666097797035,\n        \"nauc_mrr_at_5_std\": -0.2977794052487303,\n        \"nauc_ndcg_at_1000_diff1\": 0.7956021251421836,\n        \"nauc_ndcg_at_1000_max\": 0.33379727067161213,\n        \"nauc_ndcg_at_1000_std\": -0.2862451635342314,\n        \"nauc_ndcg_at_100_diff1\": 0.7956021251421836,\n        \"nauc_ndcg_at_100_max\": 0.33379727067161213,\n        \"nauc_ndcg_at_100_std\": -0.2862451635342314,\n        \"nauc_ndcg_at_10_diff1\": 0.8035444610764061,\n        \"nauc_ndcg_at_10_max\": 0.3256076661295447,\n        \"nauc_ndcg_at_10_std\": -0.2817943860852995,\n        \"nauc_ndcg_at_1_diff1\": 0.7577173196038672,\n        \"nauc_ndcg_at_1_max\": 0.32284171451891813,\n        \"nauc_ndcg_at_1_std\": -0.20882769514998567,\n        \"nauc_ndcg_at_20_diff1\": 0.8035444610764061,\n        \"nauc_ndcg_at_20_max\": 0.3256076661295447,\n        \"nauc_ndcg_at_20_std\": -0.2817943860852995,\n        \"nauc_ndcg_at_3_diff1\": 0.8231850214230185,\n        \"nauc_ndcg_at_3_max\": 0.35797191104736537,\n        \"nauc_ndcg_at_3_std\": -0.3364824459168836,\n        \"nauc_ndcg_at_5_diff1\": 0.8030605288101285,\n        \"nauc_ndcg_at_5_max\": 0.32315494694121266,\n        \"nauc_ndcg_at_5_std\": -0.33328124665004133,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.9015345268542192,\n        \"nauc_precision_at_10_max\": 0.23077751617064066,\n        \"nauc_precision_at_10_std\": -0.21914209780721652,\n        \"nauc_precision_at_1_diff1\": 0.7577173196038672,\n        \"nauc_precision_at_1_max\": 0.32284171451891813,\n        \"nauc_precision_at_1_std\": -0.20882769514998567,\n        \"nauc_precision_at_20_diff1\": 0.9015345268542192,\n        \"nauc_precision_at_20_max\": 0.23077751617064066,\n        \"nauc_precision_at_20_std\": -0.21914209780721652,\n        \"nauc_precision_at_3_diff1\": 0.9036789848803191,\n        \"nauc_precision_at_3_max\": 0.3934861268650965,\n        \"nauc_precision_at_3_std\": -0.4964096640360838,\n        \"nauc_precision_at_5_diff1\": 0.8613853520214367,\n        \"nauc_precision_at_5_max\": 0.2666030629895003,\n        \"nauc_precision_at_5_std\": -0.5325711292896321,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.9015345268542205,\n        \"nauc_recall_at_10_max\": 0.2307775161706363,\n        \"nauc_recall_at_10_std\": -0.2191420978072253,\n        \"nauc_recall_at_1_diff1\": 0.7577173196038672,\n        \"nauc_recall_at_1_max\": 0.32284171451891813,\n        \"nauc_recall_at_1_std\": -0.20882769514998567,\n        \"nauc_recall_at_20_diff1\": 0.9015345268542205,\n        \"nauc_recall_at_20_max\": 0.2307775161706363,\n        \"nauc_recall_at_20_std\": -0.2191420978072253,\n        \"nauc_recall_at_3_diff1\": 0.903678984880319,\n        \"nauc_recall_at_3_max\": 0.3934861268650947,\n        \"nauc_recall_at_3_std\": -0.49640966403608566,\n        \"nauc_recall_at_5_diff1\": 0.8613853520214378,\n        \"nauc_recall_at_5_max\": 0.26660306298949915,\n        \"nauc_recall_at_5_std\": -0.5325711292896324,\n        \"ndcg_at_1\": 0.71429,\n        \"ndcg_at_10\": 0.83507,\n        \"ndcg_at_100\": 0.84618,\n        \"ndcg_at_1000\": 0.84618,\n        \"ndcg_at_20\": 0.83507,\n        \"ndcg_at_3\": 0.80102,\n        \"ndcg_at_5\": 0.82225,\n        \"precision_at_1\": 0.71429,\n        \"precision_at_10\": 0.09481,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.0474,\n        \"precision_at_3\": 0.28571,\n        \"precision_at_5\": 0.18182,\n        \"recall_at_1\": 0.71429,\n        \"recall_at_10\": 0.94805,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.94805,\n        \"recall_at_3\": 0.85714,\n        \"recall_at_5\": 0.90909\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KoE5/no_model_name_available/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 21.183428287506104,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.35086,\n        \"map_at_1\": 0.19131,\n        \"map_at_10\": 0.30434,\n        \"map_at_100\": 0.32044,\n        \"map_at_1000\": 0.3217,\n        \"map_at_20\": 0.31239,\n        \"map_at_3\": 0.27181,\n        \"map_at_5\": 0.29452,\n        \"mrr_at_1\": 0.27522935779816515,\n        \"mrr_at_10\": 0.34570833940099976,\n        \"mrr_at_100\": 0.35727638920899696,\n        \"mrr_at_1000\": 0.35812819846900046,\n        \"mrr_at_20\": 0.3513326196391708,\n        \"mrr_at_3\": 0.32237512742099905,\n        \"mrr_at_5\": 0.3391182466870539,\n        \"nauc_map_at_1000_diff1\": 0.409891211890938,\n        \"nauc_map_at_1000_max\": 0.16453956251285742,\n        \"nauc_map_at_1000_std\": -0.3139775027453628,\n        \"nauc_map_at_100_diff1\": 0.40949505819737153,\n        \"nauc_map_at_100_max\": 0.16508576648509377,\n        \"nauc_map_at_100_std\": -0.3127088715184433,\n        \"nauc_map_at_10_diff1\": 0.4122547974430382,\n        \"nauc_map_at_10_max\": 0.16044604520693573,\n        \"nauc_map_at_10_std\": -0.3248597067207718,\n        \"nauc_map_at_1_diff1\": 0.4777061091822854,\n        \"nauc_map_at_1_max\": 0.14012396295028154,\n        \"nauc_map_at_1_std\": -0.2933447558477882,\n        \"nauc_map_at_20_diff1\": 0.4096657611840877,\n        \"nauc_map_at_20_max\": 0.1596009991931055,\n        \"nauc_map_at_20_std\": -0.32136636100620725,\n        \"nauc_map_at_3_diff1\": 0.4150801755132676,\n        \"nauc_map_at_3_max\": 0.16114985288044859,\n        \"nauc_map_at_3_std\": -0.3152011065710757,\n        \"nauc_map_at_5_diff1\": 0.4156042299065368,\n        \"nauc_map_at_5_max\": 0.164822475562178,\n        \"nauc_map_at_5_std\": -0.3253096219738663,\n        \"nauc_mrr_at_1000_diff1\": 0.4316079477998367,\n        \"nauc_mrr_at_1000_max\": 0.16386364595135064,\n        \"nauc_mrr_at_1000_std\": -0.31489718856720234,\n        \"nauc_mrr_at_100_diff1\": 0.4314284888707276,\n        \"nauc_mrr_at_100_max\": 0.16450638693823644,\n        \"nauc_mrr_at_100_std\": -0.3137283988869892,\n        \"nauc_mrr_at_10_diff1\": 0.43309757520126724,\n        \"nauc_mrr_at_10_max\": 0.16043575416951922,\n        \"nauc_mrr_at_10_std\": -0.3229044396958187,\n        \"nauc_mrr_at_1_diff1\": 0.45481694829443947,\n        \"nauc_mrr_at_1_max\": 0.180971841227373,\n        \"nauc_mrr_at_1_std\": -0.3205775185600898,\n        \"nauc_mrr_at_20_diff1\": 0.4306733326980395,\n        \"nauc_mrr_at_20_max\": 0.1603739795107345,\n        \"nauc_mrr_at_20_std\": -0.31915671054108863,\n        \"nauc_mrr_at_3_diff1\": 0.43581235824304093,\n        \"nauc_mrr_at_3_max\": 0.1525340587607215,\n        \"nauc_mrr_at_3_std\": -0.32962878843671045,\n        \"nauc_mrr_at_5_diff1\": 0.43567216072404585,\n        \"nauc_mrr_at_5_max\": 0.15921852607655793,\n        \"nauc_mrr_at_5_std\": -0.32828041586705575,\n        \"nauc_ndcg_at_1000_diff1\": 0.4087053309824719,\n        \"nauc_ndcg_at_1000_max\": 0.17254236463813988,\n        \"nauc_ndcg_at_1000_std\": -0.29251465841312,\n        \"nauc_ndcg_at_100_diff1\": 0.4002654119015821,\n        \"nauc_ndcg_at_100_max\": 0.18760731852733362,\n        \"nauc_ndcg_at_100_std\": -0.25818039099702117,\n        \"nauc_ndcg_at_10_diff1\": 0.4074582908497202,\n        \"nauc_ndcg_at_10_max\": 0.15382112712853638,\n        \"nauc_ndcg_at_10_std\": -0.32581525769692254,\n        \"nauc_ndcg_at_1_diff1\": 0.46062551861494544,\n        \"nauc_ndcg_at_1_max\": 0.18478273585670998,\n        \"nauc_ndcg_at_1_std\": -0.31807342680384515,\n        \"nauc_ndcg_at_20_diff1\": 0.3987930474204499,\n        \"nauc_ndcg_at_20_max\": 0.15167313866012083,\n        \"nauc_ndcg_at_20_std\": -0.3123073905402383,\n        \"nauc_ndcg_at_3_diff1\": 0.413138499471295,\n        \"nauc_ndcg_at_3_max\": 0.14968205337514273,\n        \"nauc_ndcg_at_3_std\": -0.32356853747445136,\n        \"nauc_ndcg_at_5_diff1\": 0.41559541269795314,\n        \"nauc_ndcg_at_5_max\": 0.16058447547298413,\n        \"nauc_ndcg_at_5_std\": -0.3306809176053113,\n        \"nauc_precision_at_1000_diff1\": 0.005598514217803497,\n        \"nauc_precision_at_1000_max\": 0.12201578109620512,\n        \"nauc_precision_at_1000_std\": 0.04235933539624416,\n        \"nauc_precision_at_100_diff1\": 0.09573341817465238,\n        \"nauc_precision_at_100_max\": 0.21966018517316385,\n        \"nauc_precision_at_100_std\": 0.08492736005360908,\n        \"nauc_precision_at_10_diff1\": 0.23415224862463332,\n        \"nauc_precision_at_10_max\": 0.1210617698100394,\n        \"nauc_precision_at_10_std\": -0.27548985963557165,\n        \"nauc_precision_at_1_diff1\": 0.46062551861494544,\n        \"nauc_precision_at_1_max\": 0.18478273585670998,\n        \"nauc_precision_at_1_std\": -0.31807342680384515,\n        \"nauc_precision_at_20_diff1\": 0.19211125561102455,\n        \"nauc_precision_at_20_max\": 0.11098938573217373,\n        \"nauc_precision_at_20_std\": -0.21514662243840546,\n        \"nauc_precision_at_3_diff1\": 0.2854559172268683,\n        \"nauc_precision_at_3_max\": 0.15258475902272714,\n        \"nauc_precision_at_3_std\": -0.2985137253538266,\n        \"nauc_precision_at_5_diff1\": 0.2669222443359308,\n        \"nauc_precision_at_5_max\": 0.1500651160680117,\n        \"nauc_precision_at_5_std\": -0.30143876723721863,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.2862413184497751,\n        \"nauc_recall_at_100_max\": 0.3338603298540222,\n        \"nauc_recall_at_100_std\": 0.12383628514709578,\n        \"nauc_recall_at_10_diff1\": 0.3591712788207327,\n        \"nauc_recall_at_10_max\": 0.13294003401397117,\n        \"nauc_recall_at_10_std\": -0.31282126791818005,\n        \"nauc_recall_at_1_diff1\": 0.4777061091822854,\n        \"nauc_recall_at_1_max\": 0.14012396295028154,\n        \"nauc_recall_at_1_std\": -0.2933447558477882,\n        \"nauc_recall_at_20_diff1\": 0.3242252495515925,\n        \"nauc_recall_at_20_max\": 0.12006091569134453,\n        \"nauc_recall_at_20_std\": -0.2637785006914098,\n        \"nauc_recall_at_3_diff1\": 0.3849361371197937,\n        \"nauc_recall_at_3_max\": 0.1359168382947383,\n        \"nauc_recall_at_3_std\": -0.31194448337435726,\n        \"nauc_recall_at_5_diff1\": 0.3844633841942806,\n        \"nauc_recall_at_5_max\": 0.1538609262812138,\n        \"nauc_recall_at_5_std\": -0.3249312935156017,\n        \"ndcg_at_1\": 0.2737,\n        \"ndcg_at_10\": 0.35086,\n        \"ndcg_at_100\": 0.42802,\n        \"ndcg_at_1000\": 0.45685,\n        \"ndcg_at_20\": 0.37512,\n        \"ndcg_at_3\": 0.29972,\n        \"ndcg_at_5\": 0.33117,\n        \"precision_at_1\": 0.2737,\n        \"precision_at_10\": 0.07125,\n        \"precision_at_100\": 0.01257,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.04228,\n        \"precision_at_3\": 0.16718,\n        \"precision_at_5\": 0.12416,\n        \"recall_at_1\": 0.19131,\n        \"recall_at_10\": 0.4476,\n        \"recall_at_100\": 0.7923,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.53259,\n        \"recall_at_3\": 0.31814,\n        \"recall_at_5\": 0.39422\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.36377,\n        \"map_at_1\": 0.17026,\n        \"map_at_10\": 0.30586,\n        \"map_at_100\": 0.32484,\n        \"map_at_1000\": 0.32634,\n        \"map_at_20\": 0.31556,\n        \"map_at_3\": 0.26655,\n        \"map_at_5\": 0.28822,\n        \"mrr_at_1\": 0.3012232415902141,\n        \"mrr_at_10\": 0.3803650308237463,\n        \"mrr_at_100\": 0.3913429533203558,\n        \"mrr_at_1000\": 0.39204175444015227,\n        \"mrr_at_20\": 0.38581026176568256,\n        \"mrr_at_3\": 0.36009174311926617,\n        \"mrr_at_5\": 0.3716360856269113,\n        \"nauc_map_at_1000_diff1\": 0.3905129088274741,\n        \"nauc_map_at_1000_max\": 0.09151544153933133,\n        \"nauc_map_at_1000_std\": -0.3897538814357438,\n        \"nauc_map_at_100_diff1\": 0.3907039036342101,\n        \"nauc_map_at_100_max\": 0.09073947613087816,\n        \"nauc_map_at_100_std\": -0.3906553158476923,\n        \"nauc_map_at_10_diff1\": 0.3899537801863117,\n        \"nauc_map_at_10_max\": 0.08718295461061652,\n        \"nauc_map_at_10_std\": -0.3958163496438521,\n        \"nauc_map_at_1_diff1\": 0.46049287918661735,\n        \"nauc_map_at_1_max\": 0.0630133239894579,\n        \"nauc_map_at_1_std\": -0.3497742685415477,\n        \"nauc_map_at_20_diff1\": 0.3905049564577334,\n        \"nauc_map_at_20_max\": 0.09162655579285119,\n        \"nauc_map_at_20_std\": -0.39226698525830733,\n        \"nauc_map_at_3_diff1\": 0.40906145738501326,\n        \"nauc_map_at_3_max\": 0.07561830491702498,\n        \"nauc_map_at_3_std\": -0.3918087853272699,\n        \"nauc_map_at_5_diff1\": 0.3993190233282131,\n        \"nauc_map_at_5_max\": 0.08423375728472689,\n        \"nauc_map_at_5_std\": -0.39102988017824986,\n        \"nauc_mrr_at_1000_diff1\": 0.35249685487189764,\n        \"nauc_mrr_at_1000_max\": 0.06464677251048417,\n        \"nauc_mrr_at_1000_std\": -0.3958787711297941,\n        \"nauc_mrr_at_100_diff1\": 0.35241828188347774,\n        \"nauc_mrr_at_100_max\": 0.0647195675869247,\n        \"nauc_mrr_at_100_std\": -0.3956532654295093,\n        \"nauc_mrr_at_10_diff1\": 0.35029761789993663,\n        \"nauc_mrr_at_10_max\": 0.06085785807185011,\n        \"nauc_mrr_at_10_std\": -0.4025441401674854,\n        \"nauc_mrr_at_1_diff1\": 0.4103962669017795,\n        \"nauc_mrr_at_1_max\": 0.09122270133294437,\n        \"nauc_mrr_at_1_std\": -0.397300936878487,\n        \"nauc_mrr_at_20_diff1\": 0.35087000183203443,\n        \"nauc_mrr_at_20_max\": 0.06466336598668623,\n        \"nauc_mrr_at_20_std\": -0.396970413603308,\n        \"nauc_mrr_at_3_diff1\": 0.36002736433393084,\n        \"nauc_mrr_at_3_max\": 0.058919259461077185,\n        \"nauc_mrr_at_3_std\": -0.40384169099115996,\n        \"nauc_mrr_at_5_diff1\": 0.35202572569014046,\n        \"nauc_mrr_at_5_max\": 0.05923611779394499,\n        \"nauc_mrr_at_5_std\": -0.4032668057214314,\n        \"nauc_ndcg_at_1000_diff1\": 0.3629001370839508,\n        \"nauc_ndcg_at_1000_max\": 0.09126996346619579,\n        \"nauc_ndcg_at_1000_std\": -0.37359818020832514,\n        \"nauc_ndcg_at_100_diff1\": 0.3657815332529199,\n        \"nauc_ndcg_at_100_max\": 0.08821375764553004,\n        \"nauc_ndcg_at_100_std\": -0.3717296673154076,\n        \"nauc_ndcg_at_10_diff1\": 0.35722238704057396,\n        \"nauc_ndcg_at_10_max\": 0.07119677725654398,\n        \"nauc_ndcg_at_10_std\": -0.4031827765071559,\n        \"nauc_ndcg_at_1_diff1\": 0.4103962669017795,\n        \"nauc_ndcg_at_1_max\": 0.09122270133294437,\n        \"nauc_ndcg_at_1_std\": -0.397300936878487,\n        \"nauc_ndcg_at_20_diff1\": 0.3572772000121436,\n        \"nauc_ndcg_at_20_max\": 0.08467338613153831,\n        \"nauc_ndcg_at_20_std\": -0.38846316389609437,\n        \"nauc_ndcg_at_3_diff1\": 0.38032648713998807,\n        \"nauc_ndcg_at_3_max\": 0.06941830849493003,\n        \"nauc_ndcg_at_3_std\": -0.40083307028190324,\n        \"nauc_ndcg_at_5_diff1\": 0.3706386370369462,\n        \"nauc_ndcg_at_5_max\": 0.07058132504063835,\n        \"nauc_ndcg_at_5_std\": -0.39576709249460673,\n        \"nauc_precision_at_1000_diff1\": -0.05655782430294636,\n        \"nauc_precision_at_1000_max\": 0.13439956993472651,\n        \"nauc_precision_at_1000_std\": 0.03825648662313364,\n        \"nauc_precision_at_100_diff1\": 0.05320036231388014,\n        \"nauc_precision_at_100_max\": 0.12599490994320076,\n        \"nauc_precision_at_100_std\": -0.06557644002992093,\n        \"nauc_precision_at_10_diff1\": 0.15543747030263136,\n        \"nauc_precision_at_10_max\": 0.09143402417922405,\n        \"nauc_precision_at_10_std\": -0.2973547392633464,\n        \"nauc_precision_at_1_diff1\": 0.4103962669017795,\n        \"nauc_precision_at_1_max\": 0.09122270133294437,\n        \"nauc_precision_at_1_std\": -0.397300936878487,\n        \"nauc_precision_at_20_diff1\": 0.13970539353492695,\n        \"nauc_precision_at_20_max\": 0.11306823178518817,\n        \"nauc_precision_at_20_std\": -0.23946049278152726,\n        \"nauc_precision_at_3_diff1\": 0.25118756576971546,\n        \"nauc_precision_at_3_max\": 0.08726898876587896,\n        \"nauc_precision_at_3_std\": -0.35813694351384023,\n        \"nauc_precision_at_5_diff1\": 0.20874812786297975,\n        \"nauc_precision_at_5_max\": 0.09592288168702671,\n        \"nauc_precision_at_5_std\": -0.32413314057359777,\n        \"nauc_recall_at_1000_diff1\": 0.5377292301225426,\n        \"nauc_recall_at_1000_max\": 0.08617668209469644,\n        \"nauc_recall_at_1000_std\": -0.6137837304264496,\n        \"nauc_recall_at_100_diff1\": 0.33559922640241197,\n        \"nauc_recall_at_100_max\": 0.09917249026842827,\n        \"nauc_recall_at_100_std\": -0.2242024437567541,\n        \"nauc_recall_at_10_diff1\": 0.2863014008696317,\n        \"nauc_recall_at_10_max\": 0.041133587343860675,\n        \"nauc_recall_at_10_std\": -0.3917937947225005,\n        \"nauc_recall_at_1_diff1\": 0.46049287918661735,\n        \"nauc_recall_at_1_max\": 0.0630133239894579,\n        \"nauc_recall_at_1_std\": -0.3497742685415477,\n        \"nauc_recall_at_20_diff1\": 0.27946785579178257,\n        \"nauc_recall_at_20_max\": 0.08117566142227187,\n        \"nauc_recall_at_20_std\": -0.3406835436160669,\n        \"nauc_recall_at_3_diff1\": 0.3456054830033666,\n        \"nauc_recall_at_3_max\": 0.035682358079581346,\n        \"nauc_recall_at_3_std\": -0.3777249942139196,\n        \"nauc_recall_at_5_diff1\": 0.3131933271355397,\n        \"nauc_recall_at_5_max\": 0.04456728949924791,\n        \"nauc_recall_at_5_std\": -0.3693165343322579,\n        \"ndcg_at_1\": 0.30122,\n        \"ndcg_at_10\": 0.36377,\n        \"ndcg_at_100\": 0.44631,\n        \"ndcg_at_1000\": 0.47442,\n        \"ndcg_at_20\": 0.3904,\n        \"ndcg_at_3\": 0.32092,\n        \"ndcg_at_5\": 0.33334,\n        \"precision_at_1\": 0.30122,\n        \"precision_at_10\": 0.0945,\n        \"precision_at_100\": 0.01602,\n        \"precision_at_1000\": 0.00194,\n        \"precision_at_20\": 0.05627,\n        \"precision_at_3\": 0.21254,\n        \"precision_at_5\": 0.15413,\n        \"recall_at_1\": 0.17026,\n        \"recall_at_10\": 0.45178,\n        \"recall_at_100\": 0.80499,\n        \"recall_at_1000\": 0.99554,\n        \"recall_at_20\": 0.53833,\n        \"recall_at_3\": 0.32067,\n        \"recall_at_5\": 0.37704\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.30566,\n        \"map_at_1\": 0.14889,\n        \"map_at_10\": 0.2533,\n        \"map_at_100\": 0.26858,\n        \"map_at_1000\": 0.27012,\n        \"map_at_20\": 0.2598,\n        \"map_at_3\": 0.21998,\n        \"map_at_5\": 0.23516,\n        \"mrr_at_1\": 0.21661237785016288,\n        \"mrr_at_10\": 0.29075345121762064,\n        \"mrr_at_100\": 0.302032412104649,\n        \"mrr_at_1000\": 0.3029382678911658,\n        \"mrr_at_20\": 0.2959832386412645,\n        \"mrr_at_3\": 0.26628664495114013,\n        \"mrr_at_5\": 0.27923452768729645,\n        \"nauc_map_at_1000_diff1\": 0.2754364492779979,\n        \"nauc_map_at_1000_max\": 0.14501680207074708,\n        \"nauc_map_at_1000_std\": -0.2045503695323753,\n        \"nauc_map_at_100_diff1\": 0.27468520019967235,\n        \"nauc_map_at_100_max\": 0.1449756191021319,\n        \"nauc_map_at_100_std\": -0.2041052774261539,\n        \"nauc_map_at_10_diff1\": 0.28147767660133116,\n        \"nauc_map_at_10_max\": 0.14025745921071164,\n        \"nauc_map_at_10_std\": -0.21372035506613338,\n        \"nauc_map_at_1_diff1\": 0.37355624071723426,\n        \"nauc_map_at_1_max\": 0.15577040920214252,\n        \"nauc_map_at_1_std\": -0.17169604535252767,\n        \"nauc_map_at_20_diff1\": 0.27836961510751596,\n        \"nauc_map_at_20_max\": 0.14085538102145206,\n        \"nauc_map_at_20_std\": -0.21238875224210338,\n        \"nauc_map_at_3_diff1\": 0.30405261799344346,\n        \"nauc_map_at_3_max\": 0.15057309668512775,\n        \"nauc_map_at_3_std\": -0.20396464056220748,\n        \"nauc_map_at_5_diff1\": 0.28049454701333115,\n        \"nauc_map_at_5_max\": 0.14003192566298497,\n        \"nauc_map_at_5_std\": -0.21110639749549373,\n        \"nauc_mrr_at_1000_diff1\": 0.2984814662606854,\n        \"nauc_mrr_at_1000_max\": 0.16666015956025307,\n        \"nauc_mrr_at_1000_std\": -0.18122636527094793,\n        \"nauc_mrr_at_100_diff1\": 0.29792570356379233,\n        \"nauc_mrr_at_100_max\": 0.166961439195054,\n        \"nauc_mrr_at_100_std\": -0.18041092111235443,\n        \"nauc_mrr_at_10_diff1\": 0.30116251421854034,\n        \"nauc_mrr_at_10_max\": 0.1637199501267214,\n        \"nauc_mrr_at_10_std\": -0.1874035341015473,\n        \"nauc_mrr_at_1_diff1\": 0.33740901044062355,\n        \"nauc_mrr_at_1_max\": 0.1999944810544008,\n        \"nauc_mrr_at_1_std\": -0.1596080201600802,\n        \"nauc_mrr_at_20_diff1\": 0.3004351087223235,\n        \"nauc_mrr_at_20_max\": 0.16574095356682053,\n        \"nauc_mrr_at_20_std\": -0.18385409738665423,\n        \"nauc_mrr_at_3_diff1\": 0.3145750231821114,\n        \"nauc_mrr_at_3_max\": 0.16624498810306568,\n        \"nauc_mrr_at_3_std\": -0.19056963230635668,\n        \"nauc_mrr_at_5_diff1\": 0.3031707905169204,\n        \"nauc_mrr_at_5_max\": 0.15864107353931567,\n        \"nauc_mrr_at_5_std\": -0.1917669677434899,\n        \"nauc_ndcg_at_1000_diff1\": 0.2638915547403895,\n        \"nauc_ndcg_at_1000_max\": 0.15893667003710962,\n        \"nauc_ndcg_at_1000_std\": -0.17555103553711757,\n        \"nauc_ndcg_at_100_diff1\": 0.2444918613900452,\n        \"nauc_ndcg_at_100_max\": 0.16317746440265982,\n        \"nauc_ndcg_at_100_std\": -0.1534943916878785,\n        \"nauc_ndcg_at_10_diff1\": 0.27135860426735636,\n        \"nauc_ndcg_at_10_max\": 0.1336012494083595,\n        \"nauc_ndcg_at_10_std\": -0.21470931348310615,\n        \"nauc_ndcg_at_1_diff1\": 0.33740901044062355,\n        \"nauc_ndcg_at_1_max\": 0.1999944810544008,\n        \"nauc_ndcg_at_1_std\": -0.1596080201600802,\n        \"nauc_ndcg_at_20_diff1\": 0.26369265299606637,\n        \"nauc_ndcg_at_20_max\": 0.13752019711062136,\n        \"nauc_ndcg_at_20_std\": -0.20626370482023434,\n        \"nauc_ndcg_at_3_diff1\": 0.29881336605653613,\n        \"nauc_ndcg_at_3_max\": 0.1482670195777456,\n        \"nauc_ndcg_at_3_std\": -0.2040467634245727,\n        \"nauc_ndcg_at_5_diff1\": 0.26977399346089515,\n        \"nauc_ndcg_at_5_max\": 0.12880930683718117,\n        \"nauc_ndcg_at_5_std\": -0.21464303645223115,\n        \"nauc_precision_at_1000_diff1\": -0.035880393010250144,\n        \"nauc_precision_at_1000_max\": 0.1872749399058316,\n        \"nauc_precision_at_1000_std\": 0.183770376736487,\n        \"nauc_precision_at_100_diff1\": -0.0090438550124689,\n        \"nauc_precision_at_100_max\": 0.21951059823863653,\n        \"nauc_precision_at_100_std\": 0.1654453563845961,\n        \"nauc_precision_at_10_diff1\": 0.12395431875178056,\n        \"nauc_precision_at_10_max\": 0.10197447301235081,\n        \"nauc_precision_at_10_std\": -0.16913261463696172,\n        \"nauc_precision_at_1_diff1\": 0.33740901044062355,\n        \"nauc_precision_at_1_max\": 0.1999944810544008,\n        \"nauc_precision_at_1_std\": -0.1596080201600802,\n        \"nauc_precision_at_20_diff1\": 0.10141506216433606,\n        \"nauc_precision_at_20_max\": 0.11950733862274829,\n        \"nauc_precision_at_20_std\": -0.1242682898861257,\n        \"nauc_precision_at_3_diff1\": 0.19338903376280286,\n        \"nauc_precision_at_3_max\": 0.1517632901942953,\n        \"nauc_precision_at_3_std\": -0.18603356922253142,\n        \"nauc_precision_at_5_diff1\": 0.13213350660356132,\n        \"nauc_precision_at_5_max\": 0.11840418939206036,\n        \"nauc_precision_at_5_std\": -0.19022391159285162,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.047343750173015633,\n        \"nauc_recall_at_100_max\": 0.19953634957126565,\n        \"nauc_recall_at_100_std\": 0.07688256827536674,\n        \"nauc_recall_at_10_diff1\": 0.22177387526628714,\n        \"nauc_recall_at_10_max\": 0.094492493751116,\n        \"nauc_recall_at_10_std\": -0.22657379096798275,\n        \"nauc_recall_at_1_diff1\": 0.37355624071723426,\n        \"nauc_recall_at_1_max\": 0.15577040920214252,\n        \"nauc_recall_at_1_std\": -0.17169604535252767,\n        \"nauc_recall_at_20_diff1\": 0.19755904312802172,\n        \"nauc_recall_at_20_max\": 0.09992574025954884,\n        \"nauc_recall_at_20_std\": -0.2072258063780811,\n        \"nauc_recall_at_3_diff1\": 0.2748226355661856,\n        \"nauc_recall_at_3_max\": 0.11562233256202345,\n        \"nauc_recall_at_3_std\": -0.21550214097011122,\n        \"nauc_recall_at_5_diff1\": 0.2133193695719311,\n        \"nauc_recall_at_5_max\": 0.07666242316327561,\n        \"nauc_recall_at_5_std\": -0.22846840896747536,\n        \"ndcg_at_1\": 0.21661,\n        \"ndcg_at_10\": 0.30566,\n        \"ndcg_at_100\": 0.38118,\n        \"ndcg_at_1000\": 0.41551,\n        \"ndcg_at_20\": 0.32625,\n        \"ndcg_at_3\": 0.24937,\n        \"ndcg_at_5\": 0.26993,\n        \"precision_at_1\": 0.21661,\n        \"precision_at_10\": 0.06954,\n        \"precision_at_100\": 0.01288,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.04112,\n        \"precision_at_3\": 0.14495,\n        \"precision_at_5\": 0.10456,\n        \"recall_at_1\": 0.14889,\n        \"recall_at_10\": 0.41997,\n        \"recall_at_100\": 0.75291,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.4909,\n        \"recall_at_3\": 0.27454,\n        \"recall_at_5\": 0.32448\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/nlpai-lab/KoE5/no_model_name_available/no_revision_available/model_meta.json",
    "content": "{\"name\": \"no_model_name_available\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": null, \"n_parameters\": null, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": null, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"zero_shot_benchmarks\": null, \"loader\": null}"
  },
  {
    "path": "eval/results/nomic-ai/nomic-embed-text-v2-moe/no_model_name_available/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"task_name\": \"AutoRAGRetrieval\",\n  \"mteb_version\": \"1.29.16\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.65789,\n        \"ndcg_at_3\": 0.78801,\n        \"ndcg_at_5\": 0.79556,\n        \"ndcg_at_10\": 0.80682,\n        \"ndcg_at_20\": 0.81613,\n        \"ndcg_at_100\": 0.82083,\n        \"ndcg_at_1000\": 0.82083,\n        \"map_at_1\": 0.65789,\n        \"map_at_3\": 0.75439,\n        \"map_at_5\": 0.75877,\n        \"map_at_10\": 0.76335,\n        \"map_at_20\": 0.76614,\n        \"map_at_100\": 0.76671,\n        \"map_at_1000\": 0.76671,\n        \"recall_at_1\": 0.65789,\n        \"recall_at_3\": 0.88596,\n        \"recall_at_5\": 0.90351,\n        \"recall_at_10\": 0.9386,\n        \"recall_at_20\": 0.97368,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.65789,\n        \"precision_at_3\": 0.29532,\n        \"precision_at_5\": 0.1807,\n        \"precision_at_10\": 0.09386,\n        \"precision_at_20\": 0.04868,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.657895,\n        \"mrr_at_3\": 0.754386,\n        \"mrr_at_5\": 0.758772,\n        \"mrr_at_10\": 0.763349,\n        \"mrr_at_20\": 0.766137,\n        \"mrr_at_100\": 0.766708,\n        \"mrr_at_1000\": 0.766708,\n        \"nauc_ndcg_at_1_max\": 0.144952,\n        \"nauc_ndcg_at_1_std\": -0.468953,\n        \"nauc_ndcg_at_1_diff1\": 0.703742,\n        \"nauc_ndcg_at_3_max\": 0.174457,\n        \"nauc_ndcg_at_3_std\": -0.609373,\n        \"nauc_ndcg_at_3_diff1\": 0.661707,\n        \"nauc_ndcg_at_5_max\": 0.14815,\n        \"nauc_ndcg_at_5_std\": -0.652516,\n        \"nauc_ndcg_at_5_diff1\": 0.671674,\n        \"nauc_ndcg_at_10_max\": 0.19037,\n        \"nauc_ndcg_at_10_std\": -0.639461,\n        \"nauc_ndcg_at_10_diff1\": 0.681606,\n        \"nauc_ndcg_at_20_max\": 0.177141,\n        \"nauc_ndcg_at_20_std\": -0.629436,\n        \"nauc_ndcg_at_20_diff1\": 0.684969,\n        \"nauc_ndcg_at_100_max\": 0.161606,\n        \"nauc_ndcg_at_100_std\": -0.601734,\n        \"nauc_ndcg_at_100_diff1\": 0.684327,\n        \"nauc_ndcg_at_1000_max\": 0.161606,\n        \"nauc_ndcg_at_1000_std\": -0.601734,\n        \"nauc_ndcg_at_1000_diff1\": 0.684327,\n        \"nauc_map_at_1_max\": 0.144952,\n        \"nauc_map_at_1_std\": -0.468953,\n        \"nauc_map_at_1_diff1\": 0.703742,\n        \"nauc_map_at_3_max\": 0.15807,\n        \"nauc_map_at_3_std\": -0.570541,\n        \"nauc_map_at_3_diff1\": 0.675715,\n        \"nauc_map_at_5_max\": 0.144572,\n        \"nauc_map_at_5_std\": -0.591471,\n        \"nauc_map_at_5_diff1\": 0.680973,\n        \"nauc_map_at_10_max\": 0.158889,\n        \"nauc_map_at_10_std\": -0.586532,\n        \"nauc_map_at_10_diff1\": 0.68437,\n        \"nauc_map_at_20_max\": 0.155476,\n        \"nauc_map_at_20_std\": -0.583429,\n        \"nauc_map_at_20_diff1\": 0.685566,\n        \"nauc_map_at_100_max\": 0.154046,\n        \"nauc_map_at_100_std\": -0.580807,\n        \"nauc_map_at_100_diff1\": 0.68558,\n        \"nauc_map_at_1000_max\": 0.154046,\n        \"nauc_map_at_1000_std\": -0.580807,\n        \"nauc_map_at_1000_diff1\": 0.68558,\n        \"nauc_recall_at_1_max\": 0.144952,\n        \"nauc_recall_at_1_std\": -0.468953,\n        \"nauc_recall_at_1_diff1\": 0.703742,\n        \"nauc_recall_at_3_max\": 0.269469,\n        \"nauc_recall_at_3_std\": -0.816798,\n        \"nauc_recall_at_3_diff1\": 0.584712,\n        \"nauc_recall_at_5_max\": 0.170742,\n        \"nauc_recall_at_5_std\": -1.036153,\n        \"nauc_recall_at_5_diff1\": 0.615636,\n        \"nauc_recall_at_10_max\": 0.54137,\n        \"nauc_recall_at_10_std\": -1.128869,\n        \"nauc_recall_at_10_diff1\": 0.671434,\n        \"nauc_recall_at_20_max\": 0.699035,\n        \"nauc_recall_at_20_std\": -1.553327,\n        \"nauc_recall_at_20_diff1\": 0.715652,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.144952,\n        \"nauc_precision_at_1_std\": -0.468953,\n        \"nauc_precision_at_1_diff1\": 0.703742,\n        \"nauc_precision_at_3_max\": 0.269469,\n        \"nauc_precision_at_3_std\": -0.816798,\n        \"nauc_precision_at_3_diff1\": 0.584712,\n        \"nauc_precision_at_5_max\": 0.170742,\n        \"nauc_precision_at_5_std\": -1.036153,\n        \"nauc_precision_at_5_diff1\": 0.615636,\n        \"nauc_precision_at_10_max\": 0.54137,\n        \"nauc_precision_at_10_std\": -1.128869,\n        \"nauc_precision_at_10_diff1\": 0.671434,\n        \"nauc_precision_at_20_max\": 0.699035,\n        \"nauc_precision_at_20_std\": -1.553327,\n        \"nauc_precision_at_20_diff1\": 0.715652,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_mrr_at_1_max\": 0.144952,\n        \"nauc_mrr_at_1_std\": -0.468953,\n        \"nauc_mrr_at_1_diff1\": 0.703742,\n        \"nauc_mrr_at_3_max\": 0.15807,\n        \"nauc_mrr_at_3_std\": -0.570541,\n        \"nauc_mrr_at_3_diff1\": 0.675715,\n        \"nauc_mrr_at_5_max\": 0.144572,\n        \"nauc_mrr_at_5_std\": -0.591471,\n        \"nauc_mrr_at_5_diff1\": 0.680973,\n        \"nauc_mrr_at_10_max\": 0.158889,\n        \"nauc_mrr_at_10_std\": -0.586532,\n        \"nauc_mrr_at_10_diff1\": 0.68437,\n        \"nauc_mrr_at_20_max\": 0.155476,\n        \"nauc_mrr_at_20_std\": -0.583429,\n        \"nauc_mrr_at_20_diff1\": 0.685566,\n        \"nauc_mrr_at_100_max\": 0.154046,\n        \"nauc_mrr_at_100_std\": -0.580807,\n        \"nauc_mrr_at_100_diff1\": 0.68558,\n        \"nauc_mrr_at_1000_max\": 0.154046,\n        \"nauc_mrr_at_1000_std\": -0.580807,\n        \"nauc_mrr_at_1000_diff1\": 0.68558,\n        \"main_score\": 0.80682,\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 10.152276277542114,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nomic-ai/nomic-embed-text-v2-moe/no_model_name_available/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"task_name\": \"BelebeleRetrieval\",\n  \"mteb_version\": \"1.29.16\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.9,\n        \"ndcg_at_3\": 0.92729,\n        \"ndcg_at_5\": 0.93236,\n        \"ndcg_at_10\": 0.93636,\n        \"ndcg_at_20\": 0.93941,\n        \"ndcg_at_100\": 0.94156,\n        \"ndcg_at_1000\": 0.94246,\n        \"map_at_1\": 0.9,\n        \"map_at_3\": 0.92093,\n        \"map_at_5\": 0.92376,\n        \"map_at_10\": 0.92544,\n        \"map_at_20\": 0.92625,\n        \"map_at_100\": 0.92659,\n        \"map_at_1000\": 0.92663,\n        \"recall_at_1\": 0.9,\n        \"recall_at_3\": 0.94556,\n        \"recall_at_5\": 0.95778,\n        \"recall_at_10\": 0.97,\n        \"recall_at_20\": 0.98222,\n        \"recall_at_100\": 0.99333,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.9,\n        \"precision_at_3\": 0.31519,\n        \"precision_at_5\": 0.19156,\n        \"precision_at_10\": 0.097,\n        \"precision_at_20\": 0.04911,\n        \"precision_at_100\": 0.00993,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.9,\n        \"mrr_at_3\": 0.920926,\n        \"mrr_at_5\": 0.923759,\n        \"mrr_at_10\": 0.925442,\n        \"mrr_at_20\": 0.926254,\n        \"mrr_at_100\": 0.926592,\n        \"mrr_at_1000\": 0.926632,\n        \"nauc_ndcg_at_1_max\": 0.849813,\n        \"nauc_ndcg_at_1_std\": 0.119157,\n        \"nauc_ndcg_at_1_diff1\": 0.900093,\n        \"nauc_ndcg_at_3_max\": 0.872149,\n        \"nauc_ndcg_at_3_std\": 0.075853,\n        \"nauc_ndcg_at_3_diff1\": 0.912054,\n        \"nauc_ndcg_at_5_max\": 0.870113,\n        \"nauc_ndcg_at_5_std\": 0.096455,\n        \"nauc_ndcg_at_5_diff1\": 0.907313,\n        \"nauc_ndcg_at_10_max\": 0.865967,\n        \"nauc_ndcg_at_10_std\": 0.086424,\n        \"nauc_ndcg_at_10_diff1\": 0.908127,\n        \"nauc_ndcg_at_20_max\": 0.865356,\n        \"nauc_ndcg_at_20_std\": 0.083029,\n        \"nauc_ndcg_at_20_diff1\": 0.910442,\n        \"nauc_ndcg_at_100_max\": 0.86684,\n        \"nauc_ndcg_at_100_std\": 0.105116,\n        \"nauc_ndcg_at_100_diff1\": 0.909392,\n        \"nauc_ndcg_at_1000_max\": 0.86514,\n        \"nauc_ndcg_at_1000_std\": 0.099406,\n        \"nauc_ndcg_at_1000_diff1\": 0.908351,\n        \"nauc_map_at_1_max\": 0.849813,\n        \"nauc_map_at_1_std\": 0.119157,\n        \"nauc_map_at_1_diff1\": 0.900093,\n        \"nauc_map_at_3_max\": 0.866128,\n        \"nauc_map_at_3_std\": 0.090474,\n        \"nauc_map_at_3_diff1\": 0.908821,\n        \"nauc_map_at_5_max\": 0.864939,\n        \"nauc_map_at_5_std\": 0.101507,\n        \"nauc_map_at_5_diff1\": 0.906386,\n        \"nauc_map_at_10_max\": 0.863324,\n        \"nauc_map_at_10_std\": 0.097936,\n        \"nauc_map_at_10_diff1\": 0.906683,\n        \"nauc_map_at_20_max\": 0.863212,\n        \"nauc_map_at_20_std\": 0.097465,\n        \"nauc_map_at_20_diff1\": 0.907289,\n        \"nauc_map_at_100_max\": 0.863306,\n        \"nauc_map_at_100_std\": 0.100578,\n        \"nauc_map_at_100_diff1\": 0.907099,\n        \"nauc_map_at_1000_max\": 0.863247,\n        \"nauc_map_at_1000_std\": 0.100452,\n        \"nauc_map_at_1000_diff1\": 0.907064,\n        \"nauc_recall_at_1_max\": 0.849813,\n        \"nauc_recall_at_1_std\": 0.119157,\n        \"nauc_recall_at_1_diff1\": 0.900093,\n        \"nauc_recall_at_3_max\": 0.896911,\n        \"nauc_recall_at_3_std\": 0.01372,\n        \"nauc_recall_at_3_diff1\": 0.925351,\n        \"nauc_recall_at_5_max\": 0.895879,\n        \"nauc_recall_at_5_std\": 0.073284,\n        \"nauc_recall_at_5_diff1\": 0.910622,\n        \"nauc_recall_at_10_max\": 0.879656,\n        \"nauc_recall_at_10_std\": -5.2e-05,\n        \"nauc_recall_at_10_diff1\": 0.916917,\n        \"nauc_recall_at_20_max\": 0.87891,\n        \"nauc_recall_at_20_std\": -0.111578,\n        \"nauc_recall_at_20_diff1\": 0.95098,\n        \"nauc_recall_at_100_max\": 0.978214,\n        \"nauc_recall_at_100_std\": 0.512605,\n        \"nauc_recall_at_100_diff1\": 0.978214,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.849813,\n        \"nauc_precision_at_1_std\": 0.119157,\n        \"nauc_precision_at_1_diff1\": 0.900093,\n        \"nauc_precision_at_3_max\": 0.896911,\n        \"nauc_precision_at_3_std\": 0.01372,\n        \"nauc_precision_at_3_diff1\": 0.925351,\n        \"nauc_precision_at_5_max\": 0.895879,\n        \"nauc_precision_at_5_std\": 0.073284,\n        \"nauc_precision_at_5_diff1\": 0.910622,\n        \"nauc_precision_at_10_max\": 0.879656,\n        \"nauc_precision_at_10_std\": -5.2e-05,\n        \"nauc_precision_at_10_diff1\": 0.916917,\n        \"nauc_precision_at_20_max\": 0.87891,\n        \"nauc_precision_at_20_std\": -0.111578,\n        \"nauc_precision_at_20_diff1\": 0.95098,\n        \"nauc_precision_at_100_max\": 0.978214,\n        \"nauc_precision_at_100_std\": 0.512605,\n        \"nauc_precision_at_100_diff1\": 0.978214,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.849813,\n        \"nauc_mrr_at_1_std\": 0.119157,\n        \"nauc_mrr_at_1_diff1\": 0.900093,\n        \"nauc_mrr_at_3_max\": 0.866128,\n        \"nauc_mrr_at_3_std\": 0.090474,\n        \"nauc_mrr_at_3_diff1\": 0.908821,\n        \"nauc_mrr_at_5_max\": 0.864939,\n        \"nauc_mrr_at_5_std\": 0.101507,\n        \"nauc_mrr_at_5_diff1\": 0.906386,\n        \"nauc_mrr_at_10_max\": 0.863324,\n        \"nauc_mrr_at_10_std\": 0.097936,\n        \"nauc_mrr_at_10_diff1\": 0.906683,\n        \"nauc_mrr_at_20_max\": 0.863212,\n        \"nauc_mrr_at_20_std\": 0.097465,\n        \"nauc_mrr_at_20_diff1\": 0.907289,\n        \"nauc_mrr_at_100_max\": 0.863306,\n        \"nauc_mrr_at_100_std\": 0.100578,\n        \"nauc_mrr_at_100_diff1\": 0.907099,\n        \"nauc_mrr_at_1000_max\": 0.863247,\n        \"nauc_mrr_at_1000_std\": 0.100452,\n        \"nauc_mrr_at_1000_diff1\": 0.907064,\n        \"main_score\": 0.93636,\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.77444,\n        \"ndcg_at_3\": 0.83469,\n        \"ndcg_at_5\": 0.84971,\n        \"ndcg_at_10\": 0.8598,\n        \"ndcg_at_20\": 0.8654,\n        \"ndcg_at_100\": 0.87031,\n        \"ndcg_at_1000\": 0.87122,\n        \"map_at_1\": 0.77444,\n        \"map_at_3\": 0.81981,\n        \"map_at_5\": 0.82809,\n        \"map_at_10\": 0.83228,\n        \"map_at_20\": 0.83381,\n        \"map_at_100\": 0.83454,\n        \"map_at_1000\": 0.83459,\n        \"recall_at_1\": 0.77444,\n        \"recall_at_3\": 0.87778,\n        \"recall_at_5\": 0.91444,\n        \"recall_at_10\": 0.94556,\n        \"recall_at_20\": 0.96778,\n        \"recall_at_100\": 0.99333,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.77444,\n        \"precision_at_3\": 0.29259,\n        \"precision_at_5\": 0.18289,\n        \"precision_at_10\": 0.09456,\n        \"precision_at_20\": 0.04839,\n        \"precision_at_100\": 0.00993,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.774444,\n        \"mrr_at_3\": 0.819815,\n        \"mrr_at_5\": 0.828093,\n        \"mrr_at_10\": 0.832275,\n        \"mrr_at_20\": 0.833805,\n        \"mrr_at_100\": 0.834541,\n        \"mrr_at_1000\": 0.834586,\n        \"nauc_ndcg_at_1_max\": 0.709926,\n        \"nauc_ndcg_at_1_std\": -0.063143,\n        \"nauc_ndcg_at_1_diff1\": 0.863108,\n        \"nauc_ndcg_at_3_max\": 0.720473,\n        \"nauc_ndcg_at_3_std\": -0.080147,\n        \"nauc_ndcg_at_3_diff1\": 0.841613,\n        \"nauc_ndcg_at_5_max\": 0.723408,\n        \"nauc_ndcg_at_5_std\": -0.062139,\n        \"nauc_ndcg_at_5_diff1\": 0.842072,\n        \"nauc_ndcg_at_10_max\": 0.730953,\n        \"nauc_ndcg_at_10_std\": -0.019305,\n        \"nauc_ndcg_at_10_diff1\": 0.845659,\n        \"nauc_ndcg_at_20_max\": 0.7317,\n        \"nauc_ndcg_at_20_std\": -0.026528,\n        \"nauc_ndcg_at_20_diff1\": 0.847865,\n        \"nauc_ndcg_at_100_max\": 0.726646,\n        \"nauc_ndcg_at_100_std\": -0.040923,\n        \"nauc_ndcg_at_100_diff1\": 0.847999,\n        \"nauc_ndcg_at_1000_max\": 0.725425,\n        \"nauc_ndcg_at_1000_std\": -0.045003,\n        \"nauc_ndcg_at_1000_diff1\": 0.848429,\n        \"nauc_map_at_1_max\": 0.709926,\n        \"nauc_map_at_1_std\": -0.063143,\n        \"nauc_map_at_1_diff1\": 0.863108,\n        \"nauc_map_at_3_max\": 0.719983,\n        \"nauc_map_at_3_std\": -0.074201,\n        \"nauc_map_at_3_diff1\": 0.848359,\n        \"nauc_map_at_5_max\": 0.720959,\n        \"nauc_map_at_5_std\": -0.065162,\n        \"nauc_map_at_5_diff1\": 0.848573,\n        \"nauc_map_at_10_max\": 0.723392,\n        \"nauc_map_at_10_std\": -0.049768,\n        \"nauc_map_at_10_diff1\": 0.849886,\n        \"nauc_map_at_20_max\": 0.723456,\n        \"nauc_map_at_20_std\": -0.051621,\n        \"nauc_map_at_20_diff1\": 0.850372,\n        \"nauc_map_at_100_max\": 0.722814,\n        \"nauc_map_at_100_std\": -0.0534,\n        \"nauc_map_at_100_diff1\": 0.850366,\n        \"nauc_map_at_1000_max\": 0.722767,\n        \"nauc_map_at_1000_std\": -0.05353,\n        \"nauc_map_at_1000_diff1\": 0.850381,\n        \"nauc_recall_at_1_max\": 0.709926,\n        \"nauc_recall_at_1_std\": -0.063143,\n        \"nauc_recall_at_1_diff1\": 0.863108,\n        \"nauc_recall_at_3_max\": 0.720942,\n        \"nauc_recall_at_3_std\": -0.104817,\n        \"nauc_recall_at_3_diff1\": 0.813999,\n        \"nauc_recall_at_5_max\": 0.736325,\n        \"nauc_recall_at_5_std\": -0.041635,\n        \"nauc_recall_at_5_diff1\": 0.807505,\n        \"nauc_recall_at_10_max\": 0.801787,\n        \"nauc_recall_at_10_std\": 0.280674,\n        \"nauc_recall_at_10_diff1\": 0.816126,\n        \"nauc_recall_at_20_max\": 0.863164,\n        \"nauc_recall_at_20_std\": 0.373161,\n        \"nauc_recall_at_20_diff1\": 0.831611,\n        \"nauc_recall_at_100_max\": 0.888344,\n        \"nauc_recall_at_100_std\": 0.527,\n        \"nauc_recall_at_100_diff1\": 0.789527,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.709926,\n        \"nauc_precision_at_1_std\": -0.063143,\n        \"nauc_precision_at_1_diff1\": 0.863108,\n        \"nauc_precision_at_3_max\": 0.720942,\n        \"nauc_precision_at_3_std\": -0.104817,\n        \"nauc_precision_at_3_diff1\": 0.813999,\n        \"nauc_precision_at_5_max\": 0.736325,\n        \"nauc_precision_at_5_std\": -0.041635,\n        \"nauc_precision_at_5_diff1\": 0.807505,\n        \"nauc_precision_at_10_max\": 0.801787,\n        \"nauc_precision_at_10_std\": 0.280674,\n        \"nauc_precision_at_10_diff1\": 0.816126,\n        \"nauc_precision_at_20_max\": 0.863164,\n        \"nauc_precision_at_20_std\": 0.373161,\n        \"nauc_precision_at_20_diff1\": 0.831611,\n        \"nauc_precision_at_100_max\": 0.888344,\n        \"nauc_precision_at_100_std\": 0.527,\n        \"nauc_precision_at_100_diff1\": 0.789527,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.709926,\n        \"nauc_mrr_at_1_std\": -0.063143,\n        \"nauc_mrr_at_1_diff1\": 0.863108,\n        \"nauc_mrr_at_3_max\": 0.719983,\n        \"nauc_mrr_at_3_std\": -0.074201,\n        \"nauc_mrr_at_3_diff1\": 0.848359,\n        \"nauc_mrr_at_5_max\": 0.720959,\n        \"nauc_mrr_at_5_std\": -0.065162,\n        \"nauc_mrr_at_5_diff1\": 0.848573,\n        \"nauc_mrr_at_10_max\": 0.723392,\n        \"nauc_mrr_at_10_std\": -0.049768,\n        \"nauc_mrr_at_10_diff1\": 0.849886,\n        \"nauc_mrr_at_20_max\": 0.723456,\n        \"nauc_mrr_at_20_std\": -0.051621,\n        \"nauc_mrr_at_20_diff1\": 0.850372,\n        \"nauc_mrr_at_100_max\": 0.722814,\n        \"nauc_mrr_at_100_std\": -0.0534,\n        \"nauc_mrr_at_100_diff1\": 0.850366,\n        \"nauc_mrr_at_1000_max\": 0.722767,\n        \"nauc_mrr_at_1000_std\": -0.05353,\n        \"nauc_mrr_at_1000_diff1\": 0.850381,\n        \"main_score\": 0.8598,\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.71,\n        \"ndcg_at_3\": 0.77028,\n        \"ndcg_at_5\": 0.78702,\n        \"ndcg_at_10\": 0.80552,\n        \"ndcg_at_20\": 0.81313,\n        \"ndcg_at_100\": 0.82143,\n        \"ndcg_at_1000\": 0.82368,\n        \"map_at_1\": 0.71,\n        \"map_at_3\": 0.75574,\n        \"map_at_5\": 0.76519,\n        \"map_at_10\": 0.77293,\n        \"map_at_20\": 0.77502,\n        \"map_at_100\": 0.77618,\n        \"map_at_1000\": 0.77629,\n        \"recall_at_1\": 0.71,\n        \"recall_at_3\": 0.81222,\n        \"recall_at_5\": 0.85222,\n        \"recall_at_10\": 0.90889,\n        \"recall_at_20\": 0.93889,\n        \"recall_at_100\": 0.98333,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.71,\n        \"precision_at_3\": 0.27074,\n        \"precision_at_5\": 0.17044,\n        \"precision_at_10\": 0.09089,\n        \"precision_at_20\": 0.04694,\n        \"precision_at_100\": 0.00983,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.71,\n        \"mrr_at_3\": 0.755741,\n        \"mrr_at_5\": 0.765185,\n        \"mrr_at_10\": 0.772925,\n        \"mrr_at_20\": 0.77502,\n        \"mrr_at_100\": 0.776182,\n        \"mrr_at_1000\": 0.776288,\n        \"nauc_ndcg_at_1_max\": 0.741047,\n        \"nauc_ndcg_at_1_std\": 0.150175,\n        \"nauc_ndcg_at_1_diff1\": 0.874735,\n        \"nauc_ndcg_at_3_max\": 0.743184,\n        \"nauc_ndcg_at_3_std\": 0.158375,\n        \"nauc_ndcg_at_3_diff1\": 0.848813,\n        \"nauc_ndcg_at_5_max\": 0.752586,\n        \"nauc_ndcg_at_5_std\": 0.187284,\n        \"nauc_ndcg_at_5_diff1\": 0.84275,\n        \"nauc_ndcg_at_10_max\": 0.746801,\n        \"nauc_ndcg_at_10_std\": 0.195985,\n        \"nauc_ndcg_at_10_diff1\": 0.841376,\n        \"nauc_ndcg_at_20_max\": 0.74242,\n        \"nauc_ndcg_at_20_std\": 0.18473,\n        \"nauc_ndcg_at_20_diff1\": 0.842535,\n        \"nauc_ndcg_at_100_max\": 0.745244,\n        \"nauc_ndcg_at_100_std\": 0.183086,\n        \"nauc_ndcg_at_100_diff1\": 0.847303,\n        \"nauc_ndcg_at_1000_max\": 0.74542,\n        \"nauc_ndcg_at_1000_std\": 0.178041,\n        \"nauc_ndcg_at_1000_diff1\": 0.849251,\n        \"nauc_map_at_1_max\": 0.741047,\n        \"nauc_map_at_1_std\": 0.150175,\n        \"nauc_map_at_1_diff1\": 0.874735,\n        \"nauc_map_at_3_max\": 0.742529,\n        \"nauc_map_at_3_std\": 0.15468,\n        \"nauc_map_at_3_diff1\": 0.855357,\n        \"nauc_map_at_5_max\": 0.747374,\n        \"nauc_map_at_5_std\": 0.169622,\n        \"nauc_map_at_5_diff1\": 0.852636,\n        \"nauc_map_at_10_max\": 0.745154,\n        \"nauc_map_at_10_std\": 0.17275,\n        \"nauc_map_at_10_diff1\": 0.852492,\n        \"nauc_map_at_20_max\": 0.744114,\n        \"nauc_map_at_20_std\": 0.169849,\n        \"nauc_map_at_20_diff1\": 0.852877,\n        \"nauc_map_at_100_max\": 0.744707,\n        \"nauc_map_at_100_std\": 0.169854,\n        \"nauc_map_at_100_diff1\": 0.85356,\n        \"nauc_map_at_1000_max\": 0.744725,\n        \"nauc_map_at_1000_std\": 0.169696,\n        \"nauc_map_at_1000_diff1\": 0.853632,\n        \"nauc_recall_at_1_max\": 0.741047,\n        \"nauc_recall_at_1_std\": 0.150175,\n        \"nauc_recall_at_1_diff1\": 0.874735,\n        \"nauc_recall_at_3_max\": 0.745556,\n        \"nauc_recall_at_3_std\": 0.1723,\n        \"nauc_recall_at_3_diff1\": 0.825776,\n        \"nauc_recall_at_5_max\": 0.776768,\n        \"nauc_recall_at_5_std\": 0.269229,\n        \"nauc_recall_at_5_diff1\": 0.799352,\n        \"nauc_recall_at_10_max\": 0.755352,\n        \"nauc_recall_at_10_std\": 0.360046,\n        \"nauc_recall_at_10_diff1\": 0.766904,\n        \"nauc_recall_at_20_max\": 0.711858,\n        \"nauc_recall_at_20_std\": 0.318852,\n        \"nauc_recall_at_20_diff1\": 0.742917,\n        \"nauc_recall_at_100_max\": 0.73906,\n        \"nauc_recall_at_100_std\": 0.555836,\n        \"nauc_recall_at_100_diff1\": 0.709679,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.741047,\n        \"nauc_precision_at_1_std\": 0.150175,\n        \"nauc_precision_at_1_diff1\": 0.874735,\n        \"nauc_precision_at_3_max\": 0.745556,\n        \"nauc_precision_at_3_std\": 0.1723,\n        \"nauc_precision_at_3_diff1\": 0.825776,\n        \"nauc_precision_at_5_max\": 0.776768,\n        \"nauc_precision_at_5_std\": 0.269229,\n        \"nauc_precision_at_5_diff1\": 0.799352,\n        \"nauc_precision_at_10_max\": 0.755352,\n        \"nauc_precision_at_10_std\": 0.360046,\n        \"nauc_precision_at_10_diff1\": 0.766904,\n        \"nauc_precision_at_20_max\": 0.711858,\n        \"nauc_precision_at_20_std\": 0.318852,\n        \"nauc_precision_at_20_diff1\": 0.742917,\n        \"nauc_precision_at_100_max\": 0.73906,\n        \"nauc_precision_at_100_std\": 0.555836,\n        \"nauc_precision_at_100_diff1\": 0.709679,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.741047,\n        \"nauc_mrr_at_1_std\": 0.150175,\n        \"nauc_mrr_at_1_diff1\": 0.874735,\n        \"nauc_mrr_at_3_max\": 0.742529,\n        \"nauc_mrr_at_3_std\": 0.15468,\n        \"nauc_mrr_at_3_diff1\": 0.855357,\n        \"nauc_mrr_at_5_max\": 0.747374,\n        \"nauc_mrr_at_5_std\": 0.169622,\n        \"nauc_mrr_at_5_diff1\": 0.852636,\n        \"nauc_mrr_at_10_max\": 0.745154,\n        \"nauc_mrr_at_10_std\": 0.17275,\n        \"nauc_mrr_at_10_diff1\": 0.852492,\n        \"nauc_mrr_at_20_max\": 0.744114,\n        \"nauc_mrr_at_20_std\": 0.169849,\n        \"nauc_mrr_at_20_diff1\": 0.852877,\n        \"nauc_mrr_at_100_max\": 0.744707,\n        \"nauc_mrr_at_100_std\": 0.169854,\n        \"nauc_mrr_at_100_diff1\": 0.85356,\n        \"nauc_mrr_at_1000_max\": 0.744725,\n        \"nauc_mrr_at_1000_std\": 0.169696,\n        \"nauc_mrr_at_1000_diff1\": 0.853632,\n        \"main_score\": 0.80552,\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 19.255128145217896,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nomic-ai/nomic-embed-text-v2-moe/no_model_name_available/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"task_name\": \"Ko-StrategyQA\",\n  \"mteb_version\": \"1.29.16\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"ndcg_at_1\": 0.71453,\n        \"ndcg_at_3\": 0.7184,\n        \"ndcg_at_5\": 0.74457,\n        \"ndcg_at_10\": 0.76325,\n        \"ndcg_at_20\": 0.77435,\n        \"ndcg_at_100\": 0.78386,\n        \"ndcg_at_1000\": 0.79186,\n        \"map_at_1\": 0.46761,\n        \"map_at_3\": 0.67454,\n        \"map_at_5\": 0.70272,\n        \"map_at_10\": 0.71519,\n        \"map_at_20\": 0.71987,\n        \"map_at_100\": 0.72181,\n        \"map_at_1000\": 0.72217,\n        \"recall_at_1\": 0.46761,\n        \"recall_at_3\": 0.72928,\n        \"recall_at_5\": 0.78289,\n        \"recall_at_10\": 0.82686,\n        \"recall_at_20\": 0.86076,\n        \"recall_at_100\": 0.90259,\n        \"recall_at_1000\": 0.9544,\n        \"precision_at_1\": 0.71453,\n        \"precision_at_3\": 0.42736,\n        \"precision_at_5\": 0.28378,\n        \"precision_at_10\": 0.15253,\n        \"precision_at_20\": 0.08015,\n        \"precision_at_100\": 0.01691,\n        \"precision_at_1000\": 0.00181,\n        \"mrr_at_1\": 0.714527,\n        \"mrr_at_3\": 0.774775,\n        \"mrr_at_5\": 0.777477,\n        \"mrr_at_10\": 0.780593,\n        \"mrr_at_20\": 0.782165,\n        \"mrr_at_100\": 0.782891,\n        \"mrr_at_1000\": 0.783037,\n        \"nauc_ndcg_at_1_max\": 0.657745,\n        \"nauc_ndcg_at_1_std\": 0.24173,\n        \"nauc_ndcg_at_1_diff1\": 0.689846,\n        \"nauc_ndcg_at_3_max\": 0.639985,\n        \"nauc_ndcg_at_3_std\": 0.223257,\n        \"nauc_ndcg_at_3_diff1\": 0.576491,\n        \"nauc_ndcg_at_5_max\": 0.677781,\n        \"nauc_ndcg_at_5_std\": 0.266772,\n        \"nauc_ndcg_at_5_diff1\": 0.564678,\n        \"nauc_ndcg_at_10_max\": 0.68748,\n        \"nauc_ndcg_at_10_std\": 0.301639,\n        \"nauc_ndcg_at_10_diff1\": 0.571674,\n        \"nauc_ndcg_at_20_max\": 0.705281,\n        \"nauc_ndcg_at_20_std\": 0.324945,\n        \"nauc_ndcg_at_20_diff1\": 0.580892,\n        \"nauc_ndcg_at_100_max\": 0.704981,\n        \"nauc_ndcg_at_100_std\": 0.342294,\n        \"nauc_ndcg_at_100_diff1\": 0.578293,\n        \"nauc_ndcg_at_1000_max\": 0.699871,\n        \"nauc_ndcg_at_1000_std\": 0.326877,\n        \"nauc_ndcg_at_1000_diff1\": 0.582325,\n        \"nauc_map_at_1_max\": 0.321776,\n        \"nauc_map_at_1_std\": 0.051511,\n        \"nauc_map_at_1_diff1\": 0.615717,\n        \"nauc_map_at_3_max\": 0.591045,\n        \"nauc_map_at_3_std\": 0.169109,\n        \"nauc_map_at_3_diff1\": 0.566227,\n        \"nauc_map_at_5_max\": 0.628691,\n        \"nauc_map_at_5_std\": 0.209505,\n        \"nauc_map_at_5_diff1\": 0.554182,\n        \"nauc_map_at_10_max\": 0.634033,\n        \"nauc_map_at_10_std\": 0.228864,\n        \"nauc_map_at_10_diff1\": 0.558702,\n        \"nauc_map_at_20_max\": 0.641918,\n        \"nauc_map_at_20_std\": 0.237956,\n        \"nauc_map_at_20_diff1\": 0.561968,\n        \"nauc_map_at_100_max\": 0.642257,\n        \"nauc_map_at_100_std\": 0.241074,\n        \"nauc_map_at_100_diff1\": 0.561667,\n        \"nauc_map_at_1000_max\": 0.642144,\n        \"nauc_map_at_1000_std\": 0.240601,\n        \"nauc_map_at_1000_diff1\": 0.561874,\n        \"nauc_recall_at_1_max\": 0.321776,\n        \"nauc_recall_at_1_std\": 0.051511,\n        \"nauc_recall_at_1_diff1\": 0.615717,\n        \"nauc_recall_at_3_max\": 0.61726,\n        \"nauc_recall_at_3_std\": 0.21254,\n        \"nauc_recall_at_3_diff1\": 0.513592,\n        \"nauc_recall_at_5_max\": 0.700999,\n        \"nauc_recall_at_5_std\": 0.30856,\n        \"nauc_recall_at_5_diff1\": 0.484074,\n        \"nauc_recall_at_10_max\": 0.736903,\n        \"nauc_recall_at_10_std\": 0.419002,\n        \"nauc_recall_at_10_diff1\": 0.498531,\n        \"nauc_recall_at_20_max\": 0.822719,\n        \"nauc_recall_at_20_std\": 0.540586,\n        \"nauc_recall_at_20_diff1\": 0.529592,\n        \"nauc_recall_at_100_max\": 0.862766,\n        \"nauc_recall_at_100_std\": 0.775853,\n        \"nauc_recall_at_100_diff1\": 0.482599,\n        \"nauc_recall_at_1000_max\": 0.918329,\n        \"nauc_recall_at_1000_std\": 0.846873,\n        \"nauc_recall_at_1000_diff1\": 0.480587,\n        \"nauc_precision_at_1_max\": 0.657745,\n        \"nauc_precision_at_1_std\": 0.24173,\n        \"nauc_precision_at_1_diff1\": 0.689846,\n        \"nauc_precision_at_3_max\": 0.482042,\n        \"nauc_precision_at_3_std\": 0.267328,\n        \"nauc_precision_at_3_diff1\": 0.057941,\n        \"nauc_precision_at_5_max\": 0.405916,\n        \"nauc_precision_at_5_std\": 0.275096,\n        \"nauc_precision_at_5_diff1\": -0.036951,\n        \"nauc_precision_at_10_max\": 0.33671,\n        \"nauc_precision_at_10_std\": 0.294959,\n        \"nauc_precision_at_10_diff1\": -0.091127,\n        \"nauc_precision_at_20_max\": 0.314331,\n        \"nauc_precision_at_20_std\": 0.316038,\n        \"nauc_precision_at_20_diff1\": -0.124284,\n        \"nauc_precision_at_100_max\": 0.23692,\n        \"nauc_precision_at_100_std\": 0.318947,\n        \"nauc_precision_at_100_diff1\": -0.191179,\n        \"nauc_precision_at_1000_max\": 0.107935,\n        \"nauc_precision_at_1000_std\": 0.212494,\n        \"nauc_precision_at_1000_diff1\": -0.265746,\n        \"nauc_mrr_at_1_max\": 0.657745,\n        \"nauc_mrr_at_1_std\": 0.24173,\n        \"nauc_mrr_at_1_diff1\": 0.689846,\n        \"nauc_mrr_at_3_max\": 0.729292,\n        \"nauc_mrr_at_3_std\": 0.334929,\n        \"nauc_mrr_at_3_diff1\": 0.661563,\n        \"nauc_mrr_at_5_max\": 0.731308,\n        \"nauc_mrr_at_5_std\": 0.337845,\n        \"nauc_mrr_at_5_diff1\": 0.661708,\n        \"nauc_mrr_at_10_max\": 0.731278,\n        \"nauc_mrr_at_10_std\": 0.339699,\n        \"nauc_mrr_at_10_diff1\": 0.663405,\n        \"nauc_mrr_at_20_max\": 0.73118,\n        \"nauc_mrr_at_20_std\": 0.340714,\n        \"nauc_mrr_at_20_diff1\": 0.664546,\n        \"nauc_mrr_at_100_max\": 0.730669,\n        \"nauc_mrr_at_100_std\": 0.340809,\n        \"nauc_mrr_at_100_diff1\": 0.664665,\n        \"nauc_mrr_at_1000_max\": 0.730492,\n        \"nauc_mrr_at_1000_std\": 0.340435,\n        \"nauc_mrr_at_1000_diff1\": 0.664655,\n        \"main_score\": 0.76325,\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 57.423654556274414,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nomic-ai/nomic-embed-text-v2-moe/no_model_name_available/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"task_name\": \"MIRACLRetrieval\",\n  \"mteb_version\": \"1.29.16\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"ndcg_at_1\": 0.61033,\n        \"ndcg_at_3\": 0.6176,\n        \"ndcg_at_5\": 0.6276,\n        \"ndcg_at_10\": 0.65913,\n        \"ndcg_at_20\": 0.69053,\n        \"ndcg_at_100\": 0.72143,\n        \"ndcg_at_1000\": 0.72654,\n        \"map_at_1\": 0.38197,\n        \"map_at_3\": 0.50465,\n        \"map_at_5\": 0.53735,\n        \"map_at_10\": 0.56822,\n        \"map_at_20\": 0.58548,\n        \"map_at_100\": 0.59466,\n        \"map_at_1000\": 0.59528,\n        \"recall_at_1\": 0.38197,\n        \"recall_at_3\": 0.58499,\n        \"recall_at_5\": 0.65526,\n        \"recall_at_10\": 0.75056,\n        \"recall_at_20\": 0.83774,\n        \"recall_at_100\": 0.95188,\n        \"recall_at_1000\": 0.97786,\n        \"precision_at_1\": 0.61033,\n        \"precision_at_3\": 0.36776,\n        \"precision_at_5\": 0.26854,\n        \"precision_at_10\": 0.16901,\n        \"precision_at_20\": 0.1,\n        \"precision_at_100\": 0.02423,\n        \"precision_at_1000\": 0.00252,\n        \"mrr_at_1\": 0.610329,\n        \"mrr_at_3\": 0.711268,\n        \"mrr_at_5\": 0.718545,\n        \"mrr_at_10\": 0.72552,\n        \"mrr_at_20\": 0.727103,\n        \"mrr_at_100\": 0.727978,\n        \"mrr_at_1000\": 0.727988,\n        \"nauc_ndcg_at_1_max\": 0.363021,\n        \"nauc_ndcg_at_1_std\": -0.042296,\n        \"nauc_ndcg_at_1_diff1\": 0.492822,\n        \"nauc_ndcg_at_3_max\": 0.358674,\n        \"nauc_ndcg_at_3_std\": -0.048445,\n        \"nauc_ndcg_at_3_diff1\": 0.480832,\n        \"nauc_ndcg_at_5_max\": 0.369315,\n        \"nauc_ndcg_at_5_std\": -0.019819,\n        \"nauc_ndcg_at_5_diff1\": 0.475952,\n        \"nauc_ndcg_at_10_max\": 0.398008,\n        \"nauc_ndcg_at_10_std\": -0.008035,\n        \"nauc_ndcg_at_10_diff1\": 0.487936,\n        \"nauc_ndcg_at_20_max\": 0.412476,\n        \"nauc_ndcg_at_20_std\": 0.024583,\n        \"nauc_ndcg_at_20_diff1\": 0.489312,\n        \"nauc_ndcg_at_100_max\": 0.412105,\n        \"nauc_ndcg_at_100_std\": 0.023433,\n        \"nauc_ndcg_at_100_diff1\": 0.49975,\n        \"nauc_ndcg_at_1000_max\": 0.413061,\n        \"nauc_ndcg_at_1000_std\": 0.023001,\n        \"nauc_ndcg_at_1000_diff1\": 0.497511,\n        \"nauc_map_at_1_max\": 0.214492,\n        \"nauc_map_at_1_std\": -0.122707,\n        \"nauc_map_at_1_diff1\": 0.520518,\n        \"nauc_map_at_3_max\": 0.296177,\n        \"nauc_map_at_3_std\": -0.090703,\n        \"nauc_map_at_3_diff1\": 0.47893,\n        \"nauc_map_at_5_max\": 0.321156,\n        \"nauc_map_at_5_std\": -0.053627,\n        \"nauc_map_at_5_diff1\": 0.470241,\n        \"nauc_map_at_10_max\": 0.354251,\n        \"nauc_map_at_10_std\": -0.043471,\n        \"nauc_map_at_10_diff1\": 0.487821,\n        \"nauc_map_at_20_max\": 0.364801,\n        \"nauc_map_at_20_std\": -0.029409,\n        \"nauc_map_at_20_diff1\": 0.489186,\n        \"nauc_map_at_100_max\": 0.366346,\n        \"nauc_map_at_100_std\": -0.028111,\n        \"nauc_map_at_100_diff1\": 0.491536,\n        \"nauc_map_at_1000_max\": 0.366562,\n        \"nauc_map_at_1000_std\": -0.028481,\n        \"nauc_map_at_1000_diff1\": 0.491601,\n        \"nauc_recall_at_1_max\": 0.214492,\n        \"nauc_recall_at_1_std\": -0.122707,\n        \"nauc_recall_at_1_diff1\": 0.520518,\n        \"nauc_recall_at_3_max\": 0.26531,\n        \"nauc_recall_at_3_std\": -0.068894,\n        \"nauc_recall_at_3_diff1\": 0.409745,\n        \"nauc_recall_at_5_max\": 0.297952,\n        \"nauc_recall_at_5_std\": 0.001566,\n        \"nauc_recall_at_5_diff1\": 0.370023,\n        \"nauc_recall_at_10_max\": 0.388384,\n        \"nauc_recall_at_10_std\": 0.0103,\n        \"nauc_recall_at_10_diff1\": 0.407716,\n        \"nauc_recall_at_20_max\": 0.440723,\n        \"nauc_recall_at_20_std\": 0.171722,\n        \"nauc_recall_at_20_diff1\": 0.378589,\n        \"nauc_recall_at_100_max\": 0.545394,\n        \"nauc_recall_at_100_std\": 0.322864,\n        \"nauc_recall_at_100_diff1\": 0.512669,\n        \"nauc_recall_at_1000_max\": 0.857152,\n        \"nauc_recall_at_1000_std\": 0.743431,\n        \"nauc_recall_at_1000_diff1\": 0.52794,\n        \"nauc_precision_at_1_max\": 0.363021,\n        \"nauc_precision_at_1_std\": -0.042296,\n        \"nauc_precision_at_1_diff1\": 0.492822,\n        \"nauc_precision_at_3_max\": 0.316402,\n        \"nauc_precision_at_3_std\": 0.113752,\n        \"nauc_precision_at_3_diff1\": 0.081769,\n        \"nauc_precision_at_5_max\": 0.267986,\n        \"nauc_precision_at_5_std\": 0.178829,\n        \"nauc_precision_at_5_diff1\": -0.004231,\n        \"nauc_precision_at_10_max\": 0.241916,\n        \"nauc_precision_at_10_std\": 0.180147,\n        \"nauc_precision_at_10_diff1\": -0.030231,\n        \"nauc_precision_at_20_max\": 0.173029,\n        \"nauc_precision_at_20_std\": 0.182248,\n        \"nauc_precision_at_20_diff1\": -0.082592,\n        \"nauc_precision_at_100_max\": 0.098192,\n        \"nauc_precision_at_100_std\": 0.14408,\n        \"nauc_precision_at_100_diff1\": -0.108657,\n        \"nauc_precision_at_1000_max\": 0.087758,\n        \"nauc_precision_at_1000_std\": 0.132117,\n        \"nauc_precision_at_1000_diff1\": -0.116775,\n        \"nauc_mrr_at_1_max\": 0.363021,\n        \"nauc_mrr_at_1_std\": -0.042296,\n        \"nauc_mrr_at_1_diff1\": 0.492822,\n        \"nauc_mrr_at_3_max\": 0.40441,\n        \"nauc_mrr_at_3_std\": 0.011383,\n        \"nauc_mrr_at_3_diff1\": 0.46785,\n        \"nauc_mrr_at_5_max\": 0.411774,\n        \"nauc_mrr_at_5_std\": 0.015938,\n        \"nauc_mrr_at_5_diff1\": 0.47189,\n        \"nauc_mrr_at_10_max\": 0.407763,\n        \"nauc_mrr_at_10_std\": 0.012721,\n        \"nauc_mrr_at_10_diff1\": 0.477408,\n        \"nauc_mrr_at_20_max\": 0.408228,\n        \"nauc_mrr_at_20_std\": 0.015341,\n        \"nauc_mrr_at_20_diff1\": 0.476169,\n        \"nauc_mrr_at_100_max\": 0.407503,\n        \"nauc_mrr_at_100_std\": 0.013473,\n        \"nauc_mrr_at_100_diff1\": 0.47738,\n        \"nauc_mrr_at_1000_max\": 0.407515,\n        \"nauc_mrr_at_1000_std\": 0.013498,\n        \"nauc_mrr_at_1000_diff1\": 0.477357,\n        \"main_score\": 0.65913,\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 5944.149179697037,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nomic-ai/nomic-embed-text-v2-moe/no_model_name_available/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"task_name\": \"MrTidyRetrieval\",\n  \"mteb_version\": \"1.29.16\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.41568,\n        \"ndcg_at_3\": 0.48461,\n        \"ndcg_at_5\": 0.51236,\n        \"ndcg_at_10\": 0.53766,\n        \"ndcg_at_20\": 0.55826,\n        \"ndcg_at_100\": 0.58428,\n        \"ndcg_at_1000\": 0.5934,\n        \"map_at_1\": 0.38717,\n        \"map_at_3\": 0.45691,\n        \"map_at_5\": 0.47439,\n        \"map_at_10\": 0.48529,\n        \"map_at_20\": 0.49112,\n        \"map_at_100\": 0.49529,\n        \"map_at_1000\": 0.49568,\n        \"recall_at_1\": 0.38717,\n        \"recall_at_3\": 0.53761,\n        \"recall_at_5\": 0.60016,\n        \"recall_at_10\": 0.67379,\n        \"recall_at_20\": 0.75218,\n        \"recall_at_100\": 0.88361,\n        \"recall_at_1000\": 0.95131,\n        \"precision_at_1\": 0.41568,\n        \"precision_at_3\": 0.19477,\n        \"precision_at_5\": 0.13302,\n        \"precision_at_10\": 0.07577,\n        \"precision_at_20\": 0.04276,\n        \"precision_at_100\": 0.01024,\n        \"precision_at_1000\": 0.00111,\n        \"mrr_at_1\": 0.415677,\n        \"mrr_at_3\": 0.485748,\n        \"mrr_at_5\": 0.498931,\n        \"mrr_at_10\": 0.509528,\n        \"mrr_at_20\": 0.514774,\n        \"mrr_at_100\": 0.517754,\n        \"mrr_at_1000\": 0.518063,\n        \"nauc_ndcg_at_1_max\": 0.36563,\n        \"nauc_ndcg_at_1_std\": 0.021405,\n        \"nauc_ndcg_at_1_diff1\": 0.545735,\n        \"nauc_ndcg_at_3_max\": 0.363778,\n        \"nauc_ndcg_at_3_std\": 0.075458,\n        \"nauc_ndcg_at_3_diff1\": 0.467389,\n        \"nauc_ndcg_at_5_max\": 0.35744,\n        \"nauc_ndcg_at_5_std\": 0.064434,\n        \"nauc_ndcg_at_5_diff1\": 0.46136,\n        \"nauc_ndcg_at_10_max\": 0.359559,\n        \"nauc_ndcg_at_10_std\": 0.069018,\n        \"nauc_ndcg_at_10_diff1\": 0.464143,\n        \"nauc_ndcg_at_20_max\": 0.352116,\n        \"nauc_ndcg_at_20_std\": 0.063247,\n        \"nauc_ndcg_at_20_diff1\": 0.457219,\n        \"nauc_ndcg_at_100_max\": 0.364589,\n        \"nauc_ndcg_at_100_std\": 0.066101,\n        \"nauc_ndcg_at_100_diff1\": 0.465926,\n        \"nauc_ndcg_at_1000_max\": 0.366221,\n        \"nauc_ndcg_at_1000_std\": 0.065985,\n        \"nauc_ndcg_at_1000_diff1\": 0.465447,\n        \"nauc_map_at_1_max\": 0.341404,\n        \"nauc_map_at_1_std\": 0.003898,\n        \"nauc_map_at_1_diff1\": 0.528226,\n        \"nauc_map_at_3_max\": 0.354432,\n        \"nauc_map_at_3_std\": 0.055171,\n        \"nauc_map_at_3_diff1\": 0.477927,\n        \"nauc_map_at_5_max\": 0.351993,\n        \"nauc_map_at_5_std\": 0.049569,\n        \"nauc_map_at_5_diff1\": 0.476226,\n        \"nauc_map_at_10_max\": 0.352941,\n        \"nauc_map_at_10_std\": 0.050982,\n        \"nauc_map_at_10_diff1\": 0.477124,\n        \"nauc_map_at_20_max\": 0.35123,\n        \"nauc_map_at_20_std\": 0.050284,\n        \"nauc_map_at_20_diff1\": 0.475396,\n        \"nauc_map_at_100_max\": 0.353237,\n        \"nauc_map_at_100_std\": 0.050806,\n        \"nauc_map_at_100_diff1\": 0.477174,\n        \"nauc_map_at_1000_max\": 0.353336,\n        \"nauc_map_at_1000_std\": 0.050726,\n        \"nauc_map_at_1000_diff1\": 0.47718,\n        \"nauc_recall_at_1_max\": 0.341404,\n        \"nauc_recall_at_1_std\": 0.003898,\n        \"nauc_recall_at_1_diff1\": 0.528226,\n        \"nauc_recall_at_3_max\": 0.361431,\n        \"nauc_recall_at_3_std\": 0.121148,\n        \"nauc_recall_at_3_diff1\": 0.410598,\n        \"nauc_recall_at_5_max\": 0.346582,\n        \"nauc_recall_at_5_std\": 0.098528,\n        \"nauc_recall_at_5_diff1\": 0.396035,\n        \"nauc_recall_at_10_max\": 0.347597,\n        \"nauc_recall_at_10_std\": 0.116493,\n        \"nauc_recall_at_10_diff1\": 0.393829,\n        \"nauc_recall_at_20_max\": 0.307695,\n        \"nauc_recall_at_20_std\": 0.089611,\n        \"nauc_recall_at_20_diff1\": 0.348414,\n        \"nauc_recall_at_100_max\": 0.438337,\n        \"nauc_recall_at_100_std\": 0.154177,\n        \"nauc_recall_at_100_diff1\": 0.372848,\n        \"nauc_recall_at_1000_max\": 0.618793,\n        \"nauc_recall_at_1000_std\": 0.310567,\n        \"nauc_recall_at_1000_diff1\": 0.254789,\n        \"nauc_precision_at_1_max\": 0.36563,\n        \"nauc_precision_at_1_std\": 0.021405,\n        \"nauc_precision_at_1_diff1\": 0.545735,\n        \"nauc_precision_at_3_max\": 0.368948,\n        \"nauc_precision_at_3_std\": 0.13057,\n        \"nauc_precision_at_3_diff1\": 0.392224,\n        \"nauc_precision_at_5_max\": 0.316819,\n        \"nauc_precision_at_5_std\": 0.093421,\n        \"nauc_precision_at_5_diff1\": 0.326096,\n        \"nauc_precision_at_10_max\": 0.292185,\n        \"nauc_precision_at_10_std\": 0.111568,\n        \"nauc_precision_at_10_diff1\": 0.280641,\n        \"nauc_precision_at_20_max\": 0.210837,\n        \"nauc_precision_at_20_std\": 0.077051,\n        \"nauc_precision_at_20_diff1\": 0.177257,\n        \"nauc_precision_at_100_max\": 0.142966,\n        \"nauc_precision_at_100_std\": 0.079245,\n        \"nauc_precision_at_100_diff1\": 0.034753,\n        \"nauc_precision_at_1000_max\": 0.069815,\n        \"nauc_precision_at_1000_std\": 0.064027,\n        \"nauc_precision_at_1000_diff1\": -0.110983,\n        \"nauc_mrr_at_1_max\": 0.36563,\n        \"nauc_mrr_at_1_std\": 0.021405,\n        \"nauc_mrr_at_1_diff1\": 0.545735,\n        \"nauc_mrr_at_3_max\": 0.377567,\n        \"nauc_mrr_at_3_std\": 0.069935,\n        \"nauc_mrr_at_3_diff1\": 0.494994,\n        \"nauc_mrr_at_5_max\": 0.372936,\n        \"nauc_mrr_at_5_std\": 0.06194,\n        \"nauc_mrr_at_5_diff1\": 0.489104,\n        \"nauc_mrr_at_10_max\": 0.37477,\n        \"nauc_mrr_at_10_std\": 0.064485,\n        \"nauc_mrr_at_10_diff1\": 0.492345,\n        \"nauc_mrr_at_20_max\": 0.372642,\n        \"nauc_mrr_at_20_std\": 0.063059,\n        \"nauc_mrr_at_20_diff1\": 0.490381,\n        \"nauc_mrr_at_100_max\": 0.373562,\n        \"nauc_mrr_at_100_std\": 0.062576,\n        \"nauc_mrr_at_100_diff1\": 0.491209,\n        \"nauc_mrr_at_1000_max\": 0.373513,\n        \"nauc_mrr_at_1000_std\": 0.06247,\n        \"nauc_mrr_at_1000_diff1\": 0.49126,\n        \"main_score\": 0.53766,\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 5873.947786092758,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nomic-ai/nomic-embed-text-v2-moe/no_model_name_available/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"task_name\": \"MultiLongDocRetrieval\",\n  \"mteb_version\": \"1.29.16\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"ndcg_at_1\": 0.185,\n        \"ndcg_at_3\": 0.24601,\n        \"ndcg_at_5\": 0.26021,\n        \"ndcg_at_10\": 0.27135,\n        \"ndcg_at_20\": 0.28472,\n        \"ndcg_at_100\": 0.31724,\n        \"ndcg_at_1000\": 0.34325,\n        \"map_at_1\": 0.185,\n        \"map_at_3\": 0.23083,\n        \"map_at_5\": 0.23858,\n        \"map_at_10\": 0.24308,\n        \"map_at_20\": 0.24646,\n        \"map_at_100\": 0.25034,\n        \"map_at_1000\": 0.25104,\n        \"recall_at_1\": 0.185,\n        \"recall_at_3\": 0.29,\n        \"recall_at_5\": 0.325,\n        \"recall_at_10\": 0.36,\n        \"recall_at_20\": 0.415,\n        \"recall_at_100\": 0.6,\n        \"recall_at_1000\": 0.82,\n        \"precision_at_1\": 0.185,\n        \"precision_at_3\": 0.09667,\n        \"precision_at_5\": 0.065,\n        \"precision_at_10\": 0.036,\n        \"precision_at_20\": 0.02075,\n        \"precision_at_100\": 0.006,\n        \"precision_at_1000\": 0.00082,\n        \"mrr_at_1\": 0.185,\n        \"mrr_at_3\": 0.230833,\n        \"mrr_at_5\": 0.238583,\n        \"mrr_at_10\": 0.243081,\n        \"mrr_at_20\": 0.246464,\n        \"mrr_at_100\": 0.250338,\n        \"mrr_at_1000\": 0.251036,\n        \"nauc_ndcg_at_1_max\": 0.527168,\n        \"nauc_ndcg_at_1_std\": 0.014784,\n        \"nauc_ndcg_at_1_diff1\": 0.559594,\n        \"nauc_ndcg_at_3_max\": 0.48434,\n        \"nauc_ndcg_at_3_std\": 0.091035,\n        \"nauc_ndcg_at_3_diff1\": 0.472706,\n        \"nauc_ndcg_at_5_max\": 0.449814,\n        \"nauc_ndcg_at_5_std\": 0.076969,\n        \"nauc_ndcg_at_5_diff1\": 0.443832,\n        \"nauc_ndcg_at_10_max\": 0.447785,\n        \"nauc_ndcg_at_10_std\": 0.08679,\n        \"nauc_ndcg_at_10_diff1\": 0.44382,\n        \"nauc_ndcg_at_20_max\": 0.448409,\n        \"nauc_ndcg_at_20_std\": 0.091679,\n        \"nauc_ndcg_at_20_diff1\": 0.440796,\n        \"nauc_ndcg_at_100_max\": 0.462103,\n        \"nauc_ndcg_at_100_std\": 0.121956,\n        \"nauc_ndcg_at_100_diff1\": 0.44629,\n        \"nauc_ndcg_at_1000_max\": 0.462386,\n        \"nauc_ndcg_at_1000_std\": 0.118884,\n        \"nauc_ndcg_at_1000_diff1\": 0.443739,\n        \"nauc_map_at_1_max\": 0.527168,\n        \"nauc_map_at_1_std\": 0.014784,\n        \"nauc_map_at_1_diff1\": 0.559594,\n        \"nauc_map_at_3_max\": 0.493459,\n        \"nauc_map_at_3_std\": 0.071993,\n        \"nauc_map_at_3_diff1\": 0.491309,\n        \"nauc_map_at_5_max\": 0.473685,\n        \"nauc_map_at_5_std\": 0.063892,\n        \"nauc_map_at_5_diff1\": 0.475104,\n        \"nauc_map_at_10_max\": 0.47256,\n        \"nauc_map_at_10_std\": 0.067593,\n        \"nauc_map_at_10_diff1\": 0.474762,\n        \"nauc_map_at_20_max\": 0.472079,\n        \"nauc_map_at_20_std\": 0.06829,\n        \"nauc_map_at_20_diff1\": 0.473401,\n        \"nauc_map_at_100_max\": 0.473787,\n        \"nauc_map_at_100_std\": 0.07125,\n        \"nauc_map_at_100_diff1\": 0.473491,\n        \"nauc_map_at_1000_max\": 0.473862,\n        \"nauc_map_at_1000_std\": 0.071282,\n        \"nauc_map_at_1000_diff1\": 0.473528,\n        \"nauc_recall_at_1_max\": 0.527168,\n        \"nauc_recall_at_1_std\": 0.014784,\n        \"nauc_recall_at_1_diff1\": 0.559594,\n        \"nauc_recall_at_3_max\": 0.461011,\n        \"nauc_recall_at_3_std\": 0.140798,\n        \"nauc_recall_at_3_diff1\": 0.425079,\n        \"nauc_recall_at_5_max\": 0.385312,\n        \"nauc_recall_at_5_std\": 0.109065,\n        \"nauc_recall_at_5_diff1\": 0.361069,\n        \"nauc_recall_at_10_max\": 0.38162,\n        \"nauc_recall_at_10_std\": 0.138134,\n        \"nauc_recall_at_10_diff1\": 0.363486,\n        \"nauc_recall_at_20_max\": 0.389019,\n        \"nauc_recall_at_20_std\": 0.159428,\n        \"nauc_recall_at_20_diff1\": 0.357227,\n        \"nauc_recall_at_100_max\": 0.45797,\n        \"nauc_recall_at_100_std\": 0.349295,\n        \"nauc_recall_at_100_diff1\": 0.384298,\n        \"nauc_recall_at_1000_max\": 0.455144,\n        \"nauc_recall_at_1000_std\": 0.481083,\n        \"nauc_recall_at_1000_diff1\": 0.291524,\n        \"nauc_precision_at_1_max\": 0.527168,\n        \"nauc_precision_at_1_std\": 0.014784,\n        \"nauc_precision_at_1_diff1\": 0.559594,\n        \"nauc_precision_at_3_max\": 0.461011,\n        \"nauc_precision_at_3_std\": 0.140798,\n        \"nauc_precision_at_3_diff1\": 0.425079,\n        \"nauc_precision_at_5_max\": 0.385312,\n        \"nauc_precision_at_5_std\": 0.109065,\n        \"nauc_precision_at_5_diff1\": 0.361069,\n        \"nauc_precision_at_10_max\": 0.38162,\n        \"nauc_precision_at_10_std\": 0.138134,\n        \"nauc_precision_at_10_diff1\": 0.363486,\n        \"nauc_precision_at_20_max\": 0.389019,\n        \"nauc_precision_at_20_std\": 0.159428,\n        \"nauc_precision_at_20_diff1\": 0.357227,\n        \"nauc_precision_at_100_max\": 0.45797,\n        \"nauc_precision_at_100_std\": 0.349295,\n        \"nauc_precision_at_100_diff1\": 0.384298,\n        \"nauc_precision_at_1000_max\": 0.455144,\n        \"nauc_precision_at_1000_std\": 0.481083,\n        \"nauc_precision_at_1000_diff1\": 0.291524,\n        \"nauc_mrr_at_1_max\": 0.527168,\n        \"nauc_mrr_at_1_std\": 0.014784,\n        \"nauc_mrr_at_1_diff1\": 0.559594,\n        \"nauc_mrr_at_3_max\": 0.493459,\n        \"nauc_mrr_at_3_std\": 0.071993,\n        \"nauc_mrr_at_3_diff1\": 0.491309,\n        \"nauc_mrr_at_5_max\": 0.473685,\n        \"nauc_mrr_at_5_std\": 0.063892,\n        \"nauc_mrr_at_5_diff1\": 0.475104,\n        \"nauc_mrr_at_10_max\": 0.47256,\n        \"nauc_mrr_at_10_std\": 0.067593,\n        \"nauc_mrr_at_10_diff1\": 0.474762,\n        \"nauc_mrr_at_20_max\": 0.472079,\n        \"nauc_mrr_at_20_std\": 0.06829,\n        \"nauc_mrr_at_20_diff1\": 0.473401,\n        \"nauc_mrr_at_100_max\": 0.473787,\n        \"nauc_mrr_at_100_std\": 0.07125,\n        \"nauc_mrr_at_100_diff1\": 0.473491,\n        \"nauc_mrr_at_1000_max\": 0.473862,\n        \"nauc_mrr_at_1000_std\": 0.071282,\n        \"nauc_mrr_at_1000_diff1\": 0.473528,\n        \"main_score\": 0.27135,\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ],\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.215,\n        \"ndcg_at_3\": 0.24327,\n        \"ndcg_at_5\": 0.25813,\n        \"ndcg_at_10\": 0.27145,\n        \"ndcg_at_20\": 0.2863,\n        \"ndcg_at_100\": 0.31275,\n        \"ndcg_at_1000\": 0.34383,\n        \"map_at_1\": 0.215,\n        \"map_at_3\": 0.23583,\n        \"map_at_5\": 0.24433,\n        \"map_at_10\": 0.25006,\n        \"map_at_20\": 0.25398,\n        \"map_at_100\": 0.25714,\n        \"map_at_1000\": 0.25812,\n        \"recall_at_1\": 0.215,\n        \"recall_at_3\": 0.265,\n        \"recall_at_5\": 0.3,\n        \"recall_at_10\": 0.34,\n        \"recall_at_20\": 0.4,\n        \"recall_at_100\": 0.55,\n        \"recall_at_1000\": 0.805,\n        \"precision_at_1\": 0.215,\n        \"precision_at_3\": 0.08833,\n        \"precision_at_5\": 0.06,\n        \"precision_at_10\": 0.034,\n        \"precision_at_20\": 0.02,\n        \"precision_at_100\": 0.0055,\n        \"precision_at_1000\": 0.00081,\n        \"mrr_at_1\": 0.215,\n        \"mrr_at_3\": 0.235833,\n        \"mrr_at_5\": 0.244333,\n        \"mrr_at_10\": 0.250062,\n        \"mrr_at_20\": 0.253979,\n        \"mrr_at_100\": 0.257143,\n        \"mrr_at_1000\": 0.258122,\n        \"nauc_ndcg_at_1_max\": 0.549596,\n        \"nauc_ndcg_at_1_std\": -0.036517,\n        \"nauc_ndcg_at_1_diff1\": 0.62056,\n        \"nauc_ndcg_at_3_max\": 0.549458,\n        \"nauc_ndcg_at_3_std\": -0.004973,\n        \"nauc_ndcg_at_3_diff1\": 0.606656,\n        \"nauc_ndcg_at_5_max\": 0.523696,\n        \"nauc_ndcg_at_5_std\": 0.009265,\n        \"nauc_ndcg_at_5_diff1\": 0.585378,\n        \"nauc_ndcg_at_10_max\": 0.517249,\n        \"nauc_ndcg_at_10_std\": 0.020401,\n        \"nauc_ndcg_at_10_diff1\": 0.572666,\n        \"nauc_ndcg_at_20_max\": 0.501538,\n        \"nauc_ndcg_at_20_std\": 0.021863,\n        \"nauc_ndcg_at_20_diff1\": 0.547941,\n        \"nauc_ndcg_at_100_max\": 0.50442,\n        \"nauc_ndcg_at_100_std\": 0.035896,\n        \"nauc_ndcg_at_100_diff1\": 0.54428,\n        \"nauc_ndcg_at_1000_max\": 0.516494,\n        \"nauc_ndcg_at_1000_std\": 0.056268,\n        \"nauc_ndcg_at_1000_diff1\": 0.54551,\n        \"nauc_map_at_1_max\": 0.549596,\n        \"nauc_map_at_1_std\": -0.036517,\n        \"nauc_map_at_1_diff1\": 0.62056,\n        \"nauc_map_at_3_max\": 0.549431,\n        \"nauc_map_at_3_std\": -0.012275,\n        \"nauc_map_at_3_diff1\": 0.610549,\n        \"nauc_map_at_5_max\": 0.534007,\n        \"nauc_map_at_5_std\": -0.004376,\n        \"nauc_map_at_5_diff1\": 0.598306,\n        \"nauc_map_at_10_max\": 0.530521,\n        \"nauc_map_at_10_std\": -0.001206,\n        \"nauc_map_at_10_diff1\": 0.592643,\n        \"nauc_map_at_20_max\": 0.525733,\n        \"nauc_map_at_20_std\": -0.000354,\n        \"nauc_map_at_20_diff1\": 0.585909,\n        \"nauc_map_at_100_max\": 0.525779,\n        \"nauc_map_at_100_std\": 0.001575,\n        \"nauc_map_at_100_diff1\": 0.584504,\n        \"nauc_map_at_1000_max\": 0.526529,\n        \"nauc_map_at_1000_std\": 0.002524,\n        \"nauc_map_at_1000_diff1\": 0.584661,\n        \"nauc_recall_at_1_max\": 0.549596,\n        \"nauc_recall_at_1_std\": -0.036517,\n        \"nauc_recall_at_1_diff1\": 0.62056,\n        \"nauc_recall_at_3_max\": 0.549555,\n        \"nauc_recall_at_3_std\": 0.015032,\n        \"nauc_recall_at_3_diff1\": 0.595725,\n        \"nauc_recall_at_5_max\": 0.49419,\n        \"nauc_recall_at_5_std\": 0.047257,\n        \"nauc_recall_at_5_diff1\": 0.548534,\n        \"nauc_recall_at_10_max\": 0.47967,\n        \"nauc_recall_at_10_std\": 0.085714,\n        \"nauc_recall_at_10_diff1\": 0.513991,\n        \"nauc_recall_at_20_max\": 0.426757,\n        \"nauc_recall_at_20_std\": 0.086657,\n        \"nauc_recall_at_20_diff1\": 0.42529,\n        \"nauc_recall_at_100_max\": 0.441129,\n        \"nauc_recall_at_100_std\": 0.16625,\n        \"nauc_recall_at_100_diff1\": 0.410012,\n        \"nauc_recall_at_1000_max\": 0.517694,\n        \"nauc_recall_at_1000_std\": 0.512887,\n        \"nauc_recall_at_1000_diff1\": 0.314148,\n        \"nauc_precision_at_1_max\": 0.549596,\n        \"nauc_precision_at_1_std\": -0.036517,\n        \"nauc_precision_at_1_diff1\": 0.62056,\n        \"nauc_precision_at_3_max\": 0.549555,\n        \"nauc_precision_at_3_std\": 0.015032,\n        \"nauc_precision_at_3_diff1\": 0.595725,\n        \"nauc_precision_at_5_max\": 0.49419,\n        \"nauc_precision_at_5_std\": 0.047257,\n        \"nauc_precision_at_5_diff1\": 0.548534,\n        \"nauc_precision_at_10_max\": 0.47967,\n        \"nauc_precision_at_10_std\": 0.085714,\n        \"nauc_precision_at_10_diff1\": 0.513991,\n        \"nauc_precision_at_20_max\": 0.426757,\n        \"nauc_precision_at_20_std\": 0.086657,\n        \"nauc_precision_at_20_diff1\": 0.42529,\n        \"nauc_precision_at_100_max\": 0.441129,\n        \"nauc_precision_at_100_std\": 0.16625,\n        \"nauc_precision_at_100_diff1\": 0.410012,\n        \"nauc_precision_at_1000_max\": 0.517694,\n        \"nauc_precision_at_1000_std\": 0.512887,\n        \"nauc_precision_at_1000_diff1\": 0.314148,\n        \"nauc_mrr_at_1_max\": 0.549596,\n        \"nauc_mrr_at_1_std\": -0.036517,\n        \"nauc_mrr_at_1_diff1\": 0.62056,\n        \"nauc_mrr_at_3_max\": 0.549431,\n        \"nauc_mrr_at_3_std\": -0.012275,\n        \"nauc_mrr_at_3_diff1\": 0.610549,\n        \"nauc_mrr_at_5_max\": 0.534007,\n        \"nauc_mrr_at_5_std\": -0.004376,\n        \"nauc_mrr_at_5_diff1\": 0.598306,\n        \"nauc_mrr_at_10_max\": 0.530521,\n        \"nauc_mrr_at_10_std\": -0.001206,\n        \"nauc_mrr_at_10_diff1\": 0.592643,\n        \"nauc_mrr_at_20_max\": 0.525733,\n        \"nauc_mrr_at_20_std\": -0.000354,\n        \"nauc_mrr_at_20_diff1\": 0.585909,\n        \"nauc_mrr_at_100_max\": 0.525779,\n        \"nauc_mrr_at_100_std\": 0.001575,\n        \"nauc_mrr_at_100_diff1\": 0.584504,\n        \"nauc_mrr_at_1000_max\": 0.526529,\n        \"nauc_mrr_at_1000_std\": 0.002524,\n        \"nauc_mrr_at_1000_diff1\": 0.584661,\n        \"main_score\": 0.27145,\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 220.92831134796143,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nomic-ai/nomic-embed-text-v2-moe/no_model_name_available/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"task_name\": \"PublicHealthQA\",\n  \"mteb_version\": \"1.29.16\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.62338,\n        \"ndcg_at_3\": 0.74629,\n        \"ndcg_at_5\": 0.76752,\n        \"ndcg_at_10\": 0.78448,\n        \"ndcg_at_20\": 0.79802,\n        \"ndcg_at_100\": 0.80336,\n        \"ndcg_at_1000\": 0.80336,\n        \"map_at_1\": 0.62338,\n        \"map_at_3\": 0.72078,\n        \"map_at_5\": 0.73247,\n        \"map_at_10\": 0.73955,\n        \"map_at_20\": 0.74349,\n        \"map_at_100\": 0.74443,\n        \"map_at_1000\": 0.74443,\n        \"recall_at_1\": 0.62338,\n        \"recall_at_3\": 0.81818,\n        \"recall_at_5\": 0.87013,\n        \"recall_at_10\": 0.92208,\n        \"recall_at_20\": 0.97403,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.62338,\n        \"precision_at_3\": 0.27273,\n        \"precision_at_5\": 0.17403,\n        \"precision_at_10\": 0.09221,\n        \"precision_at_20\": 0.0487,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"mrr_at_1\": 0.623377,\n        \"mrr_at_3\": 0.720779,\n        \"mrr_at_5\": 0.732468,\n        \"mrr_at_10\": 0.739554,\n        \"mrr_at_20\": 0.743491,\n        \"mrr_at_100\": 0.744426,\n        \"mrr_at_1000\": 0.744426,\n        \"nauc_ndcg_at_1_max\": 0.320914,\n        \"nauc_ndcg_at_1_std\": 0.06798,\n        \"nauc_ndcg_at_1_diff1\": 0.545833,\n        \"nauc_ndcg_at_3_max\": 0.304722,\n        \"nauc_ndcg_at_3_std\": 0.1048,\n        \"nauc_ndcg_at_3_diff1\": 0.504437,\n        \"nauc_ndcg_at_5_max\": 0.28857,\n        \"nauc_ndcg_at_5_std\": 0.063545,\n        \"nauc_ndcg_at_5_diff1\": 0.51012,\n        \"nauc_ndcg_at_10_max\": 0.296526,\n        \"nauc_ndcg_at_10_std\": 0.114659,\n        \"nauc_ndcg_at_10_diff1\": 0.483728,\n        \"nauc_ndcg_at_20_max\": 0.317526,\n        \"nauc_ndcg_at_20_std\": 0.112382,\n        \"nauc_ndcg_at_20_diff1\": 0.515798,\n        \"nauc_ndcg_at_100_max\": 0.306529,\n        \"nauc_ndcg_at_100_std\": 0.094793,\n        \"nauc_ndcg_at_100_diff1\": 0.513444,\n        \"nauc_ndcg_at_1000_max\": 0.306529,\n        \"nauc_ndcg_at_1000_std\": 0.094793,\n        \"nauc_ndcg_at_1000_diff1\": 0.513444,\n        \"nauc_map_at_1_max\": 0.320914,\n        \"nauc_map_at_1_std\": 0.06798,\n        \"nauc_map_at_1_diff1\": 0.545833,\n        \"nauc_map_at_3_max\": 0.309003,\n        \"nauc_map_at_3_std\": 0.095065,\n        \"nauc_map_at_3_diff1\": 0.515382,\n        \"nauc_map_at_5_max\": 0.301849,\n        \"nauc_map_at_5_std\": 0.074899,\n        \"nauc_map_at_5_diff1\": 0.518527,\n        \"nauc_map_at_10_max\": 0.305767,\n        \"nauc_map_at_10_std\": 0.094267,\n        \"nauc_map_at_10_diff1\": 0.50991,\n        \"nauc_map_at_20_max\": 0.309326,\n        \"nauc_map_at_20_std\": 0.09249,\n        \"nauc_map_at_20_diff1\": 0.518194,\n        \"nauc_map_at_100_max\": 0.308006,\n        \"nauc_map_at_100_std\": 0.090224,\n        \"nauc_map_at_100_diff1\": 0.517606,\n        \"nauc_map_at_1000_max\": 0.308006,\n        \"nauc_map_at_1000_std\": 0.090224,\n        \"nauc_map_at_1000_diff1\": 0.517606,\n        \"nauc_recall_at_1_max\": 0.320914,\n        \"nauc_recall_at_1_std\": 0.06798,\n        \"nauc_recall_at_1_diff1\": 0.545833,\n        \"nauc_recall_at_3_max\": 0.288097,\n        \"nauc_recall_at_3_std\": 0.142604,\n        \"nauc_recall_at_3_diff1\": 0.461934,\n        \"nauc_recall_at_5_max\": 0.215277,\n        \"nauc_recall_at_5_std\": -0.00758,\n        \"nauc_recall_at_5_diff1\": 0.469782,\n        \"nauc_recall_at_10_max\": 0.217403,\n        \"nauc_recall_at_10_std\": 0.304819,\n        \"nauc_recall_at_10_diff1\": 0.246522,\n        \"nauc_recall_at_20_max\": 0.678958,\n        \"nauc_recall_at_20_std\": 0.678958,\n        \"nauc_recall_at_20_diff1\": 0.562819,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.320914,\n        \"nauc_precision_at_1_std\": 0.06798,\n        \"nauc_precision_at_1_diff1\": 0.545833,\n        \"nauc_precision_at_3_max\": 0.288097,\n        \"nauc_precision_at_3_std\": 0.142604,\n        \"nauc_precision_at_3_diff1\": 0.461934,\n        \"nauc_precision_at_5_max\": 0.215277,\n        \"nauc_precision_at_5_std\": -0.00758,\n        \"nauc_precision_at_5_diff1\": 0.469782,\n        \"nauc_precision_at_10_max\": 0.217403,\n        \"nauc_precision_at_10_std\": 0.304819,\n        \"nauc_precision_at_10_diff1\": 0.246522,\n        \"nauc_precision_at_20_max\": 0.678958,\n        \"nauc_precision_at_20_std\": 0.678958,\n        \"nauc_precision_at_20_diff1\": 0.562819,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_mrr_at_1_max\": 0.320914,\n        \"nauc_mrr_at_1_std\": 0.06798,\n        \"nauc_mrr_at_1_diff1\": 0.545833,\n        \"nauc_mrr_at_3_max\": 0.309003,\n        \"nauc_mrr_at_3_std\": 0.095065,\n        \"nauc_mrr_at_3_diff1\": 0.515382,\n        \"nauc_mrr_at_5_max\": 0.301849,\n        \"nauc_mrr_at_5_std\": 0.074899,\n        \"nauc_mrr_at_5_diff1\": 0.518527,\n        \"nauc_mrr_at_10_max\": 0.305767,\n        \"nauc_mrr_at_10_std\": 0.094267,\n        \"nauc_mrr_at_10_diff1\": 0.50991,\n        \"nauc_mrr_at_20_max\": 0.309326,\n        \"nauc_mrr_at_20_std\": 0.09249,\n        \"nauc_mrr_at_20_diff1\": 0.518194,\n        \"nauc_mrr_at_100_max\": 0.308006,\n        \"nauc_mrr_at_100_std\": 0.090224,\n        \"nauc_mrr_at_100_diff1\": 0.517606,\n        \"nauc_mrr_at_1000_max\": 0.308006,\n        \"nauc_mrr_at_1000_std\": 0.090224,\n        \"nauc_mrr_at_1000_diff1\": 0.517606,\n        \"main_score\": 0.78448,\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 1.3850245475769043,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nomic-ai/nomic-embed-text-v2-moe/no_model_name_available/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"task_name\": \"XPQARetrieval\",\n  \"mteb_version\": \"1.29.16\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"ndcg_at_1\": 0.30581,\n        \"ndcg_at_3\": 0.32337,\n        \"ndcg_at_5\": 0.34775,\n        \"ndcg_at_10\": 0.36871,\n        \"ndcg_at_20\": 0.39062,\n        \"ndcg_at_100\": 0.43898,\n        \"ndcg_at_1000\": 0.47042,\n        \"map_at_1\": 0.21654,\n        \"map_at_3\": 0.2965,\n        \"map_at_5\": 0.31775,\n        \"map_at_10\": 0.3276,\n        \"map_at_20\": 0.33433,\n        \"map_at_100\": 0.34197,\n        \"map_at_1000\": 0.34329,\n        \"recall_at_1\": 0.21654,\n        \"recall_at_3\": 0.33871,\n        \"recall_at_5\": 0.39748,\n        \"recall_at_10\": 0.45464,\n        \"recall_at_20\": 0.53305,\n        \"recall_at_100\": 0.76542,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.30581,\n        \"precision_at_3\": 0.18094,\n        \"precision_at_5\": 0.12936,\n        \"precision_at_10\": 0.07446,\n        \"precision_at_20\": 0.0432,\n        \"precision_at_100\": 0.01252,\n        \"precision_at_1000\": 0.00156,\n        \"mrr_at_1\": 0.30581,\n        \"mrr_at_3\": 0.344801,\n        \"mrr_at_5\": 0.355275,\n        \"mrr_at_10\": 0.363192,\n        \"mrr_at_20\": 0.368504,\n        \"mrr_at_100\": 0.373922,\n        \"mrr_at_1000\": 0.374789,\n        \"nauc_ndcg_at_1_max\": 0.311288,\n        \"nauc_ndcg_at_1_std\": -0.283077,\n        \"nauc_ndcg_at_1_diff1\": 0.505347,\n        \"nauc_ndcg_at_3_max\": 0.31655,\n        \"nauc_ndcg_at_3_std\": -0.270178,\n        \"nauc_ndcg_at_3_diff1\": 0.453532,\n        \"nauc_ndcg_at_5_max\": 0.305679,\n        \"nauc_ndcg_at_5_std\": -0.275801,\n        \"nauc_ndcg_at_5_diff1\": 0.436661,\n        \"nauc_ndcg_at_10_max\": 0.3056,\n        \"nauc_ndcg_at_10_std\": -0.270147,\n        \"nauc_ndcg_at_10_diff1\": 0.435218,\n        \"nauc_ndcg_at_20_max\": 0.306377,\n        \"nauc_ndcg_at_20_std\": -0.255502,\n        \"nauc_ndcg_at_20_diff1\": 0.426827,\n        \"nauc_ndcg_at_100_max\": 0.316141,\n        \"nauc_ndcg_at_100_std\": -0.224757,\n        \"nauc_ndcg_at_100_diff1\": 0.414833,\n        \"nauc_ndcg_at_1000_max\": 0.313036,\n        \"nauc_ndcg_at_1000_std\": -0.246118,\n        \"nauc_ndcg_at_1000_diff1\": 0.43138,\n        \"nauc_map_at_1_max\": 0.235078,\n        \"nauc_map_at_1_std\": -0.271015,\n        \"nauc_map_at_1_diff1\": 0.532184,\n        \"nauc_map_at_3_max\": 0.311095,\n        \"nauc_map_at_3_std\": -0.269109,\n        \"nauc_map_at_3_diff1\": 0.457754,\n        \"nauc_map_at_5_max\": 0.303814,\n        \"nauc_map_at_5_std\": -0.277169,\n        \"nauc_map_at_5_diff1\": 0.435833,\n        \"nauc_map_at_10_max\": 0.304025,\n        \"nauc_map_at_10_std\": -0.275743,\n        \"nauc_map_at_10_diff1\": 0.436994,\n        \"nauc_map_at_20_max\": 0.304141,\n        \"nauc_map_at_20_std\": -0.271632,\n        \"nauc_map_at_20_diff1\": 0.433932,\n        \"nauc_map_at_100_max\": 0.305175,\n        \"nauc_map_at_100_std\": -0.266555,\n        \"nauc_map_at_100_diff1\": 0.432242,\n        \"nauc_map_at_1000_max\": 0.3051,\n        \"nauc_map_at_1000_std\": -0.267058,\n        \"nauc_map_at_1000_diff1\": 0.432696,\n        \"nauc_recall_at_1_max\": 0.235078,\n        \"nauc_recall_at_1_std\": -0.271015,\n        \"nauc_recall_at_1_diff1\": 0.532184,\n        \"nauc_recall_at_3_max\": 0.313823,\n        \"nauc_recall_at_3_std\": -0.249996,\n        \"nauc_recall_at_3_diff1\": 0.427477,\n        \"nauc_recall_at_5_max\": 0.28534,\n        \"nauc_recall_at_5_std\": -0.268175,\n        \"nauc_recall_at_5_diff1\": 0.388201,\n        \"nauc_recall_at_10_max\": 0.286909,\n        \"nauc_recall_at_10_std\": -0.248995,\n        \"nauc_recall_at_10_diff1\": 0.379877,\n        \"nauc_recall_at_20_max\": 0.286162,\n        \"nauc_recall_at_20_std\": -0.189555,\n        \"nauc_recall_at_20_diff1\": 0.34246,\n        \"nauc_recall_at_100_max\": 0.345446,\n        \"nauc_recall_at_100_std\": 0.039232,\n        \"nauc_recall_at_100_diff1\": 0.22118,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.311288,\n        \"nauc_precision_at_1_std\": -0.283077,\n        \"nauc_precision_at_1_diff1\": 0.505347,\n        \"nauc_precision_at_3_max\": 0.335789,\n        \"nauc_precision_at_3_std\": -0.21226,\n        \"nauc_precision_at_3_diff1\": 0.27896,\n        \"nauc_precision_at_5_max\": 0.286018,\n        \"nauc_precision_at_5_std\": -0.211069,\n        \"nauc_precision_at_5_diff1\": 0.2114,\n        \"nauc_precision_at_10_max\": 0.267447,\n        \"nauc_precision_at_10_std\": -0.188898,\n        \"nauc_precision_at_10_diff1\": 0.206173,\n        \"nauc_precision_at_20_max\": 0.243744,\n        \"nauc_precision_at_20_std\": -0.144214,\n        \"nauc_precision_at_20_diff1\": 0.163522,\n        \"nauc_precision_at_100_max\": 0.214885,\n        \"nauc_precision_at_100_std\": 0.027884,\n        \"nauc_precision_at_100_diff1\": 0.03346,\n        \"nauc_precision_at_1000_max\": 0.140024,\n        \"nauc_precision_at_1000_std\": 0.039212,\n        \"nauc_precision_at_1000_diff1\": -0.029463,\n        \"nauc_mrr_at_1_max\": 0.311288,\n        \"nauc_mrr_at_1_std\": -0.283077,\n        \"nauc_mrr_at_1_diff1\": 0.505347,\n        \"nauc_mrr_at_3_max\": 0.325613,\n        \"nauc_mrr_at_3_std\": -0.272578,\n        \"nauc_mrr_at_3_diff1\": 0.485305,\n        \"nauc_mrr_at_5_max\": 0.319542,\n        \"nauc_mrr_at_5_std\": -0.273768,\n        \"nauc_mrr_at_5_diff1\": 0.480104,\n        \"nauc_mrr_at_10_max\": 0.317487,\n        \"nauc_mrr_at_10_std\": -0.271725,\n        \"nauc_mrr_at_10_diff1\": 0.476175,\n        \"nauc_mrr_at_20_max\": 0.31808,\n        \"nauc_mrr_at_20_std\": -0.267332,\n        \"nauc_mrr_at_20_diff1\": 0.474981,\n        \"nauc_mrr_at_100_max\": 0.319132,\n        \"nauc_mrr_at_100_std\": -0.264791,\n        \"nauc_mrr_at_100_diff1\": 0.474002,\n        \"nauc_mrr_at_1000_max\": 0.319001,\n        \"nauc_mrr_at_1000_std\": -0.265319,\n        \"nauc_mrr_at_1000_diff1\": 0.474376,\n        \"main_score\": 0.36871,\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.28746,\n        \"ndcg_at_3\": 0.2976,\n        \"ndcg_at_5\": 0.31584,\n        \"ndcg_at_10\": 0.34545,\n        \"ndcg_at_20\": 0.37121,\n        \"ndcg_at_100\": 0.42469,\n        \"ndcg_at_1000\": 0.45866,\n        \"map_at_1\": 0.1656,\n        \"map_at_3\": 0.24906,\n        \"map_at_5\": 0.27422,\n        \"map_at_10\": 0.28984,\n        \"map_at_20\": 0.29906,\n        \"map_at_100\": 0.30812,\n        \"map_at_1000\": 0.30997,\n        \"recall_at_1\": 0.1656,\n        \"recall_at_3\": 0.2936,\n        \"recall_at_5\": 0.35798,\n        \"recall_at_10\": 0.43349,\n        \"recall_at_20\": 0.51575,\n        \"recall_at_100\": 0.76636,\n        \"recall_at_1000\": 0.99809,\n        \"precision_at_1\": 0.28746,\n        \"precision_at_3\": 0.1947,\n        \"precision_at_5\": 0.14771,\n        \"precision_at_10\": 0.09021,\n        \"precision_at_20\": 0.05413,\n        \"precision_at_100\": 0.01554,\n        \"precision_at_1000\": 0.00195,\n        \"mrr_at_1\": 0.287462,\n        \"mrr_at_3\": 0.335372,\n        \"mrr_at_5\": 0.35158,\n        \"mrr_at_10\": 0.360888,\n        \"mrr_at_20\": 0.36642,\n        \"mrr_at_100\": 0.371447,\n        \"mrr_at_1000\": 0.372251,\n        \"nauc_ndcg_at_1_max\": 0.201657,\n        \"nauc_ndcg_at_1_std\": -0.2879,\n        \"nauc_ndcg_at_1_diff1\": 0.442656,\n        \"nauc_ndcg_at_3_max\": 0.192234,\n        \"nauc_ndcg_at_3_std\": -0.290577,\n        \"nauc_ndcg_at_3_diff1\": 0.402866,\n        \"nauc_ndcg_at_5_max\": 0.19155,\n        \"nauc_ndcg_at_5_std\": -0.286866,\n        \"nauc_ndcg_at_5_diff1\": 0.400679,\n        \"nauc_ndcg_at_10_max\": 0.177678,\n        \"nauc_ndcg_at_10_std\": -0.291851,\n        \"nauc_ndcg_at_10_diff1\": 0.395469,\n        \"nauc_ndcg_at_20_max\": 0.165234,\n        \"nauc_ndcg_at_20_std\": -0.291409,\n        \"nauc_ndcg_at_20_diff1\": 0.378526,\n        \"nauc_ndcg_at_100_max\": 0.179826,\n        \"nauc_ndcg_at_100_std\": -0.260967,\n        \"nauc_ndcg_at_100_diff1\": 0.376394,\n        \"nauc_ndcg_at_1000_max\": 0.187783,\n        \"nauc_ndcg_at_1000_std\": -0.267931,\n        \"nauc_ndcg_at_1000_diff1\": 0.388467,\n        \"nauc_map_at_1_max\": 0.174807,\n        \"nauc_map_at_1_std\": -0.245718,\n        \"nauc_map_at_1_diff1\": 0.457417,\n        \"nauc_map_at_3_max\": 0.194672,\n        \"nauc_map_at_3_std\": -0.276974,\n        \"nauc_map_at_3_diff1\": 0.423815,\n        \"nauc_map_at_5_max\": 0.197,\n        \"nauc_map_at_5_std\": -0.281495,\n        \"nauc_map_at_5_diff1\": 0.410867,\n        \"nauc_map_at_10_max\": 0.190462,\n        \"nauc_map_at_10_std\": -0.286135,\n        \"nauc_map_at_10_diff1\": 0.406367,\n        \"nauc_map_at_20_max\": 0.184592,\n        \"nauc_map_at_20_std\": -0.287948,\n        \"nauc_map_at_20_diff1\": 0.399485,\n        \"nauc_map_at_100_max\": 0.186309,\n        \"nauc_map_at_100_std\": -0.283896,\n        \"nauc_map_at_100_diff1\": 0.398831,\n        \"nauc_map_at_1000_max\": 0.187486,\n        \"nauc_map_at_1000_std\": -0.28301,\n        \"nauc_map_at_1000_diff1\": 0.399449,\n        \"nauc_recall_at_1_max\": 0.174807,\n        \"nauc_recall_at_1_std\": -0.245718,\n        \"nauc_recall_at_1_diff1\": 0.457417,\n        \"nauc_recall_at_3_max\": 0.17536,\n        \"nauc_recall_at_3_std\": -0.276148,\n        \"nauc_recall_at_3_diff1\": 0.383754,\n        \"nauc_recall_at_5_max\": 0.168221,\n        \"nauc_recall_at_5_std\": -0.274878,\n        \"nauc_recall_at_5_diff1\": 0.355527,\n        \"nauc_recall_at_10_max\": 0.135118,\n        \"nauc_recall_at_10_std\": -0.281284,\n        \"nauc_recall_at_10_diff1\": 0.348563,\n        \"nauc_recall_at_20_max\": 0.097836,\n        \"nauc_recall_at_20_std\": -0.275298,\n        \"nauc_recall_at_20_diff1\": 0.289646,\n        \"nauc_recall_at_100_max\": 0.144121,\n        \"nauc_recall_at_100_std\": -0.076736,\n        \"nauc_recall_at_100_diff1\": 0.223493,\n        \"nauc_recall_at_1000_max\": 0.687293,\n        \"nauc_recall_at_1000_std\": 0.824538,\n        \"nauc_recall_at_1000_diff1\": 0.6613,\n        \"nauc_precision_at_1_max\": 0.201657,\n        \"nauc_precision_at_1_std\": -0.2879,\n        \"nauc_precision_at_1_diff1\": 0.442656,\n        \"nauc_precision_at_3_max\": 0.186142,\n        \"nauc_precision_at_3_std\": -0.267155,\n        \"nauc_precision_at_3_diff1\": 0.293118,\n        \"nauc_precision_at_5_max\": 0.16958,\n        \"nauc_precision_at_5_std\": -0.2512,\n        \"nauc_precision_at_5_diff1\": 0.240926,\n        \"nauc_precision_at_10_max\": 0.121913,\n        \"nauc_precision_at_10_std\": -0.239312,\n        \"nauc_precision_at_10_diff1\": 0.197129,\n        \"nauc_precision_at_20_max\": 0.07668,\n        \"nauc_precision_at_20_std\": -0.218574,\n        \"nauc_precision_at_20_diff1\": 0.140458,\n        \"nauc_precision_at_100_max\": 0.087452,\n        \"nauc_precision_at_100_std\": -0.059537,\n        \"nauc_precision_at_100_diff1\": 0.054791,\n        \"nauc_precision_at_1000_max\": 0.080563,\n        \"nauc_precision_at_1000_std\": 0.000892,\n        \"nauc_precision_at_1000_diff1\": -0.002318,\n        \"nauc_mrr_at_1_max\": 0.201657,\n        \"nauc_mrr_at_1_std\": -0.2879,\n        \"nauc_mrr_at_1_diff1\": 0.442656,\n        \"nauc_mrr_at_3_max\": 0.195831,\n        \"nauc_mrr_at_3_std\": -0.294736,\n        \"nauc_mrr_at_3_diff1\": 0.419949,\n        \"nauc_mrr_at_5_max\": 0.189667,\n        \"nauc_mrr_at_5_std\": -0.29252,\n        \"nauc_mrr_at_5_diff1\": 0.411453,\n        \"nauc_mrr_at_10_max\": 0.18534,\n        \"nauc_mrr_at_10_std\": -0.291873,\n        \"nauc_mrr_at_10_diff1\": 0.410579,\n        \"nauc_mrr_at_20_max\": 0.185276,\n        \"nauc_mrr_at_20_std\": -0.287898,\n        \"nauc_mrr_at_20_diff1\": 0.407642,\n        \"nauc_mrr_at_100_max\": 0.187201,\n        \"nauc_mrr_at_100_std\": -0.285521,\n        \"nauc_mrr_at_100_diff1\": 0.408829,\n        \"nauc_mrr_at_1000_max\": 0.187446,\n        \"nauc_mrr_at_1000_std\": -0.285824,\n        \"nauc_mrr_at_1000_diff1\": 0.409163,\n        \"main_score\": 0.34545,\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ]\n      },\n      {\n        \"ndcg_at_1\": 0.25081,\n        \"ndcg_at_3\": 0.27258,\n        \"ndcg_at_5\": 0.2871,\n        \"ndcg_at_10\": 0.31205,\n        \"ndcg_at_20\": 0.33519,\n        \"ndcg_at_100\": 0.3934,\n        \"ndcg_at_1000\": 0.42727,\n        \"map_at_1\": 0.16895,\n        \"map_at_3\": 0.24394,\n        \"map_at_5\": 0.25794,\n        \"map_at_10\": 0.27103,\n        \"map_at_20\": 0.27809,\n        \"map_at_100\": 0.28706,\n        \"map_at_1000\": 0.28864,\n        \"recall_at_1\": 0.16895,\n        \"recall_at_3\": 0.28555,\n        \"recall_at_5\": 0.32541,\n        \"recall_at_10\": 0.39173,\n        \"recall_at_20\": 0.47433,\n        \"recall_at_100\": 0.75536,\n        \"recall_at_1000\": 1.0,\n        \"precision_at_1\": 0.25081,\n        \"precision_at_3\": 0.16124,\n        \"precision_at_5\": 0.11238,\n        \"precision_at_10\": 0.06906,\n        \"precision_at_20\": 0.04096,\n        \"precision_at_100\": 0.01303,\n        \"precision_at_1000\": 0.00167,\n        \"mrr_at_1\": 0.250814,\n        \"mrr_at_3\": 0.294245,\n        \"mrr_at_5\": 0.301982,\n        \"mrr_at_10\": 0.310341,\n        \"mrr_at_20\": 0.316275,\n        \"mrr_at_100\": 0.322775,\n        \"mrr_at_1000\": 0.323634,\n        \"nauc_ndcg_at_1_max\": 0.193886,\n        \"nauc_ndcg_at_1_std\": -0.216627,\n        \"nauc_ndcg_at_1_diff1\": 0.441826,\n        \"nauc_ndcg_at_3_max\": 0.180387,\n        \"nauc_ndcg_at_3_std\": -0.213751,\n        \"nauc_ndcg_at_3_diff1\": 0.387516,\n        \"nauc_ndcg_at_5_max\": 0.159271,\n        \"nauc_ndcg_at_5_std\": -0.22786,\n        \"nauc_ndcg_at_5_diff1\": 0.366407,\n        \"nauc_ndcg_at_10_max\": 0.165582,\n        \"nauc_ndcg_at_10_std\": -0.225034,\n        \"nauc_ndcg_at_10_diff1\": 0.349482,\n        \"nauc_ndcg_at_20_max\": 0.161333,\n        \"nauc_ndcg_at_20_std\": -0.22264,\n        \"nauc_ndcg_at_20_diff1\": 0.352346,\n        \"nauc_ndcg_at_100_max\": 0.174417,\n        \"nauc_ndcg_at_100_std\": -0.175529,\n        \"nauc_ndcg_at_100_diff1\": 0.334731,\n        \"nauc_ndcg_at_1000_max\": 0.175213,\n        \"nauc_ndcg_at_1000_std\": -0.196456,\n        \"nauc_ndcg_at_1000_diff1\": 0.357803,\n        \"nauc_map_at_1_max\": 0.163012,\n        \"nauc_map_at_1_std\": -0.229248,\n        \"nauc_map_at_1_diff1\": 0.481955,\n        \"nauc_map_at_3_max\": 0.180761,\n        \"nauc_map_at_3_std\": -0.219693,\n        \"nauc_map_at_3_diff1\": 0.39315,\n        \"nauc_map_at_5_max\": 0.167584,\n        \"nauc_map_at_5_std\": -0.225807,\n        \"nauc_map_at_5_diff1\": 0.375512,\n        \"nauc_map_at_10_max\": 0.167727,\n        \"nauc_map_at_10_std\": -0.227501,\n        \"nauc_map_at_10_diff1\": 0.366203,\n        \"nauc_map_at_20_max\": 0.165379,\n        \"nauc_map_at_20_std\": -0.227643,\n        \"nauc_map_at_20_diff1\": 0.36711,\n        \"nauc_map_at_100_max\": 0.168346,\n        \"nauc_map_at_100_std\": -0.219738,\n        \"nauc_map_at_100_diff1\": 0.365347,\n        \"nauc_map_at_1000_max\": 0.168504,\n        \"nauc_map_at_1000_std\": -0.220301,\n        \"nauc_map_at_1000_diff1\": 0.366307,\n        \"nauc_recall_at_1_max\": 0.163012,\n        \"nauc_recall_at_1_std\": -0.229248,\n        \"nauc_recall_at_1_diff1\": 0.481955,\n        \"nauc_recall_at_3_max\": 0.178663,\n        \"nauc_recall_at_3_std\": -0.212073,\n        \"nauc_recall_at_3_diff1\": 0.363339,\n        \"nauc_recall_at_5_max\": 0.132254,\n        \"nauc_recall_at_5_std\": -0.236296,\n        \"nauc_recall_at_5_diff1\": 0.315634,\n        \"nauc_recall_at_10_max\": 0.153427,\n        \"nauc_recall_at_10_std\": -0.220275,\n        \"nauc_recall_at_10_diff1\": 0.269116,\n        \"nauc_recall_at_20_max\": 0.136551,\n        \"nauc_recall_at_20_std\": -0.210697,\n        \"nauc_recall_at_20_diff1\": 0.268921,\n        \"nauc_recall_at_100_max\": 0.166553,\n        \"nauc_recall_at_100_std\": 0.06243,\n        \"nauc_recall_at_100_diff1\": 0.091275,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1_max\": 0.193886,\n        \"nauc_precision_at_1_std\": -0.216627,\n        \"nauc_precision_at_1_diff1\": 0.441826,\n        \"nauc_precision_at_3_max\": 0.163269,\n        \"nauc_precision_at_3_std\": -0.170411,\n        \"nauc_precision_at_3_diff1\": 0.240167,\n        \"nauc_precision_at_5_max\": 0.113688,\n        \"nauc_precision_at_5_std\": -0.183426,\n        \"nauc_precision_at_5_diff1\": 0.189589,\n        \"nauc_precision_at_10_max\": 0.100432,\n        \"nauc_precision_at_10_std\": -0.17552,\n        \"nauc_precision_at_10_diff1\": 0.142262,\n        \"nauc_precision_at_20_max\": 0.095465,\n        \"nauc_precision_at_20_std\": -0.145022,\n        \"nauc_precision_at_20_diff1\": 0.14824,\n        \"nauc_precision_at_100_max\": 0.129026,\n        \"nauc_precision_at_100_std\": 0.104406,\n        \"nauc_precision_at_100_diff1\": 0.027278,\n        \"nauc_precision_at_1000_max\": 0.094267,\n        \"nauc_precision_at_1000_std\": 0.105362,\n        \"nauc_precision_at_1000_diff1\": 0.008359,\n        \"nauc_mrr_at_1_max\": 0.193886,\n        \"nauc_mrr_at_1_std\": -0.216627,\n        \"nauc_mrr_at_1_diff1\": 0.441826,\n        \"nauc_mrr_at_3_max\": 0.187154,\n        \"nauc_mrr_at_3_std\": -0.208072,\n        \"nauc_mrr_at_3_diff1\": 0.416461,\n        \"nauc_mrr_at_5_max\": 0.174889,\n        \"nauc_mrr_at_5_std\": -0.216175,\n        \"nauc_mrr_at_5_diff1\": 0.404943,\n        \"nauc_mrr_at_10_max\": 0.180038,\n        \"nauc_mrr_at_10_std\": -0.211804,\n        \"nauc_mrr_at_10_diff1\": 0.399066,\n        \"nauc_mrr_at_20_max\": 0.179579,\n        \"nauc_mrr_at_20_std\": -0.210213,\n        \"nauc_mrr_at_20_diff1\": 0.399724,\n        \"nauc_mrr_at_100_max\": 0.180684,\n        \"nauc_mrr_at_100_std\": -0.206719,\n        \"nauc_mrr_at_100_diff1\": 0.39797,\n        \"nauc_mrr_at_1000_max\": 0.180764,\n        \"nauc_mrr_at_1000_std\": -0.207127,\n        \"nauc_mrr_at_1000_diff1\": 0.398566,\n        \"main_score\": 0.31205,\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ]\n      }\n    ]\n  },\n  \"evaluation_time\": 17.949707984924316,\n  \"kg_co2_emissions\": null\n}"
  },
  {
    "path": "eval/results/nomic-ai/nomic-embed-text-v2-moe/no_model_name_available/no_revision_available/model_meta.json",
    "content": "{\"name\": \"no_model_name_available\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": null, \"n_parameters\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": true, \"public_training_code\": null, \"public_training_data\": null, \"framework\": [], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"training_datasets\": null, \"adapted_from\": null, \"superseded_by\": null, \"loader\": null}"
  },
  {
    "path": "eval/results/openai/text-embedding-3-large/no_model_name_available/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 26.646844148635864,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.76466,\n        \"map_at_1\": 0.57895,\n        \"map_at_10\": 0.70816,\n        \"map_at_100\": 0.71079,\n        \"map_at_1000\": 0.71088,\n        \"map_at_20\": 0.71012,\n        \"map_at_3\": 0.68275,\n        \"map_at_5\": 0.69942,\n        \"mrr_at_1\": 0.5789473684210527,\n        \"mrr_at_10\": 0.7081592871066557,\n        \"mrr_at_100\": 0.7107949944358983,\n        \"mrr_at_1000\": 0.7108785366247037,\n        \"mrr_at_20\": 0.7101188285398814,\n        \"mrr_at_3\": 0.682748538011696,\n        \"mrr_at_5\": 0.6994152046783627,\n        \"nauc_map_at_1000_diff1\": 0.5829110062545787,\n        \"nauc_map_at_1000_max\": 0.23128052346477607,\n        \"nauc_map_at_1000_std\": -0.20377647286138453,\n        \"nauc_map_at_100_diff1\": 0.5830135479066073,\n        \"nauc_map_at_100_max\": 0.23150875202930604,\n        \"nauc_map_at_100_std\": -0.20365994369781237,\n        \"nauc_map_at_10_diff1\": 0.5802843326592293,\n        \"nauc_map_at_10_max\": 0.2343691605851438,\n        \"nauc_map_at_10_std\": -0.1995251028748617,\n        \"nauc_map_at_1_diff1\": 0.6403438739047393,\n        \"nauc_map_at_1_max\": 0.18225916909648981,\n        \"nauc_map_at_1_std\": -0.2271351677125876,\n        \"nauc_map_at_20_diff1\": 0.5828885713014177,\n        \"nauc_map_at_20_max\": 0.23233109061892526,\n        \"nauc_map_at_20_std\": -0.20391468794273773,\n        \"nauc_map_at_3_diff1\": 0.5900444084004162,\n        \"nauc_map_at_3_max\": 0.24110925672649372,\n        \"nauc_map_at_3_std\": -0.21439877098670698,\n        \"nauc_map_at_5_diff1\": 0.5821939194952693,\n        \"nauc_map_at_5_max\": 0.242817217238973,\n        \"nauc_map_at_5_std\": -0.18968439733720696,\n        \"nauc_mrr_at_1000_diff1\": 0.5829110062545787,\n        \"nauc_mrr_at_1000_max\": 0.23128052346477607,\n        \"nauc_mrr_at_1000_std\": -0.20377647286138453,\n        \"nauc_mrr_at_100_diff1\": 0.5830135479066073,\n        \"nauc_mrr_at_100_max\": 0.23150875202930604,\n        \"nauc_mrr_at_100_std\": -0.20365994369781237,\n        \"nauc_mrr_at_10_diff1\": 0.5802843326592293,\n        \"nauc_mrr_at_10_max\": 0.2343691605851438,\n        \"nauc_mrr_at_10_std\": -0.1995251028748617,\n        \"nauc_mrr_at_1_diff1\": 0.6403438739047393,\n        \"nauc_mrr_at_1_max\": 0.18225916909648981,\n        \"nauc_mrr_at_1_std\": -0.2271351677125876,\n        \"nauc_mrr_at_20_diff1\": 0.5828885713014177,\n        \"nauc_mrr_at_20_max\": 0.23233109061892526,\n        \"nauc_mrr_at_20_std\": -0.20391468794273773,\n        \"nauc_mrr_at_3_diff1\": 0.5900444084004162,\n        \"nauc_mrr_at_3_max\": 0.24110925672649372,\n        \"nauc_mrr_at_3_std\": -0.21439877098670698,\n        \"nauc_mrr_at_5_diff1\": 0.5821939194952693,\n        \"nauc_mrr_at_5_max\": 0.242817217238973,\n        \"nauc_mrr_at_5_std\": -0.18968439733720696,\n        \"nauc_ndcg_at_1000_diff1\": 0.5773268804066995,\n        \"nauc_ndcg_at_1000_max\": 0.23923313794532927,\n        \"nauc_ndcg_at_1000_std\": -0.20329298222158235,\n        \"nauc_ndcg_at_100_diff1\": 0.5794181753883131,\n        \"nauc_ndcg_at_100_max\": 0.24374202633049696,\n        \"nauc_ndcg_at_100_std\": -0.20096525193591755,\n        \"nauc_ndcg_at_10_diff1\": 0.5648083467695035,\n        \"nauc_ndcg_at_10_max\": 0.2565211201237364,\n        \"nauc_ndcg_at_10_std\": -0.19112254941280304,\n        \"nauc_ndcg_at_1_diff1\": 0.6403438739047393,\n        \"nauc_ndcg_at_1_max\": 0.18225916909648981,\n        \"nauc_ndcg_at_1_std\": -0.2271351677125876,\n        \"nauc_ndcg_at_20_diff1\": 0.5747514020950384,\n        \"nauc_ndcg_at_20_max\": 0.2474030248483696,\n        \"nauc_ndcg_at_20_std\": -0.21037902951574675,\n        \"nauc_ndcg_at_3_diff1\": 0.5860471149700772,\n        \"nauc_ndcg_at_3_max\": 0.2666193142967102,\n        \"nauc_ndcg_at_3_std\": -0.2149612280213397,\n        \"nauc_ndcg_at_5_diff1\": 0.5699609677327039,\n        \"nauc_ndcg_at_5_max\": 0.2753338721736746,\n        \"nauc_ndcg_at_5_std\": -0.16581140344599296,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 0.8697886921759251,\n        \"nauc_precision_at_100_max\": 0.8697886921759251,\n        \"nauc_precision_at_100_std\": 0.12223365206034731,\n        \"nauc_precision_at_10_diff1\": 0.4054838122463558,\n        \"nauc_precision_at_10_max\": 0.4950344150961882,\n        \"nauc_precision_at_10_std\": -0.11514909457473732,\n        \"nauc_precision_at_1_diff1\": 0.6403438739047393,\n        \"nauc_precision_at_1_max\": 0.18225916909648981,\n        \"nauc_precision_at_1_std\": -0.2271351677125876,\n        \"nauc_precision_at_20_diff1\": 0.48194467595441853,\n        \"nauc_precision_at_20_max\": 0.4745484821827859,\n        \"nauc_precision_at_20_std\": -0.4601411718520565,\n        \"nauc_precision_at_3_diff1\": 0.5767799568769227,\n        \"nauc_precision_at_3_max\": 0.37242262131016984,\n        \"nauc_precision_at_3_std\": -0.21979199837598418,\n        \"nauc_precision_at_5_diff1\": 0.5048896679723024,\n        \"nauc_precision_at_5_max\": 0.472750814625999,\n        \"nauc_precision_at_5_std\": -0.016834198269562995,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8697886921759079,\n        \"nauc_recall_at_100_max\": 0.8697886921759079,\n        \"nauc_recall_at_100_std\": 0.12223365206031499,\n        \"nauc_recall_at_10_diff1\": 0.40548381224635466,\n        \"nauc_recall_at_10_max\": 0.4950344150961911,\n        \"nauc_recall_at_10_std\": -0.11514909457473714,\n        \"nauc_recall_at_1_diff1\": 0.6403438739047393,\n        \"nauc_recall_at_1_max\": 0.18225916909648981,\n        \"nauc_recall_at_1_std\": -0.2271351677125876,\n        \"nauc_recall_at_20_diff1\": 0.48194467595441987,\n        \"nauc_recall_at_20_max\": 0.4745484821827929,\n        \"nauc_recall_at_20_std\": -0.4601411718520569,\n        \"nauc_recall_at_3_diff1\": 0.5767799568769236,\n        \"nauc_recall_at_3_max\": 0.3724226213101706,\n        \"nauc_recall_at_3_std\": -0.21979199837598373,\n        \"nauc_recall_at_5_diff1\": 0.5048896679723038,\n        \"nauc_recall_at_5_max\": 0.47275081462600177,\n        \"nauc_recall_at_5_std\": -0.016834198269564362,\n        \"ndcg_at_1\": 0.57895,\n        \"ndcg_at_10\": 0.76466,\n        \"ndcg_at_100\": 0.77633,\n        \"ndcg_at_1000\": 0.77763,\n        \"ndcg_at_20\": 0.77147,\n        \"ndcg_at_3\": 0.7148,\n        \"ndcg_at_5\": 0.74426,\n        \"precision_at_1\": 0.57895,\n        \"precision_at_10\": 0.09386,\n        \"precision_at_100\": 0.00991,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04825,\n        \"precision_at_3\": 0.26901,\n        \"precision_at_5\": 0.17544,\n        \"recall_at_1\": 0.57895,\n        \"recall_at_10\": 0.9386,\n        \"recall_at_100\": 0.99123,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96491,\n        \"recall_at_3\": 0.80702,\n        \"recall_at_5\": 0.87719\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/openai/text-embedding-3-large/no_model_name_available/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 104.64979100227356,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.89451,\n        \"map_at_1\": 0.82778,\n        \"map_at_10\": 0.87456,\n        \"map_at_100\": 0.8758,\n        \"map_at_1000\": 0.87589,\n        \"map_at_20\": 0.87534,\n        \"map_at_3\": 0.86685,\n        \"map_at_5\": 0.87235,\n        \"mrr_at_1\": 0.8277777777777777,\n        \"mrr_at_10\": 0.8745582010582011,\n        \"mrr_at_100\": 0.8758046640392401,\n        \"mrr_at_1000\": 0.8758850873355876,\n        \"mrr_at_20\": 0.8753374166444343,\n        \"mrr_at_3\": 0.8668518518518518,\n        \"mrr_at_5\": 0.8723518518518518,\n        \"nauc_map_at_1000_diff1\": 0.8765941147751475,\n        \"nauc_map_at_1000_max\": 0.8184670320296146,\n        \"nauc_map_at_1000_std\": 0.2043466216556563,\n        \"nauc_map_at_100_diff1\": 0.8765424901088339,\n        \"nauc_map_at_100_max\": 0.81855492741636,\n        \"nauc_map_at_100_std\": 0.2045661771941467,\n        \"nauc_map_at_10_diff1\": 0.8765135889872123,\n        \"nauc_map_at_10_max\": 0.8193676890799481,\n        \"nauc_map_at_10_std\": 0.20616727802609794,\n        \"nauc_map_at_1_diff1\": 0.8867658774417635,\n        \"nauc_map_at_1_max\": 0.7924731525445328,\n        \"nauc_map_at_1_std\": 0.14594181192441288,\n        \"nauc_map_at_20_diff1\": 0.8768109145959556,\n        \"nauc_map_at_20_max\": 0.8189936498500454,\n        \"nauc_map_at_20_std\": 0.20548817848269876,\n        \"nauc_map_at_3_diff1\": 0.8721401111097621,\n        \"nauc_map_at_3_max\": 0.8190431660209794,\n        \"nauc_map_at_3_std\": 0.20189887851198635,\n        \"nauc_map_at_5_diff1\": 0.8747765806150434,\n        \"nauc_map_at_5_max\": 0.8201125877199104,\n        \"nauc_map_at_5_std\": 0.20757675285082214,\n        \"nauc_mrr_at_1000_diff1\": 0.8765941147751475,\n        \"nauc_mrr_at_1000_max\": 0.8184670320296146,\n        \"nauc_mrr_at_1000_std\": 0.2043466216556563,\n        \"nauc_mrr_at_100_diff1\": 0.8765424901088339,\n        \"nauc_mrr_at_100_max\": 0.81855492741636,\n        \"nauc_mrr_at_100_std\": 0.2045661771941467,\n        \"nauc_mrr_at_10_diff1\": 0.8765135889872123,\n        \"nauc_mrr_at_10_max\": 0.8193676890799481,\n        \"nauc_mrr_at_10_std\": 0.20616727802609794,\n        \"nauc_mrr_at_1_diff1\": 0.8867658774417635,\n        \"nauc_mrr_at_1_max\": 0.7924731525445328,\n        \"nauc_mrr_at_1_std\": 0.14594181192441288,\n        \"nauc_mrr_at_20_diff1\": 0.8768109145959556,\n        \"nauc_mrr_at_20_max\": 0.8189936498500454,\n        \"nauc_mrr_at_20_std\": 0.20548817848269876,\n        \"nauc_mrr_at_3_diff1\": 0.8721401111097621,\n        \"nauc_mrr_at_3_max\": 0.8190431660209794,\n        \"nauc_mrr_at_3_std\": 0.20189887851198635,\n        \"nauc_mrr_at_5_diff1\": 0.8747765806150434,\n        \"nauc_mrr_at_5_max\": 0.8201125877199104,\n        \"nauc_mrr_at_5_std\": 0.20757675285082214,\n        \"nauc_ndcg_at_1000_diff1\": 0.8760407250178142,\n        \"nauc_ndcg_at_1000_max\": 0.8237066948911186,\n        \"nauc_ndcg_at_1000_std\": 0.21778313960840487,\n        \"nauc_ndcg_at_100_diff1\": 0.8749002952635064,\n        \"nauc_ndcg_at_100_max\": 0.8260964950874432,\n        \"nauc_ndcg_at_100_std\": 0.2242878788311883,\n        \"nauc_ndcg_at_10_diff1\": 0.8764469804941419,\n        \"nauc_ndcg_at_10_max\": 0.8310922283782205,\n        \"nauc_ndcg_at_10_std\": 0.23470651073965554,\n        \"nauc_ndcg_at_1_diff1\": 0.8867658774417635,\n        \"nauc_ndcg_at_1_max\": 0.7924731525445328,\n        \"nauc_ndcg_at_1_std\": 0.14594181192441288,\n        \"nauc_ndcg_at_20_diff1\": 0.8777498779087349,\n        \"nauc_ndcg_at_20_max\": 0.8298172101274326,\n        \"nauc_ndcg_at_20_std\": 0.23235065354034032,\n        \"nauc_ndcg_at_3_diff1\": 0.8667275120085678,\n        \"nauc_ndcg_at_3_max\": 0.8294622491545487,\n        \"nauc_ndcg_at_3_std\": 0.22511113369692567,\n        \"nauc_ndcg_at_5_diff1\": 0.8714639073447893,\n        \"nauc_ndcg_at_5_max\": 0.8322960824684759,\n        \"nauc_ndcg_at_5_std\": 0.2372072419718233,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8194833488951155,\n        \"nauc_precision_at_100_max\": 0.9519530034235867,\n        \"nauc_precision_at_100_std\": 0.5737628384687296,\n        \"nauc_precision_at_10_diff1\": 0.8835200746965407,\n        \"nauc_precision_at_10_max\": 0.9216269841269835,\n        \"nauc_precision_at_10_std\": 0.4553804855275415,\n        \"nauc_precision_at_1_diff1\": 0.8867658774417635,\n        \"nauc_precision_at_1_max\": 0.7924731525445328,\n        \"nauc_precision_at_1_std\": 0.14594181192441288,\n        \"nauc_precision_at_20_diff1\": 0.9011048863990015,\n        \"nauc_precision_at_20_max\": 0.9370525988173025,\n        \"nauc_precision_at_20_std\": 0.5000466853408015,\n        \"nauc_precision_at_3_diff1\": 0.8434812521499847,\n        \"nauc_precision_at_3_max\": 0.8745147181679728,\n        \"nauc_precision_at_3_std\": 0.3261032483168725,\n        \"nauc_precision_at_5_diff1\": 0.853959765724471,\n        \"nauc_precision_at_5_max\": 0.902427637721753,\n        \"nauc_precision_at_5_std\": 0.4090569561157763,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8194833488951093,\n        \"nauc_recall_at_100_max\": 0.9519530034235866,\n        \"nauc_recall_at_100_std\": 0.5737628384687221,\n        \"nauc_recall_at_10_diff1\": 0.8835200746965439,\n        \"nauc_recall_at_10_max\": 0.921626984126984,\n        \"nauc_recall_at_10_std\": 0.4553804855275454,\n        \"nauc_recall_at_1_diff1\": 0.8867658774417635,\n        \"nauc_recall_at_1_max\": 0.7924731525445328,\n        \"nauc_recall_at_1_std\": 0.14594181192441288,\n        \"nauc_recall_at_20_diff1\": 0.9011048863990032,\n        \"nauc_recall_at_20_max\": 0.9370525988173043,\n        \"nauc_recall_at_20_std\": 0.5000466853408011,\n        \"nauc_recall_at_3_diff1\": 0.8434812521499828,\n        \"nauc_recall_at_3_max\": 0.8745147181679692,\n        \"nauc_recall_at_3_std\": 0.32610324831686943,\n        \"nauc_recall_at_5_diff1\": 0.8539597657244727,\n        \"nauc_recall_at_5_max\": 0.9024276377217549,\n        \"nauc_recall_at_5_std\": 0.40905695611578,\n        \"ndcg_at_1\": 0.82778,\n        \"ndcg_at_10\": 0.89451,\n        \"ndcg_at_100\": 0.90095,\n        \"ndcg_at_1000\": 0.90274,\n        \"ndcg_at_20\": 0.89733,\n        \"ndcg_at_3\": 0.87938,\n        \"ndcg_at_5\": 0.88913,\n        \"precision_at_1\": 0.82778,\n        \"precision_at_10\": 0.09556,\n        \"precision_at_100\": 0.00987,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04833,\n        \"precision_at_3\": 0.30519,\n        \"precision_at_5\": 0.18778,\n        \"recall_at_1\": 0.82778,\n        \"recall_at_10\": 0.95556,\n        \"recall_at_100\": 0.98667,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96667,\n        \"recall_at_3\": 0.91556,\n        \"recall_at_5\": 0.93889\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.94404,\n        \"map_at_1\": 0.89667,\n        \"map_at_10\": 0.9308,\n        \"map_at_100\": 0.93143,\n        \"map_at_1000\": 0.93144,\n        \"map_at_20\": 0.93123,\n        \"map_at_3\": 0.92722,\n        \"map_at_5\": 0.92894,\n        \"mrr_at_1\": 0.8966666666666666,\n        \"mrr_at_10\": 0.9308002645502649,\n        \"mrr_at_100\": 0.9314284409958359,\n        \"mrr_at_1000\": 0.9314385805367853,\n        \"mrr_at_20\": 0.931229114452799,\n        \"mrr_at_3\": 0.9272222222222225,\n        \"mrr_at_5\": 0.9289444444444448,\n        \"nauc_map_at_1000_diff1\": 0.8944097187683182,\n        \"nauc_map_at_1000_max\": 0.7331593396576956,\n        \"nauc_map_at_1000_std\": -0.17657754769293518,\n        \"nauc_map_at_100_diff1\": 0.8944253819595299,\n        \"nauc_map_at_100_max\": 0.7331989226215538,\n        \"nauc_map_at_100_std\": -0.17640301497183783,\n        \"nauc_map_at_10_diff1\": 0.8942036768623971,\n        \"nauc_map_at_10_max\": 0.7351280873510182,\n        \"nauc_map_at_10_std\": -0.17113751257430934,\n        \"nauc_map_at_1_diff1\": 0.8900769285058929,\n        \"nauc_map_at_1_max\": 0.6828387929383056,\n        \"nauc_map_at_1_std\": -0.2375759958863897,\n        \"nauc_map_at_20_diff1\": 0.8944467039706967,\n        \"nauc_map_at_20_max\": 0.7338846356141927,\n        \"nauc_map_at_20_std\": -0.17387853872569373,\n        \"nauc_map_at_3_diff1\": 0.8951668441985208,\n        \"nauc_map_at_3_max\": 0.7406033223478056,\n        \"nauc_map_at_3_std\": -0.1749987489365976,\n        \"nauc_map_at_5_diff1\": 0.8938483367738029,\n        \"nauc_map_at_5_max\": 0.7395307392770073,\n        \"nauc_map_at_5_std\": -0.17639382868741973,\n        \"nauc_mrr_at_1000_diff1\": 0.8944097187683182,\n        \"nauc_mrr_at_1000_max\": 0.7331593396576956,\n        \"nauc_mrr_at_1000_std\": -0.17657754769293518,\n        \"nauc_mrr_at_100_diff1\": 0.8944253819595299,\n        \"nauc_mrr_at_100_max\": 0.7331989226215538,\n        \"nauc_mrr_at_100_std\": -0.17640301497183783,\n        \"nauc_mrr_at_10_diff1\": 0.8942036768623971,\n        \"nauc_mrr_at_10_max\": 0.7351280873510182,\n        \"nauc_mrr_at_10_std\": -0.17113751257430934,\n        \"nauc_mrr_at_1_diff1\": 0.8900769285058929,\n        \"nauc_mrr_at_1_max\": 0.6828387929383056,\n        \"nauc_mrr_at_1_std\": -0.2375759958863897,\n        \"nauc_mrr_at_20_diff1\": 0.8944467039706967,\n        \"nauc_mrr_at_20_max\": 0.7338846356141927,\n        \"nauc_mrr_at_20_std\": -0.17387853872569373,\n        \"nauc_mrr_at_3_diff1\": 0.8951668441985208,\n        \"nauc_mrr_at_3_max\": 0.7406033223478056,\n        \"nauc_mrr_at_3_std\": -0.1749987489365976,\n        \"nauc_mrr_at_5_diff1\": 0.8938483367738029,\n        \"nauc_mrr_at_5_max\": 0.7395307392770073,\n        \"nauc_mrr_at_5_std\": -0.17639382868741973,\n        \"nauc_ndcg_at_1000_diff1\": 0.8951841037723368,\n        \"nauc_ndcg_at_1000_max\": 0.7409071064713759,\n        \"nauc_ndcg_at_1000_std\": -0.1606713452509553,\n        \"nauc_ndcg_at_100_diff1\": 0.8957385508571588,\n        \"nauc_ndcg_at_100_max\": 0.7422776361780857,\n        \"nauc_ndcg_at_100_std\": -0.15453171503288304,\n        \"nauc_ndcg_at_10_diff1\": 0.8951195079697556,\n        \"nauc_ndcg_at_10_max\": 0.7526671853587154,\n        \"nauc_ndcg_at_10_std\": -0.12627422949906705,\n        \"nauc_ndcg_at_1_diff1\": 0.8900769285058929,\n        \"nauc_ndcg_at_1_max\": 0.6828387929383056,\n        \"nauc_ndcg_at_1_std\": -0.2375759958863897,\n        \"nauc_ndcg_at_20_diff1\": 0.8960069380183776,\n        \"nauc_ndcg_at_20_max\": 0.74806717367277,\n        \"nauc_ndcg_at_20_std\": -0.13433623091149807,\n        \"nauc_ndcg_at_3_diff1\": 0.8967126881150357,\n        \"nauc_ndcg_at_3_max\": 0.7652745835504532,\n        \"nauc_ndcg_at_3_std\": -0.14427405393147222,\n        \"nauc_ndcg_at_5_diff1\": 0.8941084626720966,\n        \"nauc_ndcg_at_5_max\": 0.7639066051670461,\n        \"nauc_ndcg_at_5_std\": -0.14605075393547182,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.9054621848739591,\n        \"nauc_precision_at_10_max\": 0.950980392156856,\n        \"nauc_precision_at_10_std\": 0.4800253434707128,\n        \"nauc_precision_at_1_diff1\": 0.8900769285058929,\n        \"nauc_precision_at_1_max\": 0.6828387929383056,\n        \"nauc_precision_at_1_std\": -0.2375759958863897,\n        \"nauc_precision_at_20_diff1\": 0.9273783587509046,\n        \"nauc_precision_at_20_max\": 0.9691358024691454,\n        \"nauc_precision_at_20_std\": 0.6805166511048747,\n        \"nauc_precision_at_3_diff1\": 0.9047069808315497,\n        \"nauc_precision_at_3_max\": 0.8992283187784935,\n        \"nauc_precision_at_3_std\": 0.025086505190320282,\n        \"nauc_precision_at_5_diff1\": 0.8945257115191743,\n        \"nauc_precision_at_5_max\": 0.9255628177196821,\n        \"nauc_precision_at_5_std\": 0.05842583947158553,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 1.0,\n        \"nauc_recall_at_100_max\": 1.0,\n        \"nauc_recall_at_100_std\": 1.0,\n        \"nauc_recall_at_10_diff1\": 0.9054621848739518,\n        \"nauc_recall_at_10_max\": 0.9509803921568608,\n        \"nauc_recall_at_10_std\": 0.4800253434707287,\n        \"nauc_recall_at_1_diff1\": 0.8900769285058929,\n        \"nauc_recall_at_1_max\": 0.6828387929383056,\n        \"nauc_recall_at_1_std\": -0.2375759958863897,\n        \"nauc_recall_at_20_diff1\": 0.9273783587509028,\n        \"nauc_recall_at_20_max\": 0.9691358024691298,\n        \"nauc_recall_at_20_std\": 0.6805166511048744,\n        \"nauc_recall_at_3_diff1\": 0.9047069808315451,\n        \"nauc_recall_at_3_max\": 0.8992283187784907,\n        \"nauc_recall_at_3_std\": 0.025086505190313194,\n        \"nauc_recall_at_5_diff1\": 0.8945257115191748,\n        \"nauc_recall_at_5_max\": 0.9255628177196803,\n        \"nauc_recall_at_5_std\": 0.05842583947159392,\n        \"ndcg_at_1\": 0.89667,\n        \"ndcg_at_10\": 0.94404,\n        \"ndcg_at_100\": 0.94693,\n        \"ndcg_at_1000\": 0.94721,\n        \"ndcg_at_20\": 0.94549,\n        \"ndcg_at_3\": 0.93628,\n        \"ndcg_at_5\": 0.93944,\n        \"precision_at_1\": 0.89667,\n        \"precision_at_10\": 0.09844,\n        \"precision_at_100\": 0.00998,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.0495,\n        \"precision_at_3\": 0.32074,\n        \"precision_at_5\": 0.194,\n        \"recall_at_1\": 0.89667,\n        \"recall_at_10\": 0.98444,\n        \"recall_at_100\": 0.99778,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.99,\n        \"recall_at_3\": 0.96222,\n        \"recall_at_5\": 0.97\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.83939,\n        \"map_at_1\": 0.74556,\n        \"map_at_10\": 0.81086,\n        \"map_at_100\": 0.81348,\n        \"map_at_1000\": 0.81361,\n        \"map_at_20\": 0.81281,\n        \"map_at_3\": 0.80037,\n        \"map_at_5\": 0.80576,\n        \"mrr_at_1\": 0.7455555555555555,\n        \"mrr_at_10\": 0.8108615520282187,\n        \"mrr_at_100\": 0.8134795094402523,\n        \"mrr_at_1000\": 0.8136063404487494,\n        \"mrr_at_20\": 0.8128069114742231,\n        \"mrr_at_3\": 0.8003703703703703,\n        \"mrr_at_5\": 0.8057592592592592,\n        \"nauc_map_at_1000_diff1\": 0.8236854639603854,\n        \"nauc_map_at_1000_max\": 0.8103952303909684,\n        \"nauc_map_at_1000_std\": 0.2586868987678583,\n        \"nauc_map_at_100_diff1\": 0.8236446486633416,\n        \"nauc_map_at_100_max\": 0.8104796888389018,\n        \"nauc_map_at_100_std\": 0.2589135923444036,\n        \"nauc_map_at_10_diff1\": 0.8225884486067362,\n        \"nauc_map_at_10_max\": 0.8114661410076641,\n        \"nauc_map_at_10_std\": 0.2619132283873032,\n        \"nauc_map_at_1_diff1\": 0.8410043951458513,\n        \"nauc_map_at_1_max\": 0.7818407338540867,\n        \"nauc_map_at_1_std\": 0.19217127541767628,\n        \"nauc_map_at_20_diff1\": 0.8234074332253382,\n        \"nauc_map_at_20_max\": 0.8107245343183193,\n        \"nauc_map_at_20_std\": 0.25984670164966256,\n        \"nauc_map_at_3_diff1\": 0.8216450589475749,\n        \"nauc_map_at_3_max\": 0.8133226584904062,\n        \"nauc_map_at_3_std\": 0.26377009759337877,\n        \"nauc_map_at_5_diff1\": 0.8209266148182254,\n        \"nauc_map_at_5_max\": 0.8117429469022233,\n        \"nauc_map_at_5_std\": 0.26320383986602525,\n        \"nauc_mrr_at_1000_diff1\": 0.8236854639603854,\n        \"nauc_mrr_at_1000_max\": 0.8103952303909684,\n        \"nauc_mrr_at_1000_std\": 0.2586868987678583,\n        \"nauc_mrr_at_100_diff1\": 0.8236446486633416,\n        \"nauc_mrr_at_100_max\": 0.8104796888389018,\n        \"nauc_mrr_at_100_std\": 0.2589135923444036,\n        \"nauc_mrr_at_10_diff1\": 0.8225884486067362,\n        \"nauc_mrr_at_10_max\": 0.8114661410076641,\n        \"nauc_mrr_at_10_std\": 0.2619132283873032,\n        \"nauc_mrr_at_1_diff1\": 0.8410043951458513,\n        \"nauc_mrr_at_1_max\": 0.7818407338540867,\n        \"nauc_mrr_at_1_std\": 0.19217127541767628,\n        \"nauc_mrr_at_20_diff1\": 0.8234074332253382,\n        \"nauc_mrr_at_20_max\": 0.8107245343183193,\n        \"nauc_mrr_at_20_std\": 0.25984670164966256,\n        \"nauc_mrr_at_3_diff1\": 0.8216450589475749,\n        \"nauc_mrr_at_3_max\": 0.8133226584904062,\n        \"nauc_mrr_at_3_std\": 0.26377009759337877,\n        \"nauc_mrr_at_5_diff1\": 0.8209266148182254,\n        \"nauc_mrr_at_5_max\": 0.8117429469022233,\n        \"nauc_mrr_at_5_std\": 0.26320383986602525,\n        \"nauc_ndcg_at_1000_diff1\": 0.8216579324360656,\n        \"nauc_ndcg_at_1000_max\": 0.8151412460616603,\n        \"nauc_ndcg_at_1000_std\": 0.27193364821124083,\n        \"nauc_ndcg_at_100_diff1\": 0.8210987189079783,\n        \"nauc_ndcg_at_100_max\": 0.8173944243567918,\n        \"nauc_ndcg_at_100_std\": 0.27868650248356985,\n        \"nauc_ndcg_at_10_diff1\": 0.8170767326320595,\n        \"nauc_ndcg_at_10_max\": 0.8224982340728226,\n        \"nauc_ndcg_at_10_std\": 0.2932402399225149,\n        \"nauc_ndcg_at_1_diff1\": 0.8410043951458513,\n        \"nauc_ndcg_at_1_max\": 0.7818407338540867,\n        \"nauc_ndcg_at_1_std\": 0.19217127541767628,\n        \"nauc_ndcg_at_20_diff1\": 0.8196429827542367,\n        \"nauc_ndcg_at_20_max\": 0.8195488316353458,\n        \"nauc_ndcg_at_20_std\": 0.2861480223727952,\n        \"nauc_ndcg_at_3_diff1\": 0.8145823402723746,\n        \"nauc_ndcg_at_3_max\": 0.8244369456509973,\n        \"nauc_ndcg_at_3_std\": 0.29220631014785814,\n        \"nauc_ndcg_at_5_diff1\": 0.8128094206384131,\n        \"nauc_ndcg_at_5_max\": 0.8218584503476292,\n        \"nauc_ndcg_at_5_std\": 0.29312522084572695,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8000570598609865,\n        \"nauc_precision_at_100_max\": 0.9307500778089097,\n        \"nauc_precision_at_100_std\": 0.627632534495279,\n        \"nauc_precision_at_10_diff1\": 0.7837175895999401,\n        \"nauc_precision_at_10_max\": 0.8981972276089916,\n        \"nauc_precision_at_10_std\": 0.5126912303382867,\n        \"nauc_precision_at_1_diff1\": 0.8410043951458513,\n        \"nauc_precision_at_1_max\": 0.7818407338540867,\n        \"nauc_precision_at_1_std\": 0.19217127541767628,\n        \"nauc_precision_at_20_diff1\": 0.7910204732299405,\n        \"nauc_precision_at_20_max\": 0.9047619047619067,\n        \"nauc_precision_at_20_std\": 0.5567625424153366,\n        \"nauc_precision_at_3_diff1\": 0.7862129987129995,\n        \"nauc_precision_at_3_max\": 0.8689028314028325,\n        \"nauc_precision_at_3_std\": 0.40753700128700165,\n        \"nauc_precision_at_5_diff1\": 0.7746852599528464,\n        \"nauc_precision_at_5_max\": 0.8679428075098536,\n        \"nauc_precision_at_5_std\": 0.4342314997756957,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8000570598609825,\n        \"nauc_recall_at_100_max\": 0.9307500778089021,\n        \"nauc_recall_at_100_std\": 0.6276325344952765,\n        \"nauc_recall_at_10_diff1\": 0.7837175895999435,\n        \"nauc_recall_at_10_max\": 0.8981972276089929,\n        \"nauc_recall_at_10_std\": 0.512691230338289,\n        \"nauc_recall_at_1_diff1\": 0.8410043951458513,\n        \"nauc_recall_at_1_max\": 0.7818407338540867,\n        \"nauc_recall_at_1_std\": 0.19217127541767628,\n        \"nauc_recall_at_20_diff1\": 0.7910204732299413,\n        \"nauc_recall_at_20_max\": 0.9047619047619062,\n        \"nauc_recall_at_20_std\": 0.5567625424153411,\n        \"nauc_recall_at_3_diff1\": 0.786212998712998,\n        \"nauc_recall_at_3_max\": 0.8689028314028308,\n        \"nauc_recall_at_3_std\": 0.4075370012870014,\n        \"nauc_recall_at_5_diff1\": 0.7746852599528486,\n        \"nauc_recall_at_5_max\": 0.8679428075098551,\n        \"nauc_recall_at_5_std\": 0.4342314997756967,\n        \"ndcg_at_1\": 0.74556,\n        \"ndcg_at_10\": 0.83939,\n        \"ndcg_at_100\": 0.85105,\n        \"ndcg_at_1000\": 0.85376,\n        \"ndcg_at_20\": 0.84625,\n        \"ndcg_at_3\": 0.81746,\n        \"ndcg_at_5\": 0.82712,\n        \"precision_at_1\": 0.74556,\n        \"precision_at_10\": 0.09278,\n        \"precision_at_100\": 0.0098,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04772,\n        \"precision_at_3\": 0.28889,\n        \"precision_at_5\": 0.178,\n        \"recall_at_1\": 0.74556,\n        \"recall_at_10\": 0.92778,\n        \"recall_at_100\": 0.98,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.95444,\n        \"recall_at_3\": 0.86667,\n        \"recall_at_5\": 0.89\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/openai/text-embedding-3-large/no_model_name_available/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 237.30947017669678,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.73634,\n        \"map_at_1\": 0.44241,\n        \"map_at_10\": 0.68383,\n        \"map_at_100\": 0.69176,\n        \"map_at_1000\": 0.6921,\n        \"map_at_20\": 0.68904,\n        \"map_at_3\": 0.64254,\n        \"map_at_5\": 0.6684,\n        \"mrr_at_1\": 0.6790540540540541,\n        \"mrr_at_10\": 0.7532972704847704,\n        \"mrr_at_100\": 0.7559985262633544,\n        \"mrr_at_1000\": 0.7561420435710626,\n        \"mrr_at_20\": 0.7550215149020293,\n        \"mrr_at_3\": 0.7446509009009006,\n        \"mrr_at_5\": 0.7494650900900897,\n        \"nauc_map_at_1000_diff1\": 0.48024490354329186,\n        \"nauc_map_at_1000_max\": 0.6577756188539895,\n        \"nauc_map_at_1000_std\": 0.32397669434789156,\n        \"nauc_map_at_100_diff1\": 0.4804109136170325,\n        \"nauc_map_at_100_max\": 0.6580401855215885,\n        \"nauc_map_at_100_std\": 0.324251519616049,\n        \"nauc_map_at_10_diff1\": 0.4781401379135908,\n        \"nauc_map_at_10_max\": 0.6568089319286831,\n        \"nauc_map_at_10_std\": 0.3202292904413023,\n        \"nauc_map_at_1_diff1\": 0.51999296982784,\n        \"nauc_map_at_1_max\": 0.34504071442645023,\n        \"nauc_map_at_1_std\": 0.08913155871900409,\n        \"nauc_map_at_20_diff1\": 0.4801684760313508,\n        \"nauc_map_at_20_max\": 0.6579232930060366,\n        \"nauc_map_at_20_std\": 0.32348525742939516,\n        \"nauc_map_at_3_diff1\": 0.4528236603136616,\n        \"nauc_map_at_3_max\": 0.6080448272990129,\n        \"nauc_map_at_3_std\": 0.2662375486373062,\n        \"nauc_map_at_5_diff1\": 0.46138854487159403,\n        \"nauc_map_at_5_max\": 0.644121088475665,\n        \"nauc_map_at_5_std\": 0.3124756372747152,\n        \"nauc_mrr_at_1000_diff1\": 0.54167194486031,\n        \"nauc_mrr_at_1000_max\": 0.6946953972618817,\n        \"nauc_mrr_at_1000_std\": 0.3866057057930993,\n        \"nauc_mrr_at_100_diff1\": 0.5417526786003602,\n        \"nauc_mrr_at_100_max\": 0.6948396323300571,\n        \"nauc_mrr_at_100_std\": 0.3868498594318191,\n        \"nauc_mrr_at_10_diff1\": 0.5419284774153654,\n        \"nauc_mrr_at_10_max\": 0.6964656597669708,\n        \"nauc_mrr_at_10_std\": 0.3867261217686278,\n        \"nauc_mrr_at_1_diff1\": 0.5547727290978133,\n        \"nauc_mrr_at_1_max\": 0.6386574505999577,\n        \"nauc_mrr_at_1_std\": 0.29287479172122255,\n        \"nauc_mrr_at_20_diff1\": 0.5410970500118761,\n        \"nauc_mrr_at_20_max\": 0.6952034358130702,\n        \"nauc_mrr_at_20_std\": 0.3869955866876459,\n        \"nauc_mrr_at_3_diff1\": 0.5372790416884039,\n        \"nauc_mrr_at_3_max\": 0.6956157270245855,\n        \"nauc_mrr_at_3_std\": 0.38559048071434454,\n        \"nauc_mrr_at_5_diff1\": 0.5384152692038623,\n        \"nauc_mrr_at_5_max\": 0.69596351576861,\n        \"nauc_mrr_at_5_std\": 0.38785563897547254,\n        \"nauc_ndcg_at_1000_diff1\": 0.5044511740728997,\n        \"nauc_ndcg_at_1000_max\": 0.696478013741544,\n        \"nauc_ndcg_at_1000_std\": 0.3854855467736299,\n        \"nauc_ndcg_at_100_diff1\": 0.5099500981488786,\n        \"nauc_ndcg_at_100_max\": 0.7039875042608843,\n        \"nauc_ndcg_at_100_std\": 0.39397458509915845,\n        \"nauc_ndcg_at_10_diff1\": 0.5010657696272983,\n        \"nauc_ndcg_at_10_max\": 0.7010178968298936,\n        \"nauc_ndcg_at_10_std\": 0.37961734234385697,\n        \"nauc_ndcg_at_1_diff1\": 0.5547727290978133,\n        \"nauc_ndcg_at_1_max\": 0.6386574505999577,\n        \"nauc_ndcg_at_1_std\": 0.29287479172122255,\n        \"nauc_ndcg_at_20_diff1\": 0.5063214529426214,\n        \"nauc_ndcg_at_20_max\": 0.703223309216109,\n        \"nauc_ndcg_at_20_std\": 0.3884921467593283,\n        \"nauc_ndcg_at_3_diff1\": 0.4665841947069789,\n        \"nauc_ndcg_at_3_max\": 0.6486065928362671,\n        \"nauc_ndcg_at_3_std\": 0.31098809930840826,\n        \"nauc_ndcg_at_5_diff1\": 0.47257352117214096,\n        \"nauc_ndcg_at_5_max\": 0.6798015549552966,\n        \"nauc_ndcg_at_5_std\": 0.36385777849580075,\n        \"nauc_precision_at_1000_diff1\": -0.2045792141194065,\n        \"nauc_precision_at_1000_max\": 0.0923983166590144,\n        \"nauc_precision_at_1000_std\": 0.1842917601255491,\n        \"nauc_precision_at_100_diff1\": -0.0924778240068036,\n        \"nauc_precision_at_100_max\": 0.23945740578209762,\n        \"nauc_precision_at_100_std\": 0.2772321794780336,\n        \"nauc_precision_at_10_diff1\": 0.0050384572423236235,\n        \"nauc_precision_at_10_max\": 0.38808155226369717,\n        \"nauc_precision_at_10_std\": 0.32186634654595453,\n        \"nauc_precision_at_1_diff1\": 0.5547727290978133,\n        \"nauc_precision_at_1_max\": 0.6386574505999577,\n        \"nauc_precision_at_1_std\": 0.29287479172122255,\n        \"nauc_precision_at_20_diff1\": -0.027283037477734473,\n        \"nauc_precision_at_20_max\": 0.331546778853098,\n        \"nauc_precision_at_20_std\": 0.3063002908816235,\n        \"nauc_precision_at_3_diff1\": 0.057265296872990146,\n        \"nauc_precision_at_3_max\": 0.5059780250293879,\n        \"nauc_precision_at_3_std\": 0.3348233691716301,\n        \"nauc_precision_at_5_diff1\": 0.02009426255892043,\n        \"nauc_precision_at_5_max\": 0.4538078963381503,\n        \"nauc_precision_at_5_std\": 0.35551411831086677,\n        \"nauc_recall_at_1000_diff1\": 0.5593920012054591,\n        \"nauc_recall_at_1000_max\": 0.9484961822611118,\n        \"nauc_recall_at_1000_std\": 0.9145594097008884,\n        \"nauc_recall_at_100_diff1\": 0.6054992834066972,\n        \"nauc_recall_at_100_max\": 0.8929036099365333,\n        \"nauc_recall_at_100_std\": 0.7177467917566535,\n        \"nauc_recall_at_10_diff1\": 0.5075914378203094,\n        \"nauc_recall_at_10_max\": 0.7804190681705211,\n        \"nauc_recall_at_10_std\": 0.49436746198645015,\n        \"nauc_recall_at_1_diff1\": 0.51999296982784,\n        \"nauc_recall_at_1_max\": 0.34504071442645023,\n        \"nauc_recall_at_1_std\": 0.08913155871900409,\n        \"nauc_recall_at_20_diff1\": 0.5361802043962446,\n        \"nauc_recall_at_20_max\": 0.8061942008149131,\n        \"nauc_recall_at_20_std\": 0.555787928974621,\n        \"nauc_recall_at_3_diff1\": 0.41912542875681236,\n        \"nauc_recall_at_3_max\": 0.633651990506452,\n        \"nauc_recall_at_3_std\": 0.3153751225453728,\n        \"nauc_recall_at_5_diff1\": 0.426538357846737,\n        \"nauc_recall_at_5_max\": 0.7052808185418215,\n        \"nauc_recall_at_5_std\": 0.4257365974276217,\n        \"ndcg_at_1\": 0.67905,\n        \"ndcg_at_10\": 0.73634,\n        \"ndcg_at_100\": 0.7627,\n        \"ndcg_at_1000\": 0.77106,\n        \"ndcg_at_20\": 0.74878,\n        \"ndcg_at_3\": 0.68791,\n        \"ndcg_at_5\": 0.7133,\n        \"precision_at_1\": 0.67905,\n        \"precision_at_10\": 0.15,\n        \"precision_at_100\": 0.01711,\n        \"precision_at_1000\": 0.00184,\n        \"precision_at_20\": 0.07931,\n        \"precision_at_3\": 0.41273,\n        \"precision_at_5\": 0.27399,\n        \"recall_at_1\": 0.44241,\n        \"recall_at_10\": 0.80961,\n        \"recall_at_100\": 0.91154,\n        \"recall_at_1000\": 0.9656,\n        \"recall_at_20\": 0.84899,\n        \"recall_at_3\": 0.70058,\n        \"recall_at_5\": 0.75421\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/openai/text-embedding-3-large/no_model_name_available/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 33137.345321416855,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.56248,\n        \"map_at_1\": 0.30948,\n        \"map_at_10\": 0.47448,\n        \"map_at_100\": 0.49609,\n        \"map_at_1000\": 0.49721,\n        \"map_at_20\": 0.48632,\n        \"map_at_3\": 0.41323,\n        \"map_at_5\": 0.44685,\n        \"mrr_at_1\": 0.5117370892018779,\n        \"mrr_at_10\": 0.6263469707131678,\n        \"mrr_at_100\": 0.6310493015293891,\n        \"mrr_at_1000\": 0.6312807995001647,\n        \"mrr_at_20\": 0.6296541877527791,\n        \"mrr_at_3\": 0.6056338028169013,\n        \"mrr_at_5\": 0.6187793427230046,\n        \"nauc_map_at_1000_diff1\": 0.37925146547858096,\n        \"nauc_map_at_1000_max\": 0.38393750763748724,\n        \"nauc_map_at_1000_std\": 0.05891865912238271,\n        \"nauc_map_at_100_diff1\": 0.3782379567688696,\n        \"nauc_map_at_100_max\": 0.38322503194927765,\n        \"nauc_map_at_100_std\": 0.058831474657309604,\n        \"nauc_map_at_10_diff1\": 0.3832710216827202,\n        \"nauc_map_at_10_max\": 0.36683267089602234,\n        \"nauc_map_at_10_std\": 0.026892103842806724,\n        \"nauc_map_at_1_diff1\": 0.49365461114311804,\n        \"nauc_map_at_1_max\": 0.2918514591021837,\n        \"nauc_map_at_1_std\": -0.11208835818015112,\n        \"nauc_map_at_20_diff1\": 0.3793428340027727,\n        \"nauc_map_at_20_max\": 0.3748696182549113,\n        \"nauc_map_at_20_std\": 0.04339019773594362,\n        \"nauc_map_at_3_diff1\": 0.4134825237458013,\n        \"nauc_map_at_3_max\": 0.33924523392135614,\n        \"nauc_map_at_3_std\": -0.03084896014209,\n        \"nauc_map_at_5_diff1\": 0.3992244042521568,\n        \"nauc_map_at_5_max\": 0.3502362451364744,\n        \"nauc_map_at_5_std\": -0.0008844652182879082,\n        \"nauc_mrr_at_1000_diff1\": 0.3804494072179413,\n        \"nauc_mrr_at_1000_max\": 0.41181085719579424,\n        \"nauc_mrr_at_1000_std\": 0.13615036332775504,\n        \"nauc_mrr_at_100_diff1\": 0.3802312256800871,\n        \"nauc_mrr_at_100_max\": 0.41152305903347564,\n        \"nauc_mrr_at_100_std\": 0.1365010579879352,\n        \"nauc_mrr_at_10_diff1\": 0.3798182269100851,\n        \"nauc_mrr_at_10_max\": 0.41366216007296513,\n        \"nauc_mrr_at_10_std\": 0.1389683805203404,\n        \"nauc_mrr_at_1_diff1\": 0.4160609388879719,\n        \"nauc_mrr_at_1_max\": 0.3532899641057627,\n        \"nauc_mrr_at_1_std\": 0.05289132915299127,\n        \"nauc_mrr_at_20_diff1\": 0.37803605444131233,\n        \"nauc_mrr_at_20_max\": 0.4109375741828441,\n        \"nauc_mrr_at_20_std\": 0.13732524262993256,\n        \"nauc_mrr_at_3_diff1\": 0.3824567401276728,\n        \"nauc_mrr_at_3_max\": 0.42021258755510976,\n        \"nauc_mrr_at_3_std\": 0.12955773749855876,\n        \"nauc_mrr_at_5_diff1\": 0.3789704117435803,\n        \"nauc_mrr_at_5_max\": 0.4147745485772556,\n        \"nauc_mrr_at_5_std\": 0.1369112019461578,\n        \"nauc_ndcg_at_1000_diff1\": 0.363053513038303,\n        \"nauc_ndcg_at_1000_max\": 0.42128006908240295,\n        \"nauc_ndcg_at_1000_std\": 0.13584194128028712,\n        \"nauc_ndcg_at_100_diff1\": 0.3506382906727237,\n        \"nauc_ndcg_at_100_max\": 0.4154933578112467,\n        \"nauc_ndcg_at_100_std\": 0.1419311999381482,\n        \"nauc_ndcg_at_10_diff1\": 0.35725727935664,\n        \"nauc_ndcg_at_10_max\": 0.39020719251422,\n        \"nauc_ndcg_at_10_std\": 0.07699604833791614,\n        \"nauc_ndcg_at_1_diff1\": 0.4160609388879719,\n        \"nauc_ndcg_at_1_max\": 0.3532899641057627,\n        \"nauc_ndcg_at_1_std\": 0.05289132915299127,\n        \"nauc_ndcg_at_20_diff1\": 0.34602119552486355,\n        \"nauc_ndcg_at_20_max\": 0.396721647626583,\n        \"nauc_ndcg_at_20_std\": 0.09923537325308451,\n        \"nauc_ndcg_at_3_diff1\": 0.3763835032280149,\n        \"nauc_ndcg_at_3_max\": 0.4000639447674701,\n        \"nauc_ndcg_at_3_std\": 0.0734424840936636,\n        \"nauc_ndcg_at_5_diff1\": 0.37576210381027525,\n        \"nauc_ndcg_at_5_max\": 0.38922798447671997,\n        \"nauc_ndcg_at_5_std\": 0.06607350859818849,\n        \"nauc_precision_at_1000_diff1\": -0.15659288685601278,\n        \"nauc_precision_at_1000_max\": 0.10073399800798498,\n        \"nauc_precision_at_1000_std\": 0.3600674256961004,\n        \"nauc_precision_at_100_diff1\": -0.17475131446533904,\n        \"nauc_precision_at_100_max\": 0.14409497116554254,\n        \"nauc_precision_at_100_std\": 0.41957566181019906,\n        \"nauc_precision_at_10_diff1\": -0.13137530202946976,\n        \"nauc_precision_at_10_max\": 0.24963100519082526,\n        \"nauc_precision_at_10_std\": 0.3958546008338007,\n        \"nauc_precision_at_1_diff1\": 0.4160609388879719,\n        \"nauc_precision_at_1_max\": 0.3532899641057627,\n        \"nauc_precision_at_1_std\": 0.05289132915299127,\n        \"nauc_precision_at_20_diff1\": -0.16766718583593815,\n        \"nauc_precision_at_20_max\": 0.21212193458523845,\n        \"nauc_precision_at_20_std\": 0.40767885355800093,\n        \"nauc_precision_at_3_diff1\": 0.028779165141450597,\n        \"nauc_precision_at_3_max\": 0.34986561938560257,\n        \"nauc_precision_at_3_std\": 0.3142930493368277,\n        \"nauc_precision_at_5_diff1\": -0.062490258776151913,\n        \"nauc_precision_at_5_max\": 0.2838887776811703,\n        \"nauc_precision_at_5_std\": 0.3754445793992626,\n        \"nauc_recall_at_1000_diff1\": 0.2625174161462087,\n        \"nauc_recall_at_1000_max\": 0.5058751981466968,\n        \"nauc_recall_at_1000_std\": 0.41365934629491147,\n        \"nauc_recall_at_100_diff1\": 0.19090263080722517,\n        \"nauc_recall_at_100_max\": 0.37715710310087497,\n        \"nauc_recall_at_100_std\": 0.3279595994770744,\n        \"nauc_recall_at_10_diff1\": 0.2638311881347135,\n        \"nauc_recall_at_10_max\": 0.31671324018241753,\n        \"nauc_recall_at_10_std\": 0.047722887210953885,\n        \"nauc_recall_at_1_diff1\": 0.49365461114311804,\n        \"nauc_recall_at_1_max\": 0.2918514591021837,\n        \"nauc_recall_at_1_std\": -0.11208835818015112,\n        \"nauc_recall_at_20_diff1\": 0.20618528582383414,\n        \"nauc_recall_at_20_max\": 0.3113722053667383,\n        \"nauc_recall_at_20_std\": 0.09157097795159481,\n        \"nauc_recall_at_3_diff1\": 0.3481381867556256,\n        \"nauc_recall_at_3_max\": 0.32068460146844313,\n        \"nauc_recall_at_3_std\": -0.03481664824465478,\n        \"nauc_recall_at_5_diff1\": 0.3112152698315664,\n        \"nauc_recall_at_5_max\": 0.3086393422242716,\n        \"nauc_recall_at_5_std\": -0.01626746932818709,\n        \"ndcg_at_1\": 0.51174,\n        \"ndcg_at_10\": 0.56248,\n        \"ndcg_at_100\": 0.62302,\n        \"ndcg_at_1000\": 0.63886,\n        \"ndcg_at_20\": 0.58752,\n        \"ndcg_at_3\": 0.51214,\n        \"ndcg_at_5\": 0.53072,\n        \"precision_at_1\": 0.51174,\n        \"precision_at_10\": 0.14319,\n        \"precision_at_100\": 0.02169,\n        \"precision_at_1000\": 0.00245,\n        \"precision_at_20\": 0.08404,\n        \"precision_at_3\": 0.30516,\n        \"precision_at_5\": 0.23005,\n        \"recall_at_1\": 0.30948,\n        \"recall_at_10\": 0.66458,\n        \"recall_at_100\": 0.86656,\n        \"recall_at_1000\": 0.96072,\n        \"recall_at_20\": 0.73488,\n        \"recall_at_3\": 0.48693,\n        \"recall_at_5\": 0.56965\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/openai/text-embedding-3-large/no_model_name_available/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 33973.33324599266,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.44728,\n        \"map_at_1\": 0.28583,\n        \"map_at_10\": 0.38924,\n        \"map_at_100\": 0.39971,\n        \"map_at_1000\": 0.40018,\n        \"map_at_20\": 0.3961,\n        \"map_at_3\": 0.35854,\n        \"map_at_5\": 0.37754,\n        \"mrr_at_1\": 0.3087885985748218,\n        \"mrr_at_10\": 0.4115861704935341,\n        \"mrr_at_100\": 0.41973492049542444,\n        \"mrr_at_1000\": 0.4200780686652876,\n        \"mrr_at_20\": 0.4168646874081562,\n        \"mrr_at_3\": 0.3828186856690421,\n        \"mrr_at_5\": 0.4013460015835315,\n        \"nauc_map_at_1000_diff1\": 0.48372971824247185,\n        \"nauc_map_at_1000_max\": 0.40168966875755646,\n        \"nauc_map_at_1000_std\": 0.1285061926289655,\n        \"nauc_map_at_100_diff1\": 0.4833848030996116,\n        \"nauc_map_at_100_max\": 0.4018035826214681,\n        \"nauc_map_at_100_std\": 0.12885925526978198,\n        \"nauc_map_at_10_diff1\": 0.4830161176312886,\n        \"nauc_map_at_10_max\": 0.3985904062346475,\n        \"nauc_map_at_10_std\": 0.11965352228819547,\n        \"nauc_map_at_1_diff1\": 0.5746242473139114,\n        \"nauc_map_at_1_max\": 0.396500930373006,\n        \"nauc_map_at_1_std\": 0.09460472034396682,\n        \"nauc_map_at_20_diff1\": 0.4836382254283399,\n        \"nauc_map_at_20_max\": 0.40127233440151805,\n        \"nauc_map_at_20_std\": 0.12589792975498248,\n        \"nauc_map_at_3_diff1\": 0.4936982288981077,\n        \"nauc_map_at_3_max\": 0.4028372641792409,\n        \"nauc_map_at_3_std\": 0.10674461390494162,\n        \"nauc_map_at_5_diff1\": 0.48598164884819683,\n        \"nauc_map_at_5_max\": 0.401841357514279,\n        \"nauc_map_at_5_std\": 0.11702141380744592,\n        \"nauc_mrr_at_1000_diff1\": 0.4943420682279905,\n        \"nauc_mrr_at_1000_max\": 0.41808539497314195,\n        \"nauc_mrr_at_1000_std\": 0.1598519050725324,\n        \"nauc_mrr_at_100_diff1\": 0.4940577062017333,\n        \"nauc_mrr_at_100_max\": 0.41816429953760254,\n        \"nauc_mrr_at_100_std\": 0.16004526001331285,\n        \"nauc_mrr_at_10_diff1\": 0.4934310284365195,\n        \"nauc_mrr_at_10_max\": 0.41665182716899923,\n        \"nauc_mrr_at_10_std\": 0.15560215149520606,\n        \"nauc_mrr_at_1_diff1\": 0.5724327254732907,\n        \"nauc_mrr_at_1_max\": 0.4058774880102169,\n        \"nauc_mrr_at_1_std\": 0.1250378922282418,\n        \"nauc_mrr_at_20_diff1\": 0.49445123004973524,\n        \"nauc_mrr_at_20_max\": 0.41857409422818076,\n        \"nauc_mrr_at_20_std\": 0.15927696365870916,\n        \"nauc_mrr_at_3_diff1\": 0.5036890367233479,\n        \"nauc_mrr_at_3_max\": 0.4203619306278547,\n        \"nauc_mrr_at_3_std\": 0.1395379625838852,\n        \"nauc_mrr_at_5_diff1\": 0.49654517183667035,\n        \"nauc_mrr_at_5_max\": 0.4185014234088432,\n        \"nauc_mrr_at_5_std\": 0.15114613437898916,\n        \"nauc_ndcg_at_1000_diff1\": 0.4625779088303276,\n        \"nauc_ndcg_at_1000_max\": 0.41406576604336215,\n        \"nauc_ndcg_at_1000_std\": 0.17748518231716406,\n        \"nauc_ndcg_at_100_diff1\": 0.45159432918365955,\n        \"nauc_ndcg_at_100_max\": 0.41426577077646537,\n        \"nauc_ndcg_at_100_std\": 0.18599051372730077,\n        \"nauc_ndcg_at_10_diff1\": 0.4522864180155836,\n        \"nauc_ndcg_at_10_max\": 0.4011682556085032,\n        \"nauc_ndcg_at_10_std\": 0.14626934147248594,\n        \"nauc_ndcg_at_1_diff1\": 0.5724327254732907,\n        \"nauc_ndcg_at_1_max\": 0.4058774880102169,\n        \"nauc_ndcg_at_1_std\": 0.1250378922282418,\n        \"nauc_ndcg_at_20_diff1\": 0.45435864027081746,\n        \"nauc_ndcg_at_20_max\": 0.40988667988806715,\n        \"nauc_ndcg_at_20_std\": 0.16624740189899134,\n        \"nauc_ndcg_at_3_diff1\": 0.47389621715921837,\n        \"nauc_ndcg_at_3_max\": 0.40901774289509407,\n        \"nauc_ndcg_at_3_std\": 0.11705012854210183,\n        \"nauc_ndcg_at_5_diff1\": 0.45980908807654736,\n        \"nauc_ndcg_at_5_max\": 0.40752173290426674,\n        \"nauc_ndcg_at_5_std\": 0.13774330119040987,\n        \"nauc_precision_at_1000_diff1\": 0.04140219661244718,\n        \"nauc_precision_at_1000_max\": 0.17654948776428595,\n        \"nauc_precision_at_1000_std\": 0.3039186497711353,\n        \"nauc_precision_at_100_diff1\": 0.05980477244767715,\n        \"nauc_precision_at_100_max\": 0.24382763958828502,\n        \"nauc_precision_at_100_std\": 0.3711864834409094,\n        \"nauc_precision_at_10_diff1\": 0.2614488984819199,\n        \"nauc_precision_at_10_max\": 0.3408588588696674,\n        \"nauc_precision_at_10_std\": 0.21319520575289586,\n        \"nauc_precision_at_1_diff1\": 0.5724327254732907,\n        \"nauc_precision_at_1_max\": 0.4058774880102169,\n        \"nauc_precision_at_1_std\": 0.1250378922282418,\n        \"nauc_precision_at_20_diff1\": 0.20986441359275726,\n        \"nauc_precision_at_20_max\": 0.3232709607257924,\n        \"nauc_precision_at_20_std\": 0.28231811638624704,\n        \"nauc_precision_at_3_diff1\": 0.38717992771711085,\n        \"nauc_precision_at_3_max\": 0.4146312510950824,\n        \"nauc_precision_at_3_std\": 0.1439453573034876,\n        \"nauc_precision_at_5_diff1\": 0.3288179741781324,\n        \"nauc_precision_at_5_max\": 0.3957686802944973,\n        \"nauc_precision_at_5_std\": 0.19930637202133739,\n        \"nauc_recall_at_1000_diff1\": 0.35946258297874323,\n        \"nauc_recall_at_1000_max\": 0.5201793036771298,\n        \"nauc_recall_at_1000_std\": 0.590054630887816,\n        \"nauc_recall_at_100_diff1\": 0.24716884378565085,\n        \"nauc_recall_at_100_max\": 0.46118861559094754,\n        \"nauc_recall_at_100_std\": 0.5169952188036749,\n        \"nauc_recall_at_10_diff1\": 0.32824913211442686,\n        \"nauc_recall_at_10_max\": 0.37297663482851995,\n        \"nauc_recall_at_10_std\": 0.19311853884927607,\n        \"nauc_recall_at_1_diff1\": 0.5746242473139114,\n        \"nauc_recall_at_1_max\": 0.396500930373006,\n        \"nauc_recall_at_1_std\": 0.09460472034396682,\n        \"nauc_recall_at_20_diff1\": 0.3223491189352304,\n        \"nauc_recall_at_20_max\": 0.40927823196987545,\n        \"nauc_recall_at_20_std\": 0.28640455005390064,\n        \"nauc_recall_at_3_diff1\": 0.39794868348142554,\n        \"nauc_recall_at_3_max\": 0.397940641626162,\n        \"nauc_recall_at_3_std\": 0.11302745138912197,\n        \"nauc_recall_at_5_diff1\": 0.35830984073737415,\n        \"nauc_recall_at_5_max\": 0.393494120447945,\n        \"nauc_recall_at_5_std\": 0.16341818262680563,\n        \"ndcg_at_1\": 0.30879,\n        \"ndcg_at_10\": 0.44728,\n        \"ndcg_at_100\": 0.49391,\n        \"ndcg_at_1000\": 0.50578,\n        \"ndcg_at_20\": 0.46943,\n        \"ndcg_at_3\": 0.38692,\n        \"ndcg_at_5\": 0.42028,\n        \"precision_at_1\": 0.30879,\n        \"precision_at_10\": 0.0677,\n        \"precision_at_100\": 0.00938,\n        \"precision_at_1000\": 0.00105,\n        \"precision_at_20\": 0.03884,\n        \"precision_at_3\": 0.1631,\n        \"precision_at_5\": 0.11639,\n        \"recall_at_1\": 0.28583,\n        \"recall_at_10\": 0.60451,\n        \"recall_at_100\": 0.81235,\n        \"recall_at_1000\": 0.9038,\n        \"recall_at_20\": 0.68725,\n        \"recall_at_3\": 0.44576,\n        \"recall_at_5\": 0.52336\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/openai/text-embedding-3-large/no_model_name_available/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 791.2342638969421,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.31108,\n        \"map_at_1\": 0.225,\n        \"map_at_10\": 0.27634,\n        \"map_at_100\": 0.28547,\n        \"map_at_1000\": 0.2864,\n        \"map_at_20\": 0.28083,\n        \"map_at_3\": 0.25333,\n        \"map_at_5\": 0.26533,\n        \"mrr_at_1\": 0.225,\n        \"mrr_at_10\": 0.2763373015873016,\n        \"mrr_at_100\": 0.28547413152370693,\n        \"mrr_at_1000\": 0.2864043033289739,\n        \"mrr_at_20\": 0.28082997615989114,\n        \"mrr_at_3\": 0.2533333333333333,\n        \"mrr_at_5\": 0.26533333333333337,\n        \"nauc_map_at_1000_diff1\": 0.5827440283312539,\n        \"nauc_map_at_1000_max\": 0.47121346840093437,\n        \"nauc_map_at_1000_std\": 0.01761850507064754,\n        \"nauc_map_at_100_diff1\": 0.5818862178246292,\n        \"nauc_map_at_100_max\": 0.4702677970629844,\n        \"nauc_map_at_100_std\": 0.01732113924124195,\n        \"nauc_map_at_10_diff1\": 0.5854386442392447,\n        \"nauc_map_at_10_max\": 0.47577814442978594,\n        \"nauc_map_at_10_std\": 0.013683084601007884,\n        \"nauc_map_at_1_diff1\": 0.6303121271600662,\n        \"nauc_map_at_1_max\": 0.45306546588153795,\n        \"nauc_map_at_1_std\": -0.03716276026632798,\n        \"nauc_map_at_20_diff1\": 0.5828572421752594,\n        \"nauc_map_at_20_max\": 0.46939532577476534,\n        \"nauc_map_at_20_std\": 0.012200111756481068,\n        \"nauc_map_at_3_diff1\": 0.5953459236004133,\n        \"nauc_map_at_3_max\": 0.4673015424214653,\n        \"nauc_map_at_3_std\": -0.007863229530253665,\n        \"nauc_map_at_5_diff1\": 0.596001269055143,\n        \"nauc_map_at_5_max\": 0.47341165290086296,\n        \"nauc_map_at_5_std\": 0.005731512744635958,\n        \"nauc_mrr_at_1000_diff1\": 0.5827440283312539,\n        \"nauc_mrr_at_1000_max\": 0.47121346840093437,\n        \"nauc_mrr_at_1000_std\": 0.01761850507064754,\n        \"nauc_mrr_at_100_diff1\": 0.5818862178246292,\n        \"nauc_mrr_at_100_max\": 0.4702677970629844,\n        \"nauc_mrr_at_100_std\": 0.01732113924124195,\n        \"nauc_mrr_at_10_diff1\": 0.5854386442392447,\n        \"nauc_mrr_at_10_max\": 0.47577814442978594,\n        \"nauc_mrr_at_10_std\": 0.013683084601007884,\n        \"nauc_mrr_at_1_diff1\": 0.6303121271600662,\n        \"nauc_mrr_at_1_max\": 0.45306546588153795,\n        \"nauc_mrr_at_1_std\": -0.03716276026632798,\n        \"nauc_mrr_at_20_diff1\": 0.5828572421752594,\n        \"nauc_mrr_at_20_max\": 0.46939532577476534,\n        \"nauc_mrr_at_20_std\": 0.012200111756481068,\n        \"nauc_mrr_at_3_diff1\": 0.5953459236004133,\n        \"nauc_mrr_at_3_max\": 0.4673015424214653,\n        \"nauc_mrr_at_3_std\": -0.007863229530253665,\n        \"nauc_mrr_at_5_diff1\": 0.596001269055143,\n        \"nauc_mrr_at_5_max\": 0.47341165290086296,\n        \"nauc_mrr_at_5_std\": 0.005731512744635958,\n        \"nauc_ndcg_at_1000_diff1\": 0.5519537330473182,\n        \"nauc_ndcg_at_1000_max\": 0.4776051956831099,\n        \"nauc_ndcg_at_1000_std\": 0.07098420071862646,\n        \"nauc_ndcg_at_100_diff1\": 0.5358392865731979,\n        \"nauc_ndcg_at_100_max\": 0.46350611930764696,\n        \"nauc_ndcg_at_100_std\": 0.07691855816662034,\n        \"nauc_ndcg_at_10_diff1\": 0.558761866391538,\n        \"nauc_ndcg_at_10_max\": 0.4815954148923924,\n        \"nauc_ndcg_at_10_std\": 0.04145292681314251,\n        \"nauc_ndcg_at_1_diff1\": 0.6303121271600662,\n        \"nauc_ndcg_at_1_max\": 0.45306546588153795,\n        \"nauc_ndcg_at_1_std\": -0.03716276026632798,\n        \"nauc_ndcg_at_20_diff1\": 0.5458553168628171,\n        \"nauc_ndcg_at_20_max\": 0.45640758615377236,\n        \"nauc_ndcg_at_20_std\": 0.037411713002657526,\n        \"nauc_ndcg_at_3_diff1\": 0.581931256292059,\n        \"nauc_ndcg_at_3_max\": 0.4672095603839993,\n        \"nauc_ndcg_at_3_std\": 0.0010732582708155496,\n        \"nauc_ndcg_at_5_diff1\": 0.5828683592678144,\n        \"nauc_ndcg_at_5_max\": 0.4768678411192577,\n        \"nauc_ndcg_at_5_std\": 0.023373647848388267,\n        \"nauc_precision_at_1000_diff1\": 0.22665732959850426,\n        \"nauc_precision_at_1000_max\": 0.6512313258636786,\n        \"nauc_precision_at_1000_std\": 0.7869105975723624,\n        \"nauc_precision_at_100_diff1\": 0.31753884685256706,\n        \"nauc_precision_at_100_max\": 0.4285852866994729,\n        \"nauc_precision_at_100_std\": 0.3884332504365306,\n        \"nauc_precision_at_10_diff1\": 0.4804829757538381,\n        \"nauc_precision_at_10_max\": 0.49708851309682217,\n        \"nauc_precision_at_10_std\": 0.12169171346035226,\n        \"nauc_precision_at_1_diff1\": 0.6303121271600662,\n        \"nauc_precision_at_1_max\": 0.45306546588153795,\n        \"nauc_precision_at_1_std\": -0.03716276026632798,\n        \"nauc_precision_at_20_diff1\": 0.42342438374417013,\n        \"nauc_precision_at_20_max\": 0.39866755496335765,\n        \"nauc_precision_at_20_std\": 0.11081279147235165,\n        \"nauc_precision_at_3_diff1\": 0.544668488935896,\n        \"nauc_precision_at_3_max\": 0.46566762358694047,\n        \"nauc_precision_at_3_std\": 0.025362965811848406,\n        \"nauc_precision_at_5_diff1\": 0.5472598349226488,\n        \"nauc_precision_at_5_max\": 0.48527983188279383,\n        \"nauc_precision_at_5_std\": 0.0718595322588108,\n        \"nauc_recall_at_1000_diff1\": 0.2266573295985049,\n        \"nauc_recall_at_1000_max\": 0.6512313258636785,\n        \"nauc_recall_at_1000_std\": 0.7869105975723616,\n        \"nauc_recall_at_100_diff1\": 0.3175388468525674,\n        \"nauc_recall_at_100_max\": 0.42858528669947293,\n        \"nauc_recall_at_100_std\": 0.38843325043653104,\n        \"nauc_recall_at_10_diff1\": 0.4804829757538381,\n        \"nauc_recall_at_10_max\": 0.4970885130968222,\n        \"nauc_recall_at_10_std\": 0.12169171346035257,\n        \"nauc_recall_at_1_diff1\": 0.6303121271600662,\n        \"nauc_recall_at_1_max\": 0.45306546588153795,\n        \"nauc_recall_at_1_std\": -0.03716276026632798,\n        \"nauc_recall_at_20_diff1\": 0.4234243837441704,\n        \"nauc_recall_at_20_max\": 0.39866755496335765,\n        \"nauc_recall_at_20_std\": 0.11081279147235173,\n        \"nauc_recall_at_3_diff1\": 0.5446684889358954,\n        \"nauc_recall_at_3_max\": 0.46566762358694014,\n        \"nauc_recall_at_3_std\": 0.0253629658118484,\n        \"nauc_recall_at_5_diff1\": 0.5472598349226487,\n        \"nauc_recall_at_5_max\": 0.4852798318827938,\n        \"nauc_recall_at_5_std\": 0.07185953225881045,\n        \"ndcg_at_1\": 0.225,\n        \"ndcg_at_10\": 0.31108,\n        \"ndcg_at_100\": 0.36408,\n        \"ndcg_at_1000\": 0.3922,\n        \"ndcg_at_20\": 0.32913,\n        \"ndcg_at_3\": 0.26274,\n        \"ndcg_at_5\": 0.28489,\n        \"precision_at_1\": 0.225,\n        \"precision_at_10\": 0.0425,\n        \"precision_at_100\": 0.0069,\n        \"precision_at_1000\": 0.00092,\n        \"precision_at_20\": 0.025,\n        \"precision_at_3\": 0.09667,\n        \"precision_at_5\": 0.069,\n        \"recall_at_1\": 0.225,\n        \"recall_at_10\": 0.425,\n        \"recall_at_100\": 0.69,\n        \"recall_at_1000\": 0.92,\n        \"recall_at_20\": 0.5,\n        \"recall_at_3\": 0.29,\n        \"recall_at_5\": 0.345\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.28479,\n        \"map_at_1\": 0.2,\n        \"map_at_10\": 0.25486,\n        \"map_at_100\": 0.26535,\n        \"map_at_1000\": 0.26645,\n        \"map_at_20\": 0.26155,\n        \"map_at_3\": 0.23917,\n        \"map_at_5\": 0.24692,\n        \"mrr_at_1\": 0.2,\n        \"mrr_at_10\": 0.2548571428571429,\n        \"mrr_at_100\": 0.2653479973134919,\n        \"mrr_at_1000\": 0.2664475273861746,\n        \"mrr_at_20\": 0.26155286766896685,\n        \"mrr_at_3\": 0.23916666666666672,\n        \"mrr_at_5\": 0.2469166666666667,\n        \"nauc_map_at_1000_diff1\": 0.4582594378042708,\n        \"nauc_map_at_1000_max\": 0.3948624842187872,\n        \"nauc_map_at_1000_std\": -0.03468906962815208,\n        \"nauc_map_at_100_diff1\": 0.457657589855601,\n        \"nauc_map_at_100_max\": 0.3943825734840979,\n        \"nauc_map_at_100_std\": -0.03445673443990469,\n        \"nauc_map_at_10_diff1\": 0.4609797691297197,\n        \"nauc_map_at_10_max\": 0.39313889251279743,\n        \"nauc_map_at_10_std\": -0.04730129167400886,\n        \"nauc_map_at_1_diff1\": 0.4804246044559252,\n        \"nauc_map_at_1_max\": 0.38819825637713934,\n        \"nauc_map_at_1_std\": -0.06094607684856327,\n        \"nauc_map_at_20_diff1\": 0.45850715411026194,\n        \"nauc_map_at_20_max\": 0.39479073700656353,\n        \"nauc_map_at_20_std\": -0.03687865755487684,\n        \"nauc_map_at_3_diff1\": 0.47511215498825665,\n        \"nauc_map_at_3_max\": 0.39136309716515716,\n        \"nauc_map_at_3_std\": -0.073459173584297,\n        \"nauc_map_at_5_diff1\": 0.46072255066461987,\n        \"nauc_map_at_5_max\": 0.38753280167396637,\n        \"nauc_map_at_5_std\": -0.06931887538819474,\n        \"nauc_mrr_at_1000_diff1\": 0.4582594378042708,\n        \"nauc_mrr_at_1000_max\": 0.3948624842187872,\n        \"nauc_mrr_at_1000_std\": -0.03468906962815208,\n        \"nauc_mrr_at_100_diff1\": 0.457657589855601,\n        \"nauc_mrr_at_100_max\": 0.3943825734840979,\n        \"nauc_mrr_at_100_std\": -0.03445673443990469,\n        \"nauc_mrr_at_10_diff1\": 0.4609797691297197,\n        \"nauc_mrr_at_10_max\": 0.39313889251279743,\n        \"nauc_mrr_at_10_std\": -0.04730129167400886,\n        \"nauc_mrr_at_1_diff1\": 0.4804246044559252,\n        \"nauc_mrr_at_1_max\": 0.38819825637713934,\n        \"nauc_mrr_at_1_std\": -0.06094607684856327,\n        \"nauc_mrr_at_20_diff1\": 0.45850715411026194,\n        \"nauc_mrr_at_20_max\": 0.39479073700656353,\n        \"nauc_mrr_at_20_std\": -0.03687865755487684,\n        \"nauc_mrr_at_3_diff1\": 0.47511215498825665,\n        \"nauc_mrr_at_3_max\": 0.39136309716515716,\n        \"nauc_mrr_at_3_std\": -0.073459173584297,\n        \"nauc_mrr_at_5_diff1\": 0.46072255066461987,\n        \"nauc_mrr_at_5_max\": 0.38753280167396637,\n        \"nauc_mrr_at_5_std\": -0.06931887538819474,\n        \"nauc_ndcg_at_1000_diff1\": 0.4488569762316068,\n        \"nauc_ndcg_at_1000_max\": 0.40849512245632413,\n        \"nauc_ndcg_at_1000_std\": 0.027126231441878132,\n        \"nauc_ndcg_at_100_diff1\": 0.4363550168495924,\n        \"nauc_ndcg_at_100_max\": 0.40152755948454205,\n        \"nauc_ndcg_at_100_std\": 0.036757853379914364,\n        \"nauc_ndcg_at_10_diff1\": 0.44503079744042595,\n        \"nauc_ndcg_at_10_max\": 0.39587888961386797,\n        \"nauc_ndcg_at_10_std\": -0.017562145039247794,\n        \"nauc_ndcg_at_1_diff1\": 0.4804246044559252,\n        \"nauc_ndcg_at_1_max\": 0.38819825637713934,\n        \"nauc_ndcg_at_1_std\": -0.06094607684856327,\n        \"nauc_ndcg_at_20_diff1\": 0.43562189371533044,\n        \"nauc_ndcg_at_20_max\": 0.4023564273040959,\n        \"nauc_ndcg_at_20_std\": 0.020538959255559326,\n        \"nauc_ndcg_at_3_diff1\": 0.4686025661010145,\n        \"nauc_ndcg_at_3_max\": 0.3898646738127454,\n        \"nauc_ndcg_at_3_std\": -0.0745048617099372,\n        \"nauc_ndcg_at_5_diff1\": 0.44299593443243157,\n        \"nauc_ndcg_at_5_max\": 0.38332430221771063,\n        \"nauc_ndcg_at_5_std\": -0.066726525440986,\n        \"nauc_precision_at_1000_diff1\": 0.5314439501290708,\n        \"nauc_precision_at_1000_max\": 0.6654858021640021,\n        \"nauc_precision_at_1000_std\": 0.7862086010874936,\n        \"nauc_precision_at_100_diff1\": 0.37186915127349696,\n        \"nauc_precision_at_100_max\": 0.4383106843518594,\n        \"nauc_precision_at_100_std\": 0.3533810725038655,\n        \"nauc_precision_at_10_diff1\": 0.40163231357055595,\n        \"nauc_precision_at_10_max\": 0.4053037194915917,\n        \"nauc_precision_at_10_std\": 0.0749551633613182,\n        \"nauc_precision_at_1_diff1\": 0.4804246044559252,\n        \"nauc_precision_at_1_max\": 0.38819825637713934,\n        \"nauc_precision_at_1_std\": -0.06094607684856327,\n        \"nauc_precision_at_20_diff1\": 0.3656232281543797,\n        \"nauc_precision_at_20_max\": 0.4300689618797718,\n        \"nauc_precision_at_20_std\": 0.21663655902635845,\n        \"nauc_precision_at_3_diff1\": 0.44994024971498453,\n        \"nauc_precision_at_3_max\": 0.38519703858357507,\n        \"nauc_precision_at_3_std\": -0.07651470406439288,\n        \"nauc_precision_at_5_diff1\": 0.39206566347469224,\n        \"nauc_precision_at_5_max\": 0.37099195889359715,\n        \"nauc_precision_at_5_std\": -0.05794267792199136,\n        \"nauc_recall_at_1000_diff1\": 0.5314439501290714,\n        \"nauc_recall_at_1000_max\": 0.6654858021640025,\n        \"nauc_recall_at_1000_std\": 0.7862086010874946,\n        \"nauc_recall_at_100_diff1\": 0.3718691512734966,\n        \"nauc_recall_at_100_max\": 0.4383106843518591,\n        \"nauc_recall_at_100_std\": 0.35338107250386497,\n        \"nauc_recall_at_10_diff1\": 0.4016323135705559,\n        \"nauc_recall_at_10_max\": 0.4053037194915914,\n        \"nauc_recall_at_10_std\": 0.07495516336131847,\n        \"nauc_recall_at_1_diff1\": 0.4804246044559252,\n        \"nauc_recall_at_1_max\": 0.38819825637713934,\n        \"nauc_recall_at_1_std\": -0.06094607684856327,\n        \"nauc_recall_at_20_diff1\": 0.3656232281543799,\n        \"nauc_recall_at_20_max\": 0.43006896187977184,\n        \"nauc_recall_at_20_std\": 0.21663655902635856,\n        \"nauc_recall_at_3_diff1\": 0.44994024971498436,\n        \"nauc_recall_at_3_max\": 0.3851970385835748,\n        \"nauc_recall_at_3_std\": -0.07651470406439295,\n        \"nauc_recall_at_5_diff1\": 0.39206566347469235,\n        \"nauc_recall_at_5_max\": 0.3709919588935971,\n        \"nauc_recall_at_5_std\": -0.057942677921991474,\n        \"ndcg_at_1\": 0.2,\n        \"ndcg_at_10\": 0.28479,\n        \"ndcg_at_100\": 0.33976,\n        \"ndcg_at_1000\": 0.37259,\n        \"ndcg_at_20\": 0.3081,\n        \"ndcg_at_3\": 0.2522,\n        \"ndcg_at_5\": 0.2664,\n        \"precision_at_1\": 0.2,\n        \"precision_at_10\": 0.038,\n        \"precision_at_100\": 0.0065,\n        \"precision_at_1000\": 0.00092,\n        \"precision_at_20\": 0.0235,\n        \"precision_at_3\": 0.09667,\n        \"precision_at_5\": 0.065,\n        \"recall_at_1\": 0.2,\n        \"recall_at_10\": 0.38,\n        \"recall_at_100\": 0.65,\n        \"recall_at_1000\": 0.915,\n        \"recall_at_20\": 0.47,\n        \"recall_at_3\": 0.29,\n        \"recall_at_5\": 0.325\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/openai/text-embedding-3-large/no_model_name_available/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 5.753293514251709,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.85617,\n        \"map_at_1\": 0.72727,\n        \"map_at_10\": 0.818,\n        \"map_at_100\": 0.81972,\n        \"map_at_1000\": 0.81972,\n        \"map_at_20\": 0.81972,\n        \"map_at_3\": 0.80519,\n        \"map_at_5\": 0.80844,\n        \"mrr_at_1\": 0.7272727272727273,\n        \"mrr_at_10\": 0.8180014430014431,\n        \"mrr_at_100\": 0.8197219447219448,\n        \"mrr_at_1000\": 0.8197219447219448,\n        \"mrr_at_20\": 0.8197219447219448,\n        \"mrr_at_3\": 0.8051948051948052,\n        \"mrr_at_5\": 0.8084415584415584,\n        \"nauc_map_at_1000_diff1\": 0.646244043446091,\n        \"nauc_map_at_1000_max\": 0.11771466620451258,\n        \"nauc_map_at_1000_std\": -0.22293982162876316,\n        \"nauc_map_at_100_diff1\": 0.646244043446091,\n        \"nauc_map_at_100_max\": 0.11771466620451258,\n        \"nauc_map_at_100_std\": -0.22293982162876316,\n        \"nauc_map_at_10_diff1\": 0.642856708479778,\n        \"nauc_map_at_10_max\": 0.11035422874096561,\n        \"nauc_map_at_10_std\": -0.22329349236179952,\n        \"nauc_map_at_1_diff1\": 0.6496291120568579,\n        \"nauc_map_at_1_max\": 0.08105503859326908,\n        \"nauc_map_at_1_std\": -0.15869430013902078,\n        \"nauc_map_at_20_diff1\": 0.646244043446091,\n        \"nauc_map_at_20_max\": 0.11771466620451258,\n        \"nauc_map_at_20_std\": -0.22293982162876316,\n        \"nauc_map_at_3_diff1\": 0.6487588838089147,\n        \"nauc_map_at_3_max\": 0.13649166333805868,\n        \"nauc_map_at_3_std\": -0.24378692695065055,\n        \"nauc_map_at_5_diff1\": 0.6422022858465769,\n        \"nauc_map_at_5_max\": 0.13669426466557213,\n        \"nauc_map_at_5_std\": -0.2378759106262703,\n        \"nauc_mrr_at_1000_diff1\": 0.646244043446091,\n        \"nauc_mrr_at_1000_max\": 0.11771466620451258,\n        \"nauc_mrr_at_1000_std\": -0.22293982162876316,\n        \"nauc_mrr_at_100_diff1\": 0.646244043446091,\n        \"nauc_mrr_at_100_max\": 0.11771466620451258,\n        \"nauc_mrr_at_100_std\": -0.22293982162876316,\n        \"nauc_mrr_at_10_diff1\": 0.642856708479778,\n        \"nauc_mrr_at_10_max\": 0.11035422874096561,\n        \"nauc_mrr_at_10_std\": -0.22329349236179952,\n        \"nauc_mrr_at_1_diff1\": 0.6496291120568579,\n        \"nauc_mrr_at_1_max\": 0.08105503859326908,\n        \"nauc_mrr_at_1_std\": -0.15869430013902078,\n        \"nauc_mrr_at_20_diff1\": 0.646244043446091,\n        \"nauc_mrr_at_20_max\": 0.11771466620451258,\n        \"nauc_mrr_at_20_std\": -0.22293982162876316,\n        \"nauc_mrr_at_3_diff1\": 0.6487588838089147,\n        \"nauc_mrr_at_3_max\": 0.13649166333805868,\n        \"nauc_mrr_at_3_std\": -0.24378692695065055,\n        \"nauc_mrr_at_5_diff1\": 0.6422022858465769,\n        \"nauc_mrr_at_5_max\": 0.13669426466557213,\n        \"nauc_mrr_at_5_std\": -0.2378759106262703,\n        \"nauc_ndcg_at_1000_diff1\": 0.6454336670366856,\n        \"nauc_ndcg_at_1000_max\": 0.1204399199301231,\n        \"nauc_ndcg_at_1000_std\": -0.22851662405485756,\n        \"nauc_ndcg_at_100_diff1\": 0.6454336670366856,\n        \"nauc_ndcg_at_100_max\": 0.1204399199301231,\n        \"nauc_ndcg_at_100_std\": -0.22851662405485756,\n        \"nauc_ndcg_at_10_diff1\": 0.6325430114209823,\n        \"nauc_ndcg_at_10_max\": 0.09272330063627189,\n        \"nauc_ndcg_at_10_std\": -0.22420639498410985,\n        \"nauc_ndcg_at_1_diff1\": 0.6496291120568579,\n        \"nauc_ndcg_at_1_max\": 0.08105503859326908,\n        \"nauc_ndcg_at_1_std\": -0.15869430013902078,\n        \"nauc_ndcg_at_20_diff1\": 0.6454336670366856,\n        \"nauc_ndcg_at_20_max\": 0.1204399199301231,\n        \"nauc_ndcg_at_20_std\": -0.22851662405485756,\n        \"nauc_ndcg_at_3_diff1\": 0.6474924583756264,\n        \"nauc_ndcg_at_3_max\": 0.16124916234667075,\n        \"nauc_ndcg_at_3_std\": -0.2811007748212722,\n        \"nauc_ndcg_at_5_diff1\": 0.6345773846760506,\n        \"nauc_ndcg_at_5_max\": 0.1625538675994191,\n        \"nauc_ndcg_at_5_std\": -0.2708662815048982,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.4167090338610833,\n        \"nauc_precision_at_10_max\": -0.36527093203830124,\n        \"nauc_precision_at_10_std\": -0.08218269674418595,\n        \"nauc_precision_at_1_diff1\": 0.6496291120568579,\n        \"nauc_precision_at_1_max\": 0.08105503859326908,\n        \"nauc_precision_at_1_std\": -0.15869430013902078,\n        \"nauc_precision_at_20_diff1\": 1.0,\n        \"nauc_precision_at_20_max\": 1.0,\n        \"nauc_precision_at_20_std\": 1.0,\n        \"nauc_precision_at_3_diff1\": 0.6408580232419018,\n        \"nauc_precision_at_3_max\": 0.28213621696446,\n        \"nauc_precision_at_3_std\": -0.46294543948589373,\n        \"nauc_precision_at_5_diff1\": 0.5895520265621751,\n        \"nauc_precision_at_5_max\": 0.30449307916307494,\n        \"nauc_precision_at_5_std\": -0.4490170987180294,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.41670903386108427,\n        \"nauc_recall_at_10_max\": -0.3652709320383255,\n        \"nauc_recall_at_10_std\": -0.08218269674420323,\n        \"nauc_recall_at_1_diff1\": 0.6496291120568579,\n        \"nauc_recall_at_1_max\": 0.08105503859326908,\n        \"nauc_recall_at_1_std\": -0.15869430013902078,\n        \"nauc_recall_at_20_diff1\": NaN,\n        \"nauc_recall_at_20_max\": NaN,\n        \"nauc_recall_at_20_std\": NaN,\n        \"nauc_recall_at_3_diff1\": 0.6408580232419027,\n        \"nauc_recall_at_3_max\": 0.28213621696445973,\n        \"nauc_recall_at_3_std\": -0.4629454394858956,\n        \"nauc_recall_at_5_diff1\": 0.5895520265621734,\n        \"nauc_recall_at_5_max\": 0.3044930791630734,\n        \"nauc_recall_at_5_std\": -0.4490170987180282,\n        \"ndcg_at_1\": 0.72727,\n        \"ndcg_at_10\": 0.85617,\n        \"ndcg_at_100\": 0.86264,\n        \"ndcg_at_1000\": 0.86264,\n        \"ndcg_at_20\": 0.86264,\n        \"ndcg_at_3\": 0.82869,\n        \"ndcg_at_5\": 0.83429,\n        \"precision_at_1\": 0.72727,\n        \"precision_at_10\": 0.0974,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.05,\n        \"precision_at_3\": 0.2987,\n        \"precision_at_5\": 0.18182,\n        \"recall_at_1\": 0.72727,\n        \"recall_at_10\": 0.97403,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 1.0,\n        \"recall_at_3\": 0.8961,\n        \"recall_at_5\": 0.90909\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/openai/text-embedding-3-large/no_model_name_available/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 127.63971376419067,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.1\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.37423,\n        \"map_at_1\": 0.20652,\n        \"map_at_10\": 0.32424,\n        \"map_at_100\": 0.34083,\n        \"map_at_1000\": 0.34195,\n        \"map_at_20\": 0.33307,\n        \"map_at_3\": 0.29049,\n        \"map_at_5\": 0.30924,\n        \"mrr_at_1\": 0.2889908256880734,\n        \"mrr_at_10\": 0.36114569681083425,\n        \"mrr_at_100\": 0.3735580971418379,\n        \"mrr_at_1000\": 0.37422727602805517,\n        \"mrr_at_20\": 0.36821475588783903,\n        \"mrr_at_3\": 0.3363914373088686,\n        \"mrr_at_5\": 0.3509174311926605,\n        \"nauc_map_at_1000_diff1\": 0.47524766111826294,\n        \"nauc_map_at_1000_max\": 0.09883153525011047,\n        \"nauc_map_at_1000_std\": -0.32764285382136416,\n        \"nauc_map_at_100_diff1\": 0.4744188521819488,\n        \"nauc_map_at_100_max\": 0.09861768287384905,\n        \"nauc_map_at_100_std\": -0.3273774197260536,\n        \"nauc_map_at_10_diff1\": 0.47796628713312844,\n        \"nauc_map_at_10_max\": 0.09671833361089476,\n        \"nauc_map_at_10_std\": -0.33068239680612016,\n        \"nauc_map_at_1_diff1\": 0.5312068574156018,\n        \"nauc_map_at_1_max\": 0.08316273395496018,\n        \"nauc_map_at_1_std\": -0.2770183950295717,\n        \"nauc_map_at_20_diff1\": 0.4754634006576872,\n        \"nauc_map_at_20_max\": 0.09667059424098755,\n        \"nauc_map_at_20_std\": -0.33196629807587275,\n        \"nauc_map_at_3_diff1\": 0.48320602714004945,\n        \"nauc_map_at_3_max\": 0.10272353700709959,\n        \"nauc_map_at_3_std\": -0.3222699822858497,\n        \"nauc_map_at_5_diff1\": 0.47935771756155027,\n        \"nauc_map_at_5_max\": 0.0936269166017143,\n        \"nauc_map_at_5_std\": -0.3279742827497809,\n        \"nauc_mrr_at_1000_diff1\": 0.49733197428074555,\n        \"nauc_mrr_at_1000_max\": 0.096006678397459,\n        \"nauc_mrr_at_1000_std\": -0.3391850920791737,\n        \"nauc_mrr_at_100_diff1\": 0.4970710841874183,\n        \"nauc_mrr_at_100_max\": 0.09609958107752674,\n        \"nauc_mrr_at_100_std\": -0.3388351833013782,\n        \"nauc_mrr_at_10_diff1\": 0.49583599307300874,\n        \"nauc_mrr_at_10_max\": 0.09263389688314552,\n        \"nauc_mrr_at_10_std\": -0.34279253646801777,\n        \"nauc_mrr_at_1_diff1\": 0.530507552915156,\n        \"nauc_mrr_at_1_max\": 0.11081685259047605,\n        \"nauc_mrr_at_1_std\": -0.336591986082507,\n        \"nauc_mrr_at_20_diff1\": 0.4974467054890617,\n        \"nauc_mrr_at_20_max\": 0.09442546029359035,\n        \"nauc_mrr_at_20_std\": -0.3415754228379661,\n        \"nauc_mrr_at_3_diff1\": 0.5005066657676188,\n        \"nauc_mrr_at_3_max\": 0.09523918796369456,\n        \"nauc_mrr_at_3_std\": -0.34511618876714556,\n        \"nauc_mrr_at_5_diff1\": 0.4951612263800776,\n        \"nauc_mrr_at_5_max\": 0.09065455861736223,\n        \"nauc_mrr_at_5_std\": -0.3404558034485618,\n        \"nauc_ndcg_at_1000_diff1\": 0.4712828373716081,\n        \"nauc_ndcg_at_1000_max\": 0.10383926602469376,\n        \"nauc_ndcg_at_1000_std\": -0.3214816132955133,\n        \"nauc_ndcg_at_100_diff1\": 0.4553816037095231,\n        \"nauc_ndcg_at_100_max\": 0.10841608065924647,\n        \"nauc_ndcg_at_100_std\": -0.30666351560829147,\n        \"nauc_ndcg_at_10_diff1\": 0.4690219510049616,\n        \"nauc_ndcg_at_10_max\": 0.08740305491826425,\n        \"nauc_ndcg_at_10_std\": -0.3417997128940579,\n        \"nauc_ndcg_at_1_diff1\": 0.530507552915156,\n        \"nauc_ndcg_at_1_max\": 0.11081685259047605,\n        \"nauc_ndcg_at_1_std\": -0.336591986082507,\n        \"nauc_ndcg_at_20_diff1\": 0.46514937364526887,\n        \"nauc_ndcg_at_20_max\": 0.09016332315940649,\n        \"nauc_ndcg_at_20_std\": -0.34221828530596565,\n        \"nauc_ndcg_at_3_diff1\": 0.4751896909410173,\n        \"nauc_ndcg_at_3_max\": 0.09018621762145725,\n        \"nauc_ndcg_at_3_std\": -0.33853718672197586,\n        \"nauc_ndcg_at_5_diff1\": 0.47079315412116823,\n        \"nauc_ndcg_at_5_max\": 0.0819286070811535,\n        \"nauc_ndcg_at_5_std\": -0.3355510330595144,\n        \"nauc_precision_at_1000_diff1\": -0.005767266391941639,\n        \"nauc_precision_at_1000_max\": 0.10655339932047396,\n        \"nauc_precision_at_1000_std\": 0.0034373965971917554,\n        \"nauc_precision_at_100_diff1\": 0.04565703614267389,\n        \"nauc_precision_at_100_max\": 0.12321925001636382,\n        \"nauc_precision_at_100_std\": -0.028986377035503448,\n        \"nauc_precision_at_10_diff1\": 0.2606865910429876,\n        \"nauc_precision_at_10_max\": 0.0690376536277112,\n        \"nauc_precision_at_10_std\": -0.3017927914358375,\n        \"nauc_precision_at_1_diff1\": 0.530507552915156,\n        \"nauc_precision_at_1_max\": 0.11081685259047605,\n        \"nauc_precision_at_1_std\": -0.336591986082507,\n        \"nauc_precision_at_20_diff1\": 0.2032930893089947,\n        \"nauc_precision_at_20_max\": 0.07073110216590488,\n        \"nauc_precision_at_20_std\": -0.26140795871276373,\n        \"nauc_precision_at_3_diff1\": 0.3338599510767471,\n        \"nauc_precision_at_3_max\": 0.10242310759589818,\n        \"nauc_precision_at_3_std\": -0.32842806479168957,\n        \"nauc_precision_at_5_diff1\": 0.29836479908807134,\n        \"nauc_precision_at_5_max\": 0.0777515735924914,\n        \"nauc_precision_at_5_std\": -0.31047088963223834,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.2317669452615089,\n        \"nauc_recall_at_100_max\": 0.20594504302420488,\n        \"nauc_recall_at_100_std\": -0.05681131555526767,\n        \"nauc_recall_at_10_diff1\": 0.4102379566937134,\n        \"nauc_recall_at_10_max\": 0.06361937146897327,\n        \"nauc_recall_at_10_std\": -0.34785219614907414,\n        \"nauc_recall_at_1_diff1\": 0.5312068574156018,\n        \"nauc_recall_at_1_max\": 0.08316273395496018,\n        \"nauc_recall_at_1_std\": -0.2770183950295717,\n        \"nauc_recall_at_20_diff1\": 0.389303726811902,\n        \"nauc_recall_at_20_max\": 0.07067454954471056,\n        \"nauc_recall_at_20_std\": -0.3490048604348846,\n        \"nauc_recall_at_3_diff1\": 0.43805948201691913,\n        \"nauc_recall_at_3_max\": 0.07672959491844454,\n        \"nauc_recall_at_3_std\": -0.3312609114334921,\n        \"nauc_recall_at_5_diff1\": 0.41987819758641604,\n        \"nauc_recall_at_5_max\": 0.04949803095594345,\n        \"nauc_recall_at_5_std\": -0.3334354339134594,\n        \"ndcg_at_1\": 0.28899,\n        \"ndcg_at_10\": 0.37423,\n        \"ndcg_at_100\": 0.45146,\n        \"ndcg_at_1000\": 0.47572,\n        \"ndcg_at_20\": 0.40221,\n        \"ndcg_at_3\": 0.319,\n        \"ndcg_at_5\": 0.34348,\n        \"precision_at_1\": 0.28899,\n        \"precision_at_10\": 0.07768,\n        \"precision_at_100\": 0.01317,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.04656,\n        \"precision_at_3\": 0.17788,\n        \"precision_at_5\": 0.12783,\n        \"recall_at_1\": 0.20652,\n        \"recall_at_10\": 0.48629,\n        \"recall_at_100\": 0.82454,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.58496,\n        \"recall_at_3\": 0.34088,\n        \"recall_at_5\": 0.40183\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.3659,\n        \"map_at_1\": 0.18038,\n        \"map_at_10\": 0.31357,\n        \"map_at_100\": 0.3329,\n        \"map_at_1000\": 0.33458,\n        \"map_at_20\": 0.3239,\n        \"map_at_3\": 0.26744,\n        \"map_at_5\": 0.29445,\n        \"mrr_at_1\": 0.2996941896024465,\n        \"mrr_at_10\": 0.36893172661521256,\n        \"mrr_at_100\": 0.37999973579962687,\n        \"mrr_at_1000\": 0.38081355802900246,\n        \"mrr_at_20\": 0.3751262464551014,\n        \"mrr_at_3\": 0.34480122324159035,\n        \"mrr_at_5\": 0.35856269113149836,\n        \"nauc_map_at_1000_diff1\": 0.5475845862896238,\n        \"nauc_map_at_1000_max\": 0.17129985115486587,\n        \"nauc_map_at_1000_std\": -0.31192134531931526,\n        \"nauc_map_at_100_diff1\": 0.5472658081934074,\n        \"nauc_map_at_100_max\": 0.1702211431621068,\n        \"nauc_map_at_100_std\": -0.31310792303685064,\n        \"nauc_map_at_10_diff1\": 0.551458713298644,\n        \"nauc_map_at_10_max\": 0.17502023070573752,\n        \"nauc_map_at_10_std\": -0.3108407143933329,\n        \"nauc_map_at_1_diff1\": 0.5812609502108893,\n        \"nauc_map_at_1_max\": 0.14606228480022937,\n        \"nauc_map_at_1_std\": -0.2755845356500218,\n        \"nauc_map_at_20_diff1\": 0.5491856326088752,\n        \"nauc_map_at_20_max\": 0.17151836955292996,\n        \"nauc_map_at_20_std\": -0.3146971451556958,\n        \"nauc_map_at_3_diff1\": 0.5632033415363726,\n        \"nauc_map_at_3_max\": 0.16810213892994397,\n        \"nauc_map_at_3_std\": -0.3018261794541308,\n        \"nauc_map_at_5_diff1\": 0.5541230617030946,\n        \"nauc_map_at_5_max\": 0.1752806060272934,\n        \"nauc_map_at_5_std\": -0.30863452026905913,\n        \"nauc_mrr_at_1000_diff1\": 0.5319526790628266,\n        \"nauc_mrr_at_1000_max\": 0.15798458903661572,\n        \"nauc_mrr_at_1000_std\": -0.3161777593887362,\n        \"nauc_mrr_at_100_diff1\": 0.5314497575661327,\n        \"nauc_mrr_at_100_max\": 0.1579687609307439,\n        \"nauc_mrr_at_100_std\": -0.3158669687764293,\n        \"nauc_mrr_at_10_diff1\": 0.5330646219432362,\n        \"nauc_mrr_at_10_max\": 0.15607701799166418,\n        \"nauc_mrr_at_10_std\": -0.3216853173474818,\n        \"nauc_mrr_at_1_diff1\": 0.5777369192363048,\n        \"nauc_mrr_at_1_max\": 0.17996075609578352,\n        \"nauc_mrr_at_1_std\": -0.3055325778055966,\n        \"nauc_mrr_at_20_diff1\": 0.5312353932468608,\n        \"nauc_mrr_at_20_max\": 0.15651230811629652,\n        \"nauc_mrr_at_20_std\": -0.3182475877521702,\n        \"nauc_mrr_at_3_diff1\": 0.5443148099829979,\n        \"nauc_mrr_at_3_max\": 0.158954825500078,\n        \"nauc_mrr_at_3_std\": -0.3192038118068102,\n        \"nauc_mrr_at_5_diff1\": 0.5343630391590962,\n        \"nauc_mrr_at_5_max\": 0.15514715460628098,\n        \"nauc_mrr_at_5_std\": -0.3220709171492349,\n        \"nauc_ndcg_at_1000_diff1\": 0.5202673417802097,\n        \"nauc_ndcg_at_1000_max\": 0.16310877019932138,\n        \"nauc_ndcg_at_1000_std\": -0.3045619273813806,\n        \"nauc_ndcg_at_100_diff1\": 0.5102621009967564,\n        \"nauc_ndcg_at_100_max\": 0.1554204416240501,\n        \"nauc_ndcg_at_100_std\": -0.30558837713364984,\n        \"nauc_ndcg_at_10_diff1\": 0.5301561213420717,\n        \"nauc_ndcg_at_10_max\": 0.16256242494569756,\n        \"nauc_ndcg_at_10_std\": -0.3197634187745068,\n        \"nauc_ndcg_at_1_diff1\": 0.5777369192363048,\n        \"nauc_ndcg_at_1_max\": 0.17996075609578352,\n        \"nauc_ndcg_at_1_std\": -0.3055325778055966,\n        \"nauc_ndcg_at_20_diff1\": 0.5195791786524678,\n        \"nauc_ndcg_at_20_max\": 0.15426717535597573,\n        \"nauc_ndcg_at_20_std\": -0.3234141170942771,\n        \"nauc_ndcg_at_3_diff1\": 0.5439887228884779,\n        \"nauc_ndcg_at_3_max\": 0.15863062376493972,\n        \"nauc_ndcg_at_3_std\": -0.31517249866480807,\n        \"nauc_ndcg_at_5_diff1\": 0.5320369390007491,\n        \"nauc_ndcg_at_5_max\": 0.16414407022065952,\n        \"nauc_ndcg_at_5_std\": -0.31603967683181655,\n        \"nauc_precision_at_1000_diff1\": -0.01972151472070089,\n        \"nauc_precision_at_1000_max\": 0.04885050874249441,\n        \"nauc_precision_at_1000_std\": -0.011980239281004945,\n        \"nauc_precision_at_100_diff1\": 0.07956393359823302,\n        \"nauc_precision_at_100_max\": 0.05148451548152324,\n        \"nauc_precision_at_100_std\": -0.10063971949175372,\n        \"nauc_precision_at_10_diff1\": 0.3016511844169242,\n        \"nauc_precision_at_10_max\": 0.11760651902070267,\n        \"nauc_precision_at_10_std\": -0.25074452316449297,\n        \"nauc_precision_at_1_diff1\": 0.5777369192363048,\n        \"nauc_precision_at_1_max\": 0.17996075609578352,\n        \"nauc_precision_at_1_std\": -0.3055325778055966,\n        \"nauc_precision_at_20_diff1\": 0.23822808536130927,\n        \"nauc_precision_at_20_max\": 0.08461029451434389,\n        \"nauc_precision_at_20_std\": -0.23469224953329992,\n        \"nauc_precision_at_3_diff1\": 0.4023597377637611,\n        \"nauc_precision_at_3_max\": 0.14598522494350358,\n        \"nauc_precision_at_3_std\": -0.2759980327072713,\n        \"nauc_precision_at_5_diff1\": 0.34710591102430166,\n        \"nauc_precision_at_5_max\": 0.13793631724712827,\n        \"nauc_precision_at_5_std\": -0.2653965283294146,\n        \"nauc_recall_at_1000_diff1\": -0.21622330025083975,\n        \"nauc_recall_at_1000_max\": -0.17411302595557848,\n        \"nauc_recall_at_1000_std\": -0.46808130028818207,\n        \"nauc_recall_at_100_diff1\": 0.3248732360733499,\n        \"nauc_recall_at_100_max\": 0.09632461146835207,\n        \"nauc_recall_at_100_std\": -0.21395135506452787,\n        \"nauc_recall_at_10_diff1\": 0.4661512723671577,\n        \"nauc_recall_at_10_max\": 0.14417075776566576,\n        \"nauc_recall_at_10_std\": -0.31186651082212025,\n        \"nauc_recall_at_1_diff1\": 0.5812609502108893,\n        \"nauc_recall_at_1_max\": 0.14606228480022937,\n        \"nauc_recall_at_1_std\": -0.2755845356500218,\n        \"nauc_recall_at_20_diff1\": 0.4243012119763299,\n        \"nauc_recall_at_20_max\": 0.11425505582759143,\n        \"nauc_recall_at_20_std\": -0.32209030412851514,\n        \"nauc_recall_at_3_diff1\": 0.5128831174573368,\n        \"nauc_recall_at_3_max\": 0.14039851355316052,\n        \"nauc_recall_at_3_std\": -0.3051519092441379,\n        \"nauc_recall_at_5_diff1\": 0.47049871862950743,\n        \"nauc_recall_at_5_max\": 0.14809208942815275,\n        \"nauc_recall_at_5_std\": -0.3090292790912479,\n        \"ndcg_at_1\": 0.29969,\n        \"ndcg_at_10\": 0.3659,\n        \"ndcg_at_100\": 0.44749,\n        \"ndcg_at_1000\": 0.47656,\n        \"ndcg_at_20\": 0.39505,\n        \"ndcg_at_3\": 0.31337,\n        \"ndcg_at_5\": 0.33242,\n        \"precision_at_1\": 0.29969,\n        \"precision_at_10\": 0.09572,\n        \"precision_at_100\": 0.01619,\n        \"precision_at_1000\": 0.00194,\n        \"precision_at_20\": 0.05772,\n        \"precision_at_3\": 0.20489,\n        \"precision_at_5\": 0.15474,\n        \"recall_at_1\": 0.18038,\n        \"recall_at_10\": 0.45609,\n        \"recall_at_100\": 0.79796,\n        \"recall_at_1000\": 0.9949,\n        \"recall_at_20\": 0.55099,\n        \"recall_at_3\": 0.30647,\n        \"recall_at_5\": 0.3726\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.37028,\n        \"map_at_1\": 0.19803,\n        \"map_at_10\": 0.31863,\n        \"map_at_100\": 0.33429,\n        \"map_at_1000\": 0.33557,\n        \"map_at_20\": 0.3257,\n        \"map_at_3\": 0.28057,\n        \"map_at_5\": 0.29986,\n        \"mrr_at_1\": 0.28664495114006516,\n        \"mrr_at_10\": 0.35963238715681695,\n        \"mrr_at_100\": 0.37055198162289404,\n        \"mrr_at_1000\": 0.3713710790315084,\n        \"mrr_at_20\": 0.36522946934537664,\n        \"mrr_at_3\": 0.3330618892508144,\n        \"mrr_at_5\": 0.3460097719869707,\n        \"nauc_map_at_1000_diff1\": 0.45384537054326274,\n        \"nauc_map_at_1000_max\": 0.06941323095795682,\n        \"nauc_map_at_1000_std\": -0.3190300006388068,\n        \"nauc_map_at_100_diff1\": 0.45331188809340084,\n        \"nauc_map_at_100_max\": 0.06974115300695743,\n        \"nauc_map_at_100_std\": -0.31834923704324725,\n        \"nauc_map_at_10_diff1\": 0.4548177046458187,\n        \"nauc_map_at_10_max\": 0.06609084456502891,\n        \"nauc_map_at_10_std\": -0.3263912570727043,\n        \"nauc_map_at_1_diff1\": 0.5411729166156709,\n        \"nauc_map_at_1_max\": 0.04965791121034343,\n        \"nauc_map_at_1_std\": -0.2770971704111151,\n        \"nauc_map_at_20_diff1\": 0.4550026878212889,\n        \"nauc_map_at_20_max\": 0.06544234925863715,\n        \"nauc_map_at_20_std\": -0.32794064880249657,\n        \"nauc_map_at_3_diff1\": 0.46628565155101115,\n        \"nauc_map_at_3_max\": 0.06837861613381846,\n        \"nauc_map_at_3_std\": -0.30792101181267695,\n        \"nauc_map_at_5_diff1\": 0.45639933652657977,\n        \"nauc_map_at_5_max\": 0.06699970410481666,\n        \"nauc_map_at_5_std\": -0.3176249865537211,\n        \"nauc_mrr_at_1000_diff1\": 0.46678779520345426,\n        \"nauc_mrr_at_1000_max\": 0.06683354615752005,\n        \"nauc_mrr_at_1000_std\": -0.3098309567636614,\n        \"nauc_mrr_at_100_diff1\": 0.4663617454366421,\n        \"nauc_mrr_at_100_max\": 0.06742196992757753,\n        \"nauc_mrr_at_100_std\": -0.30897623574808364,\n        \"nauc_mrr_at_10_diff1\": 0.46575145011988317,\n        \"nauc_mrr_at_10_max\": 0.06308966595195759,\n        \"nauc_mrr_at_10_std\": -0.316220345622948,\n        \"nauc_mrr_at_1_diff1\": 0.5217613398284591,\n        \"nauc_mrr_at_1_max\": 0.06723111294341066,\n        \"nauc_mrr_at_1_std\": -0.30864470486943385,\n        \"nauc_mrr_at_20_diff1\": 0.4670769592041788,\n        \"nauc_mrr_at_20_max\": 0.06530971752756526,\n        \"nauc_mrr_at_20_std\": -0.31389838093131917,\n        \"nauc_mrr_at_3_diff1\": 0.47668011938645516,\n        \"nauc_mrr_at_3_max\": 0.06650270899588769,\n        \"nauc_mrr_at_3_std\": -0.30852685782572564,\n        \"nauc_mrr_at_5_diff1\": 0.4690693607040199,\n        \"nauc_mrr_at_5_max\": 0.06325125895453224,\n        \"nauc_mrr_at_5_std\": -0.3123463685542158,\n        \"nauc_ndcg_at_1000_diff1\": 0.4425089332119335,\n        \"nauc_ndcg_at_1000_max\": 0.0813733799435709,\n        \"nauc_ndcg_at_1000_std\": -0.30069417441181623,\n        \"nauc_ndcg_at_100_diff1\": 0.4277002642353046,\n        \"nauc_ndcg_at_100_max\": 0.09225279866642008,\n        \"nauc_ndcg_at_100_std\": -0.2763152217911081,\n        \"nauc_ndcg_at_10_diff1\": 0.4357781494862851,\n        \"nauc_ndcg_at_10_max\": 0.06497312147959357,\n        \"nauc_ndcg_at_10_std\": -0.3347075429482461,\n        \"nauc_ndcg_at_1_diff1\": 0.5217613398284591,\n        \"nauc_ndcg_at_1_max\": 0.06723111294341066,\n        \"nauc_ndcg_at_1_std\": -0.30864470486943385,\n        \"nauc_ndcg_at_20_diff1\": 0.437615883595116,\n        \"nauc_ndcg_at_20_max\": 0.06585660117698056,\n        \"nauc_ndcg_at_20_std\": -0.3360552708508598,\n        \"nauc_ndcg_at_3_diff1\": 0.46016302280312,\n        \"nauc_ndcg_at_3_max\": 0.06306325920843273,\n        \"nauc_ndcg_at_3_std\": -0.31453094531104747,\n        \"nauc_ndcg_at_5_diff1\": 0.4429885882606201,\n        \"nauc_ndcg_at_5_max\": 0.06364424725181266,\n        \"nauc_ndcg_at_5_std\": -0.32161883938094465,\n        \"nauc_precision_at_1000_diff1\": -0.01977690378890249,\n        \"nauc_precision_at_1000_max\": 0.15031719296078636,\n        \"nauc_precision_at_1000_std\": 0.09028119274489933,\n        \"nauc_precision_at_100_diff1\": 0.035411720860641184,\n        \"nauc_precision_at_100_max\": 0.17217751658003042,\n        \"nauc_precision_at_100_std\": 0.07385988957101293,\n        \"nauc_precision_at_10_diff1\": 0.22252752974305495,\n        \"nauc_precision_at_10_max\": 0.05524962251923645,\n        \"nauc_precision_at_10_std\": -0.2854246386801379,\n        \"nauc_precision_at_1_diff1\": 0.5217613398284591,\n        \"nauc_precision_at_1_max\": 0.06723111294341066,\n        \"nauc_precision_at_1_std\": -0.30864470486943385,\n        \"nauc_precision_at_20_diff1\": 0.19163443790426712,\n        \"nauc_precision_at_20_max\": 0.055944718940985134,\n        \"nauc_precision_at_20_std\": -0.25304253423825107,\n        \"nauc_precision_at_3_diff1\": 0.31039815192793946,\n        \"nauc_precision_at_3_max\": 0.07700281650111754,\n        \"nauc_precision_at_3_std\": -0.2914386559768999,\n        \"nauc_precision_at_5_diff1\": 0.2566827685957296,\n        \"nauc_precision_at_5_max\": 0.05795553331673374,\n        \"nauc_precision_at_5_std\": -0.29418793418071815,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.22548139370284953,\n        \"nauc_recall_at_100_max\": 0.21967501152347532,\n        \"nauc_recall_at_100_std\": 0.043216409696874146,\n        \"nauc_recall_at_10_diff1\": 0.35174012919899866,\n        \"nauc_recall_at_10_max\": 0.06359013710810518,\n        \"nauc_recall_at_10_std\": -0.34903356214691456,\n        \"nauc_recall_at_1_diff1\": 0.5411729166156709,\n        \"nauc_recall_at_1_max\": 0.04965791121034343,\n        \"nauc_recall_at_1_std\": -0.2770971704111151,\n        \"nauc_recall_at_20_diff1\": 0.3456468055090329,\n        \"nauc_recall_at_20_max\": 0.06377354394911941,\n        \"nauc_recall_at_20_std\": -0.3507476267229391,\n        \"nauc_recall_at_3_diff1\": 0.412487641826751,\n        \"nauc_recall_at_3_max\": 0.06124492567012575,\n        \"nauc_recall_at_3_std\": -0.2995915030276966,\n        \"nauc_recall_at_5_diff1\": 0.3829534227232191,\n        \"nauc_recall_at_5_max\": 0.05735351902047361,\n        \"nauc_recall_at_5_std\": -0.3216100683761451,\n        \"ndcg_at_1\": 0.28664,\n        \"ndcg_at_10\": 0.37028,\n        \"ndcg_at_100\": 0.44438,\n        \"ndcg_at_1000\": 0.47193,\n        \"ndcg_at_20\": 0.39278,\n        \"ndcg_at_3\": 0.31,\n        \"ndcg_at_5\": 0.33396,\n        \"precision_at_1\": 0.28664,\n        \"precision_at_10\": 0.08078,\n        \"precision_at_100\": 0.01379,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.04723,\n        \"precision_at_3\": 0.17427,\n        \"precision_at_5\": 0.12736,\n        \"recall_at_1\": 0.19803,\n        \"recall_at_10\": 0.48125,\n        \"recall_at_100\": 0.8032,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.559,\n        \"recall_at_3\": 0.32611,\n        \"recall_at_5\": 0.38459\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/openai/text-embedding-3-large/no_model_name_available/no_revision_available/model_meta.json",
    "content": "{\"name\": \"no_model_name_available\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": null, \"n_parameters\": null, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": null, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"zero_shot_benchmarks\": null, \"loader\": null}"
  },
  {
    "path": "eval/results/upskyy/bge-m3-korean/upskyy__bge-m3-korean/no_revision_available/AutoRAGRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fd7df84ac089bbec763b1c6bb1b56e985df5cc5c\",\n  \"evaluation_time\": 19.277517318725586,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.72946,\n        \"map_at_1\": 0.55263,\n        \"map_at_10\": 0.67118,\n        \"map_at_100\": 0.67467,\n        \"map_at_1000\": 0.67467,\n        \"map_at_20\": 0.67281,\n        \"map_at_3\": 0.64474,\n        \"map_at_5\": 0.66053,\n        \"mrr_at_1\": 0.5526315789473685,\n        \"mrr_at_10\": 0.6711849067112226,\n        \"mrr_at_100\": 0.6746715904241167,\n        \"mrr_at_1000\": 0.6746715904241167,\n        \"mrr_at_20\": 0.6728147984339936,\n        \"mrr_at_3\": 0.6447368421052632,\n        \"mrr_at_5\": 0.6605263157894737,\n        \"nauc_map_at_1000_diff1\": 0.6707428725853308,\n        \"nauc_map_at_1000_max\": 0.36408406762747764,\n        \"nauc_map_at_1000_std\": -0.20570630552244473,\n        \"nauc_map_at_100_diff1\": 0.6707428725853308,\n        \"nauc_map_at_100_max\": 0.36408406762747764,\n        \"nauc_map_at_100_std\": -0.20570630552244473,\n        \"nauc_map_at_10_diff1\": 0.6694228696798035,\n        \"nauc_map_at_10_max\": 0.36958077127650485,\n        \"nauc_map_at_10_std\": -0.2031257096763581,\n        \"nauc_map_at_1_diff1\": 0.6675668434290756,\n        \"nauc_map_at_1_max\": 0.2661749445307839,\n        \"nauc_map_at_1_std\": -0.21180878980375847,\n        \"nauc_map_at_20_diff1\": 0.6699889586317481,\n        \"nauc_map_at_20_max\": 0.3658466072887328,\n        \"nauc_map_at_20_std\": -0.20962057627984584,\n        \"nauc_map_at_3_diff1\": 0.6862468818525479,\n        \"nauc_map_at_3_max\": 0.3838859599279802,\n        \"nauc_map_at_3_std\": -0.18434990538136026,\n        \"nauc_map_at_5_diff1\": 0.6734220459216618,\n        \"nauc_map_at_5_max\": 0.3715153642651667,\n        \"nauc_map_at_5_std\": -0.19638862477177044,\n        \"nauc_mrr_at_1000_diff1\": 0.6707428725853308,\n        \"nauc_mrr_at_1000_max\": 0.36408406762747764,\n        \"nauc_mrr_at_1000_std\": -0.20570630552244473,\n        \"nauc_mrr_at_100_diff1\": 0.6707428725853308,\n        \"nauc_mrr_at_100_max\": 0.36408406762747764,\n        \"nauc_mrr_at_100_std\": -0.20570630552244473,\n        \"nauc_mrr_at_10_diff1\": 0.6694228696798035,\n        \"nauc_mrr_at_10_max\": 0.36958077127650485,\n        \"nauc_mrr_at_10_std\": -0.2031257096763581,\n        \"nauc_mrr_at_1_diff1\": 0.6675668434290756,\n        \"nauc_mrr_at_1_max\": 0.2661749445307839,\n        \"nauc_mrr_at_1_std\": -0.21180878980375847,\n        \"nauc_mrr_at_20_diff1\": 0.6699889586317481,\n        \"nauc_mrr_at_20_max\": 0.3658466072887328,\n        \"nauc_mrr_at_20_std\": -0.20962057627984584,\n        \"nauc_mrr_at_3_diff1\": 0.6862468818525479,\n        \"nauc_mrr_at_3_max\": 0.3838859599279802,\n        \"nauc_mrr_at_3_std\": -0.18434990538136026,\n        \"nauc_mrr_at_5_diff1\": 0.6734220459216618,\n        \"nauc_mrr_at_5_max\": 0.3715153642651667,\n        \"nauc_mrr_at_5_std\": -0.19638862477177044,\n        \"nauc_ndcg_at_1000_diff1\": 0.6671740713837205,\n        \"nauc_ndcg_at_1000_max\": 0.3756626204320296,\n        \"nauc_ndcg_at_1000_std\": -0.21166796127675785,\n        \"nauc_ndcg_at_100_diff1\": 0.6671740713837205,\n        \"nauc_ndcg_at_100_max\": 0.3756626204320296,\n        \"nauc_ndcg_at_100_std\": -0.21166796127675785,\n        \"nauc_ndcg_at_10_diff1\": 0.6568831312543059,\n        \"nauc_ndcg_at_10_max\": 0.4052814278786497,\n        \"nauc_ndcg_at_10_std\": -0.2119241383539628,\n        \"nauc_ndcg_at_1_diff1\": 0.6675668434290756,\n        \"nauc_ndcg_at_1_max\": 0.2661749445307839,\n        \"nauc_ndcg_at_1_std\": -0.21180878980375847,\n        \"nauc_ndcg_at_20_diff1\": 0.6594793623983968,\n        \"nauc_ndcg_at_20_max\": 0.3885895716791715,\n        \"nauc_ndcg_at_20_std\": -0.24290058030624878,\n        \"nauc_ndcg_at_3_diff1\": 0.6928031605606169,\n        \"nauc_ndcg_at_3_max\": 0.4232920523897769,\n        \"nauc_ndcg_at_3_std\": -0.17400981818457717,\n        \"nauc_ndcg_at_5_diff1\": 0.6676229670124798,\n        \"nauc_ndcg_at_5_max\": 0.403635040677057,\n        \"nauc_ndcg_at_5_std\": -0.19753091492323405,\n        \"nauc_precision_at_1000_diff1\": 1.0,\n        \"nauc_precision_at_1000_max\": 1.0,\n        \"nauc_precision_at_1000_std\": 1.0,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.5288063479518919,\n        \"nauc_precision_at_10_max\": 0.708870042679463,\n        \"nauc_precision_at_10_std\": -0.30338470765024184,\n        \"nauc_precision_at_1_diff1\": 0.6675668434290756,\n        \"nauc_precision_at_1_max\": 0.2661749445307839,\n        \"nauc_precision_at_1_std\": -0.21180878980375847,\n        \"nauc_precision_at_20_diff1\": 0.5125144625120732,\n        \"nauc_precision_at_20_max\": 0.6027016763741028,\n        \"nauc_precision_at_20_std\": -0.7797707674708182,\n        \"nauc_precision_at_3_diff1\": 0.7174378963535222,\n        \"nauc_precision_at_3_max\": 0.570515649257075,\n        \"nauc_precision_at_3_std\": -0.13484764350266676,\n        \"nauc_precision_at_5_diff1\": 0.6323812858648742,\n        \"nauc_precision_at_5_max\": 0.5549884337148923,\n        \"nauc_precision_at_5_std\": -0.20953464522227783,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.5288063479518927,\n        \"nauc_recall_at_10_max\": 0.7088700426794637,\n        \"nauc_recall_at_10_std\": -0.3033847076502421,\n        \"nauc_recall_at_1_diff1\": 0.6675668434290756,\n        \"nauc_recall_at_1_max\": 0.2661749445307839,\n        \"nauc_recall_at_1_std\": -0.21180878980375847,\n        \"nauc_recall_at_20_diff1\": 0.5125144625120719,\n        \"nauc_recall_at_20_max\": 0.602701676374104,\n        \"nauc_recall_at_20_std\": -0.7797707674708185,\n        \"nauc_recall_at_3_diff1\": 0.717437896353523,\n        \"nauc_recall_at_3_max\": 0.5705156492570749,\n        \"nauc_recall_at_3_std\": -0.13484764350266565,\n        \"nauc_recall_at_5_diff1\": 0.6323812858648742,\n        \"nauc_recall_at_5_max\": 0.5549884337148914,\n        \"nauc_recall_at_5_std\": -0.20953464522227613,\n        \"ndcg_at_1\": 0.55263,\n        \"ndcg_at_10\": 0.72946,\n        \"ndcg_at_100\": 0.74777,\n        \"ndcg_at_1000\": 0.74777,\n        \"ndcg_at_20\": 0.73587,\n        \"ndcg_at_3\": 0.67512,\n        \"ndcg_at_5\": 0.70381,\n        \"precision_at_1\": 0.55263,\n        \"precision_at_10\": 0.09123,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04693,\n        \"precision_at_3\": 0.25439,\n        \"precision_at_5\": 0.16667,\n        \"recall_at_1\": 0.55263,\n        \"recall_at_10\": 0.91228,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.9386,\n        \"recall_at_3\": 0.76316,\n        \"recall_at_5\": 0.83333\n      }\n    ]\n  },\n  \"task_name\": \"AutoRAGRetrieval\"\n}"
  },
  {
    "path": "eval/results/upskyy/bge-m3-korean/upskyy__bge-m3-korean/no_revision_available/BelebeleRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"75b399394a9803252cfec289d103de462763db7c\",\n  \"evaluation_time\": 20.426774740219116,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor_Hang-kor_Hang\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.8731,\n        \"map_at_1\": 0.80222,\n        \"map_at_10\": 0.85083,\n        \"map_at_100\": 0.853,\n        \"map_at_1000\": 0.85306,\n        \"map_at_20\": 0.85226,\n        \"map_at_3\": 0.83944,\n        \"map_at_5\": 0.84744,\n        \"mrr_at_1\": 0.8022222222222222,\n        \"mrr_at_10\": 0.8508262786596121,\n        \"mrr_at_100\": 0.8529968861639116,\n        \"mrr_at_1000\": 0.8530557336878666,\n        \"mrr_at_20\": 0.8522600180988984,\n        \"mrr_at_3\": 0.8394444444444445,\n        \"mrr_at_5\": 0.8474444444444444,\n        \"nauc_map_at_1000_diff1\": 0.8560640977493851,\n        \"nauc_map_at_1000_max\": 0.8063463833899528,\n        \"nauc_map_at_1000_std\": -0.08489516754902722,\n        \"nauc_map_at_100_diff1\": 0.8560402544947975,\n        \"nauc_map_at_100_max\": 0.8063864802759896,\n        \"nauc_map_at_100_std\": -0.08482547418762357,\n        \"nauc_map_at_10_diff1\": 0.8549918293194821,\n        \"nauc_map_at_10_max\": 0.8069540239085331,\n        \"nauc_map_at_10_std\": -0.08483361982813872,\n        \"nauc_map_at_1_diff1\": 0.8780100718940327,\n        \"nauc_map_at_1_max\": 0.7914175798292935,\n        \"nauc_map_at_1_std\": -0.09726163371056187,\n        \"nauc_map_at_20_diff1\": 0.8553785393171915,\n        \"nauc_map_at_20_max\": 0.8065336965287219,\n        \"nauc_map_at_20_std\": -0.08371384444228923,\n        \"nauc_map_at_3_diff1\": 0.8524735012353063,\n        \"nauc_map_at_3_max\": 0.8072587980883054,\n        \"nauc_map_at_3_std\": -0.09268025786806994,\n        \"nauc_map_at_5_diff1\": 0.854626838155166,\n        \"nauc_map_at_5_max\": 0.8078977938446023,\n        \"nauc_map_at_5_std\": -0.0873739578815138,\n        \"nauc_mrr_at_1000_diff1\": 0.8560640977493851,\n        \"nauc_mrr_at_1000_max\": 0.8063463833899528,\n        \"nauc_mrr_at_1000_std\": -0.08489516754902722,\n        \"nauc_mrr_at_100_diff1\": 0.8560402544947975,\n        \"nauc_mrr_at_100_max\": 0.8063864802759896,\n        \"nauc_mrr_at_100_std\": -0.08482547418762357,\n        \"nauc_mrr_at_10_diff1\": 0.8549918293194821,\n        \"nauc_mrr_at_10_max\": 0.8069540239085331,\n        \"nauc_mrr_at_10_std\": -0.08483361982813872,\n        \"nauc_mrr_at_1_diff1\": 0.8780100718940327,\n        \"nauc_mrr_at_1_max\": 0.7914175798292935,\n        \"nauc_mrr_at_1_std\": -0.09726163371056187,\n        \"nauc_mrr_at_20_diff1\": 0.8553785393171915,\n        \"nauc_mrr_at_20_max\": 0.8065336965287219,\n        \"nauc_mrr_at_20_std\": -0.08371384444228923,\n        \"nauc_mrr_at_3_diff1\": 0.8524735012353063,\n        \"nauc_mrr_at_3_max\": 0.8072587980883054,\n        \"nauc_mrr_at_3_std\": -0.09268025786806994,\n        \"nauc_mrr_at_5_diff1\": 0.854626838155166,\n        \"nauc_mrr_at_5_max\": 0.8078977938446023,\n        \"nauc_mrr_at_5_std\": -0.0873739578815138,\n        \"nauc_ndcg_at_1000_diff1\": 0.8529039894642638,\n        \"nauc_ndcg_at_1000_max\": 0.8087187703322236,\n        \"nauc_ndcg_at_1000_std\": -0.07918583237480917,\n        \"nauc_ndcg_at_100_diff1\": 0.8524104038120888,\n        \"nauc_ndcg_at_100_max\": 0.8101262523349947,\n        \"nauc_ndcg_at_100_std\": -0.0757592935305003,\n        \"nauc_ndcg_at_10_diff1\": 0.8466716122240695,\n        \"nauc_ndcg_at_10_max\": 0.812224133560615,\n        \"nauc_ndcg_at_10_std\": -0.07233879254576772,\n        \"nauc_ndcg_at_1_diff1\": 0.8780100718940327,\n        \"nauc_ndcg_at_1_max\": 0.7914175798292935,\n        \"nauc_ndcg_at_1_std\": -0.09726163371056187,\n        \"nauc_ndcg_at_20_diff1\": 0.8478973857717044,\n        \"nauc_ndcg_at_20_max\": 0.8102840983169886,\n        \"nauc_ndcg_at_20_std\": -0.06787643804581135,\n        \"nauc_ndcg_at_3_diff1\": 0.8428769936195931,\n        \"nauc_ndcg_at_3_max\": 0.8126819826757915,\n        \"nauc_ndcg_at_3_std\": -0.09209093244222816,\n        \"nauc_ndcg_at_5_diff1\": 0.8458023636227519,\n        \"nauc_ndcg_at_5_max\": 0.8143924646960852,\n        \"nauc_ndcg_at_5_std\": -0.0809920849336958,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.8223834988540969,\n        \"nauc_precision_at_100_max\": 0.9104490280961036,\n        \"nauc_precision_at_100_std\": 0.18385536032594635,\n        \"nauc_precision_at_10_diff1\": 0.7905534008475149,\n        \"nauc_precision_at_10_max\": 0.84715937657114,\n        \"nauc_precision_at_10_std\": 0.03006715506715187,\n        \"nauc_precision_at_1_diff1\": 0.8780100718940327,\n        \"nauc_precision_at_1_max\": 0.7914175798292935,\n        \"nauc_precision_at_1_std\": -0.09726163371056187,\n        \"nauc_precision_at_20_diff1\": 0.7728828905299473,\n        \"nauc_precision_at_20_max\": 0.8407888407888411,\n        \"nauc_precision_at_20_std\": 0.13823104999575037,\n        \"nauc_precision_at_3_diff1\": 0.8063250419101998,\n        \"nauc_precision_at_3_max\": 0.8331113225499538,\n        \"nauc_precision_at_3_std\": -0.09033120384214648,\n        \"nauc_precision_at_5_diff1\": 0.8015999192469749,\n        \"nauc_precision_at_5_max\": 0.8471433618492425,\n        \"nauc_precision_at_5_std\": -0.04609861962803618,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.8223834988540899,\n        \"nauc_recall_at_100_max\": 0.9104490280960834,\n        \"nauc_recall_at_100_std\": 0.18385536032594385,\n        \"nauc_recall_at_10_diff1\": 0.7905534008475215,\n        \"nauc_recall_at_10_max\": 0.8471593765711437,\n        \"nauc_recall_at_10_std\": 0.03006715506715634,\n        \"nauc_recall_at_1_diff1\": 0.8780100718940327,\n        \"nauc_recall_at_1_max\": 0.7914175798292935,\n        \"nauc_recall_at_1_std\": -0.09726163371056187,\n        \"nauc_recall_at_20_diff1\": 0.7728828905299517,\n        \"nauc_recall_at_20_max\": 0.840788840788842,\n        \"nauc_recall_at_20_std\": 0.13823104999575303,\n        \"nauc_recall_at_3_diff1\": 0.8063250419101982,\n        \"nauc_recall_at_3_max\": 0.8331113225499521,\n        \"nauc_recall_at_3_std\": -0.0903312038421456,\n        \"nauc_recall_at_5_diff1\": 0.8015999192469797,\n        \"nauc_recall_at_5_max\": 0.8471433618492444,\n        \"nauc_recall_at_5_std\": -0.046098619628033,\n        \"ndcg_at_1\": 0.80222,\n        \"ndcg_at_10\": 0.8731,\n        \"ndcg_at_100\": 0.88315,\n        \"ndcg_at_1000\": 0.88472,\n        \"ndcg_at_20\": 0.8784,\n        \"ndcg_at_3\": 0.85078,\n        \"ndcg_at_5\": 0.86508,\n        \"precision_at_1\": 0.80222,\n        \"precision_at_10\": 0.09422,\n        \"precision_at_100\": 0.00988,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04817,\n        \"precision_at_3\": 0.29444,\n        \"precision_at_5\": 0.18356,\n        \"recall_at_1\": 0.80222,\n        \"recall_at_10\": 0.94222,\n        \"recall_at_100\": 0.98778,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.96333,\n        \"recall_at_3\": 0.88333,\n        \"recall_at_5\": 0.91778\n      },\n      {\n        \"hf_subset\": \"kor_Hang-eng_Latn\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.83888,\n        \"map_at_1\": 0.75556,\n        \"map_at_10\": 0.81336,\n        \"map_at_100\": 0.81681,\n        \"map_at_1000\": 0.81686,\n        \"map_at_20\": 0.81569,\n        \"map_at_3\": 0.80352,\n        \"map_at_5\": 0.80957,\n        \"mrr_at_1\": 0.7555555555555555,\n        \"mrr_at_10\": 0.8133562610229279,\n        \"mrr_at_100\": 0.8168110342899199,\n        \"mrr_at_1000\": 0.8168636074795783,\n        \"mrr_at_20\": 0.8156923300202454,\n        \"mrr_at_3\": 0.8035185185185189,\n        \"mrr_at_5\": 0.8095740740740744,\n        \"nauc_map_at_1000_diff1\": 0.8552079792935121,\n        \"nauc_map_at_1000_max\": 0.7655597821372521,\n        \"nauc_map_at_1000_std\": -0.052744148523482345,\n        \"nauc_map_at_100_diff1\": 0.8551799309543388,\n        \"nauc_map_at_100_max\": 0.7655729563607201,\n        \"nauc_map_at_100_std\": -0.05267908144900576,\n        \"nauc_map_at_10_diff1\": 0.8539404180083635,\n        \"nauc_map_at_10_max\": 0.7669291493096944,\n        \"nauc_map_at_10_std\": -0.050172170353697,\n        \"nauc_map_at_1_diff1\": 0.8750686813186811,\n        \"nauc_map_at_1_max\": 0.7513523114816217,\n        \"nauc_map_at_1_std\": -0.06911472148541131,\n        \"nauc_map_at_20_diff1\": 0.8543470168817537,\n        \"nauc_map_at_20_max\": 0.7656251112308703,\n        \"nauc_map_at_20_std\": -0.052179337171268055,\n        \"nauc_map_at_3_diff1\": 0.8554683573147109,\n        \"nauc_map_at_3_max\": 0.7678759319132484,\n        \"nauc_map_at_3_std\": -0.057746787669783646,\n        \"nauc_map_at_5_diff1\": 0.8542533469592593,\n        \"nauc_map_at_5_max\": 0.767135369326461,\n        \"nauc_map_at_5_std\": -0.056006509755512475,\n        \"nauc_mrr_at_1000_diff1\": 0.8552079792935121,\n        \"nauc_mrr_at_1000_max\": 0.7655597821372521,\n        \"nauc_mrr_at_1000_std\": -0.052744148523482345,\n        \"nauc_mrr_at_100_diff1\": 0.8551799309543388,\n        \"nauc_mrr_at_100_max\": 0.7655729563607201,\n        \"nauc_mrr_at_100_std\": -0.05267908144900576,\n        \"nauc_mrr_at_10_diff1\": 0.8539404180083635,\n        \"nauc_mrr_at_10_max\": 0.7669291493096944,\n        \"nauc_mrr_at_10_std\": -0.050172170353697,\n        \"nauc_mrr_at_1_diff1\": 0.8750686813186811,\n        \"nauc_mrr_at_1_max\": 0.7513523114816217,\n        \"nauc_mrr_at_1_std\": -0.06911472148541131,\n        \"nauc_mrr_at_20_diff1\": 0.8543470168817537,\n        \"nauc_mrr_at_20_max\": 0.7656251112308703,\n        \"nauc_mrr_at_20_std\": -0.052179337171268055,\n        \"nauc_mrr_at_3_diff1\": 0.8554683573147109,\n        \"nauc_mrr_at_3_max\": 0.7678759319132484,\n        \"nauc_mrr_at_3_std\": -0.057746787669783646,\n        \"nauc_mrr_at_5_diff1\": 0.8542533469592593,\n        \"nauc_mrr_at_5_max\": 0.767135369326461,\n        \"nauc_mrr_at_5_std\": -0.056006509755512475,\n        \"nauc_ndcg_at_1000_diff1\": 0.8516502375385397,\n        \"nauc_ndcg_at_1000_max\": 0.7681734581374354,\n        \"nauc_ndcg_at_1000_std\": -0.046068889340921834,\n        \"nauc_ndcg_at_100_diff1\": 0.8507752097738177,\n        \"nauc_ndcg_at_100_max\": 0.7685687755564266,\n        \"nauc_ndcg_at_100_std\": -0.043780455888798045,\n        \"nauc_ndcg_at_10_diff1\": 0.8444678096177537,\n        \"nauc_ndcg_at_10_max\": 0.7745939843597542,\n        \"nauc_ndcg_at_10_std\": -0.029952471574620623,\n        \"nauc_ndcg_at_1_diff1\": 0.8750686813186811,\n        \"nauc_ndcg_at_1_max\": 0.7513523114816217,\n        \"nauc_ndcg_at_1_std\": -0.06911472148541131,\n        \"nauc_ndcg_at_20_diff1\": 0.8455288219624316,\n        \"nauc_ndcg_at_20_max\": 0.7694035427816696,\n        \"nauc_ndcg_at_20_std\": -0.03916335368484008,\n        \"nauc_ndcg_at_3_diff1\": 0.8483046588257898,\n        \"nauc_ndcg_at_3_max\": 0.7759423187598142,\n        \"nauc_ndcg_at_3_std\": -0.049595196825266315,\n        \"nauc_ndcg_at_5_diff1\": 0.8453704821374776,\n        \"nauc_ndcg_at_5_max\": 0.7745320077009648,\n        \"nauc_ndcg_at_5_std\": -0.04643041354083876,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.770308123249306,\n        \"nauc_precision_at_100_max\": 0.805088702147535,\n        \"nauc_precision_at_100_std\": 0.17478991596638663,\n        \"nauc_precision_at_10_diff1\": 0.7871148459383727,\n        \"nauc_precision_at_10_max\": 0.8209617180205405,\n        \"nauc_precision_at_10_std\": 0.10627223862517551,\n        \"nauc_precision_at_1_diff1\": 0.8750686813186811,\n        \"nauc_precision_at_1_max\": 0.7513523114816217,\n        \"nauc_precision_at_1_std\": -0.06911472148541131,\n        \"nauc_precision_at_20_diff1\": 0.7612407926133399,\n        \"nauc_precision_at_20_max\": 0.7927793339558018,\n        \"nauc_precision_at_20_std\": 0.08127399107790856,\n        \"nauc_precision_at_3_diff1\": 0.8203684910276686,\n        \"nauc_precision_at_3_max\": 0.8083162225736156,\n        \"nauc_precision_at_3_std\": -0.015997576959084468,\n        \"nauc_precision_at_5_diff1\": 0.8041012298959324,\n        \"nauc_precision_at_5_max\": 0.8085241248817403,\n        \"nauc_precision_at_5_std\": -0.0006811731315055293,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.7703081232493021,\n        \"nauc_recall_at_100_max\": 0.8050887021475257,\n        \"nauc_recall_at_100_std\": 0.17478991596638907,\n        \"nauc_recall_at_10_diff1\": 0.7871148459383758,\n        \"nauc_recall_at_10_max\": 0.8209617180205421,\n        \"nauc_recall_at_10_std\": 0.10627223862517948,\n        \"nauc_recall_at_1_diff1\": 0.8750686813186811,\n        \"nauc_recall_at_1_max\": 0.7513523114816217,\n        \"nauc_recall_at_1_std\": -0.06911472148541131,\n        \"nauc_recall_at_20_diff1\": 0.7612407926133409,\n        \"nauc_recall_at_20_max\": 0.7927793339558047,\n        \"nauc_recall_at_20_std\": 0.08127399107791237,\n        \"nauc_recall_at_3_diff1\": 0.8203684910276674,\n        \"nauc_recall_at_3_max\": 0.8083162225736152,\n        \"nauc_recall_at_3_std\": -0.01599757695908346,\n        \"nauc_recall_at_5_diff1\": 0.8041012298959324,\n        \"nauc_recall_at_5_max\": 0.8085241248817412,\n        \"nauc_recall_at_5_std\": -0.0006811731315034448,\n        \"ndcg_at_1\": 0.75556,\n        \"ndcg_at_10\": 0.83888,\n        \"ndcg_at_100\": 0.85459,\n        \"ndcg_at_1000\": 0.85601,\n        \"ndcg_at_20\": 0.84716,\n        \"ndcg_at_3\": 0.8189,\n        \"ndcg_at_5\": 0.82961,\n        \"precision_at_1\": 0.75556,\n        \"precision_at_10\": 0.09178,\n        \"precision_at_100\": 0.00989,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.0475,\n        \"precision_at_3\": 0.28778,\n        \"precision_at_5\": 0.17778,\n        \"recall_at_1\": 0.75556,\n        \"recall_at_10\": 0.91778,\n        \"recall_at_100\": 0.98889,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.95,\n        \"recall_at_3\": 0.86333,\n        \"recall_at_5\": 0.88889\n      },\n      {\n        \"hf_subset\": \"eng_Latn-kor_Hang\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.82498,\n        \"map_at_1\": 0.72667,\n        \"map_at_10\": 0.79367,\n        \"map_at_100\": 0.79628,\n        \"map_at_1000\": 0.79635,\n        \"map_at_20\": 0.7953,\n        \"map_at_3\": 0.78056,\n        \"map_at_5\": 0.78767,\n        \"mrr_at_1\": 0.7266666666666667,\n        \"mrr_at_10\": 0.7936684303350976,\n        \"mrr_at_100\": 0.7962803748187756,\n        \"mrr_at_1000\": 0.7963519416455496,\n        \"mrr_at_20\": 0.795298418424064,\n        \"mrr_at_3\": 0.7805555555555558,\n        \"mrr_at_5\": 0.7876666666666673,\n        \"nauc_map_at_1000_diff1\": 0.8198877016857965,\n        \"nauc_map_at_1000_max\": 0.7039621373903541,\n        \"nauc_map_at_1000_std\": -0.010282032620789295,\n        \"nauc_map_at_100_diff1\": 0.8198307635640973,\n        \"nauc_map_at_100_max\": 0.7039987287897214,\n        \"nauc_map_at_100_std\": -0.010170817226117472,\n        \"nauc_map_at_10_diff1\": 0.8190978533154528,\n        \"nauc_map_at_10_max\": 0.7043790265300705,\n        \"nauc_map_at_10_std\": -0.007775808697076773,\n        \"nauc_map_at_1_diff1\": 0.8389424428385471,\n        \"nauc_map_at_1_max\": 0.6697198904991112,\n        \"nauc_map_at_1_std\": -0.06391227819799271,\n        \"nauc_map_at_20_diff1\": 0.8194881547456134,\n        \"nauc_map_at_20_max\": 0.704000317261751,\n        \"nauc_map_at_20_std\": -0.010215529201033439,\n        \"nauc_map_at_3_diff1\": 0.8216468435498626,\n        \"nauc_map_at_3_max\": 0.7111519191391099,\n        \"nauc_map_at_3_std\": -0.005581841153662009,\n        \"nauc_map_at_5_diff1\": 0.8189828919805343,\n        \"nauc_map_at_5_max\": 0.7095371290717255,\n        \"nauc_map_at_5_std\": -0.0040165946637628165,\n        \"nauc_mrr_at_1000_diff1\": 0.8198877016857965,\n        \"nauc_mrr_at_1000_max\": 0.7039621373903541,\n        \"nauc_mrr_at_1000_std\": -0.010282032620789295,\n        \"nauc_mrr_at_100_diff1\": 0.8198307635640973,\n        \"nauc_mrr_at_100_max\": 0.7039987287897214,\n        \"nauc_mrr_at_100_std\": -0.010170817226117472,\n        \"nauc_mrr_at_10_diff1\": 0.8190978533154528,\n        \"nauc_mrr_at_10_max\": 0.7043790265300705,\n        \"nauc_mrr_at_10_std\": -0.007775808697076773,\n        \"nauc_mrr_at_1_diff1\": 0.8389424428385471,\n        \"nauc_mrr_at_1_max\": 0.6697198904991112,\n        \"nauc_mrr_at_1_std\": -0.06391227819799271,\n        \"nauc_mrr_at_20_diff1\": 0.8194881547456134,\n        \"nauc_mrr_at_20_max\": 0.704000317261751,\n        \"nauc_mrr_at_20_std\": -0.010215529201033439,\n        \"nauc_mrr_at_3_diff1\": 0.8216468435498626,\n        \"nauc_mrr_at_3_max\": 0.7111519191391099,\n        \"nauc_mrr_at_3_std\": -0.005581841153662009,\n        \"nauc_mrr_at_5_diff1\": 0.8189828919805343,\n        \"nauc_mrr_at_5_max\": 0.7095371290717255,\n        \"nauc_mrr_at_5_std\": -0.0040165946637628165,\n        \"nauc_ndcg_at_1000_diff1\": 0.8166294722148444,\n        \"nauc_ndcg_at_1000_max\": 0.7082342519759786,\n        \"nauc_ndcg_at_1000_std\": -0.0006063837025108052,\n        \"nauc_ndcg_at_100_diff1\": 0.8150190642956522,\n        \"nauc_ndcg_at_100_max\": 0.7095296953964633,\n        \"nauc_ndcg_at_100_std\": 0.004120037570128214,\n        \"nauc_ndcg_at_10_diff1\": 0.811486575865088,\n        \"nauc_ndcg_at_10_max\": 0.711251275982116,\n        \"nauc_ndcg_at_10_std\": 0.01407065567263889,\n        \"nauc_ndcg_at_1_diff1\": 0.8389424428385471,\n        \"nauc_ndcg_at_1_max\": 0.6697198904991112,\n        \"nauc_ndcg_at_1_std\": -0.06391227819799271,\n        \"nauc_ndcg_at_20_diff1\": 0.8131008675319239,\n        \"nauc_ndcg_at_20_max\": 0.7099436542200415,\n        \"nauc_ndcg_at_20_std\": 0.004561534822046999,\n        \"nauc_ndcg_at_3_diff1\": 0.8165304433896998,\n        \"nauc_ndcg_at_3_max\": 0.7257597506185963,\n        \"nauc_ndcg_at_3_std\": 0.015108113368058916,\n        \"nauc_ndcg_at_5_diff1\": 0.8110766298697383,\n        \"nauc_ndcg_at_5_max\": 0.7241590386588409,\n        \"nauc_ndcg_at_5_std\": 0.020597282917691275,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 0.7012138188608817,\n        \"nauc_precision_at_100_max\": 0.8060891023075896,\n        \"nauc_precision_at_100_std\": 0.3697145524876703,\n        \"nauc_precision_at_10_diff1\": 0.7599358584013315,\n        \"nauc_precision_at_10_max\": 0.7470872406933767,\n        \"nauc_precision_at_10_std\": 0.1667546245551344,\n        \"nauc_precision_at_1_diff1\": 0.8389424428385471,\n        \"nauc_precision_at_1_max\": 0.6697198904991112,\n        \"nauc_precision_at_1_std\": -0.06391227819799271,\n        \"nauc_precision_at_20_diff1\": 0.7569736227824434,\n        \"nauc_precision_at_20_max\": 0.748229847494551,\n        \"nauc_precision_at_20_std\": 0.12646864301275607,\n        \"nauc_precision_at_3_diff1\": 0.7974318529107323,\n        \"nauc_precision_at_3_max\": 0.7815772239787632,\n        \"nauc_precision_at_3_std\": 0.09422290136540673,\n        \"nauc_precision_at_5_diff1\": 0.7745448115852023,\n        \"nauc_precision_at_5_max\": 0.790755642956331,\n        \"nauc_precision_at_5_std\": 0.13480563389999892,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.7012138188608772,\n        \"nauc_recall_at_100_max\": 0.80608910230759,\n        \"nauc_recall_at_100_std\": 0.3697145524876553,\n        \"nauc_recall_at_10_diff1\": 0.7599358584013316,\n        \"nauc_recall_at_10_max\": 0.7470872406933793,\n        \"nauc_recall_at_10_std\": 0.1667546245551364,\n        \"nauc_recall_at_1_diff1\": 0.8389424428385471,\n        \"nauc_recall_at_1_max\": 0.6697198904991112,\n        \"nauc_recall_at_1_std\": -0.06391227819799271,\n        \"nauc_recall_at_20_diff1\": 0.7569736227824453,\n        \"nauc_recall_at_20_max\": 0.7482298474945528,\n        \"nauc_recall_at_20_std\": 0.1264686430127625,\n        \"nauc_recall_at_3_diff1\": 0.7974318529107312,\n        \"nauc_recall_at_3_max\": 0.7815772239787608,\n        \"nauc_recall_at_3_std\": 0.09422290136540572,\n        \"nauc_recall_at_5_diff1\": 0.7745448115852033,\n        \"nauc_recall_at_5_max\": 0.7907556429563315,\n        \"nauc_recall_at_5_std\": 0.1348056338999996,\n        \"ndcg_at_1\": 0.72667,\n        \"ndcg_at_10\": 0.82498,\n        \"ndcg_at_100\": 0.83794,\n        \"ndcg_at_1000\": 0.83992,\n        \"ndcg_at_20\": 0.8309,\n        \"ndcg_at_3\": 0.79731,\n        \"ndcg_at_5\": 0.81013,\n        \"precision_at_1\": 0.72667,\n        \"precision_at_10\": 0.09233,\n        \"precision_at_100\": 0.00984,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.04733,\n        \"precision_at_3\": 0.28185,\n        \"precision_at_5\": 0.17533,\n        \"recall_at_1\": 0.72667,\n        \"recall_at_10\": 0.92333,\n        \"recall_at_100\": 0.98444,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.94667,\n        \"recall_at_3\": 0.84556,\n        \"recall_at_5\": 0.87667\n      }\n    ]\n  },\n  \"task_name\": \"BelebeleRetrieval\"\n}"
  },
  {
    "path": "eval/results/upskyy/bge-m3-korean/upskyy__bge-m3-korean/no_revision_available/Ko-StrategyQA.json",
    "content": "{\n  \"dataset_revision\": \"d243889a3eb6654029dbd7e7f9319ae31d58f97c\",\n  \"evaluation_time\": 112.89276218414307,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"default\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.75277,\n        \"map_at_1\": 0.46061,\n        \"map_at_10\": 0.70381,\n        \"map_at_100\": 0.70988,\n        \"map_at_1000\": 0.71025,\n        \"map_at_20\": 0.70718,\n        \"map_at_3\": 0.66324,\n        \"map_at_5\": 0.69005,\n        \"mrr_at_1\": 0.7094594594594594,\n        \"mrr_at_10\": 0.7702065905190908,\n        \"mrr_at_100\": 0.7724194172647475,\n        \"mrr_at_1000\": 0.77260268439593,\n        \"mrr_at_20\": 0.7713943086282484,\n        \"mrr_at_3\": 0.762668918918919,\n        \"mrr_at_5\": 0.7662162162162162,\n        \"nauc_map_at_1000_diff1\": 0.5283723980423071,\n        \"nauc_map_at_1000_max\": 0.5639612303477157,\n        \"nauc_map_at_1000_std\": 0.03188120725857407,\n        \"nauc_map_at_100_diff1\": 0.5284713837594557,\n        \"nauc_map_at_100_max\": 0.5643147055598294,\n        \"nauc_map_at_100_std\": 0.032082227552883445,\n        \"nauc_map_at_10_diff1\": 0.5256042644404846,\n        \"nauc_map_at_10_max\": 0.5623005303848427,\n        \"nauc_map_at_10_std\": 0.0297382912059091,\n        \"nauc_map_at_1_diff1\": 0.5701858649712257,\n        \"nauc_map_at_1_max\": 0.27644800311234535,\n        \"nauc_map_at_1_std\": -0.0689066272003743,\n        \"nauc_map_at_20_diff1\": 0.5280904970352152,\n        \"nauc_map_at_20_max\": 0.5633255574048996,\n        \"nauc_map_at_20_std\": 0.030878945418817243,\n        \"nauc_map_at_3_diff1\": 0.5294488430554147,\n        \"nauc_map_at_3_max\": 0.5079972019662355,\n        \"nauc_map_at_3_std\": -0.002753515625402979,\n        \"nauc_map_at_5_diff1\": 0.5230331286467887,\n        \"nauc_map_at_5_max\": 0.5521673525537383,\n        \"nauc_map_at_5_std\": 0.018118497110511143,\n        \"nauc_mrr_at_1000_diff1\": 0.6110877608775925,\n        \"nauc_mrr_at_1000_max\": 0.655476433933367,\n        \"nauc_mrr_at_1000_std\": 0.09332923134454195,\n        \"nauc_mrr_at_100_diff1\": 0.611094567812382,\n        \"nauc_mrr_at_100_max\": 0.6556526188303674,\n        \"nauc_mrr_at_100_std\": 0.09345938564755246,\n        \"nauc_mrr_at_10_diff1\": 0.6110172404956511,\n        \"nauc_mrr_at_10_max\": 0.6580183379655195,\n        \"nauc_mrr_at_10_std\": 0.09396654331046725,\n        \"nauc_mrr_at_1_diff1\": 0.6196685261632404,\n        \"nauc_mrr_at_1_max\": 0.5628198471368047,\n        \"nauc_mrr_at_1_std\": 0.06250151061095299,\n        \"nauc_mrr_at_20_diff1\": 0.6114055724751905,\n        \"nauc_mrr_at_20_max\": 0.6565513476004787,\n        \"nauc_mrr_at_20_std\": 0.09336678821083362,\n        \"nauc_mrr_at_3_diff1\": 0.610102556468651,\n        \"nauc_mrr_at_3_max\": 0.6546153414720447,\n        \"nauc_mrr_at_3_std\": 0.0980530815344508,\n        \"nauc_mrr_at_5_diff1\": 0.6102606171597507,\n        \"nauc_mrr_at_5_max\": 0.6588326469437563,\n        \"nauc_mrr_at_5_std\": 0.0956488852031488,\n        \"nauc_ndcg_at_1000_diff1\": 0.548364721562242,\n        \"nauc_ndcg_at_1000_max\": 0.6210691913997829,\n        \"nauc_ndcg_at_1000_std\": 0.06170363548170726,\n        \"nauc_ndcg_at_100_diff1\": 0.5478737500892652,\n        \"nauc_ndcg_at_100_max\": 0.6302602500235459,\n        \"nauc_ndcg_at_100_std\": 0.06464152290901783,\n        \"nauc_ndcg_at_10_diff1\": 0.5404294253877192,\n        \"nauc_ndcg_at_10_max\": 0.6254988627051006,\n        \"nauc_ndcg_at_10_std\": 0.05611631319806918,\n        \"nauc_ndcg_at_1_diff1\": 0.6196685261632404,\n        \"nauc_ndcg_at_1_max\": 0.5628198471368047,\n        \"nauc_ndcg_at_1_std\": 0.06250151061095299,\n        \"nauc_ndcg_at_20_diff1\": 0.5458839263846998,\n        \"nauc_ndcg_at_20_max\": 0.6273474088149236,\n        \"nauc_ndcg_at_20_std\": 0.058500300554178264,\n        \"nauc_ndcg_at_3_diff1\": 0.5380531600639286,\n        \"nauc_ndcg_at_3_max\": 0.55783541791414,\n        \"nauc_ndcg_at_3_std\": 0.017346169525437556,\n        \"nauc_ndcg_at_5_diff1\": 0.5335841119966354,\n        \"nauc_ndcg_at_5_max\": 0.6084086071554122,\n        \"nauc_ndcg_at_5_std\": 0.04155408370757714,\n        \"nauc_precision_at_1000_diff1\": -0.25699322093687643,\n        \"nauc_precision_at_1000_max\": 0.07601960825033816,\n        \"nauc_precision_at_1000_std\": 0.14744955792025402,\n        \"nauc_precision_at_100_diff1\": -0.15632197997122793,\n        \"nauc_precision_at_100_max\": 0.21329386391075608,\n        \"nauc_precision_at_100_std\": 0.1615057936864428,\n        \"nauc_precision_at_10_diff1\": -0.057457221919012806,\n        \"nauc_precision_at_10_max\": 0.3279489619845634,\n        \"nauc_precision_at_10_std\": 0.15133353580564418,\n        \"nauc_precision_at_1_diff1\": 0.6196685261632404,\n        \"nauc_precision_at_1_max\": 0.5628198471368047,\n        \"nauc_precision_at_1_std\": 0.06250151061095299,\n        \"nauc_precision_at_20_diff1\": -0.08043791260906195,\n        \"nauc_precision_at_20_max\": 0.29662091164606197,\n        \"nauc_precision_at_20_std\": 0.1538681230302332,\n        \"nauc_precision_at_3_diff1\": 0.08073152560763562,\n        \"nauc_precision_at_3_max\": 0.4082838602872238,\n        \"nauc_precision_at_3_std\": 0.11105723443150181,\n        \"nauc_precision_at_5_diff1\": -0.0008838666573368835,\n        \"nauc_precision_at_5_max\": 0.37939011955604734,\n        \"nauc_precision_at_5_std\": 0.1333475642609226,\n        \"nauc_recall_at_1000_diff1\": 0.5643819020368003,\n        \"nauc_recall_at_1000_max\": 0.8204347370517291,\n        \"nauc_recall_at_1000_std\": 0.19033850555495097,\n        \"nauc_recall_at_100_diff1\": 0.5304304823659386,\n        \"nauc_recall_at_100_max\": 0.8262527382803844,\n        \"nauc_recall_at_100_std\": 0.14912134664777515,\n        \"nauc_recall_at_10_diff1\": 0.49163547770924193,\n        \"nauc_recall_at_10_max\": 0.7174822582587085,\n        \"nauc_recall_at_10_std\": 0.07108521174262873,\n        \"nauc_recall_at_1_diff1\": 0.5701858649712257,\n        \"nauc_recall_at_1_max\": 0.27644800311234535,\n        \"nauc_recall_at_1_std\": -0.0689066272003743,\n        \"nauc_recall_at_20_diff1\": 0.5092786343003812,\n        \"nauc_recall_at_20_max\": 0.7359239824179382,\n        \"nauc_recall_at_20_std\": 0.08327847033603757,\n        \"nauc_recall_at_3_diff1\": 0.487954999737232,\n        \"nauc_recall_at_3_max\": 0.5440221661839623,\n        \"nauc_recall_at_3_std\": -0.004510327744451479,\n        \"nauc_recall_at_5_diff1\": 0.4750711658142984,\n        \"nauc_recall_at_5_max\": 0.6544747050418612,\n        \"nauc_recall_at_5_std\": 0.03719332438438219,\n        \"ndcg_at_1\": 0.70946,\n        \"ndcg_at_10\": 0.75277,\n        \"ndcg_at_100\": 0.77389,\n        \"ndcg_at_1000\": 0.78241,\n        \"ndcg_at_20\": 0.76106,\n        \"ndcg_at_3\": 0.70598,\n        \"ndcg_at_5\": 0.73118,\n        \"precision_at_1\": 0.70946,\n        \"precision_at_10\": 0.15135,\n        \"precision_at_100\": 0.01693,\n        \"precision_at_1000\": 0.00182,\n        \"precision_at_20\": 0.07838,\n        \"precision_at_3\": 0.41892,\n        \"precision_at_5\": 0.2777,\n        \"recall_at_1\": 0.46061,\n        \"recall_at_10\": 0.81975,\n        \"recall_at_100\": 0.90035,\n        \"recall_at_1000\": 0.95687,\n        \"recall_at_20\": 0.84632,\n        \"recall_at_3\": 0.71699,\n        \"recall_at_5\": 0.76854\n      }\n    ]\n  },\n  \"task_name\": \"Ko-StrategyQA\"\n}"
  },
  {
    "path": "eval/results/upskyy/bge-m3-korean/upskyy__bge-m3-korean/no_revision_available/MIRACLRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 11371.988452672958,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.59892,\n        \"map_at_1\": 0.33166,\n        \"map_at_10\": 0.50683,\n        \"map_at_100\": 0.53331,\n        \"map_at_1000\": 0.53409,\n        \"map_at_20\": 0.5235,\n        \"map_at_3\": 0.43921,\n        \"map_at_5\": 0.47596,\n        \"mrr_at_1\": 0.539906103286385,\n        \"mrr_at_10\": 0.654562560548476,\n        \"mrr_at_100\": 0.6584680305976771,\n        \"mrr_at_1000\": 0.6586721474663049,\n        \"mrr_at_20\": 0.6570736531540831,\n        \"mrr_at_3\": 0.6330203442879497,\n        \"mrr_at_5\": 0.647809076682316,\n        \"nauc_map_at_1000_diff1\": 0.3356785312787551,\n        \"nauc_map_at_1000_max\": 0.3235511706611351,\n        \"nauc_map_at_1000_std\": -0.07993364772635123,\n        \"nauc_map_at_100_diff1\": 0.3355767982975825,\n        \"nauc_map_at_100_max\": 0.32366533560928623,\n        \"nauc_map_at_100_std\": -0.08006408616329992,\n        \"nauc_map_at_10_diff1\": 0.33847390960408513,\n        \"nauc_map_at_10_max\": 0.3027052556364594,\n        \"nauc_map_at_10_std\": -0.130456084374079,\n        \"nauc_map_at_1_diff1\": 0.4436529715971849,\n        \"nauc_map_at_1_max\": 0.2197593675886129,\n        \"nauc_map_at_1_std\": -0.2338662252219611,\n        \"nauc_map_at_20_diff1\": 0.33870857019496,\n        \"nauc_map_at_20_max\": 0.3128885452188113,\n        \"nauc_map_at_20_std\": -0.09798507583805648,\n        \"nauc_map_at_3_diff1\": 0.37776447643229705,\n        \"nauc_map_at_3_max\": 0.2767416668664703,\n        \"nauc_map_at_3_std\": -0.19863192356358927,\n        \"nauc_map_at_5_diff1\": 0.3561167429750661,\n        \"nauc_map_at_5_max\": 0.2849009688135222,\n        \"nauc_map_at_5_std\": -0.18058479036602415,\n        \"nauc_mrr_at_1000_diff1\": 0.26418759775085326,\n        \"nauc_mrr_at_1000_max\": 0.42615412318814566,\n        \"nauc_mrr_at_1000_std\": 0.16920356600320913,\n        \"nauc_mrr_at_100_diff1\": 0.26416301871133957,\n        \"nauc_mrr_at_100_max\": 0.4264119448078765,\n        \"nauc_mrr_at_100_std\": 0.16948480024623644,\n        \"nauc_mrr_at_10_diff1\": 0.2635977730704618,\n        \"nauc_mrr_at_10_max\": 0.42979782822917384,\n        \"nauc_mrr_at_10_std\": 0.1722637550445164,\n        \"nauc_mrr_at_1_diff1\": 0.31806203990846843,\n        \"nauc_mrr_at_1_max\": 0.3772431818974325,\n        \"nauc_mrr_at_1_std\": 0.10571097874830919,\n        \"nauc_mrr_at_20_diff1\": 0.2650788317901155,\n        \"nauc_mrr_at_20_max\": 0.4272246710009317,\n        \"nauc_mrr_at_20_std\": 0.16955994974903277,\n        \"nauc_mrr_at_3_diff1\": 0.26143767164359477,\n        \"nauc_mrr_at_3_max\": 0.4207971187432844,\n        \"nauc_mrr_at_3_std\": 0.17140995146958404,\n        \"nauc_mrr_at_5_diff1\": 0.25139687618821654,\n        \"nauc_mrr_at_5_max\": 0.42323570646317255,\n        \"nauc_mrr_at_5_std\": 0.16558258004255935,\n        \"nauc_ndcg_at_1000_diff1\": 0.29958892618620975,\n        \"nauc_ndcg_at_1000_max\": 0.38501029247145113,\n        \"nauc_ndcg_at_1000_std\": 0.059259573627608066,\n        \"nauc_ndcg_at_100_diff1\": 0.3009377107043353,\n        \"nauc_ndcg_at_100_max\": 0.39527292405597536,\n        \"nauc_ndcg_at_100_std\": 0.06903667287487025,\n        \"nauc_ndcg_at_10_diff1\": 0.30065589964999173,\n        \"nauc_ndcg_at_10_max\": 0.34411859353149415,\n        \"nauc_ndcg_at_10_std\": -0.03588746180506714,\n        \"nauc_ndcg_at_1_diff1\": 0.31806203990846843,\n        \"nauc_ndcg_at_1_max\": 0.3772431818974325,\n        \"nauc_ndcg_at_1_std\": 0.10571097874830919,\n        \"nauc_ndcg_at_20_diff1\": 0.30998840438403896,\n        \"nauc_ndcg_at_20_max\": 0.3663471267563369,\n        \"nauc_ndcg_at_20_std\": 0.01414153978661343,\n        \"nauc_ndcg_at_3_diff1\": 0.30193750136919056,\n        \"nauc_ndcg_at_3_max\": 0.3458377385105322,\n        \"nauc_ndcg_at_3_std\": 0.004422511116013512,\n        \"nauc_ndcg_at_5_diff1\": 0.3042528293597453,\n        \"nauc_ndcg_at_5_max\": 0.329355225386227,\n        \"nauc_ndcg_at_5_std\": -0.04888581154378307,\n        \"nauc_precision_at_1000_diff1\": -0.22484858090221838,\n        \"nauc_precision_at_1000_max\": 0.14007405630073602,\n        \"nauc_precision_at_1000_std\": 0.5620988868690893,\n        \"nauc_precision_at_100_diff1\": -0.20199411739609105,\n        \"nauc_precision_at_100_max\": 0.18794875350999649,\n        \"nauc_precision_at_100_std\": 0.5848460512676487,\n        \"nauc_precision_at_10_diff1\": -0.1780495088533368,\n        \"nauc_precision_at_10_max\": 0.23748412451595022,\n        \"nauc_precision_at_10_std\": 0.49889886269187383,\n        \"nauc_precision_at_1_diff1\": 0.31806203990846843,\n        \"nauc_precision_at_1_max\": 0.3772431818974325,\n        \"nauc_precision_at_1_std\": 0.10571097874830919,\n        \"nauc_precision_at_20_diff1\": -0.17607522736467468,\n        \"nauc_precision_at_20_max\": 0.21173930270938313,\n        \"nauc_precision_at_20_std\": 0.5620839514918033,\n        \"nauc_precision_at_3_diff1\": -0.04710361351541399,\n        \"nauc_precision_at_3_max\": 0.3553157438328994,\n        \"nauc_precision_at_3_std\": 0.34595623758315647,\n        \"nauc_precision_at_5_diff1\": -0.14216537428749043,\n        \"nauc_precision_at_5_max\": 0.27558625362486805,\n        \"nauc_precision_at_5_std\": 0.4195412647387249,\n        \"nauc_recall_at_1000_diff1\": 0.3746757572669107,\n        \"nauc_recall_at_1000_max\": 0.5928548386757957,\n        \"nauc_recall_at_1000_std\": 0.5142911199199388,\n        \"nauc_recall_at_100_diff1\": 0.28745646235411654,\n        \"nauc_recall_at_100_max\": 0.5775877005126822,\n        \"nauc_recall_at_100_std\": 0.3759204362505022,\n        \"nauc_recall_at_10_diff1\": 0.23963010961221182,\n        \"nauc_recall_at_10_max\": 0.2713974290618537,\n        \"nauc_recall_at_10_std\": -0.10668557001230727,\n        \"nauc_recall_at_1_diff1\": 0.4436529715971849,\n        \"nauc_recall_at_1_max\": 0.2197593675886129,\n        \"nauc_recall_at_1_std\": -0.2338662252219611,\n        \"nauc_recall_at_20_diff1\": 0.28452710089292077,\n        \"nauc_recall_at_20_max\": 0.32921281235198213,\n        \"nauc_recall_at_20_std\": -0.0009927656338690539,\n        \"nauc_recall_at_3_diff1\": 0.31662499652398335,\n        \"nauc_recall_at_3_max\": 0.2300903670686967,\n        \"nauc_recall_at_3_std\": -0.20219157373562308,\n        \"nauc_recall_at_5_diff1\": 0.24517982270251407,\n        \"nauc_recall_at_5_max\": 0.21475414644023236,\n        \"nauc_recall_at_5_std\": -0.2104959961896699,\n        \"ndcg_at_1\": 0.53991,\n        \"ndcg_at_10\": 0.59892,\n        \"ndcg_at_100\": 0.66341,\n        \"ndcg_at_1000\": 0.67497,\n        \"ndcg_at_20\": 0.63091,\n        \"ndcg_at_3\": 0.55108,\n        \"ndcg_at_5\": 0.56797,\n        \"precision_at_1\": 0.53991,\n        \"precision_at_10\": 0.15822,\n        \"precision_at_100\": 0.02357,\n        \"precision_at_1000\": 0.00254,\n        \"precision_at_20\": 0.09507,\n        \"precision_at_3\": 0.33959,\n        \"precision_at_5\": 0.25352,\n        \"recall_at_1\": 0.33166,\n        \"recall_at_10\": 0.70097,\n        \"recall_at_100\": 0.91204,\n        \"recall_at_1000\": 0.98419,\n        \"recall_at_20\": 0.79295,\n        \"recall_at_3\": 0.50931,\n        \"recall_at_5\": 0.60515\n      }\n    ]\n  },\n  \"task_name\": \"MIRACLRetrieval\"\n}"
  },
  {
    "path": "eval/results/upskyy/bge-m3-korean/upskyy__bge-m3-korean/no_revision_available/MrTidyRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"fc24a3ce8f09746410daee3d5cd823ff7a0675b7\",\n  \"evaluation_time\": 11457.999158143997,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Kore\"\n        ],\n        \"main_score\": 0.55011,\n        \"map_at_1\": 0.37173,\n        \"map_at_10\": 0.49022,\n        \"map_at_100\": 0.49864,\n        \"map_at_1000\": 0.49898,\n        \"map_at_20\": 0.49577,\n        \"map_at_3\": 0.45322,\n        \"map_at_5\": 0.47929,\n        \"mrr_at_1\": 0.40617577197149646,\n        \"mrr_at_10\": 0.5142206763940729,\n        \"mrr_at_100\": 0.5211613964658944,\n        \"mrr_at_1000\": 0.5213639580879118,\n        \"mrr_at_20\": 0.5188662330481526,\n        \"mrr_at_3\": 0.48218527315914494,\n        \"mrr_at_5\": 0.5058194774346793,\n        \"nauc_map_at_1000_diff1\": 0.3534765508644741,\n        \"nauc_map_at_1000_max\": 0.362924613909079,\n        \"nauc_map_at_1000_std\": 0.022637065199890526,\n        \"nauc_map_at_100_diff1\": 0.353334465744014,\n        \"nauc_map_at_100_max\": 0.3627436546134224,\n        \"nauc_map_at_100_std\": 0.022577027925581254,\n        \"nauc_map_at_10_diff1\": 0.35081454613547175,\n        \"nauc_map_at_10_max\": 0.35824316801536765,\n        \"nauc_map_at_10_std\": 0.018621993483028804,\n        \"nauc_map_at_1_diff1\": 0.4394346374015472,\n        \"nauc_map_at_1_max\": 0.35914751186291155,\n        \"nauc_map_at_1_std\": -0.03112772622952899,\n        \"nauc_map_at_20_diff1\": 0.3515758956767678,\n        \"nauc_map_at_20_max\": 0.36139434521556835,\n        \"nauc_map_at_20_std\": 0.022340965234366888,\n        \"nauc_map_at_3_diff1\": 0.3643412305788555,\n        \"nauc_map_at_3_max\": 0.35824502290711857,\n        \"nauc_map_at_3_std\": 0.007773972628907927,\n        \"nauc_map_at_5_diff1\": 0.3542438089845706,\n        \"nauc_map_at_5_max\": 0.35294327035520345,\n        \"nauc_map_at_5_std\": 0.012824952270608616,\n        \"nauc_mrr_at_1000_diff1\": 0.37030847743191486,\n        \"nauc_mrr_at_1000_max\": 0.4014409059065291,\n        \"nauc_mrr_at_1000_std\": 0.04284497455893501,\n        \"nauc_mrr_at_100_diff1\": 0.37021214811364633,\n        \"nauc_mrr_at_100_max\": 0.4014604238515054,\n        \"nauc_mrr_at_100_std\": 0.042864488196709745,\n        \"nauc_mrr_at_10_diff1\": 0.36840780492276015,\n        \"nauc_mrr_at_10_max\": 0.3985126565719115,\n        \"nauc_mrr_at_10_std\": 0.040760639604665264,\n        \"nauc_mrr_at_1_diff1\": 0.4476333755929182,\n        \"nauc_mrr_at_1_max\": 0.40326469057519526,\n        \"nauc_mrr_at_1_std\": 0.0072997114123084985,\n        \"nauc_mrr_at_20_diff1\": 0.3696458244513162,\n        \"nauc_mrr_at_20_max\": 0.4017034248300554,\n        \"nauc_mrr_at_20_std\": 0.0426350028542941,\n        \"nauc_mrr_at_3_diff1\": 0.37427363850577317,\n        \"nauc_mrr_at_3_max\": 0.39667457388663585,\n        \"nauc_mrr_at_3_std\": 0.0360488155766075,\n        \"nauc_mrr_at_5_diff1\": 0.37018973625063745,\n        \"nauc_mrr_at_5_max\": 0.39118360580739486,\n        \"nauc_mrr_at_5_std\": 0.035550641671329056,\n        \"nauc_ndcg_at_1000_diff1\": 0.34179738872130816,\n        \"nauc_ndcg_at_1000_max\": 0.38723451860916625,\n        \"nauc_ndcg_at_1000_std\": 0.05766002535067514,\n        \"nauc_ndcg_at_100_diff1\": 0.33198200853952514,\n        \"nauc_ndcg_at_100_max\": 0.3849533600748478,\n        \"nauc_ndcg_at_100_std\": 0.06016231442477039,\n        \"nauc_ndcg_at_10_diff1\": 0.3213002162445567,\n        \"nauc_ndcg_at_10_max\": 0.3669678880126573,\n        \"nauc_ndcg_at_10_std\": 0.04435716135388231,\n        \"nauc_ndcg_at_1_diff1\": 0.4476333755929182,\n        \"nauc_ndcg_at_1_max\": 0.40326469057519526,\n        \"nauc_ndcg_at_1_std\": 0.0072997114123084985,\n        \"nauc_ndcg_at_20_diff1\": 0.3233671091658442,\n        \"nauc_ndcg_at_20_max\": 0.3784652743856314,\n        \"nauc_ndcg_at_20_std\": 0.05610222103228094,\n        \"nauc_ndcg_at_3_diff1\": 0.34540185310356236,\n        \"nauc_ndcg_at_3_max\": 0.36440518603972377,\n        \"nauc_ndcg_at_3_std\": 0.023929022932015993,\n        \"nauc_ndcg_at_5_diff1\": 0.3292907310376978,\n        \"nauc_ndcg_at_5_max\": 0.3535803636201188,\n        \"nauc_ndcg_at_5_std\": 0.031205350457471002,\n        \"nauc_precision_at_1000_diff1\": 0.038071768151506126,\n        \"nauc_precision_at_1000_max\": 0.2023526720585822,\n        \"nauc_precision_at_1000_std\": 0.2245887465920116,\n        \"nauc_precision_at_100_diff1\": 0.034165106875631755,\n        \"nauc_precision_at_100_max\": 0.2546944915960753,\n        \"nauc_precision_at_100_std\": 0.24449808850665333,\n        \"nauc_precision_at_10_diff1\": 0.10354267350812409,\n        \"nauc_precision_at_10_max\": 0.2800684643390209,\n        \"nauc_precision_at_10_std\": 0.15076718576951242,\n        \"nauc_precision_at_1_diff1\": 0.4476333755929182,\n        \"nauc_precision_at_1_max\": 0.40326469057519526,\n        \"nauc_precision_at_1_std\": 0.0072997114123084985,\n        \"nauc_precision_at_20_diff1\": 0.061548928520456604,\n        \"nauc_precision_at_20_max\": 0.27662177632394025,\n        \"nauc_precision_at_20_std\": 0.2128774243275918,\n        \"nauc_precision_at_3_diff1\": 0.2501330958282208,\n        \"nauc_precision_at_3_max\": 0.34690185014533564,\n        \"nauc_precision_at_3_std\": 0.09171446549360808,\n        \"nauc_precision_at_5_diff1\": 0.1750713626614356,\n        \"nauc_precision_at_5_max\": 0.2914769521390908,\n        \"nauc_precision_at_5_std\": 0.11260780828219168,\n        \"nauc_recall_at_1000_diff1\": 0.370279255219639,\n        \"nauc_recall_at_1000_max\": 0.6750328138256553,\n        \"nauc_recall_at_1000_std\": 0.5043423318119773,\n        \"nauc_recall_at_100_diff1\": 0.14232466984906053,\n        \"nauc_recall_at_100_max\": 0.4792748970125092,\n        \"nauc_recall_at_100_std\": 0.3228399242838028,\n        \"nauc_recall_at_10_diff1\": 0.17444062059210683,\n        \"nauc_recall_at_10_max\": 0.3396516241541569,\n        \"nauc_recall_at_10_std\": 0.11756635139731124,\n        \"nauc_recall_at_1_diff1\": 0.4394346374015472,\n        \"nauc_recall_at_1_max\": 0.35914751186291155,\n        \"nauc_recall_at_1_std\": -0.03112772622952899,\n        \"nauc_recall_at_20_diff1\": 0.15478654557339946,\n        \"nauc_recall_at_20_max\": 0.395072895370965,\n        \"nauc_recall_at_20_std\": 0.18701562249696008,\n        \"nauc_recall_at_3_diff1\": 0.2718140986712021,\n        \"nauc_recall_at_3_max\": 0.3380662842993732,\n        \"nauc_recall_at_3_std\": 0.04541815103444281,\n        \"nauc_recall_at_5_diff1\": 0.2174882358215161,\n        \"nauc_recall_at_5_max\": 0.3016629817024547,\n        \"nauc_recall_at_5_std\": 0.06951134218978933,\n        \"ndcg_at_1\": 0.40618,\n        \"ndcg_at_10\": 0.55011,\n        \"ndcg_at_100\": 0.58706,\n        \"ndcg_at_1000\": 0.59621,\n        \"ndcg_at_20\": 0.56841,\n        \"ndcg_at_3\": 0.48167,\n        \"ndcg_at_5\": 0.52645,\n        \"precision_at_1\": 0.40618,\n        \"precision_at_10\": 0.081,\n        \"precision_at_100\": 0.01014,\n        \"precision_at_1000\": 0.0011,\n        \"precision_at_20\": 0.04489,\n        \"precision_at_3\": 0.19873,\n        \"precision_at_5\": 0.14489,\n        \"recall_at_1\": 0.37173,\n        \"recall_at_10\": 0.70942,\n        \"recall_at_100\": 0.87253,\n        \"recall_at_1000\": 0.94418,\n        \"recall_at_20\": 0.77672,\n        \"recall_at_3\": 0.53603,\n        \"recall_at_5\": 0.64054\n      }\n    ]\n  },\n  \"task_name\": \"MrTidyRetrieval\"\n}"
  },
  {
    "path": "eval/results/upskyy/bge-m3-korean/upskyy__bge-m3-korean/no_revision_available/MultiLongDocRetrieval.json",
    "content": "{\n  \"dataset_revision\": \"d67138e705d963e346253a80e59676ddb418810a\",\n  \"evaluation_time\": 411.78907680511475,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"dev\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.21968,\n        \"map_at_1\": 0.15,\n        \"map_at_10\": 0.19486,\n        \"map_at_100\": 0.20348,\n        \"map_at_1000\": 0.20422,\n        \"map_at_20\": 0.19862,\n        \"map_at_3\": 0.1825,\n        \"map_at_5\": 0.185,\n        \"mrr_at_1\": 0.15,\n        \"mrr_at_10\": 0.1948611111111111,\n        \"mrr_at_100\": 0.20348075961449408,\n        \"mrr_at_1000\": 0.2042227028085186,\n        \"mrr_at_20\": 0.19861868094066237,\n        \"mrr_at_3\": 0.1825,\n        \"mrr_at_5\": 0.185,\n        \"nauc_map_at_1000_diff1\": 0.5228641163292851,\n        \"nauc_map_at_1000_max\": 0.3412128831254867,\n        \"nauc_map_at_1000_std\": 0.0012824128179374956,\n        \"nauc_map_at_100_diff1\": 0.5229167197883231,\n        \"nauc_map_at_100_max\": 0.3413522374374235,\n        \"nauc_map_at_100_std\": 0.0010966877334498038,\n        \"nauc_map_at_10_diff1\": 0.521436223842329,\n        \"nauc_map_at_10_max\": 0.33387114549522184,\n        \"nauc_map_at_10_std\": -0.006027959979052935,\n        \"nauc_map_at_1_diff1\": 0.6252091523031954,\n        \"nauc_map_at_1_max\": 0.36016530591674234,\n        \"nauc_map_at_1_std\": -0.026327991129926537,\n        \"nauc_map_at_20_diff1\": 0.5205561717274496,\n        \"nauc_map_at_20_max\": 0.335644036778537,\n        \"nauc_map_at_20_std\": -0.004322490258848994,\n        \"nauc_map_at_3_diff1\": 0.5377286501316654,\n        \"nauc_map_at_3_max\": 0.3340684836642245,\n        \"nauc_map_at_3_std\": -0.02057244685965842,\n        \"nauc_map_at_5_diff1\": 0.5309102396475923,\n        \"nauc_map_at_5_max\": 0.34128063601821707,\n        \"nauc_map_at_5_std\": -0.017655472582244612,\n        \"nauc_mrr_at_1000_diff1\": 0.5228641163292851,\n        \"nauc_mrr_at_1000_max\": 0.3412128831254867,\n        \"nauc_mrr_at_1000_std\": 0.0012824128179374956,\n        \"nauc_mrr_at_100_diff1\": 0.5229167197883231,\n        \"nauc_mrr_at_100_max\": 0.3413522374374235,\n        \"nauc_mrr_at_100_std\": 0.0010966877334498038,\n        \"nauc_mrr_at_10_diff1\": 0.521436223842329,\n        \"nauc_mrr_at_10_max\": 0.33387114549522184,\n        \"nauc_mrr_at_10_std\": -0.006027959979052935,\n        \"nauc_mrr_at_1_diff1\": 0.6252091523031954,\n        \"nauc_mrr_at_1_max\": 0.36016530591674234,\n        \"nauc_mrr_at_1_std\": -0.026327991129926537,\n        \"nauc_mrr_at_20_diff1\": 0.5205561717274496,\n        \"nauc_mrr_at_20_max\": 0.335644036778537,\n        \"nauc_mrr_at_20_std\": -0.004322490258848994,\n        \"nauc_mrr_at_3_diff1\": 0.5377286501316654,\n        \"nauc_mrr_at_3_max\": 0.3340684836642245,\n        \"nauc_mrr_at_3_std\": -0.02057244685965842,\n        \"nauc_mrr_at_5_diff1\": 0.5309102396475923,\n        \"nauc_mrr_at_5_max\": 0.34128063601821707,\n        \"nauc_mrr_at_5_std\": -0.017655472582244612,\n        \"nauc_ndcg_at_1000_diff1\": 0.49450756826140746,\n        \"nauc_ndcg_at_1000_max\": 0.3625588888678582,\n        \"nauc_ndcg_at_1000_std\": 0.06012473989322547,\n        \"nauc_ndcg_at_100_diff1\": 0.4933383125619591,\n        \"nauc_ndcg_at_100_max\": 0.36004732048036603,\n        \"nauc_ndcg_at_100_std\": 0.05438097701534137,\n        \"nauc_ndcg_at_10_diff1\": 0.4866665045019168,\n        \"nauc_ndcg_at_10_max\": 0.32095272853954526,\n        \"nauc_ndcg_at_10_std\": 0.011149336322515323,\n        \"nauc_ndcg_at_1_diff1\": 0.6252091523031954,\n        \"nauc_ndcg_at_1_max\": 0.36016530591674234,\n        \"nauc_ndcg_at_1_std\": -0.026327991129926537,\n        \"nauc_ndcg_at_20_diff1\": 0.4826000708364039,\n        \"nauc_ndcg_at_20_max\": 0.3273890002320808,\n        \"nauc_ndcg_at_20_std\": 0.019339722067390635,\n        \"nauc_ndcg_at_3_diff1\": 0.5172758390255361,\n        \"nauc_ndcg_at_3_max\": 0.3259425664001633,\n        \"nauc_ndcg_at_3_std\": -0.01780903214899896,\n        \"nauc_ndcg_at_5_diff1\": 0.5061486447758137,\n        \"nauc_ndcg_at_5_max\": 0.33797366721555006,\n        \"nauc_ndcg_at_5_std\": -0.012996151109373837,\n        \"nauc_precision_at_1000_diff1\": 0.40466972852093236,\n        \"nauc_precision_at_1000_max\": 0.5651645947050766,\n        \"nauc_precision_at_1000_std\": 0.4529059561882323,\n        \"nauc_precision_at_100_diff1\": 0.4242039205720622,\n        \"nauc_precision_at_100_max\": 0.44951751692396735,\n        \"nauc_precision_at_100_std\": 0.2506511933250036,\n        \"nauc_precision_at_10_diff1\": 0.4020470206728822,\n        \"nauc_precision_at_10_max\": 0.2867450344548034,\n        \"nauc_precision_at_10_std\": 0.05682340224294023,\n        \"nauc_precision_at_1_diff1\": 0.6252091523031954,\n        \"nauc_precision_at_1_max\": 0.36016530591674234,\n        \"nauc_precision_at_1_std\": -0.026327991129926537,\n        \"nauc_precision_at_20_diff1\": 0.3886963441341078,\n        \"nauc_precision_at_20_max\": 0.3091011923160395,\n        \"nauc_precision_at_20_std\": 0.0864544216971267,\n        \"nauc_precision_at_3_diff1\": 0.46614041085247243,\n        \"nauc_precision_at_3_max\": 0.30496161854740966,\n        \"nauc_precision_at_3_std\": -0.01043447182770295,\n        \"nauc_precision_at_5_diff1\": 0.4437546712222209,\n        \"nauc_precision_at_5_max\": 0.33057000350818333,\n        \"nauc_precision_at_5_std\": -0.00048046857125419895,\n        \"nauc_recall_at_1000_diff1\": 0.40466972852093197,\n        \"nauc_recall_at_1000_max\": 0.565164594705076,\n        \"nauc_recall_at_1000_std\": 0.4529059561882311,\n        \"nauc_recall_at_100_diff1\": 0.4242039205720618,\n        \"nauc_recall_at_100_max\": 0.44951751692396746,\n        \"nauc_recall_at_100_std\": 0.2506511933250037,\n        \"nauc_recall_at_10_diff1\": 0.4020470206728819,\n        \"nauc_recall_at_10_max\": 0.28674503445480354,\n        \"nauc_recall_at_10_std\": 0.05682340224293989,\n        \"nauc_recall_at_1_diff1\": 0.6252091523031954,\n        \"nauc_recall_at_1_max\": 0.36016530591674234,\n        \"nauc_recall_at_1_std\": -0.026327991129926537,\n        \"nauc_recall_at_20_diff1\": 0.3886963441341077,\n        \"nauc_recall_at_20_max\": 0.3091011923160393,\n        \"nauc_recall_at_20_std\": 0.08645442169712678,\n        \"nauc_recall_at_3_diff1\": 0.46614041085247204,\n        \"nauc_recall_at_3_max\": 0.3049616185474097,\n        \"nauc_recall_at_3_std\": -0.010434471827703058,\n        \"nauc_recall_at_5_diff1\": 0.4437546712222204,\n        \"nauc_recall_at_5_max\": 0.3305700035081832,\n        \"nauc_recall_at_5_std\": -0.00048046857125430553,\n        \"ndcg_at_1\": 0.15,\n        \"ndcg_at_10\": 0.21968,\n        \"ndcg_at_100\": 0.27014,\n        \"ndcg_at_1000\": 0.29778,\n        \"ndcg_at_20\": 0.23352,\n        \"ndcg_at_3\": 0.1922,\n        \"ndcg_at_5\": 0.19651,\n        \"precision_at_1\": 0.15,\n        \"precision_at_10\": 0.03,\n        \"precision_at_100\": 0.00555,\n        \"precision_at_1000\": 0.00079,\n        \"precision_at_20\": 0.01775,\n        \"precision_at_3\": 0.07333,\n        \"precision_at_5\": 0.046,\n        \"recall_at_1\": 0.15,\n        \"recall_at_10\": 0.3,\n        \"recall_at_100\": 0.555,\n        \"recall_at_1000\": 0.79,\n        \"recall_at_20\": 0.355,\n        \"recall_at_3\": 0.22,\n        \"recall_at_5\": 0.23\n      }\n    ],\n    \"test\": [\n      {\n        \"hf_subset\": \"ko\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.22787,\n        \"map_at_1\": 0.14,\n        \"map_at_10\": 0.1987,\n        \"map_at_100\": 0.20557,\n        \"map_at_1000\": 0.20665,\n        \"map_at_20\": 0.2017,\n        \"map_at_3\": 0.185,\n        \"map_at_5\": 0.1945,\n        \"mrr_at_1\": 0.14,\n        \"mrr_at_10\": 0.19870039682539684,\n        \"mrr_at_100\": 0.2055687357826064,\n        \"mrr_at_1000\": 0.20664794980331383,\n        \"mrr_at_20\": 0.2016985743015155,\n        \"mrr_at_3\": 0.185,\n        \"mrr_at_5\": 0.19450000000000003,\n        \"nauc_map_at_1000_diff1\": 0.388027241959978,\n        \"nauc_map_at_1000_max\": 0.40123520494204395,\n        \"nauc_map_at_1000_std\": 0.04780702712023158,\n        \"nauc_map_at_100_diff1\": 0.3877132605487392,\n        \"nauc_map_at_100_max\": 0.40102565182458855,\n        \"nauc_map_at_100_std\": 0.04748594852112135,\n        \"nauc_map_at_10_diff1\": 0.3925371205072556,\n        \"nauc_map_at_10_max\": 0.39907470125816463,\n        \"nauc_map_at_10_std\": 0.04097899189000299,\n        \"nauc_map_at_1_diff1\": 0.5254571683143111,\n        \"nauc_map_at_1_max\": 0.47881751453180027,\n        \"nauc_map_at_1_std\": 0.03938436081293219,\n        \"nauc_map_at_20_diff1\": 0.39352216894549075,\n        \"nauc_map_at_20_max\": 0.4015975417502318,\n        \"nauc_map_at_20_std\": 0.041859869003760916,\n        \"nauc_map_at_3_diff1\": 0.4075827351322252,\n        \"nauc_map_at_3_max\": 0.4147374865792952,\n        \"nauc_map_at_3_std\": 0.04135351689012322,\n        \"nauc_map_at_5_diff1\": 0.4039580621195217,\n        \"nauc_map_at_5_max\": 0.40326439248540985,\n        \"nauc_map_at_5_std\": 0.03782948945277216,\n        \"nauc_mrr_at_1000_diff1\": 0.388027241959978,\n        \"nauc_mrr_at_1000_max\": 0.40123520494204395,\n        \"nauc_mrr_at_1000_std\": 0.04780702712023158,\n        \"nauc_mrr_at_100_diff1\": 0.3877132605487392,\n        \"nauc_mrr_at_100_max\": 0.40102565182458855,\n        \"nauc_mrr_at_100_std\": 0.04748594852112135,\n        \"nauc_mrr_at_10_diff1\": 0.3925371205072556,\n        \"nauc_mrr_at_10_max\": 0.39907470125816463,\n        \"nauc_mrr_at_10_std\": 0.04097899189000299,\n        \"nauc_mrr_at_1_diff1\": 0.5254571683143111,\n        \"nauc_mrr_at_1_max\": 0.47881751453180027,\n        \"nauc_mrr_at_1_std\": 0.03938436081293219,\n        \"nauc_mrr_at_20_diff1\": 0.39352216894549075,\n        \"nauc_mrr_at_20_max\": 0.4015975417502318,\n        \"nauc_mrr_at_20_std\": 0.041859869003760916,\n        \"nauc_mrr_at_3_diff1\": 0.4075827351322252,\n        \"nauc_mrr_at_3_max\": 0.4147374865792952,\n        \"nauc_mrr_at_3_std\": 0.04135351689012322,\n        \"nauc_mrr_at_5_diff1\": 0.4039580621195217,\n        \"nauc_mrr_at_5_max\": 0.40326439248540985,\n        \"nauc_mrr_at_5_std\": 0.03782948945277216,\n        \"nauc_ndcg_at_1000_diff1\": 0.3299411072050852,\n        \"nauc_ndcg_at_1000_max\": 0.38494496638411996,\n        \"nauc_ndcg_at_1000_std\": 0.08822983305464273,\n        \"nauc_ndcg_at_100_diff1\": 0.3179348100164186,\n        \"nauc_ndcg_at_100_max\": 0.3783068852575221,\n        \"nauc_ndcg_at_100_std\": 0.0879924637618615,\n        \"nauc_ndcg_at_10_diff1\": 0.3480091281920641,\n        \"nauc_ndcg_at_10_max\": 0.3669584525955309,\n        \"nauc_ndcg_at_10_std\": 0.04323131580056823,\n        \"nauc_ndcg_at_1_diff1\": 0.5254571683143111,\n        \"nauc_ndcg_at_1_max\": 0.47881751453180027,\n        \"nauc_ndcg_at_1_std\": 0.03938436081293219,\n        \"nauc_ndcg_at_20_diff1\": 0.3523221210131712,\n        \"nauc_ndcg_at_20_max\": 0.3775461181355033,\n        \"nauc_ndcg_at_20_std\": 0.048983482187103106,\n        \"nauc_ndcg_at_3_diff1\": 0.3789291832529862,\n        \"nauc_ndcg_at_3_max\": 0.3968734473338933,\n        \"nauc_ndcg_at_3_std\": 0.04163039160544848,\n        \"nauc_ndcg_at_5_diff1\": 0.3749576778048497,\n        \"nauc_ndcg_at_5_max\": 0.37668940459113825,\n        \"nauc_ndcg_at_5_std\": 0.03543307330469742,\n        \"nauc_precision_at_1000_diff1\": 0.10452785726308714,\n        \"nauc_precision_at_1000_max\": 0.3883545338687571,\n        \"nauc_precision_at_1000_std\": 0.35327145502200163,\n        \"nauc_precision_at_100_diff1\": 0.10860492979551226,\n        \"nauc_precision_at_100_max\": 0.3360728565082189,\n        \"nauc_precision_at_100_std\": 0.24945815327867799,\n        \"nauc_precision_at_10_diff1\": 0.23936369474472868,\n        \"nauc_precision_at_10_max\": 0.2881903564165687,\n        \"nauc_precision_at_10_std\": 0.05033848870812367,\n        \"nauc_precision_at_1_diff1\": 0.5254571683143111,\n        \"nauc_precision_at_1_max\": 0.47881751453180027,\n        \"nauc_precision_at_1_std\": 0.03938436081293219,\n        \"nauc_precision_at_20_diff1\": 0.25693921762407507,\n        \"nauc_precision_at_20_max\": 0.3270611488896598,\n        \"nauc_precision_at_20_std\": 0.07357763219037795,\n        \"nauc_precision_at_3_diff1\": 0.30945962137550925,\n        \"nauc_precision_at_3_max\": 0.35290109034267914,\n        \"nauc_precision_at_3_std\": 0.042243290198897755,\n        \"nauc_precision_at_5_diff1\": 0.3088456291248556,\n        \"nauc_precision_at_5_max\": 0.3120104709866414,\n        \"nauc_precision_at_5_std\": 0.029009896190416957,\n        \"nauc_recall_at_1000_diff1\": 0.10452785726308628,\n        \"nauc_recall_at_1000_max\": 0.38835453386875723,\n        \"nauc_recall_at_1000_std\": 0.3532714550220019,\n        \"nauc_recall_at_100_diff1\": 0.10860492979551183,\n        \"nauc_recall_at_100_max\": 0.3360728565082186,\n        \"nauc_recall_at_100_std\": 0.24945815327867757,\n        \"nauc_recall_at_10_diff1\": 0.23936369474472857,\n        \"nauc_recall_at_10_max\": 0.28819035641656854,\n        \"nauc_recall_at_10_std\": 0.05033848870812356,\n        \"nauc_recall_at_1_diff1\": 0.5254571683143111,\n        \"nauc_recall_at_1_max\": 0.47881751453180027,\n        \"nauc_recall_at_1_std\": 0.03938436081293219,\n        \"nauc_recall_at_20_diff1\": 0.25693921762407457,\n        \"nauc_recall_at_20_max\": 0.3270611488896596,\n        \"nauc_recall_at_20_std\": 0.07357763219037759,\n        \"nauc_recall_at_3_diff1\": 0.3094596213755092,\n        \"nauc_recall_at_3_max\": 0.352901090342679,\n        \"nauc_recall_at_3_std\": 0.0422432901988977,\n        \"nauc_recall_at_5_diff1\": 0.30884562912485536,\n        \"nauc_recall_at_5_max\": 0.31201047098664125,\n        \"nauc_recall_at_5_std\": 0.02900989619041678,\n        \"ndcg_at_1\": 0.14,\n        \"ndcg_at_10\": 0.22787,\n        \"ndcg_at_100\": 0.26642,\n        \"ndcg_at_1000\": 0.3004,\n        \"ndcg_at_20\": 0.23909,\n        \"ndcg_at_3\": 0.19917,\n        \"ndcg_at_5\": 0.21701,\n        \"precision_at_1\": 0.14,\n        \"precision_at_10\": 0.032,\n        \"precision_at_100\": 0.0051,\n        \"precision_at_1000\": 0.00079,\n        \"precision_at_20\": 0.01825,\n        \"precision_at_3\": 0.08,\n        \"precision_at_5\": 0.057,\n        \"recall_at_1\": 0.14,\n        \"recall_at_10\": 0.32,\n        \"recall_at_100\": 0.51,\n        \"recall_at_1000\": 0.79,\n        \"recall_at_20\": 0.365,\n        \"recall_at_3\": 0.24,\n        \"recall_at_5\": 0.285\n      }\n    ]\n  },\n  \"task_name\": \"MultiLongDocRetrieval\"\n}"
  },
  {
    "path": "eval/results/upskyy/bge-m3-korean/upskyy__bge-m3-korean/no_revision_available/PublicHealthQA.json",
    "content": "{\n  \"dataset_revision\": \"main\",\n  \"evaluation_time\": 1.244837760925293,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"korean\",\n        \"languages\": [\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.77559,\n        \"map_at_1\": 0.61039,\n        \"map_at_10\": 0.72063,\n        \"map_at_100\": 0.72355,\n        \"map_at_1000\": 0.72355,\n        \"map_at_20\": 0.72263,\n        \"map_at_3\": 0.69481,\n        \"map_at_5\": 0.71234,\n        \"mrr_at_1\": 0.6103896103896104,\n        \"mrr_at_10\": 0.7206349206349209,\n        \"mrr_at_100\": 0.7235476992385783,\n        \"mrr_at_1000\": 0.7235476992385783,\n        \"mrr_at_20\": 0.722627246490883,\n        \"mrr_at_3\": 0.6948051948051949,\n        \"mrr_at_5\": 0.7123376623376625,\n        \"nauc_map_at_1000_diff1\": 0.581514277430857,\n        \"nauc_map_at_1000_max\": 0.2600121945421672,\n        \"nauc_map_at_1000_std\": 0.0508272097576097,\n        \"nauc_map_at_100_diff1\": 0.581514277430857,\n        \"nauc_map_at_100_max\": 0.2600121945421672,\n        \"nauc_map_at_100_std\": 0.0508272097576097,\n        \"nauc_map_at_10_diff1\": 0.5798020406094601,\n        \"nauc_map_at_10_max\": 0.25947368479173144,\n        \"nauc_map_at_10_std\": 0.048451816839532806,\n        \"nauc_map_at_1_diff1\": 0.6100966757438426,\n        \"nauc_map_at_1_max\": 0.2804109120002006,\n        \"nauc_map_at_1_std\": 0.05816858573239319,\n        \"nauc_map_at_20_diff1\": 0.5784057148274875,\n        \"nauc_map_at_20_max\": 0.2544781162654774,\n        \"nauc_map_at_20_std\": 0.048219088535449,\n        \"nauc_map_at_3_diff1\": 0.569994023647647,\n        \"nauc_map_at_3_max\": 0.272733130545418,\n        \"nauc_map_at_3_std\": 0.06125117458543027,\n        \"nauc_map_at_5_diff1\": 0.576767098858931,\n        \"nauc_map_at_5_max\": 0.270790922453173,\n        \"nauc_map_at_5_std\": 0.06666333477243593,\n        \"nauc_mrr_at_1000_diff1\": 0.581514277430857,\n        \"nauc_mrr_at_1000_max\": 0.2600121945421672,\n        \"nauc_mrr_at_1000_std\": 0.0508272097576097,\n        \"nauc_mrr_at_100_diff1\": 0.581514277430857,\n        \"nauc_mrr_at_100_max\": 0.2600121945421672,\n        \"nauc_mrr_at_100_std\": 0.0508272097576097,\n        \"nauc_mrr_at_10_diff1\": 0.5798020406094601,\n        \"nauc_mrr_at_10_max\": 0.25947368479173144,\n        \"nauc_mrr_at_10_std\": 0.048451816839532806,\n        \"nauc_mrr_at_1_diff1\": 0.6100966757438426,\n        \"nauc_mrr_at_1_max\": 0.2804109120002006,\n        \"nauc_mrr_at_1_std\": 0.05816858573239319,\n        \"nauc_mrr_at_20_diff1\": 0.5784057148274875,\n        \"nauc_mrr_at_20_max\": 0.2544781162654774,\n        \"nauc_mrr_at_20_std\": 0.048219088535449,\n        \"nauc_mrr_at_3_diff1\": 0.569994023647647,\n        \"nauc_mrr_at_3_max\": 0.272733130545418,\n        \"nauc_mrr_at_3_std\": 0.06125117458543027,\n        \"nauc_mrr_at_5_diff1\": 0.576767098858931,\n        \"nauc_mrr_at_5_max\": 0.270790922453173,\n        \"nauc_mrr_at_5_std\": 0.06666333477243593,\n        \"nauc_ndcg_at_1000_diff1\": 0.5758895970977408,\n        \"nauc_ndcg_at_1000_max\": 0.2563332621286461,\n        \"nauc_ndcg_at_1000_std\": 0.052889533846057366,\n        \"nauc_ndcg_at_100_diff1\": 0.5758895970977408,\n        \"nauc_ndcg_at_100_max\": 0.2563332621286461,\n        \"nauc_ndcg_at_100_std\": 0.052889533846057366,\n        \"nauc_ndcg_at_10_diff1\": 0.5633651886103245,\n        \"nauc_ndcg_at_10_max\": 0.24550419270187773,\n        \"nauc_ndcg_at_10_std\": 0.044610907154761195,\n        \"nauc_ndcg_at_1_diff1\": 0.6100966757438426,\n        \"nauc_ndcg_at_1_max\": 0.2804109120002006,\n        \"nauc_ndcg_at_1_std\": 0.05816858573239319,\n        \"nauc_ndcg_at_20_diff1\": 0.5574381993765986,\n        \"nauc_ndcg_at_20_max\": 0.22284415830217352,\n        \"nauc_ndcg_at_20_std\": 0.03997714559180442,\n        \"nauc_ndcg_at_3_diff1\": 0.5484583236884947,\n        \"nauc_ndcg_at_3_max\": 0.2799253810560104,\n        \"nauc_ndcg_at_3_std\": 0.07669422284650178,\n        \"nauc_ndcg_at_5_diff1\": 0.5557446471304487,\n        \"nauc_ndcg_at_5_max\": 0.2774984592893927,\n        \"nauc_ndcg_at_5_std\": 0.0958730828908401,\n        \"nauc_precision_at_1000_diff1\": NaN,\n        \"nauc_precision_at_1000_max\": NaN,\n        \"nauc_precision_at_1000_std\": NaN,\n        \"nauc_precision_at_100_diff1\": 1.0,\n        \"nauc_precision_at_100_max\": 1.0,\n        \"nauc_precision_at_100_std\": 1.0,\n        \"nauc_precision_at_10_diff1\": 0.3544905465332846,\n        \"nauc_precision_at_10_max\": 0.029424740760962274,\n        \"nauc_precision_at_10_std\": -0.04249064102210631,\n        \"nauc_precision_at_1_diff1\": 0.6100966757438426,\n        \"nauc_precision_at_1_max\": 0.2804109120002006,\n        \"nauc_precision_at_1_std\": 0.05816858573239319,\n        \"nauc_precision_at_20_diff1\": -0.00279858530002641,\n        \"nauc_precision_at_20_max\": -0.8024518412512177,\n        \"nauc_precision_at_20_std\": -0.304759369613741,\n        \"nauc_precision_at_3_diff1\": 0.45974310015268893,\n        \"nauc_precision_at_3_max\": 0.3130926276273598,\n        \"nauc_precision_at_3_std\": 0.14462348982364673,\n        \"nauc_precision_at_5_diff1\": 0.42345017705413346,\n        \"nauc_precision_at_5_max\": 0.32459075504746615,\n        \"nauc_precision_at_5_std\": 0.29382656447244254,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": NaN,\n        \"nauc_recall_at_100_max\": NaN,\n        \"nauc_recall_at_100_std\": NaN,\n        \"nauc_recall_at_10_diff1\": 0.35449054653328155,\n        \"nauc_recall_at_10_max\": 0.029424740760955526,\n        \"nauc_recall_at_10_std\": -0.0424906410221141,\n        \"nauc_recall_at_1_diff1\": 0.6100966757438426,\n        \"nauc_recall_at_1_max\": 0.2804109120002006,\n        \"nauc_recall_at_1_std\": 0.05816858573239319,\n        \"nauc_recall_at_20_diff1\": -0.002798585300030213,\n        \"nauc_recall_at_20_max\": -0.8024518412512368,\n        \"nauc_recall_at_20_std\": -0.3047593696137533,\n        \"nauc_recall_at_3_diff1\": 0.4597431001526878,\n        \"nauc_recall_at_3_max\": 0.31309262762735857,\n        \"nauc_recall_at_3_std\": 0.1446234898236454,\n        \"nauc_recall_at_5_diff1\": 0.42345017705413185,\n        \"nauc_recall_at_5_max\": 0.3245907550474637,\n        \"nauc_recall_at_5_std\": 0.2938265644724397,\n        \"ndcg_at_1\": 0.61039,\n        \"ndcg_at_10\": 0.77559,\n        \"ndcg_at_100\": 0.78768,\n        \"ndcg_at_1000\": 0.78768,\n        \"ndcg_at_20\": 0.78239,\n        \"ndcg_at_3\": 0.7231,\n        \"ndcg_at_5\": 0.75495,\n        \"precision_at_1\": 0.61039,\n        \"precision_at_10\": 0.09481,\n        \"precision_at_100\": 0.01,\n        \"precision_at_1000\": 0.001,\n        \"precision_at_20\": 0.0487,\n        \"precision_at_3\": 0.2684,\n        \"precision_at_5\": 0.17662,\n        \"recall_at_1\": 0.61039,\n        \"recall_at_10\": 0.94805,\n        \"recall_at_100\": 1.0,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.97403,\n        \"recall_at_3\": 0.80519,\n        \"recall_at_5\": 0.88312\n      }\n    ]\n  },\n  \"task_name\": \"PublicHealthQA\"\n}"
  },
  {
    "path": "eval/results/upskyy/bge-m3-korean/upskyy__bge-m3-korean/no_revision_available/XPQARetrieval.json",
    "content": "{\n  \"dataset_revision\": \"c99d599f0a6ab9b85b065da6f9d94f9cf731679f\",\n  \"evaluation_time\": 13.89358639717102,\n  \"kg_co2_emissions\": null,\n  \"mteb_version\": \"1.20.0\",\n  \"scores\": {\n    \"test\": [\n      {\n        \"hf_subset\": \"kor-kor\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.31695,\n        \"map_at_1\": 0.17576,\n        \"map_at_10\": 0.27113,\n        \"map_at_100\": 0.28608,\n        \"map_at_1000\": 0.28776,\n        \"map_at_20\": 0.27892,\n        \"map_at_3\": 0.24589,\n        \"map_at_5\": 0.25816,\n        \"mrr_at_1\": 0.25229357798165136,\n        \"mrr_at_10\": 0.31745789039367023,\n        \"mrr_at_100\": 0.32816024545088235,\n        \"mrr_at_1000\": 0.32917734216519506,\n        \"mrr_at_20\": 0.32299553219114674,\n        \"mrr_at_3\": 0.30020387359836914,\n        \"mrr_at_5\": 0.3079255861365954,\n        \"nauc_map_at_1000_diff1\": 0.47010970462821955,\n        \"nauc_map_at_1000_max\": 0.3098774398025671,\n        \"nauc_map_at_1000_std\": -0.1963456368690233,\n        \"nauc_map_at_100_diff1\": 0.4696861789142314,\n        \"nauc_map_at_100_max\": 0.3093119757413642,\n        \"nauc_map_at_100_std\": -0.19676930499005943,\n        \"nauc_map_at_10_diff1\": 0.46920825182729364,\n        \"nauc_map_at_10_max\": 0.30888721389787793,\n        \"nauc_map_at_10_std\": -0.19545447098058139,\n        \"nauc_map_at_1_diff1\": 0.5356241797932373,\n        \"nauc_map_at_1_max\": 0.2738833679981866,\n        \"nauc_map_at_1_std\": -0.169789162578628,\n        \"nauc_map_at_20_diff1\": 0.46930293232753695,\n        \"nauc_map_at_20_max\": 0.3074578890497353,\n        \"nauc_map_at_20_std\": -0.19850651372859576,\n        \"nauc_map_at_3_diff1\": 0.48349817727753475,\n        \"nauc_map_at_3_max\": 0.3127191887552773,\n        \"nauc_map_at_3_std\": -0.19032516458436943,\n        \"nauc_map_at_5_diff1\": 0.4767338284192987,\n        \"nauc_map_at_5_max\": 0.30830539578693966,\n        \"nauc_map_at_5_std\": -0.19780921970754842,\n        \"nauc_mrr_at_1000_diff1\": 0.5219129093886344,\n        \"nauc_mrr_at_1000_max\": 0.31579091461596176,\n        \"nauc_mrr_at_1000_std\": -0.22169124154266842,\n        \"nauc_mrr_at_100_diff1\": 0.521776297162607,\n        \"nauc_mrr_at_100_max\": 0.31609933760546466,\n        \"nauc_mrr_at_100_std\": -0.22132323823988,\n        \"nauc_mrr_at_10_diff1\": 0.5229792298473174,\n        \"nauc_mrr_at_10_max\": 0.31191935916074975,\n        \"nauc_mrr_at_10_std\": -0.22515088134298458,\n        \"nauc_mrr_at_1_diff1\": 0.5440625092689464,\n        \"nauc_mrr_at_1_max\": 0.32017015103420715,\n        \"nauc_mrr_at_1_std\": -0.22188149293588674,\n        \"nauc_mrr_at_20_diff1\": 0.52146104714408,\n        \"nauc_mrr_at_20_max\": 0.3138962710865594,\n        \"nauc_mrr_at_20_std\": -0.22327101012867404,\n        \"nauc_mrr_at_3_diff1\": 0.536037870020009,\n        \"nauc_mrr_at_3_max\": 0.31853282396028315,\n        \"nauc_mrr_at_3_std\": -0.22170941151791226,\n        \"nauc_mrr_at_5_diff1\": 0.5280003894597486,\n        \"nauc_mrr_at_5_max\": 0.31199781678150607,\n        \"nauc_mrr_at_5_std\": -0.2259123946480528,\n        \"nauc_ndcg_at_1000_diff1\": 0.47542042721883954,\n        \"nauc_ndcg_at_1000_max\": 0.319743954325265,\n        \"nauc_ndcg_at_1000_std\": -0.1969569163821828,\n        \"nauc_ndcg_at_100_diff1\": 0.46520084113259214,\n        \"nauc_ndcg_at_100_max\": 0.32017555416152155,\n        \"nauc_ndcg_at_100_std\": -0.19587487741313742,\n        \"nauc_ndcg_at_10_diff1\": 0.46854597146746774,\n        \"nauc_ndcg_at_10_max\": 0.30666262911980746,\n        \"nauc_ndcg_at_10_std\": -0.2042751495469241,\n        \"nauc_ndcg_at_1_diff1\": 0.5378096090850387,\n        \"nauc_ndcg_at_1_max\": 0.31665420346212914,\n        \"nauc_ndcg_at_1_std\": -0.2185862246391458,\n        \"nauc_ndcg_at_20_diff1\": 0.46587586384321245,\n        \"nauc_ndcg_at_20_max\": 0.30661705681445245,\n        \"nauc_ndcg_at_20_std\": -0.20860794516424908,\n        \"nauc_ndcg_at_3_diff1\": 0.49375417874271904,\n        \"nauc_ndcg_at_3_max\": 0.31228234398000687,\n        \"nauc_ndcg_at_3_std\": -0.20291869025747036,\n        \"nauc_ndcg_at_5_diff1\": 0.4843844240743984,\n        \"nauc_ndcg_at_5_max\": 0.30668841355544346,\n        \"nauc_ndcg_at_5_std\": -0.20916296093832581,\n        \"nauc_precision_at_1000_diff1\": 0.04877723637029814,\n        \"nauc_precision_at_1000_max\": 0.16688314936689905,\n        \"nauc_precision_at_1000_std\": 0.019828467896436743,\n        \"nauc_precision_at_100_diff1\": 0.179882119045427,\n        \"nauc_precision_at_100_max\": 0.25324013308929927,\n        \"nauc_precision_at_100_std\": -0.07202221013960236,\n        \"nauc_precision_at_10_diff1\": 0.3007906115132944,\n        \"nauc_precision_at_10_max\": 0.27121384375921054,\n        \"nauc_precision_at_10_std\": -0.18014855087915327,\n        \"nauc_precision_at_1_diff1\": 0.5378096090850387,\n        \"nauc_precision_at_1_max\": 0.31665420346212914,\n        \"nauc_precision_at_1_std\": -0.2185862246391458,\n        \"nauc_precision_at_20_diff1\": 0.27108689157120675,\n        \"nauc_precision_at_20_max\": 0.25181094342953053,\n        \"nauc_precision_at_20_std\": -0.17973160589793455,\n        \"nauc_precision_at_3_diff1\": 0.3849078664119124,\n        \"nauc_precision_at_3_max\": 0.3165770590612215,\n        \"nauc_precision_at_3_std\": -0.20444308572079384,\n        \"nauc_precision_at_5_diff1\": 0.35334428871263895,\n        \"nauc_precision_at_5_max\": 0.28990972220689615,\n        \"nauc_precision_at_5_std\": -0.20547892044831662,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.3360985759229544,\n        \"nauc_recall_at_100_max\": 0.3328302204527823,\n        \"nauc_recall_at_100_std\": -0.14266636407335864,\n        \"nauc_recall_at_10_diff1\": 0.39515327362604297,\n        \"nauc_recall_at_10_max\": 0.2827566725071189,\n        \"nauc_recall_at_10_std\": -0.19174467066103854,\n        \"nauc_recall_at_1_diff1\": 0.5356241797932373,\n        \"nauc_recall_at_1_max\": 0.2738833679981866,\n        \"nauc_recall_at_1_std\": -0.169789162578628,\n        \"nauc_recall_at_20_diff1\": 0.3796528036373591,\n        \"nauc_recall_at_20_max\": 0.27975372875136006,\n        \"nauc_recall_at_20_std\": -0.2026172679066614,\n        \"nauc_recall_at_3_diff1\": 0.4720342315302788,\n        \"nauc_recall_at_3_max\": 0.31016277396024305,\n        \"nauc_recall_at_3_std\": -0.193173168073115,\n        \"nauc_recall_at_5_diff1\": 0.4470773059265365,\n        \"nauc_recall_at_5_max\": 0.2887834167422638,\n        \"nauc_recall_at_5_std\": -0.20932335416019043,\n        \"ndcg_at_1\": 0.25382,\n        \"ndcg_at_10\": 0.31695,\n        \"ndcg_at_100\": 0.38782,\n        \"ndcg_at_1000\": 0.42593,\n        \"ndcg_at_20\": 0.34113,\n        \"ndcg_at_3\": 0.27438,\n        \"ndcg_at_5\": 0.28968,\n        \"precision_at_1\": 0.25382,\n        \"precision_at_10\": 0.06483,\n        \"precision_at_100\": 0.01159,\n        \"precision_at_1000\": 0.00156,\n        \"precision_at_20\": 0.0396,\n        \"precision_at_3\": 0.15494,\n        \"precision_at_5\": 0.10673,\n        \"recall_at_1\": 0.17576,\n        \"recall_at_10\": 0.40889,\n        \"recall_at_100\": 0.72207,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.49312,\n        \"recall_at_3\": 0.29317,\n        \"recall_at_5\": 0.33216\n      },\n      {\n        \"hf_subset\": \"eng-kor\",\n        \"languages\": [\n          \"eng-Latn\",\n          \"kor-Hang\"\n        ],\n        \"main_score\": 0.32279,\n        \"map_at_1\": 0.14964,\n        \"map_at_10\": 0.26403,\n        \"map_at_100\": 0.28199,\n        \"map_at_1000\": 0.28389,\n        \"map_at_20\": 0.2738,\n        \"map_at_3\": 0.22309,\n        \"map_at_5\": 0.24491,\n        \"mrr_at_1\": 0.2798165137614679,\n        \"mrr_at_10\": 0.3482482646473471,\n        \"mrr_at_100\": 0.3576154284974784,\n        \"mrr_at_1000\": 0.358538469457532,\n        \"mrr_at_20\": 0.353191168637493,\n        \"mrr_at_3\": 0.32390417940876665,\n        \"mrr_at_5\": 0.3357543323139654,\n        \"nauc_map_at_1000_diff1\": 0.3662708399002596,\n        \"nauc_map_at_1000_max\": 0.11516861417385038,\n        \"nauc_map_at_1000_std\": -0.2261251217271451,\n        \"nauc_map_at_100_diff1\": 0.36630926098352395,\n        \"nauc_map_at_100_max\": 0.11388820361248321,\n        \"nauc_map_at_100_std\": -0.22757909547798452,\n        \"nauc_map_at_10_diff1\": 0.36994023414439564,\n        \"nauc_map_at_10_max\": 0.11481118314040571,\n        \"nauc_map_at_10_std\": -0.22855637342757695,\n        \"nauc_map_at_1_diff1\": 0.47423086837159883,\n        \"nauc_map_at_1_max\": 0.10536961568854993,\n        \"nauc_map_at_1_std\": -0.18893895789801746,\n        \"nauc_map_at_20_diff1\": 0.366939272679902,\n        \"nauc_map_at_20_max\": 0.10983679096927623,\n        \"nauc_map_at_20_std\": -0.23374220242287974,\n        \"nauc_map_at_3_diff1\": 0.39334244076238073,\n        \"nauc_map_at_3_max\": 0.11436057658181406,\n        \"nauc_map_at_3_std\": -0.2210910109711889,\n        \"nauc_map_at_5_diff1\": 0.37737593049160195,\n        \"nauc_map_at_5_max\": 0.11892726061718971,\n        \"nauc_map_at_5_std\": -0.22262031548738906,\n        \"nauc_mrr_at_1000_diff1\": 0.37123198474648256,\n        \"nauc_mrr_at_1000_max\": 0.12727530442627744,\n        \"nauc_mrr_at_1000_std\": -0.21112173800821682,\n        \"nauc_mrr_at_100_diff1\": 0.37101870995622205,\n        \"nauc_mrr_at_100_max\": 0.1271614417906171,\n        \"nauc_mrr_at_100_std\": -0.2112405573972666,\n        \"nauc_mrr_at_10_diff1\": 0.3709052997544111,\n        \"nauc_mrr_at_10_max\": 0.12694165718497352,\n        \"nauc_mrr_at_10_std\": -0.21254209422882392,\n        \"nauc_mrr_at_1_diff1\": 0.41584437352589027,\n        \"nauc_mrr_at_1_max\": 0.1328740002999804,\n        \"nauc_mrr_at_1_std\": -0.2130308623550934,\n        \"nauc_mrr_at_20_diff1\": 0.3705755370423673,\n        \"nauc_mrr_at_20_max\": 0.12468510854757699,\n        \"nauc_mrr_at_20_std\": -0.2141889212406071,\n        \"nauc_mrr_at_3_diff1\": 0.38286783683707126,\n        \"nauc_mrr_at_3_max\": 0.13574605621937452,\n        \"nauc_mrr_at_3_std\": -0.21082410124444367,\n        \"nauc_mrr_at_5_diff1\": 0.37683917849074244,\n        \"nauc_mrr_at_5_max\": 0.12783644925485255,\n        \"nauc_mrr_at_5_std\": -0.21141293436461875,\n        \"nauc_ndcg_at_1000_diff1\": 0.3423736953036982,\n        \"nauc_ndcg_at_1000_max\": 0.12924407470721727,\n        \"nauc_ndcg_at_1000_std\": -0.20436857853331591,\n        \"nauc_ndcg_at_100_diff1\": 0.33738996916468716,\n        \"nauc_ndcg_at_100_max\": 0.12644350937190557,\n        \"nauc_ndcg_at_100_std\": -0.20587008962489492,\n        \"nauc_ndcg_at_10_diff1\": 0.3461413361400627,\n        \"nauc_ndcg_at_10_max\": 0.10926953290970053,\n        \"nauc_ndcg_at_10_std\": -0.22924642778609006,\n        \"nauc_ndcg_at_1_diff1\": 0.41584437352589027,\n        \"nauc_ndcg_at_1_max\": 0.1328740002999804,\n        \"nauc_ndcg_at_1_std\": -0.2130308623550934,\n        \"nauc_ndcg_at_20_diff1\": 0.3415544325633606,\n        \"nauc_ndcg_at_20_max\": 0.09671625391922535,\n        \"nauc_ndcg_at_20_std\": -0.2422354888009854,\n        \"nauc_ndcg_at_3_diff1\": 0.367483739659615,\n        \"nauc_ndcg_at_3_max\": 0.1265622124663101,\n        \"nauc_ndcg_at_3_std\": -0.21788403159650543,\n        \"nauc_ndcg_at_5_diff1\": 0.3608782556832026,\n        \"nauc_ndcg_at_5_max\": 0.11871910231919881,\n        \"nauc_ndcg_at_5_std\": -0.21799306222986042,\n        \"nauc_precision_at_1000_diff1\": -0.022334056218972737,\n        \"nauc_precision_at_1000_max\": 0.13940688277251082,\n        \"nauc_precision_at_1000_std\": 0.028726723259119125,\n        \"nauc_precision_at_100_diff1\": 0.04924307028385224,\n        \"nauc_precision_at_100_max\": 0.1443955710683356,\n        \"nauc_precision_at_100_std\": -0.039578863449027626,\n        \"nauc_precision_at_10_diff1\": 0.1645766060046971,\n        \"nauc_precision_at_10_max\": 0.10417358758584026,\n        \"nauc_precision_at_10_std\": -0.19642475114107616,\n        \"nauc_precision_at_1_diff1\": 0.41584437352589027,\n        \"nauc_precision_at_1_max\": 0.1328740002999804,\n        \"nauc_precision_at_1_std\": -0.2130308623550934,\n        \"nauc_precision_at_20_diff1\": 0.1314953529866074,\n        \"nauc_precision_at_20_max\": 0.07263940993521478,\n        \"nauc_precision_at_20_std\": -0.2040657067850367,\n        \"nauc_precision_at_3_diff1\": 0.24539317151793216,\n        \"nauc_precision_at_3_max\": 0.13549592702027766,\n        \"nauc_precision_at_3_std\": -0.2121180653666456,\n        \"nauc_precision_at_5_diff1\": 0.20719525349224496,\n        \"nauc_precision_at_5_max\": 0.12663867643220872,\n        \"nauc_precision_at_5_std\": -0.2043996228265867,\n        \"nauc_recall_at_1000_diff1\": -0.06774630366806214,\n        \"nauc_recall_at_1000_max\": 0.3349907211075982,\n        \"nauc_recall_at_1000_std\": 0.0408621395621626,\n        \"nauc_recall_at_100_diff1\": 0.2052762602690791,\n        \"nauc_recall_at_100_max\": 0.16620711929006302,\n        \"nauc_recall_at_100_std\": -0.09607436340389881,\n        \"nauc_recall_at_10_diff1\": 0.2614919975156877,\n        \"nauc_recall_at_10_max\": 0.07035861293021471,\n        \"nauc_recall_at_10_std\": -0.228483692408934,\n        \"nauc_recall_at_1_diff1\": 0.47423086837159883,\n        \"nauc_recall_at_1_max\": 0.10536961568854993,\n        \"nauc_recall_at_1_std\": -0.18893895789801746,\n        \"nauc_recall_at_20_diff1\": 0.2514547872416605,\n        \"nauc_recall_at_20_max\": 0.030726476984294798,\n        \"nauc_recall_at_20_std\": -0.26509466944101795,\n        \"nauc_recall_at_3_diff1\": 0.329564352854595,\n        \"nauc_recall_at_3_max\": 0.10484425240517557,\n        \"nauc_recall_at_3_std\": -0.20715027169708047,\n        \"nauc_recall_at_5_diff1\": 0.30092812079581244,\n        \"nauc_recall_at_5_max\": 0.09858083422573315,\n        \"nauc_recall_at_5_std\": -0.20002863615923247,\n        \"ndcg_at_1\": 0.27982,\n        \"ndcg_at_10\": 0.32279,\n        \"ndcg_at_100\": 0.39834,\n        \"ndcg_at_1000\": 0.43527,\n        \"ndcg_at_20\": 0.34922,\n        \"ndcg_at_3\": 0.27259,\n        \"ndcg_at_5\": 0.28663,\n        \"precision_at_1\": 0.27982,\n        \"precision_at_10\": 0.0867,\n        \"precision_at_100\": 0.01495,\n        \"precision_at_1000\": 0.00193,\n        \"precision_at_20\": 0.05283,\n        \"precision_at_3\": 0.18196,\n        \"precision_at_5\": 0.13517,\n        \"recall_at_1\": 0.14964,\n        \"recall_at_10\": 0.41042,\n        \"recall_at_100\": 0.72564,\n        \"recall_at_1000\": 0.98191,\n        \"recall_at_20\": 0.49424,\n        \"recall_at_3\": 0.26555,\n        \"recall_at_5\": 0.31906\n      },\n      {\n        \"hf_subset\": \"kor-eng\",\n        \"languages\": [\n          \"kor-Hang\",\n          \"eng-Latn\"\n        ],\n        \"main_score\": 0.2815,\n        \"map_at_1\": 0.14746,\n        \"map_at_10\": 0.2379,\n        \"map_at_100\": 0.25255,\n        \"map_at_1000\": 0.25448,\n        \"map_at_20\": 0.24529,\n        \"map_at_3\": 0.21036,\n        \"map_at_5\": 0.22613,\n        \"mrr_at_1\": 0.21498371335504887,\n        \"mrr_at_10\": 0.27844152318908016,\n        \"mrr_at_100\": 0.2898901926591287,\n        \"mrr_at_1000\": 0.2909255381684909,\n        \"mrr_at_20\": 0.28434342738920654,\n        \"mrr_at_3\": 0.25678610206297503,\n        \"mrr_at_5\": 0.26908251900108576,\n        \"nauc_map_at_1000_diff1\": 0.3969527263143755,\n        \"nauc_map_at_1000_max\": 0.24477892510950194,\n        \"nauc_map_at_1000_std\": -0.17697408503150655,\n        \"nauc_map_at_100_diff1\": 0.39621663673684815,\n        \"nauc_map_at_100_max\": 0.24414822578522066,\n        \"nauc_map_at_100_std\": -0.1774117796874293,\n        \"nauc_map_at_10_diff1\": 0.40329655125674535,\n        \"nauc_map_at_10_max\": 0.24510025952131498,\n        \"nauc_map_at_10_std\": -0.17940346758074718,\n        \"nauc_map_at_1_diff1\": 0.459756702022391,\n        \"nauc_map_at_1_max\": 0.21062599804717708,\n        \"nauc_map_at_1_std\": -0.15042748824219065,\n        \"nauc_map_at_20_diff1\": 0.39763732662346135,\n        \"nauc_map_at_20_max\": 0.24039193755105104,\n        \"nauc_map_at_20_std\": -0.18070885755684768,\n        \"nauc_map_at_3_diff1\": 0.42437784299115283,\n        \"nauc_map_at_3_max\": 0.25598937841695124,\n        \"nauc_map_at_3_std\": -0.1657926913213058,\n        \"nauc_map_at_5_diff1\": 0.41252522347403225,\n        \"nauc_map_at_5_max\": 0.24631329137451874,\n        \"nauc_map_at_5_std\": -0.1804687351340366,\n        \"nauc_mrr_at_1000_diff1\": 0.4159418939093896,\n        \"nauc_mrr_at_1000_max\": 0.2518855932320016,\n        \"nauc_mrr_at_1000_std\": -0.19804067491998278,\n        \"nauc_mrr_at_100_diff1\": 0.4155660820331092,\n        \"nauc_mrr_at_100_max\": 0.252084585579496,\n        \"nauc_mrr_at_100_std\": -0.1977519441655383,\n        \"nauc_mrr_at_10_diff1\": 0.41882598096572715,\n        \"nauc_mrr_at_10_max\": 0.24975534932181165,\n        \"nauc_mrr_at_10_std\": -0.20331611640254818,\n        \"nauc_mrr_at_1_diff1\": 0.43034958740728674,\n        \"nauc_mrr_at_1_max\": 0.24415080072183756,\n        \"nauc_mrr_at_1_std\": -0.1960017531952652,\n        \"nauc_mrr_at_20_diff1\": 0.4155559045006145,\n        \"nauc_mrr_at_20_max\": 0.2487849936163397,\n        \"nauc_mrr_at_20_std\": -0.20071623782706016,\n        \"nauc_mrr_at_3_diff1\": 0.432824544485855,\n        \"nauc_mrr_at_3_max\": 0.258881953077277,\n        \"nauc_mrr_at_3_std\": -0.19994890791385014,\n        \"nauc_mrr_at_5_diff1\": 0.4245282020571004,\n        \"nauc_mrr_at_5_max\": 0.2526657216382904,\n        \"nauc_mrr_at_5_std\": -0.20588903310501974,\n        \"nauc_ndcg_at_1000_diff1\": 0.3881231065699723,\n        \"nauc_ndcg_at_1000_max\": 0.25406410892726006,\n        \"nauc_ndcg_at_1000_std\": -0.17343211138861236,\n        \"nauc_ndcg_at_100_diff1\": 0.36918028335621594,\n        \"nauc_ndcg_at_100_max\": 0.25332895045953363,\n        \"nauc_ndcg_at_100_std\": -0.16633957934868546,\n        \"nauc_ndcg_at_10_diff1\": 0.3932948883164321,\n        \"nauc_ndcg_at_10_max\": 0.23936355850750848,\n        \"nauc_ndcg_at_10_std\": -0.19078998661825733,\n        \"nauc_ndcg_at_1_diff1\": 0.43034958740728674,\n        \"nauc_ndcg_at_1_max\": 0.24415080072183756,\n        \"nauc_ndcg_at_1_std\": -0.1960017531952652,\n        \"nauc_ndcg_at_20_diff1\": 0.37776056898615223,\n        \"nauc_ndcg_at_20_max\": 0.2291496653546807,\n        \"nauc_ndcg_at_20_std\": -0.18960104920000687,\n        \"nauc_ndcg_at_3_diff1\": 0.42242138926841405,\n        \"nauc_ndcg_at_3_max\": 0.25415734830804504,\n        \"nauc_ndcg_at_3_std\": -0.18193855363293832,\n        \"nauc_ndcg_at_5_diff1\": 0.40917918459532354,\n        \"nauc_ndcg_at_5_max\": 0.24332506218050745,\n        \"nauc_ndcg_at_5_std\": -0.1958771002703526,\n        \"nauc_precision_at_1000_diff1\": 0.0014243480474259468,\n        \"nauc_precision_at_1000_max\": 0.16678180277908505,\n        \"nauc_precision_at_1000_std\": 0.027359371138435964,\n        \"nauc_precision_at_100_diff1\": 0.06508721331970349,\n        \"nauc_precision_at_100_max\": 0.22982452992859312,\n        \"nauc_precision_at_100_std\": -0.015544385060792282,\n        \"nauc_precision_at_10_diff1\": 0.2299686644226259,\n        \"nauc_precision_at_10_max\": 0.20508463425090528,\n        \"nauc_precision_at_10_std\": -0.20238340654579362,\n        \"nauc_precision_at_1_diff1\": 0.43034958740728674,\n        \"nauc_precision_at_1_max\": 0.24415080072183756,\n        \"nauc_precision_at_1_std\": -0.1960017531952652,\n        \"nauc_precision_at_20_diff1\": 0.17946826792879048,\n        \"nauc_precision_at_20_max\": 0.1744467450720577,\n        \"nauc_precision_at_20_std\": -0.18591120569922195,\n        \"nauc_precision_at_3_diff1\": 0.32050003491604123,\n        \"nauc_precision_at_3_max\": 0.266713463768876,\n        \"nauc_precision_at_3_std\": -0.19667977570584666,\n        \"nauc_precision_at_5_diff1\": 0.27976985306893926,\n        \"nauc_precision_at_5_max\": 0.2272630441916428,\n        \"nauc_precision_at_5_std\": -0.21950656093547194,\n        \"nauc_recall_at_1000_diff1\": NaN,\n        \"nauc_recall_at_1000_max\": NaN,\n        \"nauc_recall_at_1000_std\": NaN,\n        \"nauc_recall_at_100_diff1\": 0.19485824080100417,\n        \"nauc_recall_at_100_max\": 0.2484326517970991,\n        \"nauc_recall_at_100_std\": -0.07243889229118167,\n        \"nauc_recall_at_10_diff1\": 0.33520147413477436,\n        \"nauc_recall_at_10_max\": 0.20709025445809287,\n        \"nauc_recall_at_10_std\": -0.18525478614342566,\n        \"nauc_recall_at_1_diff1\": 0.459756702022391,\n        \"nauc_recall_at_1_max\": 0.21062599804717708,\n        \"nauc_recall_at_1_std\": -0.15042748824219065,\n        \"nauc_recall_at_20_diff1\": 0.28048438077204607,\n        \"nauc_recall_at_20_max\": 0.1710650121519085,\n        \"nauc_recall_at_20_std\": -0.17771177772845145,\n        \"nauc_recall_at_3_diff1\": 0.4151834934058445,\n        \"nauc_recall_at_3_max\": 0.25469360673270813,\n        \"nauc_recall_at_3_std\": -0.16243993065702017,\n        \"nauc_recall_at_5_diff1\": 0.3793251586166503,\n        \"nauc_recall_at_5_max\": 0.22133888152640455,\n        \"nauc_recall_at_5_std\": -0.20005187592158255,\n        \"ndcg_at_1\": 0.21498,\n        \"ndcg_at_10\": 0.2815,\n        \"ndcg_at_100\": 0.35338,\n        \"ndcg_at_1000\": 0.3971,\n        \"ndcg_at_20\": 0.30508,\n        \"ndcg_at_3\": 0.23709,\n        \"ndcg_at_5\": 0.25698,\n        \"precision_at_1\": 0.21498,\n        \"precision_at_10\": 0.06091,\n        \"precision_at_100\": 0.01176,\n        \"precision_at_1000\": 0.00167,\n        \"precision_at_20\": 0.03721,\n        \"precision_at_3\": 0.13572,\n        \"precision_at_5\": 0.09935,\n        \"recall_at_1\": 0.14746,\n        \"recall_at_10\": 0.36994,\n        \"recall_at_100\": 0.68087,\n        \"recall_at_1000\": 1.0,\n        \"recall_at_20\": 0.45279,\n        \"recall_at_3\": 0.25291,\n        \"recall_at_5\": 0.30226\n      }\n    ]\n  },\n  \"task_name\": \"XPQARetrieval\"\n}"
  },
  {
    "path": "eval/results/upskyy/bge-m3-korean/upskyy__bge-m3-korean/no_revision_available/model_meta.json",
    "content": "{\"name\": \"upskyy/bge-m3-korean\", \"revision\": \"no_revision_available\", \"release_date\": null, \"languages\": [], \"n_parameters\": null, \"memory_usage\": null, \"max_tokens\": null, \"embed_dim\": null, \"license\": null, \"open_weights\": null, \"public_training_data\": null, \"public_training_code\": null, \"framework\": [\"Sentence Transformers\"], \"reference\": null, \"similarity_fn_name\": null, \"use_instructions\": null, \"zero_shot_benchmarks\": null, \"loader\": null}"
  }
]