Zum Inhalt

Model Compatibility Report

Generated on: 2026-11-16 02:11:07 UTC

API Base: https://aqueduct.ai.datalab.tuwien.ac.at/v1

Summary

  • Test Categories: 21
  • Tests Run: 58
  • Passed: 52 (89.7%)
  • Failed: 2 (3.4%)
  • Skipped: 4 (6.9%)

Compatibility Matrix

Legend: ✅ = Passed, ❌ = Failed, - = Skipped

Test deepseek-v4-vision-exp-284b glm-5.3-744b-experimental qwen-3.8-27b qwen3-embedding-4b speech_de speech_en transcription
tests/test_model_compatibility.py::test_chat_completion_cached_input_tokens ✅ ✅ ❌ - - - -
tests/test_model_compatibility.py::test_chat_completion_image_input_b64 ✅ - ✅ - - - -
tests/test_model_compatibility.py::test_chat_completion_image_input_url ✅ - ✅ - - - -
tests/test_model_compatibility.py::test_chat_completion_reasoning_tokens ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_chat_completion_simple ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_chat_completion_simple_streaming ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_chat_completion_structured_output_response_format ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_chat_completion_structured_output_simple ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_chat_completion_tool_calling ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_completion_simple ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_embedding - - - ✅ - - -
tests/test_model_compatibility.py::test_files_and_batches_api ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_responses_api_image_input_b64 ✅ - ✅ - - - -
tests/test_model_compatibility.py::test_responses_api_image_input_url ✅ - ✅ - - - -
tests/test_model_compatibility.py::test_responses_api_simple ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_responses_api_simple_streaming ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_responses_api_structured_output_response_format ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_responses_api_structured_output_simple ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_responses_api_tool_calling ✅ ✅ ✅ - - - -
tests/test_model_compatibility.py::test_speech_simple - - - - ✅ ✅ -
tests/test_model_compatibility.py::test_transcription_simple - - - - - - ❌