Model Compatibility Report¶
Generated on: 2026-11-16 02:11:07 UTC
API Base: https://aqueduct.ai.datalab.tuwien.ac.at/v1
Summary¶
- Test Categories: 21
- Tests Run: 58
- Passed: 52 (89.7%)
- Failed: 2 (3.4%)
- Skipped: 4 (6.9%)
Compatibility Matrix¶
Legend: ✅ = Passed, ❌ = Failed, - = Skipped
| Test | deepseek-v4-vision-exp-284b | glm-5.3-744b-experimental | qwen-3.8-27b | qwen3-embedding-4b | speech_de | speech_en | transcription |
|---|---|---|---|---|---|---|---|
| tests/test_model_compatibility.py::test_chat_completion_cached_input_tokens | ✅ | ✅ | ❌ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_image_input_b64 | ✅ | - | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_image_input_url | ✅ | - | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_reasoning_tokens | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_simple | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_simple_streaming | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_structured_output_response_format | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_structured_output_simple | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_tool_calling | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_completion_simple | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_embedding | - | - | - | ✅ | - | - | - |
| tests/test_model_compatibility.py::test_files_and_batches_api | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_image_input_b64 | ✅ | - | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_image_input_url | ✅ | - | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_simple | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_simple_streaming | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_structured_output_response_format | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_structured_output_simple | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_tool_calling | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_speech_simple | - | - | - | - | ✅ | ✅ | - |
| tests/test_model_compatibility.py::test_transcription_simple | - | - | - | - | - | - | ❌ |