Model Compatibility Report¶
Generated on: 2026-08-04 01:07:28 UTC
API Base: https://aqueduct.ai.datalab.tuwien.ac.at/v1
Summary¶
- Test Categories: 19
- Tests Run: 36
- Passed: 31 (86.1%)
- Failed: 5 (13.9%)
- Skipped: 0 (0.0%)
Compatibility Matrix¶
Legend: ✅ = Passed, ❌ = Failed, - = Skipped
| Test | qwen-3.5-397b | qwen-3.6-35b | qwen3-embedding-4b | speech_de | speech_en | transcription |
|---|---|---|---|---|---|---|
| tests/test_model_compatibility.py::test_chat_completion_image_input_b64 | ❌ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_image_input_url | ❌ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_simple | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_simple_streaming | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_structured_output_response_format | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_structured_output_simple | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_tool_calling | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_completion_simple | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_embedding | - | - | ✅ | - | - | - |
| tests/test_model_compatibility.py::test_files_and_batches_api | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_image_input_b64 | ❌ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_image_input_url | ❌ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_simple | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_simple_streaming | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_structured_output_response_format | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_structured_output_simple | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_tool_calling | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_speech_simple | - | - | - | ✅ | ✅ | - |
| tests/test_model_compatibility.py::test_transcription_simple | - | - | - | - | - | ❌ |