# Model Compatibility Report

Generated on: 2026-11-16 02:11:07 UTC

API Base: [https://aqueduct.ai.datalab.tuwien.ac.at/v1](https://aqueduct.ai.datalab.tuwien.ac.at/v1)

## Summary

- **Test Categories**: 21
- **Tests Run**: 58
- **Passed**: 52 (89.7%)
- **Failed**: 2 (3.4%)
- **Skipped**: 4 (6.9%)

## Compatibility Matrix

Legend: ✅ = Passed, ❌ = Failed, - = Skipped

| Test | deepseek-v4-vision-exp-284b | glm-5.3-744b-experimental | qwen-3.8-27b | qwen3-embedding-4b | speech_de | speech_en | transcription |
| --- | --- | --- | --- | --- | --- | --- | --- |
| tests/test_model_compatibility.py::test_chat_completion_cached_input_tokens | ✅ | ✅ | ❌ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_image_input_b64 | ✅ | - | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_image_input_url | ✅ | - | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_reasoning_tokens | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_simple | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_simple_streaming | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_structured_output_response_format | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_structured_output_simple | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_chat_completion_tool_calling | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_completion_simple | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_embedding | - | - | - | ✅ | - | - | - |
| tests/test_model_compatibility.py::test_files_and_batches_api | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_image_input_b64 | ✅ | - | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_image_input_url | ✅ | - | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_simple | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_simple_streaming | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_structured_output_response_format | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_structured_output_simple | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_responses_api_tool_calling | ✅ | ✅ | ✅ | - | - | - | - |
| tests/test_model_compatibility.py::test_speech_simple | - | - | - | - | ✅ | ✅ | - |
| tests/test_model_compatibility.py::test_transcription_simple | - | - | - | - | - | - | ❌ |