Initial marker-api benchmark setup: Containerfile, app.py, convert_both.py, compare_conversions.py

2026-06-05 13:26:25 +02:00
commit 460fc0003b
33 changed files with 58290 additions and 0 deletions
@@ -0,0 +1,58 @@
+# Test Report — marker-api Endpoint Tests
+
+**Date:** 2026-06-04 10:57:07
+**API Base:** N/A (offline validation)
+**Test files:** /home/oval/Projects/marker-api/test_files/enisa (5 file(s))
+
+## Summary
+
+| Result | Count |
+|--------|-------|
+| ✅ Passed | 5 |
+| ❌ Failed | 0 |
+| ⏭️ Skipped | 10 |
+| **Total** | **15** |
+| **Pass Rate** | **33.3%** |
+
+## Test Details
+
+| Test | Result | Time | Notes |
+|------|--------|------|-------|
+
+### Application Tests
+| app.py syntax valid | ✅ PASS | 0.002s | |
+| use_llm/llm_service params present in app.py | ✅ PASS | 0.000s | |
+| marker-convert.ps1 has all new parameters | ✅ PASS | 0.000s | |
+| README.md documents all endpoints | ✅ PASS | 0.000s | |
+| ENISA test files available | ✅ PASS | 0.019s | |
+
+### Endpoint Tests (HTTP)
+| GET /health | ⏭️ SKIP | - | API not running |
+| GET / | ⏭️ SKIP | - | API not running |
+| POST /marker (multipart) | ⏭️ SKIP | - | API not running |
+| POST /marker (JSON) | ⏭️ SKIP | - | API not running |
+| POST /marker with use_llm | ⏭️ SKIP | - | API not running |
+| POST /marker with page_range | ⏭️ SKIP | - | API not running |
+| POST /marker missing file | ⏭️ SKIP | - | API not running |
+| POST /v1/conversions | ⏭️ SKIP | - | API not running |
+| POST /v1/files/convert (multipart) | ⏭️ SKIP | - | API not running |
+| POST /v1/files/convert (JSON) | ⏭️ SKIP | - | API not running |
+
+## Environment
+- Python: 3.14.5
+- Platform: linux
+- marker: ❌ not installed (Pillow build failure on this platform)
+
+## Test Files
+- enisa-international-strategy-2026.pdf (39.7 KB)
+- enisa-nis360-2026.pdf (3983.3 KB)
+- enisa-stakeholder-strategy-2026-2028.pdf (35.3 KB)
+- nis-investments-2025.pdf (3118.9 KB)
+- nis2-technical-implementation-guidance.pdf (4699.7 KB)
+
+## Notes
+- HTTP endpoint tests require a running marker-api instance.
+- API-level tests were skipped (no API running).
+- Offline validation tests (syntax, parameter availability, docs) ran regardless.
+- The marker library could not be installed due to Pillow build failure in this sandbox.
+- For live endpoint testing, start the API with: `python app.py` (requires marker-pdf[full] + flask).