test: add integration tests for test_results schema validation

[mashraf-222]

Summary

• Adds 5 comprehensive integration tests for the Java Comparator test_results schema
• Validates the schema fix from PR fix: update Java Comparator to read from test_results table #1272
• Ensures the Comparator correctly reads from test_results table

Background

PR #1272 updated the Java Comparator to read from the test_results table (used by instrumentation) instead of the invocations table. This PR adds tests to validate that change and prevent future regressions.

New Tests

TestTestResultsTableSchema class (5 tests):

1. test_comparator_reads_test_results_table_identical

   • Creates test_results tables with identical data
   • Validates Comparator returns equivalent=True, diffs=[]
   • Tests basic schema integration

2. test_comparator_reads_test_results_table_different_values

   • Tests detection of different return values
   • Validates Comparator returns equivalent=False with 1 RETURN_VALUE diff
   • Ensures correctness detection works

3. test_comparator_handles_multiple_loop_iterations

   • Tests 3 loops × 2 iterations = 6 results
   • Validates loop_index and iteration_id handling
   • Ensures unique call_id generation works correctly

4. test_comparator_iteration_id_parsing

   • Tests various iteration_id formats: "1_0", "2_5", etc.
   • Validates parseIterationId() helper function
   • Different loop indices create unique call_ids

5. test_comparator_missing_result_in_candidate

   • Original has 2 results, candidate has only 1
   • Validates missing invocation detection
   • Ensures Comparator detects incomplete results

Test Features

✅ Real Schema - Creates actual test_results table with instrumentation schema
✅ SQL Integration - Tests full path through Java Comparator.jar
✅ Column Mapping - Validates iteration_id → call_id, return_value → result_json
✅ Graceful Skipping - Uses @requires_java decorator to skip when Java unavailable
✅ Documentation - Shows expected schema for future developers
✅ Regression Prevention - Catches if table name changes back to invocations

Schema Validated

CREATE TABLE test_results (
    test_module_path TEXT,
    test_class_name TEXT,
    test_function_name TEXT,
    function_getting_tested TEXT,
    loop_index INTEGER,
    iteration_id TEXT,
    runtime INTEGER,
    return_value TEXT,
    verification_type TEXT
)

Testing

✅ All 18 existing comparator tests still pass
✅ 5 new tests skip gracefully when Java not installed
✅ Total: 18 passed, 5 skipped (without Java)
✅ All tests pass when Java is available

Why These Tests Are Important

1. Validates PR fix: update Java Comparator to read from test_results table #1272 - Ensures the Comparator schema fix works correctly
2. Documents Schema - Shows what table/columns the Comparator expects
3. Prevents Regressions - Catches if someone changes back to invocations table
4. Integration Coverage - Tests actual Comparator.jar execution, not just Python code
5. Future-Proofs - Helps maintain schema consistency as codebase evolves

🤖 Generated with Claude Code